2024-04-25T22:25:18.046 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T22:25:18.046 DEBUG:teuthology.run:Teuthology command: teuthology --name teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi --verbose --archive /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058 --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} --owner scheduled_teuthology@teuthology -- /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058/orig.config.yaml 2024-04-25T22:25:18.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T22:25:18.157 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058 branch: squid description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7674058' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: b22e2ebdeb24376882b7bda2a7329c8cccc2276a owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 9595 sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 sleep_before_teardown: 0 subset: 3/4 suite: powercycle suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: b22e2ebdeb24376882b7bda2a7329c8cccc2276a targets: smithi057.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDsF5KKvx9Zp3hhI2gvE4mkhISy2QpxBdhDYnTa2sXX0CiiOwB8bw4Wx+OS0rcmVdH9g794qd/rrVPKW66Bxs2I= smithi122.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN2rONxR4WSf376EVafTW6Hzo8ypuxs5i5Gg4/4zbW33QRTucGmzx5/zvfd3nTzrt2cE3uGCl5Tbidf2xUVUNi4= smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKUp2AtTkGIyOqNBmH3t7KlgeYlUhtsH0ctPCzaO14K18wRWZx9/xz8ep5oPymRmpnIQ6Z45SD20VFrL+4ooORg= smithi188.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIyw+IKuZBJWO8ssnWXm6Xrv4qpiXf5DDCnU7gOt3G6GDXTgogTRwWzT387JEZ7MmLnSUIY9CQm5v/xKDxrr41Q= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_21:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T22:25:18.158 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa; will attempt to use it 2024-04-25T22:25:18.158 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa/tasks 2024-04-25T22:25:18.159 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T22:25:18.160 INFO:teuthology.task.internal:Checking packages... 2024-04-25T22:25:18.184 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd2c45d977142e024a59b68a8f1dce8f0b9840551' 2024-04-25T22:25:18.184 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T22:25:18.184 INFO:teuthology.packaging:ref: None 2024-04-25T22:25:18.184 INFO:teuthology.packaging:tag: None 2024-04-25T22:25:18.184 INFO:teuthology.packaging:branch: squid 2024-04-25T22:25:18.184 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:25:18.184 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-04-25T22:25:18.493 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2447-gb22e2ebd-1jammy 2024-04-25T22:25:18.494 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T22:25:18.501 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T22:25:18.501 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T22:25:18.560 INFO:teuthology.task.internal:Saving configuration 2024-04-25T22:25:18.576 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T22:25:18.598 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T22:25:18.623 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 22:19:38.985327', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPs7l8pT6tAHeR90yzPXIxOwAq8WeEdps2hKA0Fozf5L'} 2024-04-25T22:25:18.645 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 22:19:38.982835', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPmMQX/9VQ4HFLtlwNQUGQWY3i0Ag74GIxoIDd3b/cBv'} 2024-04-25T22:25:18.668 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 22:19:38.984110', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEMa3jvroCqwPlCD7XcDA1HyCqldUI8z0KbGZteRmJEr'} 2024-04-25T22:25:18.692 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 22:19:38.981141', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF1eg8ugejsih5e6vvrkCK+9fEww2PC0mkmgEcrzmuIf'} 2024-04-25T22:25:18.692 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T22:25:18.699 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-25T22:25:18.699 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['osd.0'] 2024-04-25T22:25:18.699 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['osd.1'] 2024-04-25T22:25:18.699 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['osd.2'] 2024-04-25T22:25:18.699 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T22:25:18.872 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7894aad280>, signals=[15]) 2024-04-25T22:25:18.872 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T22:25:18.878 INFO:teuthology.task.internal:Opening connections... 2024-04-25T22:25:18.879 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T22:25:18.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:25:18.976 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi122.front.sepia.ceph.com 2024-04-25T22:25:18.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:25:19.055 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2024-04-25T22:25:19.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:25:19.136 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi188.front.sepia.ceph.com 2024-04-25T22:25:19.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:25:19.218 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T22:25:19.225 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2024-04-25T22:25:19.231 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2024-04-25T22:25:19.231 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2024-04-25T22:25:19.278 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T22:25:19.278 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Ubuntu" 2024-04-25T22:25:19.278 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="22.04" 2024-04-25T22:25:19.279 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T22:25:19.279 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_CODENAME=jammy 2024-04-25T22:25:19.279 INFO:teuthology.orchestra.run.smithi057.stdout:ID=ubuntu 2024-04-25T22:25:19.279 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE=debian 2024-04-25T22:25:19.279 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T22:25:19.279 INFO:teuthology.orchestra.run.smithi057.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T22:25:19.279 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T22:25:19.279 INFO:teuthology.orchestra.run.smithi057.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T22:25:19.279 INFO:teuthology.orchestra.run.smithi057.stdout:UBUNTU_CODENAME=jammy 2024-04-25T22:25:19.280 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2024-04-25T22:25:19.298 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2024-04-25T22:25:19.304 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2024-04-25T22:25:19.305 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-04-25T22:25:19.350 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T22:25:19.351 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="Ubuntu" 2024-04-25T22:25:19.351 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="22.04" 2024-04-25T22:25:19.351 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T22:25:19.351 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_CODENAME=jammy 2024-04-25T22:25:19.351 INFO:teuthology.orchestra.run.smithi122.stdout:ID=ubuntu 2024-04-25T22:25:19.351 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE=debian 2024-04-25T22:25:19.351 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T22:25:19.351 INFO:teuthology.orchestra.run.smithi122.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T22:25:19.351 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T22:25:19.351 INFO:teuthology.orchestra.run.smithi122.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T22:25:19.351 INFO:teuthology.orchestra.run.smithi122.stdout:UBUNTU_CODENAME=jammy 2024-04-25T22:25:19.351 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-04-25T22:25:19.373 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-04-25T22:25:19.379 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-04-25T22:25:19.379 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-04-25T22:25:19.425 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T22:25:19.425 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Ubuntu" 2024-04-25T22:25:19.425 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="22.04" 2024-04-25T22:25:19.425 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T22:25:19.425 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_CODENAME=jammy 2024-04-25T22:25:19.425 INFO:teuthology.orchestra.run.smithi148.stdout:ID=ubuntu 2024-04-25T22:25:19.425 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE=debian 2024-04-25T22:25:19.426 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T22:25:19.426 INFO:teuthology.orchestra.run.smithi148.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T22:25:19.426 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T22:25:19.426 INFO:teuthology.orchestra.run.smithi148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T22:25:19.426 INFO:teuthology.orchestra.run.smithi148.stdout:UBUNTU_CODENAME=jammy 2024-04-25T22:25:19.426 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-04-25T22:25:19.448 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2024-04-25T22:25:19.454 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2024-04-25T22:25:19.454 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2024-04-25T22:25:19.500 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T22:25:19.500 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Ubuntu" 2024-04-25T22:25:19.500 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="22.04" 2024-04-25T22:25:19.500 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T22:25:19.500 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_CODENAME=jammy 2024-04-25T22:25:19.500 INFO:teuthology.orchestra.run.smithi188.stdout:ID=ubuntu 2024-04-25T22:25:19.500 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE=debian 2024-04-25T22:25:19.500 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T22:25:19.500 INFO:teuthology.orchestra.run.smithi188.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T22:25:19.500 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T22:25:19.500 INFO:teuthology.orchestra.run.smithi188.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T22:25:19.501 INFO:teuthology.orchestra.run.smithi188.stdout:UBUNTU_CODENAME=jammy 2024-04-25T22:25:19.501 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2024-04-25T22:25:19.523 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T22:25:19.539 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T22:25:19.625 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T22:25:19.625 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2024-04-25T22:25:19.628 DEBUG:teuthology.orchestra.run.smithi122:> test '!' -e /home/ubuntu/cephtest 2024-04-25T22:25:19.630 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2024-04-25T22:25:19.633 DEBUG:teuthology.orchestra.run.smithi188:> test '!' -e /home/ubuntu/cephtest 2024-04-25T22:25:19.637 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T22:25:19.649 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T22:25:19.650 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2024-04-25T22:25:19.675 DEBUG:teuthology.orchestra.run.smithi122:> test -z $(ls -A /var/lib/ceph) 2024-04-25T22:25:19.678 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2024-04-25T22:25:19.680 DEBUG:teuthology.orchestra.run.smithi188:> test -z $(ls -A /var/lib/ceph) 2024-04-25T22:25:19.704 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T22:25:19.810 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T22:25:19.824 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-25T22:25:19.825 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-25T22:25:19.825 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T22:25:19.825 DEBUG:teuthology.orchestra.run.smithi122:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T22:25:19.826 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T22:25:19.826 DEBUG:teuthology.orchestra.run.smithi188:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T22:25:19.830 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:25:19.831 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-04-25T22:25:19.832 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:25:19.832 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:25:19.832 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:25:19.833 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2024-04-25T22:25:19.833 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2024-04-25T22:25:19.834 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-04-25T22:25:19.877 INFO:teuthology.orchestra.run.smithi148.stdout:5.15.0-56-generic 2024-04-25T22:25:19.877 INFO:teuthology.task.kernel:Running kernel on smithi148: 5.15.0-56-generic 2024-04-25T22:25:19.877 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-get clean 2024-04-25T22:25:19.879 INFO:teuthology.orchestra.run.smithi122.stdout:5.15.0-56-generic 2024-04-25T22:25:19.879 INFO:teuthology.task.kernel:Running kernel on smithi122: 5.15.0-56-generic 2024-04-25T22:25:19.879 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get clean 2024-04-25T22:25:19.881 INFO:teuthology.orchestra.run.smithi188.stdout:5.15.0-56-generic 2024-04-25T22:25:19.881 INFO:teuthology.task.kernel:Running kernel on smithi188: 5.15.0-56-generic 2024-04-25T22:25:19.881 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-get clean 2024-04-25T22:25:19.882 INFO:teuthology.orchestra.run.smithi057.stdout:5.15.0-56-generic 2024-04-25T22:25:19.883 INFO:teuthology.task.kernel:Running kernel on smithi057: 5.15.0-56-generic 2024-04-25T22:25:19.883 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get clean 2024-04-25T22:25:20.006 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get update 2024-04-25T22:25:20.008 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-get update 2024-04-25T22:25:20.015 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get update 2024-04-25T22:25:20.016 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-get update 2024-04-25T22:25:20.156 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:25:20.163 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:25:20.181 INFO:teuthology.orchestra.run.smithi122.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T22:25:20.186 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T22:25:20.186 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T22:25:20.187 INFO:teuthology.orchestra.run.smithi148.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T22:25:20.264 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T22:25:20.264 INFO:teuthology.orchestra.run.smithi148.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T22:25:20.396 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T22:25:20.401 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-25T22:25:20.406 INFO:teuthology.orchestra.run.smithi122.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T22:25:20.483 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T22:25:20.494 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T22:25:20.508 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T22:25:20.534 INFO:teuthology.orchestra.run.smithi122.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T22:25:20.545 INFO:teuthology.orchestra.run.smithi122.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T22:25:20.549 INFO:teuthology.orchestra.run.smithi148.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T22:25:20.551 INFO:teuthology.orchestra.run.smithi122.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T22:25:20.552 INFO:teuthology.orchestra.run.smithi122.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T22:25:20.560 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T22:25:20.561 INFO:teuthology.orchestra.run.smithi148.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T22:25:20.575 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T22:25:20.588 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T22:25:20.589 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T22:25:20.591 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T22:25:20.604 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T22:25:20.605 INFO:teuthology.orchestra.run.smithi122.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T22:25:20.611 INFO:teuthology.orchestra.run.smithi148.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T22:25:20.612 INFO:teuthology.orchestra.run.smithi122.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T22:25:20.613 INFO:teuthology.orchestra.run.smithi122.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T22:25:20.614 INFO:teuthology.orchestra.run.smithi148.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T22:25:20.622 INFO:teuthology.orchestra.run.smithi148.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T22:25:20.623 INFO:teuthology.orchestra.run.smithi148.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-25T22:25:20.645 INFO:teuthology.orchestra.run.smithi057.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-25T22:25:20.647 INFO:teuthology.orchestra.run.smithi148.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T22:25:20.649 INFO:teuthology.orchestra.run.smithi122.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T22:25:20.663 INFO:teuthology.orchestra.run.smithi057.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T22:25:20.709 INFO:teuthology.orchestra.run.smithi057.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T22:25:20.710 INFO:teuthology.orchestra.run.smithi057.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T22:25:20.712 INFO:teuthology.orchestra.run.smithi057.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T22:25:20.713 INFO:teuthology.orchestra.run.smithi057.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T22:25:20.713 INFO:teuthology.orchestra.run.smithi057.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T22:25:20.718 INFO:teuthology.orchestra.run.smithi148.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T22:25:20.719 INFO:teuthology.orchestra.run.smithi057.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T22:25:20.722 INFO:teuthology.orchestra.run.smithi148.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T22:25:20.722 INFO:teuthology.orchestra.run.smithi122.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T22:25:20.723 INFO:teuthology.orchestra.run.smithi148.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T22:25:20.724 INFO:teuthology.orchestra.run.smithi148.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T22:25:20.724 INFO:teuthology.orchestra.run.smithi148.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T22:25:20.732 INFO:teuthology.orchestra.run.smithi122.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T22:25:20.733 INFO:teuthology.orchestra.run.smithi122.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T22:25:20.733 INFO:teuthology.orchestra.run.smithi122.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T22:25:20.734 INFO:teuthology.orchestra.run.smithi122.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T22:25:20.734 INFO:teuthology.orchestra.run.smithi122.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T22:25:20.735 INFO:teuthology.orchestra.run.smithi148.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T22:25:20.735 INFO:teuthology.orchestra.run.smithi148.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T22:25:20.736 INFO:teuthology.orchestra.run.smithi148.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T22:25:20.737 INFO:teuthology.orchestra.run.smithi148.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T22:25:20.744 INFO:teuthology.orchestra.run.smithi148.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T22:25:20.766 INFO:teuthology.orchestra.run.smithi057.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T22:25:20.766 INFO:teuthology.orchestra.run.smithi057.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T22:25:20.767 INFO:teuthology.orchestra.run.smithi057.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T22:25:20.767 INFO:teuthology.orchestra.run.smithi057.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T22:25:20.768 INFO:teuthology.orchestra.run.smithi148.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T22:25:20.768 INFO:teuthology.orchestra.run.smithi057.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T22:25:20.768 INFO:teuthology.orchestra.run.smithi148.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T22:25:20.769 INFO:teuthology.orchestra.run.smithi057.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T22:25:20.769 INFO:teuthology.orchestra.run.smithi057.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T22:25:20.769 INFO:teuthology.orchestra.run.smithi057.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T22:25:20.769 INFO:teuthology.orchestra.run.smithi148.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T22:25:20.770 INFO:teuthology.orchestra.run.smithi148.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T22:25:20.773 INFO:teuthology.orchestra.run.smithi057.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T22:25:20.773 INFO:teuthology.orchestra.run.smithi057.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-25T22:25:20.790 INFO:teuthology.orchestra.run.smithi057.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T22:25:20.801 INFO:teuthology.orchestra.run.smithi057.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T22:25:20.805 INFO:teuthology.orchestra.run.smithi057.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T22:25:20.806 INFO:teuthology.orchestra.run.smithi057.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T22:25:20.806 INFO:teuthology.orchestra.run.smithi057.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T22:25:20.807 INFO:teuthology.orchestra.run.smithi057.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T22:25:20.810 INFO:teuthology.orchestra.run.smithi057.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T22:25:20.810 INFO:teuthology.orchestra.run.smithi057.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T22:25:20.812 INFO:teuthology.orchestra.run.smithi057.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T22:25:20.828 INFO:teuthology.orchestra.run.smithi057.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T22:25:20.829 INFO:teuthology.orchestra.run.smithi057.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T22:25:20.830 INFO:teuthology.orchestra.run.smithi057.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T22:25:20.830 INFO:teuthology.orchestra.run.smithi057.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T22:25:20.830 INFO:teuthology.orchestra.run.smithi057.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T22:25:20.831 INFO:teuthology.orchestra.run.smithi057.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T22:25:20.855 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:18 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:25:20.870 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:25:20.889 INFO:teuthology.orchestra.run.smithi148.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T22:25:20.903 INFO:teuthology.orchestra.run.smithi188.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T22:25:20.923 INFO:teuthology.orchestra.run.smithi188.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T22:25:20.941 INFO:teuthology.orchestra.run.smithi122.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T22:25:21.323 INFO:teuthology.orchestra.run.smithi188.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T22:25:21.323 INFO:teuthology.orchestra.run.smithi188.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T22:25:21.360 INFO:teuthology.orchestra.run.smithi122.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T22:25:21.402 INFO:teuthology.orchestra.run.smithi148.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T22:25:21.506 INFO:teuthology.orchestra.run.smithi122.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T22:25:21.690 INFO:teuthology.orchestra.run.smithi188.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-25T22:25:22.133 INFO:teuthology.orchestra.run.smithi188.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T22:25:22.156 INFO:teuthology.orchestra.run.smithi188.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T22:25:22.211 INFO:teuthology.orchestra.run.smithi188.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T22:25:22.244 INFO:teuthology.orchestra.run.smithi188.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T22:25:22.244 INFO:teuthology.orchestra.run.smithi188.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T22:25:22.250 INFO:teuthology.orchestra.run.smithi188.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T22:25:22.372 INFO:teuthology.orchestra.run.smithi188.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T22:25:22.387 INFO:teuthology.orchestra.run.smithi188.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T22:25:22.387 INFO:teuthology.orchestra.run.smithi188.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T22:25:22.424 INFO:teuthology.orchestra.run.smithi188.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T22:25:23.234 INFO:teuthology.orchestra.run.smithi188.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T22:25:23.341 INFO:teuthology.orchestra.run.smithi148.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T22:25:23.645 INFO:teuthology.orchestra.run.smithi188.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T22:25:23.651 INFO:teuthology.orchestra.run.smithi188.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T22:25:23.652 INFO:teuthology.orchestra.run.smithi188.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T22:25:23.665 INFO:teuthology.orchestra.run.smithi188.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T22:25:23.669 INFO:teuthology.orchestra.run.smithi188.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T22:25:25.073 INFO:teuthology.orchestra.run.smithi148.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T22:25:25.362 INFO:teuthology.orchestra.run.smithi122.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-25T22:25:26.538 INFO:teuthology.orchestra.run.smithi148.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T22:25:26.584 INFO:teuthology.orchestra.run.smithi148.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T22:25:26.652 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 13.2 MB in 2s (6,657 kB/s) 2024-04-25T22:25:26.737 INFO:teuthology.orchestra.run.smithi148.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T22:25:26.820 INFO:teuthology.orchestra.run.smithi122.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T22:25:27.142 INFO:teuthology.orchestra.run.smithi188.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T22:25:27.402 INFO:teuthology.orchestra.run.smithi122.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T22:25:27.422 INFO:teuthology.orchestra.run.smithi122.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T22:25:27.957 INFO:teuthology.orchestra.run.smithi188.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T22:25:27.980 INFO:teuthology.orchestra.run.smithi188.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T22:25:28.092 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-25T22:25:28.109 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T22:25:28.170 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-25T22:25:28.371 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2024-04-25T22:25:28.371 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2024-04-25T22:25:28.554 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:25:28.554 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:25:28.554 INFO:teuthology.orchestra.run.smithi057.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:25:28.555 INFO:teuthology.orchestra.run.smithi057.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:25:28.555 INFO:teuthology.orchestra.run.smithi057.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T22:25:28.555 INFO:teuthology.orchestra.run.smithi057.stdout: python2.7-minimal 2024-04-25T22:25:28.555 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:25:28.556 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2024-04-25T22:25:28.556 INFO:teuthology.orchestra.run.smithi057.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T22:25:28.557 INFO:teuthology.orchestra.run.smithi057.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T22:25:28.557 INFO:teuthology.orchestra.run.smithi057.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T22:25:28.558 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2024-04-25T22:25:28.558 INFO:teuthology.orchestra.run.smithi057.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T22:25:28.558 INFO:teuthology.orchestra.run.smithi057.stdout:Recommended packages: 2024-04-25T22:25:28.558 INFO:teuthology.orchestra.run.smithi057.stdout: thermald 2024-04-25T22:25:28.607 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2024-04-25T22:25:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T22:25:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T22:25:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T22:25:28.609 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages will be upgraded: 2024-04-25T22:25:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T22:25:28.675 INFO:teuthology.orchestra.run.smithi057.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T22:25:28.675 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 113 MB of archives. 2024-04-25T22:25:28.676 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T22:25:28.676 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T22:25:29.166 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T22:25:29.285 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T22:25:30.238 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T22:25:30.238 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T22:25:30.238 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T22:25:30.505 INFO:teuthology.orchestra.run.smithi122.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T22:25:30.564 INFO:teuthology.orchestra.run.smithi122.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T22:25:30.575 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T22:25:30.607 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T22:25:31.012 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 113 MB in 2s (57.0 MB/s) 2024-04-25T22:25:31.179 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T22:25:31.347 INFO:teuthology.orchestra.run.smithi122.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T22:25:32.023 INFO:teuthology.orchestra.run.smithi122.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T22:25:32.709 INFO:teuthology.orchestra.run.smithi122.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-25T22:25:32.868 INFO:teuthology.orchestra.run.smithi122.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T22:25:32.884 INFO:teuthology.orchestra.run.smithi122.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T22:25:32.885 INFO:teuthology.orchestra.run.smithi122.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T22:25:32.887 INFO:teuthology.orchestra.run.smithi122.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T22:25:32.888 INFO:teuthology.orchestra.run.smithi122.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T22:25:32.889 INFO:teuthology.orchestra.run.smithi122.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T22:25:32.889 INFO:teuthology.orchestra.run.smithi122.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T22:25:32.892 INFO:teuthology.orchestra.run.smithi122.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T22:25:32.896 INFO:teuthology.orchestra.run.smithi122.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T22:25:33.162 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T22:25:33.166 INFO:teuthology.orchestra.run.smithi148.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T22:25:33.167 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:25:33.267 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:25:33.648 INFO:teuthology.orchestra.run.smithi122.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T22:25:33.709 INFO:teuthology.orchestra.run.smithi188.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T22:25:33.731 INFO:teuthology.orchestra.run.smithi122.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T22:25:33.856 INFO:teuthology.orchestra.run.smithi122.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T22:25:33.895 INFO:teuthology.orchestra.run.smithi188.stdout:Ign:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages 2024-04-25T22:25:33.903 INFO:teuthology.orchestra.run.smithi122.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T22:25:33.945 INFO:teuthology.orchestra.run.smithi122.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T22:25:34.294 INFO:teuthology.orchestra.run.smithi148.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T22:25:34.294 INFO:teuthology.orchestra.run.smithi148.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T22:25:34.403 INFO:teuthology.orchestra.run.smithi188.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T22:25:34.913 INFO:teuthology.orchestra.run.smithi188.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T22:25:34.997 INFO:teuthology.orchestra.run.smithi188.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-25T22:25:35.334 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T22:25:35.356 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:25:35.478 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:25:35.887 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T22:25:35.908 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:25:35.937 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:25:36.130 INFO:teuthology.orchestra.run.smithi188.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T22:25:36.548 INFO:teuthology.orchestra.run.smithi148.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T22:25:37.335 INFO:teuthology.orchestra.run.smithi188.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T22:25:37.733 INFO:teuthology.orchestra.run.smithi188.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T22:25:37.833 INFO:teuthology.orchestra.run.smithi188.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T22:25:37.960 INFO:teuthology.orchestra.run.smithi188.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T22:25:38.044 INFO:teuthology.orchestra.run.smithi188.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T22:25:38.137 INFO:teuthology.orchestra.run.smithi188.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T22:25:38.220 INFO:teuthology.orchestra.run.smithi188.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T22:25:38.370 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 13.2 MB in 14s (956 kB/s) 2024-04-25T22:25:38.444 INFO:teuthology.orchestra.run.smithi188.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T22:25:38.750 INFO:teuthology.orchestra.run.smithi188.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T22:25:38.847 INFO:teuthology.orchestra.run.smithi188.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T22:25:38.931 INFO:teuthology.orchestra.run.smithi188.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T22:25:39.028 INFO:teuthology.orchestra.run.smithi188.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T22:25:39.134 INFO:teuthology.orchestra.run.smithi188.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T22:25:39.229 INFO:teuthology.orchestra.run.smithi188.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T22:25:39.314 INFO:teuthology.orchestra.run.smithi188.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T22:25:39.995 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-04-25T22:25:40.013 DEBUG:teuthology.orchestra.run.smithi122:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T22:25:40.077 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-04-25T22:25:40.278 INFO:teuthology.orchestra.run.smithi122.stdout:Building dependency tree... 2024-04-25T22:25:40.278 INFO:teuthology.orchestra.run.smithi122.stdout:Reading state information... 2024-04-25T22:25:40.452 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:25:40.452 INFO:teuthology.orchestra.run.smithi122.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:25:40.452 INFO:teuthology.orchestra.run.smithi122.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:25:40.453 INFO:teuthology.orchestra.run.smithi122.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:25:40.453 INFO:teuthology.orchestra.run.smithi122.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T22:25:40.453 INFO:teuthology.orchestra.run.smithi122.stdout: python2.7-minimal 2024-04-25T22:25:40.453 INFO:teuthology.orchestra.run.smithi122.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:25:40.454 INFO:teuthology.orchestra.run.smithi122.stdout:The following additional packages will be installed: 2024-04-25T22:25:40.455 INFO:teuthology.orchestra.run.smithi122.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T22:25:40.455 INFO:teuthology.orchestra.run.smithi122.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T22:25:40.455 INFO:teuthology.orchestra.run.smithi122.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T22:25:40.456 INFO:teuthology.orchestra.run.smithi122.stdout:Suggested packages: 2024-04-25T22:25:40.456 INFO:teuthology.orchestra.run.smithi122.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T22:25:40.456 INFO:teuthology.orchestra.run.smithi122.stdout:Recommended packages: 2024-04-25T22:25:40.456 INFO:teuthology.orchestra.run.smithi122.stdout: thermald 2024-04-25T22:25:40.506 INFO:teuthology.orchestra.run.smithi122.stdout:The following NEW packages will be installed: 2024-04-25T22:25:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T22:25:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T22:25:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T22:25:40.508 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages will be upgraded: 2024-04-25T22:25:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T22:25:40.569 INFO:teuthology.orchestra.run.smithi122.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T22:25:40.569 INFO:teuthology.orchestra.run.smithi122.stdout:Need to get 113 MB of archives. 2024-04-25T22:25:40.569 INFO:teuthology.orchestra.run.smithi122.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T22:25:40.569 INFO:teuthology.orchestra.run.smithi122.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T22:25:40.574 INFO:teuthology.orchestra.run.smithi148.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T22:25:40.982 INFO:teuthology.orchestra.run.smithi148.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T22:25:40.988 INFO:teuthology.orchestra.run.smithi148.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T22:25:41.002 INFO:teuthology.orchestra.run.smithi148.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T22:25:41.002 INFO:teuthology.orchestra.run.smithi148.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T22:25:41.005 INFO:teuthology.orchestra.run.smithi148.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T22:25:41.256 INFO:teuthology.orchestra.run.smithi122.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T22:25:41.431 INFO:teuthology.orchestra.run.smithi122.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T22:25:42.859 INFO:teuthology.orchestra.run.smithi122.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T22:25:42.859 INFO:teuthology.orchestra.run.smithi122.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T22:25:42.859 INFO:teuthology.orchestra.run.smithi122.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T22:25:43.086 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:25:43.202 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:25:43.224 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T22:25:43.311 INFO:teuthology.orchestra.run.smithi122.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T22:25:43.552 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:25:43.560 INFO:teuthology.orchestra.run.smithi188.stdout:Fetched 13.2 MB in 19s (687 kB/s) 2024-04-25T22:25:43.680 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:25:43.707 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 113 MB in 3s (40.5 MB/s) 2024-04-25T22:25:43.918 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T22:25:44.025 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T22:25:44.048 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T22:25:44.091 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T22:25:44.972 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-04-25T22:25:44.990 DEBUG:teuthology.orchestra.run.smithi188:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T22:25:45.049 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-04-25T22:25:45.217 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 13.2 MB in 21s (633 kB/s) 2024-04-25T22:25:45.250 INFO:teuthology.orchestra.run.smithi188.stdout:Building dependency tree... 2024-04-25T22:25:45.250 INFO:teuthology.orchestra.run.smithi188.stdout:Reading state information... 2024-04-25T22:25:45.418 INFO:teuthology.orchestra.run.smithi188.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:25:45.418 INFO:teuthology.orchestra.run.smithi188.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:25:45.418 INFO:teuthology.orchestra.run.smithi188.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:25:45.419 INFO:teuthology.orchestra.run.smithi188.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:25:45.419 INFO:teuthology.orchestra.run.smithi188.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T22:25:45.419 INFO:teuthology.orchestra.run.smithi188.stdout: python2.7-minimal 2024-04-25T22:25:45.419 INFO:teuthology.orchestra.run.smithi188.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:25:45.420 INFO:teuthology.orchestra.run.smithi188.stdout:The following additional packages will be installed: 2024-04-25T22:25:45.420 INFO:teuthology.orchestra.run.smithi188.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T22:25:45.420 INFO:teuthology.orchestra.run.smithi188.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T22:25:45.420 INFO:teuthology.orchestra.run.smithi188.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T22:25:45.422 INFO:teuthology.orchestra.run.smithi188.stdout:Suggested packages: 2024-04-25T22:25:45.422 INFO:teuthology.orchestra.run.smithi188.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T22:25:45.422 INFO:teuthology.orchestra.run.smithi188.stdout:Recommended packages: 2024-04-25T22:25:45.422 INFO:teuthology.orchestra.run.smithi188.stdout: thermald 2024-04-25T22:25:45.465 INFO:teuthology.orchestra.run.smithi188.stdout:The following NEW packages will be installed: 2024-04-25T22:25:45.465 INFO:teuthology.orchestra.run.smithi188.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T22:25:45.465 INFO:teuthology.orchestra.run.smithi188.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T22:25:45.466 INFO:teuthology.orchestra.run.smithi188.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T22:25:45.467 INFO:teuthology.orchestra.run.smithi188.stdout:The following packages will be upgraded: 2024-04-25T22:25:45.467 INFO:teuthology.orchestra.run.smithi188.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T22:25:45.647 INFO:teuthology.orchestra.run.smithi188.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T22:25:45.647 INFO:teuthology.orchestra.run.smithi188.stdout:Need to get 113 MB of archives. 2024-04-25T22:25:45.647 INFO:teuthology.orchestra.run.smithi188.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T22:25:45.647 INFO:teuthology.orchestra.run.smithi188.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T22:25:45.959 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T22:25:45.964 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:25:46.140 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:25:46.518 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2024-04-25T22:25:46.535 DEBUG:teuthology.orchestra.run.smithi148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T22:25:46.595 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2024-04-25T22:25:46.803 INFO:teuthology.orchestra.run.smithi148.stdout:Building dependency tree... 2024-04-25T22:25:46.804 INFO:teuthology.orchestra.run.smithi148.stdout:Reading state information... 2024-04-25T22:25:46.972 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:25:46.972 INFO:teuthology.orchestra.run.smithi148.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:25:46.972 INFO:teuthology.orchestra.run.smithi148.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:25:46.972 INFO:teuthology.orchestra.run.smithi148.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:25:46.972 INFO:teuthology.orchestra.run.smithi148.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T22:25:46.973 INFO:teuthology.orchestra.run.smithi148.stdout: python2.7-minimal 2024-04-25T22:25:46.973 INFO:teuthology.orchestra.run.smithi148.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:25:46.974 INFO:teuthology.orchestra.run.smithi148.stdout:The following additional packages will be installed: 2024-04-25T22:25:46.974 INFO:teuthology.orchestra.run.smithi148.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T22:25:46.974 INFO:teuthology.orchestra.run.smithi148.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T22:25:46.975 INFO:teuthology.orchestra.run.smithi148.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T22:25:46.976 INFO:teuthology.orchestra.run.smithi148.stdout:Suggested packages: 2024-04-25T22:25:46.976 INFO:teuthology.orchestra.run.smithi148.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T22:25:46.976 INFO:teuthology.orchestra.run.smithi148.stdout:Recommended packages: 2024-04-25T22:25:46.976 INFO:teuthology.orchestra.run.smithi148.stdout: thermald 2024-04-25T22:25:46.992 INFO:teuthology.orchestra.run.smithi188.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T22:25:47.012 INFO:teuthology.orchestra.run.smithi148.stdout:The following NEW packages will be installed: 2024-04-25T22:25:47.013 INFO:teuthology.orchestra.run.smithi148.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T22:25:47.013 INFO:teuthology.orchestra.run.smithi148.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T22:25:47.013 INFO:teuthology.orchestra.run.smithi148.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T22:25:47.014 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages will be upgraded: 2024-04-25T22:25:47.015 INFO:teuthology.orchestra.run.smithi148.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T22:25:47.075 INFO:teuthology.orchestra.run.smithi148.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T22:25:47.075 INFO:teuthology.orchestra.run.smithi148.stdout:Need to get 113 MB of archives. 2024-04-25T22:25:47.075 INFO:teuthology.orchestra.run.smithi148.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T22:25:47.075 INFO:teuthology.orchestra.run.smithi148.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T22:25:47.405 INFO:teuthology.orchestra.run.smithi188.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T22:25:47.740 INFO:teuthology.orchestra.run.smithi148.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T22:25:47.909 INFO:teuthology.orchestra.run.smithi148.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T22:25:48.392 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T22:25:48.413 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:25:48.499 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:25:49.079 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T22:25:49.079 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T22:25:49.080 INFO:teuthology.orchestra.run.smithi148.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T22:25:49.312 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T22:25:49.332 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:25:49.360 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T22:25:49.361 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:25:49.443 INFO:teuthology.orchestra.run.smithi148.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T22:25:49.647 INFO:teuthology.orchestra.run.smithi188.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T22:25:49.647 INFO:teuthology.orchestra.run.smithi188.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T22:25:49.647 INFO:teuthology.orchestra.run.smithi188.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T22:25:49.836 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 113 MB in 2s (46.8 MB/s) 2024-04-25T22:25:49.991 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T22:25:50.132 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T22:25:50.169 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:25:50.207 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:25:50.487 INFO:teuthology.orchestra.run.smithi188.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T22:25:50.614 INFO:teuthology.orchestra.run.smithi188.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T22:25:51.000 INFO:teuthology.orchestra.run.smithi188.stdout:Fetched 113 MB in 5s (22.0 MB/s) 2024-04-25T22:25:51.183 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T22:25:52.015 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T22:25:52.020 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:25:52.154 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:25:52.978 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:25:53.099 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:25:53.166 INFO:teuthology.orchestra.run.smithi188.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T22:25:53.170 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:25:53.239 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:25:53.458 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T22:25:53.596 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:25:53.721 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T22:25:53.850 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:25:54.141 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T22:25:54.162 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:25:54.251 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:25:54.694 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T22:25:54.714 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:25:54.752 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:25:55.173 INFO:teuthology.orchestra.run.smithi057.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:25:55.173 INFO:teuthology.orchestra.run.smithi057.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T22:25:55.173 INFO:teuthology.orchestra.run.smithi057.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:25:55.173 INFO:teuthology.orchestra.run.smithi057.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T22:25:55.343 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:25:56.192 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T22:25:56.213 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:25:56.308 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:25:56.554 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:25:56.673 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:25:56.745 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T22:25:56.766 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:25:56.794 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:25:57.020 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:25:57.031 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:25:57.160 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:25:57.471 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T22:25:57.494 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T22:25:57.530 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T22:25:58.437 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T22:25:58.580 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T22:25:58.715 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:25:58.778 INFO:teuthology.orchestra.run.smithi057.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T22:25:58.778 INFO:teuthology.orchestra.run.smithi057.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:26:01.374 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:26:01.503 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:26:01.844 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:26:01.964 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:26:02.267 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T22:26:02.290 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T22:26:02.334 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T22:26:03.332 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:26:03.465 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:26:03.485 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T22:26:03.522 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:26:03.560 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:26:03.781 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:26:03.877 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:26:04.163 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T22:26:04.186 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T22:26:04.230 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T22:26:07.016 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:26:07.114 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:26:07.472 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T22:26:07.602 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:26:07.728 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T22:26:07.890 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:26:08.274 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T22:26:08.312 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:26:08.348 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:26:09.197 INFO:teuthology.orchestra.run.smithi122.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:26:09.197 INFO:teuthology.orchestra.run.smithi122.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T22:26:09.197 INFO:teuthology.orchestra.run.smithi122.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:26:09.197 INFO:teuthology.orchestra.run.smithi122.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T22:26:09.342 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:26:09.809 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T22:26:09.846 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T22:26:09.883 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:26:10.761 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:26:10.848 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:26:10.950 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:26:11.268 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T22:26:11.455 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:26:11.581 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T22:26:11.709 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:26:12.662 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T22:26:12.821 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T22:26:12.948 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:26:13.012 INFO:teuthology.orchestra.run.smithi122.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T22:26:13.012 INFO:teuthology.orchestra.run.smithi122.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:26:13.044 INFO:teuthology.orchestra.run.smithi148.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:26:13.045 INFO:teuthology.orchestra.run.smithi148.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T22:26:13.045 INFO:teuthology.orchestra.run.smithi148.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:26:13.045 INFO:teuthology.orchestra.run.smithi148.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T22:26:13.128 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T22:26:13.211 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:26:13.254 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T22:26:13.337 INFO:teuthology.orchestra.run.smithi057.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T22:26:13.337 INFO:teuthology.orchestra.run.smithi057.stdout:Sourcing file `/etc/default/grub' 2024-04-25T22:26:13.358 INFO:teuthology.orchestra.run.smithi057.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T22:26:13.381 INFO:teuthology.orchestra.run.smithi057.stdout:Generating grub configuration file ... 2024-04-25T22:26:13.596 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T22:26:13.606 INFO:teuthology.orchestra.run.smithi057.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:26:13.624 INFO:teuthology.orchestra.run.smithi057.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:26:13.718 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:26:13.844 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T22:26:13.957 INFO:teuthology.orchestra.run.smithi057.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:26:13.962 INFO:teuthology.orchestra.run.smithi057.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T22:26:13.972 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:26:14.025 INFO:teuthology.orchestra.run.smithi057.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T22:26:14.030 INFO:teuthology.orchestra.run.smithi057.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T22:26:14.178 INFO:teuthology.orchestra.run.smithi057.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T22:26:14.178 INFO:teuthology.orchestra.run.smithi057.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T22:26:14.178 INFO:teuthology.orchestra.run.smithi057.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T22:26:14.216 INFO:teuthology.orchestra.run.smithi057.stdout:done 2024-04-25T22:26:14.622 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:26:14.708 DEBUG:teuthology.orchestra.run.smithi057:> dpkg -s linux-image-generic 2024-04-25T22:26:14.728 INFO:teuthology.orchestra.run.smithi057.stdout:Package: linux-image-generic 2024-04-25T22:26:14.728 INFO:teuthology.orchestra.run.smithi057.stdout:Status: install ok installed 2024-04-25T22:26:14.728 INFO:teuthology.orchestra.run.smithi057.stdout:Priority: optional 2024-04-25T22:26:14.728 INFO:teuthology.orchestra.run.smithi057.stdout:Section: kernel 2024-04-25T22:26:14.728 INFO:teuthology.orchestra.run.smithi057.stdout:Installed-Size: 21 2024-04-25T22:26:14.728 INFO:teuthology.orchestra.run.smithi057.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T22:26:14.728 INFO:teuthology.orchestra.run.smithi057.stdout:Architecture: amd64 2024-04-25T22:26:14.728 INFO:teuthology.orchestra.run.smithi057.stdout:Source: linux-meta 2024-04-25T22:26:14.728 INFO:teuthology.orchestra.run.smithi057.stdout:Version: 5.15.0.105.102 2024-04-25T22:26:14.728 INFO:teuthology.orchestra.run.smithi057.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T22:26:14.729 INFO:teuthology.orchestra.run.smithi057.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T22:26:14.729 INFO:teuthology.orchestra.run.smithi057.stdout:Recommends: thermald 2024-04-25T22:26:14.729 INFO:teuthology.orchestra.run.smithi057.stdout:Description: Generic Linux kernel image 2024-04-25T22:26:14.729 INFO:teuthology.orchestra.run.smithi057.stdout: This package will always depend on the latest generic kernel image 2024-04-25T22:26:14.729 INFO:teuthology.orchestra.run.smithi057.stdout: available. 2024-04-25T22:26:14.730 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T22:26:14.730 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T22:26:14.730 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T22:26:14.730 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-25T22:26:14.730 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi057.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T22:26:14.730 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get clean 2024-04-25T22:26:15.028 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get update 2024-04-25T22:26:15.157 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T22:26:15.166 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:26:15.187 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T22:26:15.210 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T22:26:15.290 INFO:teuthology.orchestra.run.smithi188.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:26:15.290 INFO:teuthology.orchestra.run.smithi188.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T22:26:15.290 INFO:teuthology.orchestra.run.smithi188.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:26:15.290 INFO:teuthology.orchestra.run.smithi188.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T22:26:15.475 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:26:16.022 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T22:26:16.148 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T22:26:16.275 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:26:16.340 INFO:teuthology.orchestra.run.smithi148.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T22:26:16.340 INFO:teuthology.orchestra.run.smithi148.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:26:16.516 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-25T22:26:16.536 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T22:26:16.588 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-25T22:26:16.786 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2024-04-25T22:26:16.787 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2024-04-25T22:26:16.951 INFO:teuthology.orchestra.run.smithi057.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T22:26:16.952 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:26:16.952 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:26:16.952 INFO:teuthology.orchestra.run.smithi057.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:26:16.952 INFO:teuthology.orchestra.run.smithi057.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:26:16.952 INFO:teuthology.orchestra.run.smithi057.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:26:16.952 INFO:teuthology.orchestra.run.smithi057.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:26:16.952 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:26:16.992 INFO:teuthology.orchestra.run.smithi057.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T22:26:16.994 DEBUG:teuthology.orchestra.run.smithi057:> dpkg -s linux-image-generic 2024-04-25T22:26:17.053 INFO:teuthology.orchestra.run.smithi057.stdout:Package: linux-image-generic 2024-04-25T22:26:17.053 INFO:teuthology.orchestra.run.smithi057.stdout:Status: install ok installed 2024-04-25T22:26:17.053 INFO:teuthology.orchestra.run.smithi057.stdout:Priority: optional 2024-04-25T22:26:17.053 INFO:teuthology.orchestra.run.smithi057.stdout:Section: kernel 2024-04-25T22:26:17.053 INFO:teuthology.orchestra.run.smithi057.stdout:Installed-Size: 21 2024-04-25T22:26:17.053 INFO:teuthology.orchestra.run.smithi057.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T22:26:17.053 INFO:teuthology.orchestra.run.smithi057.stdout:Architecture: amd64 2024-04-25T22:26:17.054 INFO:teuthology.orchestra.run.smithi057.stdout:Source: linux-meta 2024-04-25T22:26:17.054 INFO:teuthology.orchestra.run.smithi057.stdout:Version: 5.15.0.105.102 2024-04-25T22:26:17.054 INFO:teuthology.orchestra.run.smithi057.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T22:26:17.054 INFO:teuthology.orchestra.run.smithi057.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T22:26:17.054 INFO:teuthology.orchestra.run.smithi057.stdout:Recommends: thermald 2024-04-25T22:26:17.054 INFO:teuthology.orchestra.run.smithi057.stdout:Description: Generic Linux kernel image 2024-04-25T22:26:17.054 INFO:teuthology.orchestra.run.smithi057.stdout: This package will always depend on the latest generic kernel image 2024-04-25T22:26:17.054 INFO:teuthology.orchestra.run.smithi057.stdout: available. 2024-04-25T22:26:17.054 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-04-25T22:26:17.098 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.YAcD5YLabB 2024-04-25T22:26:17.098 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /boot/grub/grub.cfg /tmp/tmp.YAcD5YLabB 2024-04-25T22:26:17.154 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.YAcD5YLabB 2024-04-25T22:26:17.273 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.YAcD5YLabB is 10KB 2024-04-25T22:26:17.286 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.YAcD5YLabB 2024-04-25T22:26:17.291 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T22:26:17.349 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:26:17.350 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T22:26:17.350 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T22:26:17.394 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:26:17.427 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T22:26:17.428 DEBUG:teuthology.orchestra.run.smithi057:> sudo update-grub 2024-04-25T22:26:18.627 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub' 2024-04-25T22:26:18.628 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T22:26:18.629 INFO:teuthology.orchestra.run.smithi057.stderr:Generating grub configuration file ... 2024-04-25T22:26:18.794 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T22:26:18.829 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:26:18.836 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:26:18.921 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T22:26:19.047 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T22:26:19.102 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:26:19.108 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T22:26:19.109 INFO:teuthology.orchestra.run.smithi188.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T22:26:19.109 INFO:teuthology.orchestra.run.smithi188.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:26:19.153 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T22:26:19.159 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T22:26:19.277 INFO:teuthology.orchestra.run.smithi057.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T22:26:19.277 INFO:teuthology.orchestra.run.smithi057.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T22:26:19.277 INFO:teuthology.orchestra.run.smithi057.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T22:26:19.288 INFO:teuthology.orchestra.run.smithi057.stderr:done 2024-04-25T22:26:19.291 DEBUG:teuthology.orchestra.run.smithi057:> sudo shutdown -r now 2024-04-25T22:26:27.134 INFO:teuthology.orchestra.run.smithi122.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T22:26:27.134 INFO:teuthology.orchestra.run.smithi122.stdout:Sourcing file `/etc/default/grub' 2024-04-25T22:26:27.156 INFO:teuthology.orchestra.run.smithi122.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T22:26:27.180 INFO:teuthology.orchestra.run.smithi122.stdout:Generating grub configuration file ... 2024-04-25T22:26:27.496 INFO:teuthology.orchestra.run.smithi122.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:26:27.513 INFO:teuthology.orchestra.run.smithi122.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:26:27.854 INFO:teuthology.orchestra.run.smithi122.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:26:27.860 INFO:teuthology.orchestra.run.smithi122.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T22:26:27.928 INFO:teuthology.orchestra.run.smithi122.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T22:26:27.934 INFO:teuthology.orchestra.run.smithi122.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T22:26:28.113 INFO:teuthology.orchestra.run.smithi122.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T22:26:28.114 INFO:teuthology.orchestra.run.smithi122.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T22:26:28.114 INFO:teuthology.orchestra.run.smithi122.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T22:26:28.152 INFO:teuthology.orchestra.run.smithi122.stdout:done 2024-04-25T22:26:28.650 DEBUG:teuthology.orchestra.run.smithi122:> dpkg -s linux-image-generic 2024-04-25T22:26:28.671 INFO:teuthology.orchestra.run.smithi122.stdout:Package: linux-image-generic 2024-04-25T22:26:28.671 INFO:teuthology.orchestra.run.smithi122.stdout:Status: install ok installed 2024-04-25T22:26:28.671 INFO:teuthology.orchestra.run.smithi122.stdout:Priority: optional 2024-04-25T22:26:28.671 INFO:teuthology.orchestra.run.smithi122.stdout:Section: kernel 2024-04-25T22:26:28.671 INFO:teuthology.orchestra.run.smithi122.stdout:Installed-Size: 21 2024-04-25T22:26:28.671 INFO:teuthology.orchestra.run.smithi122.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T22:26:28.671 INFO:teuthology.orchestra.run.smithi122.stdout:Architecture: amd64 2024-04-25T22:26:28.671 INFO:teuthology.orchestra.run.smithi122.stdout:Source: linux-meta 2024-04-25T22:26:28.671 INFO:teuthology.orchestra.run.smithi122.stdout:Version: 5.15.0.105.102 2024-04-25T22:26:28.672 INFO:teuthology.orchestra.run.smithi122.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T22:26:28.672 INFO:teuthology.orchestra.run.smithi122.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T22:26:28.672 INFO:teuthology.orchestra.run.smithi122.stdout:Recommends: thermald 2024-04-25T22:26:28.672 INFO:teuthology.orchestra.run.smithi122.stdout:Description: Generic Linux kernel image 2024-04-25T22:26:28.672 INFO:teuthology.orchestra.run.smithi122.stdout: This package will always depend on the latest generic kernel image 2024-04-25T22:26:28.672 INFO:teuthology.orchestra.run.smithi122.stdout: available. 2024-04-25T22:26:28.672 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T22:26:28.672 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T22:26:28.672 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T22:26:28.672 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-04-25T22:26:28.672 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi122.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T22:26:28.673 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get clean 2024-04-25T22:26:28.832 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get update 2024-04-25T22:26:28.968 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:26:28.982 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T22:26:28.983 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T22:26:29.002 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T22:26:30.346 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-04-25T22:26:30.363 DEBUG:teuthology.orchestra.run.smithi122:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T22:26:30.423 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-04-25T22:26:30.614 INFO:teuthology.orchestra.run.smithi148.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T22:26:30.614 INFO:teuthology.orchestra.run.smithi148.stdout:Sourcing file `/etc/default/grub' 2024-04-25T22:26:30.623 INFO:teuthology.orchestra.run.smithi122.stdout:Building dependency tree... 2024-04-25T22:26:30.624 INFO:teuthology.orchestra.run.smithi122.stdout:Reading state information... 2024-04-25T22:26:30.629 INFO:teuthology.orchestra.run.smithi148.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T22:26:30.660 INFO:teuthology.orchestra.run.smithi148.stdout:Generating grub configuration file ... 2024-04-25T22:26:30.798 INFO:teuthology.orchestra.run.smithi122.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T22:26:30.798 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:26:30.798 INFO:teuthology.orchestra.run.smithi122.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:26:30.798 INFO:teuthology.orchestra.run.smithi122.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:26:30.798 INFO:teuthology.orchestra.run.smithi122.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:26:30.799 INFO:teuthology.orchestra.run.smithi122.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:26:30.799 INFO:teuthology.orchestra.run.smithi122.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:26:30.799 INFO:teuthology.orchestra.run.smithi122.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:26:30.842 INFO:teuthology.orchestra.run.smithi122.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T22:26:30.844 DEBUG:teuthology.orchestra.run.smithi122:> dpkg -s linux-image-generic 2024-04-25T22:26:30.860 INFO:teuthology.orchestra.run.smithi122.stdout:Package: linux-image-generic 2024-04-25T22:26:30.860 INFO:teuthology.orchestra.run.smithi122.stdout:Status: install ok installed 2024-04-25T22:26:30.860 INFO:teuthology.orchestra.run.smithi122.stdout:Priority: optional 2024-04-25T22:26:30.860 INFO:teuthology.orchestra.run.smithi122.stdout:Section: kernel 2024-04-25T22:26:30.860 INFO:teuthology.orchestra.run.smithi122.stdout:Installed-Size: 21 2024-04-25T22:26:30.860 INFO:teuthology.orchestra.run.smithi122.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T22:26:30.860 INFO:teuthology.orchestra.run.smithi122.stdout:Architecture: amd64 2024-04-25T22:26:30.860 INFO:teuthology.orchestra.run.smithi122.stdout:Source: linux-meta 2024-04-25T22:26:30.860 INFO:teuthology.orchestra.run.smithi122.stdout:Version: 5.15.0.105.102 2024-04-25T22:26:30.860 INFO:teuthology.orchestra.run.smithi122.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T22:26:30.861 INFO:teuthology.orchestra.run.smithi122.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T22:26:30.861 INFO:teuthology.orchestra.run.smithi122.stdout:Recommends: thermald 2024-04-25T22:26:30.861 INFO:teuthology.orchestra.run.smithi122.stdout:Description: Generic Linux kernel image 2024-04-25T22:26:30.861 INFO:teuthology.orchestra.run.smithi122.stdout: This package will always depend on the latest generic kernel image 2024-04-25T22:26:30.861 INFO:teuthology.orchestra.run.smithi122.stdout: available. 2024-04-25T22:26:30.861 DEBUG:teuthology.orchestra.run.smithi122:> mktemp 2024-04-25T22:26:30.905 INFO:teuthology.orchestra.run.smithi122.stdout:/tmp/tmp.folAjOMTwu 2024-04-25T22:26:30.905 DEBUG:teuthology.orchestra.run.smithi122:> sudo cp /boot/grub/grub.cfg /tmp/tmp.folAjOMTwu 2024-04-25T22:26:30.909 INFO:teuthology.orchestra.run.smithi148.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:26:30.925 INFO:teuthology.orchestra.run.smithi148.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:26:30.961 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0666 /tmp/tmp.folAjOMTwu 2024-04-25T22:26:31.080 DEBUG:teuthology.orchestra.remote:smithi122:/tmp/tmp.folAjOMTwu is 10KB 2024-04-25T22:26:31.092 DEBUG:teuthology.orchestra.run.smithi122:> rm -fr /tmp/tmp.folAjOMTwu 2024-04-25T22:26:31.097 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T22:26:31.153 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-25T22:26:31.153 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T22:26:31.153 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T22:26:31.201 INFO:teuthology.orchestra.run.smithi148.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:26:31.207 INFO:teuthology.orchestra.run.smithi148.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T22:26:31.258 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T22:26:31.258 DEBUG:teuthology.orchestra.run.smithi122:> sudo update-grub 2024-04-25T22:26:31.272 INFO:teuthology.orchestra.run.smithi148.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T22:26:31.277 INFO:teuthology.orchestra.run.smithi148.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T22:26:31.437 INFO:teuthology.orchestra.run.smithi148.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T22:26:31.437 INFO:teuthology.orchestra.run.smithi148.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T22:26:31.437 INFO:teuthology.orchestra.run.smithi148.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T22:26:31.470 INFO:teuthology.orchestra.run.smithi148.stdout:done 2024-04-25T22:26:31.949 DEBUG:teuthology.orchestra.run.smithi148:> dpkg -s linux-image-generic 2024-04-25T22:26:31.974 INFO:teuthology.orchestra.run.smithi148.stdout:Package: linux-image-generic 2024-04-25T22:26:31.974 INFO:teuthology.orchestra.run.smithi148.stdout:Status: install ok installed 2024-04-25T22:26:31.974 INFO:teuthology.orchestra.run.smithi148.stdout:Priority: optional 2024-04-25T22:26:31.974 INFO:teuthology.orchestra.run.smithi148.stdout:Section: kernel 2024-04-25T22:26:31.974 INFO:teuthology.orchestra.run.smithi148.stdout:Installed-Size: 21 2024-04-25T22:26:31.974 INFO:teuthology.orchestra.run.smithi148.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T22:26:31.974 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: amd64 2024-04-25T22:26:31.974 INFO:teuthology.orchestra.run.smithi148.stdout:Source: linux-meta 2024-04-25T22:26:31.974 INFO:teuthology.orchestra.run.smithi148.stdout:Version: 5.15.0.105.102 2024-04-25T22:26:31.974 INFO:teuthology.orchestra.run.smithi148.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T22:26:31.974 INFO:teuthology.orchestra.run.smithi148.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T22:26:31.975 INFO:teuthology.orchestra.run.smithi148.stdout:Recommends: thermald 2024-04-25T22:26:31.975 INFO:teuthology.orchestra.run.smithi148.stdout:Description: Generic Linux kernel image 2024-04-25T22:26:31.975 INFO:teuthology.orchestra.run.smithi148.stdout: This package will always depend on the latest generic kernel image 2024-04-25T22:26:31.975 INFO:teuthology.orchestra.run.smithi148.stdout: available. 2024-04-25T22:26:31.975 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T22:26:31.975 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T22:26:31.975 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T22:26:31.975 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-04-25T22:26:31.975 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi148.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T22:26:31.975 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-get clean 2024-04-25T22:26:32.151 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-get update 2024-04-25T22:26:32.408 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:26:32.481 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T22:26:32.563 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T22:26:32.573 INFO:teuthology.orchestra.run.smithi122.stderr:Sourcing file `/etc/default/grub' 2024-04-25T22:26:32.579 INFO:teuthology.orchestra.run.smithi122.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T22:26:32.596 INFO:teuthology.orchestra.run.smithi122.stderr:Generating grub configuration file ... 2024-04-25T22:26:32.812 INFO:teuthology.orchestra.run.smithi122.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:26:32.818 INFO:teuthology.orchestra.run.smithi122.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:26:33.015 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T22:26:33.092 INFO:teuthology.orchestra.run.smithi122.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:26:33.097 INFO:teuthology.orchestra.run.smithi122.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T22:26:33.139 INFO:teuthology.orchestra.run.smithi122.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T22:26:33.145 INFO:teuthology.orchestra.run.smithi122.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T22:26:33.160 INFO:teuthology.orchestra.run.smithi188.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T22:26:33.160 INFO:teuthology.orchestra.run.smithi188.stdout:Sourcing file `/etc/default/grub' 2024-04-25T22:26:33.178 INFO:teuthology.orchestra.run.smithi188.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T22:26:33.206 INFO:teuthology.orchestra.run.smithi188.stdout:Generating grub configuration file ... 2024-04-25T22:26:33.282 INFO:teuthology.orchestra.run.smithi122.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T22:26:33.282 INFO:teuthology.orchestra.run.smithi122.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T22:26:33.282 INFO:teuthology.orchestra.run.smithi122.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T22:26:33.299 INFO:teuthology.orchestra.run.smithi122.stderr:done 2024-04-25T22:26:33.301 DEBUG:teuthology.orchestra.run.smithi122:> sudo shutdown -r now 2024-04-25T22:26:33.573 INFO:teuthology.orchestra.run.smithi188.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:26:33.599 INFO:teuthology.orchestra.run.smithi188.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:26:33.979 INFO:teuthology.orchestra.run.smithi188.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:26:33.985 INFO:teuthology.orchestra.run.smithi188.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T22:26:34.053 INFO:teuthology.orchestra.run.smithi188.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T22:26:34.058 INFO:teuthology.orchestra.run.smithi188.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T22:26:34.119 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2024-04-25T22:26:34.138 DEBUG:teuthology.orchestra.run.smithi148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T22:26:34.197 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2024-04-25T22:26:34.237 INFO:teuthology.orchestra.run.smithi188.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T22:26:34.237 INFO:teuthology.orchestra.run.smithi188.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T22:26:34.237 INFO:teuthology.orchestra.run.smithi188.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T22:26:34.278 INFO:teuthology.orchestra.run.smithi188.stdout:done 2024-04-25T22:26:34.397 INFO:teuthology.orchestra.run.smithi148.stdout:Building dependency tree... 2024-04-25T22:26:34.398 INFO:teuthology.orchestra.run.smithi148.stdout:Reading state information... 2024-04-25T22:26:34.564 INFO:teuthology.orchestra.run.smithi148.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T22:26:34.564 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:26:34.565 INFO:teuthology.orchestra.run.smithi148.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:26:34.565 INFO:teuthology.orchestra.run.smithi148.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:26:34.565 INFO:teuthology.orchestra.run.smithi148.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:26:34.565 INFO:teuthology.orchestra.run.smithi148.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:26:34.565 INFO:teuthology.orchestra.run.smithi148.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:26:34.565 INFO:teuthology.orchestra.run.smithi148.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:26:34.603 INFO:teuthology.orchestra.run.smithi148.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T22:26:34.605 DEBUG:teuthology.orchestra.run.smithi148:> dpkg -s linux-image-generic 2024-04-25T22:26:34.617 INFO:teuthology.orchestra.run.smithi148.stdout:Package: linux-image-generic 2024-04-25T22:26:34.617 INFO:teuthology.orchestra.run.smithi148.stdout:Status: install ok installed 2024-04-25T22:26:34.617 INFO:teuthology.orchestra.run.smithi148.stdout:Priority: optional 2024-04-25T22:26:34.618 INFO:teuthology.orchestra.run.smithi148.stdout:Section: kernel 2024-04-25T22:26:34.618 INFO:teuthology.orchestra.run.smithi148.stdout:Installed-Size: 21 2024-04-25T22:26:34.618 INFO:teuthology.orchestra.run.smithi148.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T22:26:34.618 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: amd64 2024-04-25T22:26:34.618 INFO:teuthology.orchestra.run.smithi148.stdout:Source: linux-meta 2024-04-25T22:26:34.618 INFO:teuthology.orchestra.run.smithi148.stdout:Version: 5.15.0.105.102 2024-04-25T22:26:34.618 INFO:teuthology.orchestra.run.smithi148.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T22:26:34.618 INFO:teuthology.orchestra.run.smithi148.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T22:26:34.618 INFO:teuthology.orchestra.run.smithi148.stdout:Recommends: thermald 2024-04-25T22:26:34.618 INFO:teuthology.orchestra.run.smithi148.stdout:Description: Generic Linux kernel image 2024-04-25T22:26:34.618 INFO:teuthology.orchestra.run.smithi148.stdout: This package will always depend on the latest generic kernel image 2024-04-25T22:26:34.618 INFO:teuthology.orchestra.run.smithi148.stdout: available. 2024-04-25T22:26:34.619 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2024-04-25T22:26:34.663 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.Jxf769eoyW 2024-04-25T22:26:34.664 DEBUG:teuthology.orchestra.run.smithi148:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Jxf769eoyW 2024-04-25T22:26:34.720 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.Jxf769eoyW 2024-04-25T22:26:34.743 DEBUG:teuthology.orchestra.run.smithi188:> dpkg -s linux-image-generic 2024-04-25T22:26:34.766 INFO:teuthology.orchestra.run.smithi188.stdout:Package: linux-image-generic 2024-04-25T22:26:34.766 INFO:teuthology.orchestra.run.smithi188.stdout:Status: install ok installed 2024-04-25T22:26:34.767 INFO:teuthology.orchestra.run.smithi188.stdout:Priority: optional 2024-04-25T22:26:34.767 INFO:teuthology.orchestra.run.smithi188.stdout:Section: kernel 2024-04-25T22:26:34.767 INFO:teuthology.orchestra.run.smithi188.stdout:Installed-Size: 21 2024-04-25T22:26:34.767 INFO:teuthology.orchestra.run.smithi188.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T22:26:34.767 INFO:teuthology.orchestra.run.smithi188.stdout:Architecture: amd64 2024-04-25T22:26:34.767 INFO:teuthology.orchestra.run.smithi188.stdout:Source: linux-meta 2024-04-25T22:26:34.767 INFO:teuthology.orchestra.run.smithi188.stdout:Version: 5.15.0.105.102 2024-04-25T22:26:34.767 INFO:teuthology.orchestra.run.smithi188.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T22:26:34.767 INFO:teuthology.orchestra.run.smithi188.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T22:26:34.767 INFO:teuthology.orchestra.run.smithi188.stdout:Recommends: thermald 2024-04-25T22:26:34.768 INFO:teuthology.orchestra.run.smithi188.stdout:Description: Generic Linux kernel image 2024-04-25T22:26:34.768 INFO:teuthology.orchestra.run.smithi188.stdout: This package will always depend on the latest generic kernel image 2024-04-25T22:26:34.768 INFO:teuthology.orchestra.run.smithi188.stdout: available. 2024-04-25T22:26:34.768 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T22:26:34.768 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T22:26:34.768 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T22:26:34.768 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-04-25T22:26:34.768 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi188.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T22:26:34.768 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-get clean 2024-04-25T22:26:34.849 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.Jxf769eoyW is 10KB 2024-04-25T22:26:34.862 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.Jxf769eoyW 2024-04-25T22:26:34.867 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T22:26:34.923 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-25T22:26:34.923 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T22:26:34.924 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T22:26:34.951 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-get update 2024-04-25T22:26:34.990 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T22:26:34.990 DEBUG:teuthology.orchestra.run.smithi148:> sudo update-grub 2024-04-25T22:26:35.091 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:26:35.108 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T22:26:35.134 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T22:26:35.862 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T22:26:36.061 INFO:teuthology.orchestra.run.smithi148.stderr:Sourcing file `/etc/default/grub' 2024-04-25T22:26:36.062 INFO:teuthology.orchestra.run.smithi148.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T22:26:36.064 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2024-04-25T22:26:36.216 INFO:teuthology.orchestra.run.smithi148.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:26:36.221 INFO:teuthology.orchestra.run.smithi148.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:26:36.438 INFO:teuthology.orchestra.run.smithi148.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:26:36.442 INFO:teuthology.orchestra.run.smithi148.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T22:26:36.478 INFO:teuthology.orchestra.run.smithi148.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T22:26:36.482 INFO:teuthology.orchestra.run.smithi148.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T22:26:36.610 INFO:teuthology.orchestra.run.smithi148.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T22:26:36.611 INFO:teuthology.orchestra.run.smithi148.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T22:26:36.611 INFO:teuthology.orchestra.run.smithi148.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T22:26:36.630 INFO:teuthology.orchestra.run.smithi148.stderr:done 2024-04-25T22:26:36.638 DEBUG:teuthology.orchestra.run.smithi148:> sudo shutdown -r now 2024-04-25T22:26:37.019 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-04-25T22:26:37.037 DEBUG:teuthology.orchestra.run.smithi188:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T22:26:37.096 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-04-25T22:26:37.297 INFO:teuthology.orchestra.run.smithi188.stdout:Building dependency tree... 2024-04-25T22:26:37.306 INFO:teuthology.orchestra.run.smithi188.stdout:Reading state information... 2024-04-25T22:26:37.484 INFO:teuthology.orchestra.run.smithi188.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T22:26:37.484 INFO:teuthology.orchestra.run.smithi188.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:26:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:26:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:26:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:26:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:26:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:26:37.485 INFO:teuthology.orchestra.run.smithi188.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:26:37.524 INFO:teuthology.orchestra.run.smithi188.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T22:26:37.526 DEBUG:teuthology.orchestra.run.smithi188:> dpkg -s linux-image-generic 2024-04-25T22:26:37.581 INFO:teuthology.orchestra.run.smithi188.stdout:Package: linux-image-generic 2024-04-25T22:26:37.581 INFO:teuthology.orchestra.run.smithi188.stdout:Status: install ok installed 2024-04-25T22:26:37.581 INFO:teuthology.orchestra.run.smithi188.stdout:Priority: optional 2024-04-25T22:26:37.581 INFO:teuthology.orchestra.run.smithi188.stdout:Section: kernel 2024-04-25T22:26:37.581 INFO:teuthology.orchestra.run.smithi188.stdout:Installed-Size: 21 2024-04-25T22:26:37.581 INFO:teuthology.orchestra.run.smithi188.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T22:26:37.581 INFO:teuthology.orchestra.run.smithi188.stdout:Architecture: amd64 2024-04-25T22:26:37.581 INFO:teuthology.orchestra.run.smithi188.stdout:Source: linux-meta 2024-04-25T22:26:37.582 INFO:teuthology.orchestra.run.smithi188.stdout:Version: 5.15.0.105.102 2024-04-25T22:26:37.582 INFO:teuthology.orchestra.run.smithi188.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T22:26:37.582 INFO:teuthology.orchestra.run.smithi188.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T22:26:37.582 INFO:teuthology.orchestra.run.smithi188.stdout:Recommends: thermald 2024-04-25T22:26:37.582 INFO:teuthology.orchestra.run.smithi188.stdout:Description: Generic Linux kernel image 2024-04-25T22:26:37.582 INFO:teuthology.orchestra.run.smithi188.stdout: This package will always depend on the latest generic kernel image 2024-04-25T22:26:37.582 INFO:teuthology.orchestra.run.smithi188.stdout: available. 2024-04-25T22:26:37.582 DEBUG:teuthology.orchestra.run.smithi188:> mktemp 2024-04-25T22:26:37.626 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.4B9Cv5dygR 2024-04-25T22:26:37.627 DEBUG:teuthology.orchestra.run.smithi188:> sudo cp /boot/grub/grub.cfg /tmp/tmp.4B9Cv5dygR 2024-04-25T22:26:37.683 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0666 /tmp/tmp.4B9Cv5dygR 2024-04-25T22:26:37.806 DEBUG:teuthology.orchestra.remote:smithi188:/tmp/tmp.4B9Cv5dygR is 10KB 2024-04-25T22:26:37.818 DEBUG:teuthology.orchestra.run.smithi188:> rm -fr /tmp/tmp.4B9Cv5dygR 2024-04-25T22:26:37.823 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T22:26:37.878 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-25T22:26:37.878 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T22:26:37.878 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T22:26:37.956 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T22:26:37.956 DEBUG:teuthology.orchestra.run.smithi188:> sudo update-grub 2024-04-25T22:26:39.114 INFO:teuthology.orchestra.run.smithi188.stderr:Sourcing file `/etc/default/grub' 2024-04-25T22:26:39.116 INFO:teuthology.orchestra.run.smithi188.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T22:26:39.118 INFO:teuthology.orchestra.run.smithi188.stderr:Generating grub configuration file ... 2024-04-25T22:26:39.379 INFO:teuthology.orchestra.run.smithi188.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T22:26:39.384 INFO:teuthology.orchestra.run.smithi188.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T22:26:39.659 INFO:teuthology.orchestra.run.smithi188.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T22:26:39.664 INFO:teuthology.orchestra.run.smithi188.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T22:26:39.705 INFO:teuthology.orchestra.run.smithi188.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T22:26:39.710 INFO:teuthology.orchestra.run.smithi188.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T22:26:39.862 INFO:teuthology.orchestra.run.smithi188.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T22:26:39.862 INFO:teuthology.orchestra.run.smithi188.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T22:26:39.862 INFO:teuthology.orchestra.run.smithi188.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T22:26:39.899 INFO:teuthology.orchestra.run.smithi188.stderr:done 2024-04-25T22:26:39.907 DEBUG:teuthology.orchestra.run.smithi188:> sudo shutdown -r now 2024-04-25T22:26:49.302 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-25T22:26:49.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-25T22:26:49.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:27:03.318 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-04-25T22:27:03.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-25T22:27:03.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:27:06.685 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-04-25T22:27:06.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-04-25T22:27:06.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:27:09.910 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-04-25T22:27:09.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-25T22:27:09.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:27:23.806 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-04-25T22:27:32.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-25T22:27:32.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:27:37.886 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-25T22:27:41.218 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-04-25T22:27:46.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-25T22:27:46.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:27:50.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-04-25T22:27:50.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:28:05.279 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-25T22:28:09.915 DEBUG:teuthology.orchestra.remote:timed out 2024-04-25T22:28:17.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-25T22:28:17.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:28:17.593 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-04-25T22:28:18.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-25T22:28:18.758 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.15.0-105-generic"... 2024-04-25T22:28:18.758 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-04-25T22:28:18.804 INFO:teuthology.orchestra.run.smithi122.stdout:5.15.0-105-generic 2024-04-25T22:28:18.805 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T22:28:18.805 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T22:28:18.805 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T22:28:18.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-25T22:28:18.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:28:18.919 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-04-25T22:28:19.805 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-25T22:28:19.806 DEBUG:teuthology.orchestra.run.smithi122:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T22:28:20.088 INFO:teuthology.orchestra.run.smithi122.stdout:ttyS1 2024-04-25T22:28:20.103 DEBUG:teuthology.parallel:result is None 2024-04-25T22:28:30.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-25T22:28:30.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:28:31.329 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-04-25T22:28:31.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-25T22:28:31.895 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.15.0-105-generic"... 2024-04-25T22:28:31.895 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2024-04-25T22:28:31.943 INFO:teuthology.orchestra.run.smithi188.stdout:5.15.0-105-generic 2024-04-25T22:28:31.944 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T22:28:31.944 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T22:28:31.944 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T22:28:32.817 DEBUG:teuthology.orchestra.remote:timed out 2024-04-25T22:28:32.945 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-25T22:28:32.945 DEBUG:teuthology.orchestra.run.smithi188:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T22:28:33.282 INFO:teuthology.orchestra.run.smithi188.stdout:ttyS1 2024-04-25T22:28:33.318 DEBUG:teuthology.parallel:result is None 2024-04-25T22:28:44.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-25T22:28:44.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:28:45.076 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-04-25T22:28:45.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-25T22:28:45.633 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-25T22:28:45.634 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2024-04-25T22:28:45.681 INFO:teuthology.orchestra.run.smithi057.stdout:5.15.0-105-generic 2024-04-25T22:28:45.681 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T22:28:45.681 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T22:28:45.681 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T22:28:46.682 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T22:28:46.682 DEBUG:teuthology.orchestra.run.smithi057:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T22:28:46.754 INFO:teuthology.orchestra.run.smithi057.stdout:ttyS1 2024-04-25T22:28:46.782 DEBUG:teuthology.parallel:result is None 2024-04-25T22:28:50.226 DEBUG:teuthology.orchestra.remote:timed out 2024-04-25T22:29:02.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-04-25T22:29:02.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:29:02.462 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-04-25T22:29:02.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-04-25T22:29:02.999 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.15.0-105-generic"... 2024-04-25T22:29:02.999 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-04-25T22:29:03.047 INFO:teuthology.orchestra.run.smithi148.stdout:5.15.0-105-generic 2024-04-25T22:29:03.047 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T22:29:03.047 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T22:29:03.047 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T22:29:04.047 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-25T22:29:04.048 DEBUG:teuthology.orchestra.run.smithi148:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T22:29:04.434 INFO:teuthology.orchestra.run.smithi148.stdout:ttyS1 2024-04-25T22:29:04.452 DEBUG:teuthology.parallel:result is None 2024-04-25T22:29:04.453 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T22:29:04.461 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T22:29:04.461 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T22:29:04.464 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T22:29:04.466 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T22:29:04.469 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T22:29:04.475 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T22:29:04.554 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T22:29:04.580 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T22:29:04.581 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T22:29:04.583 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T22:29:04.586 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T22:29:04.588 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T22:29:04.671 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T22:29:04.678 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T22:29:04.678 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T22:29:04.681 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T22:29:04.684 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T22:29:04.686 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T22:29:04.700 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:29:04.700 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:29:04.701 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:29:04.707 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:29:04.709 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:29:04.709 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:29:04.710 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:29:04.720 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:29:04.721 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T22:29:04.729 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T22:29:04.729 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T22:29:04.753 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T22:29:04.756 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T22:29:04.758 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T22:29:04.783 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T22:29:04.835 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T22:29:04.835 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T22:29:04.837 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T22:29:04.840 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T22:29:04.842 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T22:29:04.848 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T22:29:04.889 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T22:29:04.937 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:29:04.937 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T22:29:05.011 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T22:29:05.016 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T22:29:05.064 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-25T22:29:05.064 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T22:29:05.144 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T22:29:05.150 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T22:29:05.199 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-25T22:29:05.199 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T22:29:05.265 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T22:29:05.271 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T22:29:05.320 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-25T22:29:05.320 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T22:29:05.381 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2024-04-25T22:29:05.383 DEBUG:teuthology.orchestra.run.smithi122:> sudo service rsyslog restart 2024-04-25T22:29:05.386 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2024-04-25T22:29:05.388 DEBUG:teuthology.orchestra.run.smithi188:> sudo service rsyslog restart 2024-04-25T22:29:05.455 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T22:29:05.463 INFO:teuthology.task.internal:Starting timer... 2024-04-25T22:29:05.463 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T22:29:05.512 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T22:29:05.575 DEBUG:teuthology.task.selinux:Excluding smithi057: OS 'ubuntu' does not support SELinux 2024-04-25T22:29:05.575 DEBUG:teuthology.task.selinux:Excluding smithi122: OS 'ubuntu' does not support SELinux 2024-04-25T22:29:05.575 DEBUG:teuthology.task.selinux:Excluding smithi148: OS 'ubuntu' does not support SELinux 2024-04-25T22:29:05.575 DEBUG:teuthology.task.selinux:Excluding smithi188: OS 'ubuntu' does not support SELinux 2024-04-25T22:29:05.576 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T22:29:05.576 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-25T22:29:05.576 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T22:29:05.576 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T22:29:05.605 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T22:29:05.628 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T22:29:05.630 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi057.front.sepia.ceph.com,smithi122.front.sepia.ceph.com,smithi148.front.sepia.ceph.com,smithi188.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T22:37:00.328 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi057.front.sepia.ceph.com'), Remote(name='ubuntu@smithi122.front.sepia.ceph.com'), Remote(name='ubuntu@smithi148.front.sepia.ceph.com'), Remote(name='ubuntu@smithi188.front.sepia.ceph.com')] 2024-04-25T22:37:00.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-25T22:37:00.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:37:00.420 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-04-25T22:37:00.507 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-25T22:37:00.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-25T22:37:00.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:37:00.587 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-04-25T22:37:00.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-25T22:37:00.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-04-25T22:37:00.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:37:00.752 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-04-25T22:37:00.830 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-04-25T22:37:00.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-25T22:37:00.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:37:00.911 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-04-25T22:37:00.986 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-04-25T22:37:00.988 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T22:37:00.999 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T22:37:00.999 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T22:37:01.000 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:37:01.003 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T22:37:01.003 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:37:01.005 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T22:37:01.005 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:37:01.008 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T22:37:01.008 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:37:01.031 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:01 ntpd[17200]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T22:37:01.031 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:01 ntpd[17200]: Command line: ntpd -gq 2024-04-25T22:37:01.031 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:01 ntpd[17200]: ---------------------------------------------------- 2024-04-25T22:37:01.031 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:01 ntpd[17200]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T22:37:01.031 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:01 ntpd[17200]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T22:37:01.031 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:01 ntpd[17200]: corporation. Support and training for ntp-4 are 2024-04-25T22:37:01.031 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:01 ntpd[17200]: available at https://www.nwtime.org/support 2024-04-25T22:37:01.032 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:01 ntpd[17200]: ---------------------------------------------------- 2024-04-25T22:37:01.032 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:01 ntpd[17200]: proto: precision = 0.044 usec (-24) 2024-04-25T22:37:01.033 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:01 ntpd[17200]: basedate set to 2022-02-04 2024-04-25T22:37:01.033 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:01 ntpd[17200]: gps base set to 2022-02-06 (week 2196) 2024-04-25T22:37:01.033 INFO:teuthology.orchestra.run.smithi122.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T22:37:01.034 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:01 ntpd[17104]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T22:37:01.034 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:01 ntpd[17104]: Command line: ntpd -gq 2024-04-25T22:37:01.034 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:01 ntpd[17104]: ---------------------------------------------------- 2024-04-25T22:37:01.034 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:01 ntpd[17104]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T22:37:01.035 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:01 ntpd[17104]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T22:37:01.035 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:01 ntpd[17104]: corporation. Support and training for ntp-4 are 2024-04-25T22:37:01.035 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:01 ntpd[17104]: available at https://www.nwtime.org/support 2024-04-25T22:37:01.035 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:01 ntpd[17104]: ---------------------------------------------------- 2024-04-25T22:37:01.035 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:01 ntpd[17104]: proto: precision = 0.047 usec (-24) 2024-04-25T22:37:01.035 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:01 ntpd[17104]: basedate set to 2022-02-04 2024-04-25T22:37:01.035 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:01 ntpd[17104]: gps base set to 2022-02-06 (week 2196) 2024-04-25T22:37:01.035 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:01 ntpd[17104]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T22:37:01.036 INFO:teuthology.orchestra.run.smithi057.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T22:37:01.036 INFO:teuthology.orchestra.run.smithi057.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T22:37:01.036 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:01 ntpd[17200]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T22:37:01.037 INFO:teuthology.orchestra.run.smithi122.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T22:37:01.039 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:01 ntpd[17104]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T22:37:01.039 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:01 ntpd[17104]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T22:37:01.040 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:01 ntpd[17104]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T22:37:01.040 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:01 ntpd[17104]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T22:37:01.040 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:01 ntpd[17104]: Listen normally on 3 ens1f0 172.21.15.57:123 2024-04-25T22:37:01.040 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:01 ntpd[17104]: Listen normally on 4 lo [::1]:123 2024-04-25T22:37:01.040 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:01 ntpd[17104]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1562%4]:123 2024-04-25T22:37:01.040 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:01 ntpd[17104]: Listening on routing socket on fd #22 for interface updates 2024-04-25T22:37:01.041 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:01 ntpd[17200]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T22:37:01.041 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:01 ntpd[17200]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T22:37:01.041 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:01 ntpd[17200]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T22:37:01.041 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:01 ntpd[17200]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T22:37:01.041 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:01 ntpd[17200]: Listen normally on 3 enp3s0f1 172.21.15.122:123 2024-04-25T22:37:01.041 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:01 ntpd[17200]: Listen normally on 4 lo [::1]:123 2024-04-25T22:37:01.041 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:01 ntpd[17200]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d515%5]:123 2024-04-25T22:37:01.041 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:01 ntpd[17200]: Listening on routing socket on fd #22 for interface updates 2024-04-25T22:37:01.042 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:01 ntpd[17201]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T22:37:01.042 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:01 ntpd[17201]: Command line: ntpd -gq 2024-04-25T22:37:01.042 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:01 ntpd[17201]: ---------------------------------------------------- 2024-04-25T22:37:01.042 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:01 ntpd[17201]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T22:37:01.042 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:01 ntpd[17201]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T22:37:01.042 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:01 ntpd[17201]: corporation. Support and training for ntp-4 are 2024-04-25T22:37:01.042 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:01 ntpd[17201]: available at https://www.nwtime.org/support 2024-04-25T22:37:01.042 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:01 ntpd[17201]: ---------------------------------------------------- 2024-04-25T22:37:01.043 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:01 ntpd[17201]: proto: precision = 0.043 usec (-24) 2024-04-25T22:37:01.043 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:01 ntpd[17201]: basedate set to 2022-02-04 2024-04-25T22:37:01.043 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:01 ntpd[17201]: gps base set to 2022-02-06 (week 2196) 2024-04-25T22:37:01.043 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:01 ntpd[17201]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T22:37:01.043 INFO:teuthology.orchestra.run.smithi148.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T22:37:01.044 INFO:teuthology.orchestra.run.smithi148.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T22:37:01.045 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:01 ntpd[17201]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T22:37:01.045 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:01 ntpd[17201]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T22:37:01.045 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:01 ntpd[17201]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T22:37:01.046 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:01 ntpd[17201]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T22:37:01.046 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:01 ntpd[17201]: Listen normally on 3 enp3s0f1 172.21.15.148:123 2024-04-25T22:37:01.046 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:01 ntpd[17201]: Listen normally on 4 lo [::1]:123 2024-04-25T22:37:01.046 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:01 ntpd[17201]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7257%5]:123 2024-04-25T22:37:01.046 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:01 ntpd[17201]: Listening on routing socket on fd #22 for interface updates 2024-04-25T22:37:01.064 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:01 ntpd[17241]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T22:37:01.064 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:01 ntpd[17241]: Command line: ntpd -gq 2024-04-25T22:37:01.064 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:01 ntpd[17241]: ---------------------------------------------------- 2024-04-25T22:37:01.065 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:01 ntpd[17241]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T22:37:01.065 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:01 ntpd[17241]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T22:37:01.065 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:01 ntpd[17241]: corporation. Support and training for ntp-4 are 2024-04-25T22:37:01.065 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:01 ntpd[17241]: available at https://www.nwtime.org/support 2024-04-25T22:37:01.065 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:01 ntpd[17241]: ---------------------------------------------------- 2024-04-25T22:37:01.065 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:01 ntpd[17241]: proto: precision = 0.062 usec (-24) 2024-04-25T22:37:01.066 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:01 ntpd[17241]: basedate set to 2022-02-04 2024-04-25T22:37:01.066 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:01 ntpd[17241]: gps base set to 2022-02-06 (week 2196) 2024-04-25T22:37:01.066 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:01 ntpd[17241]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T22:37:01.066 INFO:teuthology.orchestra.run.smithi188.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T22:37:01.066 INFO:teuthology.orchestra.run.smithi188.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T22:37:01.067 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:01 ntpd[17241]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T22:37:01.067 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:01 ntpd[17241]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T22:37:01.067 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:01 ntpd[17241]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T22:37:01.067 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:01 ntpd[17241]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T22:37:01.067 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:01 ntpd[17241]: Listen normally on 3 enp3s0f1 172.21.15.188:123 2024-04-25T22:37:01.067 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:01 ntpd[17241]: Listen normally on 4 lo [::1]:123 2024-04-25T22:37:01.068 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:01 ntpd[17241]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8039%5]:123 2024-04-25T22:37:01.068 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:01 ntpd[17241]: Listening on routing socket on fd #22 for interface updates 2024-04-25T22:37:02.031 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:02 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:02.031 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:02 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:02.033 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:02 ntpd[17104]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:02.033 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:02 ntpd[17104]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:02.033 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:02 ntpd[17104]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:02.033 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:02 ntpd[17104]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:02.033 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:02 ntpd[17104]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:02.033 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:02 ntpd[17104]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:02.036 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:02 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:02.036 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:02 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:02.036 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:02 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:02.036 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:02 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:02 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:02 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:02 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:02 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:02 ntpd[17201]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:02 ntpd[17201]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:02 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:02 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:02 ntpd[17201]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:02 ntpd[17201]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:02.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:02 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:02.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:02 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:02.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:02 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:02.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:02 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:02.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:02 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:02.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:02 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:02.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:02 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:02.067 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:02 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:02.067 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:02 ntpd[17241]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:02.067 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:02 ntpd[17241]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:02.067 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:02 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:02.067 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:02 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:02.067 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:02 ntpd[17241]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:02.067 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:02 ntpd[17241]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:03.033 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:03 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:03.033 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:03 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:03.033 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:03 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:03.034 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:03 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:03.034 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:03 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:03.034 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:03 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:03.034 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:03 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:03.034 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:03 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:03.034 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:03 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:03.034 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:03 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:03.035 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:03 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:03.035 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:03 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:03.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:03 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:03.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:03 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:03.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:03 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:03.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:03 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:03.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:03 ntpd[17241]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:03.067 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:03 ntpd[17241]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:04.034 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:04 ntpd[17104]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:04.034 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:04 ntpd[17104]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:04.034 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:04 ntpd[17104]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:04.034 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:04 ntpd[17104]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:04.035 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:04 ntpd[17104]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:04.035 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:04 ntpd[17104]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:04.035 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:04 ntpd[17104]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:04.035 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:04 ntpd[17104]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:04.035 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:04 ntpd[17104]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:04.035 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:04 ntpd[17104]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:04.035 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:04 ntpd[17104]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:04.035 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:04 ntpd[17104]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:04.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:04 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:04.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:04 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:04.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:04 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:04.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:04 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:04.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:04 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:04.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:04 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:04 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:04 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:04 ntpd[17201]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:04 ntpd[17201]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:04 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:04 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:04 ntpd[17201]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:04 ntpd[17201]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:04 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:04 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:04 ntpd[17201]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:04 ntpd[17201]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:04.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:04 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:04.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:04 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:04.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:04 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:04.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:04 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:04.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:04 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:04.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:04 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:04.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:04 ntpd[17241]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:04.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:04 ntpd[17241]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:04.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:04 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:04.067 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:04 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:04.067 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:04 ntpd[17241]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:04.067 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:04 ntpd[17241]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:05.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:05 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:05.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:05 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:05.033 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:05 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:05.033 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:05 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:05.033 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:05 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:05.033 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:05 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:05.033 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:05 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:05.033 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:05 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:05.033 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:05 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:05.033 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:05 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:05.033 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:05 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:05.033 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:05 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:05.033 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:05 ntpd[17104]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:05.034 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:05 ntpd[17104]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:05.065 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:05 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:05.065 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:05 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:05.065 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:05 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:05.065 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:05 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:05.065 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:05 ntpd[17241]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:05.065 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:05 ntpd[17241]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:06.031 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:06 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:06.031 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:06 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:06.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:06 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:06.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:06 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:06.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:06 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:06.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:06 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:06.035 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:06 ntpd[17104]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:06.035 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:06 ntpd[17104]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:06.035 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:06 ntpd[17104]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:06.035 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:06 ntpd[17104]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:06.036 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:06 ntpd[17104]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:06.036 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:06 ntpd[17104]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:06.036 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:06 ntpd[17104]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:06.036 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:06 ntpd[17104]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:06.036 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:06 ntpd[17104]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:06.036 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:06 ntpd[17104]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:06.036 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:06 ntpd[17104]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:06.036 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:06 ntpd[17104]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:06.036 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:06 ntpd[17104]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:06.037 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:06 ntpd[17104]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:06.037 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:06 ntpd[17104]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:06.037 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:06 ntpd[17104]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:06.037 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:06 ntpd[17104]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:06.037 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:06 ntpd[17104]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:06.039 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:06 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:06.039 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:06 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:06 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:06 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:06 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:06 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:06 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:06 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:06 ntpd[17201]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:06 ntpd[17201]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:06 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:06 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:06 ntpd[17201]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:06 ntpd[17201]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:06 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:06 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:06.040 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:06 ntpd[17201]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:06.041 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:06 ntpd[17201]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:06.067 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:06 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:06.067 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:06 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:06.067 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:06 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:06.067 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:06 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:06.068 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:06 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:06.068 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:06 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:06.068 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:06 ntpd[17241]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:06.068 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:06 ntpd[17241]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:06.068 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:06 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:06.068 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:06 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:06.069 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:06 ntpd[17241]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:06.069 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:06 ntpd[17241]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:07.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:07 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:07.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:07 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:07.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:07 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:07.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:07 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:07.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:07 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:07.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:07 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:07.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:07 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:07.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:07 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:07.033 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:07 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:07.033 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:07 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:07.033 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:07 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:07.033 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:07 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:07.065 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:07 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:07.065 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:07 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:07.065 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:07 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:07.065 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:07 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:07.065 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:07 ntpd[17241]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:07.065 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:07 ntpd[17241]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:08.031 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:08 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:08.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:08 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:08.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:08 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:08.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:08 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:08.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:08 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:08.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:08 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:08.033 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:08 ntpd[17104]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:08.033 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:08 ntpd[17104]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:08.033 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:08 ntpd[17104]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:08.033 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:08 ntpd[17104]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:08.034 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:08 ntpd[17104]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:08.034 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:08 ntpd[17104]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:08.034 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:08 ntpd[17104]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:08.034 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:08 ntpd[17104]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:08.034 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:08 ntpd[17104]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:08.034 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:08 ntpd[17104]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:08.034 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:08 ntpd[17104]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:08.034 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:08 ntpd[17104]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:08.034 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:08 ntpd[17104]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:08.034 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:08 ntpd[17104]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:08.034 INFO:teuthology.orchestra.run.smithi057.stdout:25 Apr 22:37:08 ntpd[17104]: ntpd: time slew -0.001095 s 2024-04-25T22:37:08.035 INFO:teuthology.orchestra.run.smithi057.stdout:ntpd: time slew -0.001095s 2024-04-25T22:37:08.035 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:08 ntpd[17104]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T22:37:08.035 INFO:teuthology.orchestra.run.smithi057.stderr:25 Apr 22:37:08 ntpd[17104]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T22:37:08.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:08 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:08.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:08 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:08.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:08 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:08.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:08 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:08.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:08 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:08.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:08 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:08.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:08 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:08.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:08 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:08.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:08 ntpd[17201]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:08.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:08 ntpd[17201]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:08.037 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:08 ntpd[17201]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:08.038 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:08 ntpd[17201]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:08.038 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:08 ntpd[17201]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:08.038 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:08 ntpd[17201]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:08.038 INFO:teuthology.orchestra.run.smithi148.stdout:25 Apr 22:37:08 ntpd[17201]: ntpd: time slew +0.000102 s 2024-04-25T22:37:08.038 INFO:teuthology.orchestra.run.smithi148.stdout:ntpd: time slew +0.000102s 2024-04-25T22:37:08.038 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:08 ntpd[17201]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T22:37:08.039 INFO:teuthology.orchestra.run.smithi148.stderr:25 Apr 22:37:08 ntpd[17201]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T22:37:08.065 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:08 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:08.065 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:08 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:08.065 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:08 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:08.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:08 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:08.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:08 ntpd[17241]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:08.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:08 ntpd[17241]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:08.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:08 ntpd[17241]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:08.066 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:08 ntpd[17241]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:08.066 INFO:teuthology.orchestra.run.smithi188.stdout:25 Apr 22:37:08 ntpd[17241]: ntpd: time slew -0.000445 s 2024-04-25T22:37:08.066 INFO:teuthology.orchestra.run.smithi188.stdout:ntpd: time slew -0.000445s 2024-04-25T22:37:08.067 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:08 ntpd[17241]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T22:37:08.067 INFO:teuthology.orchestra.run.smithi188.stderr:25 Apr 22:37:08 ntpd[17241]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T22:37:08.079 INFO:teuthology.orchestra.run.smithi057.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T22:37:08.079 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================== 2024-04-25T22:37:08.079 INFO:teuthology.orchestra.run.smithi057.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:37:08.079 INFO:teuthology.orchestra.run.smithi057.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:37:08.079 INFO:teuthology.orchestra.run.smithi057.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:37:08.079 INFO:teuthology.orchestra.run.smithi057.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:37:08.115 INFO:teuthology.orchestra.run.smithi188.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T22:37:08.115 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================== 2024-04-25T22:37:08.115 INFO:teuthology.orchestra.run.smithi188.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:37:08.116 INFO:teuthology.orchestra.run.smithi188.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:37:08.116 INFO:teuthology.orchestra.run.smithi188.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:37:08.116 INFO:teuthology.orchestra.run.smithi188.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:37:08.164 INFO:teuthology.orchestra.run.smithi148.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T22:37:08.164 INFO:teuthology.orchestra.run.smithi148.stdout:============================================================================== 2024-04-25T22:37:08.164 INFO:teuthology.orchestra.run.smithi148.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:37:08.164 INFO:teuthology.orchestra.run.smithi148.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:37:08.164 INFO:teuthology.orchestra.run.smithi148.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:37:08.164 INFO:teuthology.orchestra.run.smithi148.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:37:09.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:09 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:09.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:09 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:09.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:09 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:09.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:09 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:09.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:09 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T22:37:09.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:09 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T22:37:09.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:09 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T22:37:09.032 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:09 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T22:37:09.033 INFO:teuthology.orchestra.run.smithi122.stdout:25 Apr 22:37:09 ntpd[17200]: ntpd: time slew -0.001107 s 2024-04-25T22:37:09.033 INFO:teuthology.orchestra.run.smithi122.stdout:ntpd: time slew -0.001107s 2024-04-25T22:37:09.033 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:09 ntpd[17200]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T22:37:09.033 INFO:teuthology.orchestra.run.smithi122.stderr:25 Apr 22:37:09 ntpd[17200]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T22:37:09.170 INFO:teuthology.orchestra.run.smithi122.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T22:37:09.171 INFO:teuthology.orchestra.run.smithi122.stdout:============================================================================== 2024-04-25T22:37:09.171 INFO:teuthology.orchestra.run.smithi122.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:37:09.171 INFO:teuthology.orchestra.run.smithi122.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:37:09.171 INFO:teuthology.orchestra.run.smithi122.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:37:09.171 INFO:teuthology.orchestra.run.smithi122.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:37:09.171 INFO:teuthology.run_tasks:Running task install... 2024-04-25T22:37:09.180 DEBUG:teuthology.task.install:project ceph 2024-04-25T22:37:09.180 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}} 2024-04-25T22:37:09.180 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-25T22:37:09.181 INFO:teuthology.task.install:Using flavor: default 2024-04-25T22:37:09.188 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T22:37:09.188 INFO:teuthology.task.install:extra packages: [] 2024-04-25T22:37:09.189 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-key list | grep Ceph 2024-04-25T22:37:09.189 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-key list | grep Ceph 2024-04-25T22:37:09.190 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-key list | grep Ceph 2024-04-25T22:37:09.190 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-key list | grep Ceph 2024-04-25T22:37:09.252 INFO:teuthology.orchestra.run.smithi188.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T22:37:09.254 INFO:teuthology.orchestra.run.smithi057.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T22:37:09.255 INFO:teuthology.orchestra.run.smithi148.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T22:37:09.274 INFO:teuthology.orchestra.run.smithi122.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T22:37:09.281 INFO:teuthology.orchestra.run.smithi188.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T22:37:09.281 INFO:teuthology.orchestra.run.smithi188.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T22:37:09.281 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-25T22:37:09.281 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-25T22:37:09.282 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:37:09.288 INFO:teuthology.orchestra.run.smithi057.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T22:37:09.288 INFO:teuthology.orchestra.run.smithi057.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T22:37:09.288 INFO:teuthology.orchestra.run.smithi148.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T22:37:09.288 INFO:teuthology.orchestra.run.smithi148.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T22:37:09.289 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-25T22:37:09.289 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-25T22:37:09.289 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:37:09.290 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-25T22:37:09.290 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-25T22:37:09.290 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:37:09.303 INFO:teuthology.orchestra.run.smithi122.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T22:37:09.303 INFO:teuthology.orchestra.run.smithi122.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T22:37:09.303 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-25T22:37:09.303 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-25T22:37:09.304 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:37:09.435 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-25T22:37:09.435 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:37:09.449 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-25T22:37:09.449 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:37:09.610 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-25T22:37:09.611 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:37:09.614 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-25T22:37:09.615 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:37:09.723 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-25T22:37:09.723 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T22:37:09.725 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:37:09.726 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T22:37:09.739 DEBUG:teuthology.orchestra.run.smithi188:> sudo apt-get update 2024-04-25T22:37:09.740 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get update 2024-04-25T22:37:09.875 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-25T22:37:09.876 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T22:37:09.890 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-get update 2024-04-25T22:37:09.945 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:37:09.945 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T22:37:09.951 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:37:09.963 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-25T22:37:09.963 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T22:37:09.968 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T22:37:09.973 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T22:37:09.977 DEBUG:teuthology.orchestra.run.smithi122:> sudo apt-get update 2024-04-25T22:37:10.000 INFO:teuthology.orchestra.run.smithi188.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T22:37:10.004 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T22:37:10.102 INFO:teuthology.orchestra.run.smithi188.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T22:37:10.102 INFO:teuthology.orchestra.run.smithi057.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T22:37:10.111 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T22:37:10.111 INFO:teuthology.orchestra.run.smithi148.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T22:37:10.132 INFO:teuthology.orchestra.run.smithi148.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T22:37:10.155 INFO:teuthology.orchestra.run.smithi148.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T22:37:10.171 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T22:37:10.172 INFO:teuthology.orchestra.run.smithi188.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T22:37:10.175 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,416 B] 2024-04-25T22:37:10.203 INFO:teuthology.orchestra.run.smithi148.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-25T22:37:10.227 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:37:10.240 INFO:teuthology.orchestra.run.smithi188.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T22:37:10.240 INFO:teuthology.orchestra.run.smithi057.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T22:37:10.270 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T22:37:10.313 INFO:teuthology.orchestra.run.smithi188.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,416 B] 2024-04-25T22:37:10.313 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,416 B] 2024-04-25T22:37:10.326 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T22:37:10.389 INFO:teuthology.orchestra.run.smithi188.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-25T22:37:10.393 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-25T22:37:10.397 INFO:teuthology.orchestra.run.smithi122.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T22:37:10.465 INFO:teuthology.orchestra.run.smithi122.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T22:37:10.486 INFO:teuthology.orchestra.run.smithi188.stdout:Fetched 28.9 kB in 1s (52.8 kB/s) 2024-04-25T22:37:10.537 INFO:teuthology.orchestra.run.smithi122.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T22:37:10.610 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-25T22:37:10.658 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:9 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T22:37:10.692 INFO:teuthology.orchestra.run.smithi122.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,416 B] 2024-04-25T22:37:10.796 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T22:37:10.828 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 28.9 kB in 1s (32.2 kB/s) 2024-04-25T22:37:10.878 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T22:37:10.880 INFO:teuthology.orchestra.run.smithi122.stdout:Hit:9 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T22:37:10.959 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T22:37:11.043 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 28.9 kB in 1s (32.9 kB/s) 2024-04-25T22:37:11.114 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 28.9 kB in 1s (27.7 kB/s) 2024-04-25T22:37:11.467 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-04-25T22:37:11.483 DEBUG:teuthology.orchestra.run.smithi188:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:37:11.535 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-04-25T22:37:11.712 INFO:teuthology.orchestra.run.smithi188.stdout:Building dependency tree... 2024-04-25T22:37:11.713 INFO:teuthology.orchestra.run.smithi188.stdout:Reading state information... 2024-04-25T22:37:11.796 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-25T22:37:11.813 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:37:11.878 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-25T22:37:11.887 INFO:teuthology.orchestra.run.smithi188.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:37:11.887 INFO:teuthology.orchestra.run.smithi188.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:37:11.887 INFO:teuthology.orchestra.run.smithi188.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:37:11.887 INFO:teuthology.orchestra.run.smithi188.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:37:11.888 INFO:teuthology.orchestra.run.smithi188.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:37:11.888 INFO:teuthology.orchestra.run.smithi188.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:37:11.888 INFO:teuthology.orchestra.run.smithi188.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:37:11.888 INFO:teuthology.orchestra.run.smithi188.stdout:The following additional packages will be installed: 2024-04-25T22:37:11.888 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T22:37:11.888 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T22:37:11.890 INFO:teuthology.orchestra.run.smithi188.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T22:37:11.890 INFO:teuthology.orchestra.run.smithi188.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T22:37:11.890 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T22:37:11.890 INFO:teuthology.orchestra.run.smithi188.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T22:37:11.890 INFO:teuthology.orchestra.run.smithi188.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T22:37:11.890 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T22:37:11.890 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T22:37:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T22:37:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T22:37:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T22:37:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T22:37:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T22:37:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T22:37:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T22:37:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-25T22:37:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-25T22:37:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T22:37:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T22:37:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T22:37:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T22:37:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-25T22:37:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet zip 2024-04-25T22:37:11.892 INFO:teuthology.orchestra.run.smithi188.stdout:Suggested packages: 2024-04-25T22:37:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T22:37:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T22:37:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T22:37:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T22:37:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T22:37:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T22:37:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T22:37:11.893 INFO:teuthology.orchestra.run.smithi188.stdout:Recommended packages: 2024-04-25T22:37:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: btrfs-tools 2024-04-25T22:37:11.989 INFO:teuthology.orchestra.run.smithi188.stdout:The following NEW packages will be installed: 2024-04-25T22:37:11.989 INFO:teuthology.orchestra.run.smithi188.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T22:37:11.989 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T22:37:11.989 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-25T22:37:11.989 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-25T22:37:11.990 INFO:teuthology.orchestra.run.smithi188.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-25T22:37:11.990 INFO:teuthology.orchestra.run.smithi188.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-25T22:37:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-25T22:37:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-25T22:37:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-25T22:37:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-25T22:37:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-25T22:37:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T22:37:11.991 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T22:37:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T22:37:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T22:37:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T22:37:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T22:37:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T22:37:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-25T22:37:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-25T22:37:11.992 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-25T22:37:11.993 INFO:teuthology.orchestra.run.smithi188.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-25T22:37:11.993 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-25T22:37:11.993 INFO:teuthology.orchestra.run.smithi188.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-25T22:37:11.993 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-25T22:37:11.993 INFO:teuthology.orchestra.run.smithi188.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-25T22:37:12.009 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-04-25T22:37:12.026 DEBUG:teuthology.orchestra.run.smithi122:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:37:12.078 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-04-25T22:37:12.082 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2024-04-25T22:37:12.082 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2024-04-25T22:37:12.105 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2024-04-25T22:37:12.120 DEBUG:teuthology.orchestra.run.smithi148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:37:12.133 INFO:teuthology.orchestra.run.smithi188.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T22:37:12.133 INFO:teuthology.orchestra.run.smithi188.stdout:Need to get 179 MB of archives. 2024-04-25T22:37:12.133 INFO:teuthology.orchestra.run.smithi188.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-25T22:37:12.133 INFO:teuthology.orchestra.run.smithi188.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,541 kB] 2024-04-25T22:37:12.173 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2024-04-25T22:37:12.253 INFO:teuthology.orchestra.run.smithi122.stdout:Building dependency tree... 2024-04-25T22:37:12.254 INFO:teuthology.orchestra.run.smithi122.stdout:Reading state information... 2024-04-25T22:37:12.288 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:37:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:37:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:37:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:37:12.288 INFO:teuthology.orchestra.run.smithi057.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:37:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:37:12.289 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:37:12.289 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2024-04-25T22:37:12.289 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T22:37:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T22:37:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T22:37:12.290 INFO:teuthology.orchestra.run.smithi057.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T22:37:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T22:37:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T22:37:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T22:37:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T22:37:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T22:37:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T22:37:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T22:37:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T22:37:12.291 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T22:37:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T22:37:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T22:37:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T22:37:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-25T22:37:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-25T22:37:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T22:37:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T22:37:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T22:37:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T22:37:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-25T22:37:12.292 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet zip 2024-04-25T22:37:12.293 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2024-04-25T22:37:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T22:37:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T22:37:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T22:37:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T22:37:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T22:37:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T22:37:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T22:37:12.293 INFO:teuthology.orchestra.run.smithi057.stdout:Recommended packages: 2024-04-25T22:37:12.293 INFO:teuthology.orchestra.run.smithi057.stdout: btrfs-tools 2024-04-25T22:37:12.342 INFO:teuthology.orchestra.run.smithi188.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-25T22:37:12.350 INFO:teuthology.orchestra.run.smithi148.stdout:Building dependency tree... 2024-04-25T22:37:12.351 INFO:teuthology.orchestra.run.smithi148.stdout:Reading state information... 2024-04-25T22:37:12.399 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2024-04-25T22:37:12.399 INFO:teuthology.orchestra.run.smithi057.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T22:37:12.399 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T22:37:12.399 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-25T22:37:12.400 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-25T22:37:12.401 INFO:teuthology.orchestra.run.smithi057.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-25T22:37:12.401 INFO:teuthology.orchestra.run.smithi057.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-25T22:37:12.401 INFO:teuthology.orchestra.run.smithi057.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-25T22:37:12.401 INFO:teuthology.orchestra.run.smithi057.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-25T22:37:12.401 INFO:teuthology.orchestra.run.smithi057.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-25T22:37:12.401 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-25T22:37:12.401 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-25T22:37:12.401 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T22:37:12.401 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T22:37:12.401 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T22:37:12.401 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T22:37:12.401 INFO:teuthology.orchestra.run.smithi057.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T22:37:12.402 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T22:37:12.402 INFO:teuthology.orchestra.run.smithi057.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T22:37:12.402 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-25T22:37:12.402 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-25T22:37:12.402 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-25T22:37:12.402 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-25T22:37:12.402 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-25T22:37:12.402 INFO:teuthology.orchestra.run.smithi057.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-25T22:37:12.402 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-25T22:37:12.402 INFO:teuthology.orchestra.run.smithi057.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-25T22:37:12.430 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:37:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:37:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:37:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:37:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:37:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:37:12.431 INFO:teuthology.orchestra.run.smithi122.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:37:12.432 INFO:teuthology.orchestra.run.smithi122.stdout:The following additional packages will be installed: 2024-04-25T22:37:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T22:37:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T22:37:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T22:37:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T22:37:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T22:37:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T22:37:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T22:37:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T22:37:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T22:37:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T22:37:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T22:37:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T22:37:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T22:37:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T22:37:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T22:37:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T22:37:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-25T22:37:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-25T22:37:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T22:37:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T22:37:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T22:37:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T22:37:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-25T22:37:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet zip 2024-04-25T22:37:12.434 INFO:teuthology.orchestra.run.smithi122.stdout:Suggested packages: 2024-04-25T22:37:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T22:37:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T22:37:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T22:37:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T22:37:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T22:37:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T22:37:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T22:37:12.435 INFO:teuthology.orchestra.run.smithi122.stdout:Recommended packages: 2024-04-25T22:37:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: btrfs-tools 2024-04-25T22:37:12.440 INFO:teuthology.orchestra.run.smithi188.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-25T22:37:12.462 INFO:teuthology.orchestra.run.smithi188.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-25T22:37:12.474 INFO:teuthology.orchestra.run.smithi188.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-25T22:37:12.475 INFO:teuthology.orchestra.run.smithi188.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-25T22:37:12.481 INFO:teuthology.orchestra.run.smithi188.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.8 kB] 2024-04-25T22:37:12.483 INFO:teuthology.orchestra.run.smithi188.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-25T22:37:12.494 INFO:teuthology.orchestra.run.smithi188.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-25T22:37:12.518 INFO:teuthology.orchestra.run.smithi057.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T22:37:12.518 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 179 MB of archives. 2024-04-25T22:37:12.518 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-25T22:37:12.518 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T22:37:12.525 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:37:12.525 INFO:teuthology.orchestra.run.smithi148.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:37:12.525 INFO:teuthology.orchestra.run.smithi148.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:37:12.525 INFO:teuthology.orchestra.run.smithi148.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:37:12.525 INFO:teuthology.orchestra.run.smithi148.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:37:12.526 INFO:teuthology.orchestra.run.smithi148.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:37:12.526 INFO:teuthology.orchestra.run.smithi148.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:37:12.526 INFO:teuthology.orchestra.run.smithi148.stdout:The following additional packages will be installed: 2024-04-25T22:37:12.526 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T22:37:12.527 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T22:37:12.527 INFO:teuthology.orchestra.run.smithi148.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T22:37:12.527 INFO:teuthology.orchestra.run.smithi148.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T22:37:12.528 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T22:37:12.528 INFO:teuthology.orchestra.run.smithi148.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T22:37:12.528 INFO:teuthology.orchestra.run.smithi148.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T22:37:12.528 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T22:37:12.528 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T22:37:12.528 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T22:37:12.528 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T22:37:12.528 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T22:37:12.528 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T22:37:12.528 INFO:teuthology.orchestra.run.smithi148.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T22:37:12.528 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T22:37:12.529 INFO:teuthology.orchestra.run.smithi148.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T22:37:12.529 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-25T22:37:12.529 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-25T22:37:12.529 INFO:teuthology.orchestra.run.smithi148.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T22:37:12.529 INFO:teuthology.orchestra.run.smithi148.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T22:37:12.529 INFO:teuthology.orchestra.run.smithi148.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T22:37:12.529 INFO:teuthology.orchestra.run.smithi148.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T22:37:12.529 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-25T22:37:12.529 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet zip 2024-04-25T22:37:12.529 INFO:teuthology.orchestra.run.smithi148.stdout:Suggested packages: 2024-04-25T22:37:12.530 INFO:teuthology.orchestra.run.smithi148.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T22:37:12.530 INFO:teuthology.orchestra.run.smithi148.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T22:37:12.530 INFO:teuthology.orchestra.run.smithi148.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T22:37:12.530 INFO:teuthology.orchestra.run.smithi148.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T22:37:12.530 INFO:teuthology.orchestra.run.smithi148.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T22:37:12.530 INFO:teuthology.orchestra.run.smithi148.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T22:37:12.530 INFO:teuthology.orchestra.run.smithi148.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T22:37:12.530 INFO:teuthology.orchestra.run.smithi148.stdout:Recommended packages: 2024-04-25T22:37:12.530 INFO:teuthology.orchestra.run.smithi148.stdout: btrfs-tools 2024-04-25T22:37:12.532 INFO:teuthology.orchestra.run.smithi122.stdout:The following NEW packages will be installed: 2024-04-25T22:37:12.532 INFO:teuthology.orchestra.run.smithi122.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T22:37:12.533 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T22:37:12.533 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-25T22:37:12.533 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-25T22:37:12.533 INFO:teuthology.orchestra.run.smithi122.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-25T22:37:12.533 INFO:teuthology.orchestra.run.smithi122.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-25T22:37:12.534 INFO:teuthology.orchestra.run.smithi122.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-25T22:37:12.534 INFO:teuthology.orchestra.run.smithi122.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-25T22:37:12.534 INFO:teuthology.orchestra.run.smithi122.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-25T22:37:12.534 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-25T22:37:12.534 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-25T22:37:12.534 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T22:37:12.534 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T22:37:12.534 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T22:37:12.535 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T22:37:12.535 INFO:teuthology.orchestra.run.smithi122.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T22:37:12.535 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T22:37:12.535 INFO:teuthology.orchestra.run.smithi122.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T22:37:12.535 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-25T22:37:12.535 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-25T22:37:12.535 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-25T22:37:12.535 INFO:teuthology.orchestra.run.smithi122.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-25T22:37:12.535 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-25T22:37:12.535 INFO:teuthology.orchestra.run.smithi122.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-25T22:37:12.535 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-25T22:37:12.535 INFO:teuthology.orchestra.run.smithi122.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-25T22:37:12.628 INFO:teuthology.orchestra.run.smithi148.stdout:The following NEW packages will be installed: 2024-04-25T22:37:12.628 INFO:teuthology.orchestra.run.smithi148.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T22:37:12.628 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T22:37:12.628 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-25T22:37:12.628 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-25T22:37:12.628 INFO:teuthology.orchestra.run.smithi148.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-25T22:37:12.628 INFO:teuthology.orchestra.run.smithi148.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-25T22:37:12.630 INFO:teuthology.orchestra.run.smithi148.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-25T22:37:12.630 INFO:teuthology.orchestra.run.smithi148.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-25T22:37:12.630 INFO:teuthology.orchestra.run.smithi148.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-25T22:37:12.630 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-25T22:37:12.630 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-25T22:37:12.630 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T22:37:12.630 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T22:37:12.630 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T22:37:12.630 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T22:37:12.630 INFO:teuthology.orchestra.run.smithi148.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T22:37:12.630 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T22:37:12.630 INFO:teuthology.orchestra.run.smithi148.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T22:37:12.630 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-25T22:37:12.631 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-25T22:37:12.631 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-25T22:37:12.631 INFO:teuthology.orchestra.run.smithi148.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-25T22:37:12.631 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-25T22:37:12.631 INFO:teuthology.orchestra.run.smithi148.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-25T22:37:12.631 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-25T22:37:12.631 INFO:teuthology.orchestra.run.smithi148.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-25T22:37:12.718 INFO:teuthology.orchestra.run.smithi188.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-25T22:37:12.720 INFO:teuthology.orchestra.run.smithi188.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [467 kB] 2024-04-25T22:37:12.735 INFO:teuthology.orchestra.run.smithi188.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-25T22:37:12.812 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T22:37:12.818 INFO:teuthology.orchestra.run.smithi148.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T22:37:12.818 INFO:teuthology.orchestra.run.smithi148.stdout:Need to get 179 MB of archives. 2024-04-25T22:37:12.818 INFO:teuthology.orchestra.run.smithi148.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-25T22:37:12.818 INFO:teuthology.orchestra.run.smithi148.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T22:37:12.835 INFO:teuthology.orchestra.run.smithi188.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T22:37:12.866 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T22:37:12.870 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T22:37:13.002 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,541 kB] 2024-04-25T22:37:13.061 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T22:37:13.072 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T22:37:13.103 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T22:37:13.151 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T22:37:13.152 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T22:37:13.153 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T22:37:13.168 INFO:teuthology.orchestra.run.smithi057.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T22:37:13.172 INFO:teuthology.orchestra.run.smithi057.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T22:37:13.179 INFO:teuthology.orchestra.run.smithi057.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T22:37:13.183 INFO:teuthology.orchestra.run.smithi057.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T22:37:13.184 INFO:teuthology.orchestra.run.smithi057.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T22:37:13.188 INFO:teuthology.orchestra.run.smithi057.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T22:37:13.193 INFO:teuthology.orchestra.run.smithi057.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T22:37:13.216 INFO:teuthology.orchestra.run.smithi148.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,541 kB] 2024-04-25T22:37:13.216 INFO:teuthology.orchestra.run.smithi057.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T22:37:13.218 INFO:teuthology.orchestra.run.smithi057.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T22:37:13.218 INFO:teuthology.orchestra.run.smithi057.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T22:37:13.249 INFO:teuthology.orchestra.run.smithi057.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T22:37:13.250 INFO:teuthology.orchestra.run.smithi057.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T22:37:13.251 INFO:teuthology.orchestra.run.smithi057.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T22:37:13.252 INFO:teuthology.orchestra.run.smithi057.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T22:37:13.253 INFO:teuthology.orchestra.run.smithi057.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T22:37:13.254 INFO:teuthology.orchestra.run.smithi057.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T22:37:13.254 INFO:teuthology.orchestra.run.smithi057.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T22:37:13.259 INFO:teuthology.orchestra.run.smithi188.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T22:37:13.272 INFO:teuthology.orchestra.run.smithi188.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T22:37:13.281 INFO:teuthology.orchestra.run.smithi057.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T22:37:13.283 INFO:teuthology.orchestra.run.smithi057.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T22:37:13.283 INFO:teuthology.orchestra.run.smithi057.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T22:37:13.321 INFO:teuthology.orchestra.run.smithi057.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T22:37:13.323 INFO:teuthology.orchestra.run.smithi057.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T22:37:13.324 INFO:teuthology.orchestra.run.smithi057.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T22:37:13.325 INFO:teuthology.orchestra.run.smithi057.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T22:37:13.327 INFO:teuthology.orchestra.run.smithi057.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T22:37:13.329 INFO:teuthology.orchestra.run.smithi057.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T22:37:13.330 INFO:teuthology.orchestra.run.smithi057.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T22:37:13.338 INFO:teuthology.orchestra.run.smithi122.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T22:37:13.338 INFO:teuthology.orchestra.run.smithi122.stdout:Need to get 179 MB of archives. 2024-04-25T22:37:13.338 INFO:teuthology.orchestra.run.smithi122.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-25T22:37:13.338 INFO:teuthology.orchestra.run.smithi122.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T22:37:13.339 INFO:teuthology.orchestra.run.smithi148.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T22:37:13.353 INFO:teuthology.orchestra.run.smithi188.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T22:37:13.379 INFO:teuthology.orchestra.run.smithi057.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T22:37:13.379 INFO:teuthology.orchestra.run.smithi057.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T22:37:13.380 INFO:teuthology.orchestra.run.smithi057.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T22:37:13.412 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T22:37:13.420 INFO:teuthology.orchestra.run.smithi122.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,541 kB] 2024-04-25T22:37:13.433 INFO:teuthology.orchestra.run.smithi057.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T22:37:13.435 INFO:teuthology.orchestra.run.smithi057.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T22:37:13.439 INFO:teuthology.orchestra.run.smithi057.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T22:37:13.441 INFO:teuthology.orchestra.run.smithi057.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T22:37:13.443 INFO:teuthology.orchestra.run.smithi057.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T22:37:13.445 INFO:teuthology.orchestra.run.smithi057.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T22:37:13.450 INFO:teuthology.orchestra.run.smithi057.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T22:37:13.472 INFO:teuthology.orchestra.run.smithi057.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T22:37:13.473 INFO:teuthology.orchestra.run.smithi057.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T22:37:13.478 INFO:teuthology.orchestra.run.smithi057.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T22:37:13.579 INFO:teuthology.orchestra.run.smithi057.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T22:37:13.581 INFO:teuthology.orchestra.run.smithi057.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T22:37:13.583 INFO:teuthology.orchestra.run.smithi057.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T22:37:13.584 INFO:teuthology.orchestra.run.smithi057.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T22:37:13.586 INFO:teuthology.orchestra.run.smithi057.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T22:37:13.627 INFO:teuthology.orchestra.run.smithi057.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T22:37:13.631 INFO:teuthology.orchestra.run.smithi057.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T22:37:13.631 INFO:teuthology.orchestra.run.smithi057.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T22:37:13.673 INFO:teuthology.orchestra.run.smithi057.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T22:37:13.673 INFO:teuthology.orchestra.run.smithi057.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T22:37:13.674 INFO:teuthology.orchestra.run.smithi057.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T22:37:13.675 INFO:teuthology.orchestra.run.smithi057.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T22:37:13.675 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T22:37:13.696 INFO:teuthology.orchestra.run.smithi057.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T22:37:13.697 INFO:teuthology.orchestra.run.smithi057.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T22:37:13.697 INFO:teuthology.orchestra.run.smithi057.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T22:37:13.698 INFO:teuthology.orchestra.run.smithi057.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T22:37:13.706 INFO:teuthology.orchestra.run.smithi057.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T22:37:13.724 INFO:teuthology.orchestra.run.smithi188.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T22:37:13.742 INFO:teuthology.orchestra.run.smithi057.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T22:37:13.744 INFO:teuthology.orchestra.run.smithi057.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T22:37:13.745 INFO:teuthology.orchestra.run.smithi057.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T22:37:13.752 INFO:teuthology.orchestra.run.smithi057.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T22:37:13.757 INFO:teuthology.orchestra.run.smithi057.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T22:37:13.759 INFO:teuthology.orchestra.run.smithi122.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T22:37:13.775 INFO:teuthology.orchestra.run.smithi188.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T22:37:13.775 INFO:teuthology.orchestra.run.smithi188.stdout:Get:19 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-25T22:37:13.778 INFO:teuthology.orchestra.run.smithi122.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T22:37:13.803 INFO:teuthology.orchestra.run.smithi057.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T22:37:13.804 INFO:teuthology.orchestra.run.smithi057.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T22:37:13.814 INFO:teuthology.orchestra.run.smithi057.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T22:37:13.815 INFO:teuthology.orchestra.run.smithi057.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T22:37:13.853 INFO:teuthology.orchestra.run.smithi122.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T22:37:13.854 INFO:teuthology.orchestra.run.smithi188.stdout:Get:20 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-25T22:37:13.857 INFO:teuthology.orchestra.run.smithi188.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-25T22:37:13.859 INFO:teuthology.orchestra.run.smithi188.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,526 kB] 2024-04-25T22:37:13.872 INFO:teuthology.orchestra.run.smithi188.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T22:37:13.897 INFO:teuthology.orchestra.run.smithi057.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T22:37:13.898 INFO:teuthology.orchestra.run.smithi057.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T22:37:13.899 INFO:teuthology.orchestra.run.smithi057.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T22:37:13.900 INFO:teuthology.orchestra.run.smithi057.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T22:37:13.901 INFO:teuthology.orchestra.run.smithi188.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-25T22:37:13.904 INFO:teuthology.orchestra.run.smithi057.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T22:37:13.906 INFO:teuthology.orchestra.run.smithi057.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T22:37:13.921 INFO:teuthology.orchestra.run.smithi188.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T22:37:13.922 INFO:teuthology.orchestra.run.smithi188.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T22:37:13.923 INFO:teuthology.orchestra.run.smithi188.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T22:37:13.930 INFO:teuthology.orchestra.run.smithi057.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T22:37:13.931 INFO:teuthology.orchestra.run.smithi057.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T22:37:13.931 INFO:teuthology.orchestra.run.smithi057.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T22:37:13.940 INFO:teuthology.orchestra.run.smithi057.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T22:37:13.941 INFO:teuthology.orchestra.run.smithi057.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T22:37:14.015 INFO:teuthology.orchestra.run.smithi188.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T22:37:14.137 INFO:teuthology.orchestra.run.smithi188.stdout:Get:29 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-25T22:37:14.549 INFO:teuthology.orchestra.run.smithi122.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T22:37:14.789 INFO:teuthology.orchestra.run.smithi057.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-25T22:37:14.877 INFO:teuthology.orchestra.run.smithi188.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T22:37:15.131 INFO:teuthology.orchestra.run.smithi188.stdout:Get:31 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-25T22:37:15.131 INFO:teuthology.orchestra.run.smithi188.stdout:Get:32 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-25T22:37:15.149 INFO:teuthology.orchestra.run.smithi188.stdout:Get:33 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-25T22:37:15.190 INFO:teuthology.orchestra.run.smithi188.stdout:Get:34 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [791 kB] 2024-04-25T22:37:15.220 INFO:teuthology.orchestra.run.smithi188.stdout:Get:35 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-25T22:37:15.226 INFO:teuthology.orchestra.run.smithi188.stdout:Get:36 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-25T22:37:15.271 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T22:37:15.290 INFO:teuthology.orchestra.run.smithi188.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T22:37:15.335 INFO:teuthology.orchestra.run.smithi188.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T22:37:15.337 INFO:teuthology.orchestra.run.smithi188.stdout:Get:39 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-25T22:37:15.337 INFO:teuthology.orchestra.run.smithi188.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T22:37:15.369 INFO:teuthology.orchestra.run.smithi057.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-25T22:37:15.409 INFO:teuthology.orchestra.run.smithi188.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T22:37:15.461 INFO:teuthology.orchestra.run.smithi188.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T22:37:15.482 INFO:teuthology.orchestra.run.smithi188.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T22:37:15.488 INFO:teuthology.orchestra.run.smithi188.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T22:37:15.490 INFO:teuthology.orchestra.run.smithi188.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T22:37:15.498 INFO:teuthology.orchestra.run.smithi057.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-25T22:37:15.514 INFO:teuthology.orchestra.run.smithi188.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T22:37:15.515 INFO:teuthology.orchestra.run.smithi188.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T22:37:15.566 INFO:teuthology.orchestra.run.smithi057.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-25T22:37:15.567 INFO:teuthology.orchestra.run.smithi057.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-25T22:37:15.596 INFO:teuthology.orchestra.run.smithi057.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.8 kB] 2024-04-25T22:37:15.598 INFO:teuthology.orchestra.run.smithi057.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-25T22:37:15.642 INFO:teuthology.orchestra.run.smithi057.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-25T22:37:15.736 INFO:teuthology.orchestra.run.smithi188.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-25T22:37:15.737 INFO:teuthology.orchestra.run.smithi188.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-25T22:37:16.171 INFO:teuthology.orchestra.run.smithi148.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-25T22:37:16.367 INFO:teuthology.orchestra.run.smithi188.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T22:37:16.451 INFO:teuthology.orchestra.run.smithi188.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T22:37:16.478 INFO:teuthology.orchestra.run.smithi057.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-25T22:37:16.479 INFO:teuthology.orchestra.run.smithi188.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T22:37:16.496 INFO:teuthology.orchestra.run.smithi188.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T22:37:16.497 INFO:teuthology.orchestra.run.smithi057.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [467 kB] 2024-04-25T22:37:16.538 INFO:teuthology.orchestra.run.smithi057.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-25T22:37:16.544 INFO:teuthology.orchestra.run.smithi188.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T22:37:16.753 INFO:teuthology.orchestra.run.smithi188.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T22:37:16.770 INFO:teuthology.orchestra.run.smithi188.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T22:37:16.775 INFO:teuthology.orchestra.run.smithi188.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T22:37:16.780 INFO:teuthology.orchestra.run.smithi188.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T22:37:16.803 INFO:teuthology.orchestra.run.smithi188.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T22:37:16.805 INFO:teuthology.orchestra.run.smithi188.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T22:37:16.835 INFO:teuthology.orchestra.run.smithi122.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-25T22:37:17.079 INFO:teuthology.orchestra.run.smithi122.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T22:37:17.182 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T22:37:17.354 INFO:teuthology.orchestra.run.smithi122.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T22:37:17.372 INFO:teuthology.orchestra.run.smithi122.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T22:37:17.397 INFO:teuthology.orchestra.run.smithi122.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T22:37:17.484 INFO:teuthology.orchestra.run.smithi148.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T22:37:17.600 INFO:teuthology.orchestra.run.smithi188.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T22:37:17.758 INFO:teuthology.orchestra.run.smithi122.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T22:37:17.920 INFO:teuthology.orchestra.run.smithi188.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T22:37:17.960 INFO:teuthology.orchestra.run.smithi188.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T22:37:17.972 INFO:teuthology.orchestra.run.smithi188.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T22:37:17.985 INFO:teuthology.orchestra.run.smithi148.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-25T22:37:18.181 INFO:teuthology.orchestra.run.smithi188.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T22:37:18.181 INFO:teuthology.orchestra.run.smithi188.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T22:37:18.186 INFO:teuthology.orchestra.run.smithi188.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T22:37:18.192 INFO:teuthology.orchestra.run.smithi188.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T22:37:18.208 INFO:teuthology.orchestra.run.smithi188.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T22:37:18.228 INFO:teuthology.orchestra.run.smithi188.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T22:37:18.234 INFO:teuthology.orchestra.run.smithi188.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T22:37:18.438 INFO:teuthology.orchestra.run.smithi148.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-25T22:37:18.628 INFO:teuthology.orchestra.run.smithi148.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-25T22:37:18.629 INFO:teuthology.orchestra.run.smithi122.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T22:37:18.631 INFO:teuthology.orchestra.run.smithi148.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-25T22:37:18.694 INFO:teuthology.orchestra.run.smithi188.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-25T22:37:18.697 INFO:teuthology.orchestra.run.smithi188.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-25T22:37:18.698 INFO:teuthology.orchestra.run.smithi188.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-25T22:37:18.763 INFO:teuthology.orchestra.run.smithi148.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.8 kB] 2024-04-25T22:37:18.765 INFO:teuthology.orchestra.run.smithi148.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-25T22:37:18.955 INFO:teuthology.orchestra.run.smithi148.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-25T22:37:19.031 INFO:teuthology.orchestra.run.smithi122.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T22:37:19.054 INFO:teuthology.orchestra.run.smithi122.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-25T22:37:19.056 INFO:teuthology.orchestra.run.smithi148.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T22:37:19.066 INFO:teuthology.orchestra.run.smithi122.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T22:37:19.068 INFO:teuthology.orchestra.run.smithi122.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T22:37:19.083 INFO:teuthology.orchestra.run.smithi188.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T22:37:19.147 INFO:teuthology.orchestra.run.smithi122.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T22:37:19.199 INFO:teuthology.orchestra.run.smithi122.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T22:37:19.220 INFO:teuthology.orchestra.run.smithi122.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T22:37:19.226 INFO:teuthology.orchestra.run.smithi122.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T22:37:19.228 INFO:teuthology.orchestra.run.smithi122.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T22:37:19.250 INFO:teuthology.orchestra.run.smithi122.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T22:37:19.251 INFO:teuthology.orchestra.run.smithi122.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T22:37:19.319 INFO:teuthology.orchestra.run.smithi057.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-25T22:37:19.330 INFO:teuthology.orchestra.run.smithi188.stdout:Get:76 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.4 kB] 2024-04-25T22:37:19.346 INFO:teuthology.orchestra.run.smithi188.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T22:37:19.412 INFO:teuthology.orchestra.run.smithi122.stdout:Get:26 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-25T22:37:19.435 INFO:teuthology.orchestra.run.smithi148.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T22:37:19.460 INFO:teuthology.orchestra.run.smithi148.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T22:37:19.476 INFO:teuthology.orchestra.run.smithi057.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-25T22:37:19.486 INFO:teuthology.orchestra.run.smithi057.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-25T22:37:19.491 INFO:teuthology.orchestra.run.smithi057.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,526 kB] 2024-04-25T22:37:19.494 INFO:teuthology.orchestra.run.smithi148.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T22:37:19.524 INFO:teuthology.orchestra.run.smithi188.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T22:37:19.533 INFO:teuthology.orchestra.run.smithi122.stdout:Get:27 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-25T22:37:19.537 INFO:teuthology.orchestra.run.smithi122.stdout:Get:28 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-25T22:37:19.538 INFO:teuthology.orchestra.run.smithi188.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T22:37:19.554 INFO:teuthology.orchestra.run.smithi057.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-25T22:37:19.558 INFO:teuthology.orchestra.run.smithi188.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T22:37:19.590 INFO:teuthology.orchestra.run.smithi122.stdout:Get:29 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.8 kB] 2024-04-25T22:37:19.622 INFO:teuthology.orchestra.run.smithi122.stdout:Get:30 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-25T22:37:19.623 INFO:teuthology.orchestra.run.smithi188.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T22:37:19.719 INFO:teuthology.orchestra.run.smithi122.stdout:Get:31 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-25T22:37:19.816 INFO:teuthology.orchestra.run.smithi057.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-25T22:37:19.937 INFO:teuthology.orchestra.run.smithi188.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T22:37:19.939 INFO:teuthology.orchestra.run.smithi188.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T22:37:19.941 INFO:teuthology.orchestra.run.smithi188.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T22:37:19.954 INFO:teuthology.orchestra.run.smithi188.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T22:37:19.956 INFO:teuthology.orchestra.run.smithi188.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T22:37:19.962 INFO:teuthology.orchestra.run.smithi122.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T22:37:20.046 INFO:teuthology.orchestra.run.smithi122.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T22:37:20.074 INFO:teuthology.orchestra.run.smithi122.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T22:37:20.091 INFO:teuthology.orchestra.run.smithi122.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T22:37:20.138 INFO:teuthology.orchestra.run.smithi122.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T22:37:20.359 INFO:teuthology.orchestra.run.smithi122.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T22:37:20.374 INFO:teuthology.orchestra.run.smithi122.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T22:37:20.380 INFO:teuthology.orchestra.run.smithi122.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T22:37:20.385 INFO:teuthology.orchestra.run.smithi122.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T22:37:20.417 INFO:teuthology.orchestra.run.smithi122.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T22:37:20.420 INFO:teuthology.orchestra.run.smithi122.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T22:37:20.689 INFO:teuthology.orchestra.run.smithi188.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T22:37:20.780 INFO:teuthology.orchestra.run.smithi148.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T22:37:20.885 INFO:teuthology.orchestra.run.smithi057.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-25T22:37:20.885 INFO:teuthology.orchestra.run.smithi057.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-25T22:37:20.902 INFO:teuthology.orchestra.run.smithi057.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-25T22:37:20.969 INFO:teuthology.orchestra.run.smithi057.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [791 kB] 2024-04-25T22:37:21.004 INFO:teuthology.orchestra.run.smithi057.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-25T22:37:21.010 INFO:teuthology.orchestra.run.smithi057.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-25T22:37:21.021 INFO:teuthology.orchestra.run.smithi148.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-25T22:37:21.060 INFO:teuthology.orchestra.run.smithi148.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [467 kB] 2024-04-25T22:37:21.071 INFO:teuthology.orchestra.run.smithi122.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T22:37:21.102 INFO:teuthology.orchestra.run.smithi057.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-25T22:37:21.118 INFO:teuthology.orchestra.run.smithi188.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T22:37:21.124 INFO:teuthology.orchestra.run.smithi188.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T22:37:21.184 INFO:teuthology.orchestra.run.smithi148.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-25T22:37:21.244 INFO:teuthology.orchestra.run.smithi148.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T22:37:21.391 INFO:teuthology.orchestra.run.smithi122.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T22:37:21.429 INFO:teuthology.orchestra.run.smithi122.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T22:37:21.440 INFO:teuthology.orchestra.run.smithi122.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T22:37:21.474 INFO:teuthology.orchestra.run.smithi057.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-25T22:37:21.475 INFO:teuthology.orchestra.run.smithi057.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-25T22:37:21.505 INFO:teuthology.orchestra.run.smithi188.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T22:37:21.506 INFO:teuthology.orchestra.run.smithi188.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T22:37:21.510 INFO:teuthology.orchestra.run.smithi188.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T22:37:21.511 INFO:teuthology.orchestra.run.smithi188.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T22:37:21.512 INFO:teuthology.orchestra.run.smithi188.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T22:37:21.514 INFO:teuthology.orchestra.run.smithi188.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T22:37:21.514 INFO:teuthology.orchestra.run.smithi188.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T22:37:21.516 INFO:teuthology.orchestra.run.smithi188.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T22:37:21.646 INFO:teuthology.orchestra.run.smithi122.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T22:37:21.646 INFO:teuthology.orchestra.run.smithi122.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T22:37:21.652 INFO:teuthology.orchestra.run.smithi122.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T22:37:21.655 INFO:teuthology.orchestra.run.smithi148.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T22:37:21.658 INFO:teuthology.orchestra.run.smithi122.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T22:37:21.673 INFO:teuthology.orchestra.run.smithi122.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T22:37:21.690 INFO:teuthology.orchestra.run.smithi148.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T22:37:21.692 INFO:teuthology.orchestra.run.smithi148.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T22:37:21.694 INFO:teuthology.orchestra.run.smithi122.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T22:37:21.700 INFO:teuthology.orchestra.run.smithi122.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T22:37:21.772 INFO:teuthology.orchestra.run.smithi148.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T22:37:21.781 INFO:teuthology.orchestra.run.smithi122.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-25T22:37:21.819 INFO:teuthology.orchestra.run.smithi122.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [467 kB] 2024-04-25T22:37:21.823 INFO:teuthology.orchestra.run.smithi148.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T22:37:21.845 INFO:teuthology.orchestra.run.smithi148.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T22:37:21.851 INFO:teuthology.orchestra.run.smithi148.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T22:37:21.853 INFO:teuthology.orchestra.run.smithi148.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T22:37:21.864 INFO:teuthology.orchestra.run.smithi148.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T22:37:21.865 INFO:teuthology.orchestra.run.smithi148.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T22:37:21.953 INFO:teuthology.orchestra.run.smithi122.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-25T22:37:22.035 INFO:teuthology.orchestra.run.smithi148.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T22:37:22.120 INFO:teuthology.orchestra.run.smithi148.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T22:37:22.150 INFO:teuthology.orchestra.run.smithi148.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T22:37:22.167 INFO:teuthology.orchestra.run.smithi148.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T22:37:22.210 INFO:teuthology.orchestra.run.smithi148.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T22:37:22.430 INFO:teuthology.orchestra.run.smithi148.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T22:37:22.445 INFO:teuthology.orchestra.run.smithi122.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T22:37:22.446 INFO:teuthology.orchestra.run.smithi148.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T22:37:22.452 INFO:teuthology.orchestra.run.smithi148.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T22:37:22.458 INFO:teuthology.orchestra.run.smithi148.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T22:37:22.479 INFO:teuthology.orchestra.run.smithi148.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T22:37:22.483 INFO:teuthology.orchestra.run.smithi148.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T22:37:22.653 INFO:teuthology.orchestra.run.smithi148.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T22:37:22.701 INFO:teuthology.orchestra.run.smithi122.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T22:37:22.901 INFO:teuthology.orchestra.run.smithi122.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T22:37:22.921 INFO:teuthology.orchestra.run.smithi122.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T22:37:22.943 INFO:teuthology.orchestra.run.smithi122.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T22:37:22.990 INFO:teuthology.orchestra.run.smithi148.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T22:37:23.010 INFO:teuthology.orchestra.run.smithi122.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T22:37:23.030 INFO:teuthology.orchestra.run.smithi148.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T22:37:23.044 INFO:teuthology.orchestra.run.smithi148.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T22:37:23.260 INFO:teuthology.orchestra.run.smithi148.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T22:37:23.261 INFO:teuthology.orchestra.run.smithi148.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T22:37:23.266 INFO:teuthology.orchestra.run.smithi148.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T22:37:23.272 INFO:teuthology.orchestra.run.smithi148.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T22:37:23.286 INFO:teuthology.orchestra.run.smithi148.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T22:37:23.307 INFO:teuthology.orchestra.run.smithi148.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T22:37:23.313 INFO:teuthology.orchestra.run.smithi148.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T22:37:23.493 INFO:teuthology.orchestra.run.smithi148.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T22:37:23.759 INFO:teuthology.orchestra.run.smithi148.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T22:37:23.817 INFO:teuthology.orchestra.run.smithi057.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-25T22:37:23.820 INFO:teuthology.orchestra.run.smithi057.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-25T22:37:23.821 INFO:teuthology.orchestra.run.smithi057.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-25T22:37:23.852 INFO:teuthology.orchestra.run.smithi122.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T22:37:23.854 INFO:teuthology.orchestra.run.smithi122.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T22:37:23.893 INFO:teuthology.orchestra.run.smithi122.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T22:37:23.894 INFO:teuthology.orchestra.run.smithi122.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T22:37:23.898 INFO:teuthology.orchestra.run.smithi122.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T22:37:24.130 INFO:teuthology.orchestra.run.smithi148.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T22:37:24.166 INFO:teuthology.orchestra.run.smithi148.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T22:37:24.239 INFO:teuthology.orchestra.run.smithi148.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T22:37:24.343 INFO:teuthology.orchestra.run.smithi057.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.4 kB] 2024-04-25T22:37:24.655 INFO:teuthology.orchestra.run.smithi188.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T22:37:24.753 INFO:teuthology.orchestra.run.smithi148.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T22:37:24.895 INFO:teuthology.orchestra.run.smithi122.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T22:37:24.929 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 179 MB in 12s (15.0 MB/s) 2024-04-25T22:37:25.087 INFO:teuthology.orchestra.run.smithi188.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T22:37:25.093 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T22:37:25.151 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T22:37:25.156 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T22:37:25.242 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T22:37:25.521 INFO:teuthology.orchestra.run.smithi188.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T22:37:25.572 INFO:teuthology.orchestra.run.smithi188.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T22:37:25.579 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T22:37:25.598 INFO:teuthology.orchestra.run.smithi122.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T22:37:25.605 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T22:37:25.609 INFO:teuthology.orchestra.run.smithi122.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T22:37:25.645 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T22:37:25.894 INFO:teuthology.orchestra.run.smithi188.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T22:37:25.982 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T22:37:26.008 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T22:37:26.048 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T22:37:26.114 INFO:teuthology.orchestra.run.smithi188.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T22:37:26.168 INFO:teuthology.orchestra.run.smithi188.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T22:37:26.191 INFO:teuthology.orchestra.run.smithi188.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T22:37:26.425 INFO:teuthology.orchestra.run.smithi188.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T22:37:26.444 INFO:teuthology.orchestra.run.smithi188.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T22:37:26.452 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T22:37:26.478 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:37:26.518 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:37:26.558 INFO:teuthology.orchestra.run.smithi188.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T22:37:26.921 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T22:37:26.948 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:37:26.988 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:37:27.277 INFO:teuthology.orchestra.run.smithi188.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T22:37:27.332 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T22:37:27.359 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:37:27.399 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:37:27.553 INFO:teuthology.orchestra.run.smithi188.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T22:37:27.569 INFO:teuthology.orchestra.run.smithi188.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T22:37:27.719 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T22:37:27.722 INFO:teuthology.orchestra.run.smithi188.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T22:37:27.746 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T22:37:27.752 INFO:teuthology.orchestra.run.smithi188.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T22:37:27.810 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T22:37:27.934 INFO:teuthology.orchestra.run.smithi188.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T22:37:27.936 INFO:teuthology.orchestra.run.smithi188.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T22:37:27.937 INFO:teuthology.orchestra.run.smithi188.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T22:37:27.956 INFO:teuthology.orchestra.run.smithi188.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T22:37:27.980 INFO:teuthology.orchestra.run.smithi188.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T22:37:28.092 INFO:teuthology.orchestra.run.smithi122.stdout:Get:71 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-25T22:37:28.130 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librados2. 2024-04-25T22:37:28.135 INFO:teuthology.orchestra.run.smithi148.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-25T22:37:28.157 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../007-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:28.196 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:28.657 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librbd1. 2024-04-25T22:37:28.684 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../008-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:28.724 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:28.824 INFO:teuthology.orchestra.run.smithi122.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-25T22:37:28.849 INFO:teuthology.orchestra.run.smithi188.stdout:Fetched 179 MB in 16s (11.0 MB/s) 2024-04-25T22:37:28.860 INFO:teuthology.orchestra.run.smithi122.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-25T22:37:28.889 INFO:teuthology.orchestra.run.smithi122.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,526 kB] 2024-04-25T22:37:28.972 INFO:teuthology.orchestra.run.smithi148.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-25T22:37:29.004 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T22:37:29.008 INFO:teuthology.orchestra.run.smithi148.stdout:Get:65 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-25T22:37:29.040 INFO:teuthology.orchestra.run.smithi148.stdout:Get:66 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,526 kB] 2024-04-25T22:37:29.105 INFO:teuthology.orchestra.run.smithi188.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T22:37:29.110 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T22:37:29.111 INFO:teuthology.orchestra.run.smithi122.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-25T22:37:29.169 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T22:37:29.178 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T22:37:29.195 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:29.227 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:29.293 INFO:teuthology.orchestra.run.smithi148.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-25T22:37:29.488 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rados. 2024-04-25T22:37:29.514 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:29.523 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T22:37:29.550 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T22:37:29.554 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:29.590 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T22:37:29.934 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T22:37:29.961 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T22:37:29.968 INFO:teuthology.orchestra.run.smithi122.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T22:37:29.981 INFO:teuthology.orchestra.run.smithi122.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T22:37:30.001 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T22:37:30.043 INFO:teuthology.orchestra.run.smithi122.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-25T22:37:30.057 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T22:37:30.084 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:37:30.124 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:30.127 INFO:teuthology.orchestra.run.smithi122.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T22:37:30.242 INFO:teuthology.orchestra.run.smithi122.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T22:37:30.285 INFO:teuthology.orchestra.run.smithi122.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T22:37:30.295 INFO:teuthology.orchestra.run.smithi148.stdout:Get:68 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-25T22:37:30.360 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T22:37:30.386 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:30.396 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T22:37:30.402 INFO:teuthology.orchestra.run.smithi122.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T22:37:30.418 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:30.423 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:37:30.428 INFO:teuthology.orchestra.run.smithi122.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T22:37:30.471 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:37:30.559 INFO:teuthology.orchestra.run.smithi122.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T22:37:30.712 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T22:37:30.739 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:37:30.778 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:30.866 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T22:37:30.893 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:37:30.933 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:37:31.106 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T22:37:31.133 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T22:37:31.173 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T22:37:31.294 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T22:37:31.321 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:37:31.361 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:37:31.493 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T22:37:31.519 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T22:37:31.559 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T22:37:31.680 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T22:37:31.707 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T22:37:31.747 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T22:37:31.853 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T22:37:31.869 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:31.903 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:32.066 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package librados2. 2024-04-25T22:37:32.093 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../007-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:32.133 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:32.181 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T22:37:32.208 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T22:37:32.220 INFO:teuthology.orchestra.run.smithi122.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T22:37:32.247 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T22:37:32.525 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T22:37:32.552 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T22:37:32.600 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T22:37:32.611 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package librbd1. 2024-04-25T22:37:32.633 INFO:teuthology.orchestra.run.smithi122.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T22:37:32.638 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../008-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:32.677 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:32.678 INFO:teuthology.orchestra.run.smithi122.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T22:37:32.714 INFO:teuthology.orchestra.run.smithi122.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T22:37:32.810 INFO:teuthology.orchestra.run.smithi122.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T22:37:32.866 INFO:teuthology.orchestra.run.smithi122.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T22:37:32.877 INFO:teuthology.orchestra.run.smithi122.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T22:37:32.882 INFO:teuthology.orchestra.run.smithi122.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T22:37:32.903 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T22:37:32.919 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T22:37:32.961 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T22:37:32.963 INFO:teuthology.orchestra.run.smithi122.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T22:37:32.966 INFO:teuthology.orchestra.run.smithi122.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T22:37:33.038 INFO:teuthology.orchestra.run.smithi122.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T22:37:33.039 INFO:teuthology.orchestra.run.smithi122.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-25T22:37:33.089 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T22:37:33.102 INFO:teuthology.orchestra.run.smithi122.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-25T22:37:33.115 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:33.139 INFO:teuthology.orchestra.run.smithi122.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-25T22:37:33.147 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:33.281 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package lua5.1. 2024-04-25T22:37:33.308 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T22:37:33.347 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T22:37:33.424 INFO:teuthology.orchestra.run.smithi122.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [791 kB] 2024-04-25T22:37:33.433 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-rados. 2024-04-25T22:37:33.460 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:33.498 INFO:teuthology.orchestra.run.smithi122.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-25T22:37:33.499 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:33.533 INFO:teuthology.orchestra.run.smithi122.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-25T22:37:33.650 INFO:teuthology.orchestra.run.smithi148.stdout:Get:69 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-25T22:37:33.650 INFO:teuthology.orchestra.run.smithi148.stdout:Get:70 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-25T22:37:33.651 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package lua-any. 2024-04-25T22:37:33.667 INFO:teuthology.orchestra.run.smithi148.stdout:Get:71 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-25T22:37:33.678 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-25T22:37:33.717 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T22:37:33.785 INFO:teuthology.orchestra.run.smithi122.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-25T22:37:33.808 INFO:teuthology.orchestra.run.smithi122.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T22:37:33.819 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T22:37:33.845 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:37:33.886 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:33.937 INFO:teuthology.orchestra.run.smithi148.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [791 kB] 2024-04-25T22:37:33.978 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package zip. 2024-04-25T22:37:33.994 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-25T22:37:34.031 INFO:teuthology.orchestra.run.smithi148.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-25T22:37:34.036 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T22:37:34.044 INFO:teuthology.orchestra.run.smithi148.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-25T22:37:34.076 INFO:teuthology.orchestra.run.smithi122.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T22:37:34.095 INFO:teuthology.orchestra.run.smithi122.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T22:37:34.138 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T22:37:34.153 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:34.196 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:34.248 INFO:teuthology.orchestra.run.smithi122.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T22:37:34.277 INFO:teuthology.orchestra.run.smithi122.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T22:37:34.293 INFO:teuthology.orchestra.run.smithi148.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-25T22:37:34.356 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package unzip. 2024-04-25T22:37:34.383 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T22:37:34.422 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T22:37:34.459 INFO:teuthology.orchestra.run.smithi122.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T22:37:34.461 INFO:teuthology.orchestra.run.smithi122.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T22:37:34.462 INFO:teuthology.orchestra.run.smithi122.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T22:37:34.474 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T22:37:34.487 INFO:teuthology.orchestra.run.smithi122.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T22:37:34.489 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:37:34.490 INFO:teuthology.orchestra.run.smithi122.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T22:37:34.524 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:34.690 INFO:teuthology.orchestra.run.smithi122.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-25T22:37:34.691 INFO:teuthology.orchestra.run.smithi122.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-25T22:37:34.768 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package luarocks. 2024-04-25T22:37:34.797 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T22:37:34.819 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T22:37:34.826 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T22:37:34.845 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T22:37:34.886 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T22:37:35.065 INFO:teuthology.orchestra.run.smithi148.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T22:37:35.161 INFO:teuthology.orchestra.run.smithi148.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-25T22:37:35.164 INFO:teuthology.orchestra.run.smithi148.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-25T22:37:35.169 INFO:teuthology.orchestra.run.smithi148.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T22:37:35.180 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T22:37:35.195 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T22:37:35.218 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librgw2. 2024-04-25T22:37:35.238 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T22:37:35.245 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../025-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:35.283 INFO:teuthology.orchestra.run.smithi148.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T22:37:35.291 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:35.294 INFO:teuthology.orchestra.run.smithi148.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T22:37:35.381 INFO:teuthology.orchestra.run.smithi148.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T22:37:35.508 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T22:37:35.523 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:35.566 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:35.853 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T22:37:35.880 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:35.919 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:35.936 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T22:37:35.962 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T22:37:36.002 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T22:37:36.214 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T22:37:36.241 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T22:37:36.272 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T22:37:36.272 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T22:37:36.287 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T22:37:36.322 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T22:37:36.566 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T22:37:36.593 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:36.608 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T22:37:36.623 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T22:37:36.633 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:36.666 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T22:37:37.012 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package lua5.1. 2024-04-25T22:37:37.038 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T22:37:37.070 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-common. 2024-04-25T22:37:37.078 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T22:37:37.097 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:37.136 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:37.389 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package lua-any. 2024-04-25T22:37:37.416 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-25T22:37:37.456 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T22:37:37.667 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package zip. 2024-04-25T22:37:37.693 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-25T22:37:37.734 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T22:37:38.045 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package unzip. 2024-04-25T22:37:38.072 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T22:37:38.112 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T22:37:38.491 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-base. 2024-04-25T22:37:38.507 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package luarocks. 2024-04-25T22:37:38.518 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:38.533 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T22:37:38.567 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:38.574 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T22:37:38.907 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package librgw2. 2024-04-25T22:37:38.934 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../025-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:38.973 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:39.128 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T22:37:39.155 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T22:37:39.187 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T22:37:39.229 INFO:teuthology.orchestra.run.smithi148.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-25T22:37:39.232 INFO:teuthology.orchestra.run.smithi148.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-25T22:37:39.273 INFO:teuthology.orchestra.run.smithi122.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-25T22:37:39.275 INFO:teuthology.orchestra.run.smithi122.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-25T22:37:39.277 INFO:teuthology.orchestra.run.smithi122.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-25T22:37:39.313 INFO:teuthology.orchestra.run.smithi148.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-25T22:37:39.397 INFO:teuthology.orchestra.run.smithi148.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T22:37:39.472 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T22:37:39.500 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T22:37:39.539 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T22:37:39.576 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T22:37:39.591 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:39.634 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:39.842 INFO:teuthology.orchestra.run.smithi148.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T22:37:39.848 INFO:teuthology.orchestra.run.smithi148.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T22:37:39.892 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T22:37:39.919 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T22:37:39.958 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T22:37:39.970 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T22:37:39.997 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T22:37:40.002 INFO:teuthology.orchestra.run.smithi148.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.4 kB] 2024-04-25T22:37:40.037 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T22:37:40.043 INFO:teuthology.orchestra.run.smithi122.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.4 kB] 2024-04-25T22:37:40.138 INFO:teuthology.orchestra.run.smithi148.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T22:37:40.139 INFO:teuthology.orchestra.run.smithi148.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T22:37:40.141 INFO:teuthology.orchestra.run.smithi148.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T22:37:40.142 INFO:teuthology.orchestra.run.smithi148.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T22:37:40.144 INFO:teuthology.orchestra.run.smithi148.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T22:37:40.146 INFO:teuthology.orchestra.run.smithi148.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T22:37:40.147 INFO:teuthology.orchestra.run.smithi148.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T22:37:40.149 INFO:teuthology.orchestra.run.smithi148.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T22:37:40.261 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T22:37:40.289 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T22:37:40.331 INFO:teuthology.orchestra.run.smithi148.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T22:37:40.340 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T22:37:40.357 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T22:37:40.367 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:40.398 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:40.675 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 179 MB in 28s (6,509 kB/s) 2024-04-25T22:37:40.756 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T22:37:40.783 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T22:37:40.801 INFO:teuthology.orchestra.run.smithi148.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T22:37:40.814 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T22:37:40.819 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-common. 2024-04-25T22:37:40.840 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T22:37:40.845 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:40.885 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:40.938 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T22:37:40.943 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T22:37:40.943 INFO:teuthology.orchestra.run.smithi148.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T22:37:41.031 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T22:37:41.065 INFO:teuthology.orchestra.run.smithi148.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T22:37:41.108 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T22:37:41.135 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T22:37:41.175 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T22:37:41.343 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T22:37:41.370 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T22:37:41.410 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T22:37:41.478 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-portend. 2024-04-25T22:37:41.505 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-25T22:37:41.544 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T22:37:41.755 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T22:37:41.774 INFO:teuthology.orchestra.run.smithi148.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T22:37:41.781 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T22:37:41.821 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T22:37:41.830 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T22:37:41.857 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T22:37:41.897 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T22:37:42.120 INFO:teuthology.orchestra.run.smithi148.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T22:37:42.124 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T22:37:42.140 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T22:37:42.183 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T22:37:42.225 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T22:37:42.252 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:37:42.266 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-base. 2024-04-25T22:37:42.269 INFO:teuthology.orchestra.run.smithi148.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T22:37:42.292 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:42.300 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:37:42.342 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:42.364 INFO:teuthology.orchestra.run.smithi148.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T22:37:42.528 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T22:37:42.555 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T22:37:42.594 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T22:37:42.721 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T22:37:42.747 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:37:42.787 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:37:42.914 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T22:37:42.928 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T22:37:42.941 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T22:37:42.954 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T22:37:42.980 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T22:37:42.995 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T22:37:43.133 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T22:37:43.146 INFO:teuthology.orchestra.run.smithi148.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T22:37:43.159 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:37:43.199 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:37:43.218 INFO:teuthology.orchestra.run.smithi148.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T22:37:43.233 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T22:37:43.239 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T22:37:43.260 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T22:37:43.265 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T22:37:43.291 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T22:37:43.306 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T22:37:43.561 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T22:37:43.587 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T22:37:43.617 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T22:37:43.628 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T22:37:43.628 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-mako. 2024-04-25T22:37:43.644 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T22:37:43.655 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T22:37:43.684 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T22:37:43.694 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T22:37:43.850 INFO:teuthology.orchestra.run.smithi148.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T22:37:43.906 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package librados2. 2024-04-25T22:37:43.921 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../007-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:43.964 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:43.987 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T22:37:44.013 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T22:37:44.018 INFO:teuthology.orchestra.run.smithi148.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T22:37:44.292 INFO:teuthology.orchestra.run.smithi148.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T22:37:44.310 INFO:teuthology.orchestra.run.smithi148.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T22:37:44.417 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package librbd1. 2024-04-25T22:37:44.443 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../008-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:44.463 INFO:teuthology.orchestra.run.smithi148.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T22:37:44.484 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:44.492 INFO:teuthology.orchestra.run.smithi148.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T22:37:44.503 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T22:37:44.650 INFO:teuthology.orchestra.run.smithi148.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T22:37:44.653 INFO:teuthology.orchestra.run.smithi148.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T22:37:44.655 INFO:teuthology.orchestra.run.smithi148.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T22:37:44.677 INFO:teuthology.orchestra.run.smithi148.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T22:37:44.682 INFO:teuthology.orchestra.run.smithi148.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T22:37:44.689 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T22:37:44.717 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T22:37:44.756 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T22:37:45.042 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T22:37:45.069 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T22:37:45.108 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T22:37:45.121 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T22:37:45.147 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:45.352 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 179 MB in 32s (5,583 kB/s) 2024-04-25T22:37:45.353 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-webob. 2024-04-25T22:37:45.365 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T22:37:45.380 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T22:37:45.391 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T22:37:45.411 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T22:37:45.423 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T22:37:45.515 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T22:37:45.616 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T22:37:45.621 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T22:37:45.693 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T22:37:45.705 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T22:37:45.719 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T22:37:45.729 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:45.747 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T22:37:45.759 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T22:37:45.774 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T22:37:45.817 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T22:37:46.007 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-rados. 2024-04-25T22:37:46.009 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T22:37:46.033 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:46.035 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T22:37:46.062 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-portend. 2024-04-25T22:37:46.067 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T22:37:46.074 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:46.089 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-25T22:37:46.125 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T22:37:46.129 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T22:37:46.152 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T22:37:46.191 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T22:37:46.378 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T22:37:46.405 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T22:37:46.432 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T22:37:46.435 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T22:37:46.444 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-paste. 2024-04-25T22:37:46.445 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T22:37:46.458 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T22:37:46.461 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:37:46.471 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T22:37:46.498 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T22:37:46.502 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:46.511 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T22:37:46.755 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T22:37:46.760 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T22:37:46.770 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:46.786 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T22:37:46.813 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:46.818 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T22:37:46.839 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T22:37:46.866 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T22:37:46.882 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T22:37:46.905 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T22:37:46.908 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:37:46.956 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:37:47.091 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T22:37:47.117 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:37:47.149 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:47.155 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T22:37:47.158 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T22:37:47.174 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T22:37:47.181 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T22:37:47.216 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T22:37:47.221 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T22:37:47.377 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T22:37:47.403 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:37:47.443 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:37:47.453 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T22:37:47.479 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T22:37:47.500 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T22:37:47.520 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T22:37:47.526 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T22:37:47.553 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T22:37:47.558 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T22:37:47.580 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T22:37:47.619 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T22:37:47.762 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T22:37:47.788 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T22:37:47.828 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T22:37:47.829 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:37:47.839 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T22:37:47.854 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T22:37:47.865 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T22:37:47.903 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T22:37:47.906 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T22:37:47.914 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T22:37:47.941 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T22:37:47.980 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T22:37:48.167 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T22:37:48.182 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:48.190 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T22:37:48.217 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T22:37:48.225 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:48.239 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-mako. 2024-04-25T22:37:48.257 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T22:37:48.265 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T22:37:48.306 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T22:37:48.360 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T22:37:48.387 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T22:37:48.426 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T22:37:48.521 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T22:37:48.547 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T22:37:48.554 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package librados2. 2024-04-25T22:37:48.580 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../007-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:48.587 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T22:37:48.620 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:48.633 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T22:37:48.660 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T22:37:48.700 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T22:37:48.771 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-idna. 2024-04-25T22:37:48.798 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-25T22:37:48.837 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T22:37:48.873 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T22:37:48.889 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T22:37:48.932 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T22:37:48.970 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T22:37:48.996 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T22:37:49.028 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T22:37:49.048 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package librbd1. 2024-04-25T22:37:49.074 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../008-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:49.107 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T22:37:49.114 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:49.123 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T22:37:49.156 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T22:37:49.244 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T22:37:49.270 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T22:37:49.306 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-webob. 2024-04-25T22:37:49.310 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T22:37:49.332 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T22:37:49.372 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T22:37:49.443 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-requests. 2024-04-25T22:37:49.470 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T22:37:49.510 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T22:37:49.551 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T22:37:49.577 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:49.617 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:49.630 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package lua5.1. 2024-04-25T22:37:49.657 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T22:37:49.689 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T22:37:49.725 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T22:37:49.752 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T22:37:49.771 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T22:37:49.795 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T22:37:49.798 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T22:37:49.837 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T22:37:49.903 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rados. 2024-04-25T22:37:49.930 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:49.970 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:50.009 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package lua-any. 2024-04-25T22:37:50.024 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-25T22:37:50.067 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T22:37:50.106 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T22:37:50.124 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T22:37:50.132 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T22:37:50.151 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:37:50.172 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T22:37:50.190 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:50.287 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package zip. 2024-04-25T22:37:50.302 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-25T22:37:50.337 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T22:37:50.433 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-paste. 2024-04-25T22:37:50.449 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T22:37:50.473 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T22:37:50.483 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T22:37:50.499 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:37:50.539 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:50.595 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T22:37:50.622 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:50.632 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package unzip. 2024-04-25T22:37:50.659 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T22:37:50.661 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:50.699 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T22:37:50.775 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T22:37:50.778 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T22:37:50.790 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:50.793 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T22:37:50.825 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:50.828 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T22:37:50.981 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T22:37:51.008 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T22:37:51.047 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T22:37:51.077 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T22:37:51.093 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:37:51.111 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package luarocks. 2024-04-25T22:37:51.131 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T22:37:51.138 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T22:37:51.144 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:51.158 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T22:37:51.179 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T22:37:51.197 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T22:37:51.325 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T22:37:51.352 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T22:37:51.391 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T22:37:51.455 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T22:37:51.482 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T22:37:51.500 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T22:37:51.522 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T22:37:51.527 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T22:37:51.528 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package librgw2. 2024-04-25T22:37:51.555 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../025-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:51.567 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T22:37:51.595 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:51.703 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T22:37:51.730 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:51.769 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:51.834 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T22:37:51.859 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T22:37:51.878 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T22:37:51.899 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T22:37:51.905 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T22:37:51.945 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T22:37:52.114 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T22:37:52.138 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:52.173 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T22:37:52.177 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T22:37:52.181 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:52.192 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:52.199 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:52.235 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:52.239 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:52.283 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T22:37:52.310 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T22:37:52.349 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T22:37:52.518 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T22:37:52.530 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T22:37:52.544 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T22:37:52.556 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T22:37:52.584 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T22:37:52.588 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T22:37:52.636 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-idna. 2024-04-25T22:37:52.663 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-25T22:37:52.702 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T22:37:52.826 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T22:37:52.853 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:52.866 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T22:37:52.881 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T22:37:52.892 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:52.896 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T22:37:52.923 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:52.924 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T22:37:52.963 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:53.022 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T22:37:53.049 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T22:37:53.089 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T22:37:53.210 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T22:37:53.225 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T22:37:53.268 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T22:37:53.375 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-common. 2024-04-25T22:37:53.392 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-requests. 2024-04-25T22:37:53.401 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:53.419 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T22:37:53.442 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:53.458 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T22:37:53.588 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package lua5.1. 2024-04-25T22:37:53.615 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T22:37:53.655 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T22:37:53.770 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T22:37:53.797 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T22:37:53.838 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T22:37:53.966 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package lua-any. 2024-04-25T22:37:53.981 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-25T22:37:53.987 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph. 2024-04-25T22:37:54.014 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../066-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:54.024 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T22:37:54.053 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:54.131 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T22:37:54.147 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:37:54.189 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:54.243 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package zip. 2024-04-25T22:37:54.258 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-25T22:37:54.293 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T22:37:54.389 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T22:37:54.417 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:54.456 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:54.536 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T22:37:54.551 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:54.586 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:54.613 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package unzip. 2024-04-25T22:37:54.639 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T22:37:54.680 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T22:37:54.834 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T22:37:54.861 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:54.900 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:54.906 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T22:37:54.933 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T22:37:54.972 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T22:37:54.998 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-base. 2024-04-25T22:37:55.024 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:55.067 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package luarocks. 2024-04-25T22:37:55.073 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:55.094 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T22:37:55.133 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T22:37:55.258 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T22:37:55.286 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T22:37:55.303 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephadm. 2024-04-25T22:37:55.319 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../069-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:55.325 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T22:37:55.353 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:55.619 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T22:37:55.639 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T22:37:55.641 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package librgw2. 2024-04-25T22:37:55.645 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T22:37:55.646 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T22:37:55.666 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T22:37:55.667 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../025-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:55.672 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:55.694 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T22:37:55.703 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:55.707 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:55.847 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T22:37:55.997 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T22:37:56.023 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T22:37:56.064 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T22:37:56.090 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T22:37:56.117 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:56.156 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:56.200 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T22:37:56.218 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T22:37:56.227 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T22:37:56.233 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:56.266 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T22:37:56.276 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:56.392 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T22:37:56.418 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T22:37:56.459 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T22:37:56.630 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T22:37:56.656 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T22:37:56.696 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T22:37:56.760 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T22:37:56.770 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T22:37:56.787 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:56.797 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T22:37:56.826 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:56.828 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T22:37:57.007 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T22:37:57.034 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:57.074 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:57.107 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T22:37:57.133 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T22:37:57.174 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T22:37:57.313 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-babel. 2024-04-25T22:37:57.329 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T22:37:57.371 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T22:37:57.452 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-common. 2024-04-25T22:37:57.460 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T22:37:57.478 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:57.486 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T22:37:57.510 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:57.526 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T22:37:57.674 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T22:37:57.701 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T22:37:57.740 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T22:37:57.805 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-portend. 2024-04-25T22:37:57.831 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-25T22:37:57.863 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T22:37:57.879 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph. 2024-04-25T22:37:57.895 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../066-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:57.929 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:58.076 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T22:37:58.104 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:37:58.141 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T22:37:58.143 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:58.168 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T22:37:58.208 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T22:37:58.224 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T22:37:58.251 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:58.290 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:58.463 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T22:37:58.490 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T22:37:58.503 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T22:37:58.529 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T22:37:58.529 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T22:37:58.569 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T22:37:58.668 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T22:37:58.696 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:58.735 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:58.832 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-routes. 2024-04-25T22:37:58.859 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T22:37:58.865 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-base. 2024-04-25T22:37:58.891 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:58.898 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T22:37:58.915 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T22:37:58.941 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:58.942 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T22:37:58.982 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T22:37:59.138 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package cephadm. 2024-04-25T22:37:59.165 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../069-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:37:59.205 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:59.270 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T22:37:59.293 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T22:37:59.298 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:37:59.320 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T22:37:59.337 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:37:59.360 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T22:37:59.490 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T22:37:59.506 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T22:37:59.528 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T22:37:59.540 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T22:37:59.554 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T22:37:59.594 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T22:37:59.639 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T22:37:59.665 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T22:37:59.705 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T22:37:59.897 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T22:37:59.923 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T22:37:59.964 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T22:38:00.008 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-mako. 2024-04-25T22:38:00.024 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T22:38:00.066 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T22:38:00.085 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T22:38:00.113 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T22:38:00.151 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T22:38:00.267 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T22:38:00.282 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T22:38:00.317 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T22:38:00.422 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T22:38:00.447 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T22:38:00.487 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T22:38:00.575 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T22:38:00.603 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T22:38:00.642 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T22:38:00.753 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T22:38:00.779 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T22:38:00.824 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T22:38:00.850 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T22:38:00.861 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T22:38:00.899 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T22:38:01.164 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T22:38:01.190 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T22:38:01.198 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-babel. 2024-04-25T22:38:01.226 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T22:38:01.231 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T22:38:01.265 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T22:38:01.268 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-webob. 2024-04-25T22:38:01.294 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T22:38:01.343 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T22:38:01.521 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T22:38:01.533 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T22:38:01.537 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T22:38:01.560 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T22:38:01.570 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T22:38:01.593 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T22:38:01.600 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T22:38:01.620 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T22:38:01.659 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T22:38:01.730 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T22:38:01.756 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T22:38:01.800 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T22:38:01.869 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-portend. 2024-04-25T22:38:01.896 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-25T22:38:01.927 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T22:38:01.932 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T22:38:01.960 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T22:38:01.998 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T22:38:02.013 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T22:38:02.040 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:38:02.079 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:02.100 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T22:38:02.126 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T22:38:02.167 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T22:38:02.231 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T22:38:02.257 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T22:38:02.297 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T22:38:02.343 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T22:38:02.370 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T22:38:02.407 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T22:38:02.409 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T22:38:02.435 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T22:38:02.474 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T22:38:02.503 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-paste. 2024-04-25T22:38:02.529 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T22:38:02.586 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T22:38:02.600 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T22:38:02.626 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T22:38:02.666 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T22:38:02.760 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-routes. 2024-04-25T22:38:02.787 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T22:38:02.826 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T22:38:02.916 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T22:38:02.930 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T22:38:02.982 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T22:38:03.013 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T22:38:03.038 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T22:38:03.078 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T22:38:03.117 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T22:38:03.145 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:38:03.163 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T22:38:03.191 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:38:03.252 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T22:38:03.255 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:03.277 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:03.278 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T22:38:03.318 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T22:38:03.390 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T22:38:03.416 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T22:38:03.456 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T22:38:03.624 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T22:38:03.650 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T22:38:03.690 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T22:38:03.759 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T22:38:03.786 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T22:38:03.825 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T22:38:03.985 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T22:38:04.011 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T22:38:04.043 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T22:38:04.086 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-mako. 2024-04-25T22:38:04.099 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T22:38:04.137 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T22:38:04.214 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T22:38:04.242 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T22:38:04.281 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T22:38:04.374 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T22:38:04.400 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T22:38:04.432 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T22:38:04.448 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T22:38:04.463 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T22:38:04.485 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T22:38:04.500 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T22:38:04.506 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T22:38:04.535 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T22:38:04.584 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T22:38:04.611 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T22:38:04.650 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T22:38:04.752 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-idna. 2024-04-25T22:38:04.778 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-25T22:38:04.809 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T22:38:04.818 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T22:38:04.835 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T22:38:04.876 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T22:38:04.970 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T22:38:04.998 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T22:38:05.036 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T22:38:05.130 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T22:38:05.156 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T22:38:05.206 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T22:38:05.233 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T22:38:05.263 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T22:38:05.280 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T22:38:05.337 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-webob. 2024-04-25T22:38:05.363 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T22:38:05.364 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T22:38:05.392 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-25T22:38:05.403 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T22:38:05.431 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T22:38:05.576 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-requests. 2024-04-25T22:38:05.602 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T22:38:05.638 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T22:38:05.642 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T22:38:05.644 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T22:38:05.683 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T22:38:05.692 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T22:38:05.720 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T22:38:05.731 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T22:38:05.750 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T22:38:05.758 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T22:38:05.801 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T22:38:05.937 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T22:38:05.963 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T22:38:05.986 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T22:38:06.003 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T22:38:06.013 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T22:38:06.029 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T22:38:06.057 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T22:38:06.061 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T22:38:06.084 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T22:38:06.095 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T22:38:06.110 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T22:38:06.142 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T22:38:06.307 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T22:38:06.333 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:38:06.374 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:06.390 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T22:38:06.418 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T22:38:06.428 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-paste. 2024-04-25T22:38:06.455 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T22:38:06.456 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T22:38:06.495 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T22:38:06.729 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T22:38:06.743 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T22:38:06.754 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T22:38:06.756 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:38:06.771 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T22:38:06.780 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:06.781 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T22:38:06.797 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T22:38:06.801 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T22:38:06.821 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:06.831 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T22:38:06.889 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:07.118 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T22:38:07.124 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T22:38:07.144 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T22:38:07.150 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T22:38:07.184 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T22:38:07.191 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T22:38:07.440 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T22:38:07.468 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:38:07.487 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T22:38:07.506 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:07.513 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T22:38:07.519 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T22:38:07.545 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T22:38:07.562 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T22:38:07.585 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T22:38:07.826 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T22:38:07.834 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T22:38:07.853 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T22:38:07.861 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T22:38:07.873 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T22:38:07.892 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T22:38:07.892 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T22:38:07.897 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T22:38:07.899 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T22:38:07.923 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:07.939 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T22:38:07.963 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:08.162 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T22:38:08.189 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T22:38:08.220 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T22:38:08.228 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T22:38:08.248 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T22:38:08.286 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T22:38:08.303 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T22:38:08.329 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T22:38:08.342 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T22:38:08.369 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:08.369 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T22:38:08.409 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:08.514 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package jq. 2024-04-25T22:38:08.531 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T22:38:08.557 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T22:38:08.564 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T22:38:08.584 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T22:38:08.623 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T22:38:08.655 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-idna. 2024-04-25T22:38:08.682 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-25T22:38:08.714 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T22:38:08.800 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package socat. 2024-04-25T22:38:08.816 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T22:38:08.858 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T22:38:08.935 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T22:38:08.962 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-25T22:38:08.996 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T22:38:09.001 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T22:38:09.022 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:09.025 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T22:38:09.051 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T22:38:09.062 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:09.091 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T22:38:09.178 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T22:38:09.194 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T22:38:09.236 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T22:38:09.288 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T22:38:09.316 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T22:38:09.346 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T22:38:09.394 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-requests. 2024-04-25T22:38:09.421 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T22:38:09.452 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T22:38:09.565 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-test. 2024-04-25T22:38:09.581 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:09.623 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:09.650 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T22:38:09.677 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T22:38:09.716 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T22:38:09.772 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T22:38:09.799 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T22:38:09.839 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T22:38:10.028 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T22:38:10.055 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T22:38:10.103 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T22:38:10.108 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph. 2024-04-25T22:38:10.117 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T22:38:10.123 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../066-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:10.144 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:38:10.158 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:10.183 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:10.414 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T22:38:10.441 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T22:38:10.481 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T22:38:10.563 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T22:38:10.590 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:10.630 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:10.653 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T22:38:10.679 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:10.710 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:10.941 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T22:38:10.968 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T22:38:11.007 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T22:38:11.089 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T22:38:11.116 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:11.145 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T22:38:11.156 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:11.161 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:38:11.203 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:11.277 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T22:38:11.304 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T22:38:11.335 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T22:38:11.514 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T22:38:11.542 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T22:38:11.581 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T22:38:11.593 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package cephadm. 2024-04-25T22:38:11.619 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../069-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:11.671 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T22:38:11.676 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:11.698 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:11.738 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:11.892 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T22:38:11.894 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T22:38:11.920 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T22:38:11.922 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:38:11.958 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T22:38:11.960 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:11.962 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T22:38:11.977 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T22:38:12.012 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T22:38:12.133 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T22:38:12.160 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:12.199 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:12.237 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package jq. 2024-04-25T22:38:12.265 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T22:38:12.272 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T22:38:12.302 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:12.303 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T22:38:12.332 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T22:38:12.339 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:12.358 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T22:38:12.398 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T22:38:12.556 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package socat. 2024-04-25T22:38:12.583 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T22:38:12.622 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T22:38:12.642 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T22:38:12.669 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T22:38:12.710 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T22:38:12.744 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T22:38:12.771 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:12.810 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:12.926 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T22:38:12.942 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T22:38:12.983 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T22:38:13.046 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T22:38:13.074 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T22:38:13.112 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T22:38:13.330 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-test. 2024-04-25T22:38:13.358 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:13.396 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-babel. 2024-04-25T22:38:13.396 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:13.411 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T22:38:13.446 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T22:38:13.466 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T22:38:13.494 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T22:38:13.532 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T22:38:13.724 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T22:38:13.739 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T22:38:13.774 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T22:38:13.831 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph. 2024-04-25T22:38:13.857 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../066-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:13.914 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:13.954 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package pkg-config. 2024-04-25T22:38:13.982 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T22:38:14.021 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T22:38:14.102 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T22:38:14.129 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:38:14.161 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:14.241 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T22:38:14.268 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:14.282 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T22:38:14.298 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T22:38:14.308 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:14.340 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T22:38:14.464 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T22:38:14.480 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T22:38:14.514 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T22:38:14.670 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T22:38:14.697 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:14.736 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:14.802 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T22:38:14.829 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T22:38:14.834 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-routes. 2024-04-25T22:38:14.861 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T22:38:14.867 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T22:38:14.909 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T22:38:15.089 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package cephadm. 2024-04-25T22:38:15.116 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../069-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:15.155 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:15.162 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T22:38:15.190 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T22:38:15.228 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T22:38:15.230 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T22:38:15.256 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:38:15.296 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:15.466 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T22:38:15.494 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T22:38:15.532 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T22:38:15.533 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T22:38:15.560 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T22:38:15.590 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T22:38:15.827 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T22:38:15.842 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T22:38:15.851 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T22:38:15.859 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T22:38:15.879 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T22:38:15.885 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T22:38:15.886 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:38:15.909 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T22:38:15.925 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:16.221 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T22:38:16.229 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-py. 2024-04-25T22:38:16.249 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:16.257 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-25T22:38:16.288 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:16.295 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T22:38:16.557 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T22:38:16.565 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T22:38:16.573 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T22:38:16.594 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T22:38:16.607 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T22:38:16.632 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T22:38:16.677 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T22:38:16.704 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T22:38:16.743 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T22:38:16.949 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-babel. 2024-04-25T22:38:16.970 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T22:38:16.976 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T22:38:16.998 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T22:38:17.015 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T22:38:17.036 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T22:38:17.214 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T22:38:17.241 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T22:38:17.272 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T22:38:17.318 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T22:38:17.345 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T22:38:17.352 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T22:38:17.380 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T22:38:17.384 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T22:38:17.407 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T22:38:17.418 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T22:38:17.436 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T22:38:17.474 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T22:38:17.643 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T22:38:17.670 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T22:38:17.704 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T22:38:17.709 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T22:38:17.731 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:38:17.747 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-toml. 2024-04-25T22:38:17.777 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-25T22:38:17.779 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:17.813 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T22:38:17.871 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package pkg-config. 2024-04-25T22:38:17.899 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T22:38:17.937 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T22:38:18.014 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T22:38:18.040 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T22:38:18.079 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T22:38:18.091 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T22:38:18.116 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T22:38:18.117 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T22:38:18.144 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T22:38:18.157 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T22:38:18.165 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T22:38:18.182 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T22:38:18.193 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T22:38:18.232 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T22:38:18.401 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-routes. 2024-04-25T22:38:18.417 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T22:38:18.451 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T22:38:18.544 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T22:38:18.572 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T22:38:18.602 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T22:38:18.643 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T22:38:18.659 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T22:38:18.693 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T22:38:18.746 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T22:38:18.773 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:38:18.797 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T22:38:18.812 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:18.825 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:38:18.871 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T22:38:18.899 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T22:38:18.946 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T22:38:18.949 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:18.996 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T22:38:19.024 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T22:38:19.062 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T22:38:19.383 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T22:38:19.410 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T22:38:19.449 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T22:38:19.692 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package radosgw. 2024-04-25T22:38:19.716 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../116-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:19.749 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:19.760 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T22:38:19.788 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T22:38:19.827 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T22:38:19.887 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T22:38:19.914 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T22:38:19.945 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T22:38:20.026 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T22:38:20.053 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T22:38:20.092 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T22:38:20.164 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-py. 2024-04-25T22:38:20.191 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-25T22:38:20.238 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T22:38:20.248 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T22:38:20.276 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T22:38:20.314 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T22:38:20.544 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T22:38:20.558 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T22:38:20.562 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T22:38:20.572 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:20.587 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T22:38:20.589 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T22:38:20.610 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:20.624 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T22:38:20.629 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T22:38:20.644 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T22:38:20.671 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T22:38:20.710 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T22:38:20.915 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T22:38:20.983 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T22:38:21.009 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T22:38:21.038 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T22:38:21.049 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T22:38:21.054 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T22:38:21.066 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-25T22:38:21.070 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T22:38:21.105 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T22:38:21.112 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T22:38:21.165 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T22:38:21.291 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T22:38:21.352 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T22:38:21.378 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T22:38:21.406 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-toml. 2024-04-25T22:38:21.418 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T22:38:21.426 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T22:38:21.434 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-25T22:38:21.453 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T22:38:21.473 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T22:38:21.492 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T22:38:21.558 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T22:38:21.784 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T22:38:21.812 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T22:38:21.815 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T22:38:21.843 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T22:38:21.850 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T22:38:21.879 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T22:38:21.880 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T22:38:22.135 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T22:38:22.149 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T22:38:22.162 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:38:22.171 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T22:38:22.176 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T22:38:22.198 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T22:38:22.224 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T22:38:22.237 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T22:38:22.287 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:22.323 INFO:teuthology.orchestra.run.smithi057.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T22:38:22.385 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:22.531 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T22:38:22.545 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T22:38:22.548 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T22:38:22.572 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T22:38:22.590 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T22:38:22.611 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T22:38:22.901 INFO:teuthology.orchestra.run.smithi057.stdout:Adding system user cephadm....done 2024-04-25T22:38:23.049 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T22:38:23.240 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T22:38:23.267 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T22:38:23.268 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T22:38:23.284 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:38:23.306 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T22:38:23.326 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:23.344 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package radosgw. 2024-04-25T22:38:23.367 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T22:38:23.371 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../116-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:23.410 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:23.568 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T22:38:23.595 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T22:38:23.626 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T22:38:23.626 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T22:38:23.654 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T22:38:23.681 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T22:38:23.720 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T22:38:23.752 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T22:38:23.938 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T22:38:23.965 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T22:38:24.004 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T22:38:24.012 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T22:38:24.032 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T22:38:24.059 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T22:38:24.098 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T22:38:24.246 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T22:38:24.262 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:24.280 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T22:38:24.305 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:24.315 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T22:38:24.342 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-25T22:38:24.360 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package jq. 2024-04-25T22:38:24.382 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T22:38:24.387 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T22:38:24.427 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T22:38:24.431 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T22:38:24.618 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T22:38:24.680 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package socat. 2024-04-25T22:38:24.694 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T22:38:24.707 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T22:38:24.721 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T22:38:24.746 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T22:38:24.757 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T22:38:24.760 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T22:38:24.860 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T22:38:24.986 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T22:38:25.066 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T22:38:25.082 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T22:38:25.083 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T22:38:25.110 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T22:38:25.110 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T22:38:25.125 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T22:38:25.149 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T22:38:25.247 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T22:38:25.436 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T22:38:25.460 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T22:38:25.487 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T22:38:25.504 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-test. 2024-04-25T22:38:25.521 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:25.526 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T22:38:25.563 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:25.588 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T22:38:25.813 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T22:38:25.840 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T22:38:25.845 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T22:38:25.879 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T22:38:26.040 INFO:teuthology.orchestra.run.smithi188.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T22:38:26.113 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:26.113 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T22:38:26.406 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T22:38:26.535 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T22:38:26.551 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:38:26.585 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:26.588 INFO:teuthology.orchestra.run.smithi188.stdout:Adding system user cephadm....done 2024-04-25T22:38:26.682 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T22:38:26.736 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T22:38:26.888 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T22:38:26.916 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T22:38:26.933 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:27.004 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T22:38:27.129 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T22:38:27.193 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T22:38:27.255 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T22:38:27.318 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T22:38:27.381 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T22:38:27.453 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T22:38:27.474 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T22:38:27.502 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T22:38:27.540 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T22:38:27.587 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T22:38:27.632 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T22:38:27.802 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package jq. 2024-04-25T22:38:27.818 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T22:38:27.855 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T22:38:27.859 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T22:38:27.891 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T22:38:27.893 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T22:38:27.920 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:38:27.951 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:28.001 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T22:38:28.088 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package socat. 2024-04-25T22:38:28.115 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T22:38:28.145 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T22:38:28.247 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T22:38:28.254 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T22:38:28.274 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:28.286 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T22:38:28.294 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T22:38:28.313 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:28.358 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T22:38:28.467 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T22:38:28.474 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T22:38:28.502 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T22:38:28.540 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T22:38:28.642 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T22:38:28.655 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T22:38:28.669 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T22:38:28.708 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T22:38:28.835 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T22:38:28.894 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-test. 2024-04-25T22:38:28.906 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T22:38:28.910 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:28.944 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:28.961 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T22:38:29.064 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T22:38:29.091 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T22:38:29.130 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T22:38:29.182 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T22:38:29.238 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T22:38:29.417 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T22:38:29.485 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T22:38:29.512 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T22:38:29.513 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T22:38:29.551 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T22:38:29.659 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T22:38:29.831 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T22:38:29.919 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T22:38:29.932 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T22:38:29.990 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package pkg-config. 2024-04-25T22:38:30.021 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T22:38:30.065 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T22:38:30.178 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:30.327 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T22:38:30.345 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T22:38:30.385 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T22:38:30.488 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T22:38:30.610 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T22:38:30.656 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T22:38:30.782 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T22:38:30.830 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T22:38:30.858 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T22:38:30.885 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T22:38:30.896 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T22:38:30.908 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T22:38:31.012 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T22:38:31.159 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T22:38:31.163 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T22:38:31.183 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T22:38:31.210 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T22:38:31.224 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T22:38:31.249 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T22:38:31.251 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T22:38:31.315 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:31.489 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T22:38:31.537 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T22:38:31.542 INFO:teuthology.orchestra.run.smithi188.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T22:38:31.564 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T22:38:31.575 INFO:teuthology.orchestra.run.smithi188.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T22:38:31.595 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T22:38:31.627 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T22:38:31.639 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T22:38:31.655 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:31.694 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:31.765 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T22:38:31.898 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T22:38:31.915 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T22:38:31.925 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T22:38:31.965 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T22:38:31.997 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T22:38:32.024 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T22:38:32.063 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T22:38:32.124 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T22:38:32.174 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T22:38:32.250 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T22:38:32.302 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-py. 2024-04-25T22:38:32.329 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-25T22:38:32.368 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T22:38:32.368 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T22:38:32.395 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T22:38:32.434 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T22:38:32.518 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T22:38:32.559 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T22:38:32.705 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T22:38:32.732 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T22:38:32.771 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T22:38:32.785 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T22:38:32.796 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T22:38:32.824 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T22:38:32.860 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T22:38:32.862 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T22:38:33.104 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T22:38:33.201 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T22:38:33.211 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T22:38:33.229 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T22:38:33.229 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T22:38:33.243 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package pkg-config. 2024-04-25T22:38:33.267 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T22:38:33.271 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T22:38:33.309 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T22:38:33.480 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T22:38:33.570 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T22:38:33.587 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T22:38:33.606 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:33.613 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-toml. 2024-04-25T22:38:33.629 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T22:38:33.640 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-25T22:38:33.679 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T22:38:33.898 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T22:38:33.907 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T22:38:33.965 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T22:38:33.993 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T22:38:34.032 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T22:38:34.032 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T22:38:34.060 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T22:38:34.098 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T22:38:34.174 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T22:38:34.225 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T22:38:34.275 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T22:38:34.378 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T22:38:34.392 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T22:38:34.393 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T22:38:34.405 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T22:38:34.421 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T22:38:34.444 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T22:38:34.459 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T22:38:34.702 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T22:38:34.714 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T22:38:34.741 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T22:38:34.763 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T22:38:34.780 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T22:38:34.790 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T22:38:34.829 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T22:38:35.086 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T22:38:35.149 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T22:38:35.177 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T22:38:35.215 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T22:38:35.329 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T22:38:35.464 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T22:38:35.552 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-py. 2024-04-25T22:38:35.579 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-25T22:38:35.585 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package radosgw. 2024-04-25T22:38:35.613 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../116-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:35.645 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T22:38:35.651 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:35.698 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T22:38:35.757 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:38:35.900 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T22:38:35.971 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T22:38:35.982 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T22:38:35.999 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T22:38:36.037 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T22:38:36.167 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T22:38:36.293 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T22:38:36.333 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T22:38:36.419 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T22:38:36.492 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T22:38:36.497 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T22:38:36.519 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T22:38:36.524 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:36.558 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T22:38:36.563 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:36.601 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T22:38:36.727 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:36.737 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T22:38:36.819 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-toml. 2024-04-25T22:38:36.847 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-25T22:38:36.859 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T22:38:36.877 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T22:38:37.005 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T22:38:37.028 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T22:38:37.094 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T22:38:37.180 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T22:38:37.195 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T22:38:37.208 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T22:38:37.246 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T22:38:37.290 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:38:37.337 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T22:38:37.390 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T22:38:37.431 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T22:38:37.567 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T22:38:37.595 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T22:38:37.625 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T22:38:37.717 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T22:38:37.761 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T22:38:37.852 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T22:38:37.866 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T22:38:37.902 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T22:38:37.976 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T22:38:38.203 INFO:teuthology.orchestra.run.smithi122.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T22:38:38.252 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T22:38:38.490 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:38.493 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T22:38:38.512 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T22:38:38.690 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package radosgw. 2024-04-25T22:38:38.718 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../116-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:38.753 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:38:38.755 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:38.780 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T22:38:38.912 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T22:38:38.949 INFO:teuthology.orchestra.run.smithi122.stdout:Adding system user cephadm....done 2024-04-25T22:38:39.056 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T22:38:39.071 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T22:38:39.205 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T22:38:39.206 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T22:38:39.331 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T22:38:39.348 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T22:38:39.457 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T22:38:39.508 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T22:38:39.568 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T22:38:39.582 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T22:38:39.596 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T22:38:39.617 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T22:38:39.633 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:39.727 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T22:38:39.741 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T22:38:39.918 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T22:38:39.930 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T22:38:39.994 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T22:38:40.001 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T22:38:40.213 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T22:38:40.219 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T22:38:40.245 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T22:38:40.252 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:38:40.348 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T22:38:40.371 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T22:38:40.378 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T22:38:40.487 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T22:38:40.596 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T22:38:40.638 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T22:38:40.673 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T22:38:40.679 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T22:38:40.789 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T22:38:40.896 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T22:38:40.931 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T22:38:40.941 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T22:38:41.025 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T22:38:41.149 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T22:38:41.181 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T22:38:41.250 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T22:38:41.277 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T22:38:41.350 INFO:teuthology.orchestra.run.smithi148.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T22:38:41.449 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T22:38:41.500 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:41.545 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T22:38:41.643 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T22:38:41.700 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T22:38:41.796 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T22:38:41.919 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T22:38:41.968 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T22:38:42.064 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T22:38:42.071 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T22:38:42.094 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T22:38:42.315 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T22:38:42.342 INFO:teuthology.orchestra.run.smithi148.stdout:Adding system user cephadm....done 2024-04-25T22:38:42.347 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:38:42.395 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T22:38:42.456 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T22:38:42.499 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T22:38:42.504 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T22:38:42.550 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:42.774 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T22:38:42.789 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T22:38:42.812 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T22:38:42.938 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T22:38:43.064 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T22:38:43.066 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T22:38:43.090 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T22:38:43.091 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T22:38:43.190 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T22:38:43.326 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T22:38:43.343 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T22:38:43.349 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T22:38:43.432 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T22:38:43.444 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T22:38:43.469 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T22:38:43.475 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T22:38:43.601 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T22:38:43.690 INFO:teuthology.orchestra.run.smithi188.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T22:38:43.695 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T22:38:43.744 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T22:38:43.797 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T22:38:43.830 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T22:38:43.894 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T22:38:43.936 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T22:38:43.954 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T22:38:44.012 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T22:38:44.037 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T22:38:44.054 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T22:38:44.080 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T22:38:44.363 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T22:38:44.399 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T22:38:44.413 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T22:38:44.416 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T22:38:44.472 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T22:38:44.665 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T22:38:44.748 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T22:38:44.751 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T22:38:44.790 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T22:38:44.801 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T22:38:44.999 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T22:38:45.010 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T22:38:45.041 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:38:45.094 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T22:38:45.167 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T22:38:45.278 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T22:38:45.292 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T22:38:45.410 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T22:38:45.465 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T22:38:45.510 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T22:38:45.563 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T22:38:45.566 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:45.676 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:45.802 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T22:38:45.853 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T22:38:45.914 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T22:38:46.070 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T22:38:46.138 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:46.165 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T22:38:46.264 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:46.330 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T22:38:46.337 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T22:38:46.365 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T22:38:46.425 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:46.463 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T22:38:46.464 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T22:38:46.582 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T22:38:46.625 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:46.661 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T22:38:46.748 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T22:38:46.751 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:46.785 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T22:38:46.858 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T22:38:46.877 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:46.911 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T22:38:47.023 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T22:38:47.037 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T22:38:47.095 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T22:38:47.095 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T22:38:47.276 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T22:38:47.296 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T22:38:47.377 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T22:38:47.518 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T22:38:47.695 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:47.753 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T22:38:47.757 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T22:38:47.787 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T22:38:47.821 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:47.850 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T22:38:47.895 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T22:38:47.965 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:47.993 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T22:38:48.022 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T22:38:48.066 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T22:38:48.188 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T22:38:48.349 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T22:38:48.360 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T22:38:48.475 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:48.486 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T22:38:48.556 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T22:38:48.601 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:48.727 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T22:38:48.754 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T22:38:48.807 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T22:38:48.933 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:49.022 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T22:38:49.022 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:49.148 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:49.243 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T22:38:49.274 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T22:38:49.315 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T22:38:49.345 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:49.441 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T22:38:49.496 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:49.569 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T22:38:49.575 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:49.647 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:49.693 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:49.794 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:49.798 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:49.924 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:49.991 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T22:38:49.991 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T22:38:50.093 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T22:38:50.352 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T22:38:50.460 INFO:teuthology.orchestra.run.smithi057.stdout:Adding group ceph....done 2024-04-25T22:38:50.470 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:50.478 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T22:38:50.571 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:50.604 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T22:38:50.689 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:50.716 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T22:38:50.836 INFO:teuthology.orchestra.run.smithi057.stdout:Adding system user ceph....done 2024-04-25T22:38:50.840 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T22:38:50.897 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T22:38:50.972 INFO:teuthology.orchestra.run.smithi057.stdout:Setting system user ceph properties....done 2024-04-25T22:38:50.976 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:38:50.988 INFO:teuthology.orchestra.run.smithi057.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T22:38:51.110 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T22:38:51.129 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T22:38:51.281 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T22:38:51.387 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T22:38:51.462 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T22:38:51.513 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T22:38:51.533 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T22:38:51.639 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T22:38:51.909 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T22:38:51.927 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:51.931 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T22:38:52.051 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:52.053 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:52.161 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:52.183 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T22:38:52.202 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T22:38:52.287 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:52.413 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:52.434 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:38:52.539 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:52.545 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T22:38:52.555 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:38:52.555 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:38:52.560 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T22:38:52.796 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T22:38:52.870 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T22:38:52.914 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:53.055 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:53.082 INFO:teuthology.orchestra.run.smithi188.stdout:Adding group ceph....done 2024-04-25T22:38:53.112 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T22:38:53.207 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T22:38:53.364 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T22:38:53.413 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T22:38:53.450 INFO:teuthology.orchestra.run.smithi188.stdout:Adding system user ceph....done 2024-04-25T22:38:53.525 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T22:38:53.609 INFO:teuthology.orchestra.run.smithi188.stdout:Setting system user ceph properties....done 2024-04-25T22:38:53.623 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T22:38:53.626 INFO:teuthology.orchestra.run.smithi188.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T22:38:53.760 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T22:38:53.857 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T22:38:53.932 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:54.101 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T22:38:54.108 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T22:38:54.176 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T22:38:54.176 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T22:38:54.251 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T22:38:54.535 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T22:38:54.606 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:54.638 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T22:38:54.662 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T22:38:54.732 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:54.792 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:54.865 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:38:54.946 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T22:38:55.000 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T22:38:55.013 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T22:38:55.013 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T22:38:55.211 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:38:55.211 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:38:55.239 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T22:38:55.268 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T22:38:55.410 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T22:38:55.490 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T22:38:55.493 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:55.536 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T22:38:55.616 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T22:38:55.675 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:55.742 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T22:38:55.754 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T22:38:55.754 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T22:38:55.831 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T22:38:55.837 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T22:38:56.027 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T22:38:56.060 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T22:38:56.089 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T22:38:56.195 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T22:38:56.254 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:56.331 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:38:56.380 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:56.441 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T22:38:56.519 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:56.523 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:56.597 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T22:38:56.717 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T22:38:56.717 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T22:38:56.731 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T22:38:56.731 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T22:38:56.742 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T22:38:56.847 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T22:38:56.974 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T22:38:57.002 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T22:38:57.171 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:57.199 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:57.216 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:38:57.278 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T22:38:57.342 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T22:38:57.350 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:57.385 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T22:38:57.386 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T22:38:57.477 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:57.537 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T22:38:57.627 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:57.685 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T22:38:57.788 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T22:38:57.846 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:57.994 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T22:38:58.048 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T22:38:58.121 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T22:38:58.122 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T22:38:58.208 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T22:38:58.279 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T22:38:58.310 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T22:38:58.316 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:38:58.380 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T22:38:58.469 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:38:58.631 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:58.656 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T22:38:58.733 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T22:38:58.757 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:58.843 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T22:38:58.908 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:58.949 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T22:38:59.123 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T22:38:59.123 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T22:38:59.135 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T22:38:59.293 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T22:38:59.436 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T22:38:59.587 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:38:59.609 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:59.679 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T22:38:59.696 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T22:38:59.752 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:59.805 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T22:38:59.878 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:38:59.914 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T22:38:59.947 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T22:39:00.004 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T22:39:00.029 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:00.241 INFO:teuthology.orchestra.run.smithi057.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:39:00.245 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-25T22:39:00.250 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T22:39:00.283 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T22:39:00.301 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2024-04-25T22:39:00.376 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T22:39:00.409 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:00.415 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T22:39:00.505 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2024-04-25T22:39:00.506 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2024-04-25T22:39:00.533 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:39:00.535 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:00.661 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T22:39:00.685 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:39:00.700 INFO:teuthology.orchestra.run.smithi057.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T22:39:00.701 INFO:teuthology.orchestra.run.smithi057.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T22:39:00.701 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:39:00.701 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:39:00.701 INFO:teuthology.orchestra.run.smithi057.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:39:00.701 INFO:teuthology.orchestra.run.smithi057.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:39:00.701 INFO:teuthology.orchestra.run.smithi057.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:39:00.701 INFO:teuthology.orchestra.run.smithi057.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:39:00.702 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:39:00.702 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2024-04-25T22:39:00.703 INFO:teuthology.orchestra.run.smithi057.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-25T22:39:00.705 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2024-04-25T22:39:00.705 INFO:teuthology.orchestra.run.smithi057.stdout: bison-doc flex-doc libssl-doc 2024-04-25T22:39:00.735 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2024-04-25T22:39:00.737 INFO:teuthology.orchestra.run.smithi057.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-25T22:39:00.738 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages will be upgraded: 2024-04-25T22:39:00.739 INFO:teuthology.orchestra.run.smithi057.stdout: libssl3 libuuid1 uuid-dev 2024-04-25T22:39:00.752 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T22:39:00.797 INFO:teuthology.orchestra.run.smithi057.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-25T22:39:00.797 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 5,495 kB of archives. 2024-04-25T22:39:00.797 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-25T22:39:00.797 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T22:39:00.914 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T22:39:00.947 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:00.986 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T22:39:00.987 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T22:39:00.988 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T22:39:01.004 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T22:39:01.005 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T22:39:01.007 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T22:39:01.007 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T22:39:01.008 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T22:39:01.011 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T22:39:01.073 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:01.138 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T22:39:01.199 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T22:39:01.380 INFO:teuthology.orchestra.run.smithi057.stdout:Preconfiguring packages ... 2024-04-25T22:39:01.397 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T22:39:01.475 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 5,495 kB in 0s (18.9 MB/s) 2024-04-25T22:39:01.492 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:01.523 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T22:39:01.618 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:01.619 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package flex. 2024-04-25T22:39:01.725 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173891 files and directories currently installed.) 2024-04-25T22:39:01.731 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T22:39:01.744 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:01.775 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T22:39:01.816 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T22:39:01.853 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:39:01.958 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T22:39:01.958 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T22:39:02.092 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T22:39:02.377 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T22:39:02.384 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:39:02.429 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:02.503 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T22:39:02.505 INFO:teuthology.orchestra.run.smithi188.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:39:02.508 DEBUG:teuthology.orchestra.run.smithi188:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-25T22:39:02.540 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T22:39:02.547 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:02.607 INFO:teuthology.orchestra.run.smithi188.stdout:Reading package lists... 2024-04-25T22:39:02.673 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:02.770 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T22:39:02.808 INFO:teuthology.orchestra.run.smithi188.stdout:Building dependency tree... 2024-04-25T22:39:02.808 INFO:teuthology.orchestra.run.smithi188.stdout:Reading state information... 2024-04-25T22:39:02.987 INFO:teuthology.orchestra.run.smithi188.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T22:39:02.987 INFO:teuthology.orchestra.run.smithi188.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T22:39:02.987 INFO:teuthology.orchestra.run.smithi188.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:39:02.987 INFO:teuthology.orchestra.run.smithi188.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:39:02.987 INFO:teuthology.orchestra.run.smithi188.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:39:02.987 INFO:teuthology.orchestra.run.smithi188.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:39:02.988 INFO:teuthology.orchestra.run.smithi188.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:39:02.988 INFO:teuthology.orchestra.run.smithi188.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:39:02.988 INFO:teuthology.orchestra.run.smithi188.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:39:02.988 INFO:teuthology.orchestra.run.smithi188.stdout:The following additional packages will be installed: 2024-04-25T22:39:02.989 INFO:teuthology.orchestra.run.smithi188.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-25T22:39:02.990 INFO:teuthology.orchestra.run.smithi188.stdout:Suggested packages: 2024-04-25T22:39:02.990 INFO:teuthology.orchestra.run.smithi188.stdout: bison-doc flex-doc libssl-doc 2024-04-25T22:39:03.002 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:39:03.020 INFO:teuthology.orchestra.run.smithi188.stdout:The following NEW packages will be installed: 2024-04-25T22:39:03.021 INFO:teuthology.orchestra.run.smithi188.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-25T22:39:03.022 INFO:teuthology.orchestra.run.smithi188.stdout:The following packages will be upgraded: 2024-04-25T22:39:03.023 INFO:teuthology.orchestra.run.smithi188.stdout: libssl3 libuuid1 uuid-dev 2024-04-25T22:39:03.046 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T22:39:03.073 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T22:39:03.079 INFO:teuthology.orchestra.run.smithi188.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-25T22:39:03.079 INFO:teuthology.orchestra.run.smithi188.stdout:Need to get 5,495 kB of archives. 2024-04-25T22:39:03.080 INFO:teuthology.orchestra.run.smithi188.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-25T22:39:03.080 INFO:teuthology.orchestra.run.smithi188.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T22:39:03.207 INFO:teuthology.orchestra.run.smithi188.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T22:39:03.325 INFO:teuthology.orchestra.run.smithi188.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T22:39:03.326 INFO:teuthology.orchestra.run.smithi188.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T22:39:03.327 INFO:teuthology.orchestra.run.smithi188.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T22:39:03.345 INFO:teuthology.orchestra.run.smithi188.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T22:39:03.345 INFO:teuthology.orchestra.run.smithi188.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T22:39:03.347 INFO:teuthology.orchestra.run.smithi188.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T22:39:03.348 INFO:teuthology.orchestra.run.smithi188.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T22:39:03.348 INFO:teuthology.orchestra.run.smithi188.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T22:39:03.391 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T22:39:03.623 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:39:03.629 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:39:03.719 INFO:teuthology.orchestra.run.smithi188.stdout:Preconfiguring packages ... 2024-04-25T22:39:03.750 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:39:03.768 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T22:39:03.820 INFO:teuthology.orchestra.run.smithi188.stdout:Fetched 5,495 kB in 0s (15.2 MB/s) 2024-04-25T22:39:03.959 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package flex. 2024-04-25T22:39:04.036 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T22:39:04.058 INFO:teuthology.orchestra.run.smithi188.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173891 files and directories currently installed.) 2024-04-25T22:39:04.064 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T22:39:04.107 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T22:39:04.143 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:39:04.274 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:39:04.364 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T22:39:04.395 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:04.490 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:04.521 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:04.624 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:04.644 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:39:04.647 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:04.673 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:39:04.733 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T22:39:04.773 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:04.838 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T22:39:04.891 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:05.008 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package bison. 2024-04-25T22:39:05.028 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:05.114 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:39:05.120 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T22:39:05.154 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:05.177 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:39:05.265 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:39:05.280 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T22:39:05.377 INFO:teuthology.orchestra.run.smithi122.stdout:Adding group ceph....done 2024-04-25T22:39:05.565 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:05.594 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T22:39:05.623 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T22:39:05.661 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:39:05.699 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:05.769 INFO:teuthology.orchestra.run.smithi122.stdout:Adding system user ceph....done 2024-04-25T22:39:05.779 INFO:teuthology.orchestra.run.smithi188.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:39:05.785 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:39:05.825 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:05.878 INFO:teuthology.orchestra.run.smithi122.stdout:Setting system user ceph properties....done 2024-04-25T22:39:05.890 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T22:39:05.895 INFO:teuthology.orchestra.run.smithi122.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T22:39:05.907 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T22:39:05.912 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:39:05.948 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:39:06.034 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T22:39:06.035 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T22:39:06.036 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T22:39:06.294 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T22:39:06.322 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T22:39:06.337 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:39:06.360 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:39:06.376 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T22:39:06.443 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:39:06.510 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:06.613 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T22:39:06.627 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:06.629 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T22:39:06.671 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:39:06.753 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:06.842 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:06.879 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T22:39:06.880 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:39:06.899 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T22:39:06.927 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:39:06.957 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:39:06.967 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:07.244 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package bison. 2024-04-25T22:39:07.348 INFO:teuthology.orchestra.run.smithi188.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:39:07.353 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T22:39:07.413 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:39:07.453 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T22:39:07.454 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:39:07.454 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:39:07.579 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:39:07.705 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:39:07.746 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T22:39:07.763 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T22:39:07.796 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:39:07.831 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:39:07.886 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:07.966 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:39:08.025 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T22:39:08.041 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T22:39:08.083 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:39:08.108 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:08.117 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:39:08.209 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:08.243 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T22:39:08.327 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:08.345 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:39:08.420 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T22:39:08.444 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:08.448 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T22:39:08.468 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T22:39:08.508 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:39:08.530 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:39:08.570 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:08.657 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:39:08.688 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:08.764 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T22:39:08.792 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T22:39:08.825 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:39:08.830 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:39:08.900 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T22:39:08.900 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T22:39:09.049 INFO:teuthology.orchestra.run.smithi188.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T22:39:09.066 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:39:09.099 INFO:teuthology.orchestra.run.smithi188.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:39:09.114 INFO:teuthology.orchestra.run.smithi148.stdout:Adding group ceph....done 2024-04-25T22:39:09.382 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:09.481 INFO:teuthology.orchestra.run.smithi148.stdout:Adding system user ceph....done 2024-04-25T22:39:09.587 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T22:39:09.587 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T22:39:09.602 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T22:39:09.609 INFO:teuthology.orchestra.run.smithi148.stdout:Setting system user ceph properties....done 2024-04-25T22:39:09.623 INFO:teuthology.orchestra.run.smithi148.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T22:39:09.729 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:39:09.761 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T22:39:10.025 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:10.027 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:39:10.063 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:39:10.114 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T22:39:10.223 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:39:10.264 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T22:39:10.264 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T22:39:10.349 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:39:10.475 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:39:10.502 INFO:teuthology.orchestra.run.smithi057.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:39:10.508 DEBUG:teuthology.parallel:result is None 2024-04-25T22:39:10.572 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:10.584 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:39:10.656 INFO:teuthology.orchestra.run.smithi188.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T22:39:10.697 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:10.719 INFO:teuthology.orchestra.run.smithi188.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:39:10.735 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:10.846 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:39:10.860 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:10.997 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:39:11.020 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:11.183 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:39:11.184 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:39:11.230 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T22:39:11.230 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T22:39:11.625 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:11.738 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:11.889 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:11.949 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T22:39:12.015 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:12.150 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:12.249 INFO:teuthology.orchestra.run.smithi188.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:39:12.393 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:12.486 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T22:39:12.586 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:39:12.616 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T22:39:12.617 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T22:39:12.701 INFO:teuthology.orchestra.run.smithi188.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:39:12.706 DEBUG:teuthology.parallel:result is None 2024-04-25T22:39:12.722 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:39:13.086 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:13.303 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T22:39:13.303 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T22:39:13.787 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:13.790 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:39:14.056 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T22:39:14.057 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T22:39:14.456 INFO:teuthology.orchestra.run.smithi122.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:39:14.459 DEBUG:teuthology.orchestra.run.smithi122:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-25T22:39:14.531 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:14.553 INFO:teuthology.orchestra.run.smithi122.stdout:Reading package lists... 2024-04-25T22:39:14.659 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:14.753 INFO:teuthology.orchestra.run.smithi122.stdout:Building dependency tree... 2024-04-25T22:39:14.754 INFO:teuthology.orchestra.run.smithi122.stdout:Reading state information... 2024-04-25T22:39:14.802 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:14.934 INFO:teuthology.orchestra.run.smithi122.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T22:39:14.934 INFO:teuthology.orchestra.run.smithi122.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T22:39:14.934 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:39:14.934 INFO:teuthology.orchestra.run.smithi122.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:39:14.935 INFO:teuthology.orchestra.run.smithi122.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:39:14.935 INFO:teuthology.orchestra.run.smithi122.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:39:14.935 INFO:teuthology.orchestra.run.smithi122.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:39:14.935 INFO:teuthology.orchestra.run.smithi122.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:39:14.936 INFO:teuthology.orchestra.run.smithi122.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:39:14.936 INFO:teuthology.orchestra.run.smithi122.stdout:The following additional packages will be installed: 2024-04-25T22:39:14.936 INFO:teuthology.orchestra.run.smithi122.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-25T22:39:14.937 INFO:teuthology.orchestra.run.smithi122.stdout:Suggested packages: 2024-04-25T22:39:14.938 INFO:teuthology.orchestra.run.smithi122.stdout: bison-doc flex-doc libssl-doc 2024-04-25T22:39:14.966 INFO:teuthology.orchestra.run.smithi122.stdout:The following NEW packages will be installed: 2024-04-25T22:39:14.969 INFO:teuthology.orchestra.run.smithi122.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-25T22:39:14.969 INFO:teuthology.orchestra.run.smithi122.stdout:The following packages will be upgraded: 2024-04-25T22:39:14.970 INFO:teuthology.orchestra.run.smithi122.stdout: libssl3 libuuid1 uuid-dev 2024-04-25T22:39:15.005 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T22:39:15.005 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T22:39:15.364 INFO:teuthology.orchestra.run.smithi122.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-25T22:39:15.364 INFO:teuthology.orchestra.run.smithi122.stdout:Need to get 5,495 kB of archives. 2024-04-25T22:39:15.364 INFO:teuthology.orchestra.run.smithi122.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-25T22:39:15.364 INFO:teuthology.orchestra.run.smithi122.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T22:39:15.461 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:15.604 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:15.730 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:15.841 INFO:teuthology.orchestra.run.smithi122.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T22:39:15.881 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T22:39:16.197 INFO:teuthology.orchestra.run.smithi122.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T22:39:16.198 INFO:teuthology.orchestra.run.smithi122.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T22:39:16.201 INFO:teuthology.orchestra.run.smithi122.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T22:39:16.225 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T22:39:16.241 INFO:teuthology.orchestra.run.smithi122.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T22:39:16.242 INFO:teuthology.orchestra.run.smithi122.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T22:39:16.246 INFO:teuthology.orchestra.run.smithi122.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T22:39:16.246 INFO:teuthology.orchestra.run.smithi122.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T22:39:16.247 INFO:teuthology.orchestra.run.smithi122.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T22:39:16.334 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:39:16.470 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:39:16.684 INFO:teuthology.orchestra.run.smithi122.stdout:Preconfiguring packages ... 2024-04-25T22:39:16.789 INFO:teuthology.orchestra.run.smithi122.stdout:Fetched 5,495 kB in 1s (4,012 kB/s) 2024-04-25T22:39:16.912 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package flex. 2024-04-25T22:39:17.005 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173891 files and directories currently installed.) 2024-04-25T22:39:17.010 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T22:39:17.061 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T22:39:17.570 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:39:17.577 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:39:17.725 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T22:39:18.137 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:39:18.233 INFO:teuthology.orchestra.run.smithi148.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:39:18.236 DEBUG:teuthology.orchestra.run.smithi148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-25T22:39:18.342 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2024-04-25T22:39:18.552 INFO:teuthology.orchestra.run.smithi148.stdout:Building dependency tree... 2024-04-25T22:39:18.552 INFO:teuthology.orchestra.run.smithi148.stdout:Reading state information... 2024-04-25T22:39:18.686 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:39:18.691 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:39:18.747 INFO:teuthology.orchestra.run.smithi148.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T22:39:18.747 INFO:teuthology.orchestra.run.smithi148.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T22:39:18.747 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T22:39:18.747 INFO:teuthology.orchestra.run.smithi148.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T22:39:18.747 INFO:teuthology.orchestra.run.smithi148.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T22:39:18.747 INFO:teuthology.orchestra.run.smithi148.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T22:39:18.747 INFO:teuthology.orchestra.run.smithi148.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T22:39:18.748 INFO:teuthology.orchestra.run.smithi148.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T22:39:18.748 INFO:teuthology.orchestra.run.smithi148.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T22:39:18.748 INFO:teuthology.orchestra.run.smithi148.stdout:The following additional packages will be installed: 2024-04-25T22:39:18.749 INFO:teuthology.orchestra.run.smithi148.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-25T22:39:18.751 INFO:teuthology.orchestra.run.smithi148.stdout:Suggested packages: 2024-04-25T22:39:18.751 INFO:teuthology.orchestra.run.smithi148.stdout: bison-doc flex-doc libssl-doc 2024-04-25T22:39:18.783 INFO:teuthology.orchestra.run.smithi148.stdout:The following NEW packages will be installed: 2024-04-25T22:39:18.784 INFO:teuthology.orchestra.run.smithi148.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-25T22:39:18.785 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages will be upgraded: 2024-04-25T22:39:18.786 INFO:teuthology.orchestra.run.smithi148.stdout: libssl3 libuuid1 uuid-dev 2024-04-25T22:39:18.842 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:39:18.858 INFO:teuthology.orchestra.run.smithi148.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-25T22:39:18.858 INFO:teuthology.orchestra.run.smithi148.stdout:Need to get 5,495 kB of archives. 2024-04-25T22:39:18.858 INFO:teuthology.orchestra.run.smithi148.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-25T22:39:18.859 INFO:teuthology.orchestra.run.smithi148.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T22:39:19.039 INFO:teuthology.orchestra.run.smithi148.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T22:39:19.249 INFO:teuthology.orchestra.run.smithi148.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T22:39:19.250 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T22:39:19.251 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T22:39:19.301 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:39:19.307 INFO:teuthology.orchestra.run.smithi148.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T22:39:19.307 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T22:39:19.309 INFO:teuthology.orchestra.run.smithi148.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T22:39:19.310 INFO:teuthology.orchestra.run.smithi148.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T22:39:19.310 INFO:teuthology.orchestra.run.smithi148.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T22:39:19.449 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:39:19.817 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:39:19.872 INFO:teuthology.orchestra.run.smithi148.stdout:Preconfiguring packages ... 2024-04-25T22:39:19.963 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 5,495 kB in 1s (7,419 kB/s) 2024-04-25T22:39:20.085 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package flex. 2024-04-25T22:39:20.180 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173891 files and directories currently installed.) 2024-04-25T22:39:20.182 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package bison. 2024-04-25T22:39:20.185 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T22:39:20.234 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T22:39:20.286 INFO:teuthology.orchestra.run.smithi122.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:39:20.292 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T22:39:20.351 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:39:20.702 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T22:39:20.729 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T22:39:20.758 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:39:20.768 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:39:20.898 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T22:39:21.030 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T22:39:21.046 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T22:39:21.088 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:39:21.317 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:39:21.392 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T22:39:21.419 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T22:39:21.458 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:39:21.736 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T22:39:21.752 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T22:39:21.794 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:39:21.847 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:39:21.853 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:39:21.980 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:39:22.047 INFO:teuthology.orchestra.run.smithi122.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T22:39:22.063 INFO:teuthology.orchestra.run.smithi122.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:39:22.105 INFO:teuthology.orchestra.run.smithi122.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:39:22.414 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T22:39:22.528 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T22:39:22.575 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T22:39:22.743 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:39:22.855 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:39:22.894 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:39:23.045 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:39:23.180 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:39:23.246 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package bison. 2024-04-25T22:39:23.305 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:39:23.350 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173964 files and directories currently installed.) 2024-04-25T22:39:23.355 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T22:39:23.398 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:39:23.432 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:39:23.521 INFO:teuthology.orchestra.run.smithi122.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T22:39:23.591 INFO:teuthology.orchestra.run.smithi122.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:39:23.740 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T22:39:23.767 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T22:39:23.805 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:39:23.806 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:39:24.021 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:39:24.069 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T22:39:24.084 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T22:39:24.126 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:39:24.624 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T22:39:24.652 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T22:39:24.690 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:39:24.951 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T22:39:24.967 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T22:39:25.009 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:39:25.247 INFO:teuthology.orchestra.run.smithi122.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:39:25.262 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T22:39:25.290 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T22:39:25.328 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:39:25.739 INFO:teuthology.orchestra.run.smithi122.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:39:25.743 DEBUG:teuthology.parallel:result is None 2024-04-25T22:39:25.831 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T22:39:25.958 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T22:39:26.084 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T22:39:26.210 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T22:39:26.336 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T22:39:26.462 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T22:39:26.580 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T22:39:26.652 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T22:39:26.706 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T22:39:26.816 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T22:39:26.967 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T22:39:28.160 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T22:39:28.603 INFO:teuthology.orchestra.run.smithi148.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T22:39:28.608 DEBUG:teuthology.parallel:result is None 2024-04-25T22:39:28.609 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:39:28.833 DEBUG:teuthology.orchestra.run.smithi057:> dpkg-query -W -f '${Version}' ceph 2024-04-25T22:39:28.853 INFO:teuthology.orchestra.run.smithi057.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:39:28.854 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:39:28.854 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-25T22:39:28.856 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:39:29.083 DEBUG:teuthology.orchestra.run.smithi122:> dpkg-query -W -f '${Version}' ceph 2024-04-25T22:39:29.102 INFO:teuthology.orchestra.run.smithi122.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:39:29.102 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:39:29.102 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-25T22:39:29.104 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:39:29.327 DEBUG:teuthology.orchestra.run.smithi148:> dpkg-query -W -f '${Version}' ceph 2024-04-25T22:39:29.346 INFO:teuthology.orchestra.run.smithi148.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:39:29.346 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:39:29.346 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-25T22:39:29.348 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:39:29.495 DEBUG:teuthology.orchestra.run.smithi188:> dpkg-query -W -f '${Version}' ceph 2024-04-25T22:39:29.514 INFO:teuthology.orchestra.run.smithi188.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:39:29.514 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T22:39:29.515 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-25T22:39:29.516 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T22:39:29.516 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:39:29.517 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T22:39:29.532 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-25T22:39:29.532 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T22:39:29.546 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-25T22:39:29.546 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T22:39:29.560 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-25T22:39:29.561 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T22:39:29.575 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T22:39:29.575 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:39:29.575 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T22:39:29.589 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T22:39:29.643 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-25T22:39:29.643 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T22:39:29.657 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T22:39:29.713 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-25T22:39:29.713 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T22:39:29.726 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T22:39:29.786 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-25T22:39:29.786 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T22:39:29.800 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T22:39:29.853 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T22:39:29.853 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:39:29.853 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T22:39:29.867 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T22:39:29.924 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-25T22:39:29.924 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T22:39:29.937 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T22:39:29.992 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-25T22:39:29.992 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T22:39:30.006 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T22:39:30.062 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-25T22:39:30.062 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T22:39:30.075 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T22:39:30.129 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T22:39:30.129 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:39:30.129 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T22:39:30.144 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T22:39:30.200 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-25T22:39:30.200 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T22:39:30.213 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T22:39:30.267 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-25T22:39:30.268 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T22:39:30.281 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T22:39:30.337 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-25T22:39:30.337 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T22:39:30.350 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T22:39:30.405 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T22:39:30.491 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T22:39:30.491 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /var/log/ceph 2024-04-25T22:39:30.493 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 777 /var/log/ceph 2024-04-25T22:39:30.496 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /var/log/ceph 2024-04-25T22:39:30.498 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 777 /var/log/ceph 2024-04-25T22:39:30.510 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T22:39:30.511 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T22:39:30.549 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T22:39:30.551 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T22:39:30.554 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T22:39:30.566 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T22:39:30.566 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T22:39:30.605 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T22:39:30.607 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T22:39:30.610 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T22:39:30.632 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T22:39:30.632 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T22:39:30.632 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058', 'branch': 'squid', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7674058', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 9595, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'sleep_before_teardown': 0, 'subset': '3/4', 'suite': 'powercycle', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a', 'targets': {'smithi057.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDsF5KKvx9Zp3hhI2gvE4mkhISy2QpxBdhDYnTa2sXX0CiiOwB8bw4Wx+OS0rcmVdH9g794qd/rrVPKW66Bxs2I=', 'smithi122.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN2rONxR4WSf376EVafTW6Hzo8ypuxs5i5Gg4/4zbW33QRTucGmzx5/zvfd3nTzrt2cE3uGCl5Tbidf2xUVUNi4=', 'smithi148.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKUp2AtTkGIyOqNBmH3t7KlgeYlUhtsH0ctPCzaO14K18wRWZx9/xz8ep5oPymRmpnIQ6Z45SD20VFrL+4ooORg=', 'smithi188.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIyw+IKuZBJWO8ssnWXm6Xrv4qpiXf5DDCnU7gOt3G6GDXTgogTRwWzT387JEZ7MmLnSUIY9CQm5v/xKDxrr41Q='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_21:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T22:39:30.633 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T22:39:30.661 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T22:39:30.663 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T22:39:30.671 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T22:39:30.676 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T22:39:30.709 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T22:39:30.711 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T22:39:30.718 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T22:39:30.733 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-25T22:39:30.733 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T22:39:30.769 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T22:39:30.769 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_1 2024-04-25T22:39:30.817 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T22:39:30.817 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:39:30.817 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 879 Links: 1 2024-04-25T22:39:30.817 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:39:30.817 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-04-25 22:32:54.066131235 +0000 2024-04-25T22:39:30.817 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-04-25 22:32:53.826133379 +0000 2024-04-25T22:39:30.817 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-04-25 22:32:53.826133379 +0000 2024-04-25T22:39:30.818 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-04-25T22:39:30.818 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T22:39:30.871 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-04-25T22:39:30.871 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-04-25T22:39:30.871 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000335983 s, 1.5 MB/s 2024-04-25T22:39:30.872 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T22:39:30.922 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_2 2024-04-25T22:39:30.969 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T22:39:30.969 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:39:30.969 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-04-25T22:39:30.969 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:39:30.969 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-04-25 22:32:54.294129198 +0000 2024-04-25T22:39:30.969 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-04-25 22:32:54.290129233 +0000 2024-04-25T22:39:30.969 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-04-25 22:32:54.290129233 +0000 2024-04-25T22:39:30.969 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-04-25T22:39:30.970 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T22:39:31.024 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-04-25T22:39:31.024 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-04-25T22:39:31.024 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000422477 s, 1.2 MB/s 2024-04-25T22:39:31.025 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T22:39:31.075 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_3 2024-04-25T22:39:31.121 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T22:39:31.121 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:39:31.121 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-04-25T22:39:31.121 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:39:31.121 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-04-25 22:32:55.026122660 +0000 2024-04-25T22:39:31.121 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-04-25 22:32:54.762125018 +0000 2024-04-25T22:39:31.121 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-04-25 22:32:54.762125018 +0000 2024-04-25T22:39:31.122 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-04-25T22:39:31.122 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T22:39:31.175 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-04-25T22:39:31.176 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-04-25T22:39:31.176 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000371287 s, 1.4 MB/s 2024-04-25T22:39:31.177 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T22:39:31.226 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_4 2024-04-25T22:39:31.272 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T22:39:31.273 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:39:31.273 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-04-25T22:39:31.273 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:39:31.273 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-04-25 22:32:55.490118515 +0000 2024-04-25T22:39:31.273 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-04-25 22:32:55.242120730 +0000 2024-04-25T22:39:31.273 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-04-25 22:32:55.242120730 +0000 2024-04-25T22:39:31.273 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-04-25T22:39:31.273 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T22:39:31.327 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-04-25T22:39:31.327 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-04-25T22:39:31.327 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000378957 s, 1.4 MB/s 2024-04-25T22:39:31.328 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T22:39:31.378 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-25T22:39:31.378 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-25T22:39:31.378 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T22:39:31.384 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T22:39:31.384 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_1 2024-04-25T22:39:31.430 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T22:39:31.430 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:39:31.430 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-04-25T22:39:31.430 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:39:31.430 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-04-25 22:32:49.918484534 +0000 2024-04-25T22:39:31.430 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-04-25 22:32:49.658486858 +0000 2024-04-25T22:39:31.431 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-04-25 22:32:49.658486858 +0000 2024-04-25T22:39:31.431 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2024-04-25T22:39:31.431 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T22:39:31.484 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-04-25T22:39:31.484 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-04-25T22:39:31.484 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000363844 s, 1.4 MB/s 2024-04-25T22:39:31.485 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T22:39:31.535 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_2 2024-04-25T22:39:31.582 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T22:39:31.582 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:39:31.582 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 901 Links: 1 2024-04-25T22:39:31.582 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:39:31.582 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-04-25 22:32:50.430479962 +0000 2024-04-25T22:39:31.582 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-04-25 22:32:50.174482248 +0000 2024-04-25T22:39:31.582 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-04-25 22:32:50.174482248 +0000 2024-04-25T22:39:31.582 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2024-04-25T22:39:31.583 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T22:39:31.636 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-04-25T22:39:31.636 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-04-25T22:39:31.636 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000412927 s, 1.2 MB/s 2024-04-25T22:39:31.637 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T22:39:31.687 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_3 2024-04-25T22:39:31.733 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T22:39:31.734 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:39:31.734 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-04-25T22:39:31.734 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:39:31.734 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-04-25 22:32:50.918475603 +0000 2024-04-25T22:39:31.734 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-04-25 22:32:50.658477925 +0000 2024-04-25T22:39:31.734 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-04-25 22:32:50.658477925 +0000 2024-04-25T22:39:31.734 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2024-04-25T22:39:31.734 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T22:39:31.788 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-04-25T22:39:31.788 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-04-25T22:39:31.788 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000438127 s, 1.2 MB/s 2024-04-25T22:39:31.789 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T22:39:31.839 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_4 2024-04-25T22:39:31.889 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T22:39:31.890 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:39:31.890 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 938 Links: 1 2024-04-25T22:39:31.890 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:39:31.890 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-04-25 22:32:51.398471315 +0000 2024-04-25T22:39:31.890 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-04-25 22:32:51.162473424 +0000 2024-04-25T22:39:31.890 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-04-25 22:32:51.162473424 +0000 2024-04-25T22:39:31.890 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2024-04-25T22:39:31.890 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T22:39:31.948 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-04-25T22:39:31.948 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-04-25T22:39:31.948 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000382197 s, 1.3 MB/s 2024-04-25T22:39:31.949 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T22:39:31.999 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-25T22:39:31.999 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-25T22:39:31.999 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T22:39:32.005 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T22:39:32.005 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_1 2024-04-25T22:39:32.054 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T22:39:32.054 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:39:32.054 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-04-25T22:39:32.054 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:39:32.054 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-04-25 22:32:55.075113382 +0000 2024-04-25T22:39:32.054 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-04-25 22:32:54.803115811 +0000 2024-04-25T22:39:32.054 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-04-25 22:32:54.803115811 +0000 2024-04-25T22:39:32.055 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2024-04-25T22:39:32.055 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T22:39:32.107 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-04-25T22:39:32.108 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-04-25T22:39:32.108 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000333819 s, 1.5 MB/s 2024-04-25T22:39:32.109 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T22:39:32.159 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_2 2024-04-25T22:39:32.206 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T22:39:32.206 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:39:32.206 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-04-25T22:39:32.206 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:39:32.206 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-04-25 22:32:55.595108737 +0000 2024-04-25T22:39:32.206 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-04-25 22:32:55.303111345 +0000 2024-04-25T22:39:32.206 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-04-25 22:32:55.303111345 +0000 2024-04-25T22:39:32.207 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2024-04-25T22:39:32.207 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T22:39:32.260 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-04-25T22:39:32.260 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-04-25T22:39:32.260 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000435697 s, 1.2 MB/s 2024-04-25T22:39:32.261 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T22:39:32.311 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_3 2024-04-25T22:39:32.358 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T22:39:32.358 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:39:32.358 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-04-25T22:39:32.358 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:39:32.358 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-04-25 22:32:56.051104664 +0000 2024-04-25T22:39:32.358 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-04-25 22:32:55.815106772 +0000 2024-04-25T22:39:32.358 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-04-25 22:32:55.815106772 +0000 2024-04-25T22:39:32.358 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2024-04-25T22:39:32.359 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T22:39:32.412 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-04-25T22:39:32.412 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-04-25T22:39:32.412 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000377093 s, 1.4 MB/s 2024-04-25T22:39:32.413 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T22:39:32.463 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_4 2024-04-25T22:39:32.509 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T22:39:32.510 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:39:32.510 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 937 Links: 1 2024-04-25T22:39:32.510 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:39:32.510 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-04-25 22:32:56.567100055 +0000 2024-04-25T22:39:32.510 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-04-25 22:32:56.299102449 +0000 2024-04-25T22:39:32.510 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-04-25 22:32:56.299102449 +0000 2024-04-25T22:39:32.510 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2024-04-25T22:39:32.510 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T22:39:32.564 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-04-25T22:39:32.564 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-04-25T22:39:32.564 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.00035108 s, 1.5 MB/s 2024-04-25T22:39:32.566 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T22:39:32.615 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-25T22:39:32.615 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi188.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-25T22:39:32.615 INFO:tasks.ceph:Generating config... 2024-04-25T22:39:32.616 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T22:39:32.617 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T22:39:32.617 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T22:39:32.617 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T22:39:32.617 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T22:39:32.617 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-25T22:39:32.617 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-25T22:39:32.617 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2024-04-25T22:39:32.617 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T22:39:32.617 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T22:39:32.617 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-25T22:39:32.617 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-25T22:39:32.617 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T22:39:32.618 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T22:39:32.618 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-25T22:39:32.618 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T22:39:32.618 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T22:39:32.618 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T22:39:32.618 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-25T22:39:32.618 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T22:39:32.618 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-25T22:39:32.618 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T22:39:32.618 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T22:39:32.619 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T22:39:32.654 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T22:39:32.662 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T22:39:32.738 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T22:39:32.790 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.57'), ('mon.b', '[v2:172.21.15.57:3301,v1:172.21.15.57:6790]'), ('mon.c', '[v2:172.21.15.57:3302,v1:172.21.15.57:6791]')] 2024-04-25T22:39:32.790 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.57,[v2:172.21.15.57:3301,v1:172.21.15.57:6790],[v2:172.21.15.57:3302,v1:172.21.15.57:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-04-25T22:39:32.791 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:39:32.791 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T22:39:32.835 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.57 --addv b '[v2:172.21.15.57:3301,v1:172.21.15.57:6790]' --addv c '[v2:172.21.15.57:3302,v1:172.21.15.57:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:39:32.917 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:39:32.918 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: generated fsid 5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d 2024-04-25T22:39:32.918 INFO:teuthology.orchestra.run.smithi057.stdout:setting min_mon_release = quincy 2024-04-25T22:39:32.918 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 0 2024-04-25T22:39:32.918 INFO:teuthology.orchestra.run.smithi057.stdout:fsid 5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d 2024-04-25T22:39:32.918 INFO:teuthology.orchestra.run.smithi057.stdout:last_changed 2024-04-25T22:39:32.918032+0000 2024-04-25T22:39:32.918 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-04-25T22:39:32.918032+0000 2024-04-25T22:39:32.918 INFO:teuthology.orchestra.run.smithi057.stdout:min_mon_release 17 (quincy) 2024-04-25T22:39:32.918 INFO:teuthology.orchestra.run.smithi057.stdout:election_strategy: 1 2024-04-25T22:39:32.918 INFO:teuthology.orchestra.run.smithi057.stdout:0: [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon.a 2024-04-25T22:39:32.918 INFO:teuthology.orchestra.run.smithi057.stdout:1: [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] mon.b 2024-04-25T22:39:32.918 INFO:teuthology.orchestra.run.smithi057.stdout:2: [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] mon.c 2024-04-25T22:39:32.918 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T22:39:32.919 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T22:39:32.967 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d... 2024-04-25T22:39:32.968 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T22:39:33.013 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T22:39:33.015 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T22:39:33.018 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T22:39:33.044 INFO:teuthology.orchestra.run.smithi122.stdout:[global] 2024-04-25T22:39:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: chdir = "" 2024-04-25T22:39:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T22:39:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: auth supported = cephx 2024-04-25T22:39:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: filestore xattr use omap = true 2024-04-25T22:39:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: mon clock drift allowed = 1.000 2024-04-25T22:39:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: osd crush chooseleaf type = 0 2024-04-25T22:39:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: auth debug = true 2024-04-25T22:39:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on old message = true 2024-04-25T22:39:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on bug = true 2024-04-25T22:39:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T22:39:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: mon pg warn max object skew = 0 2024-04-25T22:39:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T22:39:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T22:39:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default size = 2 2024-04-25T22:39:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow primary affinity = true 2024-04-25T22:39:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow pg remap = true 2024-04-25T22:39:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on legacy crush tunables = false 2024-04-25T22:39:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on crush straw calc version zero = false 2024-04-25T22:39:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on no sortbitwise = false 2024-04-25T22:39:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on osd down out interval zero = false 2024-04-25T22:39:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on too few osds = false 2024-04-25T22:39:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T22:39:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T22:39:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: mon_allow_pool_size_one = true 2024-04-25T22:39:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T22:39:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: osd default data pool replay window = 5 2024-04-25T22:39:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: mon allow pool delete = true 2024-04-25T22:39:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: mon cluster log file level = debug 2024-04-25T22:39:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: debug asserts on shutdown = true 2024-04-25T22:39:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: mon health detail to clog = false 2024-04-25T22:39:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: mon host = "172.21.15.57,[v2:172.21.15.57:3301,v1:172.21.15.57:6790],[v2:172.21.15.57:3302,v1:172.21.15.57:6791]" 2024-04-25T22:39:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: fsid = 5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d 2024-04-25T22:39:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.047 INFO:teuthology.orchestra.run.smithi122.stdout:[osd] 2024-04-25T22:39:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: osd journal size = 100 2024-04-25T22:39:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub load threshold = 5.0 2024-04-25T22:39:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub max interval = 600 2024-04-25T22:39:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: osd mclock profile = high_recovery_ops 2024-04-25T22:39:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: osd recover clone overlap = true 2024-04-25T22:39:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: osd recovery max chunk = 1048576 2024-04-25T22:39:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug shutdown = true 2024-04-25T22:39:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug op order = true 2024-04-25T22:39:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug verify stray on activate = true 2024-04-25T22:39:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug trim objects = true 2024-04-25T22:39:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: osd open classes on start = true 2024-04-25T22:39:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug pg log writeout = true 2024-04-25T22:39:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: osd deep scrub update digest min age = 30 2024-04-25T22:39:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: osd map max advance = 10 2024-04-25T22:39:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: journal zero on create = true 2024-04-25T22:39:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: filestore ondisk finisher threads = 3 2024-04-25T22:39:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: filestore apply finisher threads = 3 2024-04-25T22:39:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: bdev debug aio = true 2024-04-25T22:39:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug misdirected ops = true 2024-04-25T22:39:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: bdev async discard = True 2024-04-25T22:39:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: bdev enable discard = True 2024-04-25T22:39:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore allocator = stupid 2024-04-25T22:39:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore block size = 96636764160 2024-04-25T22:39:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore fsck on mount = True 2024-04-25T22:39:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluefs = 1/20 2024-04-25T22:39:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluestore = 1/20 2024-04-25T22:39:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-04-25T22:39:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: debug osd = 20 2024-04-25T22:39:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: debug rocksdb = 4/10 2024-04-25T22:39:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T22:39:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd full ratio = 0.9 2024-04-25T22:39:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd nearfull ratio = 0.8 2024-04-25T22:39:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: osd blocked scrub grace period = 3600 2024-04-25T22:39:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: osd failsafe full ratio = 0.95 2024-04-25T22:39:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: osd max markdown count = 1000 2024-04-25T22:39:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: osd objectstore = bluestore 2024-04-25T22:39:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.050 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr] 2024-04-25T22:39:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-04-25T22:39:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: debug mgr = 20 2024-04-25T22:39:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2024-04-25T22:39:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2024-04-25T22:39:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:39:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:39:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: mgr/telemetry/nag = false 2024-04-25T22:39:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.051 INFO:teuthology.orchestra.run.smithi122.stdout:[mon] 2024-04-25T22:39:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-04-25T22:39:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2024-04-25T22:39:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: debug paxos = 20 2024-04-25T22:39:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2024-04-25T22:39:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: mon data avail warn = 5 2024-04-25T22:39:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: mon mgr mkfs grace = 240 2024-04-25T22:39:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:39:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd reporter subtree level = osd 2024-04-25T22:39:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd prime pg temp = true 2024-04-25T22:39:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:39:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T22:39:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T22:39:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T22:39:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T22:39:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T22:39:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T22:39:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: # 1m isn't quite enough 2024-04-25T22:39:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: mon_down_mkfs_grace = 2m 2024-04-25T22:39:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_filestore_osds = false 2024-04-25T22:39:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-25T22:39:33.053 INFO:teuthology.orchestra.run.smithi122.stdout:[client] 2024-04-25T22:39:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: rgw cache enabled = true 2024-04-25T22:39:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable ops log = true 2024-04-25T22:39:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable usage log = true 2024-04-25T22:39:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T22:39:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T22:39:33.053 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.a] 2024-04-25T22:39:33.053 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.b] 2024-04-25T22:39:33.053 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.c] 2024-04-25T22:39:33.054 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.a] 2024-04-25T22:39:33.054 INFO:teuthology.orchestra.run.smithi188.stdout:[global] 2024-04-25T22:39:33.055 INFO:teuthology.orchestra.run.smithi188.stdout: chdir = "" 2024-04-25T22:39:33.055 INFO:teuthology.orchestra.run.smithi188.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T22:39:33.055 INFO:teuthology.orchestra.run.smithi188.stdout: auth supported = cephx 2024-04-25T22:39:33.055 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.055 INFO:teuthology.orchestra.run.smithi188.stdout: filestore xattr use omap = true 2024-04-25T22:39:33.055 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.055 INFO:teuthology.orchestra.run.smithi188.stdout: mon clock drift allowed = 1.000 2024-04-25T22:39:33.055 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.055 INFO:teuthology.orchestra.run.smithi188.stdout: osd crush chooseleaf type = 0 2024-04-25T22:39:33.055 INFO:teuthology.orchestra.run.smithi188.stdout: auth debug = true 2024-04-25T22:39:33.055 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.055 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on old message = true 2024-04-25T22:39:33.056 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on bug = true 2024-04-25T22:39:33.056 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.056 INFO:teuthology.orchestra.run.smithi188.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T22:39:33.056 INFO:teuthology.orchestra.run.smithi188.stdout: mon pg warn max object skew = 0 2024-04-25T22:39:33.056 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.056 INFO:teuthology.orchestra.run.smithi188.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T22:39:33.056 INFO:teuthology.orchestra.run.smithi188.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T22:39:33.056 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.056 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default size = 2 2024-04-25T22:39:33.056 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.056 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow primary affinity = true 2024-04-25T22:39:33.056 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow pg remap = true 2024-04-25T22:39:33.056 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on legacy crush tunables = false 2024-04-25T22:39:33.056 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on crush straw calc version zero = false 2024-04-25T22:39:33.057 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on no sortbitwise = false 2024-04-25T22:39:33.057 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on osd down out interval zero = false 2024-04-25T22:39:33.057 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on too few osds = false 2024-04-25T22:39:33.057 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T22:39:33.057 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T22:39:33.057 INFO:teuthology.orchestra.run.smithi188.stdout: mon_allow_pool_size_one = true 2024-04-25T22:39:33.057 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.057 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T22:39:33.057 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.057 INFO:teuthology.orchestra.run.smithi188.stdout: osd default data pool replay window = 5 2024-04-25T22:39:33.057 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.057 INFO:teuthology.orchestra.run.smithi188.stdout: mon allow pool delete = true 2024-04-25T22:39:33.057 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.057 INFO:teuthology.orchestra.run.smithi188.stdout: mon cluster log file level = debug 2024-04-25T22:39:33.058 INFO:teuthology.orchestra.run.smithi188.stdout: debug asserts on shutdown = true 2024-04-25T22:39:33.058 INFO:teuthology.orchestra.run.smithi188.stdout: mon health detail to clog = false 2024-04-25T22:39:33.058 INFO:teuthology.orchestra.run.smithi188.stdout: mon host = "172.21.15.57,[v2:172.21.15.57:3301,v1:172.21.15.57:6790],[v2:172.21.15.57:3302,v1:172.21.15.57:6791]" 2024-04-25T22:39:33.058 INFO:teuthology.orchestra.run.smithi188.stdout: fsid = 5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d 2024-04-25T22:39:33.058 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.058 INFO:teuthology.orchestra.run.smithi188.stdout:[osd] 2024-04-25T22:39:33.058 INFO:teuthology.orchestra.run.smithi188.stdout: osd journal size = 100 2024-04-25T22:39:33.058 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.058 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub load threshold = 5.0 2024-04-25T22:39:33.058 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub max interval = 600 2024-04-25T22:39:33.058 INFO:teuthology.orchestra.run.smithi188.stdout: osd mclock profile = high_recovery_ops 2024-04-25T22:39:33.058 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.059 INFO:teuthology.orchestra.run.smithi188.stdout: osd recover clone overlap = true 2024-04-25T22:39:33.059 INFO:teuthology.orchestra.run.smithi188.stdout: osd recovery max chunk = 1048576 2024-04-25T22:39:33.059 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.059 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug shutdown = true 2024-04-25T22:39:33.059 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug op order = true 2024-04-25T22:39:33.059 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug verify stray on activate = true 2024-04-25T22:39:33.059 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug trim objects = true 2024-04-25T22:39:33.059 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.059 INFO:teuthology.orchestra.run.smithi188.stdout: osd open classes on start = true 2024-04-25T22:39:33.059 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug pg log writeout = true 2024-04-25T22:39:33.059 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.059 INFO:teuthology.orchestra.run.smithi188.stdout: osd deep scrub update digest min age = 30 2024-04-25T22:39:33.059 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.060 INFO:teuthology.orchestra.run.smithi188.stdout: osd map max advance = 10 2024-04-25T22:39:33.060 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.060 INFO:teuthology.orchestra.run.smithi188.stdout: journal zero on create = true 2024-04-25T22:39:33.060 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.060 INFO:teuthology.orchestra.run.smithi188.stdout: filestore ondisk finisher threads = 3 2024-04-25T22:39:33.060 INFO:teuthology.orchestra.run.smithi188.stdout: filestore apply finisher threads = 3 2024-04-25T22:39:33.060 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.060 INFO:teuthology.orchestra.run.smithi188.stdout: bdev debug aio = true 2024-04-25T22:39:33.060 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug misdirected ops = true 2024-04-25T22:39:33.060 INFO:teuthology.orchestra.run.smithi188.stdout: bdev async discard = True 2024-04-25T22:39:33.060 INFO:teuthology.orchestra.run.smithi188.stdout: bdev enable discard = True 2024-04-25T22:39:33.061 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore allocator = stupid 2024-04-25T22:39:33.061 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore block size = 96636764160 2024-04-25T22:39:33.061 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore fsck on mount = True 2024-04-25T22:39:33.061 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluefs = 1/20 2024-04-25T22:39:33.061 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluestore = 1/20 2024-04-25T22:39:33.061 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-04-25T22:39:33.061 INFO:teuthology.orchestra.run.smithi188.stdout: debug osd = 20 2024-04-25T22:39:33.061 INFO:teuthology.orchestra.run.smithi188.stdout: debug rocksdb = 4/10 2024-04-25T22:39:33.061 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T22:39:33.061 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd full ratio = 0.9 2024-04-25T22:39:33.061 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd nearfull ratio = 0.8 2024-04-25T22:39:33.061 INFO:teuthology.orchestra.run.smithi188.stdout: osd blocked scrub grace period = 3600 2024-04-25T22:39:33.061 INFO:teuthology.orchestra.run.smithi188.stdout: osd failsafe full ratio = 0.95 2024-04-25T22:39:33.061 INFO:teuthology.orchestra.run.smithi188.stdout: osd max markdown count = 1000 2024-04-25T22:39:33.062 INFO:teuthology.orchestra.run.smithi188.stdout: osd objectstore = bluestore 2024-04-25T22:39:33.062 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.062 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr] 2024-04-25T22:39:33.062 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-04-25T22:39:33.062 INFO:teuthology.orchestra.run.smithi188.stdout: debug mgr = 20 2024-04-25T22:39:33.062 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2024-04-25T22:39:33.062 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2024-04-25T22:39:33.062 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:39:33.062 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:39:33.062 INFO:teuthology.orchestra.run.smithi188.stdout: mgr/telemetry/nag = false 2024-04-25T22:39:33.062 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.062 INFO:teuthology.orchestra.run.smithi188.stdout:[mon] 2024-04-25T22:39:33.062 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-04-25T22:39:33.062 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2024-04-25T22:39:33.063 INFO:teuthology.orchestra.run.smithi188.stdout: debug paxos = 20 2024-04-25T22:39:33.063 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2024-04-25T22:39:33.063 INFO:teuthology.orchestra.run.smithi188.stdout: mon data avail warn = 5 2024-04-25T22:39:33.063 INFO:teuthology.orchestra.run.smithi188.stdout: mon mgr mkfs grace = 240 2024-04-25T22:39:33.063 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:39:33.063 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd reporter subtree level = osd 2024-04-25T22:39:33.063 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd prime pg temp = true 2024-04-25T22:39:33.063 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:39:33.063 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.063 INFO:teuthology.orchestra.run.smithi188.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T22:39:33.063 INFO:teuthology.orchestra.run.smithi188.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T22:39:33.063 INFO:teuthology.orchestra.run.smithi188.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T22:39:33.063 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.063 INFO:teuthology.orchestra.run.smithi188.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T22:39:33.063 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T22:39:33.064 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T22:39:33.064 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.064 INFO:teuthology.orchestra.run.smithi188.stdout: # 1m isn't quite enough 2024-04-25T22:39:33.064 INFO:teuthology.orchestra.run.smithi188.stdout: mon_down_mkfs_grace = 2m 2024-04-25T22:39:33.064 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.064 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_filestore_osds = false 2024-04-25T22:39:33.064 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-04-25T22:39:33.064 INFO:teuthology.orchestra.run.smithi188.stdout:[client] 2024-04-25T22:39:33.064 INFO:teuthology.orchestra.run.smithi188.stdout: rgw cache enabled = true 2024-04-25T22:39:33.064 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable ops log = true 2024-04-25T22:39:33.064 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable usage log = true 2024-04-25T22:39:33.064 INFO:teuthology.orchestra.run.smithi188.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T22:39:33.064 INFO:teuthology.orchestra.run.smithi188.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T22:39:33.064 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.a] 2024-04-25T22:39:33.064 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.b] 2024-04-25T22:39:33.065 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.c] 2024-04-25T22:39:33.065 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.a] 2024-04-25T22:39:33.065 INFO:teuthology.orchestra.run.smithi148.stdout:[global] 2024-04-25T22:39:33.065 INFO:teuthology.orchestra.run.smithi148.stdout: chdir = "" 2024-04-25T22:39:33.065 INFO:teuthology.orchestra.run.smithi148.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T22:39:33.065 INFO:teuthology.orchestra.run.smithi148.stdout: auth supported = cephx 2024-04-25T22:39:33.065 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.065 INFO:teuthology.orchestra.run.smithi148.stdout: filestore xattr use omap = true 2024-04-25T22:39:33.065 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.065 INFO:teuthology.orchestra.run.smithi148.stdout: mon clock drift allowed = 1.000 2024-04-25T22:39:33.065 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.065 INFO:teuthology.orchestra.run.smithi148.stdout: osd crush chooseleaf type = 0 2024-04-25T22:39:33.065 INFO:teuthology.orchestra.run.smithi148.stdout: auth debug = true 2024-04-25T22:39:33.065 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.065 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on old message = true 2024-04-25T22:39:33.066 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on bug = true 2024-04-25T22:39:33.066 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.066 INFO:teuthology.orchestra.run.smithi148.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T22:39:33.066 INFO:teuthology.orchestra.run.smithi148.stdout: mon pg warn max object skew = 0 2024-04-25T22:39:33.066 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.066 INFO:teuthology.orchestra.run.smithi148.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T22:39:33.066 INFO:teuthology.orchestra.run.smithi148.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T22:39:33.066 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.066 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default size = 2 2024-04-25T22:39:33.066 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.066 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow primary affinity = true 2024-04-25T22:39:33.066 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow pg remap = true 2024-04-25T22:39:33.066 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on legacy crush tunables = false 2024-04-25T22:39:33.066 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on crush straw calc version zero = false 2024-04-25T22:39:33.067 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on no sortbitwise = false 2024-04-25T22:39:33.067 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on osd down out interval zero = false 2024-04-25T22:39:33.067 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on too few osds = false 2024-04-25T22:39:33.067 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T22:39:33.067 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T22:39:33.067 INFO:teuthology.orchestra.run.smithi148.stdout: mon_allow_pool_size_one = true 2024-04-25T22:39:33.067 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.067 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T22:39:33.067 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.067 INFO:teuthology.orchestra.run.smithi148.stdout: osd default data pool replay window = 5 2024-04-25T22:39:33.067 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.067 INFO:teuthology.orchestra.run.smithi148.stdout: mon allow pool delete = true 2024-04-25T22:39:33.067 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.067 INFO:teuthology.orchestra.run.smithi148.stdout: mon cluster log file level = debug 2024-04-25T22:39:33.068 INFO:teuthology.orchestra.run.smithi148.stdout: debug asserts on shutdown = true 2024-04-25T22:39:33.068 INFO:teuthology.orchestra.run.smithi148.stdout: mon health detail to clog = false 2024-04-25T22:39:33.068 INFO:teuthology.orchestra.run.smithi148.stdout: mon host = "172.21.15.57,[v2:172.21.15.57:3301,v1:172.21.15.57:6790],[v2:172.21.15.57:3302,v1:172.21.15.57:6791]" 2024-04-25T22:39:33.068 INFO:teuthology.orchestra.run.smithi148.stdout: fsid = 5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d 2024-04-25T22:39:33.068 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.068 INFO:teuthology.orchestra.run.smithi148.stdout:[osd] 2024-04-25T22:39:33.068 INFO:teuthology.orchestra.run.smithi148.stdout: osd journal size = 100 2024-04-25T22:39:33.068 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.068 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub load threshold = 5.0 2024-04-25T22:39:33.068 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub max interval = 600 2024-04-25T22:39:33.068 INFO:teuthology.orchestra.run.smithi148.stdout: osd mclock profile = high_recovery_ops 2024-04-25T22:39:33.068 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.068 INFO:teuthology.orchestra.run.smithi148.stdout: osd recover clone overlap = true 2024-04-25T22:39:33.068 INFO:teuthology.orchestra.run.smithi148.stdout: osd recovery max chunk = 1048576 2024-04-25T22:39:33.068 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.069 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug shutdown = true 2024-04-25T22:39:33.069 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug op order = true 2024-04-25T22:39:33.069 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug verify stray on activate = true 2024-04-25T22:39:33.069 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug trim objects = true 2024-04-25T22:39:33.069 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.069 INFO:teuthology.orchestra.run.smithi148.stdout: osd open classes on start = true 2024-04-25T22:39:33.069 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug pg log writeout = true 2024-04-25T22:39:33.069 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.069 INFO:teuthology.orchestra.run.smithi148.stdout: osd deep scrub update digest min age = 30 2024-04-25T22:39:33.069 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.069 INFO:teuthology.orchestra.run.smithi148.stdout: osd map max advance = 10 2024-04-25T22:39:33.069 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.069 INFO:teuthology.orchestra.run.smithi148.stdout: journal zero on create = true 2024-04-25T22:39:33.069 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.070 INFO:teuthology.orchestra.run.smithi148.stdout: filestore ondisk finisher threads = 3 2024-04-25T22:39:33.070 INFO:teuthology.orchestra.run.smithi148.stdout: filestore apply finisher threads = 3 2024-04-25T22:39:33.070 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.070 INFO:teuthology.orchestra.run.smithi148.stdout: bdev debug aio = true 2024-04-25T22:39:33.070 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug misdirected ops = true 2024-04-25T22:39:33.070 INFO:teuthology.orchestra.run.smithi148.stdout: bdev async discard = True 2024-04-25T22:39:33.070 INFO:teuthology.orchestra.run.smithi148.stdout: bdev enable discard = True 2024-04-25T22:39:33.070 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore allocator = stupid 2024-04-25T22:39:33.070 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore block size = 96636764160 2024-04-25T22:39:33.070 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore fsck on mount = True 2024-04-25T22:39:33.070 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluefs = 1/20 2024-04-25T22:39:33.070 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluestore = 1/20 2024-04-25T22:39:33.070 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-04-25T22:39:33.070 INFO:teuthology.orchestra.run.smithi148.stdout: debug osd = 20 2024-04-25T22:39:33.071 INFO:teuthology.orchestra.run.smithi148.stdout: debug rocksdb = 4/10 2024-04-25T22:39:33.071 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T22:39:33.071 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd full ratio = 0.9 2024-04-25T22:39:33.071 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd nearfull ratio = 0.8 2024-04-25T22:39:33.071 INFO:teuthology.orchestra.run.smithi148.stdout: osd blocked scrub grace period = 3600 2024-04-25T22:39:33.071 INFO:teuthology.orchestra.run.smithi148.stdout: osd failsafe full ratio = 0.95 2024-04-25T22:39:33.071 INFO:teuthology.orchestra.run.smithi148.stdout: osd max markdown count = 1000 2024-04-25T22:39:33.071 INFO:teuthology.orchestra.run.smithi148.stdout: osd objectstore = bluestore 2024-04-25T22:39:33.071 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.071 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr] 2024-04-25T22:39:33.071 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-04-25T22:39:33.071 INFO:teuthology.orchestra.run.smithi148.stdout: debug mgr = 20 2024-04-25T22:39:33.071 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2024-04-25T22:39:33.071 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2024-04-25T22:39:33.072 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:39:33.072 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:39:33.072 INFO:teuthology.orchestra.run.smithi148.stdout: mgr/telemetry/nag = false 2024-04-25T22:39:33.072 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.072 INFO:teuthology.orchestra.run.smithi148.stdout:[mon] 2024-04-25T22:39:33.072 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-04-25T22:39:33.072 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2024-04-25T22:39:33.072 INFO:teuthology.orchestra.run.smithi148.stdout: debug paxos = 20 2024-04-25T22:39:33.072 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2024-04-25T22:39:33.072 INFO:teuthology.orchestra.run.smithi148.stdout: mon data avail warn = 5 2024-04-25T22:39:33.072 INFO:teuthology.orchestra.run.smithi148.stdout: mon mgr mkfs grace = 240 2024-04-25T22:39:33.072 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:39:33.072 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd reporter subtree level = osd 2024-04-25T22:39:33.072 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd prime pg temp = true 2024-04-25T22:39:33.073 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:39:33.073 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.073 INFO:teuthology.orchestra.run.smithi148.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T22:39:33.073 INFO:teuthology.orchestra.run.smithi148.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T22:39:33.073 INFO:teuthology.orchestra.run.smithi148.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T22:39:33.073 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.073 INFO:teuthology.orchestra.run.smithi148.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T22:39:33.073 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T22:39:33.073 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T22:39:33.073 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.073 INFO:teuthology.orchestra.run.smithi148.stdout: # 1m isn't quite enough 2024-04-25T22:39:33.073 INFO:teuthology.orchestra.run.smithi148.stdout: mon_down_mkfs_grace = 2m 2024-04-25T22:39:33.073 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.073 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_filestore_osds = false 2024-04-25T22:39:33.074 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-04-25T22:39:33.074 INFO:teuthology.orchestra.run.smithi148.stdout:[client] 2024-04-25T22:39:33.074 INFO:teuthology.orchestra.run.smithi148.stdout: rgw cache enabled = true 2024-04-25T22:39:33.074 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable ops log = true 2024-04-25T22:39:33.074 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable usage log = true 2024-04-25T22:39:33.074 INFO:teuthology.orchestra.run.smithi148.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T22:39:33.074 INFO:teuthology.orchestra.run.smithi148.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T22:39:33.074 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.a] 2024-04-25T22:39:33.074 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.b] 2024-04-25T22:39:33.074 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.c] 2024-04-25T22:39:33.074 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.a] 2024-04-25T22:39:33.075 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2024-04-25T22:39:33.075 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2024-04-25T22:39:33.075 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T22:39:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2024-04-25T22:39:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2024-04-25T22:39:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2024-04-25T22:39:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2024-04-25T22:39:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2024-04-25T22:39:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2024-04-25T22:39:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2024-04-25T22:39:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T22:39:33.076 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2024-04-25T22:39:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T22:39:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T22:39:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2024-04-25T22:39:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2024-04-25T22:39:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2024-04-25T22:39:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2024-04-25T22:39:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2024-04-25T22:39:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2024-04-25T22:39:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2024-04-25T22:39:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2024-04-25T22:39:33.077 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T22:39:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T22:39:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2024-04-25T22:39:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T22:39:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2024-04-25T22:39:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2024-04-25T22:39:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2024-04-25T22:39:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2024-04-25T22:39:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2024-04-25T22:39:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.57,[v2:172.21.15.57:3301,v1:172.21.15.57:6790],[v2:172.21.15.57:3302,v1:172.21.15.57:6791]" 2024-04-25T22:39:33.078 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = 5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d 2024-04-25T22:39:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.079 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2024-04-25T22:39:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2024-04-25T22:39:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2024-04-25T22:39:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2024-04-25T22:39:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: osd mclock profile = high_recovery_ops 2024-04-25T22:39:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2024-04-25T22:39:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2024-04-25T22:39:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2024-04-25T22:39:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2024-04-25T22:39:33.079 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2024-04-25T22:39:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug trim objects = true 2024-04-25T22:39:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2024-04-25T22:39:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2024-04-25T22:39:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2024-04-25T22:39:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2024-04-25T22:39:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2024-04-25T22:39:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2024-04-25T22:39:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2024-04-25T22:39:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.080 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2024-04-25T22:39:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2024-04-25T22:39:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: bdev async discard = True 2024-04-25T22:39:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: bdev enable discard = True 2024-04-25T22:39:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore allocator = stupid 2024-04-25T22:39:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2024-04-25T22:39:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2024-04-25T22:39:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 1/20 2024-04-25T22:39:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 1/20 2024-04-25T22:39:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-25T22:39:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2024-04-25T22:39:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 4/10 2024-04-25T22:39:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T22:39:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2024-04-25T22:39:33.081 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2024-04-25T22:39:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: osd blocked scrub grace period = 3600 2024-04-25T22:39:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2024-04-25T22:39:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: osd max markdown count = 1000 2024-04-25T22:39:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2024-04-25T22:39:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.082 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2024-04-25T22:39:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-25T22:39:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2024-04-25T22:39:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2024-04-25T22:39:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2024-04-25T22:39:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:39:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:39:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2024-04-25T22:39:33.082 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.083 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2024-04-25T22:39:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-25T22:39:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2024-04-25T22:39:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2024-04-25T22:39:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2024-04-25T22:39:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2024-04-25T22:39:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2024-04-25T22:39:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:39:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2024-04-25T22:39:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2024-04-25T22:39:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:39:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T22:39:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T22:39:33.083 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T22:39:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T22:39:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T22:39:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T22:39:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: # 1m isn't quite enough 2024-04-25T22:39:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: mon_down_mkfs_grace = 2m 2024-04-25T22:39:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_filestore_osds = false 2024-04-25T22:39:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:33.084 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2024-04-25T22:39:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2024-04-25T22:39:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2024-04-25T22:39:33.084 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2024-04-25T22:39:33.085 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T22:39:33.085 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T22:39:33.085 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2024-04-25T22:39:33.085 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2024-04-25T22:39:33.085 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2024-04-25T22:39:33.085 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2024-04-25T22:39:33.086 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T22:39:33.086 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T22:39:33.170 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T22:39:33.170 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:39:33.170 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T22:39:33.175 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:39:33.176 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T22:39:33.224 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T22:39:33.224 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:39:33.224 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T22:39:33.224 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T22:39:33.289 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:39:33.289 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:39:33.336 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi122.front.sepia.ceph.com 2024-04-25T22:39:33.337 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-25T22:39:33.337 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T22:39:33.337 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T22:39:33.360 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-25T22:39:33.360 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:39:33.413 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi148.front.sepia.ceph.com 2024-04-25T22:39:33.413 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-25T22:39:33.413 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T22:39:33.413 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T22:39:33.436 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-25T22:39:33.436 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:39:33.482 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi188.front.sepia.ceph.com 2024-04-25T22:39:33.482 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-25T22:39:33.482 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T22:39:33.482 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T22:39:33.505 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-25T22:39:33.505 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:39:33.554 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T22:39:33.554 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T22:39:33.554 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T22:39:33.599 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T22:39:33.602 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T22:39:33.684 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T22:39:33.687 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T22:39:33.687 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T22:39:33.772 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T22:39:33.774 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T22:39:33.827 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T22:39:33.828 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T22:39:33.908 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T22:39:33.920 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T22:39:33.920 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi188.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-25T22:39:33.920 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T22:39:33.934 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-25T22:39:33.934 INFO:tasks.ceph:role: osd.0 2024-04-25T22:39:33.934 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com 2024-04-25T22:39:33.934 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T22:39:33.996 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T22:39:33.996 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T22:39:33.996 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T22:39:33.996 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T22:39:33.996 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T22:39:33.996 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2024-04-25T22:39:33.996 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T22:39:33.997 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T22:39:33.997 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T22:39:33.997 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T22:39:34.461 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2024-04-25T22:39:34.463 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2024-04-25T22:39:34.463 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T22:39:34.587 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T22:39:34.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:39:34.598 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T22:39:34.598 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:39:34.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-25T22:39:34.708+0000 7f3c5adc37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T22:39:34.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-25T22:39:34.716+0000 7f3c5adc37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T22:39:34.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-25T22:39:34.716+0000 7f3c5adc37c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T22:39:34.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-25T22:39:34.716+0000 7f3c5adc37c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T22:39:34.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-25T22:39:34.716+0000 7f3c5adc37c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T22:39:34.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-25T22:39:34.720+0000 7f3c5adc37c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T22:39:37.739 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T22:39:37.752 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T22:39:37.767 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-25T22:39:37.833 INFO:tasks.ceph:role: osd.1 2024-04-25T22:39:37.833 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com 2024-04-25T22:39:37.833 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T22:39:37.856 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T22:39:37.856 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T22:39:37.856 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T22:39:37.856 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T22:39:37.856 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T22:39:37.856 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2024-04-25T22:39:37.856 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T22:39:37.856 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T22:39:37.856 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T22:39:37.856 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T22:39:38.309 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2024-04-25T22:39:38.311 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2024-04-25T22:39:38.311 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-25T22:39:38.413 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T22:39:38.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:39:38.423 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T22:39:38.423 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:39:38.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-25T22:39:38.550+0000 7ff4de5ce7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T22:39:38.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-25T22:39:38.550+0000 7ff4de5ce7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T22:39:38.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-25T22:39:38.554+0000 7ff4de5ce7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T22:39:38.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-25T22:39:38.554+0000 7ff4de5ce7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T22:39:38.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-25T22:39:38.554+0000 7ff4de5ce7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T22:39:38.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-04-25T22:39:38.554+0000 7ff4de5ce7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T22:39:41.546 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T22:39:41.560 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T22:39:41.574 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-25T22:39:41.575 INFO:tasks.ceph:role: osd.2 2024-04-25T22:39:41.575 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi188.front.sepia.ceph.com 2024-04-25T22:39:41.575 DEBUG:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T22:39:41.637 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T22:39:41.637 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T22:39:41.637 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T22:39:41.637 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T22:39:41.637 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T22:39:41.638 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2024-04-25T22:39:41.638 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T22:39:41.638 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T22:39:41.638 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T22:39:41.638 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T22:39:42.121 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2024-04-25T22:39:42.123 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2024-04-25T22:39:42.123 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-25T22:39:42.284 DEBUG:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T22:39:42.295 INFO:teuthology.orchestra.run.smithi188.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T22:39:42.296 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:39:42.296 DEBUG:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:39:42.407 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-25T22:39:42.403+0000 7efc22cff7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T22:39:42.411 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-25T22:39:42.407+0000 7efc22cff7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T22:39:42.411 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-25T22:39:42.407+0000 7efc22cff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T22:39:42.411 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-25T22:39:42.407+0000 7efc22cff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T22:39:42.411 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-25T22:39:42.407+0000 7efc22cff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T22:39:42.420 INFO:teuthology.orchestra.run.smithi188.stderr:2024-04-25T22:39:42.415+0000 7efc22cff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T22:39:45.411 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T22:39:45.426 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T22:39:45.426 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:39:45.426 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T22:39:45.441 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:39:45.441 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T22:39:45.495 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:39:45.495 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T22:39:45.551 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-25T22:39:45.551 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T22:39:45.565 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-25T22:39:45.565 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T22:39:45.579 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-25T22:39:45.579 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T22:39:45.593 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:39:45.593 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T22:39:45.600 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T22:39:45.600 DEBUG:teuthology.orchestra.run.smithi057:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T22:39:45.654 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.x] 2024-04-25T22:39:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCl2ypmFPzFIxAAPg9vCI1USDsoZRGzq6aUDA== 2024-04-25T22:39:45.654 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.y] 2024-04-25T22:39:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCl2ypms+PVKBAA+73U4yC76uTeETjCl8ro/w== 2024-04-25T22:39:45.654 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2024-04-25T22:39:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCl2ypmoFQJLhAAlI051FHkSG7c+P8jjI9QvQ== 2024-04-25T22:39:45.654 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.0] 2024-04-25T22:39:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCm2ypmkX+TKhAAvw841GxE1j+5bfXcz2drnQ== 2024-04-25T22:39:45.655 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.1] 2024-04-25T22:39:45.655 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCq2ypmrsALIRAAToloa3SKuqmfyjZLdafBMg== 2024-04-25T22:39:45.655 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.2] 2024-04-25T22:39:45.655 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCu2ypmn8VuGBAAuwbjyx7V9QWIlAmCsPhM4Q== 2024-04-25T22:39:45.655 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2024-04-25T22:39:45.655 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCl2ypmi+szNhAALO3+hKZeeHs15ec9AP2A0Q== 2024-04-25T22:39:45.656 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T22:39:45.745 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T22:39:45.834 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T22:39:45.919 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T22:39:45.959 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T22:39:46.041 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T22:39:46.124 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T22:39:46.214 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T22:39:46.214 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T22:39:46.225 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T22:39:46.423 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T22:39:46.436 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T22:39:46.491 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T22:39:46.627 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T22:39:46.640 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T22:39:46.695 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T22:39:46.824 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T22:39:46.837 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:39:46.883 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T22:39:46.884 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T22:39:46.884 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T22:39:46.929 INFO:tasks.ceph.mon.a:Started 2024-04-25T22:39:46.929 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T22:39:46.929 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T22:39:46.931 INFO:tasks.ceph.mon.b:Started 2024-04-25T22:39:46.931 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T22:39:46.931 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T22:39:46.933 INFO:tasks.ceph.mon.c:Started 2024-04-25T22:39:46.933 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T22:39:46.933 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T22:39:46.934 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T22:39:46.936 INFO:tasks.ceph.mgr.x:Started 2024-04-25T22:39:46.936 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T22:39:46.936 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T22:39:46.939 INFO:tasks.ceph.mgr.y:Started 2024-04-25T22:39:46.939 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T22:39:46.939 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T22:39:52.442 INFO:teuthology.orchestra.run.smithi057.stderr:adjusted tunables profile to default 2024-04-25T22:39:52.462 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T22:39:52.462 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T22:39:52.462 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-25T22:39:52.462 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T22:39:52.476 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-04-25T22:39:52.477 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T22:39:52.490 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-04-25T22:39:52.490 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T22:39:52.504 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 73d465b4-5896-4d69-80b1-7e69d31eb455 0 2024-04-25T22:39:52.590 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:52.584+0000 7fe4a12d0180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T22:39:52.590 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:52.584+0000 7fa9f7697180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T22:39:52.778 INFO:teuthology.orchestra.run.smithi188.stdout:0 2024-04-25T22:39:52.796 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5 1 2024-04-25T22:39:53.008 INFO:teuthology.orchestra.run.smithi188.stdout:1 2024-04-25T22:39:53.025 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 164fc653-2135-4e9b-8826-1716fdba6ea0 2 2024-04-25T22:39:53.063 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:53.056+0000 7fe4a12d0180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T22:39:53.064 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:53.060+0000 7fa9f7697180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T22:39:53.235 INFO:teuthology.orchestra.run.smithi188.stdout:2 2024-04-25T22:39:53.253 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T22:39:53.253 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T22:39:53.255 INFO:tasks.ceph.osd.0:Started 2024-04-25T22:39:53.255 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T22:39:53.255 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T22:39:53.257 INFO:tasks.ceph.osd.1:Started 2024-04-25T22:39:53.258 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T22:39:53.258 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T22:39:53.260 INFO:tasks.ceph.osd.2:Started 2024-04-25T22:39:53.260 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:39:53.265 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:53.260+0000 7fe4a12d0180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T22:39:53.266 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:53.260+0000 7fa9f7697180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T22:39:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:39:53.444 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","created":"2024-04-25T22:39:52.303074+0000","modified":"2024-04-25T22:39:53.230242+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T22:39:53.230242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73d465b4-5896-4d69-80b1-7e69d31eb455","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"164fc653-2135-4e9b-8826-1716fdba6ea0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:39:53.461 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T22:39:53.461 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T22:39:53.765 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T22:39:53.862 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:53.856+0000 7fe4a12d0180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T22:39:53.862 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:53.856+0000 7fa9f7697180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T22:39:53.870 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:39:53.867+0000 7f113eb347c0 -1 Falling back to public interface 2024-04-25T22:39:53.881 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:39:53.880+0000 7f5c0baa57c0 -1 Falling back to public interface 2024-04-25T22:39:53.882 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:39:53.882+0000 7f00be24f7c0 -1 Falling back to public interface 2024-04-25T22:39:53.921 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:53.916+0000 7fa9f7697180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T22:39:53.921 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:53.916+0000 7fe4a12d0180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T22:39:53.951 INFO:teuthology.misc.health.smithi057.stdout: 2024-04-25T22:39:53.951 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":5,"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","created":"2024-04-25T22:39:52.303074+0000","modified":"2024-04-25T22:39:53.230242+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T22:39:53.230242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73d465b4-5896-4d69-80b1-7e69d31eb455","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"164fc653-2135-4e9b-8826-1716fdba6ea0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:39:53.967 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-25T22:39:53.978 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:53.972+0000 7fa9f7697180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T22:39:53.979 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:53.972+0000 7fe4a12d0180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T22:39:54.061 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:54.056+0000 7fa9f7697180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T22:39:54.061 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:54.056+0000 7fe4a12d0180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T22:39:54.116 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:54.112+0000 7fa9f7697180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T22:39:54.116 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:54.112+0000 7fe4a12d0180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T22:39:54.198 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:54.192+0000 7fe4a12d0180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T22:39:54.198 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:54.192+0000 7fa9f7697180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T22:39:54.258 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:54.252+0000 7fe4a12d0180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T22:39:54.258 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:54.252+0000 7fa9f7697180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T22:39:54.418 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:54.412+0000 7fe4a12d0180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T22:39:54.419 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:54.412+0000 7fa9f7697180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T22:39:54.485 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:54.480+0000 7fe4a12d0180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T22:39:54.486 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:54.480+0000 7fa9f7697180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T22:39:55.188 INFO:tasks.ceph.mgr.y.smithi057.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T22:39:55.188 INFO:tasks.ceph.mgr.y.smithi057.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T22:39:55.188 INFO:tasks.ceph.mgr.y.smithi057.stderr: from numpy import show_config as show_numpy_config 2024-04-25T22:39:55.188 INFO:tasks.ceph.mgr.x.smithi057.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T22:39:55.188 INFO:tasks.ceph.mgr.x.smithi057.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T22:39:55.188 INFO:tasks.ceph.mgr.x.smithi057.stderr: from numpy import show_config as show_numpy_config 2024-04-25T22:39:55.222 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:55.216+0000 7fa9f7697180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T22:39:55.225 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:55.220+0000 7fe4a12d0180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T22:39:55.372 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:55.368+0000 7fa9f7697180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T22:39:55.404 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:55.400+0000 7fe4a12d0180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T22:39:55.528 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:55.524+0000 7fa9f7697180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T22:39:55.529 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:55.524+0000 7fe4a12d0180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T22:39:55.595 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:55.588+0000 7fa9f7697180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T22:39:55.595 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:55.592+0000 7fe4a12d0180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T22:39:55.737 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:55.732+0000 7fa9f7697180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T22:39:55.737 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:55.732+0000 7fe4a12d0180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T22:39:56.383 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:56.376+0000 7fa9f7697180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T22:39:56.383 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:56.376+0000 7fe4a12d0180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T22:39:56.462 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:56.456+0000 7fa9f7697180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T22:39:56.463 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:56.456+0000 7fe4a12d0180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T22:39:56.655 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:56.648+0000 7fa9f7697180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T22:39:56.655 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:56.648+0000 7fe4a12d0180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T22:39:56.733 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:56.728+0000 7fe4a12d0180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T22:39:56.733 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:56.728+0000 7fa9f7697180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T22:39:57.039 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:57.036+0000 7fa9f7697180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T22:39:57.040 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:57.036+0000 7fe4a12d0180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T22:39:57.105 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-04-25T22:39:57.100+0000 7fa9f7697180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T22:39:57.105 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:57.100+0000 7fe4a12d0180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T22:39:57.545 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:39:57.544+0000 7f5c0baa57c0 -1 osd.0 0 log_to_monitors true 2024-04-25T22:39:57.576 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:39:57.571+0000 7f113eb347c0 -1 osd.2 0 log_to_monitors true 2024-04-25T22:39:57.579 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:39:57.578+0000 7f00be24f7c0 -1 osd.1 0 log_to_monitors true 2024-04-25T22:39:58.137 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:58.132+0000 7fe448719640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T22:39:58.137 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:39:58.132+0000 7fe448719640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T22:40:00.239 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:00.235+0000 7f113a2ba640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T22:40:00.244 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:00.244+0000 7f5c08a61640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T22:40:00.270 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T22:40:00.271 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:00.267+0000 7f1132901640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T22:40:00.281 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:00.280+0000 7f5bff872640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T22:40:00.367 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:00.366+0000 7f00bb20b640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T22:40:00.386 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:00.386+0000 7f00b201c640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T22:40:00.571 INFO:teuthology.misc.health.smithi057.stdout: 2024-04-25T22:40:00.571 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":7,"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","created":"2024-04-25T22:39:52.303074+0000","modified":"2024-04-25T22:39:59.177128+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T22:39:53.230242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73d465b4-5896-4d69-80b1-7e69d31eb455","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"164fc653-2135-4e9b-8826-1716fdba6ea0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:40:00.589 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-25T22:40:06.893 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T22:40:07.193 INFO:teuthology.misc.health.smithi057.stdout: 2024-04-25T22:40:07.193 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":12,"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","created":"2024-04-25T22:39:52.303074+0000","modified":"2024-04-25T22:40:05.314134+0000","last_up_change":"2024-04-25T22:40:01.251093+0000","last_in_change":"2024-04-25T22:39:53.230242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:40:03.197725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d465b4-5896-4d69-80b1-7e69d31eb455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6801","nonce":765118869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6803","nonce":765118869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6807","nonce":765118869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6805","nonce":765118869}]},"public_addr":"172.21.15.122:6801/765118869","cluster_addr":"172.21.15.122:6803/765118869","heartbeat_back_addr":"172.21.15.122:6807/765118869","heartbeat_front_addr":"172.21.15.122:6805/765118869","state":["exists","up"]},{"osd":1,"uuid":"8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6801","nonce":2387035286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6803","nonce":2387035286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6807","nonce":2387035286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6805","nonce":2387035286}]},"public_addr":"172.21.15.148:6801/2387035286","cluster_addr":"172.21.15.148:6803/2387035286","heartbeat_back_addr":"172.21.15.148:6807/2387035286","heartbeat_front_addr":"172.21.15.148:6805/2387035286","state":["exists","up"]},{"osd":2,"uuid":"164fc653-2135-4e9b-8826-1716fdba6ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6801","nonce":368834361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6803","nonce":368834361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6807","nonce":368834361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6805","nonce":368834361}]},"public_addr":"172.21.15.188:6801/368834361","cluster_addr":"172.21.15.188:6803/368834361","heartbeat_back_addr":"172.21.15.188:6807/368834361","heartbeat_front_addr":"172.21.15.188:6805/368834361","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.559393+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.563434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.557643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:40:07.211 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-25T22:40:07.212 INFO:tasks.ceph:Creating RBD pool 2024-04-25T22:40:07.212 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-25T22:40:08.464 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'rbd' created 2024-04-25T22:40:08.487 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-25T22:40:09.481 INFO:teuthology.orchestra.run.smithi057.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-25T22:40:09.507 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T22:40:09.507 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T22:40:09.507 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T22:40:09.509 INFO:tasks.ceph.mds.a:Started 2024-04-25T22:40:09.510 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T22:40:09.510 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:40:09.591 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2024-04-25T22:40:09.814 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:09.814 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","created":"2024-04-25T22:39:52.303074+0000","modified":"2024-04-25T22:40:09.454438+0000","last_up_change":"2024-04-25T22:40:01.251093+0000","last_in_change":"2024-04-25T22:39:53.230242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:40:03.197725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:40:07.560858+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d465b4-5896-4d69-80b1-7e69d31eb455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6801","nonce":765118869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6803","nonce":765118869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6807","nonce":765118869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6805","nonce":765118869}]},"public_addr":"172.21.15.122:6801/765118869","cluster_addr":"172.21.15.122:6803/765118869","heartbeat_back_addr":"172.21.15.122:6807/765118869","heartbeat_front_addr":"172.21.15.122:6805/765118869","state":["exists","up"]},{"osd":1,"uuid":"8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6801","nonce":2387035286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6803","nonce":2387035286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6807","nonce":2387035286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6805","nonce":2387035286}]},"public_addr":"172.21.15.148:6801/2387035286","cluster_addr":"172.21.15.148:6803/2387035286","heartbeat_back_addr":"172.21.15.148:6807/2387035286","heartbeat_front_addr":"172.21.15.148:6805/2387035286","state":["exists","up"]},{"osd":2,"uuid":"164fc653-2135-4e9b-8826-1716fdba6ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6801","nonce":368834361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6803","nonce":368834361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6807","nonce":368834361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6805","nonce":368834361}]},"public_addr":"172.21.15.188:6801/368834361","cluster_addr":"172.21.15.188:6803/368834361","heartbeat_back_addr":"172.21.15.188:6807/368834361","heartbeat_front_addr":"172.21.15.188:6805/368834361","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.559393+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.563434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.557643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:40:09.835 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:40:03.197725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:40:07.560858+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T22:40:09.835 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:40:10.137 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-04-25T22:40:10.156 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:40:10.463 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-04-25T22:40:10.483 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:40:10.824 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:10.824 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6803/4101484059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":4101484059},{"type":"v1","addr":"172.21.15.57:6803","nonce":4101484059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T22:40:10.824 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 2 2024-04-25T22:40:10.843 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:40:11.130 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:11.130 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":15,"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","created":"2024-04-25T22:39:52.303074+0000","modified":"2024-04-25T22:40:10.481653+0000","last_up_change":"2024-04-25T22:40:01.251093+0000","last_in_change":"2024-04-25T22:39:53.230242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:40:03.197725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:40:07.560858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d465b4-5896-4d69-80b1-7e69d31eb455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6801","nonce":765118869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6803","nonce":765118869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6807","nonce":765118869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6805","nonce":765118869}]},"public_addr":"172.21.15.122:6801/765118869","cluster_addr":"172.21.15.122:6803/765118869","heartbeat_back_addr":"172.21.15.122:6807/765118869","heartbeat_front_addr":"172.21.15.122:6805/765118869","state":["exists","up"]},{"osd":1,"uuid":"8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6801","nonce":2387035286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6803","nonce":2387035286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6807","nonce":2387035286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6805","nonce":2387035286}]},"public_addr":"172.21.15.148:6801/2387035286","cluster_addr":"172.21.15.148:6803/2387035286","heartbeat_back_addr":"172.21.15.148:6807/2387035286","heartbeat_front_addr":"172.21.15.148:6805/2387035286","state":["exists","up"]},{"osd":2,"uuid":"164fc653-2135-4e9b-8826-1716fdba6ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6801","nonce":368834361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6803","nonce":368834361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6807","nonce":368834361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6805","nonce":368834361}]},"public_addr":"172.21.15.188:6801/368834361","cluster_addr":"172.21.15.188:6803/368834361","heartbeat_back_addr":"172.21.15.188:6807/368834361","heartbeat_front_addr":"172.21.15.188:6805/368834361","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.559393+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.563434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.557643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:40:11.147 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:40:03.197725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:40:07.560858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T22:40:11.148 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:40:11.443 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-04-25T22:40:11.462 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:40:11.762 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-04-25T22:40:11.780 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T22:40:12.076 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:12.077 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2024-04-25T22:40:12.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:12.077 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2024-04-25T22:40:12.077 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": ".mgr" 2024-04-25T22:40:12.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:12.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:12.077 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 2, 2024-04-25T22:40:12.077 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2024-04-25T22:40:12.077 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:12.077 INFO:teuthology.orchestra.run.smithi057.stdout:] 2024-04-25T22:40:12.096 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T22:40:12.096 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T22:40:12.552 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2024-04-25T22:40:12.574 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T22:40:13.570 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2024-04-25T22:40:13.594 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T22:40:14.579 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 3 and data pool 4 2024-04-25T22:40:14.610 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:40:14.926 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:14.927 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","created":"2024-04-25T22:39:52.303074+0000","modified":"2024-04-25T22:40:13.930612+0000","last_up_change":"2024-04-25T22:40:01.251093+0000","last_in_change":"2024-04-25T22:39:53.230242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:40:03.197725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:40:07.560858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:40:12.431697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:40:12.919828+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d465b4-5896-4d69-80b1-7e69d31eb455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6801","nonce":765118869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6803","nonce":765118869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6807","nonce":765118869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6805","nonce":765118869}]},"public_addr":"172.21.15.122:6801/765118869","cluster_addr":"172.21.15.122:6803/765118869","heartbeat_back_addr":"172.21.15.122:6807/765118869","heartbeat_front_addr":"172.21.15.122:6805/765118869","state":["exists","up"]},{"osd":1,"uuid":"8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6801","nonce":2387035286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6803","nonce":2387035286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6807","nonce":2387035286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6805","nonce":2387035286}]},"public_addr":"172.21.15.148:6801/2387035286","cluster_addr":"172.21.15.148:6803/2387035286","heartbeat_back_addr":"172.21.15.148:6807/2387035286","heartbeat_front_addr":"172.21.15.148:6805/2387035286","state":["exists","up"]},{"osd":2,"uuid":"164fc653-2135-4e9b-8826-1716fdba6ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6801","nonce":368834361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6803","nonce":368834361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6807","nonce":368834361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6805","nonce":368834361}]},"public_addr":"172.21.15.188:6801/368834361","cluster_addr":"172.21.15.188:6803/368834361","heartbeat_back_addr":"172.21.15.188:6807/368834361","heartbeat_front_addr":"172.21.15.188:6805/368834361","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.559393+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.563434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.557643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:40:14.947 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:40:15.242 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:15.243 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","created":"2024-04-25T22:39:52.303074+0000","modified":"2024-04-25T22:40:13.930612+0000","last_up_change":"2024-04-25T22:40:01.251093+0000","last_in_change":"2024-04-25T22:39:53.230242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:40:03.197725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:40:07.560858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:40:12.431697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:40:12.919828+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d465b4-5896-4d69-80b1-7e69d31eb455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6801","nonce":765118869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6803","nonce":765118869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6807","nonce":765118869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6805","nonce":765118869}]},"public_addr":"172.21.15.122:6801/765118869","cluster_addr":"172.21.15.122:6803/765118869","heartbeat_back_addr":"172.21.15.122:6807/765118869","heartbeat_front_addr":"172.21.15.122:6805/765118869","state":["exists","up"]},{"osd":1,"uuid":"8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6801","nonce":2387035286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6803","nonce":2387035286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6807","nonce":2387035286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6805","nonce":2387035286}]},"public_addr":"172.21.15.148:6801/2387035286","cluster_addr":"172.21.15.148:6803/2387035286","heartbeat_back_addr":"172.21.15.148:6807/2387035286","heartbeat_front_addr":"172.21.15.148:6805/2387035286","state":["exists","up"]},{"osd":2,"uuid":"164fc653-2135-4e9b-8826-1716fdba6ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6801","nonce":368834361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6803","nonce":368834361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6807","nonce":368834361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6805","nonce":368834361}]},"public_addr":"172.21.15.188:6801/368834361","cluster_addr":"172.21.15.188:6803/368834361","heartbeat_back_addr":"172.21.15.188:6807/368834361","heartbeat_front_addr":"172.21.15.188:6805/368834361","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.559393+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.563434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.557643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:40:15.261 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T22:40:15.625 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T22:40:15.625 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T22:40:16.649 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T22:40:16.649 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:40:16.995 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:16.996 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:40:13.931282+0000","modified":"2024-04-25T22:40:15.954082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4192},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4192":{"gid":4192,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6803/4101484059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":4101484059},{"type":"v1","addr":"172.21.15.57:6803","nonce":4101484059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4192,"qdb_cluster":[4192]},"id":1}]} 2024-04-25T22:40:16.996 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 5 2024-04-25T22:40:17.015 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:40:17.316 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:17.317 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":19,"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","created":"2024-04-25T22:39:52.303074+0000","modified":"2024-04-25T22:40:15.597829+0000","last_up_change":"2024-04-25T22:40:01.251093+0000","last_in_change":"2024-04-25T22:39:53.230242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:40:03.197725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:40:07.560858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:40:12.431697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:40:12.919828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d465b4-5896-4d69-80b1-7e69d31eb455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6801","nonce":765118869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6803","nonce":765118869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6807","nonce":765118869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6805","nonce":765118869}]},"public_addr":"172.21.15.122:6801/765118869","cluster_addr":"172.21.15.122:6803/765118869","heartbeat_back_addr":"172.21.15.122:6807/765118869","heartbeat_front_addr":"172.21.15.122:6805/765118869","state":["exists","up"]},{"osd":1,"uuid":"8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6801","nonce":2387035286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6803","nonce":2387035286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6807","nonce":2387035286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6805","nonce":2387035286}]},"public_addr":"172.21.15.148:6801/2387035286","cluster_addr":"172.21.15.148:6803/2387035286","heartbeat_back_addr":"172.21.15.148:6807/2387035286","heartbeat_front_addr":"172.21.15.148:6805/2387035286","state":["exists","up"]},{"osd":2,"uuid":"164fc653-2135-4e9b-8826-1716fdba6ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6801","nonce":368834361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6803","nonce":368834361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6807","nonce":368834361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6805","nonce":368834361}]},"public_addr":"172.21.15.188:6801/368834361","cluster_addr":"172.21.15.188:6803/368834361","heartbeat_back_addr":"172.21.15.188:6807/368834361","heartbeat_front_addr":"172.21.15.188:6805/368834361","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.559393+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.563434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.557643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:40:17.336 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T22:40:17.336 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:40:17.643 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:17.645 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:40:17.660 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-25T22:40:17.120637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90936,"kb_used_data":1544,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024584,"statfs":{"total":289910292480,"available":289817174016,"internally_reserved":0,"allocated":1581056,"data_stored":1299038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.572431"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":214,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.987349+0000","last_change":"2024-04-25T22:40:04.317146+0000","last_active":"2024-04-25T22:40:10.987349+0000","last_peered":"2024-04-25T22:40:10.987349+0000","last_clean":"2024-04-25T22:40:10.987349+0000","last_became_active":"2024-04-25T22:40:04.316527+0000","last_became_peered":"2024-04-25T22:40:04.316527+0000","last_unstale":"2024-04-25T22:40:10.987349+0000","last_undegraded":"2024-04-25T22:40:10.987349+0000","last_fullsized":"2024-04-25T22:40:10.987349+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:25.669997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.987636+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:40:10.987636+0000","last_peered":"2024-04-25T22:40:10.987636+0000","last_clean":"2024-04-25T22:40:10.987636+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:40:10.987636+0000","last_undegraded":"2024-04-25T22:40:10.987636+0000","last_fullsized":"2024-04-25T22:40:10.987636+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.987655+0000","last_change":"2024-04-25T22:40:09.502444+0000","last_active":"2024-04-25T22:40:10.987655+0000","last_peered":"2024-04-25T22:40:10.987655+0000","last_clean":"2024-04-25T22:40:10.987655+0000","last_became_active":"2024-04-25T22:40:09.501576+0000","last_became_peered":"2024-04-25T22:40:09.501576+0000","last_unstale":"2024-04-25T22:40:10.987655+0000","last_undegraded":"2024-04-25T22:40:10.987655+0000","last_fullsized":"2024-04-25T22:40:10.987655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:35:14.955359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.503386+0000","last_change":"2024-04-25T22:40:09.501323+0000","last_active":"2024-04-25T22:40:10.503386+0000","last_peered":"2024-04-25T22:40:10.503386+0000","last_clean":"2024-04-25T22:40:10.503386+0000","last_became_active":"2024-04-25T22:40:09.500499+0000","last_became_peered":"2024-04-25T22:40:09.500499+0000","last_unstale":"2024-04-25T22:40:10.503386+0000","last_undegraded":"2024-04-25T22:40:10.503386+0000","last_fullsized":"2024-04-25T22:40:10.503386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:30.289572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.987591+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:40:10.987591+0000","last_peered":"2024-04-25T22:40:10.987591+0000","last_clean":"2024-04-25T22:40:10.987591+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:40:10.987591+0000","last_undegraded":"2024-04-25T22:40:10.987591+0000","last_fullsized":"2024-04-25T22:40:10.987591+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.503529+0000","last_change":"2024-04-25T22:40:09.501325+0000","last_active":"2024-04-25T22:40:10.503529+0000","last_peered":"2024-04-25T22:40:10.503529+0000","last_clean":"2024-04-25T22:40:10.503529+0000","last_became_active":"2024-04-25T22:40:09.500542+0000","last_became_peered":"2024-04-25T22:40:09.500542+0000","last_unstale":"2024-04-25T22:40:10.503529+0000","last_undegraded":"2024-04-25T22:40:10.503529+0000","last_fullsized":"2024-04-25T22:40:10.503529+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:34:38.234538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.506970+0000","last_change":"2024-04-25T22:40:09.501163+0000","last_active":"2024-04-25T22:40:10.506970+0000","last_peered":"2024-04-25T22:40:10.506970+0000","last_clean":"2024-04-25T22:40:10.506970+0000","last_became_active":"2024-04-25T22:40:09.500492+0000","last_became_peered":"2024-04-25T22:40:09.500492+0000","last_unstale":"2024-04-25T22:40:10.506970+0000","last_undegraded":"2024-04-25T22:40:10.506970+0000","last_fullsized":"2024-04-25T22:40:10.506970+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:22.822616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.503445+0000","last_change":"2024-04-25T22:40:09.501358+0000","last_active":"2024-04-25T22:40:10.503445+0000","last_peered":"2024-04-25T22:40:10.503445+0000","last_clean":"2024-04-25T22:40:10.503445+0000","last_became_active":"2024-04-25T22:40:09.500626+0000","last_became_peered":"2024-04-25T22:40:09.500626+0000","last_unstale":"2024-04-25T22:40:10.503445+0000","last_undegraded":"2024-04-25T22:40:10.503445+0000","last_fullsized":"2024-04-25T22:40:10.503445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:55.182967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.987654+0000","last_change":"2024-04-25T22:40:09.500948+0000","last_active":"2024-04-25T22:40:10.987654+0000","last_peered":"2024-04-25T22:40:10.987654+0000","last_clean":"2024-04-25T22:40:10.987654+0000","last_became_active":"2024-04-25T22:40:09.500236+0000","last_became_peered":"2024-04-25T22:40:09.500236+0000","last_unstale":"2024-04-25T22:40:10.987654+0000","last_undegraded":"2024-04-25T22:40:10.987654+0000","last_fullsized":"2024-04-25T22:40:10.987654+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:02.375961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":131072,"data_stored":39434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":724992,"data_stored":629802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":724992,"data_stored":629802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:40:17.665 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:40:18.015 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:18.017 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:40:18.033 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-25T22:40:17.120637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90936,"kb_used_data":1544,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024584,"statfs":{"total":289910292480,"available":289817174016,"internally_reserved":0,"allocated":1581056,"data_stored":1299038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.572431"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":214,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.987349+0000","last_change":"2024-04-25T22:40:04.317146+0000","last_active":"2024-04-25T22:40:10.987349+0000","last_peered":"2024-04-25T22:40:10.987349+0000","last_clean":"2024-04-25T22:40:10.987349+0000","last_became_active":"2024-04-25T22:40:04.316527+0000","last_became_peered":"2024-04-25T22:40:04.316527+0000","last_unstale":"2024-04-25T22:40:10.987349+0000","last_undegraded":"2024-04-25T22:40:10.987349+0000","last_fullsized":"2024-04-25T22:40:10.987349+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:25.669997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.987636+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:40:10.987636+0000","last_peered":"2024-04-25T22:40:10.987636+0000","last_clean":"2024-04-25T22:40:10.987636+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:40:10.987636+0000","last_undegraded":"2024-04-25T22:40:10.987636+0000","last_fullsized":"2024-04-25T22:40:10.987636+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.987655+0000","last_change":"2024-04-25T22:40:09.502444+0000","last_active":"2024-04-25T22:40:10.987655+0000","last_peered":"2024-04-25T22:40:10.987655+0000","last_clean":"2024-04-25T22:40:10.987655+0000","last_became_active":"2024-04-25T22:40:09.501576+0000","last_became_peered":"2024-04-25T22:40:09.501576+0000","last_unstale":"2024-04-25T22:40:10.987655+0000","last_undegraded":"2024-04-25T22:40:10.987655+0000","last_fullsized":"2024-04-25T22:40:10.987655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:35:14.955359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.503386+0000","last_change":"2024-04-25T22:40:09.501323+0000","last_active":"2024-04-25T22:40:10.503386+0000","last_peered":"2024-04-25T22:40:10.503386+0000","last_clean":"2024-04-25T22:40:10.503386+0000","last_became_active":"2024-04-25T22:40:09.500499+0000","last_became_peered":"2024-04-25T22:40:09.500499+0000","last_unstale":"2024-04-25T22:40:10.503386+0000","last_undegraded":"2024-04-25T22:40:10.503386+0000","last_fullsized":"2024-04-25T22:40:10.503386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:30.289572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.987591+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:40:10.987591+0000","last_peered":"2024-04-25T22:40:10.987591+0000","last_clean":"2024-04-25T22:40:10.987591+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:40:10.987591+0000","last_undegraded":"2024-04-25T22:40:10.987591+0000","last_fullsized":"2024-04-25T22:40:10.987591+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.503529+0000","last_change":"2024-04-25T22:40:09.501325+0000","last_active":"2024-04-25T22:40:10.503529+0000","last_peered":"2024-04-25T22:40:10.503529+0000","last_clean":"2024-04-25T22:40:10.503529+0000","last_became_active":"2024-04-25T22:40:09.500542+0000","last_became_peered":"2024-04-25T22:40:09.500542+0000","last_unstale":"2024-04-25T22:40:10.503529+0000","last_undegraded":"2024-04-25T22:40:10.503529+0000","last_fullsized":"2024-04-25T22:40:10.503529+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:34:38.234538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.506970+0000","last_change":"2024-04-25T22:40:09.501163+0000","last_active":"2024-04-25T22:40:10.506970+0000","last_peered":"2024-04-25T22:40:10.506970+0000","last_clean":"2024-04-25T22:40:10.506970+0000","last_became_active":"2024-04-25T22:40:09.500492+0000","last_became_peered":"2024-04-25T22:40:09.500492+0000","last_unstale":"2024-04-25T22:40:10.506970+0000","last_undegraded":"2024-04-25T22:40:10.506970+0000","last_fullsized":"2024-04-25T22:40:10.506970+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:22.822616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.503445+0000","last_change":"2024-04-25T22:40:09.501358+0000","last_active":"2024-04-25T22:40:10.503445+0000","last_peered":"2024-04-25T22:40:10.503445+0000","last_clean":"2024-04-25T22:40:10.503445+0000","last_became_active":"2024-04-25T22:40:09.500626+0000","last_became_peered":"2024-04-25T22:40:09.500626+0000","last_unstale":"2024-04-25T22:40:10.503445+0000","last_undegraded":"2024-04-25T22:40:10.503445+0000","last_fullsized":"2024-04-25T22:40:10.503445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:55.182967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.987654+0000","last_change":"2024-04-25T22:40:09.500948+0000","last_active":"2024-04-25T22:40:10.987654+0000","last_peered":"2024-04-25T22:40:10.987654+0000","last_clean":"2024-04-25T22:40:10.987654+0000","last_became_active":"2024-04-25T22:40:09.500236+0000","last_became_peered":"2024-04-25T22:40:09.500236+0000","last_unstale":"2024-04-25T22:40:10.987654+0000","last_undegraded":"2024-04-25T22:40:10.987654+0000","last_fullsized":"2024-04-25T22:40:10.987654+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:02.375961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":131072,"data_stored":39434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":724992,"data_stored":629802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":724992,"data_stored":629802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:40:18.037 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:40:18.382 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:18.383 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:40:18.399 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-25T22:40:17.120637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90936,"kb_used_data":1544,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024584,"statfs":{"total":289910292480,"available":289817174016,"internally_reserved":0,"allocated":1581056,"data_stored":1299038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.572431"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":214,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.987349+0000","last_change":"2024-04-25T22:40:04.317146+0000","last_active":"2024-04-25T22:40:10.987349+0000","last_peered":"2024-04-25T22:40:10.987349+0000","last_clean":"2024-04-25T22:40:10.987349+0000","last_became_active":"2024-04-25T22:40:04.316527+0000","last_became_peered":"2024-04-25T22:40:04.316527+0000","last_unstale":"2024-04-25T22:40:10.987349+0000","last_undegraded":"2024-04-25T22:40:10.987349+0000","last_fullsized":"2024-04-25T22:40:10.987349+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:25.669997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.987636+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:40:10.987636+0000","last_peered":"2024-04-25T22:40:10.987636+0000","last_clean":"2024-04-25T22:40:10.987636+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:40:10.987636+0000","last_undegraded":"2024-04-25T22:40:10.987636+0000","last_fullsized":"2024-04-25T22:40:10.987636+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.987655+0000","last_change":"2024-04-25T22:40:09.502444+0000","last_active":"2024-04-25T22:40:10.987655+0000","last_peered":"2024-04-25T22:40:10.987655+0000","last_clean":"2024-04-25T22:40:10.987655+0000","last_became_active":"2024-04-25T22:40:09.501576+0000","last_became_peered":"2024-04-25T22:40:09.501576+0000","last_unstale":"2024-04-25T22:40:10.987655+0000","last_undegraded":"2024-04-25T22:40:10.987655+0000","last_fullsized":"2024-04-25T22:40:10.987655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:35:14.955359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.503386+0000","last_change":"2024-04-25T22:40:09.501323+0000","last_active":"2024-04-25T22:40:10.503386+0000","last_peered":"2024-04-25T22:40:10.503386+0000","last_clean":"2024-04-25T22:40:10.503386+0000","last_became_active":"2024-04-25T22:40:09.500499+0000","last_became_peered":"2024-04-25T22:40:09.500499+0000","last_unstale":"2024-04-25T22:40:10.503386+0000","last_undegraded":"2024-04-25T22:40:10.503386+0000","last_fullsized":"2024-04-25T22:40:10.503386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:30.289572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.987591+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:40:10.987591+0000","last_peered":"2024-04-25T22:40:10.987591+0000","last_clean":"2024-04-25T22:40:10.987591+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:40:10.987591+0000","last_undegraded":"2024-04-25T22:40:10.987591+0000","last_fullsized":"2024-04-25T22:40:10.987591+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.503529+0000","last_change":"2024-04-25T22:40:09.501325+0000","last_active":"2024-04-25T22:40:10.503529+0000","last_peered":"2024-04-25T22:40:10.503529+0000","last_clean":"2024-04-25T22:40:10.503529+0000","last_became_active":"2024-04-25T22:40:09.500542+0000","last_became_peered":"2024-04-25T22:40:09.500542+0000","last_unstale":"2024-04-25T22:40:10.503529+0000","last_undegraded":"2024-04-25T22:40:10.503529+0000","last_fullsized":"2024-04-25T22:40:10.503529+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:34:38.234538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.506970+0000","last_change":"2024-04-25T22:40:09.501163+0000","last_active":"2024-04-25T22:40:10.506970+0000","last_peered":"2024-04-25T22:40:10.506970+0000","last_clean":"2024-04-25T22:40:10.506970+0000","last_became_active":"2024-04-25T22:40:09.500492+0000","last_became_peered":"2024-04-25T22:40:09.500492+0000","last_unstale":"2024-04-25T22:40:10.506970+0000","last_undegraded":"2024-04-25T22:40:10.506970+0000","last_fullsized":"2024-04-25T22:40:10.506970+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:22.822616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.503445+0000","last_change":"2024-04-25T22:40:09.501358+0000","last_active":"2024-04-25T22:40:10.503445+0000","last_peered":"2024-04-25T22:40:10.503445+0000","last_clean":"2024-04-25T22:40:10.503445+0000","last_became_active":"2024-04-25T22:40:09.500626+0000","last_became_peered":"2024-04-25T22:40:09.500626+0000","last_unstale":"2024-04-25T22:40:10.503445+0000","last_undegraded":"2024-04-25T22:40:10.503445+0000","last_fullsized":"2024-04-25T22:40:10.503445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:55.182967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.987654+0000","last_change":"2024-04-25T22:40:09.500948+0000","last_active":"2024-04-25T22:40:10.987654+0000","last_peered":"2024-04-25T22:40:10.987654+0000","last_clean":"2024-04-25T22:40:10.987654+0000","last_became_active":"2024-04-25T22:40:09.500236+0000","last_became_peered":"2024-04-25T22:40:09.500236+0000","last_unstale":"2024-04-25T22:40:10.987654+0000","last_undegraded":"2024-04-25T22:40:10.987654+0000","last_fullsized":"2024-04-25T22:40:10.987654+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:02.375961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":131072,"data_stored":39434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":724992,"data_stored":629802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":724992,"data_stored":629802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:40:18.403 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2024-04-25T22:40:18.403 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2024-04-25T22:40:18.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2024-04-25T22:40:18.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2024-04-25T22:40:18.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2024-04-25T22:40:18.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2024-04-25T22:40:18.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2024-04-25T22:40:18.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2024-04-25T22:40:18.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2024-04-25T22:40:18.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2024-04-25T22:40:18.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2024-04-25T22:40:18.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2024-04-25T22:40:18.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2024-04-25T22:40:18.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2024-04-25T22:40:18.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2024-04-25T22:40:18.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2024-04-25T22:40:18.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2024-04-25T22:40:18.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2024-04-25T22:40:18.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2024-04-25T22:40:18.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2024-04-25T22:40:18.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2024-04-25T22:40:18.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2024-04-25T22:40:18.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2024-04-25T22:40:18.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2024-04-25T22:40:18.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2024-04-25T22:40:18.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2024-04-25T22:40:18.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2024-04-25T22:40:18.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2024-04-25T22:40:18.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2024-04-25T22:40:18.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2024-04-25T22:40:18.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2024-04-25T22:40:18.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2024-04-25T22:40:18.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-25T22:40:18.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-04-25T22:40:18.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-25T22:40:18.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-04-25T22:40:18.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-25T22:40:18.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-04-25T22:40:18.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-25T22:40:18.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-04-25T22:40:18.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-04-25T22:40:18.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-25T22:40:18.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-04-25T22:40:18.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-25T22:40:18.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-04-25T22:40:18.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-25T22:40:18.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-04-25T22:40:18.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-25T22:40:18.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-04-25T22:40:18.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-25T22:40:18.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-04-25T22:40:18.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-25T22:40:18.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-04-25T22:40:18.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-25T22:40:18.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-04-25T22:40:18.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-25T22:40:18.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-04-25T22:40:18.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-25T22:40:18.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-04-25T22:40:18.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-25T22:40:18.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-04-25T22:40:18.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-25T22:40:18.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-04-25T22:40:18.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-04-25T22:40:18.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-04-25T22:40:18.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-25T22:40:18.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-04-25T22:40:18.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-25T22:40:18.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-04-25T22:40:18.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-25T22:40:18.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-04-25T22:40:18.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-25T22:40:18.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-25T22:40:18.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-04-25T22:40:18.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-25T22:40:18.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-04-25T22:40:18.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-04-25T22:40:18.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-25T22:40:18.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-04-25T22:40:18.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-25T22:40:18.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-25T22:40:18.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-04-25T22:40:18.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-25T22:40:18.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-04-25T22:40:18.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-25T22:40:18.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-04-25T22:40:18.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-25T22:40:18.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-04-25T22:40:18.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-25T22:40:18.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-04-25T22:40:18.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-25T22:40:18.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-04-25T22:40:18.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-25T22:40:18.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-04-25T22:40:18.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-25T22:40:18.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:13.541378+0000', 'last_change': '2024-04-25T22:40:13.541378+0000', 'last_active': '2024-04-25T22:40:13.541378+0000', 'last_peered': '2024-04-25T22:40:13.541378+0000', 'last_clean': '2024-04-25T22:40:13.541378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:13.541378+0000', 'last_undegraded': '2024-04-25T22:40:13.541378+0000', 'last_fullsized': '2024-04-25T22:40:13.541378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:13.541378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-04-25T22:40:18.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:40:12.512392+0000', 'last_change': '2024-04-25T22:40:12.512392+0000', 'last_active': '2024-04-25T22:40:12.512392+0000', 'last_peered': '2024-04-25T22:40:12.512392+0000', 'last_clean': '2024-04-25T22:40:12.512392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:40:12.512392+0000', 'last_undegraded': '2024-04-25T22:40:12.512392+0000', 'last_fullsized': '2024-04-25T22:40:12.512392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'last_clean_scrub_stamp': '2024-04-25T22:40:12.512392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:40:18.421 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T22:40:18.809 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:18.809 INFO:teuthology.orchestra.run.smithi057.stdout:{"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":26,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":19,"num_osds":3,"num_up_osds":3,"osd_up_since":1714084801,"num_in_osds":3,"osd_in_since":1714084793,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":93118464,"bytes_avail":289817174016,"bytes_total":289910292480,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4192}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-25T22:39:52.305186+0000","services":{}},"progress_events":{}} 2024-04-25T22:40:18.828 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T22:40:18.828 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:40:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:19.121 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:40:19.135 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-25T22:40:17.120637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90936,"kb_used_data":1544,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024584,"statfs":{"total":289910292480,"available":289817174016,"internally_reserved":0,"allocated":1581056,"data_stored":1299038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.572431"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":214,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.987349+0000","last_change":"2024-04-25T22:40:04.317146+0000","last_active":"2024-04-25T22:40:10.987349+0000","last_peered":"2024-04-25T22:40:10.987349+0000","last_clean":"2024-04-25T22:40:10.987349+0000","last_became_active":"2024-04-25T22:40:04.316527+0000","last_became_peered":"2024-04-25T22:40:04.316527+0000","last_unstale":"2024-04-25T22:40:10.987349+0000","last_undegraded":"2024-04-25T22:40:10.987349+0000","last_fullsized":"2024-04-25T22:40:10.987349+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:25.669997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.987636+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:40:10.987636+0000","last_peered":"2024-04-25T22:40:10.987636+0000","last_clean":"2024-04-25T22:40:10.987636+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:40:10.987636+0000","last_undegraded":"2024-04-25T22:40:10.987636+0000","last_fullsized":"2024-04-25T22:40:10.987636+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.987655+0000","last_change":"2024-04-25T22:40:09.502444+0000","last_active":"2024-04-25T22:40:10.987655+0000","last_peered":"2024-04-25T22:40:10.987655+0000","last_clean":"2024-04-25T22:40:10.987655+0000","last_became_active":"2024-04-25T22:40:09.501576+0000","last_became_peered":"2024-04-25T22:40:09.501576+0000","last_unstale":"2024-04-25T22:40:10.987655+0000","last_undegraded":"2024-04-25T22:40:10.987655+0000","last_fullsized":"2024-04-25T22:40:10.987655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:35:14.955359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.503386+0000","last_change":"2024-04-25T22:40:09.501323+0000","last_active":"2024-04-25T22:40:10.503386+0000","last_peered":"2024-04-25T22:40:10.503386+0000","last_clean":"2024-04-25T22:40:10.503386+0000","last_became_active":"2024-04-25T22:40:09.500499+0000","last_became_peered":"2024-04-25T22:40:09.500499+0000","last_unstale":"2024-04-25T22:40:10.503386+0000","last_undegraded":"2024-04-25T22:40:10.503386+0000","last_fullsized":"2024-04-25T22:40:10.503386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:30.289572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.987591+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:40:10.987591+0000","last_peered":"2024-04-25T22:40:10.987591+0000","last_clean":"2024-04-25T22:40:10.987591+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:40:10.987591+0000","last_undegraded":"2024-04-25T22:40:10.987591+0000","last_fullsized":"2024-04-25T22:40:10.987591+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.503529+0000","last_change":"2024-04-25T22:40:09.501325+0000","last_active":"2024-04-25T22:40:10.503529+0000","last_peered":"2024-04-25T22:40:10.503529+0000","last_clean":"2024-04-25T22:40:10.503529+0000","last_became_active":"2024-04-25T22:40:09.500542+0000","last_became_peered":"2024-04-25T22:40:09.500542+0000","last_unstale":"2024-04-25T22:40:10.503529+0000","last_undegraded":"2024-04-25T22:40:10.503529+0000","last_fullsized":"2024-04-25T22:40:10.503529+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:34:38.234538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.506970+0000","last_change":"2024-04-25T22:40:09.501163+0000","last_active":"2024-04-25T22:40:10.506970+0000","last_peered":"2024-04-25T22:40:10.506970+0000","last_clean":"2024-04-25T22:40:10.506970+0000","last_became_active":"2024-04-25T22:40:09.500492+0000","last_became_peered":"2024-04-25T22:40:09.500492+0000","last_unstale":"2024-04-25T22:40:10.506970+0000","last_undegraded":"2024-04-25T22:40:10.506970+0000","last_fullsized":"2024-04-25T22:40:10.506970+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:22.822616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.503445+0000","last_change":"2024-04-25T22:40:09.501358+0000","last_active":"2024-04-25T22:40:10.503445+0000","last_peered":"2024-04-25T22:40:10.503445+0000","last_clean":"2024-04-25T22:40:10.503445+0000","last_became_active":"2024-04-25T22:40:09.500626+0000","last_became_peered":"2024-04-25T22:40:09.500626+0000","last_unstale":"2024-04-25T22:40:10.503445+0000","last_undegraded":"2024-04-25T22:40:10.503445+0000","last_fullsized":"2024-04-25T22:40:10.503445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:55.182967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:40:10.987654+0000","last_change":"2024-04-25T22:40:09.500948+0000","last_active":"2024-04-25T22:40:10.987654+0000","last_peered":"2024-04-25T22:40:10.987654+0000","last_clean":"2024-04-25T22:40:10.987654+0000","last_became_active":"2024-04-25T22:40:09.500236+0000","last_became_peered":"2024-04-25T22:40:09.500236+0000","last_unstale":"2024-04-25T22:40:10.987654+0000","last_undegraded":"2024-04-25T22:40:10.987654+0000","last_fullsized":"2024-04-25T22:40:10.987654+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:02.375961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:13.541378+0000","last_change":"2024-04-25T22:40:13.541378+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:13.541378+0000","last_undegraded":"2024-04-25T22:40:13.541378+0000","last_fullsized":"2024-04-25T22:40:13.541378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:40:12.512392+0000","last_change":"2024-04-25T22:40:12.512392+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:12.512392+0000","last_undegraded":"2024-04-25T22:40:12.512392+0000","last_fullsized":"2024-04-25T22:40:12.512392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":131072,"data_stored":39434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":724992,"data_stored":629802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":724992,"data_stored":629802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:40:19.619 INFO:tasks.ceph.mds.a.smithi057.stderr:2024-04-25T22:40:19.612+0000 7f8e81c7a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T22:40:22.140 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:40:22.462 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:22.464 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:40:22.481 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-04-25T22:40:21.121509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":192,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91088,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024432,"statfs":{"total":289910292480,"available":289817018368,"internally_reserved":0,"allocated":1744896,"data_stored":1358755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.555345"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658899+0000","last_change":"2024-04-25T22:40:14.619087+0000","last_active":"2024-04-25T22:40:15.658899+0000","last_peered":"2024-04-25T22:40:15.658899+0000","last_clean":"2024-04-25T22:40:15.658899+0000","last_became_active":"2024-04-25T22:40:14.618067+0000","last_became_peered":"2024-04-25T22:40:14.618067+0000","last_unstale":"2024-04-25T22:40:15.658899+0000","last_undegraded":"2024-04-25T22:40:15.658899+0000","last_fullsized":"2024-04-25T22:40:15.658899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658764+0000","last_change":"2024-04-25T22:40:14.631180+0000","last_active":"2024-04-25T22:40:15.658764+0000","last_peered":"2024-04-25T22:40:15.658764+0000","last_clean":"2024-04-25T22:40:15.658764+0000","last_became_active":"2024-04-25T22:40:14.630146+0000","last_became_peered":"2024-04-25T22:40:14.630146+0000","last_unstale":"2024-04-25T22:40:15.658764+0000","last_undegraded":"2024-04-25T22:40:15.658764+0000","last_fullsized":"2024-04-25T22:40:15.658764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617601+0000","last_change":"2024-04-25T22:40:14.626211+0000","last_active":"2024-04-25T22:40:15.617601+0000","last_peered":"2024-04-25T22:40:15.617601+0000","last_clean":"2024-04-25T22:40:15.617601+0000","last_became_active":"2024-04-25T22:40:14.622625+0000","last_became_peered":"2024-04-25T22:40:14.622625+0000","last_unstale":"2024-04-25T22:40:15.617601+0000","last_undegraded":"2024-04-25T22:40:15.617601+0000","last_fullsized":"2024-04-25T22:40:15.617601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:35.993000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616593+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:40:15.616593+0000","last_peered":"2024-04-25T22:40:15.616593+0000","last_clean":"2024-04-25T22:40:15.616593+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:40:15.616593+0000","last_undegraded":"2024-04-25T22:40:15.616593+0000","last_fullsized":"2024-04-25T22:40:15.616593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659167+0000","last_change":"2024-04-25T22:40:14.616641+0000","last_active":"2024-04-25T22:40:15.659167+0000","last_peered":"2024-04-25T22:40:15.659167+0000","last_clean":"2024-04-25T22:40:15.659167+0000","last_became_active":"2024-04-25T22:40:14.615875+0000","last_became_peered":"2024-04-25T22:40:14.615875+0000","last_unstale":"2024-04-25T22:40:15.659167+0000","last_undegraded":"2024-04-25T22:40:15.659167+0000","last_fullsized":"2024-04-25T22:40:15.659167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615808+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:40:15.615808+0000","last_peered":"2024-04-25T22:40:15.615808+0000","last_clean":"2024-04-25T22:40:15.615808+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:40:15.615808+0000","last_undegraded":"2024-04-25T22:40:15.615808+0000","last_fullsized":"2024-04-25T22:40:15.615808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615514+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:40:15.615514+0000","last_peered":"2024-04-25T22:40:15.615514+0000","last_clean":"2024-04-25T22:40:15.615514+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:40:15.615514+0000","last_undegraded":"2024-04-25T22:40:15.615514+0000","last_fullsized":"2024-04-25T22:40:15.615514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615069+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:40:15.615069+0000","last_peered":"2024-04-25T22:40:15.615069+0000","last_clean":"2024-04-25T22:40:15.615069+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:40:15.615069+0000","last_undegraded":"2024-04-25T22:40:15.615069+0000","last_fullsized":"2024-04-25T22:40:15.615069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615789+0000","last_change":"2024-04-25T22:40:14.625922+0000","last_active":"2024-04-25T22:40:15.615789+0000","last_peered":"2024-04-25T22:40:15.615789+0000","last_clean":"2024-04-25T22:40:15.615789+0000","last_became_active":"2024-04-25T22:40:14.624594+0000","last_became_peered":"2024-04-25T22:40:14.624594+0000","last_unstale":"2024-04-25T22:40:15.615789+0000","last_undegraded":"2024-04-25T22:40:15.615789+0000","last_fullsized":"2024-04-25T22:40:15.615789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658392+0000","last_change":"2024-04-25T22:40:14.630083+0000","last_active":"2024-04-25T22:40:15.658392+0000","last_peered":"2024-04-25T22:40:15.658392+0000","last_clean":"2024-04-25T22:40:15.658392+0000","last_became_active":"2024-04-25T22:40:14.628633+0000","last_became_peered":"2024-04-25T22:40:14.628633+0000","last_unstale":"2024-04-25T22:40:15.658392+0000","last_undegraded":"2024-04-25T22:40:15.658392+0000","last_fullsized":"2024-04-25T22:40:15.658392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617428+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:40:15.617428+0000","last_peered":"2024-04-25T22:40:15.617428+0000","last_clean":"2024-04-25T22:40:15.617428+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:40:15.617428+0000","last_undegraded":"2024-04-25T22:40:15.617428+0000","last_fullsized":"2024-04-25T22:40:15.617428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657925+0000","last_change":"2024-04-25T22:40:14.636539+0000","last_active":"2024-04-25T22:40:15.657925+0000","last_peered":"2024-04-25T22:40:15.657925+0000","last_clean":"2024-04-25T22:40:15.657925+0000","last_became_active":"2024-04-25T22:40:14.635508+0000","last_became_peered":"2024-04-25T22:40:14.635508+0000","last_unstale":"2024-04-25T22:40:15.657925+0000","last_undegraded":"2024-04-25T22:40:15.657925+0000","last_fullsized":"2024-04-25T22:40:15.657925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:30:53.093623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658378+0000","last_change":"2024-04-25T22:40:14.620438+0000","last_active":"2024-04-25T22:40:15.658378+0000","last_peered":"2024-04-25T22:40:15.658378+0000","last_clean":"2024-04-25T22:40:15.658378+0000","last_became_active":"2024-04-25T22:40:14.619963+0000","last_became_peered":"2024-04-25T22:40:14.619963+0000","last_unstale":"2024-04-25T22:40:15.658378+0000","last_undegraded":"2024-04-25T22:40:15.658378+0000","last_fullsized":"2024-04-25T22:40:15.658378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615997+0000","last_change":"2024-04-25T22:40:14.616800+0000","last_active":"2024-04-25T22:40:15.615997+0000","last_peered":"2024-04-25T22:40:15.615997+0000","last_clean":"2024-04-25T22:40:15.615997+0000","last_became_active":"2024-04-25T22:40:14.612887+0000","last_became_peered":"2024-04-25T22:40:14.612887+0000","last_unstale":"2024-04-25T22:40:15.615997+0000","last_undegraded":"2024-04-25T22:40:15.615997+0000","last_fullsized":"2024-04-25T22:40:15.615997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615601+0000","last_change":"2024-04-25T22:40:14.615520+0000","last_active":"2024-04-25T22:40:15.615601+0000","last_peered":"2024-04-25T22:40:15.615601+0000","last_clean":"2024-04-25T22:40:15.615601+0000","last_became_active":"2024-04-25T22:40:14.613556+0000","last_became_peered":"2024-04-25T22:40:14.613556+0000","last_unstale":"2024-04-25T22:40:15.615601+0000","last_undegraded":"2024-04-25T22:40:15.615601+0000","last_fullsized":"2024-04-25T22:40:15.615601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615171+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:40:15.615171+0000","last_peered":"2024-04-25T22:40:15.615171+0000","last_clean":"2024-04-25T22:40:15.615171+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:40:15.615171+0000","last_undegraded":"2024-04-25T22:40:15.615171+0000","last_fullsized":"2024-04-25T22:40:15.615171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616907+0000","last_change":"2024-04-25T22:40:14.628222+0000","last_active":"2024-04-25T22:40:15.616907+0000","last_peered":"2024-04-25T22:40:15.616907+0000","last_clean":"2024-04-25T22:40:15.616907+0000","last_became_active":"2024-04-25T22:40:14.626913+0000","last_became_peered":"2024-04-25T22:40:14.626913+0000","last_unstale":"2024-04-25T22:40:15.616907+0000","last_undegraded":"2024-04-25T22:40:15.616907+0000","last_fullsized":"2024-04-25T22:40:15.616907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659087+0000","last_change":"2024-04-25T22:40:14.629506+0000","last_active":"2024-04-25T22:40:15.659087+0000","last_peered":"2024-04-25T22:40:15.659087+0000","last_clean":"2024-04-25T22:40:15.659087+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:40:15.659087+0000","last_undegraded":"2024-04-25T22:40:15.659087+0000","last_fullsized":"2024-04-25T22:40:15.659087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615553+0000","last_change":"2024-04-25T22:40:14.623704+0000","last_active":"2024-04-25T22:40:15.615553+0000","last_peered":"2024-04-25T22:40:15.615553+0000","last_clean":"2024-04-25T22:40:15.615553+0000","last_became_active":"2024-04-25T22:40:14.623146+0000","last_became_peered":"2024-04-25T22:40:14.623146+0000","last_unstale":"2024-04-25T22:40:15.615553+0000","last_undegraded":"2024-04-25T22:40:15.615553+0000","last_fullsized":"2024-04-25T22:40:15.615553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616610+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:40:15.616610+0000","last_peered":"2024-04-25T22:40:15.616610+0000","last_clean":"2024-04-25T22:40:15.616610+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:40:15.616610+0000","last_undegraded":"2024-04-25T22:40:15.616610+0000","last_fullsized":"2024-04-25T22:40:15.616610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618087+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:40:15.618087+0000","last_peered":"2024-04-25T22:40:15.618087+0000","last_clean":"2024-04-25T22:40:15.618087+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:40:15.618087+0000","last_undegraded":"2024-04-25T22:40:15.618087+0000","last_fullsized":"2024-04-25T22:40:15.618087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657153+0000","last_change":"2024-04-25T22:40:14.636703+0000","last_active":"2024-04-25T22:40:15.657153+0000","last_peered":"2024-04-25T22:40:15.657153+0000","last_clean":"2024-04-25T22:40:15.657153+0000","last_became_active":"2024-04-25T22:40:14.635943+0000","last_became_peered":"2024-04-25T22:40:14.635943+0000","last_unstale":"2024-04-25T22:40:15.657153+0000","last_undegraded":"2024-04-25T22:40:15.657153+0000","last_fullsized":"2024-04-25T22:40:15.657153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:45:57.862599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.613539+0000","last_change":"2024-04-25T22:40:14.617094+0000","last_active":"2024-04-25T22:40:15.613539+0000","last_peered":"2024-04-25T22:40:15.613539+0000","last_clean":"2024-04-25T22:40:15.613539+0000","last_became_active":"2024-04-25T22:40:14.615818+0000","last_became_peered":"2024-04-25T22:40:14.615818+0000","last_unstale":"2024-04-25T22:40:15.613539+0000","last_undegraded":"2024-04-25T22:40:15.613539+0000","last_fullsized":"2024-04-25T22:40:15.613539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:30:53.093623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.656876+0000","last_change":"2024-04-25T22:40:14.619013+0000","last_active":"2024-04-25T22:40:15.656876+0000","last_peered":"2024-04-25T22:40:15.656876+0000","last_clean":"2024-04-25T22:40:15.656876+0000","last_became_active":"2024-04-25T22:40:14.618184+0000","last_became_peered":"2024-04-25T22:40:14.618184+0000","last_unstale":"2024-04-25T22:40:15.656876+0000","last_undegraded":"2024-04-25T22:40:15.656876+0000","last_fullsized":"2024-04-25T22:40:15.656876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:34:40.281445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659068+0000","last_change":"2024-04-25T22:40:14.622357+0000","last_active":"2024-04-25T22:40:15.659068+0000","last_peered":"2024-04-25T22:40:15.659068+0000","last_clean":"2024-04-25T22:40:15.659068+0000","last_became_active":"2024-04-25T22:40:14.621617+0000","last_became_peered":"2024-04-25T22:40:14.621617+0000","last_unstale":"2024-04-25T22:40:15.659068+0000","last_undegraded":"2024-04-25T22:40:15.659068+0000","last_fullsized":"2024-04-25T22:40:15.659068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615978+0000","last_change":"2024-04-25T22:40:14.625933+0000","last_active":"2024-04-25T22:40:15.615978+0000","last_peered":"2024-04-25T22:40:15.615978+0000","last_clean":"2024-04-25T22:40:15.615978+0000","last_became_active":"2024-04-25T22:40:14.625123+0000","last_became_peered":"2024-04-25T22:40:14.625123+0000","last_unstale":"2024-04-25T22:40:15.615978+0000","last_undegraded":"2024-04-25T22:40:15.615978+0000","last_fullsized":"2024-04-25T22:40:15.615978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618233+0000","last_change":"2024-04-25T22:40:14.630596+0000","last_active":"2024-04-25T22:40:15.618233+0000","last_peered":"2024-04-25T22:40:15.618233+0000","last_clean":"2024-04-25T22:40:15.618233+0000","last_became_active":"2024-04-25T22:40:14.625407+0000","last_became_peered":"2024-04-25T22:40:14.625407+0000","last_unstale":"2024-04-25T22:40:15.618233+0000","last_undegraded":"2024-04-25T22:40:15.618233+0000","last_fullsized":"2024-04-25T22:40:15.618233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:20:05.398182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658859+0000","last_change":"2024-04-25T22:40:14.636526+0000","last_active":"2024-04-25T22:40:15.658859+0000","last_peered":"2024-04-25T22:40:15.658859+0000","last_clean":"2024-04-25T22:40:15.658859+0000","last_became_active":"2024-04-25T22:40:14.635539+0000","last_became_peered":"2024-04-25T22:40:14.635539+0000","last_unstale":"2024-04-25T22:40:15.658859+0000","last_undegraded":"2024-04-25T22:40:15.658859+0000","last_fullsized":"2024-04-25T22:40:15.658859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614790+0000","last_change":"2024-04-25T22:40:14.620608+0000","last_active":"2024-04-25T22:40:15.614790+0000","last_peered":"2024-04-25T22:40:15.614790+0000","last_clean":"2024-04-25T22:40:15.614790+0000","last_became_active":"2024-04-25T22:40:14.618171+0000","last_became_peered":"2024-04-25T22:40:14.618171+0000","last_unstale":"2024-04-25T22:40:15.614790+0000","last_undegraded":"2024-04-25T22:40:15.614790+0000","last_fullsized":"2024-04-25T22:40:15.614790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657864+0000","last_change":"2024-04-25T22:40:14.622961+0000","last_active":"2024-04-25T22:40:15.657864+0000","last_peered":"2024-04-25T22:40:15.657864+0000","last_clean":"2024-04-25T22:40:15.657864+0000","last_became_active":"2024-04-25T22:40:14.622238+0000","last_became_peered":"2024-04-25T22:40:14.622238+0000","last_unstale":"2024-04-25T22:40:15.657864+0000","last_undegraded":"2024-04-25T22:40:15.657864+0000","last_fullsized":"2024-04-25T22:40:15.657864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:09.125174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.613760+0000","last_change":"2024-04-25T22:40:14.618468+0000","last_active":"2024-04-25T22:40:15.613760+0000","last_peered":"2024-04-25T22:40:15.613760+0000","last_clean":"2024-04-25T22:40:15.613760+0000","last_became_active":"2024-04-25T22:40:14.617312+0000","last_became_peered":"2024-04-25T22:40:14.617312+0000","last_unstale":"2024-04-25T22:40:15.613760+0000","last_undegraded":"2024-04-25T22:40:15.613760+0000","last_fullsized":"2024-04-25T22:40:15.613760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:12.679354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615544+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:40:15.615544+0000","last_peered":"2024-04-25T22:40:15.615544+0000","last_clean":"2024-04-25T22:40:15.615544+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:40:15.615544+0000","last_undegraded":"2024-04-25T22:40:15.615544+0000","last_fullsized":"2024-04-25T22:40:15.615544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658398+0000","last_change":"2024-04-25T22:40:14.613553+0000","last_active":"2024-04-25T22:40:15.658398+0000","last_peered":"2024-04-25T22:40:15.658398+0000","last_clean":"2024-04-25T22:40:15.658398+0000","last_became_active":"2024-04-25T22:40:14.612857+0000","last_became_peered":"2024-04-25T22:40:14.612857+0000","last_unstale":"2024-04-25T22:40:15.658398+0000","last_undegraded":"2024-04-25T22:40:15.658398+0000","last_fullsized":"2024-04-25T22:40:15.658398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617134+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:40:15.617134+0000","last_peered":"2024-04-25T22:40:15.617134+0000","last_clean":"2024-04-25T22:40:15.617134+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:40:15.617134+0000","last_undegraded":"2024-04-25T22:40:15.617134+0000","last_fullsized":"2024-04-25T22:40:15.617134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.660077+0000","last_change":"2024-04-25T22:40:14.618292+0000","last_active":"2024-04-25T22:40:15.660077+0000","last_peered":"2024-04-25T22:40:15.660077+0000","last_clean":"2024-04-25T22:40:15.660077+0000","last_became_active":"2024-04-25T22:40:14.616712+0000","last_became_peered":"2024-04-25T22:40:14.616712+0000","last_unstale":"2024-04-25T22:40:15.660077+0000","last_undegraded":"2024-04-25T22:40:15.660077+0000","last_fullsized":"2024-04-25T22:40:15.660077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614211+0000","last_change":"2024-04-25T22:40:13.581241+0000","last_active":"2024-04-25T22:40:15.614211+0000","last_peered":"2024-04-25T22:40:15.614211+0000","last_clean":"2024-04-25T22:40:15.614211+0000","last_became_active":"2024-04-25T22:40:13.580442+0000","last_became_peered":"2024-04-25T22:40:13.580442+0000","last_unstale":"2024-04-25T22:40:15.614211+0000","last_undegraded":"2024-04-25T22:40:15.614211+0000","last_fullsized":"2024-04-25T22:40:15.614211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:50:49.280995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616561+0000","last_change":"2024-04-25T22:40:14.631577+0000","last_active":"2024-04-25T22:40:15.616561+0000","last_peered":"2024-04-25T22:40:15.616561+0000","last_clean":"2024-04-25T22:40:15.616561+0000","last_became_active":"2024-04-25T22:40:14.630371+0000","last_became_peered":"2024-04-25T22:40:14.630371+0000","last_unstale":"2024-04-25T22:40:15.616561+0000","last_undegraded":"2024-04-25T22:40:15.616561+0000","last_fullsized":"2024-04-25T22:40:15.616561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657258+0000","last_change":"2024-04-25T22:40:13.599838+0000","last_active":"2024-04-25T22:40:15.657258+0000","last_peered":"2024-04-25T22:40:15.657258+0000","last_clean":"2024-04-25T22:40:15.657258+0000","last_became_active":"2024-04-25T22:40:13.599001+0000","last_became_peered":"2024-04-25T22:40:13.599001+0000","last_unstale":"2024-04-25T22:40:15.657258+0000","last_undegraded":"2024-04-25T22:40:15.657258+0000","last_fullsized":"2024-04-25T22:40:15.657258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:16.993188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616081+0000","last_change":"2024-04-25T22:40:14.630012+0000","last_active":"2024-04-25T22:40:15.616081+0000","last_peered":"2024-04-25T22:40:15.616081+0000","last_clean":"2024-04-25T22:40:15.616081+0000","last_became_active":"2024-04-25T22:40:14.628677+0000","last_became_peered":"2024-04-25T22:40:14.628677+0000","last_unstale":"2024-04-25T22:40:15.616081+0000","last_undegraded":"2024-04-25T22:40:15.616081+0000","last_fullsized":"2024-04-25T22:40:15.616081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615558+0000","last_change":"2024-04-25T22:40:13.599918+0000","last_active":"2024-04-25T22:40:15.615558+0000","last_peered":"2024-04-25T22:40:15.615558+0000","last_clean":"2024-04-25T22:40:15.615558+0000","last_became_active":"2024-04-25T22:40:13.596461+0000","last_became_peered":"2024-04-25T22:40:13.596461+0000","last_unstale":"2024-04-25T22:40:15.615558+0000","last_undegraded":"2024-04-25T22:40:15.615558+0000","last_fullsized":"2024-04-25T22:40:15.615558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:41:51.887162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618201+0000","last_change":"2024-04-25T22:40:13.598294+0000","last_active":"2024-04-25T22:40:15.618201+0000","last_peered":"2024-04-25T22:40:15.618201+0000","last_clean":"2024-04-25T22:40:15.618201+0000","last_became_active":"2024-04-25T22:40:13.596687+0000","last_became_peered":"2024-04-25T22:40:13.596687+0000","last_unstale":"2024-04-25T22:40:15.618201+0000","last_undegraded":"2024-04-25T22:40:15.618201+0000","last_fullsized":"2024-04-25T22:40:15.618201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:50:49.280995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.656904+0000","last_change":"2024-04-25T22:40:14.625171+0000","last_active":"2024-04-25T22:40:15.656904+0000","last_peered":"2024-04-25T22:40:15.656904+0000","last_clean":"2024-04-25T22:40:15.656904+0000","last_became_active":"2024-04-25T22:40:14.624473+0000","last_became_peered":"2024-04-25T22:40:14.624473+0000","last_unstale":"2024-04-25T22:40:15.656904+0000","last_undegraded":"2024-04-25T22:40:15.656904+0000","last_fullsized":"2024-04-25T22:40:15.656904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:30.591624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659343+0000","last_change":"2024-04-25T22:40:13.599189+0000","last_active":"2024-04-25T22:40:15.659343+0000","last_peered":"2024-04-25T22:40:15.659343+0000","last_clean":"2024-04-25T22:40:15.659343+0000","last_became_active":"2024-04-25T22:40:13.598289+0000","last_became_peered":"2024-04-25T22:40:13.598289+0000","last_unstale":"2024-04-25T22:40:15.659343+0000","last_undegraded":"2024-04-25T22:40:15.659343+0000","last_fullsized":"2024-04-25T22:40:15.659343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:05:28.535490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657030+0000","last_change":"2024-04-25T22:40:14.618478+0000","last_active":"2024-04-25T22:40:15.657030+0000","last_peered":"2024-04-25T22:40:15.657030+0000","last_clean":"2024-04-25T22:40:15.657030+0000","last_became_active":"2024-04-25T22:40:14.617688+0000","last_became_peered":"2024-04-25T22:40:14.617688+0000","last_unstale":"2024-04-25T22:40:15.657030+0000","last_undegraded":"2024-04-25T22:40:15.657030+0000","last_fullsized":"2024-04-25T22:40:15.657030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:39:44.762240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618805+0000","last_change":"2024-04-25T22:40:13.601404+0000","last_active":"2024-04-25T22:40:15.618805+0000","last_peered":"2024-04-25T22:40:15.618805+0000","last_clean":"2024-04-25T22:40:15.618805+0000","last_became_active":"2024-04-25T22:40:13.600688+0000","last_became_peered":"2024-04-25T22:40:13.600688+0000","last_unstale":"2024-04-25T22:40:15.618805+0000","last_undegraded":"2024-04-25T22:40:15.618805+0000","last_fullsized":"2024-04-25T22:40:15.618805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:36.157648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616497+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:40:15.616497+0000","last_peered":"2024-04-25T22:40:15.616497+0000","last_clean":"2024-04-25T22:40:15.616497+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:40:15.616497+0000","last_undegraded":"2024-04-25T22:40:15.616497+0000","last_fullsized":"2024-04-25T22:40:15.616497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617642+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:40:15.617642+0000","last_peered":"2024-04-25T22:40:15.617642+0000","last_clean":"2024-04-25T22:40:15.617642+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:40:15.617642+0000","last_undegraded":"2024-04-25T22:40:15.617642+0000","last_fullsized":"2024-04-25T22:40:15.617642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615001+0000","last_change":"2024-04-25T22:40:14.625843+0000","last_active":"2024-04-25T22:40:15.615001+0000","last_peered":"2024-04-25T22:40:15.615001+0000","last_clean":"2024-04-25T22:40:15.615001+0000","last_became_active":"2024-04-25T22:40:14.625187+0000","last_became_peered":"2024-04-25T22:40:14.625187+0000","last_unstale":"2024-04-25T22:40:15.615001+0000","last_undegraded":"2024-04-25T22:40:15.615001+0000","last_fullsized":"2024-04-25T22:40:15.615001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615306+0000","last_change":"2024-04-25T22:40:13.581857+0000","last_active":"2024-04-25T22:40:15.615306+0000","last_peered":"2024-04-25T22:40:15.615306+0000","last_clean":"2024-04-25T22:40:15.615306+0000","last_became_active":"2024-04-25T22:40:13.581263+0000","last_became_peered":"2024-04-25T22:40:13.581263+0000","last_unstale":"2024-04-25T22:40:15.615306+0000","last_undegraded":"2024-04-25T22:40:15.615306+0000","last_fullsized":"2024-04-25T22:40:15.615306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:54:01.709709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617001+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:40:15.617001+0000","last_peered":"2024-04-25T22:40:15.617001+0000","last_clean":"2024-04-25T22:40:15.617001+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:40:15.617001+0000","last_undegraded":"2024-04-25T22:40:15.617001+0000","last_fullsized":"2024-04-25T22:40:15.617001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616780+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:40:15.616780+0000","last_peered":"2024-04-25T22:40:15.616780+0000","last_clean":"2024-04-25T22:40:15.616780+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:40:15.616780+0000","last_undegraded":"2024-04-25T22:40:15.616780+0000","last_fullsized":"2024-04-25T22:40:15.616780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618553+0000","last_change":"2024-04-25T22:40:14.621941+0000","last_active":"2024-04-25T22:40:15.618553+0000","last_peered":"2024-04-25T22:40:15.618553+0000","last_clean":"2024-04-25T22:40:15.618553+0000","last_became_active":"2024-04-25T22:40:14.614196+0000","last_became_peered":"2024-04-25T22:40:14.614196+0000","last_unstale":"2024-04-25T22:40:15.618553+0000","last_undegraded":"2024-04-25T22:40:15.618553+0000","last_fullsized":"2024-04-25T22:40:15.618553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:24.895025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657287+0000","last_change":"2024-04-25T22:40:13.599695+0000","last_active":"2024-04-25T22:40:15.657287+0000","last_peered":"2024-04-25T22:40:15.657287+0000","last_clean":"2024-04-25T22:40:15.657287+0000","last_became_active":"2024-04-25T22:40:13.598805+0000","last_became_peered":"2024-04-25T22:40:13.598805+0000","last_unstale":"2024-04-25T22:40:15.657287+0000","last_undegraded":"2024-04-25T22:40:15.657287+0000","last_fullsized":"2024-04-25T22:40:15.657287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:56.307032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617569+0000","last_change":"2024-04-25T22:40:14.614275+0000","last_active":"2024-04-25T22:40:15.617569+0000","last_peered":"2024-04-25T22:40:15.617569+0000","last_clean":"2024-04-25T22:40:15.617569+0000","last_became_active":"2024-04-25T22:40:14.613038+0000","last_became_peered":"2024-04-25T22:40:14.613038+0000","last_unstale":"2024-04-25T22:40:15.617569+0000","last_undegraded":"2024-04-25T22:40:15.617569+0000","last_fullsized":"2024-04-25T22:40:15.617569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:14:02.343388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657203+0000","last_change":"2024-04-25T22:40:13.597555+0000","last_active":"2024-04-25T22:40:15.657203+0000","last_peered":"2024-04-25T22:40:15.657203+0000","last_clean":"2024-04-25T22:40:15.657203+0000","last_became_active":"2024-04-25T22:40:13.596623+0000","last_became_peered":"2024-04-25T22:40:13.596623+0000","last_unstale":"2024-04-25T22:40:15.657203+0000","last_undegraded":"2024-04-25T22:40:15.657203+0000","last_fullsized":"2024-04-25T22:40:15.657203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:29:00.157478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616173+0000","last_change":"2024-04-25T22:40:14.627280+0000","last_active":"2024-04-25T22:40:15.616173+0000","last_peered":"2024-04-25T22:40:15.616173+0000","last_clean":"2024-04-25T22:40:15.616173+0000","last_became_active":"2024-04-25T22:40:14.624656+0000","last_became_peered":"2024-04-25T22:40:14.624656+0000","last_unstale":"2024-04-25T22:40:15.616173+0000","last_undegraded":"2024-04-25T22:40:15.616173+0000","last_fullsized":"2024-04-25T22:40:15.616173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":222,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616001+0000","last_change":"2024-04-25T22:40:04.317146+0000","last_active":"2024-04-25T22:40:15.616001+0000","last_peered":"2024-04-25T22:40:15.616001+0000","last_clean":"2024-04-25T22:40:15.616001+0000","last_became_active":"2024-04-25T22:40:04.316527+0000","last_became_peered":"2024-04-25T22:40:04.316527+0000","last_unstale":"2024-04-25T22:40:15.616001+0000","last_undegraded":"2024-04-25T22:40:15.616001+0000","last_fullsized":"2024-04-25T22:40:15.616001+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:25.669997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617484+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:40:15.617484+0000","last_peered":"2024-04-25T22:40:15.617484+0000","last_clean":"2024-04-25T22:40:15.617484+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:40:15.617484+0000","last_undegraded":"2024-04-25T22:40:15.617484+0000","last_fullsized":"2024-04-25T22:40:15.617484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614355+0000","last_change":"2024-04-25T22:40:13.591980+0000","last_active":"2024-04-25T22:40:15.614355+0000","last_peered":"2024-04-25T22:40:15.614355+0000","last_clean":"2024-04-25T22:40:15.614355+0000","last_became_active":"2024-04-25T22:40:13.591152+0000","last_became_peered":"2024-04-25T22:40:13.591152+0000","last_unstale":"2024-04-25T22:40:15.614355+0000","last_undegraded":"2024-04-25T22:40:15.614355+0000","last_fullsized":"2024-04-25T22:40:15.614355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618637+0000","last_change":"2024-04-25T22:40:14.621472+0000","last_active":"2024-04-25T22:40:15.618637+0000","last_peered":"2024-04-25T22:40:15.618637+0000","last_clean":"2024-04-25T22:40:15.618637+0000","last_became_active":"2024-04-25T22:40:14.613608+0000","last_became_peered":"2024-04-25T22:40:14.613608+0000","last_unstale":"2024-04-25T22:40:15.618637+0000","last_undegraded":"2024-04-25T22:40:15.618637+0000","last_fullsized":"2024-04-25T22:40:15.618637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:51.686908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615728+0000","last_change":"2024-04-25T22:40:09.502444+0000","last_active":"2024-04-25T22:40:15.615728+0000","last_peered":"2024-04-25T22:40:15.615728+0000","last_clean":"2024-04-25T22:40:15.615728+0000","last_became_active":"2024-04-25T22:40:09.501576+0000","last_became_peered":"2024-04-25T22:40:09.501576+0000","last_unstale":"2024-04-25T22:40:15.615728+0000","last_undegraded":"2024-04-25T22:40:15.615728+0000","last_fullsized":"2024-04-25T22:40:15.615728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:35:14.955359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614468+0000","last_change":"2024-04-25T22:40:13.579430+0000","last_active":"2024-04-25T22:40:15.614468+0000","last_peered":"2024-04-25T22:40:15.614468+0000","last_clean":"2024-04-25T22:40:15.614468+0000","last_became_active":"2024-04-25T22:40:13.578601+0000","last_became_peered":"2024-04-25T22:40:13.578601+0000","last_unstale":"2024-04-25T22:40:15.614468+0000","last_undegraded":"2024-04-25T22:40:15.614468+0000","last_fullsized":"2024-04-25T22:40:15.614468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:50.274924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658863+0000","last_change":"2024-04-25T22:40:14.628709+0000","last_active":"2024-04-25T22:40:15.658863+0000","last_peered":"2024-04-25T22:40:15.658863+0000","last_clean":"2024-04-25T22:40:15.658863+0000","last_became_active":"2024-04-25T22:40:14.627641+0000","last_became_peered":"2024-04-25T22:40:14.627641+0000","last_unstale":"2024-04-25T22:40:15.658863+0000","last_undegraded":"2024-04-25T22:40:15.658863+0000","last_fullsized":"2024-04-25T22:40:15.658863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614614+0000","last_change":"2024-04-25T22:40:09.501323+0000","last_active":"2024-04-25T22:40:15.614614+0000","last_peered":"2024-04-25T22:40:15.614614+0000","last_clean":"2024-04-25T22:40:15.614614+0000","last_became_active":"2024-04-25T22:40:09.500499+0000","last_became_peered":"2024-04-25T22:40:09.500499+0000","last_unstale":"2024-04-25T22:40:15.614614+0000","last_undegraded":"2024-04-25T22:40:15.614614+0000","last_fullsized":"2024-04-25T22:40:15.614614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:30.289572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657249+0000","last_change":"2024-04-25T22:40:13.599332+0000","last_active":"2024-04-25T22:40:15.657249+0000","last_peered":"2024-04-25T22:40:15.657249+0000","last_clean":"2024-04-25T22:40:15.657249+0000","last_became_active":"2024-04-25T22:40:13.598689+0000","last_became_peered":"2024-04-25T22:40:13.598689+0000","last_unstale":"2024-04-25T22:40:15.657249+0000","last_undegraded":"2024-04-25T22:40:15.657249+0000","last_fullsized":"2024-04-25T22:40:15.657249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:36.875346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616453+0000","last_change":"2024-04-25T22:40:14.628007+0000","last_active":"2024-04-25T22:40:15.616453+0000","last_peered":"2024-04-25T22:40:15.616453+0000","last_clean":"2024-04-25T22:40:15.616453+0000","last_became_active":"2024-04-25T22:40:14.625425+0000","last_became_peered":"2024-04-25T22:40:14.625425+0000","last_unstale":"2024-04-25T22:40:15.616453+0000","last_undegraded":"2024-04-25T22:40:15.616453+0000","last_fullsized":"2024-04-25T22:40:15.616453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616734+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:40:15.616734+0000","last_peered":"2024-04-25T22:40:15.616734+0000","last_clean":"2024-04-25T22:40:15.616734+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:40:15.616734+0000","last_undegraded":"2024-04-25T22:40:15.616734+0000","last_fullsized":"2024-04-25T22:40:15.616734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617401+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:40:15.617401+0000","last_peered":"2024-04-25T22:40:15.617401+0000","last_clean":"2024-04-25T22:40:15.617401+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:40:15.617401+0000","last_undegraded":"2024-04-25T22:40:15.617401+0000","last_fullsized":"2024-04-25T22:40:15.617401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615641+0000","last_change":"2024-04-25T22:40:14.622442+0000","last_active":"2024-04-25T22:40:15.615641+0000","last_peered":"2024-04-25T22:40:15.615641+0000","last_clean":"2024-04-25T22:40:15.615641+0000","last_became_active":"2024-04-25T22:40:14.621130+0000","last_became_peered":"2024-04-25T22:40:14.621130+0000","last_unstale":"2024-04-25T22:40:15.615641+0000","last_undegraded":"2024-04-25T22:40:15.615641+0000","last_fullsized":"2024-04-25T22:40:15.615641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618860+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:40:15.618860+0000","last_peered":"2024-04-25T22:40:15.618860+0000","last_clean":"2024-04-25T22:40:15.618860+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:40:15.618860+0000","last_undegraded":"2024-04-25T22:40:15.618860+0000","last_fullsized":"2024-04-25T22:40:15.618860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615725+0000","last_change":"2024-04-25T22:40:09.501325+0000","last_active":"2024-04-25T22:40:15.615725+0000","last_peered":"2024-04-25T22:40:15.615725+0000","last_clean":"2024-04-25T22:40:15.615725+0000","last_became_active":"2024-04-25T22:40:09.500542+0000","last_became_peered":"2024-04-25T22:40:09.500542+0000","last_unstale":"2024-04-25T22:40:15.615725+0000","last_undegraded":"2024-04-25T22:40:15.615725+0000","last_fullsized":"2024-04-25T22:40:15.615725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:34:38.234538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657224+0000","last_change":"2024-04-25T22:40:14.636726+0000","last_active":"2024-04-25T22:40:15.657224+0000","last_peered":"2024-04-25T22:40:15.657224+0000","last_clean":"2024-04-25T22:40:15.657224+0000","last_became_active":"2024-04-25T22:40:14.636013+0000","last_became_peered":"2024-04-25T22:40:14.636013+0000","last_unstale":"2024-04-25T22:40:15.657224+0000","last_undegraded":"2024-04-25T22:40:15.657224+0000","last_fullsized":"2024-04-25T22:40:15.657224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:35.910752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615587+0000","last_change":"2024-04-25T22:40:13.591256+0000","last_active":"2024-04-25T22:40:15.615587+0000","last_peered":"2024-04-25T22:40:15.615587+0000","last_clean":"2024-04-25T22:40:15.615587+0000","last_became_active":"2024-04-25T22:40:13.590744+0000","last_became_peered":"2024-04-25T22:40:13.590744+0000","last_unstale":"2024-04-25T22:40:15.615587+0000","last_undegraded":"2024-04-25T22:40:15.615587+0000","last_fullsized":"2024-04-25T22:40:15.615587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:50.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.660294+0000","last_change":"2024-04-25T22:40:09.501163+0000","last_active":"2024-04-25T22:40:15.660294+0000","last_peered":"2024-04-25T22:40:15.660294+0000","last_clean":"2024-04-25T22:40:15.660294+0000","last_became_active":"2024-04-25T22:40:09.500492+0000","last_became_peered":"2024-04-25T22:40:09.500492+0000","last_unstale":"2024-04-25T22:40:15.660294+0000","last_undegraded":"2024-04-25T22:40:15.660294+0000","last_fullsized":"2024-04-25T22:40:15.660294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:22.822616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658264+0000","last_change":"2024-04-25T22:40:14.638662+0000","last_active":"2024-04-25T22:40:15.658264+0000","last_peered":"2024-04-25T22:40:15.658264+0000","last_clean":"2024-04-25T22:40:15.658264+0000","last_became_active":"2024-04-25T22:40:14.638060+0000","last_became_peered":"2024-04-25T22:40:14.638060+0000","last_unstale":"2024-04-25T22:40:15.658264+0000","last_undegraded":"2024-04-25T22:40:15.658264+0000","last_fullsized":"2024-04-25T22:40:15.658264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:12.679354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616939+0000","last_change":"2024-04-25T22:40:13.592055+0000","last_active":"2024-04-25T22:40:15.616939+0000","last_peered":"2024-04-25T22:40:15.616939+0000","last_clean":"2024-04-25T22:40:15.616939+0000","last_became_active":"2024-04-25T22:40:13.591169+0000","last_became_peered":"2024-04-25T22:40:13.591169+0000","last_unstale":"2024-04-25T22:40:15.616939+0000","last_undegraded":"2024-04-25T22:40:15.616939+0000","last_fullsized":"2024-04-25T22:40:15.616939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:33.458799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616687+0000","last_change":"2024-04-25T22:40:09.501358+0000","last_active":"2024-04-25T22:40:15.616687+0000","last_peered":"2024-04-25T22:40:15.616687+0000","last_clean":"2024-04-25T22:40:15.616687+0000","last_became_active":"2024-04-25T22:40:09.500626+0000","last_became_peered":"2024-04-25T22:40:09.500626+0000","last_unstale":"2024-04-25T22:40:15.616687+0000","last_undegraded":"2024-04-25T22:40:15.616687+0000","last_fullsized":"2024-04-25T22:40:15.616687+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:55.182967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.613952+0000","last_change":"2024-04-25T22:40:14.618363+0000","last_active":"2024-04-25T22:40:15.613952+0000","last_peered":"2024-04-25T22:40:15.613952+0000","last_clean":"2024-04-25T22:40:15.613952+0000","last_became_active":"2024-04-25T22:40:14.617599+0000","last_became_peered":"2024-04-25T22:40:14.617599+0000","last_unstale":"2024-04-25T22:40:15.613952+0000","last_undegraded":"2024-04-25T22:40:15.613952+0000","last_fullsized":"2024-04-25T22:40:15.613952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:16.594231+0000","last_change":"2024-04-25T22:40:13.593400+0000","last_active":"2024-04-25T22:40:16.594231+0000","last_peered":"2024-04-25T22:40:16.594231+0000","last_clean":"2024-04-25T22:40:16.594231+0000","last_became_active":"2024-04-25T22:40:13.592338+0000","last_became_peered":"2024-04-25T22:40:13.592338+0000","last_unstale":"2024-04-25T22:40:16.594231+0000","last_undegraded":"2024-04-25T22:40:16.594231+0000","last_fullsized":"2024-04-25T22:40:16.594231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618220+0000","last_change":"2024-04-25T22:40:09.500948+0000","last_active":"2024-04-25T22:40:15.618220+0000","last_peered":"2024-04-25T22:40:15.618220+0000","last_clean":"2024-04-25T22:40:15.618220+0000","last_became_active":"2024-04-25T22:40:09.500236+0000","last_became_peered":"2024-04-25T22:40:09.500236+0000","last_unstale":"2024-04-25T22:40:15.618220+0000","last_undegraded":"2024-04-25T22:40:15.618220+0000","last_fullsized":"2024-04-25T22:40:15.618220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:02.375961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657009+0000","last_change":"2024-04-25T22:40:14.623882+0000","last_active":"2024-04-25T22:40:15.657009+0000","last_peered":"2024-04-25T22:40:15.657009+0000","last_clean":"2024-04-25T22:40:15.657009+0000","last_became_active":"2024-04-25T22:40:14.623090+0000","last_became_peered":"2024-04-25T22:40:14.623090+0000","last_unstale":"2024-04-25T22:40:15.657009+0000","last_undegraded":"2024-04-25T22:40:15.657009+0000","last_fullsized":"2024-04-25T22:40:15.657009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:52.116132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616663+0000","last_change":"2024-04-25T22:40:14.619806+0000","last_active":"2024-04-25T22:40:15.616663+0000","last_peered":"2024-04-25T22:40:15.616663+0000","last_clean":"2024-04-25T22:40:15.616663+0000","last_became_active":"2024-04-25T22:40:14.618980+0000","last_became_peered":"2024-04-25T22:40:14.618980+0000","last_unstale":"2024-04-25T22:40:15.616663+0000","last_undegraded":"2024-04-25T22:40:15.616663+0000","last_fullsized":"2024-04-25T22:40:15.616663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617318+0000","last_change":"2024-04-25T22:40:13.598003+0000","last_active":"2024-04-25T22:40:15.617318+0000","last_peered":"2024-04-25T22:40:15.617318+0000","last_clean":"2024-04-25T22:40:15.617318+0000","last_became_active":"2024-04-25T22:40:13.596631+0000","last_became_peered":"2024-04-25T22:40:13.596631+0000","last_unstale":"2024-04-25T22:40:15.617318+0000","last_undegraded":"2024-04-25T22:40:15.617318+0000","last_fullsized":"2024-04-25T22:40:15.617318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:50.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614024+0000","last_change":"2024-04-25T22:40:14.620064+0000","last_active":"2024-04-25T22:40:15.614024+0000","last_peered":"2024-04-25T22:40:15.614024+0000","last_clean":"2024-04-25T22:40:15.614024+0000","last_became_active":"2024-04-25T22:40:14.619294+0000","last_became_peered":"2024-04-25T22:40:14.619294+0000","last_unstale":"2024-04-25T22:40:15.614024+0000","last_undegraded":"2024-04-25T22:40:15.614024+0000","last_fullsized":"2024-04-25T22:40:15.614024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.660194+0000","last_change":"2024-04-25T22:40:13.600050+0000","last_active":"2024-04-25T22:40:15.660194+0000","last_peered":"2024-04-25T22:40:15.660194+0000","last_clean":"2024-04-25T22:40:15.660194+0000","last_became_active":"2024-04-25T22:40:13.599138+0000","last_became_peered":"2024-04-25T22:40:13.599138+0000","last_unstale":"2024-04-25T22:40:15.660194+0000","last_undegraded":"2024-04-25T22:40:15.660194+0000","last_fullsized":"2024-04-25T22:40:15.660194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:36.847491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618448+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:40:15.618448+0000","last_peered":"2024-04-25T22:40:15.618448+0000","last_clean":"2024-04-25T22:40:15.618448+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:40:15.618448+0000","last_undegraded":"2024-04-25T22:40:15.618448+0000","last_fullsized":"2024-04-25T22:40:15.618448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614160+0000","last_change":"2024-04-25T22:40:14.627868+0000","last_active":"2024-04-25T22:40:15.614160+0000","last_peered":"2024-04-25T22:40:15.614160+0000","last_clean":"2024-04-25T22:40:15.614160+0000","last_became_active":"2024-04-25T22:40:14.626388+0000","last_became_peered":"2024-04-25T22:40:14.626388+0000","last_unstale":"2024-04-25T22:40:15.614160+0000","last_undegraded":"2024-04-25T22:40:15.614160+0000","last_fullsized":"2024-04-25T22:40:15.614160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616733+0000","last_change":"2024-04-25T22:40:13.593378+0000","last_active":"2024-04-25T22:40:15.616733+0000","last_peered":"2024-04-25T22:40:15.616733+0000","last_clean":"2024-04-25T22:40:15.616733+0000","last_became_active":"2024-04-25T22:40:13.592392+0000","last_became_peered":"2024-04-25T22:40:13.592392+0000","last_unstale":"2024-04-25T22:40:15.616733+0000","last_undegraded":"2024-04-25T22:40:15.616733+0000","last_fullsized":"2024-04-25T22:40:15.616733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.613799+0000","last_change":"2024-04-25T22:40:14.619640+0000","last_active":"2024-04-25T22:40:15.613799+0000","last_peered":"2024-04-25T22:40:15.613799+0000","last_clean":"2024-04-25T22:40:15.613799+0000","last_became_active":"2024-04-25T22:40:14.618088+0000","last_became_peered":"2024-04-25T22:40:14.618088+0000","last_unstale":"2024-04-25T22:40:15.613799+0000","last_undegraded":"2024-04-25T22:40:15.613799+0000","last_fullsized":"2024-04-25T22:40:15.613799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:58.322470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659293+0000","last_change":"2024-04-25T22:40:14.622624+0000","last_active":"2024-04-25T22:40:15.659293+0000","last_peered":"2024-04-25T22:40:15.659293+0000","last_clean":"2024-04-25T22:40:15.659293+0000","last_became_active":"2024-04-25T22:40:14.621883+0000","last_became_peered":"2024-04-25T22:40:14.621883+0000","last_unstale":"2024-04-25T22:40:15.659293+0000","last_undegraded":"2024-04-25T22:40:15.659293+0000","last_fullsized":"2024-04-25T22:40:15.659293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614104+0000","last_change":"2024-04-25T22:40:13.588577+0000","last_active":"2024-04-25T22:40:15.614104+0000","last_peered":"2024-04-25T22:40:15.614104+0000","last_clean":"2024-04-25T22:40:15.614104+0000","last_became_active":"2024-04-25T22:40:13.588019+0000","last_became_peered":"2024-04-25T22:40:13.588019+0000","last_unstale":"2024-04-25T22:40:15.614104+0000","last_undegraded":"2024-04-25T22:40:15.614104+0000","last_fullsized":"2024-04-25T22:40:15.614104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:07.743396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616085+0000","last_change":"2024-04-25T22:40:14.630597+0000","last_active":"2024-04-25T22:40:15.616085+0000","last_peered":"2024-04-25T22:40:15.616085+0000","last_clean":"2024-04-25T22:40:15.616085+0000","last_became_active":"2024-04-25T22:40:14.628981+0000","last_became_peered":"2024-04-25T22:40:14.628981+0000","last_unstale":"2024-04-25T22:40:15.616085+0000","last_undegraded":"2024-04-25T22:40:15.616085+0000","last_fullsized":"2024-04-25T22:40:15.616085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614326+0000","last_change":"2024-04-25T22:40:13.581827+0000","last_active":"2024-04-25T22:40:15.614326+0000","last_peered":"2024-04-25T22:40:15.614326+0000","last_clean":"2024-04-25T22:40:15.614326+0000","last_became_active":"2024-04-25T22:40:13.581166+0000","last_became_peered":"2024-04-25T22:40:13.581166+0000","last_unstale":"2024-04-25T22:40:15.614326+0000","last_undegraded":"2024-04-25T22:40:15.614326+0000","last_fullsized":"2024-04-25T22:40:15.614326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659335+0000","last_change":"2024-04-25T22:40:14.636300+0000","last_active":"2024-04-25T22:40:15.659335+0000","last_peered":"2024-04-25T22:40:15.659335+0000","last_clean":"2024-04-25T22:40:15.659335+0000","last_became_active":"2024-04-25T22:40:14.635200+0000","last_became_peered":"2024-04-25T22:40:14.635200+0000","last_unstale":"2024-04-25T22:40:15.659335+0000","last_undegraded":"2024-04-25T22:40:15.659335+0000","last_fullsized":"2024-04-25T22:40:15.659335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657711+0000","last_change":"2024-04-25T22:40:13.597736+0000","last_active":"2024-04-25T22:40:15.657711+0000","last_peered":"2024-04-25T22:40:15.657711+0000","last_clean":"2024-04-25T22:40:15.657711+0000","last_became_active":"2024-04-25T22:40:13.596811+0000","last_became_peered":"2024-04-25T22:40:13.596811+0000","last_unstale":"2024-04-25T22:40:15.657711+0000","last_undegraded":"2024-04-25T22:40:15.657711+0000","last_fullsized":"2024-04-25T22:40:15.657711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:14:39.783367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658355+0000","last_change":"2024-04-25T22:40:14.616725+0000","last_active":"2024-04-25T22:40:15.658355+0000","last_peered":"2024-04-25T22:40:15.658355+0000","last_clean":"2024-04-25T22:40:15.658355+0000","last_became_active":"2024-04-25T22:40:14.615881+0000","last_became_peered":"2024-04-25T22:40:14.615881+0000","last_unstale":"2024-04-25T22:40:15.658355+0000","last_undegraded":"2024-04-25T22:40:15.658355+0000","last_fullsized":"2024-04-25T22:40:15.658355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658755+0000","last_change":"2024-04-25T22:40:13.594299+0000","last_active":"2024-04-25T22:40:15.658755+0000","last_peered":"2024-04-25T22:40:15.658755+0000","last_clean":"2024-04-25T22:40:15.658755+0000","last_became_active":"2024-04-25T22:40:13.593477+0000","last_became_peered":"2024-04-25T22:40:13.593477+0000","last_unstale":"2024-04-25T22:40:15.658755+0000","last_undegraded":"2024-04-25T22:40:15.658755+0000","last_fullsized":"2024-04-25T22:40:15.658755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:55.181892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616518+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:40:15.616518+0000","last_peered":"2024-04-25T22:40:15.616518+0000","last_clean":"2024-04-25T22:40:15.616518+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:40:15.616518+0000","last_undegraded":"2024-04-25T22:40:15.616518+0000","last_fullsized":"2024-04-25T22:40:15.616518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617388+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:40:15.617388+0000","last_peered":"2024-04-25T22:40:15.617388+0000","last_clean":"2024-04-25T22:40:15.617388+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:40:15.617388+0000","last_undegraded":"2024-04-25T22:40:15.617388+0000","last_fullsized":"2024-04-25T22:40:15.617388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616444+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:40:15.616444+0000","last_peered":"2024-04-25T22:40:15.616444+0000","last_clean":"2024-04-25T22:40:15.616444+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:40:15.616444+0000","last_undegraded":"2024-04-25T22:40:15.616444+0000","last_fullsized":"2024-04-25T22:40:15.616444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659592+0000","last_change":"2024-04-25T22:40:13.600784+0000","last_active":"2024-04-25T22:40:15.659592+0000","last_peered":"2024-04-25T22:40:15.659592+0000","last_clean":"2024-04-25T22:40:15.659592+0000","last_became_active":"2024-04-25T22:40:13.600104+0000","last_became_peered":"2024-04-25T22:40:13.600104+0000","last_unstale":"2024-04-25T22:40:15.659592+0000","last_undegraded":"2024-04-25T22:40:15.659592+0000","last_fullsized":"2024-04-25T22:40:15.659592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:54.861491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658308+0000","last_change":"2024-04-25T22:40:14.618046+0000","last_active":"2024-04-25T22:40:15.658308+0000","last_peered":"2024-04-25T22:40:15.658308+0000","last_clean":"2024-04-25T22:40:15.658308+0000","last_became_active":"2024-04-25T22:40:14.616356+0000","last_became_peered":"2024-04-25T22:40:14.616356+0000","last_unstale":"2024-04-25T22:40:15.658308+0000","last_undegraded":"2024-04-25T22:40:15.658308+0000","last_fullsized":"2024-04-25T22:40:15.658308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:58.322470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616346+0000","last_change":"2024-04-25T22:40:13.594172+0000","last_active":"2024-04-25T22:40:15.616346+0000","last_peered":"2024-04-25T22:40:15.616346+0000","last_clean":"2024-04-25T22:40:15.616346+0000","last_became_active":"2024-04-25T22:40:13.593428+0000","last_became_peered":"2024-04-25T22:40:13.593428+0000","last_unstale":"2024-04-25T22:40:15.616346+0000","last_undegraded":"2024-04-25T22:40:15.616346+0000","last_fullsized":"2024-04-25T22:40:15.616346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:41:51.887162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616499+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:40:15.616499+0000","last_peered":"2024-04-25T22:40:15.616499+0000","last_clean":"2024-04-25T22:40:15.616499+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:40:15.616499+0000","last_undegraded":"2024-04-25T22:40:15.616499+0000","last_fullsized":"2024-04-25T22:40:15.616499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616446+0000","last_change":"2024-04-25T22:40:13.593659+0000","last_active":"2024-04-25T22:40:15.616446+0000","last_peered":"2024-04-25T22:40:15.616446+0000","last_clean":"2024-04-25T22:40:15.616446+0000","last_became_active":"2024-04-25T22:40:13.592874+0000","last_became_peered":"2024-04-25T22:40:13.592874+0000","last_unstale":"2024-04-25T22:40:15.616446+0000","last_undegraded":"2024-04-25T22:40:15.616446+0000","last_fullsized":"2024-04-25T22:40:15.616446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":58349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":782336,"data_stored":649895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":790528,"data_stored":650511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:40:22.485 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T22:40:22.485 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T22:40:22.485 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T22:40:22.485 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T22:40:22.486 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T22:40:22.872 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:22.890 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":4095850393},{"type":"v1","addr":"172.21.15.57:6801","nonce":4095850393}]},"active_addr":"172.21.15.57:6801/4095850393","active_change":"2024-04-25T22:39:57.107937+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":4044927496}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":1537580098}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":2377085753}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":2137220479}]}]} 2024-04-25T22:40:22.894 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T22:40:22.894 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T22:40:22.894 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:40:23.191 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:23.191 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":19,"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","created":"2024-04-25T22:39:52.303074+0000","modified":"2024-04-25T22:40:15.597829+0000","last_up_change":"2024-04-25T22:40:01.251093+0000","last_in_change":"2024-04-25T22:39:53.230242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:40:03.197725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:40:07.560858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:40:12.431697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:40:12.919828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d465b4-5896-4d69-80b1-7e69d31eb455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6801","nonce":765118869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6803","nonce":765118869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6807","nonce":765118869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6805","nonce":765118869}]},"public_addr":"172.21.15.122:6801/765118869","cluster_addr":"172.21.15.122:6803/765118869","heartbeat_back_addr":"172.21.15.122:6807/765118869","heartbeat_front_addr":"172.21.15.122:6805/765118869","state":["exists","up"]},{"osd":1,"uuid":"8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6801","nonce":2387035286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6803","nonce":2387035286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6807","nonce":2387035286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6805","nonce":2387035286}]},"public_addr":"172.21.15.148:6801/2387035286","cluster_addr":"172.21.15.148:6803/2387035286","heartbeat_back_addr":"172.21.15.148:6807/2387035286","heartbeat_front_addr":"172.21.15.148:6805/2387035286","state":["exists","up"]},{"osd":2,"uuid":"164fc653-2135-4e9b-8826-1716fdba6ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6801","nonce":368834361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6803","nonce":368834361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6807","nonce":368834361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6805","nonce":368834361}]},"public_addr":"172.21.15.188:6801/368834361","cluster_addr":"172.21.15.188:6803/368834361","heartbeat_back_addr":"172.21.15.188:6807/368834361","heartbeat_front_addr":"172.21.15.188:6805/368834361","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.559393+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.563434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.557643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:40:23.210 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T22:40:23.210 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:40:23.494 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:23.494 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":19,"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","created":"2024-04-25T22:39:52.303074+0000","modified":"2024-04-25T22:40:15.597829+0000","last_up_change":"2024-04-25T22:40:01.251093+0000","last_in_change":"2024-04-25T22:39:53.230242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:40:03.197725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:40:07.560858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:40:12.431697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:40:12.919828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d465b4-5896-4d69-80b1-7e69d31eb455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6801","nonce":765118869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6803","nonce":765118869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6807","nonce":765118869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6805","nonce":765118869}]},"public_addr":"172.21.15.122:6801/765118869","cluster_addr":"172.21.15.122:6803/765118869","heartbeat_back_addr":"172.21.15.122:6807/765118869","heartbeat_front_addr":"172.21.15.122:6805/765118869","state":["exists","up"]},{"osd":1,"uuid":"8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6801","nonce":2387035286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6803","nonce":2387035286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6807","nonce":2387035286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6805","nonce":2387035286}]},"public_addr":"172.21.15.148:6801/2387035286","cluster_addr":"172.21.15.148:6803/2387035286","heartbeat_back_addr":"172.21.15.148:6807/2387035286","heartbeat_front_addr":"172.21.15.148:6805/2387035286","state":["exists","up"]},{"osd":2,"uuid":"164fc653-2135-4e9b-8826-1716fdba6ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6801","nonce":368834361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6803","nonce":368834361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6807","nonce":368834361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6805","nonce":368834361}]},"public_addr":"172.21.15.188:6801/368834361","cluster_addr":"172.21.15.188:6803/368834361","heartbeat_back_addr":"172.21.15.188:6807/368834361","heartbeat_front_addr":"172.21.15.188:6805/368834361","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.559393+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.563434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.557643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:40:23.513 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T22:40:23.513 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T22:40:23.514 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T22:40:23.667 INFO:teuthology.orchestra.run.smithi057.stdout:34359738377 2024-04-25T22:40:23.668 INFO:teuthology.orchestra.run.smithi057.stdout:34359738376 2024-04-25T22:40:23.668 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T22:40:23.669 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T22:40:23.670 INFO:teuthology.orchestra.run.smithi057.stdout:34359738377 2024-04-25T22:40:23.670 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T22:40:23.987 INFO:teuthology.orchestra.run.smithi057.stdout:34359738376 2024-04-25T22:40:23.990 INFO:teuthology.orchestra.run.smithi057.stdout:34359738375 2024-04-25T22:40:23.990 INFO:teuthology.orchestra.run.smithi057.stdout:34359738376 2024-04-25T22:40:24.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738376 for osd.0 2024-04-25T22:40:24.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738376 for osd.2 2024-04-25T22:40:24.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738375 for osd.1 2024-04-25T22:40:25.011 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T22:40:25.013 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T22:40:25.014 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T22:40:25.305 INFO:teuthology.orchestra.run.smithi057.stdout:34359738377 2024-04-25T22:40:25.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738377 for osd.2 2024-04-25T22:40:25.323 DEBUG:teuthology.parallel:result is None 2024-04-25T22:40:25.409 INFO:teuthology.orchestra.run.smithi057.stdout:34359738377 2024-04-25T22:40:25.410 INFO:teuthology.orchestra.run.smithi057.stdout:34359738376 2024-04-25T22:40:25.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738377 for osd.0 2024-04-25T22:40:25.430 DEBUG:teuthology.parallel:result is None 2024-04-25T22:40:25.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738376 for osd.1 2024-04-25T22:40:25.431 DEBUG:teuthology.parallel:result is None 2024-04-25T22:40:25.431 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T22:40:25.431 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:40:25.734 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:25.736 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:40:25.753 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-04-25T22:40:25.122918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91088,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024432,"statfs":{"total":289910292480,"available":289817018368,"internally_reserved":0,"allocated":1744896,"data_stored":1358755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002598"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658899+0000","last_change":"2024-04-25T22:40:14.619087+0000","last_active":"2024-04-25T22:40:15.658899+0000","last_peered":"2024-04-25T22:40:15.658899+0000","last_clean":"2024-04-25T22:40:15.658899+0000","last_became_active":"2024-04-25T22:40:14.618067+0000","last_became_peered":"2024-04-25T22:40:14.618067+0000","last_unstale":"2024-04-25T22:40:15.658899+0000","last_undegraded":"2024-04-25T22:40:15.658899+0000","last_fullsized":"2024-04-25T22:40:15.658899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658764+0000","last_change":"2024-04-25T22:40:14.631180+0000","last_active":"2024-04-25T22:40:15.658764+0000","last_peered":"2024-04-25T22:40:15.658764+0000","last_clean":"2024-04-25T22:40:15.658764+0000","last_became_active":"2024-04-25T22:40:14.630146+0000","last_became_peered":"2024-04-25T22:40:14.630146+0000","last_unstale":"2024-04-25T22:40:15.658764+0000","last_undegraded":"2024-04-25T22:40:15.658764+0000","last_fullsized":"2024-04-25T22:40:15.658764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617601+0000","last_change":"2024-04-25T22:40:14.626211+0000","last_active":"2024-04-25T22:40:15.617601+0000","last_peered":"2024-04-25T22:40:15.617601+0000","last_clean":"2024-04-25T22:40:15.617601+0000","last_became_active":"2024-04-25T22:40:14.622625+0000","last_became_peered":"2024-04-25T22:40:14.622625+0000","last_unstale":"2024-04-25T22:40:15.617601+0000","last_undegraded":"2024-04-25T22:40:15.617601+0000","last_fullsized":"2024-04-25T22:40:15.617601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:35.993000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616593+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:40:15.616593+0000","last_peered":"2024-04-25T22:40:15.616593+0000","last_clean":"2024-04-25T22:40:15.616593+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:40:15.616593+0000","last_undegraded":"2024-04-25T22:40:15.616593+0000","last_fullsized":"2024-04-25T22:40:15.616593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659167+0000","last_change":"2024-04-25T22:40:14.616641+0000","last_active":"2024-04-25T22:40:15.659167+0000","last_peered":"2024-04-25T22:40:15.659167+0000","last_clean":"2024-04-25T22:40:15.659167+0000","last_became_active":"2024-04-25T22:40:14.615875+0000","last_became_peered":"2024-04-25T22:40:14.615875+0000","last_unstale":"2024-04-25T22:40:15.659167+0000","last_undegraded":"2024-04-25T22:40:15.659167+0000","last_fullsized":"2024-04-25T22:40:15.659167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615808+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:40:15.615808+0000","last_peered":"2024-04-25T22:40:15.615808+0000","last_clean":"2024-04-25T22:40:15.615808+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:40:15.615808+0000","last_undegraded":"2024-04-25T22:40:15.615808+0000","last_fullsized":"2024-04-25T22:40:15.615808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615514+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:40:15.615514+0000","last_peered":"2024-04-25T22:40:15.615514+0000","last_clean":"2024-04-25T22:40:15.615514+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:40:15.615514+0000","last_undegraded":"2024-04-25T22:40:15.615514+0000","last_fullsized":"2024-04-25T22:40:15.615514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615069+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:40:15.615069+0000","last_peered":"2024-04-25T22:40:15.615069+0000","last_clean":"2024-04-25T22:40:15.615069+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:40:15.615069+0000","last_undegraded":"2024-04-25T22:40:15.615069+0000","last_fullsized":"2024-04-25T22:40:15.615069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615789+0000","last_change":"2024-04-25T22:40:14.625922+0000","last_active":"2024-04-25T22:40:15.615789+0000","last_peered":"2024-04-25T22:40:15.615789+0000","last_clean":"2024-04-25T22:40:15.615789+0000","last_became_active":"2024-04-25T22:40:14.624594+0000","last_became_peered":"2024-04-25T22:40:14.624594+0000","last_unstale":"2024-04-25T22:40:15.615789+0000","last_undegraded":"2024-04-25T22:40:15.615789+0000","last_fullsized":"2024-04-25T22:40:15.615789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658392+0000","last_change":"2024-04-25T22:40:14.630083+0000","last_active":"2024-04-25T22:40:15.658392+0000","last_peered":"2024-04-25T22:40:15.658392+0000","last_clean":"2024-04-25T22:40:15.658392+0000","last_became_active":"2024-04-25T22:40:14.628633+0000","last_became_peered":"2024-04-25T22:40:14.628633+0000","last_unstale":"2024-04-25T22:40:15.658392+0000","last_undegraded":"2024-04-25T22:40:15.658392+0000","last_fullsized":"2024-04-25T22:40:15.658392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617428+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:40:15.617428+0000","last_peered":"2024-04-25T22:40:15.617428+0000","last_clean":"2024-04-25T22:40:15.617428+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:40:15.617428+0000","last_undegraded":"2024-04-25T22:40:15.617428+0000","last_fullsized":"2024-04-25T22:40:15.617428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657925+0000","last_change":"2024-04-25T22:40:14.636539+0000","last_active":"2024-04-25T22:40:15.657925+0000","last_peered":"2024-04-25T22:40:15.657925+0000","last_clean":"2024-04-25T22:40:15.657925+0000","last_became_active":"2024-04-25T22:40:14.635508+0000","last_became_peered":"2024-04-25T22:40:14.635508+0000","last_unstale":"2024-04-25T22:40:15.657925+0000","last_undegraded":"2024-04-25T22:40:15.657925+0000","last_fullsized":"2024-04-25T22:40:15.657925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:30:53.093623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658378+0000","last_change":"2024-04-25T22:40:14.620438+0000","last_active":"2024-04-25T22:40:15.658378+0000","last_peered":"2024-04-25T22:40:15.658378+0000","last_clean":"2024-04-25T22:40:15.658378+0000","last_became_active":"2024-04-25T22:40:14.619963+0000","last_became_peered":"2024-04-25T22:40:14.619963+0000","last_unstale":"2024-04-25T22:40:15.658378+0000","last_undegraded":"2024-04-25T22:40:15.658378+0000","last_fullsized":"2024-04-25T22:40:15.658378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615997+0000","last_change":"2024-04-25T22:40:14.616800+0000","last_active":"2024-04-25T22:40:15.615997+0000","last_peered":"2024-04-25T22:40:15.615997+0000","last_clean":"2024-04-25T22:40:15.615997+0000","last_became_active":"2024-04-25T22:40:14.612887+0000","last_became_peered":"2024-04-25T22:40:14.612887+0000","last_unstale":"2024-04-25T22:40:15.615997+0000","last_undegraded":"2024-04-25T22:40:15.615997+0000","last_fullsized":"2024-04-25T22:40:15.615997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615601+0000","last_change":"2024-04-25T22:40:14.615520+0000","last_active":"2024-04-25T22:40:15.615601+0000","last_peered":"2024-04-25T22:40:15.615601+0000","last_clean":"2024-04-25T22:40:15.615601+0000","last_became_active":"2024-04-25T22:40:14.613556+0000","last_became_peered":"2024-04-25T22:40:14.613556+0000","last_unstale":"2024-04-25T22:40:15.615601+0000","last_undegraded":"2024-04-25T22:40:15.615601+0000","last_fullsized":"2024-04-25T22:40:15.615601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615171+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:40:15.615171+0000","last_peered":"2024-04-25T22:40:15.615171+0000","last_clean":"2024-04-25T22:40:15.615171+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:40:15.615171+0000","last_undegraded":"2024-04-25T22:40:15.615171+0000","last_fullsized":"2024-04-25T22:40:15.615171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616907+0000","last_change":"2024-04-25T22:40:14.628222+0000","last_active":"2024-04-25T22:40:15.616907+0000","last_peered":"2024-04-25T22:40:15.616907+0000","last_clean":"2024-04-25T22:40:15.616907+0000","last_became_active":"2024-04-25T22:40:14.626913+0000","last_became_peered":"2024-04-25T22:40:14.626913+0000","last_unstale":"2024-04-25T22:40:15.616907+0000","last_undegraded":"2024-04-25T22:40:15.616907+0000","last_fullsized":"2024-04-25T22:40:15.616907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659087+0000","last_change":"2024-04-25T22:40:14.629506+0000","last_active":"2024-04-25T22:40:15.659087+0000","last_peered":"2024-04-25T22:40:15.659087+0000","last_clean":"2024-04-25T22:40:15.659087+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:40:15.659087+0000","last_undegraded":"2024-04-25T22:40:15.659087+0000","last_fullsized":"2024-04-25T22:40:15.659087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615553+0000","last_change":"2024-04-25T22:40:14.623704+0000","last_active":"2024-04-25T22:40:15.615553+0000","last_peered":"2024-04-25T22:40:15.615553+0000","last_clean":"2024-04-25T22:40:15.615553+0000","last_became_active":"2024-04-25T22:40:14.623146+0000","last_became_peered":"2024-04-25T22:40:14.623146+0000","last_unstale":"2024-04-25T22:40:15.615553+0000","last_undegraded":"2024-04-25T22:40:15.615553+0000","last_fullsized":"2024-04-25T22:40:15.615553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616610+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:40:15.616610+0000","last_peered":"2024-04-25T22:40:15.616610+0000","last_clean":"2024-04-25T22:40:15.616610+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:40:15.616610+0000","last_undegraded":"2024-04-25T22:40:15.616610+0000","last_fullsized":"2024-04-25T22:40:15.616610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618087+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:40:15.618087+0000","last_peered":"2024-04-25T22:40:15.618087+0000","last_clean":"2024-04-25T22:40:15.618087+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:40:15.618087+0000","last_undegraded":"2024-04-25T22:40:15.618087+0000","last_fullsized":"2024-04-25T22:40:15.618087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657153+0000","last_change":"2024-04-25T22:40:14.636703+0000","last_active":"2024-04-25T22:40:15.657153+0000","last_peered":"2024-04-25T22:40:15.657153+0000","last_clean":"2024-04-25T22:40:15.657153+0000","last_became_active":"2024-04-25T22:40:14.635943+0000","last_became_peered":"2024-04-25T22:40:14.635943+0000","last_unstale":"2024-04-25T22:40:15.657153+0000","last_undegraded":"2024-04-25T22:40:15.657153+0000","last_fullsized":"2024-04-25T22:40:15.657153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:45:57.862599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.613539+0000","last_change":"2024-04-25T22:40:14.617094+0000","last_active":"2024-04-25T22:40:15.613539+0000","last_peered":"2024-04-25T22:40:15.613539+0000","last_clean":"2024-04-25T22:40:15.613539+0000","last_became_active":"2024-04-25T22:40:14.615818+0000","last_became_peered":"2024-04-25T22:40:14.615818+0000","last_unstale":"2024-04-25T22:40:15.613539+0000","last_undegraded":"2024-04-25T22:40:15.613539+0000","last_fullsized":"2024-04-25T22:40:15.613539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:30:53.093623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.656876+0000","last_change":"2024-04-25T22:40:14.619013+0000","last_active":"2024-04-25T22:40:15.656876+0000","last_peered":"2024-04-25T22:40:15.656876+0000","last_clean":"2024-04-25T22:40:15.656876+0000","last_became_active":"2024-04-25T22:40:14.618184+0000","last_became_peered":"2024-04-25T22:40:14.618184+0000","last_unstale":"2024-04-25T22:40:15.656876+0000","last_undegraded":"2024-04-25T22:40:15.656876+0000","last_fullsized":"2024-04-25T22:40:15.656876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:34:40.281445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659068+0000","last_change":"2024-04-25T22:40:14.622357+0000","last_active":"2024-04-25T22:40:15.659068+0000","last_peered":"2024-04-25T22:40:15.659068+0000","last_clean":"2024-04-25T22:40:15.659068+0000","last_became_active":"2024-04-25T22:40:14.621617+0000","last_became_peered":"2024-04-25T22:40:14.621617+0000","last_unstale":"2024-04-25T22:40:15.659068+0000","last_undegraded":"2024-04-25T22:40:15.659068+0000","last_fullsized":"2024-04-25T22:40:15.659068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615978+0000","last_change":"2024-04-25T22:40:14.625933+0000","last_active":"2024-04-25T22:40:15.615978+0000","last_peered":"2024-04-25T22:40:15.615978+0000","last_clean":"2024-04-25T22:40:15.615978+0000","last_became_active":"2024-04-25T22:40:14.625123+0000","last_became_peered":"2024-04-25T22:40:14.625123+0000","last_unstale":"2024-04-25T22:40:15.615978+0000","last_undegraded":"2024-04-25T22:40:15.615978+0000","last_fullsized":"2024-04-25T22:40:15.615978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618233+0000","last_change":"2024-04-25T22:40:14.630596+0000","last_active":"2024-04-25T22:40:15.618233+0000","last_peered":"2024-04-25T22:40:15.618233+0000","last_clean":"2024-04-25T22:40:15.618233+0000","last_became_active":"2024-04-25T22:40:14.625407+0000","last_became_peered":"2024-04-25T22:40:14.625407+0000","last_unstale":"2024-04-25T22:40:15.618233+0000","last_undegraded":"2024-04-25T22:40:15.618233+0000","last_fullsized":"2024-04-25T22:40:15.618233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:20:05.398182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658859+0000","last_change":"2024-04-25T22:40:14.636526+0000","last_active":"2024-04-25T22:40:15.658859+0000","last_peered":"2024-04-25T22:40:15.658859+0000","last_clean":"2024-04-25T22:40:15.658859+0000","last_became_active":"2024-04-25T22:40:14.635539+0000","last_became_peered":"2024-04-25T22:40:14.635539+0000","last_unstale":"2024-04-25T22:40:15.658859+0000","last_undegraded":"2024-04-25T22:40:15.658859+0000","last_fullsized":"2024-04-25T22:40:15.658859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614790+0000","last_change":"2024-04-25T22:40:14.620608+0000","last_active":"2024-04-25T22:40:15.614790+0000","last_peered":"2024-04-25T22:40:15.614790+0000","last_clean":"2024-04-25T22:40:15.614790+0000","last_became_active":"2024-04-25T22:40:14.618171+0000","last_became_peered":"2024-04-25T22:40:14.618171+0000","last_unstale":"2024-04-25T22:40:15.614790+0000","last_undegraded":"2024-04-25T22:40:15.614790+0000","last_fullsized":"2024-04-25T22:40:15.614790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657864+0000","last_change":"2024-04-25T22:40:14.622961+0000","last_active":"2024-04-25T22:40:15.657864+0000","last_peered":"2024-04-25T22:40:15.657864+0000","last_clean":"2024-04-25T22:40:15.657864+0000","last_became_active":"2024-04-25T22:40:14.622238+0000","last_became_peered":"2024-04-25T22:40:14.622238+0000","last_unstale":"2024-04-25T22:40:15.657864+0000","last_undegraded":"2024-04-25T22:40:15.657864+0000","last_fullsized":"2024-04-25T22:40:15.657864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:09.125174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.613760+0000","last_change":"2024-04-25T22:40:14.618468+0000","last_active":"2024-04-25T22:40:15.613760+0000","last_peered":"2024-04-25T22:40:15.613760+0000","last_clean":"2024-04-25T22:40:15.613760+0000","last_became_active":"2024-04-25T22:40:14.617312+0000","last_became_peered":"2024-04-25T22:40:14.617312+0000","last_unstale":"2024-04-25T22:40:15.613760+0000","last_undegraded":"2024-04-25T22:40:15.613760+0000","last_fullsized":"2024-04-25T22:40:15.613760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:12.679354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615544+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:40:15.615544+0000","last_peered":"2024-04-25T22:40:15.615544+0000","last_clean":"2024-04-25T22:40:15.615544+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:40:15.615544+0000","last_undegraded":"2024-04-25T22:40:15.615544+0000","last_fullsized":"2024-04-25T22:40:15.615544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658398+0000","last_change":"2024-04-25T22:40:14.613553+0000","last_active":"2024-04-25T22:40:15.658398+0000","last_peered":"2024-04-25T22:40:15.658398+0000","last_clean":"2024-04-25T22:40:15.658398+0000","last_became_active":"2024-04-25T22:40:14.612857+0000","last_became_peered":"2024-04-25T22:40:14.612857+0000","last_unstale":"2024-04-25T22:40:15.658398+0000","last_undegraded":"2024-04-25T22:40:15.658398+0000","last_fullsized":"2024-04-25T22:40:15.658398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617134+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:40:15.617134+0000","last_peered":"2024-04-25T22:40:15.617134+0000","last_clean":"2024-04-25T22:40:15.617134+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:40:15.617134+0000","last_undegraded":"2024-04-25T22:40:15.617134+0000","last_fullsized":"2024-04-25T22:40:15.617134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.660077+0000","last_change":"2024-04-25T22:40:14.618292+0000","last_active":"2024-04-25T22:40:15.660077+0000","last_peered":"2024-04-25T22:40:15.660077+0000","last_clean":"2024-04-25T22:40:15.660077+0000","last_became_active":"2024-04-25T22:40:14.616712+0000","last_became_peered":"2024-04-25T22:40:14.616712+0000","last_unstale":"2024-04-25T22:40:15.660077+0000","last_undegraded":"2024-04-25T22:40:15.660077+0000","last_fullsized":"2024-04-25T22:40:15.660077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614211+0000","last_change":"2024-04-25T22:40:13.581241+0000","last_active":"2024-04-25T22:40:15.614211+0000","last_peered":"2024-04-25T22:40:15.614211+0000","last_clean":"2024-04-25T22:40:15.614211+0000","last_became_active":"2024-04-25T22:40:13.580442+0000","last_became_peered":"2024-04-25T22:40:13.580442+0000","last_unstale":"2024-04-25T22:40:15.614211+0000","last_undegraded":"2024-04-25T22:40:15.614211+0000","last_fullsized":"2024-04-25T22:40:15.614211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:50:49.280995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616561+0000","last_change":"2024-04-25T22:40:14.631577+0000","last_active":"2024-04-25T22:40:15.616561+0000","last_peered":"2024-04-25T22:40:15.616561+0000","last_clean":"2024-04-25T22:40:15.616561+0000","last_became_active":"2024-04-25T22:40:14.630371+0000","last_became_peered":"2024-04-25T22:40:14.630371+0000","last_unstale":"2024-04-25T22:40:15.616561+0000","last_undegraded":"2024-04-25T22:40:15.616561+0000","last_fullsized":"2024-04-25T22:40:15.616561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657258+0000","last_change":"2024-04-25T22:40:13.599838+0000","last_active":"2024-04-25T22:40:15.657258+0000","last_peered":"2024-04-25T22:40:15.657258+0000","last_clean":"2024-04-25T22:40:15.657258+0000","last_became_active":"2024-04-25T22:40:13.599001+0000","last_became_peered":"2024-04-25T22:40:13.599001+0000","last_unstale":"2024-04-25T22:40:15.657258+0000","last_undegraded":"2024-04-25T22:40:15.657258+0000","last_fullsized":"2024-04-25T22:40:15.657258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:16.993188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616081+0000","last_change":"2024-04-25T22:40:14.630012+0000","last_active":"2024-04-25T22:40:15.616081+0000","last_peered":"2024-04-25T22:40:15.616081+0000","last_clean":"2024-04-25T22:40:15.616081+0000","last_became_active":"2024-04-25T22:40:14.628677+0000","last_became_peered":"2024-04-25T22:40:14.628677+0000","last_unstale":"2024-04-25T22:40:15.616081+0000","last_undegraded":"2024-04-25T22:40:15.616081+0000","last_fullsized":"2024-04-25T22:40:15.616081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615558+0000","last_change":"2024-04-25T22:40:13.599918+0000","last_active":"2024-04-25T22:40:15.615558+0000","last_peered":"2024-04-25T22:40:15.615558+0000","last_clean":"2024-04-25T22:40:15.615558+0000","last_became_active":"2024-04-25T22:40:13.596461+0000","last_became_peered":"2024-04-25T22:40:13.596461+0000","last_unstale":"2024-04-25T22:40:15.615558+0000","last_undegraded":"2024-04-25T22:40:15.615558+0000","last_fullsized":"2024-04-25T22:40:15.615558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:41:51.887162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618201+0000","last_change":"2024-04-25T22:40:13.598294+0000","last_active":"2024-04-25T22:40:15.618201+0000","last_peered":"2024-04-25T22:40:15.618201+0000","last_clean":"2024-04-25T22:40:15.618201+0000","last_became_active":"2024-04-25T22:40:13.596687+0000","last_became_peered":"2024-04-25T22:40:13.596687+0000","last_unstale":"2024-04-25T22:40:15.618201+0000","last_undegraded":"2024-04-25T22:40:15.618201+0000","last_fullsized":"2024-04-25T22:40:15.618201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:50:49.280995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.656904+0000","last_change":"2024-04-25T22:40:14.625171+0000","last_active":"2024-04-25T22:40:15.656904+0000","last_peered":"2024-04-25T22:40:15.656904+0000","last_clean":"2024-04-25T22:40:15.656904+0000","last_became_active":"2024-04-25T22:40:14.624473+0000","last_became_peered":"2024-04-25T22:40:14.624473+0000","last_unstale":"2024-04-25T22:40:15.656904+0000","last_undegraded":"2024-04-25T22:40:15.656904+0000","last_fullsized":"2024-04-25T22:40:15.656904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:30.591624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659343+0000","last_change":"2024-04-25T22:40:13.599189+0000","last_active":"2024-04-25T22:40:15.659343+0000","last_peered":"2024-04-25T22:40:15.659343+0000","last_clean":"2024-04-25T22:40:15.659343+0000","last_became_active":"2024-04-25T22:40:13.598289+0000","last_became_peered":"2024-04-25T22:40:13.598289+0000","last_unstale":"2024-04-25T22:40:15.659343+0000","last_undegraded":"2024-04-25T22:40:15.659343+0000","last_fullsized":"2024-04-25T22:40:15.659343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:05:28.535490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657030+0000","last_change":"2024-04-25T22:40:14.618478+0000","last_active":"2024-04-25T22:40:15.657030+0000","last_peered":"2024-04-25T22:40:15.657030+0000","last_clean":"2024-04-25T22:40:15.657030+0000","last_became_active":"2024-04-25T22:40:14.617688+0000","last_became_peered":"2024-04-25T22:40:14.617688+0000","last_unstale":"2024-04-25T22:40:15.657030+0000","last_undegraded":"2024-04-25T22:40:15.657030+0000","last_fullsized":"2024-04-25T22:40:15.657030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:39:44.762240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618805+0000","last_change":"2024-04-25T22:40:13.601404+0000","last_active":"2024-04-25T22:40:15.618805+0000","last_peered":"2024-04-25T22:40:15.618805+0000","last_clean":"2024-04-25T22:40:15.618805+0000","last_became_active":"2024-04-25T22:40:13.600688+0000","last_became_peered":"2024-04-25T22:40:13.600688+0000","last_unstale":"2024-04-25T22:40:15.618805+0000","last_undegraded":"2024-04-25T22:40:15.618805+0000","last_fullsized":"2024-04-25T22:40:15.618805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:36.157648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616497+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:40:15.616497+0000","last_peered":"2024-04-25T22:40:15.616497+0000","last_clean":"2024-04-25T22:40:15.616497+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:40:15.616497+0000","last_undegraded":"2024-04-25T22:40:15.616497+0000","last_fullsized":"2024-04-25T22:40:15.616497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617642+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:40:15.617642+0000","last_peered":"2024-04-25T22:40:15.617642+0000","last_clean":"2024-04-25T22:40:15.617642+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:40:15.617642+0000","last_undegraded":"2024-04-25T22:40:15.617642+0000","last_fullsized":"2024-04-25T22:40:15.617642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615001+0000","last_change":"2024-04-25T22:40:14.625843+0000","last_active":"2024-04-25T22:40:15.615001+0000","last_peered":"2024-04-25T22:40:15.615001+0000","last_clean":"2024-04-25T22:40:15.615001+0000","last_became_active":"2024-04-25T22:40:14.625187+0000","last_became_peered":"2024-04-25T22:40:14.625187+0000","last_unstale":"2024-04-25T22:40:15.615001+0000","last_undegraded":"2024-04-25T22:40:15.615001+0000","last_fullsized":"2024-04-25T22:40:15.615001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615306+0000","last_change":"2024-04-25T22:40:13.581857+0000","last_active":"2024-04-25T22:40:15.615306+0000","last_peered":"2024-04-25T22:40:15.615306+0000","last_clean":"2024-04-25T22:40:15.615306+0000","last_became_active":"2024-04-25T22:40:13.581263+0000","last_became_peered":"2024-04-25T22:40:13.581263+0000","last_unstale":"2024-04-25T22:40:15.615306+0000","last_undegraded":"2024-04-25T22:40:15.615306+0000","last_fullsized":"2024-04-25T22:40:15.615306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:54:01.709709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617001+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:40:15.617001+0000","last_peered":"2024-04-25T22:40:15.617001+0000","last_clean":"2024-04-25T22:40:15.617001+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:40:15.617001+0000","last_undegraded":"2024-04-25T22:40:15.617001+0000","last_fullsized":"2024-04-25T22:40:15.617001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616780+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:40:15.616780+0000","last_peered":"2024-04-25T22:40:15.616780+0000","last_clean":"2024-04-25T22:40:15.616780+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:40:15.616780+0000","last_undegraded":"2024-04-25T22:40:15.616780+0000","last_fullsized":"2024-04-25T22:40:15.616780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618553+0000","last_change":"2024-04-25T22:40:14.621941+0000","last_active":"2024-04-25T22:40:15.618553+0000","last_peered":"2024-04-25T22:40:15.618553+0000","last_clean":"2024-04-25T22:40:15.618553+0000","last_became_active":"2024-04-25T22:40:14.614196+0000","last_became_peered":"2024-04-25T22:40:14.614196+0000","last_unstale":"2024-04-25T22:40:15.618553+0000","last_undegraded":"2024-04-25T22:40:15.618553+0000","last_fullsized":"2024-04-25T22:40:15.618553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:24.895025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657287+0000","last_change":"2024-04-25T22:40:13.599695+0000","last_active":"2024-04-25T22:40:15.657287+0000","last_peered":"2024-04-25T22:40:15.657287+0000","last_clean":"2024-04-25T22:40:15.657287+0000","last_became_active":"2024-04-25T22:40:13.598805+0000","last_became_peered":"2024-04-25T22:40:13.598805+0000","last_unstale":"2024-04-25T22:40:15.657287+0000","last_undegraded":"2024-04-25T22:40:15.657287+0000","last_fullsized":"2024-04-25T22:40:15.657287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:56.307032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617569+0000","last_change":"2024-04-25T22:40:14.614275+0000","last_active":"2024-04-25T22:40:15.617569+0000","last_peered":"2024-04-25T22:40:15.617569+0000","last_clean":"2024-04-25T22:40:15.617569+0000","last_became_active":"2024-04-25T22:40:14.613038+0000","last_became_peered":"2024-04-25T22:40:14.613038+0000","last_unstale":"2024-04-25T22:40:15.617569+0000","last_undegraded":"2024-04-25T22:40:15.617569+0000","last_fullsized":"2024-04-25T22:40:15.617569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:14:02.343388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657203+0000","last_change":"2024-04-25T22:40:13.597555+0000","last_active":"2024-04-25T22:40:15.657203+0000","last_peered":"2024-04-25T22:40:15.657203+0000","last_clean":"2024-04-25T22:40:15.657203+0000","last_became_active":"2024-04-25T22:40:13.596623+0000","last_became_peered":"2024-04-25T22:40:13.596623+0000","last_unstale":"2024-04-25T22:40:15.657203+0000","last_undegraded":"2024-04-25T22:40:15.657203+0000","last_fullsized":"2024-04-25T22:40:15.657203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:29:00.157478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616173+0000","last_change":"2024-04-25T22:40:14.627280+0000","last_active":"2024-04-25T22:40:15.616173+0000","last_peered":"2024-04-25T22:40:15.616173+0000","last_clean":"2024-04-25T22:40:15.616173+0000","last_became_active":"2024-04-25T22:40:14.624656+0000","last_became_peered":"2024-04-25T22:40:14.624656+0000","last_unstale":"2024-04-25T22:40:15.616173+0000","last_undegraded":"2024-04-25T22:40:15.616173+0000","last_fullsized":"2024-04-25T22:40:15.616173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":222,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616001+0000","last_change":"2024-04-25T22:40:04.317146+0000","last_active":"2024-04-25T22:40:15.616001+0000","last_peered":"2024-04-25T22:40:15.616001+0000","last_clean":"2024-04-25T22:40:15.616001+0000","last_became_active":"2024-04-25T22:40:04.316527+0000","last_became_peered":"2024-04-25T22:40:04.316527+0000","last_unstale":"2024-04-25T22:40:15.616001+0000","last_undegraded":"2024-04-25T22:40:15.616001+0000","last_fullsized":"2024-04-25T22:40:15.616001+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:25.669997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617484+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:40:15.617484+0000","last_peered":"2024-04-25T22:40:15.617484+0000","last_clean":"2024-04-25T22:40:15.617484+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:40:15.617484+0000","last_undegraded":"2024-04-25T22:40:15.617484+0000","last_fullsized":"2024-04-25T22:40:15.617484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614355+0000","last_change":"2024-04-25T22:40:13.591980+0000","last_active":"2024-04-25T22:40:15.614355+0000","last_peered":"2024-04-25T22:40:15.614355+0000","last_clean":"2024-04-25T22:40:15.614355+0000","last_became_active":"2024-04-25T22:40:13.591152+0000","last_became_peered":"2024-04-25T22:40:13.591152+0000","last_unstale":"2024-04-25T22:40:15.614355+0000","last_undegraded":"2024-04-25T22:40:15.614355+0000","last_fullsized":"2024-04-25T22:40:15.614355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618637+0000","last_change":"2024-04-25T22:40:14.621472+0000","last_active":"2024-04-25T22:40:15.618637+0000","last_peered":"2024-04-25T22:40:15.618637+0000","last_clean":"2024-04-25T22:40:15.618637+0000","last_became_active":"2024-04-25T22:40:14.613608+0000","last_became_peered":"2024-04-25T22:40:14.613608+0000","last_unstale":"2024-04-25T22:40:15.618637+0000","last_undegraded":"2024-04-25T22:40:15.618637+0000","last_fullsized":"2024-04-25T22:40:15.618637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:51.686908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615728+0000","last_change":"2024-04-25T22:40:09.502444+0000","last_active":"2024-04-25T22:40:15.615728+0000","last_peered":"2024-04-25T22:40:15.615728+0000","last_clean":"2024-04-25T22:40:15.615728+0000","last_became_active":"2024-04-25T22:40:09.501576+0000","last_became_peered":"2024-04-25T22:40:09.501576+0000","last_unstale":"2024-04-25T22:40:15.615728+0000","last_undegraded":"2024-04-25T22:40:15.615728+0000","last_fullsized":"2024-04-25T22:40:15.615728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:35:14.955359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614468+0000","last_change":"2024-04-25T22:40:13.579430+0000","last_active":"2024-04-25T22:40:15.614468+0000","last_peered":"2024-04-25T22:40:15.614468+0000","last_clean":"2024-04-25T22:40:15.614468+0000","last_became_active":"2024-04-25T22:40:13.578601+0000","last_became_peered":"2024-04-25T22:40:13.578601+0000","last_unstale":"2024-04-25T22:40:15.614468+0000","last_undegraded":"2024-04-25T22:40:15.614468+0000","last_fullsized":"2024-04-25T22:40:15.614468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:50.274924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658863+0000","last_change":"2024-04-25T22:40:14.628709+0000","last_active":"2024-04-25T22:40:15.658863+0000","last_peered":"2024-04-25T22:40:15.658863+0000","last_clean":"2024-04-25T22:40:15.658863+0000","last_became_active":"2024-04-25T22:40:14.627641+0000","last_became_peered":"2024-04-25T22:40:14.627641+0000","last_unstale":"2024-04-25T22:40:15.658863+0000","last_undegraded":"2024-04-25T22:40:15.658863+0000","last_fullsized":"2024-04-25T22:40:15.658863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614614+0000","last_change":"2024-04-25T22:40:09.501323+0000","last_active":"2024-04-25T22:40:15.614614+0000","last_peered":"2024-04-25T22:40:15.614614+0000","last_clean":"2024-04-25T22:40:15.614614+0000","last_became_active":"2024-04-25T22:40:09.500499+0000","last_became_peered":"2024-04-25T22:40:09.500499+0000","last_unstale":"2024-04-25T22:40:15.614614+0000","last_undegraded":"2024-04-25T22:40:15.614614+0000","last_fullsized":"2024-04-25T22:40:15.614614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:30.289572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657249+0000","last_change":"2024-04-25T22:40:13.599332+0000","last_active":"2024-04-25T22:40:15.657249+0000","last_peered":"2024-04-25T22:40:15.657249+0000","last_clean":"2024-04-25T22:40:15.657249+0000","last_became_active":"2024-04-25T22:40:13.598689+0000","last_became_peered":"2024-04-25T22:40:13.598689+0000","last_unstale":"2024-04-25T22:40:15.657249+0000","last_undegraded":"2024-04-25T22:40:15.657249+0000","last_fullsized":"2024-04-25T22:40:15.657249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:36.875346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616453+0000","last_change":"2024-04-25T22:40:14.628007+0000","last_active":"2024-04-25T22:40:15.616453+0000","last_peered":"2024-04-25T22:40:15.616453+0000","last_clean":"2024-04-25T22:40:15.616453+0000","last_became_active":"2024-04-25T22:40:14.625425+0000","last_became_peered":"2024-04-25T22:40:14.625425+0000","last_unstale":"2024-04-25T22:40:15.616453+0000","last_undegraded":"2024-04-25T22:40:15.616453+0000","last_fullsized":"2024-04-25T22:40:15.616453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616734+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:40:15.616734+0000","last_peered":"2024-04-25T22:40:15.616734+0000","last_clean":"2024-04-25T22:40:15.616734+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:40:15.616734+0000","last_undegraded":"2024-04-25T22:40:15.616734+0000","last_fullsized":"2024-04-25T22:40:15.616734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617401+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:40:15.617401+0000","last_peered":"2024-04-25T22:40:15.617401+0000","last_clean":"2024-04-25T22:40:15.617401+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:40:15.617401+0000","last_undegraded":"2024-04-25T22:40:15.617401+0000","last_fullsized":"2024-04-25T22:40:15.617401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615641+0000","last_change":"2024-04-25T22:40:14.622442+0000","last_active":"2024-04-25T22:40:15.615641+0000","last_peered":"2024-04-25T22:40:15.615641+0000","last_clean":"2024-04-25T22:40:15.615641+0000","last_became_active":"2024-04-25T22:40:14.621130+0000","last_became_peered":"2024-04-25T22:40:14.621130+0000","last_unstale":"2024-04-25T22:40:15.615641+0000","last_undegraded":"2024-04-25T22:40:15.615641+0000","last_fullsized":"2024-04-25T22:40:15.615641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618860+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:40:15.618860+0000","last_peered":"2024-04-25T22:40:15.618860+0000","last_clean":"2024-04-25T22:40:15.618860+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:40:15.618860+0000","last_undegraded":"2024-04-25T22:40:15.618860+0000","last_fullsized":"2024-04-25T22:40:15.618860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615725+0000","last_change":"2024-04-25T22:40:09.501325+0000","last_active":"2024-04-25T22:40:15.615725+0000","last_peered":"2024-04-25T22:40:15.615725+0000","last_clean":"2024-04-25T22:40:15.615725+0000","last_became_active":"2024-04-25T22:40:09.500542+0000","last_became_peered":"2024-04-25T22:40:09.500542+0000","last_unstale":"2024-04-25T22:40:15.615725+0000","last_undegraded":"2024-04-25T22:40:15.615725+0000","last_fullsized":"2024-04-25T22:40:15.615725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:34:38.234538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657224+0000","last_change":"2024-04-25T22:40:14.636726+0000","last_active":"2024-04-25T22:40:15.657224+0000","last_peered":"2024-04-25T22:40:15.657224+0000","last_clean":"2024-04-25T22:40:15.657224+0000","last_became_active":"2024-04-25T22:40:14.636013+0000","last_became_peered":"2024-04-25T22:40:14.636013+0000","last_unstale":"2024-04-25T22:40:15.657224+0000","last_undegraded":"2024-04-25T22:40:15.657224+0000","last_fullsized":"2024-04-25T22:40:15.657224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:35.910752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615587+0000","last_change":"2024-04-25T22:40:13.591256+0000","last_active":"2024-04-25T22:40:15.615587+0000","last_peered":"2024-04-25T22:40:15.615587+0000","last_clean":"2024-04-25T22:40:15.615587+0000","last_became_active":"2024-04-25T22:40:13.590744+0000","last_became_peered":"2024-04-25T22:40:13.590744+0000","last_unstale":"2024-04-25T22:40:15.615587+0000","last_undegraded":"2024-04-25T22:40:15.615587+0000","last_fullsized":"2024-04-25T22:40:15.615587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:50.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.660294+0000","last_change":"2024-04-25T22:40:09.501163+0000","last_active":"2024-04-25T22:40:15.660294+0000","last_peered":"2024-04-25T22:40:15.660294+0000","last_clean":"2024-04-25T22:40:15.660294+0000","last_became_active":"2024-04-25T22:40:09.500492+0000","last_became_peered":"2024-04-25T22:40:09.500492+0000","last_unstale":"2024-04-25T22:40:15.660294+0000","last_undegraded":"2024-04-25T22:40:15.660294+0000","last_fullsized":"2024-04-25T22:40:15.660294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:22.822616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658264+0000","last_change":"2024-04-25T22:40:14.638662+0000","last_active":"2024-04-25T22:40:15.658264+0000","last_peered":"2024-04-25T22:40:15.658264+0000","last_clean":"2024-04-25T22:40:15.658264+0000","last_became_active":"2024-04-25T22:40:14.638060+0000","last_became_peered":"2024-04-25T22:40:14.638060+0000","last_unstale":"2024-04-25T22:40:15.658264+0000","last_undegraded":"2024-04-25T22:40:15.658264+0000","last_fullsized":"2024-04-25T22:40:15.658264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:12.679354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616939+0000","last_change":"2024-04-25T22:40:13.592055+0000","last_active":"2024-04-25T22:40:15.616939+0000","last_peered":"2024-04-25T22:40:15.616939+0000","last_clean":"2024-04-25T22:40:15.616939+0000","last_became_active":"2024-04-25T22:40:13.591169+0000","last_became_peered":"2024-04-25T22:40:13.591169+0000","last_unstale":"2024-04-25T22:40:15.616939+0000","last_undegraded":"2024-04-25T22:40:15.616939+0000","last_fullsized":"2024-04-25T22:40:15.616939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:33.458799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616687+0000","last_change":"2024-04-25T22:40:09.501358+0000","last_active":"2024-04-25T22:40:15.616687+0000","last_peered":"2024-04-25T22:40:15.616687+0000","last_clean":"2024-04-25T22:40:15.616687+0000","last_became_active":"2024-04-25T22:40:09.500626+0000","last_became_peered":"2024-04-25T22:40:09.500626+0000","last_unstale":"2024-04-25T22:40:15.616687+0000","last_undegraded":"2024-04-25T22:40:15.616687+0000","last_fullsized":"2024-04-25T22:40:15.616687+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:55.182967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.613952+0000","last_change":"2024-04-25T22:40:14.618363+0000","last_active":"2024-04-25T22:40:15.613952+0000","last_peered":"2024-04-25T22:40:15.613952+0000","last_clean":"2024-04-25T22:40:15.613952+0000","last_became_active":"2024-04-25T22:40:14.617599+0000","last_became_peered":"2024-04-25T22:40:14.617599+0000","last_unstale":"2024-04-25T22:40:15.613952+0000","last_undegraded":"2024-04-25T22:40:15.613952+0000","last_fullsized":"2024-04-25T22:40:15.613952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:16.594231+0000","last_change":"2024-04-25T22:40:13.593400+0000","last_active":"2024-04-25T22:40:16.594231+0000","last_peered":"2024-04-25T22:40:16.594231+0000","last_clean":"2024-04-25T22:40:16.594231+0000","last_became_active":"2024-04-25T22:40:13.592338+0000","last_became_peered":"2024-04-25T22:40:13.592338+0000","last_unstale":"2024-04-25T22:40:16.594231+0000","last_undegraded":"2024-04-25T22:40:16.594231+0000","last_fullsized":"2024-04-25T22:40:16.594231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618220+0000","last_change":"2024-04-25T22:40:09.500948+0000","last_active":"2024-04-25T22:40:15.618220+0000","last_peered":"2024-04-25T22:40:15.618220+0000","last_clean":"2024-04-25T22:40:15.618220+0000","last_became_active":"2024-04-25T22:40:09.500236+0000","last_became_peered":"2024-04-25T22:40:09.500236+0000","last_unstale":"2024-04-25T22:40:15.618220+0000","last_undegraded":"2024-04-25T22:40:15.618220+0000","last_fullsized":"2024-04-25T22:40:15.618220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:02.375961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657009+0000","last_change":"2024-04-25T22:40:14.623882+0000","last_active":"2024-04-25T22:40:15.657009+0000","last_peered":"2024-04-25T22:40:15.657009+0000","last_clean":"2024-04-25T22:40:15.657009+0000","last_became_active":"2024-04-25T22:40:14.623090+0000","last_became_peered":"2024-04-25T22:40:14.623090+0000","last_unstale":"2024-04-25T22:40:15.657009+0000","last_undegraded":"2024-04-25T22:40:15.657009+0000","last_fullsized":"2024-04-25T22:40:15.657009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:52.116132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616663+0000","last_change":"2024-04-25T22:40:14.619806+0000","last_active":"2024-04-25T22:40:15.616663+0000","last_peered":"2024-04-25T22:40:15.616663+0000","last_clean":"2024-04-25T22:40:15.616663+0000","last_became_active":"2024-04-25T22:40:14.618980+0000","last_became_peered":"2024-04-25T22:40:14.618980+0000","last_unstale":"2024-04-25T22:40:15.616663+0000","last_undegraded":"2024-04-25T22:40:15.616663+0000","last_fullsized":"2024-04-25T22:40:15.616663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617318+0000","last_change":"2024-04-25T22:40:13.598003+0000","last_active":"2024-04-25T22:40:15.617318+0000","last_peered":"2024-04-25T22:40:15.617318+0000","last_clean":"2024-04-25T22:40:15.617318+0000","last_became_active":"2024-04-25T22:40:13.596631+0000","last_became_peered":"2024-04-25T22:40:13.596631+0000","last_unstale":"2024-04-25T22:40:15.617318+0000","last_undegraded":"2024-04-25T22:40:15.617318+0000","last_fullsized":"2024-04-25T22:40:15.617318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:50.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614024+0000","last_change":"2024-04-25T22:40:14.620064+0000","last_active":"2024-04-25T22:40:15.614024+0000","last_peered":"2024-04-25T22:40:15.614024+0000","last_clean":"2024-04-25T22:40:15.614024+0000","last_became_active":"2024-04-25T22:40:14.619294+0000","last_became_peered":"2024-04-25T22:40:14.619294+0000","last_unstale":"2024-04-25T22:40:15.614024+0000","last_undegraded":"2024-04-25T22:40:15.614024+0000","last_fullsized":"2024-04-25T22:40:15.614024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.660194+0000","last_change":"2024-04-25T22:40:13.600050+0000","last_active":"2024-04-25T22:40:15.660194+0000","last_peered":"2024-04-25T22:40:15.660194+0000","last_clean":"2024-04-25T22:40:15.660194+0000","last_became_active":"2024-04-25T22:40:13.599138+0000","last_became_peered":"2024-04-25T22:40:13.599138+0000","last_unstale":"2024-04-25T22:40:15.660194+0000","last_undegraded":"2024-04-25T22:40:15.660194+0000","last_fullsized":"2024-04-25T22:40:15.660194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:36.847491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618448+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:40:15.618448+0000","last_peered":"2024-04-25T22:40:15.618448+0000","last_clean":"2024-04-25T22:40:15.618448+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:40:15.618448+0000","last_undegraded":"2024-04-25T22:40:15.618448+0000","last_fullsized":"2024-04-25T22:40:15.618448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614160+0000","last_change":"2024-04-25T22:40:14.627868+0000","last_active":"2024-04-25T22:40:15.614160+0000","last_peered":"2024-04-25T22:40:15.614160+0000","last_clean":"2024-04-25T22:40:15.614160+0000","last_became_active":"2024-04-25T22:40:14.626388+0000","last_became_peered":"2024-04-25T22:40:14.626388+0000","last_unstale":"2024-04-25T22:40:15.614160+0000","last_undegraded":"2024-04-25T22:40:15.614160+0000","last_fullsized":"2024-04-25T22:40:15.614160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616733+0000","last_change":"2024-04-25T22:40:13.593378+0000","last_active":"2024-04-25T22:40:15.616733+0000","last_peered":"2024-04-25T22:40:15.616733+0000","last_clean":"2024-04-25T22:40:15.616733+0000","last_became_active":"2024-04-25T22:40:13.592392+0000","last_became_peered":"2024-04-25T22:40:13.592392+0000","last_unstale":"2024-04-25T22:40:15.616733+0000","last_undegraded":"2024-04-25T22:40:15.616733+0000","last_fullsized":"2024-04-25T22:40:15.616733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.613799+0000","last_change":"2024-04-25T22:40:14.619640+0000","last_active":"2024-04-25T22:40:15.613799+0000","last_peered":"2024-04-25T22:40:15.613799+0000","last_clean":"2024-04-25T22:40:15.613799+0000","last_became_active":"2024-04-25T22:40:14.618088+0000","last_became_peered":"2024-04-25T22:40:14.618088+0000","last_unstale":"2024-04-25T22:40:15.613799+0000","last_undegraded":"2024-04-25T22:40:15.613799+0000","last_fullsized":"2024-04-25T22:40:15.613799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:58.322470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659293+0000","last_change":"2024-04-25T22:40:14.622624+0000","last_active":"2024-04-25T22:40:15.659293+0000","last_peered":"2024-04-25T22:40:15.659293+0000","last_clean":"2024-04-25T22:40:15.659293+0000","last_became_active":"2024-04-25T22:40:14.621883+0000","last_became_peered":"2024-04-25T22:40:14.621883+0000","last_unstale":"2024-04-25T22:40:15.659293+0000","last_undegraded":"2024-04-25T22:40:15.659293+0000","last_fullsized":"2024-04-25T22:40:15.659293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614104+0000","last_change":"2024-04-25T22:40:13.588577+0000","last_active":"2024-04-25T22:40:15.614104+0000","last_peered":"2024-04-25T22:40:15.614104+0000","last_clean":"2024-04-25T22:40:15.614104+0000","last_became_active":"2024-04-25T22:40:13.588019+0000","last_became_peered":"2024-04-25T22:40:13.588019+0000","last_unstale":"2024-04-25T22:40:15.614104+0000","last_undegraded":"2024-04-25T22:40:15.614104+0000","last_fullsized":"2024-04-25T22:40:15.614104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:07.743396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616085+0000","last_change":"2024-04-25T22:40:14.630597+0000","last_active":"2024-04-25T22:40:15.616085+0000","last_peered":"2024-04-25T22:40:15.616085+0000","last_clean":"2024-04-25T22:40:15.616085+0000","last_became_active":"2024-04-25T22:40:14.628981+0000","last_became_peered":"2024-04-25T22:40:14.628981+0000","last_unstale":"2024-04-25T22:40:15.616085+0000","last_undegraded":"2024-04-25T22:40:15.616085+0000","last_fullsized":"2024-04-25T22:40:15.616085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614326+0000","last_change":"2024-04-25T22:40:13.581827+0000","last_active":"2024-04-25T22:40:15.614326+0000","last_peered":"2024-04-25T22:40:15.614326+0000","last_clean":"2024-04-25T22:40:15.614326+0000","last_became_active":"2024-04-25T22:40:13.581166+0000","last_became_peered":"2024-04-25T22:40:13.581166+0000","last_unstale":"2024-04-25T22:40:15.614326+0000","last_undegraded":"2024-04-25T22:40:15.614326+0000","last_fullsized":"2024-04-25T22:40:15.614326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659335+0000","last_change":"2024-04-25T22:40:14.636300+0000","last_active":"2024-04-25T22:40:15.659335+0000","last_peered":"2024-04-25T22:40:15.659335+0000","last_clean":"2024-04-25T22:40:15.659335+0000","last_became_active":"2024-04-25T22:40:14.635200+0000","last_became_peered":"2024-04-25T22:40:14.635200+0000","last_unstale":"2024-04-25T22:40:15.659335+0000","last_undegraded":"2024-04-25T22:40:15.659335+0000","last_fullsized":"2024-04-25T22:40:15.659335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657711+0000","last_change":"2024-04-25T22:40:13.597736+0000","last_active":"2024-04-25T22:40:15.657711+0000","last_peered":"2024-04-25T22:40:15.657711+0000","last_clean":"2024-04-25T22:40:15.657711+0000","last_became_active":"2024-04-25T22:40:13.596811+0000","last_became_peered":"2024-04-25T22:40:13.596811+0000","last_unstale":"2024-04-25T22:40:15.657711+0000","last_undegraded":"2024-04-25T22:40:15.657711+0000","last_fullsized":"2024-04-25T22:40:15.657711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:14:39.783367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658355+0000","last_change":"2024-04-25T22:40:14.616725+0000","last_active":"2024-04-25T22:40:15.658355+0000","last_peered":"2024-04-25T22:40:15.658355+0000","last_clean":"2024-04-25T22:40:15.658355+0000","last_became_active":"2024-04-25T22:40:14.615881+0000","last_became_peered":"2024-04-25T22:40:14.615881+0000","last_unstale":"2024-04-25T22:40:15.658355+0000","last_undegraded":"2024-04-25T22:40:15.658355+0000","last_fullsized":"2024-04-25T22:40:15.658355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658755+0000","last_change":"2024-04-25T22:40:13.594299+0000","last_active":"2024-04-25T22:40:15.658755+0000","last_peered":"2024-04-25T22:40:15.658755+0000","last_clean":"2024-04-25T22:40:15.658755+0000","last_became_active":"2024-04-25T22:40:13.593477+0000","last_became_peered":"2024-04-25T22:40:13.593477+0000","last_unstale":"2024-04-25T22:40:15.658755+0000","last_undegraded":"2024-04-25T22:40:15.658755+0000","last_fullsized":"2024-04-25T22:40:15.658755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:55.181892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616518+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:40:15.616518+0000","last_peered":"2024-04-25T22:40:15.616518+0000","last_clean":"2024-04-25T22:40:15.616518+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:40:15.616518+0000","last_undegraded":"2024-04-25T22:40:15.616518+0000","last_fullsized":"2024-04-25T22:40:15.616518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617388+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:40:15.617388+0000","last_peered":"2024-04-25T22:40:15.617388+0000","last_clean":"2024-04-25T22:40:15.617388+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:40:15.617388+0000","last_undegraded":"2024-04-25T22:40:15.617388+0000","last_fullsized":"2024-04-25T22:40:15.617388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616444+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:40:15.616444+0000","last_peered":"2024-04-25T22:40:15.616444+0000","last_clean":"2024-04-25T22:40:15.616444+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:40:15.616444+0000","last_undegraded":"2024-04-25T22:40:15.616444+0000","last_fullsized":"2024-04-25T22:40:15.616444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659592+0000","last_change":"2024-04-25T22:40:13.600784+0000","last_active":"2024-04-25T22:40:15.659592+0000","last_peered":"2024-04-25T22:40:15.659592+0000","last_clean":"2024-04-25T22:40:15.659592+0000","last_became_active":"2024-04-25T22:40:13.600104+0000","last_became_peered":"2024-04-25T22:40:13.600104+0000","last_unstale":"2024-04-25T22:40:15.659592+0000","last_undegraded":"2024-04-25T22:40:15.659592+0000","last_fullsized":"2024-04-25T22:40:15.659592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:54.861491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658308+0000","last_change":"2024-04-25T22:40:14.618046+0000","last_active":"2024-04-25T22:40:15.658308+0000","last_peered":"2024-04-25T22:40:15.658308+0000","last_clean":"2024-04-25T22:40:15.658308+0000","last_became_active":"2024-04-25T22:40:14.616356+0000","last_became_peered":"2024-04-25T22:40:14.616356+0000","last_unstale":"2024-04-25T22:40:15.658308+0000","last_undegraded":"2024-04-25T22:40:15.658308+0000","last_fullsized":"2024-04-25T22:40:15.658308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:58.322470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616346+0000","last_change":"2024-04-25T22:40:13.594172+0000","last_active":"2024-04-25T22:40:15.616346+0000","last_peered":"2024-04-25T22:40:15.616346+0000","last_clean":"2024-04-25T22:40:15.616346+0000","last_became_active":"2024-04-25T22:40:13.593428+0000","last_became_peered":"2024-04-25T22:40:13.593428+0000","last_unstale":"2024-04-25T22:40:15.616346+0000","last_undegraded":"2024-04-25T22:40:15.616346+0000","last_fullsized":"2024-04-25T22:40:15.616346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:41:51.887162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616499+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:40:15.616499+0000","last_peered":"2024-04-25T22:40:15.616499+0000","last_clean":"2024-04-25T22:40:15.616499+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:40:15.616499+0000","last_undegraded":"2024-04-25T22:40:15.616499+0000","last_fullsized":"2024-04-25T22:40:15.616499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616446+0000","last_change":"2024-04-25T22:40:13.593659+0000","last_active":"2024-04-25T22:40:15.616446+0000","last_peered":"2024-04-25T22:40:15.616446+0000","last_clean":"2024-04-25T22:40:15.616446+0000","last_became_active":"2024-04-25T22:40:13.592874+0000","last_became_peered":"2024-04-25T22:40:13.592874+0000","last_unstale":"2024-04-25T22:40:15.616446+0000","last_undegraded":"2024-04-25T22:40:15.616446+0000","last_fullsized":"2024-04-25T22:40:15.616446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":58349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":782336,"data_stored":649895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":790528,"data_stored":650511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:40:25.760 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:40:26.091 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:26.093 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:40:26.107 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-04-25T22:40:25.122918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91088,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024432,"statfs":{"total":289910292480,"available":289817018368,"internally_reserved":0,"allocated":1744896,"data_stored":1358755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002598"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658899+0000","last_change":"2024-04-25T22:40:14.619087+0000","last_active":"2024-04-25T22:40:15.658899+0000","last_peered":"2024-04-25T22:40:15.658899+0000","last_clean":"2024-04-25T22:40:15.658899+0000","last_became_active":"2024-04-25T22:40:14.618067+0000","last_became_peered":"2024-04-25T22:40:14.618067+0000","last_unstale":"2024-04-25T22:40:15.658899+0000","last_undegraded":"2024-04-25T22:40:15.658899+0000","last_fullsized":"2024-04-25T22:40:15.658899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658764+0000","last_change":"2024-04-25T22:40:14.631180+0000","last_active":"2024-04-25T22:40:15.658764+0000","last_peered":"2024-04-25T22:40:15.658764+0000","last_clean":"2024-04-25T22:40:15.658764+0000","last_became_active":"2024-04-25T22:40:14.630146+0000","last_became_peered":"2024-04-25T22:40:14.630146+0000","last_unstale":"2024-04-25T22:40:15.658764+0000","last_undegraded":"2024-04-25T22:40:15.658764+0000","last_fullsized":"2024-04-25T22:40:15.658764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617601+0000","last_change":"2024-04-25T22:40:14.626211+0000","last_active":"2024-04-25T22:40:15.617601+0000","last_peered":"2024-04-25T22:40:15.617601+0000","last_clean":"2024-04-25T22:40:15.617601+0000","last_became_active":"2024-04-25T22:40:14.622625+0000","last_became_peered":"2024-04-25T22:40:14.622625+0000","last_unstale":"2024-04-25T22:40:15.617601+0000","last_undegraded":"2024-04-25T22:40:15.617601+0000","last_fullsized":"2024-04-25T22:40:15.617601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:35.993000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616593+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:40:15.616593+0000","last_peered":"2024-04-25T22:40:15.616593+0000","last_clean":"2024-04-25T22:40:15.616593+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:40:15.616593+0000","last_undegraded":"2024-04-25T22:40:15.616593+0000","last_fullsized":"2024-04-25T22:40:15.616593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659167+0000","last_change":"2024-04-25T22:40:14.616641+0000","last_active":"2024-04-25T22:40:15.659167+0000","last_peered":"2024-04-25T22:40:15.659167+0000","last_clean":"2024-04-25T22:40:15.659167+0000","last_became_active":"2024-04-25T22:40:14.615875+0000","last_became_peered":"2024-04-25T22:40:14.615875+0000","last_unstale":"2024-04-25T22:40:15.659167+0000","last_undegraded":"2024-04-25T22:40:15.659167+0000","last_fullsized":"2024-04-25T22:40:15.659167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615808+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:40:15.615808+0000","last_peered":"2024-04-25T22:40:15.615808+0000","last_clean":"2024-04-25T22:40:15.615808+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:40:15.615808+0000","last_undegraded":"2024-04-25T22:40:15.615808+0000","last_fullsized":"2024-04-25T22:40:15.615808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615514+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:40:15.615514+0000","last_peered":"2024-04-25T22:40:15.615514+0000","last_clean":"2024-04-25T22:40:15.615514+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:40:15.615514+0000","last_undegraded":"2024-04-25T22:40:15.615514+0000","last_fullsized":"2024-04-25T22:40:15.615514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615069+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:40:15.615069+0000","last_peered":"2024-04-25T22:40:15.615069+0000","last_clean":"2024-04-25T22:40:15.615069+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:40:15.615069+0000","last_undegraded":"2024-04-25T22:40:15.615069+0000","last_fullsized":"2024-04-25T22:40:15.615069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615789+0000","last_change":"2024-04-25T22:40:14.625922+0000","last_active":"2024-04-25T22:40:15.615789+0000","last_peered":"2024-04-25T22:40:15.615789+0000","last_clean":"2024-04-25T22:40:15.615789+0000","last_became_active":"2024-04-25T22:40:14.624594+0000","last_became_peered":"2024-04-25T22:40:14.624594+0000","last_unstale":"2024-04-25T22:40:15.615789+0000","last_undegraded":"2024-04-25T22:40:15.615789+0000","last_fullsized":"2024-04-25T22:40:15.615789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658392+0000","last_change":"2024-04-25T22:40:14.630083+0000","last_active":"2024-04-25T22:40:15.658392+0000","last_peered":"2024-04-25T22:40:15.658392+0000","last_clean":"2024-04-25T22:40:15.658392+0000","last_became_active":"2024-04-25T22:40:14.628633+0000","last_became_peered":"2024-04-25T22:40:14.628633+0000","last_unstale":"2024-04-25T22:40:15.658392+0000","last_undegraded":"2024-04-25T22:40:15.658392+0000","last_fullsized":"2024-04-25T22:40:15.658392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617428+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:40:15.617428+0000","last_peered":"2024-04-25T22:40:15.617428+0000","last_clean":"2024-04-25T22:40:15.617428+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:40:15.617428+0000","last_undegraded":"2024-04-25T22:40:15.617428+0000","last_fullsized":"2024-04-25T22:40:15.617428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657925+0000","last_change":"2024-04-25T22:40:14.636539+0000","last_active":"2024-04-25T22:40:15.657925+0000","last_peered":"2024-04-25T22:40:15.657925+0000","last_clean":"2024-04-25T22:40:15.657925+0000","last_became_active":"2024-04-25T22:40:14.635508+0000","last_became_peered":"2024-04-25T22:40:14.635508+0000","last_unstale":"2024-04-25T22:40:15.657925+0000","last_undegraded":"2024-04-25T22:40:15.657925+0000","last_fullsized":"2024-04-25T22:40:15.657925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:30:53.093623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658378+0000","last_change":"2024-04-25T22:40:14.620438+0000","last_active":"2024-04-25T22:40:15.658378+0000","last_peered":"2024-04-25T22:40:15.658378+0000","last_clean":"2024-04-25T22:40:15.658378+0000","last_became_active":"2024-04-25T22:40:14.619963+0000","last_became_peered":"2024-04-25T22:40:14.619963+0000","last_unstale":"2024-04-25T22:40:15.658378+0000","last_undegraded":"2024-04-25T22:40:15.658378+0000","last_fullsized":"2024-04-25T22:40:15.658378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615997+0000","last_change":"2024-04-25T22:40:14.616800+0000","last_active":"2024-04-25T22:40:15.615997+0000","last_peered":"2024-04-25T22:40:15.615997+0000","last_clean":"2024-04-25T22:40:15.615997+0000","last_became_active":"2024-04-25T22:40:14.612887+0000","last_became_peered":"2024-04-25T22:40:14.612887+0000","last_unstale":"2024-04-25T22:40:15.615997+0000","last_undegraded":"2024-04-25T22:40:15.615997+0000","last_fullsized":"2024-04-25T22:40:15.615997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615601+0000","last_change":"2024-04-25T22:40:14.615520+0000","last_active":"2024-04-25T22:40:15.615601+0000","last_peered":"2024-04-25T22:40:15.615601+0000","last_clean":"2024-04-25T22:40:15.615601+0000","last_became_active":"2024-04-25T22:40:14.613556+0000","last_became_peered":"2024-04-25T22:40:14.613556+0000","last_unstale":"2024-04-25T22:40:15.615601+0000","last_undegraded":"2024-04-25T22:40:15.615601+0000","last_fullsized":"2024-04-25T22:40:15.615601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615171+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:40:15.615171+0000","last_peered":"2024-04-25T22:40:15.615171+0000","last_clean":"2024-04-25T22:40:15.615171+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:40:15.615171+0000","last_undegraded":"2024-04-25T22:40:15.615171+0000","last_fullsized":"2024-04-25T22:40:15.615171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616907+0000","last_change":"2024-04-25T22:40:14.628222+0000","last_active":"2024-04-25T22:40:15.616907+0000","last_peered":"2024-04-25T22:40:15.616907+0000","last_clean":"2024-04-25T22:40:15.616907+0000","last_became_active":"2024-04-25T22:40:14.626913+0000","last_became_peered":"2024-04-25T22:40:14.626913+0000","last_unstale":"2024-04-25T22:40:15.616907+0000","last_undegraded":"2024-04-25T22:40:15.616907+0000","last_fullsized":"2024-04-25T22:40:15.616907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659087+0000","last_change":"2024-04-25T22:40:14.629506+0000","last_active":"2024-04-25T22:40:15.659087+0000","last_peered":"2024-04-25T22:40:15.659087+0000","last_clean":"2024-04-25T22:40:15.659087+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:40:15.659087+0000","last_undegraded":"2024-04-25T22:40:15.659087+0000","last_fullsized":"2024-04-25T22:40:15.659087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615553+0000","last_change":"2024-04-25T22:40:14.623704+0000","last_active":"2024-04-25T22:40:15.615553+0000","last_peered":"2024-04-25T22:40:15.615553+0000","last_clean":"2024-04-25T22:40:15.615553+0000","last_became_active":"2024-04-25T22:40:14.623146+0000","last_became_peered":"2024-04-25T22:40:14.623146+0000","last_unstale":"2024-04-25T22:40:15.615553+0000","last_undegraded":"2024-04-25T22:40:15.615553+0000","last_fullsized":"2024-04-25T22:40:15.615553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616610+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:40:15.616610+0000","last_peered":"2024-04-25T22:40:15.616610+0000","last_clean":"2024-04-25T22:40:15.616610+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:40:15.616610+0000","last_undegraded":"2024-04-25T22:40:15.616610+0000","last_fullsized":"2024-04-25T22:40:15.616610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618087+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:40:15.618087+0000","last_peered":"2024-04-25T22:40:15.618087+0000","last_clean":"2024-04-25T22:40:15.618087+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:40:15.618087+0000","last_undegraded":"2024-04-25T22:40:15.618087+0000","last_fullsized":"2024-04-25T22:40:15.618087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657153+0000","last_change":"2024-04-25T22:40:14.636703+0000","last_active":"2024-04-25T22:40:15.657153+0000","last_peered":"2024-04-25T22:40:15.657153+0000","last_clean":"2024-04-25T22:40:15.657153+0000","last_became_active":"2024-04-25T22:40:14.635943+0000","last_became_peered":"2024-04-25T22:40:14.635943+0000","last_unstale":"2024-04-25T22:40:15.657153+0000","last_undegraded":"2024-04-25T22:40:15.657153+0000","last_fullsized":"2024-04-25T22:40:15.657153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:45:57.862599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.613539+0000","last_change":"2024-04-25T22:40:14.617094+0000","last_active":"2024-04-25T22:40:15.613539+0000","last_peered":"2024-04-25T22:40:15.613539+0000","last_clean":"2024-04-25T22:40:15.613539+0000","last_became_active":"2024-04-25T22:40:14.615818+0000","last_became_peered":"2024-04-25T22:40:14.615818+0000","last_unstale":"2024-04-25T22:40:15.613539+0000","last_undegraded":"2024-04-25T22:40:15.613539+0000","last_fullsized":"2024-04-25T22:40:15.613539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:30:53.093623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.656876+0000","last_change":"2024-04-25T22:40:14.619013+0000","last_active":"2024-04-25T22:40:15.656876+0000","last_peered":"2024-04-25T22:40:15.656876+0000","last_clean":"2024-04-25T22:40:15.656876+0000","last_became_active":"2024-04-25T22:40:14.618184+0000","last_became_peered":"2024-04-25T22:40:14.618184+0000","last_unstale":"2024-04-25T22:40:15.656876+0000","last_undegraded":"2024-04-25T22:40:15.656876+0000","last_fullsized":"2024-04-25T22:40:15.656876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:34:40.281445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659068+0000","last_change":"2024-04-25T22:40:14.622357+0000","last_active":"2024-04-25T22:40:15.659068+0000","last_peered":"2024-04-25T22:40:15.659068+0000","last_clean":"2024-04-25T22:40:15.659068+0000","last_became_active":"2024-04-25T22:40:14.621617+0000","last_became_peered":"2024-04-25T22:40:14.621617+0000","last_unstale":"2024-04-25T22:40:15.659068+0000","last_undegraded":"2024-04-25T22:40:15.659068+0000","last_fullsized":"2024-04-25T22:40:15.659068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615978+0000","last_change":"2024-04-25T22:40:14.625933+0000","last_active":"2024-04-25T22:40:15.615978+0000","last_peered":"2024-04-25T22:40:15.615978+0000","last_clean":"2024-04-25T22:40:15.615978+0000","last_became_active":"2024-04-25T22:40:14.625123+0000","last_became_peered":"2024-04-25T22:40:14.625123+0000","last_unstale":"2024-04-25T22:40:15.615978+0000","last_undegraded":"2024-04-25T22:40:15.615978+0000","last_fullsized":"2024-04-25T22:40:15.615978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618233+0000","last_change":"2024-04-25T22:40:14.630596+0000","last_active":"2024-04-25T22:40:15.618233+0000","last_peered":"2024-04-25T22:40:15.618233+0000","last_clean":"2024-04-25T22:40:15.618233+0000","last_became_active":"2024-04-25T22:40:14.625407+0000","last_became_peered":"2024-04-25T22:40:14.625407+0000","last_unstale":"2024-04-25T22:40:15.618233+0000","last_undegraded":"2024-04-25T22:40:15.618233+0000","last_fullsized":"2024-04-25T22:40:15.618233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:20:05.398182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658859+0000","last_change":"2024-04-25T22:40:14.636526+0000","last_active":"2024-04-25T22:40:15.658859+0000","last_peered":"2024-04-25T22:40:15.658859+0000","last_clean":"2024-04-25T22:40:15.658859+0000","last_became_active":"2024-04-25T22:40:14.635539+0000","last_became_peered":"2024-04-25T22:40:14.635539+0000","last_unstale":"2024-04-25T22:40:15.658859+0000","last_undegraded":"2024-04-25T22:40:15.658859+0000","last_fullsized":"2024-04-25T22:40:15.658859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614790+0000","last_change":"2024-04-25T22:40:14.620608+0000","last_active":"2024-04-25T22:40:15.614790+0000","last_peered":"2024-04-25T22:40:15.614790+0000","last_clean":"2024-04-25T22:40:15.614790+0000","last_became_active":"2024-04-25T22:40:14.618171+0000","last_became_peered":"2024-04-25T22:40:14.618171+0000","last_unstale":"2024-04-25T22:40:15.614790+0000","last_undegraded":"2024-04-25T22:40:15.614790+0000","last_fullsized":"2024-04-25T22:40:15.614790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657864+0000","last_change":"2024-04-25T22:40:14.622961+0000","last_active":"2024-04-25T22:40:15.657864+0000","last_peered":"2024-04-25T22:40:15.657864+0000","last_clean":"2024-04-25T22:40:15.657864+0000","last_became_active":"2024-04-25T22:40:14.622238+0000","last_became_peered":"2024-04-25T22:40:14.622238+0000","last_unstale":"2024-04-25T22:40:15.657864+0000","last_undegraded":"2024-04-25T22:40:15.657864+0000","last_fullsized":"2024-04-25T22:40:15.657864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:09.125174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.613760+0000","last_change":"2024-04-25T22:40:14.618468+0000","last_active":"2024-04-25T22:40:15.613760+0000","last_peered":"2024-04-25T22:40:15.613760+0000","last_clean":"2024-04-25T22:40:15.613760+0000","last_became_active":"2024-04-25T22:40:14.617312+0000","last_became_peered":"2024-04-25T22:40:14.617312+0000","last_unstale":"2024-04-25T22:40:15.613760+0000","last_undegraded":"2024-04-25T22:40:15.613760+0000","last_fullsized":"2024-04-25T22:40:15.613760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:12.679354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615544+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:40:15.615544+0000","last_peered":"2024-04-25T22:40:15.615544+0000","last_clean":"2024-04-25T22:40:15.615544+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:40:15.615544+0000","last_undegraded":"2024-04-25T22:40:15.615544+0000","last_fullsized":"2024-04-25T22:40:15.615544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658398+0000","last_change":"2024-04-25T22:40:14.613553+0000","last_active":"2024-04-25T22:40:15.658398+0000","last_peered":"2024-04-25T22:40:15.658398+0000","last_clean":"2024-04-25T22:40:15.658398+0000","last_became_active":"2024-04-25T22:40:14.612857+0000","last_became_peered":"2024-04-25T22:40:14.612857+0000","last_unstale":"2024-04-25T22:40:15.658398+0000","last_undegraded":"2024-04-25T22:40:15.658398+0000","last_fullsized":"2024-04-25T22:40:15.658398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617134+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:40:15.617134+0000","last_peered":"2024-04-25T22:40:15.617134+0000","last_clean":"2024-04-25T22:40:15.617134+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:40:15.617134+0000","last_undegraded":"2024-04-25T22:40:15.617134+0000","last_fullsized":"2024-04-25T22:40:15.617134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.660077+0000","last_change":"2024-04-25T22:40:14.618292+0000","last_active":"2024-04-25T22:40:15.660077+0000","last_peered":"2024-04-25T22:40:15.660077+0000","last_clean":"2024-04-25T22:40:15.660077+0000","last_became_active":"2024-04-25T22:40:14.616712+0000","last_became_peered":"2024-04-25T22:40:14.616712+0000","last_unstale":"2024-04-25T22:40:15.660077+0000","last_undegraded":"2024-04-25T22:40:15.660077+0000","last_fullsized":"2024-04-25T22:40:15.660077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614211+0000","last_change":"2024-04-25T22:40:13.581241+0000","last_active":"2024-04-25T22:40:15.614211+0000","last_peered":"2024-04-25T22:40:15.614211+0000","last_clean":"2024-04-25T22:40:15.614211+0000","last_became_active":"2024-04-25T22:40:13.580442+0000","last_became_peered":"2024-04-25T22:40:13.580442+0000","last_unstale":"2024-04-25T22:40:15.614211+0000","last_undegraded":"2024-04-25T22:40:15.614211+0000","last_fullsized":"2024-04-25T22:40:15.614211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:50:49.280995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616561+0000","last_change":"2024-04-25T22:40:14.631577+0000","last_active":"2024-04-25T22:40:15.616561+0000","last_peered":"2024-04-25T22:40:15.616561+0000","last_clean":"2024-04-25T22:40:15.616561+0000","last_became_active":"2024-04-25T22:40:14.630371+0000","last_became_peered":"2024-04-25T22:40:14.630371+0000","last_unstale":"2024-04-25T22:40:15.616561+0000","last_undegraded":"2024-04-25T22:40:15.616561+0000","last_fullsized":"2024-04-25T22:40:15.616561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657258+0000","last_change":"2024-04-25T22:40:13.599838+0000","last_active":"2024-04-25T22:40:15.657258+0000","last_peered":"2024-04-25T22:40:15.657258+0000","last_clean":"2024-04-25T22:40:15.657258+0000","last_became_active":"2024-04-25T22:40:13.599001+0000","last_became_peered":"2024-04-25T22:40:13.599001+0000","last_unstale":"2024-04-25T22:40:15.657258+0000","last_undegraded":"2024-04-25T22:40:15.657258+0000","last_fullsized":"2024-04-25T22:40:15.657258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:16.993188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616081+0000","last_change":"2024-04-25T22:40:14.630012+0000","last_active":"2024-04-25T22:40:15.616081+0000","last_peered":"2024-04-25T22:40:15.616081+0000","last_clean":"2024-04-25T22:40:15.616081+0000","last_became_active":"2024-04-25T22:40:14.628677+0000","last_became_peered":"2024-04-25T22:40:14.628677+0000","last_unstale":"2024-04-25T22:40:15.616081+0000","last_undegraded":"2024-04-25T22:40:15.616081+0000","last_fullsized":"2024-04-25T22:40:15.616081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615558+0000","last_change":"2024-04-25T22:40:13.599918+0000","last_active":"2024-04-25T22:40:15.615558+0000","last_peered":"2024-04-25T22:40:15.615558+0000","last_clean":"2024-04-25T22:40:15.615558+0000","last_became_active":"2024-04-25T22:40:13.596461+0000","last_became_peered":"2024-04-25T22:40:13.596461+0000","last_unstale":"2024-04-25T22:40:15.615558+0000","last_undegraded":"2024-04-25T22:40:15.615558+0000","last_fullsized":"2024-04-25T22:40:15.615558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:41:51.887162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618201+0000","last_change":"2024-04-25T22:40:13.598294+0000","last_active":"2024-04-25T22:40:15.618201+0000","last_peered":"2024-04-25T22:40:15.618201+0000","last_clean":"2024-04-25T22:40:15.618201+0000","last_became_active":"2024-04-25T22:40:13.596687+0000","last_became_peered":"2024-04-25T22:40:13.596687+0000","last_unstale":"2024-04-25T22:40:15.618201+0000","last_undegraded":"2024-04-25T22:40:15.618201+0000","last_fullsized":"2024-04-25T22:40:15.618201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:50:49.280995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.656904+0000","last_change":"2024-04-25T22:40:14.625171+0000","last_active":"2024-04-25T22:40:15.656904+0000","last_peered":"2024-04-25T22:40:15.656904+0000","last_clean":"2024-04-25T22:40:15.656904+0000","last_became_active":"2024-04-25T22:40:14.624473+0000","last_became_peered":"2024-04-25T22:40:14.624473+0000","last_unstale":"2024-04-25T22:40:15.656904+0000","last_undegraded":"2024-04-25T22:40:15.656904+0000","last_fullsized":"2024-04-25T22:40:15.656904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:30.591624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659343+0000","last_change":"2024-04-25T22:40:13.599189+0000","last_active":"2024-04-25T22:40:15.659343+0000","last_peered":"2024-04-25T22:40:15.659343+0000","last_clean":"2024-04-25T22:40:15.659343+0000","last_became_active":"2024-04-25T22:40:13.598289+0000","last_became_peered":"2024-04-25T22:40:13.598289+0000","last_unstale":"2024-04-25T22:40:15.659343+0000","last_undegraded":"2024-04-25T22:40:15.659343+0000","last_fullsized":"2024-04-25T22:40:15.659343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:05:28.535490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657030+0000","last_change":"2024-04-25T22:40:14.618478+0000","last_active":"2024-04-25T22:40:15.657030+0000","last_peered":"2024-04-25T22:40:15.657030+0000","last_clean":"2024-04-25T22:40:15.657030+0000","last_became_active":"2024-04-25T22:40:14.617688+0000","last_became_peered":"2024-04-25T22:40:14.617688+0000","last_unstale":"2024-04-25T22:40:15.657030+0000","last_undegraded":"2024-04-25T22:40:15.657030+0000","last_fullsized":"2024-04-25T22:40:15.657030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:39:44.762240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618805+0000","last_change":"2024-04-25T22:40:13.601404+0000","last_active":"2024-04-25T22:40:15.618805+0000","last_peered":"2024-04-25T22:40:15.618805+0000","last_clean":"2024-04-25T22:40:15.618805+0000","last_became_active":"2024-04-25T22:40:13.600688+0000","last_became_peered":"2024-04-25T22:40:13.600688+0000","last_unstale":"2024-04-25T22:40:15.618805+0000","last_undegraded":"2024-04-25T22:40:15.618805+0000","last_fullsized":"2024-04-25T22:40:15.618805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:36.157648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616497+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:40:15.616497+0000","last_peered":"2024-04-25T22:40:15.616497+0000","last_clean":"2024-04-25T22:40:15.616497+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:40:15.616497+0000","last_undegraded":"2024-04-25T22:40:15.616497+0000","last_fullsized":"2024-04-25T22:40:15.616497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617642+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:40:15.617642+0000","last_peered":"2024-04-25T22:40:15.617642+0000","last_clean":"2024-04-25T22:40:15.617642+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:40:15.617642+0000","last_undegraded":"2024-04-25T22:40:15.617642+0000","last_fullsized":"2024-04-25T22:40:15.617642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615001+0000","last_change":"2024-04-25T22:40:14.625843+0000","last_active":"2024-04-25T22:40:15.615001+0000","last_peered":"2024-04-25T22:40:15.615001+0000","last_clean":"2024-04-25T22:40:15.615001+0000","last_became_active":"2024-04-25T22:40:14.625187+0000","last_became_peered":"2024-04-25T22:40:14.625187+0000","last_unstale":"2024-04-25T22:40:15.615001+0000","last_undegraded":"2024-04-25T22:40:15.615001+0000","last_fullsized":"2024-04-25T22:40:15.615001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615306+0000","last_change":"2024-04-25T22:40:13.581857+0000","last_active":"2024-04-25T22:40:15.615306+0000","last_peered":"2024-04-25T22:40:15.615306+0000","last_clean":"2024-04-25T22:40:15.615306+0000","last_became_active":"2024-04-25T22:40:13.581263+0000","last_became_peered":"2024-04-25T22:40:13.581263+0000","last_unstale":"2024-04-25T22:40:15.615306+0000","last_undegraded":"2024-04-25T22:40:15.615306+0000","last_fullsized":"2024-04-25T22:40:15.615306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:54:01.709709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617001+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:40:15.617001+0000","last_peered":"2024-04-25T22:40:15.617001+0000","last_clean":"2024-04-25T22:40:15.617001+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:40:15.617001+0000","last_undegraded":"2024-04-25T22:40:15.617001+0000","last_fullsized":"2024-04-25T22:40:15.617001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616780+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:40:15.616780+0000","last_peered":"2024-04-25T22:40:15.616780+0000","last_clean":"2024-04-25T22:40:15.616780+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:40:15.616780+0000","last_undegraded":"2024-04-25T22:40:15.616780+0000","last_fullsized":"2024-04-25T22:40:15.616780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618553+0000","last_change":"2024-04-25T22:40:14.621941+0000","last_active":"2024-04-25T22:40:15.618553+0000","last_peered":"2024-04-25T22:40:15.618553+0000","last_clean":"2024-04-25T22:40:15.618553+0000","last_became_active":"2024-04-25T22:40:14.614196+0000","last_became_peered":"2024-04-25T22:40:14.614196+0000","last_unstale":"2024-04-25T22:40:15.618553+0000","last_undegraded":"2024-04-25T22:40:15.618553+0000","last_fullsized":"2024-04-25T22:40:15.618553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:24.895025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657287+0000","last_change":"2024-04-25T22:40:13.599695+0000","last_active":"2024-04-25T22:40:15.657287+0000","last_peered":"2024-04-25T22:40:15.657287+0000","last_clean":"2024-04-25T22:40:15.657287+0000","last_became_active":"2024-04-25T22:40:13.598805+0000","last_became_peered":"2024-04-25T22:40:13.598805+0000","last_unstale":"2024-04-25T22:40:15.657287+0000","last_undegraded":"2024-04-25T22:40:15.657287+0000","last_fullsized":"2024-04-25T22:40:15.657287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:56.307032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617569+0000","last_change":"2024-04-25T22:40:14.614275+0000","last_active":"2024-04-25T22:40:15.617569+0000","last_peered":"2024-04-25T22:40:15.617569+0000","last_clean":"2024-04-25T22:40:15.617569+0000","last_became_active":"2024-04-25T22:40:14.613038+0000","last_became_peered":"2024-04-25T22:40:14.613038+0000","last_unstale":"2024-04-25T22:40:15.617569+0000","last_undegraded":"2024-04-25T22:40:15.617569+0000","last_fullsized":"2024-04-25T22:40:15.617569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:14:02.343388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657203+0000","last_change":"2024-04-25T22:40:13.597555+0000","last_active":"2024-04-25T22:40:15.657203+0000","last_peered":"2024-04-25T22:40:15.657203+0000","last_clean":"2024-04-25T22:40:15.657203+0000","last_became_active":"2024-04-25T22:40:13.596623+0000","last_became_peered":"2024-04-25T22:40:13.596623+0000","last_unstale":"2024-04-25T22:40:15.657203+0000","last_undegraded":"2024-04-25T22:40:15.657203+0000","last_fullsized":"2024-04-25T22:40:15.657203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:29:00.157478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616173+0000","last_change":"2024-04-25T22:40:14.627280+0000","last_active":"2024-04-25T22:40:15.616173+0000","last_peered":"2024-04-25T22:40:15.616173+0000","last_clean":"2024-04-25T22:40:15.616173+0000","last_became_active":"2024-04-25T22:40:14.624656+0000","last_became_peered":"2024-04-25T22:40:14.624656+0000","last_unstale":"2024-04-25T22:40:15.616173+0000","last_undegraded":"2024-04-25T22:40:15.616173+0000","last_fullsized":"2024-04-25T22:40:15.616173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":222,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616001+0000","last_change":"2024-04-25T22:40:04.317146+0000","last_active":"2024-04-25T22:40:15.616001+0000","last_peered":"2024-04-25T22:40:15.616001+0000","last_clean":"2024-04-25T22:40:15.616001+0000","last_became_active":"2024-04-25T22:40:04.316527+0000","last_became_peered":"2024-04-25T22:40:04.316527+0000","last_unstale":"2024-04-25T22:40:15.616001+0000","last_undegraded":"2024-04-25T22:40:15.616001+0000","last_fullsized":"2024-04-25T22:40:15.616001+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:25.669997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617484+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:40:15.617484+0000","last_peered":"2024-04-25T22:40:15.617484+0000","last_clean":"2024-04-25T22:40:15.617484+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:40:15.617484+0000","last_undegraded":"2024-04-25T22:40:15.617484+0000","last_fullsized":"2024-04-25T22:40:15.617484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614355+0000","last_change":"2024-04-25T22:40:13.591980+0000","last_active":"2024-04-25T22:40:15.614355+0000","last_peered":"2024-04-25T22:40:15.614355+0000","last_clean":"2024-04-25T22:40:15.614355+0000","last_became_active":"2024-04-25T22:40:13.591152+0000","last_became_peered":"2024-04-25T22:40:13.591152+0000","last_unstale":"2024-04-25T22:40:15.614355+0000","last_undegraded":"2024-04-25T22:40:15.614355+0000","last_fullsized":"2024-04-25T22:40:15.614355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618637+0000","last_change":"2024-04-25T22:40:14.621472+0000","last_active":"2024-04-25T22:40:15.618637+0000","last_peered":"2024-04-25T22:40:15.618637+0000","last_clean":"2024-04-25T22:40:15.618637+0000","last_became_active":"2024-04-25T22:40:14.613608+0000","last_became_peered":"2024-04-25T22:40:14.613608+0000","last_unstale":"2024-04-25T22:40:15.618637+0000","last_undegraded":"2024-04-25T22:40:15.618637+0000","last_fullsized":"2024-04-25T22:40:15.618637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:51.686908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615728+0000","last_change":"2024-04-25T22:40:09.502444+0000","last_active":"2024-04-25T22:40:15.615728+0000","last_peered":"2024-04-25T22:40:15.615728+0000","last_clean":"2024-04-25T22:40:15.615728+0000","last_became_active":"2024-04-25T22:40:09.501576+0000","last_became_peered":"2024-04-25T22:40:09.501576+0000","last_unstale":"2024-04-25T22:40:15.615728+0000","last_undegraded":"2024-04-25T22:40:15.615728+0000","last_fullsized":"2024-04-25T22:40:15.615728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:35:14.955359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614468+0000","last_change":"2024-04-25T22:40:13.579430+0000","last_active":"2024-04-25T22:40:15.614468+0000","last_peered":"2024-04-25T22:40:15.614468+0000","last_clean":"2024-04-25T22:40:15.614468+0000","last_became_active":"2024-04-25T22:40:13.578601+0000","last_became_peered":"2024-04-25T22:40:13.578601+0000","last_unstale":"2024-04-25T22:40:15.614468+0000","last_undegraded":"2024-04-25T22:40:15.614468+0000","last_fullsized":"2024-04-25T22:40:15.614468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:50.274924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658863+0000","last_change":"2024-04-25T22:40:14.628709+0000","last_active":"2024-04-25T22:40:15.658863+0000","last_peered":"2024-04-25T22:40:15.658863+0000","last_clean":"2024-04-25T22:40:15.658863+0000","last_became_active":"2024-04-25T22:40:14.627641+0000","last_became_peered":"2024-04-25T22:40:14.627641+0000","last_unstale":"2024-04-25T22:40:15.658863+0000","last_undegraded":"2024-04-25T22:40:15.658863+0000","last_fullsized":"2024-04-25T22:40:15.658863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614614+0000","last_change":"2024-04-25T22:40:09.501323+0000","last_active":"2024-04-25T22:40:15.614614+0000","last_peered":"2024-04-25T22:40:15.614614+0000","last_clean":"2024-04-25T22:40:15.614614+0000","last_became_active":"2024-04-25T22:40:09.500499+0000","last_became_peered":"2024-04-25T22:40:09.500499+0000","last_unstale":"2024-04-25T22:40:15.614614+0000","last_undegraded":"2024-04-25T22:40:15.614614+0000","last_fullsized":"2024-04-25T22:40:15.614614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:30.289572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657249+0000","last_change":"2024-04-25T22:40:13.599332+0000","last_active":"2024-04-25T22:40:15.657249+0000","last_peered":"2024-04-25T22:40:15.657249+0000","last_clean":"2024-04-25T22:40:15.657249+0000","last_became_active":"2024-04-25T22:40:13.598689+0000","last_became_peered":"2024-04-25T22:40:13.598689+0000","last_unstale":"2024-04-25T22:40:15.657249+0000","last_undegraded":"2024-04-25T22:40:15.657249+0000","last_fullsized":"2024-04-25T22:40:15.657249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:36.875346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616453+0000","last_change":"2024-04-25T22:40:14.628007+0000","last_active":"2024-04-25T22:40:15.616453+0000","last_peered":"2024-04-25T22:40:15.616453+0000","last_clean":"2024-04-25T22:40:15.616453+0000","last_became_active":"2024-04-25T22:40:14.625425+0000","last_became_peered":"2024-04-25T22:40:14.625425+0000","last_unstale":"2024-04-25T22:40:15.616453+0000","last_undegraded":"2024-04-25T22:40:15.616453+0000","last_fullsized":"2024-04-25T22:40:15.616453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616734+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:40:15.616734+0000","last_peered":"2024-04-25T22:40:15.616734+0000","last_clean":"2024-04-25T22:40:15.616734+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:40:15.616734+0000","last_undegraded":"2024-04-25T22:40:15.616734+0000","last_fullsized":"2024-04-25T22:40:15.616734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617401+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:40:15.617401+0000","last_peered":"2024-04-25T22:40:15.617401+0000","last_clean":"2024-04-25T22:40:15.617401+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:40:15.617401+0000","last_undegraded":"2024-04-25T22:40:15.617401+0000","last_fullsized":"2024-04-25T22:40:15.617401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615641+0000","last_change":"2024-04-25T22:40:14.622442+0000","last_active":"2024-04-25T22:40:15.615641+0000","last_peered":"2024-04-25T22:40:15.615641+0000","last_clean":"2024-04-25T22:40:15.615641+0000","last_became_active":"2024-04-25T22:40:14.621130+0000","last_became_peered":"2024-04-25T22:40:14.621130+0000","last_unstale":"2024-04-25T22:40:15.615641+0000","last_undegraded":"2024-04-25T22:40:15.615641+0000","last_fullsized":"2024-04-25T22:40:15.615641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618860+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:40:15.618860+0000","last_peered":"2024-04-25T22:40:15.618860+0000","last_clean":"2024-04-25T22:40:15.618860+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:40:15.618860+0000","last_undegraded":"2024-04-25T22:40:15.618860+0000","last_fullsized":"2024-04-25T22:40:15.618860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615725+0000","last_change":"2024-04-25T22:40:09.501325+0000","last_active":"2024-04-25T22:40:15.615725+0000","last_peered":"2024-04-25T22:40:15.615725+0000","last_clean":"2024-04-25T22:40:15.615725+0000","last_became_active":"2024-04-25T22:40:09.500542+0000","last_became_peered":"2024-04-25T22:40:09.500542+0000","last_unstale":"2024-04-25T22:40:15.615725+0000","last_undegraded":"2024-04-25T22:40:15.615725+0000","last_fullsized":"2024-04-25T22:40:15.615725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:34:38.234538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657224+0000","last_change":"2024-04-25T22:40:14.636726+0000","last_active":"2024-04-25T22:40:15.657224+0000","last_peered":"2024-04-25T22:40:15.657224+0000","last_clean":"2024-04-25T22:40:15.657224+0000","last_became_active":"2024-04-25T22:40:14.636013+0000","last_became_peered":"2024-04-25T22:40:14.636013+0000","last_unstale":"2024-04-25T22:40:15.657224+0000","last_undegraded":"2024-04-25T22:40:15.657224+0000","last_fullsized":"2024-04-25T22:40:15.657224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:35.910752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615587+0000","last_change":"2024-04-25T22:40:13.591256+0000","last_active":"2024-04-25T22:40:15.615587+0000","last_peered":"2024-04-25T22:40:15.615587+0000","last_clean":"2024-04-25T22:40:15.615587+0000","last_became_active":"2024-04-25T22:40:13.590744+0000","last_became_peered":"2024-04-25T22:40:13.590744+0000","last_unstale":"2024-04-25T22:40:15.615587+0000","last_undegraded":"2024-04-25T22:40:15.615587+0000","last_fullsized":"2024-04-25T22:40:15.615587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:50.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.660294+0000","last_change":"2024-04-25T22:40:09.501163+0000","last_active":"2024-04-25T22:40:15.660294+0000","last_peered":"2024-04-25T22:40:15.660294+0000","last_clean":"2024-04-25T22:40:15.660294+0000","last_became_active":"2024-04-25T22:40:09.500492+0000","last_became_peered":"2024-04-25T22:40:09.500492+0000","last_unstale":"2024-04-25T22:40:15.660294+0000","last_undegraded":"2024-04-25T22:40:15.660294+0000","last_fullsized":"2024-04-25T22:40:15.660294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:22.822616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658264+0000","last_change":"2024-04-25T22:40:14.638662+0000","last_active":"2024-04-25T22:40:15.658264+0000","last_peered":"2024-04-25T22:40:15.658264+0000","last_clean":"2024-04-25T22:40:15.658264+0000","last_became_active":"2024-04-25T22:40:14.638060+0000","last_became_peered":"2024-04-25T22:40:14.638060+0000","last_unstale":"2024-04-25T22:40:15.658264+0000","last_undegraded":"2024-04-25T22:40:15.658264+0000","last_fullsized":"2024-04-25T22:40:15.658264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:12.679354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616939+0000","last_change":"2024-04-25T22:40:13.592055+0000","last_active":"2024-04-25T22:40:15.616939+0000","last_peered":"2024-04-25T22:40:15.616939+0000","last_clean":"2024-04-25T22:40:15.616939+0000","last_became_active":"2024-04-25T22:40:13.591169+0000","last_became_peered":"2024-04-25T22:40:13.591169+0000","last_unstale":"2024-04-25T22:40:15.616939+0000","last_undegraded":"2024-04-25T22:40:15.616939+0000","last_fullsized":"2024-04-25T22:40:15.616939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:33.458799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616687+0000","last_change":"2024-04-25T22:40:09.501358+0000","last_active":"2024-04-25T22:40:15.616687+0000","last_peered":"2024-04-25T22:40:15.616687+0000","last_clean":"2024-04-25T22:40:15.616687+0000","last_became_active":"2024-04-25T22:40:09.500626+0000","last_became_peered":"2024-04-25T22:40:09.500626+0000","last_unstale":"2024-04-25T22:40:15.616687+0000","last_undegraded":"2024-04-25T22:40:15.616687+0000","last_fullsized":"2024-04-25T22:40:15.616687+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:55.182967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.613952+0000","last_change":"2024-04-25T22:40:14.618363+0000","last_active":"2024-04-25T22:40:15.613952+0000","last_peered":"2024-04-25T22:40:15.613952+0000","last_clean":"2024-04-25T22:40:15.613952+0000","last_became_active":"2024-04-25T22:40:14.617599+0000","last_became_peered":"2024-04-25T22:40:14.617599+0000","last_unstale":"2024-04-25T22:40:15.613952+0000","last_undegraded":"2024-04-25T22:40:15.613952+0000","last_fullsized":"2024-04-25T22:40:15.613952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:16.594231+0000","last_change":"2024-04-25T22:40:13.593400+0000","last_active":"2024-04-25T22:40:16.594231+0000","last_peered":"2024-04-25T22:40:16.594231+0000","last_clean":"2024-04-25T22:40:16.594231+0000","last_became_active":"2024-04-25T22:40:13.592338+0000","last_became_peered":"2024-04-25T22:40:13.592338+0000","last_unstale":"2024-04-25T22:40:16.594231+0000","last_undegraded":"2024-04-25T22:40:16.594231+0000","last_fullsized":"2024-04-25T22:40:16.594231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618220+0000","last_change":"2024-04-25T22:40:09.500948+0000","last_active":"2024-04-25T22:40:15.618220+0000","last_peered":"2024-04-25T22:40:15.618220+0000","last_clean":"2024-04-25T22:40:15.618220+0000","last_became_active":"2024-04-25T22:40:09.500236+0000","last_became_peered":"2024-04-25T22:40:09.500236+0000","last_unstale":"2024-04-25T22:40:15.618220+0000","last_undegraded":"2024-04-25T22:40:15.618220+0000","last_fullsized":"2024-04-25T22:40:15.618220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:02.375961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657009+0000","last_change":"2024-04-25T22:40:14.623882+0000","last_active":"2024-04-25T22:40:15.657009+0000","last_peered":"2024-04-25T22:40:15.657009+0000","last_clean":"2024-04-25T22:40:15.657009+0000","last_became_active":"2024-04-25T22:40:14.623090+0000","last_became_peered":"2024-04-25T22:40:14.623090+0000","last_unstale":"2024-04-25T22:40:15.657009+0000","last_undegraded":"2024-04-25T22:40:15.657009+0000","last_fullsized":"2024-04-25T22:40:15.657009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:52.116132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616663+0000","last_change":"2024-04-25T22:40:14.619806+0000","last_active":"2024-04-25T22:40:15.616663+0000","last_peered":"2024-04-25T22:40:15.616663+0000","last_clean":"2024-04-25T22:40:15.616663+0000","last_became_active":"2024-04-25T22:40:14.618980+0000","last_became_peered":"2024-04-25T22:40:14.618980+0000","last_unstale":"2024-04-25T22:40:15.616663+0000","last_undegraded":"2024-04-25T22:40:15.616663+0000","last_fullsized":"2024-04-25T22:40:15.616663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617318+0000","last_change":"2024-04-25T22:40:13.598003+0000","last_active":"2024-04-25T22:40:15.617318+0000","last_peered":"2024-04-25T22:40:15.617318+0000","last_clean":"2024-04-25T22:40:15.617318+0000","last_became_active":"2024-04-25T22:40:13.596631+0000","last_became_peered":"2024-04-25T22:40:13.596631+0000","last_unstale":"2024-04-25T22:40:15.617318+0000","last_undegraded":"2024-04-25T22:40:15.617318+0000","last_fullsized":"2024-04-25T22:40:15.617318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:50.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614024+0000","last_change":"2024-04-25T22:40:14.620064+0000","last_active":"2024-04-25T22:40:15.614024+0000","last_peered":"2024-04-25T22:40:15.614024+0000","last_clean":"2024-04-25T22:40:15.614024+0000","last_became_active":"2024-04-25T22:40:14.619294+0000","last_became_peered":"2024-04-25T22:40:14.619294+0000","last_unstale":"2024-04-25T22:40:15.614024+0000","last_undegraded":"2024-04-25T22:40:15.614024+0000","last_fullsized":"2024-04-25T22:40:15.614024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.660194+0000","last_change":"2024-04-25T22:40:13.600050+0000","last_active":"2024-04-25T22:40:15.660194+0000","last_peered":"2024-04-25T22:40:15.660194+0000","last_clean":"2024-04-25T22:40:15.660194+0000","last_became_active":"2024-04-25T22:40:13.599138+0000","last_became_peered":"2024-04-25T22:40:13.599138+0000","last_unstale":"2024-04-25T22:40:15.660194+0000","last_undegraded":"2024-04-25T22:40:15.660194+0000","last_fullsized":"2024-04-25T22:40:15.660194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:36.847491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618448+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:40:15.618448+0000","last_peered":"2024-04-25T22:40:15.618448+0000","last_clean":"2024-04-25T22:40:15.618448+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:40:15.618448+0000","last_undegraded":"2024-04-25T22:40:15.618448+0000","last_fullsized":"2024-04-25T22:40:15.618448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614160+0000","last_change":"2024-04-25T22:40:14.627868+0000","last_active":"2024-04-25T22:40:15.614160+0000","last_peered":"2024-04-25T22:40:15.614160+0000","last_clean":"2024-04-25T22:40:15.614160+0000","last_became_active":"2024-04-25T22:40:14.626388+0000","last_became_peered":"2024-04-25T22:40:14.626388+0000","last_unstale":"2024-04-25T22:40:15.614160+0000","last_undegraded":"2024-04-25T22:40:15.614160+0000","last_fullsized":"2024-04-25T22:40:15.614160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616733+0000","last_change":"2024-04-25T22:40:13.593378+0000","last_active":"2024-04-25T22:40:15.616733+0000","last_peered":"2024-04-25T22:40:15.616733+0000","last_clean":"2024-04-25T22:40:15.616733+0000","last_became_active":"2024-04-25T22:40:13.592392+0000","last_became_peered":"2024-04-25T22:40:13.592392+0000","last_unstale":"2024-04-25T22:40:15.616733+0000","last_undegraded":"2024-04-25T22:40:15.616733+0000","last_fullsized":"2024-04-25T22:40:15.616733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.613799+0000","last_change":"2024-04-25T22:40:14.619640+0000","last_active":"2024-04-25T22:40:15.613799+0000","last_peered":"2024-04-25T22:40:15.613799+0000","last_clean":"2024-04-25T22:40:15.613799+0000","last_became_active":"2024-04-25T22:40:14.618088+0000","last_became_peered":"2024-04-25T22:40:14.618088+0000","last_unstale":"2024-04-25T22:40:15.613799+0000","last_undegraded":"2024-04-25T22:40:15.613799+0000","last_fullsized":"2024-04-25T22:40:15.613799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:58.322470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659293+0000","last_change":"2024-04-25T22:40:14.622624+0000","last_active":"2024-04-25T22:40:15.659293+0000","last_peered":"2024-04-25T22:40:15.659293+0000","last_clean":"2024-04-25T22:40:15.659293+0000","last_became_active":"2024-04-25T22:40:14.621883+0000","last_became_peered":"2024-04-25T22:40:14.621883+0000","last_unstale":"2024-04-25T22:40:15.659293+0000","last_undegraded":"2024-04-25T22:40:15.659293+0000","last_fullsized":"2024-04-25T22:40:15.659293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614104+0000","last_change":"2024-04-25T22:40:13.588577+0000","last_active":"2024-04-25T22:40:15.614104+0000","last_peered":"2024-04-25T22:40:15.614104+0000","last_clean":"2024-04-25T22:40:15.614104+0000","last_became_active":"2024-04-25T22:40:13.588019+0000","last_became_peered":"2024-04-25T22:40:13.588019+0000","last_unstale":"2024-04-25T22:40:15.614104+0000","last_undegraded":"2024-04-25T22:40:15.614104+0000","last_fullsized":"2024-04-25T22:40:15.614104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:07.743396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616085+0000","last_change":"2024-04-25T22:40:14.630597+0000","last_active":"2024-04-25T22:40:15.616085+0000","last_peered":"2024-04-25T22:40:15.616085+0000","last_clean":"2024-04-25T22:40:15.616085+0000","last_became_active":"2024-04-25T22:40:14.628981+0000","last_became_peered":"2024-04-25T22:40:14.628981+0000","last_unstale":"2024-04-25T22:40:15.616085+0000","last_undegraded":"2024-04-25T22:40:15.616085+0000","last_fullsized":"2024-04-25T22:40:15.616085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614326+0000","last_change":"2024-04-25T22:40:13.581827+0000","last_active":"2024-04-25T22:40:15.614326+0000","last_peered":"2024-04-25T22:40:15.614326+0000","last_clean":"2024-04-25T22:40:15.614326+0000","last_became_active":"2024-04-25T22:40:13.581166+0000","last_became_peered":"2024-04-25T22:40:13.581166+0000","last_unstale":"2024-04-25T22:40:15.614326+0000","last_undegraded":"2024-04-25T22:40:15.614326+0000","last_fullsized":"2024-04-25T22:40:15.614326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659335+0000","last_change":"2024-04-25T22:40:14.636300+0000","last_active":"2024-04-25T22:40:15.659335+0000","last_peered":"2024-04-25T22:40:15.659335+0000","last_clean":"2024-04-25T22:40:15.659335+0000","last_became_active":"2024-04-25T22:40:14.635200+0000","last_became_peered":"2024-04-25T22:40:14.635200+0000","last_unstale":"2024-04-25T22:40:15.659335+0000","last_undegraded":"2024-04-25T22:40:15.659335+0000","last_fullsized":"2024-04-25T22:40:15.659335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657711+0000","last_change":"2024-04-25T22:40:13.597736+0000","last_active":"2024-04-25T22:40:15.657711+0000","last_peered":"2024-04-25T22:40:15.657711+0000","last_clean":"2024-04-25T22:40:15.657711+0000","last_became_active":"2024-04-25T22:40:13.596811+0000","last_became_peered":"2024-04-25T22:40:13.596811+0000","last_unstale":"2024-04-25T22:40:15.657711+0000","last_undegraded":"2024-04-25T22:40:15.657711+0000","last_fullsized":"2024-04-25T22:40:15.657711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:14:39.783367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658355+0000","last_change":"2024-04-25T22:40:14.616725+0000","last_active":"2024-04-25T22:40:15.658355+0000","last_peered":"2024-04-25T22:40:15.658355+0000","last_clean":"2024-04-25T22:40:15.658355+0000","last_became_active":"2024-04-25T22:40:14.615881+0000","last_became_peered":"2024-04-25T22:40:14.615881+0000","last_unstale":"2024-04-25T22:40:15.658355+0000","last_undegraded":"2024-04-25T22:40:15.658355+0000","last_fullsized":"2024-04-25T22:40:15.658355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658755+0000","last_change":"2024-04-25T22:40:13.594299+0000","last_active":"2024-04-25T22:40:15.658755+0000","last_peered":"2024-04-25T22:40:15.658755+0000","last_clean":"2024-04-25T22:40:15.658755+0000","last_became_active":"2024-04-25T22:40:13.593477+0000","last_became_peered":"2024-04-25T22:40:13.593477+0000","last_unstale":"2024-04-25T22:40:15.658755+0000","last_undegraded":"2024-04-25T22:40:15.658755+0000","last_fullsized":"2024-04-25T22:40:15.658755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:55.181892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616518+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:40:15.616518+0000","last_peered":"2024-04-25T22:40:15.616518+0000","last_clean":"2024-04-25T22:40:15.616518+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:40:15.616518+0000","last_undegraded":"2024-04-25T22:40:15.616518+0000","last_fullsized":"2024-04-25T22:40:15.616518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617388+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:40:15.617388+0000","last_peered":"2024-04-25T22:40:15.617388+0000","last_clean":"2024-04-25T22:40:15.617388+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:40:15.617388+0000","last_undegraded":"2024-04-25T22:40:15.617388+0000","last_fullsized":"2024-04-25T22:40:15.617388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616444+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:40:15.616444+0000","last_peered":"2024-04-25T22:40:15.616444+0000","last_clean":"2024-04-25T22:40:15.616444+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:40:15.616444+0000","last_undegraded":"2024-04-25T22:40:15.616444+0000","last_fullsized":"2024-04-25T22:40:15.616444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659592+0000","last_change":"2024-04-25T22:40:13.600784+0000","last_active":"2024-04-25T22:40:15.659592+0000","last_peered":"2024-04-25T22:40:15.659592+0000","last_clean":"2024-04-25T22:40:15.659592+0000","last_became_active":"2024-04-25T22:40:13.600104+0000","last_became_peered":"2024-04-25T22:40:13.600104+0000","last_unstale":"2024-04-25T22:40:15.659592+0000","last_undegraded":"2024-04-25T22:40:15.659592+0000","last_fullsized":"2024-04-25T22:40:15.659592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:54.861491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658308+0000","last_change":"2024-04-25T22:40:14.618046+0000","last_active":"2024-04-25T22:40:15.658308+0000","last_peered":"2024-04-25T22:40:15.658308+0000","last_clean":"2024-04-25T22:40:15.658308+0000","last_became_active":"2024-04-25T22:40:14.616356+0000","last_became_peered":"2024-04-25T22:40:14.616356+0000","last_unstale":"2024-04-25T22:40:15.658308+0000","last_undegraded":"2024-04-25T22:40:15.658308+0000","last_fullsized":"2024-04-25T22:40:15.658308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:58.322470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616346+0000","last_change":"2024-04-25T22:40:13.594172+0000","last_active":"2024-04-25T22:40:15.616346+0000","last_peered":"2024-04-25T22:40:15.616346+0000","last_clean":"2024-04-25T22:40:15.616346+0000","last_became_active":"2024-04-25T22:40:13.593428+0000","last_became_peered":"2024-04-25T22:40:13.593428+0000","last_unstale":"2024-04-25T22:40:15.616346+0000","last_undegraded":"2024-04-25T22:40:15.616346+0000","last_fullsized":"2024-04-25T22:40:15.616346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:41:51.887162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616499+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:40:15.616499+0000","last_peered":"2024-04-25T22:40:15.616499+0000","last_clean":"2024-04-25T22:40:15.616499+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:40:15.616499+0000","last_undegraded":"2024-04-25T22:40:15.616499+0000","last_fullsized":"2024-04-25T22:40:15.616499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616446+0000","last_change":"2024-04-25T22:40:13.593659+0000","last_active":"2024-04-25T22:40:15.616446+0000","last_peered":"2024-04-25T22:40:15.616446+0000","last_clean":"2024-04-25T22:40:15.616446+0000","last_became_active":"2024-04-25T22:40:13.592874+0000","last_became_peered":"2024-04-25T22:40:13.592874+0000","last_unstale":"2024-04-25T22:40:15.616446+0000","last_undegraded":"2024-04-25T22:40:15.616446+0000","last_fullsized":"2024-04-25T22:40:15.616446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":58349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":782336,"data_stored":649895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":790528,"data_stored":650511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:40:26.111 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T22:40:26.111 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T22:40:26.111 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T22:40:26.111 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T22:40:26.475 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:26.475 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T22:40:26.494 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T22:40:26.494 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:40:26.793 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:26.793 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":19,"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","created":"2024-04-25T22:39:52.303074+0000","modified":"2024-04-25T22:40:15.597829+0000","last_up_change":"2024-04-25T22:40:01.251093+0000","last_in_change":"2024-04-25T22:39:53.230242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:40:03.197725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:40:07.560858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:40:12.431697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:40:12.919828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d465b4-5896-4d69-80b1-7e69d31eb455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6801","nonce":765118869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6803","nonce":765118869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6807","nonce":765118869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6805","nonce":765118869}]},"public_addr":"172.21.15.122:6801/765118869","cluster_addr":"172.21.15.122:6803/765118869","heartbeat_back_addr":"172.21.15.122:6807/765118869","heartbeat_front_addr":"172.21.15.122:6805/765118869","state":["exists","up"]},{"osd":1,"uuid":"8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6801","nonce":2387035286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6803","nonce":2387035286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6807","nonce":2387035286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6805","nonce":2387035286}]},"public_addr":"172.21.15.148:6801/2387035286","cluster_addr":"172.21.15.148:6803/2387035286","heartbeat_back_addr":"172.21.15.148:6807/2387035286","heartbeat_front_addr":"172.21.15.148:6805/2387035286","state":["exists","up"]},{"osd":2,"uuid":"164fc653-2135-4e9b-8826-1716fdba6ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6801","nonce":368834361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6803","nonce":368834361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6807","nonce":368834361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6805","nonce":368834361}]},"public_addr":"172.21.15.188:6801/368834361","cluster_addr":"172.21.15.188:6803/368834361","heartbeat_back_addr":"172.21.15.188:6807/368834361","heartbeat_front_addr":"172.21.15.188:6805/368834361","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.559393+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.563434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.557643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:40:26.811 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:40:03.197725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:40:07.560858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:40:12.431697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:40:12.919828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T22:40:26.812 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:40:27.105 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-04-25T22:40:27.123 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:40:27.410 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-04-25T22:40:27.428 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T22:40:27.718 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-04-25T22:40:27.735 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T22:40:28.017 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T22:40:28.034 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:40:28.348 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:28.349 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:40:13.931282+0000","modified":"2024-04-25T22:40:15.954082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4192},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4192":{"gid":4192,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6803/4101484059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":4101484059},{"type":"v1","addr":"172.21.15.57:6803","nonce":4101484059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4192,"qdb_cluster":[4192]},"id":1}]} 2024-04-25T22:40:28.349 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 5 2024-04-25T22:40:28.366 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:40:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:28.662 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":19,"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","created":"2024-04-25T22:39:52.303074+0000","modified":"2024-04-25T22:40:15.597829+0000","last_up_change":"2024-04-25T22:40:01.251093+0000","last_in_change":"2024-04-25T22:39:53.230242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:40:03.197725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:40:07.560858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:40:12.431697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:40:12.919828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d465b4-5896-4d69-80b1-7e69d31eb455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6801","nonce":765118869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6803","nonce":765118869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6807","nonce":765118869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6805","nonce":765118869}]},"public_addr":"172.21.15.122:6801/765118869","cluster_addr":"172.21.15.122:6803/765118869","heartbeat_back_addr":"172.21.15.122:6807/765118869","heartbeat_front_addr":"172.21.15.122:6805/765118869","state":["exists","up"]},{"osd":1,"uuid":"8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6801","nonce":2387035286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6803","nonce":2387035286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6807","nonce":2387035286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6805","nonce":2387035286}]},"public_addr":"172.21.15.148:6801/2387035286","cluster_addr":"172.21.15.148:6803/2387035286","heartbeat_back_addr":"172.21.15.148:6807/2387035286","heartbeat_front_addr":"172.21.15.148:6805/2387035286","state":["exists","up"]},{"osd":2,"uuid":"164fc653-2135-4e9b-8826-1716fdba6ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6801","nonce":368834361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6803","nonce":368834361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6807","nonce":368834361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6805","nonce":368834361}]},"public_addr":"172.21.15.188:6801/368834361","cluster_addr":"172.21.15.188:6803/368834361","heartbeat_back_addr":"172.21.15.188:6807/368834361","heartbeat_front_addr":"172.21.15.188:6805/368834361","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.559393+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.563434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.557643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:40:28.679 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:40:03.197725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:40:07.560858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:40:12.431697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:40:12.919828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T22:40:28.680 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:40:28.973 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-04-25T22:40:28.992 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:40:29.290 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-04-25T22:40:29.308 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T22:40:29.601 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-04-25T22:40:29.619 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T22:40:29.903 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T22:40:29.921 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:40:30.242 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:30.242 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:40:13.931282+0000","modified":"2024-04-25T22:40:15.954082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4192},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4192":{"gid":4192,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6803/4101484059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":4101484059},{"type":"v1","addr":"172.21.15.57:6803","nonce":4101484059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4192,"qdb_cluster":[4192]},"id":1}]} 2024-04-25T22:40:30.242 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 5 2024-04-25T22:40:30.260 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:40:30.558 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:30.559 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":19,"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","created":"2024-04-25T22:39:52.303074+0000","modified":"2024-04-25T22:40:15.597829+0000","last_up_change":"2024-04-25T22:40:01.251093+0000","last_in_change":"2024-04-25T22:39:53.230242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:40:03.197725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:40:07.560858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:40:12.431697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:40:12.919828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d465b4-5896-4d69-80b1-7e69d31eb455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6801","nonce":765118869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6803","nonce":765118869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6807","nonce":765118869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6805","nonce":765118869}]},"public_addr":"172.21.15.122:6801/765118869","cluster_addr":"172.21.15.122:6803/765118869","heartbeat_back_addr":"172.21.15.122:6807/765118869","heartbeat_front_addr":"172.21.15.122:6805/765118869","state":["exists","up"]},{"osd":1,"uuid":"8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6801","nonce":2387035286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6803","nonce":2387035286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6807","nonce":2387035286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6805","nonce":2387035286}]},"public_addr":"172.21.15.148:6801/2387035286","cluster_addr":"172.21.15.148:6803/2387035286","heartbeat_back_addr":"172.21.15.148:6807/2387035286","heartbeat_front_addr":"172.21.15.148:6805/2387035286","state":["exists","up"]},{"osd":2,"uuid":"164fc653-2135-4e9b-8826-1716fdba6ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6801","nonce":368834361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6803","nonce":368834361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6807","nonce":368834361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6805","nonce":368834361}]},"public_addr":"172.21.15.188:6801/368834361","cluster_addr":"172.21.15.188:6803/368834361","heartbeat_back_addr":"172.21.15.188:6807/368834361","heartbeat_front_addr":"172.21.15.188:6805/368834361","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.559393+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.563434+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.557643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:40:30.578 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:40:30.909 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:30.909 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:40:13.931282+0000","modified":"2024-04-25T22:40:15.954082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4192},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4192":{"gid":4192,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6803/4101484059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":4101484059},{"type":"v1","addr":"172.21.15.57:6803","nonce":4101484059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4192,"qdb_cluster":[4192]},"id":1}]} 2024-04-25T22:40:30.909 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 5 2024-04-25T22:40:31.027 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T22:40:13.931282+0000', 'modified': '2024-04-25T22:40:15.954082+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4192}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4192': {'gid': 4192, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6803/4101484059', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6802', 'nonce': 4101484059}, {'type': 'v1', 'addr': '172.21.15.57:6803', 'nonce': 4101484059}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4192, 'qdb_cluster': [4192]} 2024-04-25T22:40:31.027 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T22:40:31.028 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T22:40:31.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25T22:40:31.164+0000 7f12b57fa640 0 client.4466 ms_handle_reset on v2:172.21.15.57:6802/4101484059 2024-04-25T22:40:31.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25T22:40:31.184+0000 7f12b57fa640 0 client.4650 ms_handle_reset on v2:172.21.15.57:6802/4101484059 2024-04-25T22:40:31.190 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:40:31.190 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d", 2024-04-25T22:40:31.191 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2024-04-25T22:40:31.191 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4192, 2024-04-25T22:40:31.191 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2024-04-25T22:40:31.191 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2024-04-25T22:40:31.191 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2024-04-25T22:40:31.191 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 16.605652074000002, 2024-04-25T22:40:31.191 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 5, 2024-04-25T22:40:31.191 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 19, 2024-04-25T22:40:31.191 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 19, 2024-04-25T22:40:31.191 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 21.598791551000001 2024-04-25T22:40:31.191 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:40:31.207 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-25T22:40:31.218 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-25T22:40:31.218 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a'}} 2024-04-25T22:40:31.219 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-25T22:40:31.219 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-25T22:40:31.219 DEBUG:teuthology.orchestra.run.smithi057:> sync 2024-04-25T22:40:31.439 DEBUG:teuthology.orchestra.run.smithi122:> sync 2024-04-25T22:40:31.574 DEBUG:teuthology.orchestra.run.smithi148:> sync 2024-04-25T22:40:31.727 DEBUG:teuthology.orchestra.run.smithi188:> sync 2024-04-25T22:40:31.825 DEBUG:tasks.thrashosds:checking console status of smithi057 2024-04-25T22:40:31.825 DEBUG:teuthology.orchestra.console.smithi057:Waiting for login prompt 2024-04-25T22:40:31.825 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi057 2024-04-25T22:40:31.902 DEBUG:teuthology.orchestra.console.smithi057:expect before: [Enter `^Ec?' for help] 2024-04-25T22:40:31.902 DEBUG:teuthology.orchestra.console.smithi057:expect after: smithi057 login: 2024-04-25T22:40:31.955 DEBUG:teuthology.orchestra.console.smithi057:console disconnect output: [Enter `^Ec?' for help] smithi057 login: [disconnect] 2024-04-25T22:40:32.055 DEBUG:tasks.thrashosds:checking console status of smithi122 2024-04-25T22:40:32.055 DEBUG:teuthology.orchestra.console.smithi122:Waiting for login prompt 2024-04-25T22:40:32.056 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi122 2024-04-25T22:40:32.227 DEBUG:teuthology.orchestra.console.smithi122:expect before: [Enter `^Ec?' for help] 2024-04-25T22:40:32.227 DEBUG:teuthology.orchestra.console.smithi122:expect after: smithi122 login: 2024-04-25T22:40:32.280 DEBUG:teuthology.orchestra.console.smithi122:console disconnect output: [Enter `^Ec?' for help] smithi122 login: [disconnect] 2024-04-25T22:40:32.381 DEBUG:tasks.thrashosds:checking console status of smithi148 2024-04-25T22:40:32.381 DEBUG:teuthology.orchestra.console.smithi148:Waiting for login prompt 2024-04-25T22:40:32.382 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi148 2024-04-25T22:40:32.463 DEBUG:teuthology.orchestra.console.smithi148:expect before: [Enter `^Ec?' for help] 2024-04-25T22:40:32.464 DEBUG:teuthology.orchestra.console.smithi148:expect after: smithi148 login: 2024-04-25T22:40:32.516 DEBUG:teuthology.orchestra.console.smithi148:console disconnect output: [Enter `^Ec?' for help] smithi148 login: [disconnect] 2024-04-25T22:40:32.616 DEBUG:tasks.thrashosds:checking console status of smithi188 2024-04-25T22:40:32.616 DEBUG:teuthology.orchestra.console.smithi188:Waiting for login prompt 2024-04-25T22:40:32.616 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi188 2024-04-25T22:40:32.762 DEBUG:teuthology.orchestra.console.smithi188:expect before: [Enter `^Ec?' for help] 2024-04-25T22:40:32.762 DEBUG:teuthology.orchestra.console.smithi188:expect after: smithi188 login: 2024-04-25T22:40:32.814 DEBUG:teuthology.orchestra.console.smithi188:console disconnect output: [Enter `^Ec?' for help] smithi188 login: [disconnect] 2024-04-25T22:40:32.916 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-25T22:40:33.263 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-25T22:40:33.263 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T22:40:33.264 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:40:33.567 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:33.569 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:40:33.585 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-25T22:40:33.125455+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91088,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024432,"statfs":{"total":289910292480,"available":289817018368,"internally_reserved":0,"allocated":1744896,"data_stored":1358755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003946"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658899+0000","last_change":"2024-04-25T22:40:14.619087+0000","last_active":"2024-04-25T22:40:15.658899+0000","last_peered":"2024-04-25T22:40:15.658899+0000","last_clean":"2024-04-25T22:40:15.658899+0000","last_became_active":"2024-04-25T22:40:14.618067+0000","last_became_peered":"2024-04-25T22:40:14.618067+0000","last_unstale":"2024-04-25T22:40:15.658899+0000","last_undegraded":"2024-04-25T22:40:15.658899+0000","last_fullsized":"2024-04-25T22:40:15.658899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658764+0000","last_change":"2024-04-25T22:40:14.631180+0000","last_active":"2024-04-25T22:40:15.658764+0000","last_peered":"2024-04-25T22:40:15.658764+0000","last_clean":"2024-04-25T22:40:15.658764+0000","last_became_active":"2024-04-25T22:40:14.630146+0000","last_became_peered":"2024-04-25T22:40:14.630146+0000","last_unstale":"2024-04-25T22:40:15.658764+0000","last_undegraded":"2024-04-25T22:40:15.658764+0000","last_fullsized":"2024-04-25T22:40:15.658764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617601+0000","last_change":"2024-04-25T22:40:14.626211+0000","last_active":"2024-04-25T22:40:15.617601+0000","last_peered":"2024-04-25T22:40:15.617601+0000","last_clean":"2024-04-25T22:40:15.617601+0000","last_became_active":"2024-04-25T22:40:14.622625+0000","last_became_peered":"2024-04-25T22:40:14.622625+0000","last_unstale":"2024-04-25T22:40:15.617601+0000","last_undegraded":"2024-04-25T22:40:15.617601+0000","last_fullsized":"2024-04-25T22:40:15.617601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:35.993000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616593+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:40:15.616593+0000","last_peered":"2024-04-25T22:40:15.616593+0000","last_clean":"2024-04-25T22:40:15.616593+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:40:15.616593+0000","last_undegraded":"2024-04-25T22:40:15.616593+0000","last_fullsized":"2024-04-25T22:40:15.616593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659167+0000","last_change":"2024-04-25T22:40:14.616641+0000","last_active":"2024-04-25T22:40:15.659167+0000","last_peered":"2024-04-25T22:40:15.659167+0000","last_clean":"2024-04-25T22:40:15.659167+0000","last_became_active":"2024-04-25T22:40:14.615875+0000","last_became_peered":"2024-04-25T22:40:14.615875+0000","last_unstale":"2024-04-25T22:40:15.659167+0000","last_undegraded":"2024-04-25T22:40:15.659167+0000","last_fullsized":"2024-04-25T22:40:15.659167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615808+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:40:15.615808+0000","last_peered":"2024-04-25T22:40:15.615808+0000","last_clean":"2024-04-25T22:40:15.615808+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:40:15.615808+0000","last_undegraded":"2024-04-25T22:40:15.615808+0000","last_fullsized":"2024-04-25T22:40:15.615808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615514+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:40:15.615514+0000","last_peered":"2024-04-25T22:40:15.615514+0000","last_clean":"2024-04-25T22:40:15.615514+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:40:15.615514+0000","last_undegraded":"2024-04-25T22:40:15.615514+0000","last_fullsized":"2024-04-25T22:40:15.615514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615069+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:40:15.615069+0000","last_peered":"2024-04-25T22:40:15.615069+0000","last_clean":"2024-04-25T22:40:15.615069+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:40:15.615069+0000","last_undegraded":"2024-04-25T22:40:15.615069+0000","last_fullsized":"2024-04-25T22:40:15.615069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615789+0000","last_change":"2024-04-25T22:40:14.625922+0000","last_active":"2024-04-25T22:40:15.615789+0000","last_peered":"2024-04-25T22:40:15.615789+0000","last_clean":"2024-04-25T22:40:15.615789+0000","last_became_active":"2024-04-25T22:40:14.624594+0000","last_became_peered":"2024-04-25T22:40:14.624594+0000","last_unstale":"2024-04-25T22:40:15.615789+0000","last_undegraded":"2024-04-25T22:40:15.615789+0000","last_fullsized":"2024-04-25T22:40:15.615789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658392+0000","last_change":"2024-04-25T22:40:14.630083+0000","last_active":"2024-04-25T22:40:15.658392+0000","last_peered":"2024-04-25T22:40:15.658392+0000","last_clean":"2024-04-25T22:40:15.658392+0000","last_became_active":"2024-04-25T22:40:14.628633+0000","last_became_peered":"2024-04-25T22:40:14.628633+0000","last_unstale":"2024-04-25T22:40:15.658392+0000","last_undegraded":"2024-04-25T22:40:15.658392+0000","last_fullsized":"2024-04-25T22:40:15.658392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617428+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:40:15.617428+0000","last_peered":"2024-04-25T22:40:15.617428+0000","last_clean":"2024-04-25T22:40:15.617428+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:40:15.617428+0000","last_undegraded":"2024-04-25T22:40:15.617428+0000","last_fullsized":"2024-04-25T22:40:15.617428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657925+0000","last_change":"2024-04-25T22:40:14.636539+0000","last_active":"2024-04-25T22:40:15.657925+0000","last_peered":"2024-04-25T22:40:15.657925+0000","last_clean":"2024-04-25T22:40:15.657925+0000","last_became_active":"2024-04-25T22:40:14.635508+0000","last_became_peered":"2024-04-25T22:40:14.635508+0000","last_unstale":"2024-04-25T22:40:15.657925+0000","last_undegraded":"2024-04-25T22:40:15.657925+0000","last_fullsized":"2024-04-25T22:40:15.657925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:30:53.093623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658378+0000","last_change":"2024-04-25T22:40:14.620438+0000","last_active":"2024-04-25T22:40:15.658378+0000","last_peered":"2024-04-25T22:40:15.658378+0000","last_clean":"2024-04-25T22:40:15.658378+0000","last_became_active":"2024-04-25T22:40:14.619963+0000","last_became_peered":"2024-04-25T22:40:14.619963+0000","last_unstale":"2024-04-25T22:40:15.658378+0000","last_undegraded":"2024-04-25T22:40:15.658378+0000","last_fullsized":"2024-04-25T22:40:15.658378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615997+0000","last_change":"2024-04-25T22:40:14.616800+0000","last_active":"2024-04-25T22:40:15.615997+0000","last_peered":"2024-04-25T22:40:15.615997+0000","last_clean":"2024-04-25T22:40:15.615997+0000","last_became_active":"2024-04-25T22:40:14.612887+0000","last_became_peered":"2024-04-25T22:40:14.612887+0000","last_unstale":"2024-04-25T22:40:15.615997+0000","last_undegraded":"2024-04-25T22:40:15.615997+0000","last_fullsized":"2024-04-25T22:40:15.615997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615601+0000","last_change":"2024-04-25T22:40:14.615520+0000","last_active":"2024-04-25T22:40:15.615601+0000","last_peered":"2024-04-25T22:40:15.615601+0000","last_clean":"2024-04-25T22:40:15.615601+0000","last_became_active":"2024-04-25T22:40:14.613556+0000","last_became_peered":"2024-04-25T22:40:14.613556+0000","last_unstale":"2024-04-25T22:40:15.615601+0000","last_undegraded":"2024-04-25T22:40:15.615601+0000","last_fullsized":"2024-04-25T22:40:15.615601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615171+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:40:15.615171+0000","last_peered":"2024-04-25T22:40:15.615171+0000","last_clean":"2024-04-25T22:40:15.615171+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:40:15.615171+0000","last_undegraded":"2024-04-25T22:40:15.615171+0000","last_fullsized":"2024-04-25T22:40:15.615171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616907+0000","last_change":"2024-04-25T22:40:14.628222+0000","last_active":"2024-04-25T22:40:15.616907+0000","last_peered":"2024-04-25T22:40:15.616907+0000","last_clean":"2024-04-25T22:40:15.616907+0000","last_became_active":"2024-04-25T22:40:14.626913+0000","last_became_peered":"2024-04-25T22:40:14.626913+0000","last_unstale":"2024-04-25T22:40:15.616907+0000","last_undegraded":"2024-04-25T22:40:15.616907+0000","last_fullsized":"2024-04-25T22:40:15.616907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659087+0000","last_change":"2024-04-25T22:40:14.629506+0000","last_active":"2024-04-25T22:40:15.659087+0000","last_peered":"2024-04-25T22:40:15.659087+0000","last_clean":"2024-04-25T22:40:15.659087+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:40:15.659087+0000","last_undegraded":"2024-04-25T22:40:15.659087+0000","last_fullsized":"2024-04-25T22:40:15.659087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615553+0000","last_change":"2024-04-25T22:40:14.623704+0000","last_active":"2024-04-25T22:40:15.615553+0000","last_peered":"2024-04-25T22:40:15.615553+0000","last_clean":"2024-04-25T22:40:15.615553+0000","last_became_active":"2024-04-25T22:40:14.623146+0000","last_became_peered":"2024-04-25T22:40:14.623146+0000","last_unstale":"2024-04-25T22:40:15.615553+0000","last_undegraded":"2024-04-25T22:40:15.615553+0000","last_fullsized":"2024-04-25T22:40:15.615553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616610+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:40:15.616610+0000","last_peered":"2024-04-25T22:40:15.616610+0000","last_clean":"2024-04-25T22:40:15.616610+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:40:15.616610+0000","last_undegraded":"2024-04-25T22:40:15.616610+0000","last_fullsized":"2024-04-25T22:40:15.616610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618087+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:40:15.618087+0000","last_peered":"2024-04-25T22:40:15.618087+0000","last_clean":"2024-04-25T22:40:15.618087+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:40:15.618087+0000","last_undegraded":"2024-04-25T22:40:15.618087+0000","last_fullsized":"2024-04-25T22:40:15.618087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657153+0000","last_change":"2024-04-25T22:40:14.636703+0000","last_active":"2024-04-25T22:40:15.657153+0000","last_peered":"2024-04-25T22:40:15.657153+0000","last_clean":"2024-04-25T22:40:15.657153+0000","last_became_active":"2024-04-25T22:40:14.635943+0000","last_became_peered":"2024-04-25T22:40:14.635943+0000","last_unstale":"2024-04-25T22:40:15.657153+0000","last_undegraded":"2024-04-25T22:40:15.657153+0000","last_fullsized":"2024-04-25T22:40:15.657153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:45:57.862599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.613539+0000","last_change":"2024-04-25T22:40:14.617094+0000","last_active":"2024-04-25T22:40:15.613539+0000","last_peered":"2024-04-25T22:40:15.613539+0000","last_clean":"2024-04-25T22:40:15.613539+0000","last_became_active":"2024-04-25T22:40:14.615818+0000","last_became_peered":"2024-04-25T22:40:14.615818+0000","last_unstale":"2024-04-25T22:40:15.613539+0000","last_undegraded":"2024-04-25T22:40:15.613539+0000","last_fullsized":"2024-04-25T22:40:15.613539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:30:53.093623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.656876+0000","last_change":"2024-04-25T22:40:14.619013+0000","last_active":"2024-04-25T22:40:15.656876+0000","last_peered":"2024-04-25T22:40:15.656876+0000","last_clean":"2024-04-25T22:40:15.656876+0000","last_became_active":"2024-04-25T22:40:14.618184+0000","last_became_peered":"2024-04-25T22:40:14.618184+0000","last_unstale":"2024-04-25T22:40:15.656876+0000","last_undegraded":"2024-04-25T22:40:15.656876+0000","last_fullsized":"2024-04-25T22:40:15.656876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:34:40.281445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659068+0000","last_change":"2024-04-25T22:40:14.622357+0000","last_active":"2024-04-25T22:40:15.659068+0000","last_peered":"2024-04-25T22:40:15.659068+0000","last_clean":"2024-04-25T22:40:15.659068+0000","last_became_active":"2024-04-25T22:40:14.621617+0000","last_became_peered":"2024-04-25T22:40:14.621617+0000","last_unstale":"2024-04-25T22:40:15.659068+0000","last_undegraded":"2024-04-25T22:40:15.659068+0000","last_fullsized":"2024-04-25T22:40:15.659068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615978+0000","last_change":"2024-04-25T22:40:14.625933+0000","last_active":"2024-04-25T22:40:15.615978+0000","last_peered":"2024-04-25T22:40:15.615978+0000","last_clean":"2024-04-25T22:40:15.615978+0000","last_became_active":"2024-04-25T22:40:14.625123+0000","last_became_peered":"2024-04-25T22:40:14.625123+0000","last_unstale":"2024-04-25T22:40:15.615978+0000","last_undegraded":"2024-04-25T22:40:15.615978+0000","last_fullsized":"2024-04-25T22:40:15.615978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618233+0000","last_change":"2024-04-25T22:40:14.630596+0000","last_active":"2024-04-25T22:40:15.618233+0000","last_peered":"2024-04-25T22:40:15.618233+0000","last_clean":"2024-04-25T22:40:15.618233+0000","last_became_active":"2024-04-25T22:40:14.625407+0000","last_became_peered":"2024-04-25T22:40:14.625407+0000","last_unstale":"2024-04-25T22:40:15.618233+0000","last_undegraded":"2024-04-25T22:40:15.618233+0000","last_fullsized":"2024-04-25T22:40:15.618233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:20:05.398182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658859+0000","last_change":"2024-04-25T22:40:14.636526+0000","last_active":"2024-04-25T22:40:15.658859+0000","last_peered":"2024-04-25T22:40:15.658859+0000","last_clean":"2024-04-25T22:40:15.658859+0000","last_became_active":"2024-04-25T22:40:14.635539+0000","last_became_peered":"2024-04-25T22:40:14.635539+0000","last_unstale":"2024-04-25T22:40:15.658859+0000","last_undegraded":"2024-04-25T22:40:15.658859+0000","last_fullsized":"2024-04-25T22:40:15.658859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614790+0000","last_change":"2024-04-25T22:40:14.620608+0000","last_active":"2024-04-25T22:40:15.614790+0000","last_peered":"2024-04-25T22:40:15.614790+0000","last_clean":"2024-04-25T22:40:15.614790+0000","last_became_active":"2024-04-25T22:40:14.618171+0000","last_became_peered":"2024-04-25T22:40:14.618171+0000","last_unstale":"2024-04-25T22:40:15.614790+0000","last_undegraded":"2024-04-25T22:40:15.614790+0000","last_fullsized":"2024-04-25T22:40:15.614790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657864+0000","last_change":"2024-04-25T22:40:14.622961+0000","last_active":"2024-04-25T22:40:15.657864+0000","last_peered":"2024-04-25T22:40:15.657864+0000","last_clean":"2024-04-25T22:40:15.657864+0000","last_became_active":"2024-04-25T22:40:14.622238+0000","last_became_peered":"2024-04-25T22:40:14.622238+0000","last_unstale":"2024-04-25T22:40:15.657864+0000","last_undegraded":"2024-04-25T22:40:15.657864+0000","last_fullsized":"2024-04-25T22:40:15.657864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:09.125174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.613760+0000","last_change":"2024-04-25T22:40:14.618468+0000","last_active":"2024-04-25T22:40:15.613760+0000","last_peered":"2024-04-25T22:40:15.613760+0000","last_clean":"2024-04-25T22:40:15.613760+0000","last_became_active":"2024-04-25T22:40:14.617312+0000","last_became_peered":"2024-04-25T22:40:14.617312+0000","last_unstale":"2024-04-25T22:40:15.613760+0000","last_undegraded":"2024-04-25T22:40:15.613760+0000","last_fullsized":"2024-04-25T22:40:15.613760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:12.679354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615544+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:40:15.615544+0000","last_peered":"2024-04-25T22:40:15.615544+0000","last_clean":"2024-04-25T22:40:15.615544+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:40:15.615544+0000","last_undegraded":"2024-04-25T22:40:15.615544+0000","last_fullsized":"2024-04-25T22:40:15.615544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658398+0000","last_change":"2024-04-25T22:40:14.613553+0000","last_active":"2024-04-25T22:40:15.658398+0000","last_peered":"2024-04-25T22:40:15.658398+0000","last_clean":"2024-04-25T22:40:15.658398+0000","last_became_active":"2024-04-25T22:40:14.612857+0000","last_became_peered":"2024-04-25T22:40:14.612857+0000","last_unstale":"2024-04-25T22:40:15.658398+0000","last_undegraded":"2024-04-25T22:40:15.658398+0000","last_fullsized":"2024-04-25T22:40:15.658398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617134+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:40:15.617134+0000","last_peered":"2024-04-25T22:40:15.617134+0000","last_clean":"2024-04-25T22:40:15.617134+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:40:15.617134+0000","last_undegraded":"2024-04-25T22:40:15.617134+0000","last_fullsized":"2024-04-25T22:40:15.617134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.660077+0000","last_change":"2024-04-25T22:40:14.618292+0000","last_active":"2024-04-25T22:40:15.660077+0000","last_peered":"2024-04-25T22:40:15.660077+0000","last_clean":"2024-04-25T22:40:15.660077+0000","last_became_active":"2024-04-25T22:40:14.616712+0000","last_became_peered":"2024-04-25T22:40:14.616712+0000","last_unstale":"2024-04-25T22:40:15.660077+0000","last_undegraded":"2024-04-25T22:40:15.660077+0000","last_fullsized":"2024-04-25T22:40:15.660077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614211+0000","last_change":"2024-04-25T22:40:13.581241+0000","last_active":"2024-04-25T22:40:15.614211+0000","last_peered":"2024-04-25T22:40:15.614211+0000","last_clean":"2024-04-25T22:40:15.614211+0000","last_became_active":"2024-04-25T22:40:13.580442+0000","last_became_peered":"2024-04-25T22:40:13.580442+0000","last_unstale":"2024-04-25T22:40:15.614211+0000","last_undegraded":"2024-04-25T22:40:15.614211+0000","last_fullsized":"2024-04-25T22:40:15.614211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:50:49.280995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616561+0000","last_change":"2024-04-25T22:40:14.631577+0000","last_active":"2024-04-25T22:40:15.616561+0000","last_peered":"2024-04-25T22:40:15.616561+0000","last_clean":"2024-04-25T22:40:15.616561+0000","last_became_active":"2024-04-25T22:40:14.630371+0000","last_became_peered":"2024-04-25T22:40:14.630371+0000","last_unstale":"2024-04-25T22:40:15.616561+0000","last_undegraded":"2024-04-25T22:40:15.616561+0000","last_fullsized":"2024-04-25T22:40:15.616561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657258+0000","last_change":"2024-04-25T22:40:13.599838+0000","last_active":"2024-04-25T22:40:15.657258+0000","last_peered":"2024-04-25T22:40:15.657258+0000","last_clean":"2024-04-25T22:40:15.657258+0000","last_became_active":"2024-04-25T22:40:13.599001+0000","last_became_peered":"2024-04-25T22:40:13.599001+0000","last_unstale":"2024-04-25T22:40:15.657258+0000","last_undegraded":"2024-04-25T22:40:15.657258+0000","last_fullsized":"2024-04-25T22:40:15.657258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:16.993188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616081+0000","last_change":"2024-04-25T22:40:14.630012+0000","last_active":"2024-04-25T22:40:15.616081+0000","last_peered":"2024-04-25T22:40:15.616081+0000","last_clean":"2024-04-25T22:40:15.616081+0000","last_became_active":"2024-04-25T22:40:14.628677+0000","last_became_peered":"2024-04-25T22:40:14.628677+0000","last_unstale":"2024-04-25T22:40:15.616081+0000","last_undegraded":"2024-04-25T22:40:15.616081+0000","last_fullsized":"2024-04-25T22:40:15.616081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615558+0000","last_change":"2024-04-25T22:40:13.599918+0000","last_active":"2024-04-25T22:40:15.615558+0000","last_peered":"2024-04-25T22:40:15.615558+0000","last_clean":"2024-04-25T22:40:15.615558+0000","last_became_active":"2024-04-25T22:40:13.596461+0000","last_became_peered":"2024-04-25T22:40:13.596461+0000","last_unstale":"2024-04-25T22:40:15.615558+0000","last_undegraded":"2024-04-25T22:40:15.615558+0000","last_fullsized":"2024-04-25T22:40:15.615558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:41:51.887162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618201+0000","last_change":"2024-04-25T22:40:13.598294+0000","last_active":"2024-04-25T22:40:15.618201+0000","last_peered":"2024-04-25T22:40:15.618201+0000","last_clean":"2024-04-25T22:40:15.618201+0000","last_became_active":"2024-04-25T22:40:13.596687+0000","last_became_peered":"2024-04-25T22:40:13.596687+0000","last_unstale":"2024-04-25T22:40:15.618201+0000","last_undegraded":"2024-04-25T22:40:15.618201+0000","last_fullsized":"2024-04-25T22:40:15.618201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:50:49.280995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.656904+0000","last_change":"2024-04-25T22:40:14.625171+0000","last_active":"2024-04-25T22:40:15.656904+0000","last_peered":"2024-04-25T22:40:15.656904+0000","last_clean":"2024-04-25T22:40:15.656904+0000","last_became_active":"2024-04-25T22:40:14.624473+0000","last_became_peered":"2024-04-25T22:40:14.624473+0000","last_unstale":"2024-04-25T22:40:15.656904+0000","last_undegraded":"2024-04-25T22:40:15.656904+0000","last_fullsized":"2024-04-25T22:40:15.656904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:30.591624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659343+0000","last_change":"2024-04-25T22:40:13.599189+0000","last_active":"2024-04-25T22:40:15.659343+0000","last_peered":"2024-04-25T22:40:15.659343+0000","last_clean":"2024-04-25T22:40:15.659343+0000","last_became_active":"2024-04-25T22:40:13.598289+0000","last_became_peered":"2024-04-25T22:40:13.598289+0000","last_unstale":"2024-04-25T22:40:15.659343+0000","last_undegraded":"2024-04-25T22:40:15.659343+0000","last_fullsized":"2024-04-25T22:40:15.659343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:05:28.535490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657030+0000","last_change":"2024-04-25T22:40:14.618478+0000","last_active":"2024-04-25T22:40:15.657030+0000","last_peered":"2024-04-25T22:40:15.657030+0000","last_clean":"2024-04-25T22:40:15.657030+0000","last_became_active":"2024-04-25T22:40:14.617688+0000","last_became_peered":"2024-04-25T22:40:14.617688+0000","last_unstale":"2024-04-25T22:40:15.657030+0000","last_undegraded":"2024-04-25T22:40:15.657030+0000","last_fullsized":"2024-04-25T22:40:15.657030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:39:44.762240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618805+0000","last_change":"2024-04-25T22:40:13.601404+0000","last_active":"2024-04-25T22:40:15.618805+0000","last_peered":"2024-04-25T22:40:15.618805+0000","last_clean":"2024-04-25T22:40:15.618805+0000","last_became_active":"2024-04-25T22:40:13.600688+0000","last_became_peered":"2024-04-25T22:40:13.600688+0000","last_unstale":"2024-04-25T22:40:15.618805+0000","last_undegraded":"2024-04-25T22:40:15.618805+0000","last_fullsized":"2024-04-25T22:40:15.618805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:36.157648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616497+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:40:15.616497+0000","last_peered":"2024-04-25T22:40:15.616497+0000","last_clean":"2024-04-25T22:40:15.616497+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:40:15.616497+0000","last_undegraded":"2024-04-25T22:40:15.616497+0000","last_fullsized":"2024-04-25T22:40:15.616497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617642+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:40:15.617642+0000","last_peered":"2024-04-25T22:40:15.617642+0000","last_clean":"2024-04-25T22:40:15.617642+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:40:15.617642+0000","last_undegraded":"2024-04-25T22:40:15.617642+0000","last_fullsized":"2024-04-25T22:40:15.617642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615001+0000","last_change":"2024-04-25T22:40:14.625843+0000","last_active":"2024-04-25T22:40:15.615001+0000","last_peered":"2024-04-25T22:40:15.615001+0000","last_clean":"2024-04-25T22:40:15.615001+0000","last_became_active":"2024-04-25T22:40:14.625187+0000","last_became_peered":"2024-04-25T22:40:14.625187+0000","last_unstale":"2024-04-25T22:40:15.615001+0000","last_undegraded":"2024-04-25T22:40:15.615001+0000","last_fullsized":"2024-04-25T22:40:15.615001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615306+0000","last_change":"2024-04-25T22:40:13.581857+0000","last_active":"2024-04-25T22:40:15.615306+0000","last_peered":"2024-04-25T22:40:15.615306+0000","last_clean":"2024-04-25T22:40:15.615306+0000","last_became_active":"2024-04-25T22:40:13.581263+0000","last_became_peered":"2024-04-25T22:40:13.581263+0000","last_unstale":"2024-04-25T22:40:15.615306+0000","last_undegraded":"2024-04-25T22:40:15.615306+0000","last_fullsized":"2024-04-25T22:40:15.615306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:54:01.709709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617001+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:40:15.617001+0000","last_peered":"2024-04-25T22:40:15.617001+0000","last_clean":"2024-04-25T22:40:15.617001+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:40:15.617001+0000","last_undegraded":"2024-04-25T22:40:15.617001+0000","last_fullsized":"2024-04-25T22:40:15.617001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616780+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:40:15.616780+0000","last_peered":"2024-04-25T22:40:15.616780+0000","last_clean":"2024-04-25T22:40:15.616780+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:40:15.616780+0000","last_undegraded":"2024-04-25T22:40:15.616780+0000","last_fullsized":"2024-04-25T22:40:15.616780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618553+0000","last_change":"2024-04-25T22:40:14.621941+0000","last_active":"2024-04-25T22:40:15.618553+0000","last_peered":"2024-04-25T22:40:15.618553+0000","last_clean":"2024-04-25T22:40:15.618553+0000","last_became_active":"2024-04-25T22:40:14.614196+0000","last_became_peered":"2024-04-25T22:40:14.614196+0000","last_unstale":"2024-04-25T22:40:15.618553+0000","last_undegraded":"2024-04-25T22:40:15.618553+0000","last_fullsized":"2024-04-25T22:40:15.618553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:24.895025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657287+0000","last_change":"2024-04-25T22:40:13.599695+0000","last_active":"2024-04-25T22:40:15.657287+0000","last_peered":"2024-04-25T22:40:15.657287+0000","last_clean":"2024-04-25T22:40:15.657287+0000","last_became_active":"2024-04-25T22:40:13.598805+0000","last_became_peered":"2024-04-25T22:40:13.598805+0000","last_unstale":"2024-04-25T22:40:15.657287+0000","last_undegraded":"2024-04-25T22:40:15.657287+0000","last_fullsized":"2024-04-25T22:40:15.657287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:56.307032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617569+0000","last_change":"2024-04-25T22:40:14.614275+0000","last_active":"2024-04-25T22:40:15.617569+0000","last_peered":"2024-04-25T22:40:15.617569+0000","last_clean":"2024-04-25T22:40:15.617569+0000","last_became_active":"2024-04-25T22:40:14.613038+0000","last_became_peered":"2024-04-25T22:40:14.613038+0000","last_unstale":"2024-04-25T22:40:15.617569+0000","last_undegraded":"2024-04-25T22:40:15.617569+0000","last_fullsized":"2024-04-25T22:40:15.617569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:14:02.343388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657203+0000","last_change":"2024-04-25T22:40:13.597555+0000","last_active":"2024-04-25T22:40:15.657203+0000","last_peered":"2024-04-25T22:40:15.657203+0000","last_clean":"2024-04-25T22:40:15.657203+0000","last_became_active":"2024-04-25T22:40:13.596623+0000","last_became_peered":"2024-04-25T22:40:13.596623+0000","last_unstale":"2024-04-25T22:40:15.657203+0000","last_undegraded":"2024-04-25T22:40:15.657203+0000","last_fullsized":"2024-04-25T22:40:15.657203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:29:00.157478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616173+0000","last_change":"2024-04-25T22:40:14.627280+0000","last_active":"2024-04-25T22:40:15.616173+0000","last_peered":"2024-04-25T22:40:15.616173+0000","last_clean":"2024-04-25T22:40:15.616173+0000","last_became_active":"2024-04-25T22:40:14.624656+0000","last_became_peered":"2024-04-25T22:40:14.624656+0000","last_unstale":"2024-04-25T22:40:15.616173+0000","last_undegraded":"2024-04-25T22:40:15.616173+0000","last_fullsized":"2024-04-25T22:40:15.616173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":222,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616001+0000","last_change":"2024-04-25T22:40:04.317146+0000","last_active":"2024-04-25T22:40:15.616001+0000","last_peered":"2024-04-25T22:40:15.616001+0000","last_clean":"2024-04-25T22:40:15.616001+0000","last_became_active":"2024-04-25T22:40:04.316527+0000","last_became_peered":"2024-04-25T22:40:04.316527+0000","last_unstale":"2024-04-25T22:40:15.616001+0000","last_undegraded":"2024-04-25T22:40:15.616001+0000","last_fullsized":"2024-04-25T22:40:15.616001+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:25.669997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617484+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:40:15.617484+0000","last_peered":"2024-04-25T22:40:15.617484+0000","last_clean":"2024-04-25T22:40:15.617484+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:40:15.617484+0000","last_undegraded":"2024-04-25T22:40:15.617484+0000","last_fullsized":"2024-04-25T22:40:15.617484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614355+0000","last_change":"2024-04-25T22:40:13.591980+0000","last_active":"2024-04-25T22:40:15.614355+0000","last_peered":"2024-04-25T22:40:15.614355+0000","last_clean":"2024-04-25T22:40:15.614355+0000","last_became_active":"2024-04-25T22:40:13.591152+0000","last_became_peered":"2024-04-25T22:40:13.591152+0000","last_unstale":"2024-04-25T22:40:15.614355+0000","last_undegraded":"2024-04-25T22:40:15.614355+0000","last_fullsized":"2024-04-25T22:40:15.614355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618637+0000","last_change":"2024-04-25T22:40:14.621472+0000","last_active":"2024-04-25T22:40:15.618637+0000","last_peered":"2024-04-25T22:40:15.618637+0000","last_clean":"2024-04-25T22:40:15.618637+0000","last_became_active":"2024-04-25T22:40:14.613608+0000","last_became_peered":"2024-04-25T22:40:14.613608+0000","last_unstale":"2024-04-25T22:40:15.618637+0000","last_undegraded":"2024-04-25T22:40:15.618637+0000","last_fullsized":"2024-04-25T22:40:15.618637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:51.686908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615728+0000","last_change":"2024-04-25T22:40:09.502444+0000","last_active":"2024-04-25T22:40:15.615728+0000","last_peered":"2024-04-25T22:40:15.615728+0000","last_clean":"2024-04-25T22:40:15.615728+0000","last_became_active":"2024-04-25T22:40:09.501576+0000","last_became_peered":"2024-04-25T22:40:09.501576+0000","last_unstale":"2024-04-25T22:40:15.615728+0000","last_undegraded":"2024-04-25T22:40:15.615728+0000","last_fullsized":"2024-04-25T22:40:15.615728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:35:14.955359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614468+0000","last_change":"2024-04-25T22:40:13.579430+0000","last_active":"2024-04-25T22:40:15.614468+0000","last_peered":"2024-04-25T22:40:15.614468+0000","last_clean":"2024-04-25T22:40:15.614468+0000","last_became_active":"2024-04-25T22:40:13.578601+0000","last_became_peered":"2024-04-25T22:40:13.578601+0000","last_unstale":"2024-04-25T22:40:15.614468+0000","last_undegraded":"2024-04-25T22:40:15.614468+0000","last_fullsized":"2024-04-25T22:40:15.614468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:50.274924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658863+0000","last_change":"2024-04-25T22:40:14.628709+0000","last_active":"2024-04-25T22:40:15.658863+0000","last_peered":"2024-04-25T22:40:15.658863+0000","last_clean":"2024-04-25T22:40:15.658863+0000","last_became_active":"2024-04-25T22:40:14.627641+0000","last_became_peered":"2024-04-25T22:40:14.627641+0000","last_unstale":"2024-04-25T22:40:15.658863+0000","last_undegraded":"2024-04-25T22:40:15.658863+0000","last_fullsized":"2024-04-25T22:40:15.658863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614614+0000","last_change":"2024-04-25T22:40:09.501323+0000","last_active":"2024-04-25T22:40:15.614614+0000","last_peered":"2024-04-25T22:40:15.614614+0000","last_clean":"2024-04-25T22:40:15.614614+0000","last_became_active":"2024-04-25T22:40:09.500499+0000","last_became_peered":"2024-04-25T22:40:09.500499+0000","last_unstale":"2024-04-25T22:40:15.614614+0000","last_undegraded":"2024-04-25T22:40:15.614614+0000","last_fullsized":"2024-04-25T22:40:15.614614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:30.289572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657249+0000","last_change":"2024-04-25T22:40:13.599332+0000","last_active":"2024-04-25T22:40:15.657249+0000","last_peered":"2024-04-25T22:40:15.657249+0000","last_clean":"2024-04-25T22:40:15.657249+0000","last_became_active":"2024-04-25T22:40:13.598689+0000","last_became_peered":"2024-04-25T22:40:13.598689+0000","last_unstale":"2024-04-25T22:40:15.657249+0000","last_undegraded":"2024-04-25T22:40:15.657249+0000","last_fullsized":"2024-04-25T22:40:15.657249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:36.875346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616453+0000","last_change":"2024-04-25T22:40:14.628007+0000","last_active":"2024-04-25T22:40:15.616453+0000","last_peered":"2024-04-25T22:40:15.616453+0000","last_clean":"2024-04-25T22:40:15.616453+0000","last_became_active":"2024-04-25T22:40:14.625425+0000","last_became_peered":"2024-04-25T22:40:14.625425+0000","last_unstale":"2024-04-25T22:40:15.616453+0000","last_undegraded":"2024-04-25T22:40:15.616453+0000","last_fullsized":"2024-04-25T22:40:15.616453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616734+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:40:15.616734+0000","last_peered":"2024-04-25T22:40:15.616734+0000","last_clean":"2024-04-25T22:40:15.616734+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:40:15.616734+0000","last_undegraded":"2024-04-25T22:40:15.616734+0000","last_fullsized":"2024-04-25T22:40:15.616734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617401+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:40:15.617401+0000","last_peered":"2024-04-25T22:40:15.617401+0000","last_clean":"2024-04-25T22:40:15.617401+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:40:15.617401+0000","last_undegraded":"2024-04-25T22:40:15.617401+0000","last_fullsized":"2024-04-25T22:40:15.617401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615641+0000","last_change":"2024-04-25T22:40:14.622442+0000","last_active":"2024-04-25T22:40:15.615641+0000","last_peered":"2024-04-25T22:40:15.615641+0000","last_clean":"2024-04-25T22:40:15.615641+0000","last_became_active":"2024-04-25T22:40:14.621130+0000","last_became_peered":"2024-04-25T22:40:14.621130+0000","last_unstale":"2024-04-25T22:40:15.615641+0000","last_undegraded":"2024-04-25T22:40:15.615641+0000","last_fullsized":"2024-04-25T22:40:15.615641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618860+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:40:15.618860+0000","last_peered":"2024-04-25T22:40:15.618860+0000","last_clean":"2024-04-25T22:40:15.618860+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:40:15.618860+0000","last_undegraded":"2024-04-25T22:40:15.618860+0000","last_fullsized":"2024-04-25T22:40:15.618860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615725+0000","last_change":"2024-04-25T22:40:09.501325+0000","last_active":"2024-04-25T22:40:15.615725+0000","last_peered":"2024-04-25T22:40:15.615725+0000","last_clean":"2024-04-25T22:40:15.615725+0000","last_became_active":"2024-04-25T22:40:09.500542+0000","last_became_peered":"2024-04-25T22:40:09.500542+0000","last_unstale":"2024-04-25T22:40:15.615725+0000","last_undegraded":"2024-04-25T22:40:15.615725+0000","last_fullsized":"2024-04-25T22:40:15.615725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:34:38.234538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657224+0000","last_change":"2024-04-25T22:40:14.636726+0000","last_active":"2024-04-25T22:40:15.657224+0000","last_peered":"2024-04-25T22:40:15.657224+0000","last_clean":"2024-04-25T22:40:15.657224+0000","last_became_active":"2024-04-25T22:40:14.636013+0000","last_became_peered":"2024-04-25T22:40:14.636013+0000","last_unstale":"2024-04-25T22:40:15.657224+0000","last_undegraded":"2024-04-25T22:40:15.657224+0000","last_fullsized":"2024-04-25T22:40:15.657224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:35.910752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615587+0000","last_change":"2024-04-25T22:40:13.591256+0000","last_active":"2024-04-25T22:40:15.615587+0000","last_peered":"2024-04-25T22:40:15.615587+0000","last_clean":"2024-04-25T22:40:15.615587+0000","last_became_active":"2024-04-25T22:40:13.590744+0000","last_became_peered":"2024-04-25T22:40:13.590744+0000","last_unstale":"2024-04-25T22:40:15.615587+0000","last_undegraded":"2024-04-25T22:40:15.615587+0000","last_fullsized":"2024-04-25T22:40:15.615587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:50.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.660294+0000","last_change":"2024-04-25T22:40:09.501163+0000","last_active":"2024-04-25T22:40:15.660294+0000","last_peered":"2024-04-25T22:40:15.660294+0000","last_clean":"2024-04-25T22:40:15.660294+0000","last_became_active":"2024-04-25T22:40:09.500492+0000","last_became_peered":"2024-04-25T22:40:09.500492+0000","last_unstale":"2024-04-25T22:40:15.660294+0000","last_undegraded":"2024-04-25T22:40:15.660294+0000","last_fullsized":"2024-04-25T22:40:15.660294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:22.822616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658264+0000","last_change":"2024-04-25T22:40:14.638662+0000","last_active":"2024-04-25T22:40:15.658264+0000","last_peered":"2024-04-25T22:40:15.658264+0000","last_clean":"2024-04-25T22:40:15.658264+0000","last_became_active":"2024-04-25T22:40:14.638060+0000","last_became_peered":"2024-04-25T22:40:14.638060+0000","last_unstale":"2024-04-25T22:40:15.658264+0000","last_undegraded":"2024-04-25T22:40:15.658264+0000","last_fullsized":"2024-04-25T22:40:15.658264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:12.679354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616939+0000","last_change":"2024-04-25T22:40:13.592055+0000","last_active":"2024-04-25T22:40:15.616939+0000","last_peered":"2024-04-25T22:40:15.616939+0000","last_clean":"2024-04-25T22:40:15.616939+0000","last_became_active":"2024-04-25T22:40:13.591169+0000","last_became_peered":"2024-04-25T22:40:13.591169+0000","last_unstale":"2024-04-25T22:40:15.616939+0000","last_undegraded":"2024-04-25T22:40:15.616939+0000","last_fullsized":"2024-04-25T22:40:15.616939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:33.458799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616687+0000","last_change":"2024-04-25T22:40:09.501358+0000","last_active":"2024-04-25T22:40:15.616687+0000","last_peered":"2024-04-25T22:40:15.616687+0000","last_clean":"2024-04-25T22:40:15.616687+0000","last_became_active":"2024-04-25T22:40:09.500626+0000","last_became_peered":"2024-04-25T22:40:09.500626+0000","last_unstale":"2024-04-25T22:40:15.616687+0000","last_undegraded":"2024-04-25T22:40:15.616687+0000","last_fullsized":"2024-04-25T22:40:15.616687+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:55.182967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.613952+0000","last_change":"2024-04-25T22:40:14.618363+0000","last_active":"2024-04-25T22:40:15.613952+0000","last_peered":"2024-04-25T22:40:15.613952+0000","last_clean":"2024-04-25T22:40:15.613952+0000","last_became_active":"2024-04-25T22:40:14.617599+0000","last_became_peered":"2024-04-25T22:40:14.617599+0000","last_unstale":"2024-04-25T22:40:15.613952+0000","last_undegraded":"2024-04-25T22:40:15.613952+0000","last_fullsized":"2024-04-25T22:40:15.613952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:16.594231+0000","last_change":"2024-04-25T22:40:13.593400+0000","last_active":"2024-04-25T22:40:16.594231+0000","last_peered":"2024-04-25T22:40:16.594231+0000","last_clean":"2024-04-25T22:40:16.594231+0000","last_became_active":"2024-04-25T22:40:13.592338+0000","last_became_peered":"2024-04-25T22:40:13.592338+0000","last_unstale":"2024-04-25T22:40:16.594231+0000","last_undegraded":"2024-04-25T22:40:16.594231+0000","last_fullsized":"2024-04-25T22:40:16.594231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618220+0000","last_change":"2024-04-25T22:40:09.500948+0000","last_active":"2024-04-25T22:40:15.618220+0000","last_peered":"2024-04-25T22:40:15.618220+0000","last_clean":"2024-04-25T22:40:15.618220+0000","last_became_active":"2024-04-25T22:40:09.500236+0000","last_became_peered":"2024-04-25T22:40:09.500236+0000","last_unstale":"2024-04-25T22:40:15.618220+0000","last_undegraded":"2024-04-25T22:40:15.618220+0000","last_fullsized":"2024-04-25T22:40:15.618220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:02.375961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657009+0000","last_change":"2024-04-25T22:40:14.623882+0000","last_active":"2024-04-25T22:40:15.657009+0000","last_peered":"2024-04-25T22:40:15.657009+0000","last_clean":"2024-04-25T22:40:15.657009+0000","last_became_active":"2024-04-25T22:40:14.623090+0000","last_became_peered":"2024-04-25T22:40:14.623090+0000","last_unstale":"2024-04-25T22:40:15.657009+0000","last_undegraded":"2024-04-25T22:40:15.657009+0000","last_fullsized":"2024-04-25T22:40:15.657009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:52.116132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616663+0000","last_change":"2024-04-25T22:40:14.619806+0000","last_active":"2024-04-25T22:40:15.616663+0000","last_peered":"2024-04-25T22:40:15.616663+0000","last_clean":"2024-04-25T22:40:15.616663+0000","last_became_active":"2024-04-25T22:40:14.618980+0000","last_became_peered":"2024-04-25T22:40:14.618980+0000","last_unstale":"2024-04-25T22:40:15.616663+0000","last_undegraded":"2024-04-25T22:40:15.616663+0000","last_fullsized":"2024-04-25T22:40:15.616663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617318+0000","last_change":"2024-04-25T22:40:13.598003+0000","last_active":"2024-04-25T22:40:15.617318+0000","last_peered":"2024-04-25T22:40:15.617318+0000","last_clean":"2024-04-25T22:40:15.617318+0000","last_became_active":"2024-04-25T22:40:13.596631+0000","last_became_peered":"2024-04-25T22:40:13.596631+0000","last_unstale":"2024-04-25T22:40:15.617318+0000","last_undegraded":"2024-04-25T22:40:15.617318+0000","last_fullsized":"2024-04-25T22:40:15.617318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:50.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614024+0000","last_change":"2024-04-25T22:40:14.620064+0000","last_active":"2024-04-25T22:40:15.614024+0000","last_peered":"2024-04-25T22:40:15.614024+0000","last_clean":"2024-04-25T22:40:15.614024+0000","last_became_active":"2024-04-25T22:40:14.619294+0000","last_became_peered":"2024-04-25T22:40:14.619294+0000","last_unstale":"2024-04-25T22:40:15.614024+0000","last_undegraded":"2024-04-25T22:40:15.614024+0000","last_fullsized":"2024-04-25T22:40:15.614024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.660194+0000","last_change":"2024-04-25T22:40:13.600050+0000","last_active":"2024-04-25T22:40:15.660194+0000","last_peered":"2024-04-25T22:40:15.660194+0000","last_clean":"2024-04-25T22:40:15.660194+0000","last_became_active":"2024-04-25T22:40:13.599138+0000","last_became_peered":"2024-04-25T22:40:13.599138+0000","last_unstale":"2024-04-25T22:40:15.660194+0000","last_undegraded":"2024-04-25T22:40:15.660194+0000","last_fullsized":"2024-04-25T22:40:15.660194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:36.847491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618448+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:40:15.618448+0000","last_peered":"2024-04-25T22:40:15.618448+0000","last_clean":"2024-04-25T22:40:15.618448+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:40:15.618448+0000","last_undegraded":"2024-04-25T22:40:15.618448+0000","last_fullsized":"2024-04-25T22:40:15.618448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614160+0000","last_change":"2024-04-25T22:40:14.627868+0000","last_active":"2024-04-25T22:40:15.614160+0000","last_peered":"2024-04-25T22:40:15.614160+0000","last_clean":"2024-04-25T22:40:15.614160+0000","last_became_active":"2024-04-25T22:40:14.626388+0000","last_became_peered":"2024-04-25T22:40:14.626388+0000","last_unstale":"2024-04-25T22:40:15.614160+0000","last_undegraded":"2024-04-25T22:40:15.614160+0000","last_fullsized":"2024-04-25T22:40:15.614160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616733+0000","last_change":"2024-04-25T22:40:13.593378+0000","last_active":"2024-04-25T22:40:15.616733+0000","last_peered":"2024-04-25T22:40:15.616733+0000","last_clean":"2024-04-25T22:40:15.616733+0000","last_became_active":"2024-04-25T22:40:13.592392+0000","last_became_peered":"2024-04-25T22:40:13.592392+0000","last_unstale":"2024-04-25T22:40:15.616733+0000","last_undegraded":"2024-04-25T22:40:15.616733+0000","last_fullsized":"2024-04-25T22:40:15.616733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.613799+0000","last_change":"2024-04-25T22:40:14.619640+0000","last_active":"2024-04-25T22:40:15.613799+0000","last_peered":"2024-04-25T22:40:15.613799+0000","last_clean":"2024-04-25T22:40:15.613799+0000","last_became_active":"2024-04-25T22:40:14.618088+0000","last_became_peered":"2024-04-25T22:40:14.618088+0000","last_unstale":"2024-04-25T22:40:15.613799+0000","last_undegraded":"2024-04-25T22:40:15.613799+0000","last_fullsized":"2024-04-25T22:40:15.613799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:58.322470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659293+0000","last_change":"2024-04-25T22:40:14.622624+0000","last_active":"2024-04-25T22:40:15.659293+0000","last_peered":"2024-04-25T22:40:15.659293+0000","last_clean":"2024-04-25T22:40:15.659293+0000","last_became_active":"2024-04-25T22:40:14.621883+0000","last_became_peered":"2024-04-25T22:40:14.621883+0000","last_unstale":"2024-04-25T22:40:15.659293+0000","last_undegraded":"2024-04-25T22:40:15.659293+0000","last_fullsized":"2024-04-25T22:40:15.659293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614104+0000","last_change":"2024-04-25T22:40:13.588577+0000","last_active":"2024-04-25T22:40:15.614104+0000","last_peered":"2024-04-25T22:40:15.614104+0000","last_clean":"2024-04-25T22:40:15.614104+0000","last_became_active":"2024-04-25T22:40:13.588019+0000","last_became_peered":"2024-04-25T22:40:13.588019+0000","last_unstale":"2024-04-25T22:40:15.614104+0000","last_undegraded":"2024-04-25T22:40:15.614104+0000","last_fullsized":"2024-04-25T22:40:15.614104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:07.743396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616085+0000","last_change":"2024-04-25T22:40:14.630597+0000","last_active":"2024-04-25T22:40:15.616085+0000","last_peered":"2024-04-25T22:40:15.616085+0000","last_clean":"2024-04-25T22:40:15.616085+0000","last_became_active":"2024-04-25T22:40:14.628981+0000","last_became_peered":"2024-04-25T22:40:14.628981+0000","last_unstale":"2024-04-25T22:40:15.616085+0000","last_undegraded":"2024-04-25T22:40:15.616085+0000","last_fullsized":"2024-04-25T22:40:15.616085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614326+0000","last_change":"2024-04-25T22:40:13.581827+0000","last_active":"2024-04-25T22:40:15.614326+0000","last_peered":"2024-04-25T22:40:15.614326+0000","last_clean":"2024-04-25T22:40:15.614326+0000","last_became_active":"2024-04-25T22:40:13.581166+0000","last_became_peered":"2024-04-25T22:40:13.581166+0000","last_unstale":"2024-04-25T22:40:15.614326+0000","last_undegraded":"2024-04-25T22:40:15.614326+0000","last_fullsized":"2024-04-25T22:40:15.614326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659335+0000","last_change":"2024-04-25T22:40:14.636300+0000","last_active":"2024-04-25T22:40:15.659335+0000","last_peered":"2024-04-25T22:40:15.659335+0000","last_clean":"2024-04-25T22:40:15.659335+0000","last_became_active":"2024-04-25T22:40:14.635200+0000","last_became_peered":"2024-04-25T22:40:14.635200+0000","last_unstale":"2024-04-25T22:40:15.659335+0000","last_undegraded":"2024-04-25T22:40:15.659335+0000","last_fullsized":"2024-04-25T22:40:15.659335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657711+0000","last_change":"2024-04-25T22:40:13.597736+0000","last_active":"2024-04-25T22:40:15.657711+0000","last_peered":"2024-04-25T22:40:15.657711+0000","last_clean":"2024-04-25T22:40:15.657711+0000","last_became_active":"2024-04-25T22:40:13.596811+0000","last_became_peered":"2024-04-25T22:40:13.596811+0000","last_unstale":"2024-04-25T22:40:15.657711+0000","last_undegraded":"2024-04-25T22:40:15.657711+0000","last_fullsized":"2024-04-25T22:40:15.657711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:14:39.783367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658355+0000","last_change":"2024-04-25T22:40:14.616725+0000","last_active":"2024-04-25T22:40:15.658355+0000","last_peered":"2024-04-25T22:40:15.658355+0000","last_clean":"2024-04-25T22:40:15.658355+0000","last_became_active":"2024-04-25T22:40:14.615881+0000","last_became_peered":"2024-04-25T22:40:14.615881+0000","last_unstale":"2024-04-25T22:40:15.658355+0000","last_undegraded":"2024-04-25T22:40:15.658355+0000","last_fullsized":"2024-04-25T22:40:15.658355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658755+0000","last_change":"2024-04-25T22:40:13.594299+0000","last_active":"2024-04-25T22:40:15.658755+0000","last_peered":"2024-04-25T22:40:15.658755+0000","last_clean":"2024-04-25T22:40:15.658755+0000","last_became_active":"2024-04-25T22:40:13.593477+0000","last_became_peered":"2024-04-25T22:40:13.593477+0000","last_unstale":"2024-04-25T22:40:15.658755+0000","last_undegraded":"2024-04-25T22:40:15.658755+0000","last_fullsized":"2024-04-25T22:40:15.658755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:55.181892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616518+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:40:15.616518+0000","last_peered":"2024-04-25T22:40:15.616518+0000","last_clean":"2024-04-25T22:40:15.616518+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:40:15.616518+0000","last_undegraded":"2024-04-25T22:40:15.616518+0000","last_fullsized":"2024-04-25T22:40:15.616518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617388+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:40:15.617388+0000","last_peered":"2024-04-25T22:40:15.617388+0000","last_clean":"2024-04-25T22:40:15.617388+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:40:15.617388+0000","last_undegraded":"2024-04-25T22:40:15.617388+0000","last_fullsized":"2024-04-25T22:40:15.617388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616444+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:40:15.616444+0000","last_peered":"2024-04-25T22:40:15.616444+0000","last_clean":"2024-04-25T22:40:15.616444+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:40:15.616444+0000","last_undegraded":"2024-04-25T22:40:15.616444+0000","last_fullsized":"2024-04-25T22:40:15.616444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659592+0000","last_change":"2024-04-25T22:40:13.600784+0000","last_active":"2024-04-25T22:40:15.659592+0000","last_peered":"2024-04-25T22:40:15.659592+0000","last_clean":"2024-04-25T22:40:15.659592+0000","last_became_active":"2024-04-25T22:40:13.600104+0000","last_became_peered":"2024-04-25T22:40:13.600104+0000","last_unstale":"2024-04-25T22:40:15.659592+0000","last_undegraded":"2024-04-25T22:40:15.659592+0000","last_fullsized":"2024-04-25T22:40:15.659592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:54.861491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658308+0000","last_change":"2024-04-25T22:40:14.618046+0000","last_active":"2024-04-25T22:40:15.658308+0000","last_peered":"2024-04-25T22:40:15.658308+0000","last_clean":"2024-04-25T22:40:15.658308+0000","last_became_active":"2024-04-25T22:40:14.616356+0000","last_became_peered":"2024-04-25T22:40:14.616356+0000","last_unstale":"2024-04-25T22:40:15.658308+0000","last_undegraded":"2024-04-25T22:40:15.658308+0000","last_fullsized":"2024-04-25T22:40:15.658308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:58.322470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616346+0000","last_change":"2024-04-25T22:40:13.594172+0000","last_active":"2024-04-25T22:40:15.616346+0000","last_peered":"2024-04-25T22:40:15.616346+0000","last_clean":"2024-04-25T22:40:15.616346+0000","last_became_active":"2024-04-25T22:40:13.593428+0000","last_became_peered":"2024-04-25T22:40:13.593428+0000","last_unstale":"2024-04-25T22:40:15.616346+0000","last_undegraded":"2024-04-25T22:40:15.616346+0000","last_fullsized":"2024-04-25T22:40:15.616346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:41:51.887162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616499+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:40:15.616499+0000","last_peered":"2024-04-25T22:40:15.616499+0000","last_clean":"2024-04-25T22:40:15.616499+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:40:15.616499+0000","last_undegraded":"2024-04-25T22:40:15.616499+0000","last_fullsized":"2024-04-25T22:40:15.616499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616446+0000","last_change":"2024-04-25T22:40:13.593659+0000","last_active":"2024-04-25T22:40:15.616446+0000","last_peered":"2024-04-25T22:40:15.616446+0000","last_clean":"2024-04-25T22:40:15.616446+0000","last_became_active":"2024-04-25T22:40:13.592874+0000","last_became_peered":"2024-04-25T22:40:13.592874+0000","last_unstale":"2024-04-25T22:40:15.616446+0000","last_undegraded":"2024-04-25T22:40:15.616446+0000","last_fullsized":"2024-04-25T22:40:15.616446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738379,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":58349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":782336,"data_stored":649895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":790528,"data_stored":650511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:40:33.590 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:40:33.932 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:33.934 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:40:33.950 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-25T22:40:33.125455+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91088,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024432,"statfs":{"total":289910292480,"available":289817018368,"internally_reserved":0,"allocated":1744896,"data_stored":1358755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003946"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658899+0000","last_change":"2024-04-25T22:40:14.619087+0000","last_active":"2024-04-25T22:40:15.658899+0000","last_peered":"2024-04-25T22:40:15.658899+0000","last_clean":"2024-04-25T22:40:15.658899+0000","last_became_active":"2024-04-25T22:40:14.618067+0000","last_became_peered":"2024-04-25T22:40:14.618067+0000","last_unstale":"2024-04-25T22:40:15.658899+0000","last_undegraded":"2024-04-25T22:40:15.658899+0000","last_fullsized":"2024-04-25T22:40:15.658899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658764+0000","last_change":"2024-04-25T22:40:14.631180+0000","last_active":"2024-04-25T22:40:15.658764+0000","last_peered":"2024-04-25T22:40:15.658764+0000","last_clean":"2024-04-25T22:40:15.658764+0000","last_became_active":"2024-04-25T22:40:14.630146+0000","last_became_peered":"2024-04-25T22:40:14.630146+0000","last_unstale":"2024-04-25T22:40:15.658764+0000","last_undegraded":"2024-04-25T22:40:15.658764+0000","last_fullsized":"2024-04-25T22:40:15.658764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617601+0000","last_change":"2024-04-25T22:40:14.626211+0000","last_active":"2024-04-25T22:40:15.617601+0000","last_peered":"2024-04-25T22:40:15.617601+0000","last_clean":"2024-04-25T22:40:15.617601+0000","last_became_active":"2024-04-25T22:40:14.622625+0000","last_became_peered":"2024-04-25T22:40:14.622625+0000","last_unstale":"2024-04-25T22:40:15.617601+0000","last_undegraded":"2024-04-25T22:40:15.617601+0000","last_fullsized":"2024-04-25T22:40:15.617601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:35.993000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616593+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:40:15.616593+0000","last_peered":"2024-04-25T22:40:15.616593+0000","last_clean":"2024-04-25T22:40:15.616593+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:40:15.616593+0000","last_undegraded":"2024-04-25T22:40:15.616593+0000","last_fullsized":"2024-04-25T22:40:15.616593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659167+0000","last_change":"2024-04-25T22:40:14.616641+0000","last_active":"2024-04-25T22:40:15.659167+0000","last_peered":"2024-04-25T22:40:15.659167+0000","last_clean":"2024-04-25T22:40:15.659167+0000","last_became_active":"2024-04-25T22:40:14.615875+0000","last_became_peered":"2024-04-25T22:40:14.615875+0000","last_unstale":"2024-04-25T22:40:15.659167+0000","last_undegraded":"2024-04-25T22:40:15.659167+0000","last_fullsized":"2024-04-25T22:40:15.659167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615808+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:40:15.615808+0000","last_peered":"2024-04-25T22:40:15.615808+0000","last_clean":"2024-04-25T22:40:15.615808+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:40:15.615808+0000","last_undegraded":"2024-04-25T22:40:15.615808+0000","last_fullsized":"2024-04-25T22:40:15.615808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615514+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:40:15.615514+0000","last_peered":"2024-04-25T22:40:15.615514+0000","last_clean":"2024-04-25T22:40:15.615514+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:40:15.615514+0000","last_undegraded":"2024-04-25T22:40:15.615514+0000","last_fullsized":"2024-04-25T22:40:15.615514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615069+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:40:15.615069+0000","last_peered":"2024-04-25T22:40:15.615069+0000","last_clean":"2024-04-25T22:40:15.615069+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:40:15.615069+0000","last_undegraded":"2024-04-25T22:40:15.615069+0000","last_fullsized":"2024-04-25T22:40:15.615069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615789+0000","last_change":"2024-04-25T22:40:14.625922+0000","last_active":"2024-04-25T22:40:15.615789+0000","last_peered":"2024-04-25T22:40:15.615789+0000","last_clean":"2024-04-25T22:40:15.615789+0000","last_became_active":"2024-04-25T22:40:14.624594+0000","last_became_peered":"2024-04-25T22:40:14.624594+0000","last_unstale":"2024-04-25T22:40:15.615789+0000","last_undegraded":"2024-04-25T22:40:15.615789+0000","last_fullsized":"2024-04-25T22:40:15.615789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658392+0000","last_change":"2024-04-25T22:40:14.630083+0000","last_active":"2024-04-25T22:40:15.658392+0000","last_peered":"2024-04-25T22:40:15.658392+0000","last_clean":"2024-04-25T22:40:15.658392+0000","last_became_active":"2024-04-25T22:40:14.628633+0000","last_became_peered":"2024-04-25T22:40:14.628633+0000","last_unstale":"2024-04-25T22:40:15.658392+0000","last_undegraded":"2024-04-25T22:40:15.658392+0000","last_fullsized":"2024-04-25T22:40:15.658392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617428+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:40:15.617428+0000","last_peered":"2024-04-25T22:40:15.617428+0000","last_clean":"2024-04-25T22:40:15.617428+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:40:15.617428+0000","last_undegraded":"2024-04-25T22:40:15.617428+0000","last_fullsized":"2024-04-25T22:40:15.617428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657925+0000","last_change":"2024-04-25T22:40:14.636539+0000","last_active":"2024-04-25T22:40:15.657925+0000","last_peered":"2024-04-25T22:40:15.657925+0000","last_clean":"2024-04-25T22:40:15.657925+0000","last_became_active":"2024-04-25T22:40:14.635508+0000","last_became_peered":"2024-04-25T22:40:14.635508+0000","last_unstale":"2024-04-25T22:40:15.657925+0000","last_undegraded":"2024-04-25T22:40:15.657925+0000","last_fullsized":"2024-04-25T22:40:15.657925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:30:53.093623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658378+0000","last_change":"2024-04-25T22:40:14.620438+0000","last_active":"2024-04-25T22:40:15.658378+0000","last_peered":"2024-04-25T22:40:15.658378+0000","last_clean":"2024-04-25T22:40:15.658378+0000","last_became_active":"2024-04-25T22:40:14.619963+0000","last_became_peered":"2024-04-25T22:40:14.619963+0000","last_unstale":"2024-04-25T22:40:15.658378+0000","last_undegraded":"2024-04-25T22:40:15.658378+0000","last_fullsized":"2024-04-25T22:40:15.658378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615997+0000","last_change":"2024-04-25T22:40:14.616800+0000","last_active":"2024-04-25T22:40:15.615997+0000","last_peered":"2024-04-25T22:40:15.615997+0000","last_clean":"2024-04-25T22:40:15.615997+0000","last_became_active":"2024-04-25T22:40:14.612887+0000","last_became_peered":"2024-04-25T22:40:14.612887+0000","last_unstale":"2024-04-25T22:40:15.615997+0000","last_undegraded":"2024-04-25T22:40:15.615997+0000","last_fullsized":"2024-04-25T22:40:15.615997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615601+0000","last_change":"2024-04-25T22:40:14.615520+0000","last_active":"2024-04-25T22:40:15.615601+0000","last_peered":"2024-04-25T22:40:15.615601+0000","last_clean":"2024-04-25T22:40:15.615601+0000","last_became_active":"2024-04-25T22:40:14.613556+0000","last_became_peered":"2024-04-25T22:40:14.613556+0000","last_unstale":"2024-04-25T22:40:15.615601+0000","last_undegraded":"2024-04-25T22:40:15.615601+0000","last_fullsized":"2024-04-25T22:40:15.615601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615171+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:40:15.615171+0000","last_peered":"2024-04-25T22:40:15.615171+0000","last_clean":"2024-04-25T22:40:15.615171+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:40:15.615171+0000","last_undegraded":"2024-04-25T22:40:15.615171+0000","last_fullsized":"2024-04-25T22:40:15.615171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616907+0000","last_change":"2024-04-25T22:40:14.628222+0000","last_active":"2024-04-25T22:40:15.616907+0000","last_peered":"2024-04-25T22:40:15.616907+0000","last_clean":"2024-04-25T22:40:15.616907+0000","last_became_active":"2024-04-25T22:40:14.626913+0000","last_became_peered":"2024-04-25T22:40:14.626913+0000","last_unstale":"2024-04-25T22:40:15.616907+0000","last_undegraded":"2024-04-25T22:40:15.616907+0000","last_fullsized":"2024-04-25T22:40:15.616907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659087+0000","last_change":"2024-04-25T22:40:14.629506+0000","last_active":"2024-04-25T22:40:15.659087+0000","last_peered":"2024-04-25T22:40:15.659087+0000","last_clean":"2024-04-25T22:40:15.659087+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:40:15.659087+0000","last_undegraded":"2024-04-25T22:40:15.659087+0000","last_fullsized":"2024-04-25T22:40:15.659087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615553+0000","last_change":"2024-04-25T22:40:14.623704+0000","last_active":"2024-04-25T22:40:15.615553+0000","last_peered":"2024-04-25T22:40:15.615553+0000","last_clean":"2024-04-25T22:40:15.615553+0000","last_became_active":"2024-04-25T22:40:14.623146+0000","last_became_peered":"2024-04-25T22:40:14.623146+0000","last_unstale":"2024-04-25T22:40:15.615553+0000","last_undegraded":"2024-04-25T22:40:15.615553+0000","last_fullsized":"2024-04-25T22:40:15.615553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616610+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:40:15.616610+0000","last_peered":"2024-04-25T22:40:15.616610+0000","last_clean":"2024-04-25T22:40:15.616610+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:40:15.616610+0000","last_undegraded":"2024-04-25T22:40:15.616610+0000","last_fullsized":"2024-04-25T22:40:15.616610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618087+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:40:15.618087+0000","last_peered":"2024-04-25T22:40:15.618087+0000","last_clean":"2024-04-25T22:40:15.618087+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:40:15.618087+0000","last_undegraded":"2024-04-25T22:40:15.618087+0000","last_fullsized":"2024-04-25T22:40:15.618087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657153+0000","last_change":"2024-04-25T22:40:14.636703+0000","last_active":"2024-04-25T22:40:15.657153+0000","last_peered":"2024-04-25T22:40:15.657153+0000","last_clean":"2024-04-25T22:40:15.657153+0000","last_became_active":"2024-04-25T22:40:14.635943+0000","last_became_peered":"2024-04-25T22:40:14.635943+0000","last_unstale":"2024-04-25T22:40:15.657153+0000","last_undegraded":"2024-04-25T22:40:15.657153+0000","last_fullsized":"2024-04-25T22:40:15.657153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:45:57.862599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.613539+0000","last_change":"2024-04-25T22:40:14.617094+0000","last_active":"2024-04-25T22:40:15.613539+0000","last_peered":"2024-04-25T22:40:15.613539+0000","last_clean":"2024-04-25T22:40:15.613539+0000","last_became_active":"2024-04-25T22:40:14.615818+0000","last_became_peered":"2024-04-25T22:40:14.615818+0000","last_unstale":"2024-04-25T22:40:15.613539+0000","last_undegraded":"2024-04-25T22:40:15.613539+0000","last_fullsized":"2024-04-25T22:40:15.613539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:30:53.093623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.656876+0000","last_change":"2024-04-25T22:40:14.619013+0000","last_active":"2024-04-25T22:40:15.656876+0000","last_peered":"2024-04-25T22:40:15.656876+0000","last_clean":"2024-04-25T22:40:15.656876+0000","last_became_active":"2024-04-25T22:40:14.618184+0000","last_became_peered":"2024-04-25T22:40:14.618184+0000","last_unstale":"2024-04-25T22:40:15.656876+0000","last_undegraded":"2024-04-25T22:40:15.656876+0000","last_fullsized":"2024-04-25T22:40:15.656876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:34:40.281445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659068+0000","last_change":"2024-04-25T22:40:14.622357+0000","last_active":"2024-04-25T22:40:15.659068+0000","last_peered":"2024-04-25T22:40:15.659068+0000","last_clean":"2024-04-25T22:40:15.659068+0000","last_became_active":"2024-04-25T22:40:14.621617+0000","last_became_peered":"2024-04-25T22:40:14.621617+0000","last_unstale":"2024-04-25T22:40:15.659068+0000","last_undegraded":"2024-04-25T22:40:15.659068+0000","last_fullsized":"2024-04-25T22:40:15.659068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615978+0000","last_change":"2024-04-25T22:40:14.625933+0000","last_active":"2024-04-25T22:40:15.615978+0000","last_peered":"2024-04-25T22:40:15.615978+0000","last_clean":"2024-04-25T22:40:15.615978+0000","last_became_active":"2024-04-25T22:40:14.625123+0000","last_became_peered":"2024-04-25T22:40:14.625123+0000","last_unstale":"2024-04-25T22:40:15.615978+0000","last_undegraded":"2024-04-25T22:40:15.615978+0000","last_fullsized":"2024-04-25T22:40:15.615978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618233+0000","last_change":"2024-04-25T22:40:14.630596+0000","last_active":"2024-04-25T22:40:15.618233+0000","last_peered":"2024-04-25T22:40:15.618233+0000","last_clean":"2024-04-25T22:40:15.618233+0000","last_became_active":"2024-04-25T22:40:14.625407+0000","last_became_peered":"2024-04-25T22:40:14.625407+0000","last_unstale":"2024-04-25T22:40:15.618233+0000","last_undegraded":"2024-04-25T22:40:15.618233+0000","last_fullsized":"2024-04-25T22:40:15.618233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:20:05.398182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658859+0000","last_change":"2024-04-25T22:40:14.636526+0000","last_active":"2024-04-25T22:40:15.658859+0000","last_peered":"2024-04-25T22:40:15.658859+0000","last_clean":"2024-04-25T22:40:15.658859+0000","last_became_active":"2024-04-25T22:40:14.635539+0000","last_became_peered":"2024-04-25T22:40:14.635539+0000","last_unstale":"2024-04-25T22:40:15.658859+0000","last_undegraded":"2024-04-25T22:40:15.658859+0000","last_fullsized":"2024-04-25T22:40:15.658859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614790+0000","last_change":"2024-04-25T22:40:14.620608+0000","last_active":"2024-04-25T22:40:15.614790+0000","last_peered":"2024-04-25T22:40:15.614790+0000","last_clean":"2024-04-25T22:40:15.614790+0000","last_became_active":"2024-04-25T22:40:14.618171+0000","last_became_peered":"2024-04-25T22:40:14.618171+0000","last_unstale":"2024-04-25T22:40:15.614790+0000","last_undegraded":"2024-04-25T22:40:15.614790+0000","last_fullsized":"2024-04-25T22:40:15.614790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657864+0000","last_change":"2024-04-25T22:40:14.622961+0000","last_active":"2024-04-25T22:40:15.657864+0000","last_peered":"2024-04-25T22:40:15.657864+0000","last_clean":"2024-04-25T22:40:15.657864+0000","last_became_active":"2024-04-25T22:40:14.622238+0000","last_became_peered":"2024-04-25T22:40:14.622238+0000","last_unstale":"2024-04-25T22:40:15.657864+0000","last_undegraded":"2024-04-25T22:40:15.657864+0000","last_fullsized":"2024-04-25T22:40:15.657864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:09.125174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.613760+0000","last_change":"2024-04-25T22:40:14.618468+0000","last_active":"2024-04-25T22:40:15.613760+0000","last_peered":"2024-04-25T22:40:15.613760+0000","last_clean":"2024-04-25T22:40:15.613760+0000","last_became_active":"2024-04-25T22:40:14.617312+0000","last_became_peered":"2024-04-25T22:40:14.617312+0000","last_unstale":"2024-04-25T22:40:15.613760+0000","last_undegraded":"2024-04-25T22:40:15.613760+0000","last_fullsized":"2024-04-25T22:40:15.613760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:12.679354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615544+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:40:15.615544+0000","last_peered":"2024-04-25T22:40:15.615544+0000","last_clean":"2024-04-25T22:40:15.615544+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:40:15.615544+0000","last_undegraded":"2024-04-25T22:40:15.615544+0000","last_fullsized":"2024-04-25T22:40:15.615544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658398+0000","last_change":"2024-04-25T22:40:14.613553+0000","last_active":"2024-04-25T22:40:15.658398+0000","last_peered":"2024-04-25T22:40:15.658398+0000","last_clean":"2024-04-25T22:40:15.658398+0000","last_became_active":"2024-04-25T22:40:14.612857+0000","last_became_peered":"2024-04-25T22:40:14.612857+0000","last_unstale":"2024-04-25T22:40:15.658398+0000","last_undegraded":"2024-04-25T22:40:15.658398+0000","last_fullsized":"2024-04-25T22:40:15.658398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617134+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:40:15.617134+0000","last_peered":"2024-04-25T22:40:15.617134+0000","last_clean":"2024-04-25T22:40:15.617134+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:40:15.617134+0000","last_undegraded":"2024-04-25T22:40:15.617134+0000","last_fullsized":"2024-04-25T22:40:15.617134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.660077+0000","last_change":"2024-04-25T22:40:14.618292+0000","last_active":"2024-04-25T22:40:15.660077+0000","last_peered":"2024-04-25T22:40:15.660077+0000","last_clean":"2024-04-25T22:40:15.660077+0000","last_became_active":"2024-04-25T22:40:14.616712+0000","last_became_peered":"2024-04-25T22:40:14.616712+0000","last_unstale":"2024-04-25T22:40:15.660077+0000","last_undegraded":"2024-04-25T22:40:15.660077+0000","last_fullsized":"2024-04-25T22:40:15.660077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614211+0000","last_change":"2024-04-25T22:40:13.581241+0000","last_active":"2024-04-25T22:40:15.614211+0000","last_peered":"2024-04-25T22:40:15.614211+0000","last_clean":"2024-04-25T22:40:15.614211+0000","last_became_active":"2024-04-25T22:40:13.580442+0000","last_became_peered":"2024-04-25T22:40:13.580442+0000","last_unstale":"2024-04-25T22:40:15.614211+0000","last_undegraded":"2024-04-25T22:40:15.614211+0000","last_fullsized":"2024-04-25T22:40:15.614211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:50:49.280995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616561+0000","last_change":"2024-04-25T22:40:14.631577+0000","last_active":"2024-04-25T22:40:15.616561+0000","last_peered":"2024-04-25T22:40:15.616561+0000","last_clean":"2024-04-25T22:40:15.616561+0000","last_became_active":"2024-04-25T22:40:14.630371+0000","last_became_peered":"2024-04-25T22:40:14.630371+0000","last_unstale":"2024-04-25T22:40:15.616561+0000","last_undegraded":"2024-04-25T22:40:15.616561+0000","last_fullsized":"2024-04-25T22:40:15.616561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657258+0000","last_change":"2024-04-25T22:40:13.599838+0000","last_active":"2024-04-25T22:40:15.657258+0000","last_peered":"2024-04-25T22:40:15.657258+0000","last_clean":"2024-04-25T22:40:15.657258+0000","last_became_active":"2024-04-25T22:40:13.599001+0000","last_became_peered":"2024-04-25T22:40:13.599001+0000","last_unstale":"2024-04-25T22:40:15.657258+0000","last_undegraded":"2024-04-25T22:40:15.657258+0000","last_fullsized":"2024-04-25T22:40:15.657258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:16.993188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616081+0000","last_change":"2024-04-25T22:40:14.630012+0000","last_active":"2024-04-25T22:40:15.616081+0000","last_peered":"2024-04-25T22:40:15.616081+0000","last_clean":"2024-04-25T22:40:15.616081+0000","last_became_active":"2024-04-25T22:40:14.628677+0000","last_became_peered":"2024-04-25T22:40:14.628677+0000","last_unstale":"2024-04-25T22:40:15.616081+0000","last_undegraded":"2024-04-25T22:40:15.616081+0000","last_fullsized":"2024-04-25T22:40:15.616081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615558+0000","last_change":"2024-04-25T22:40:13.599918+0000","last_active":"2024-04-25T22:40:15.615558+0000","last_peered":"2024-04-25T22:40:15.615558+0000","last_clean":"2024-04-25T22:40:15.615558+0000","last_became_active":"2024-04-25T22:40:13.596461+0000","last_became_peered":"2024-04-25T22:40:13.596461+0000","last_unstale":"2024-04-25T22:40:15.615558+0000","last_undegraded":"2024-04-25T22:40:15.615558+0000","last_fullsized":"2024-04-25T22:40:15.615558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:41:51.887162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618201+0000","last_change":"2024-04-25T22:40:13.598294+0000","last_active":"2024-04-25T22:40:15.618201+0000","last_peered":"2024-04-25T22:40:15.618201+0000","last_clean":"2024-04-25T22:40:15.618201+0000","last_became_active":"2024-04-25T22:40:13.596687+0000","last_became_peered":"2024-04-25T22:40:13.596687+0000","last_unstale":"2024-04-25T22:40:15.618201+0000","last_undegraded":"2024-04-25T22:40:15.618201+0000","last_fullsized":"2024-04-25T22:40:15.618201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:50:49.280995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.656904+0000","last_change":"2024-04-25T22:40:14.625171+0000","last_active":"2024-04-25T22:40:15.656904+0000","last_peered":"2024-04-25T22:40:15.656904+0000","last_clean":"2024-04-25T22:40:15.656904+0000","last_became_active":"2024-04-25T22:40:14.624473+0000","last_became_peered":"2024-04-25T22:40:14.624473+0000","last_unstale":"2024-04-25T22:40:15.656904+0000","last_undegraded":"2024-04-25T22:40:15.656904+0000","last_fullsized":"2024-04-25T22:40:15.656904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:30.591624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659343+0000","last_change":"2024-04-25T22:40:13.599189+0000","last_active":"2024-04-25T22:40:15.659343+0000","last_peered":"2024-04-25T22:40:15.659343+0000","last_clean":"2024-04-25T22:40:15.659343+0000","last_became_active":"2024-04-25T22:40:13.598289+0000","last_became_peered":"2024-04-25T22:40:13.598289+0000","last_unstale":"2024-04-25T22:40:15.659343+0000","last_undegraded":"2024-04-25T22:40:15.659343+0000","last_fullsized":"2024-04-25T22:40:15.659343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:05:28.535490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657030+0000","last_change":"2024-04-25T22:40:14.618478+0000","last_active":"2024-04-25T22:40:15.657030+0000","last_peered":"2024-04-25T22:40:15.657030+0000","last_clean":"2024-04-25T22:40:15.657030+0000","last_became_active":"2024-04-25T22:40:14.617688+0000","last_became_peered":"2024-04-25T22:40:14.617688+0000","last_unstale":"2024-04-25T22:40:15.657030+0000","last_undegraded":"2024-04-25T22:40:15.657030+0000","last_fullsized":"2024-04-25T22:40:15.657030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:39:44.762240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618805+0000","last_change":"2024-04-25T22:40:13.601404+0000","last_active":"2024-04-25T22:40:15.618805+0000","last_peered":"2024-04-25T22:40:15.618805+0000","last_clean":"2024-04-25T22:40:15.618805+0000","last_became_active":"2024-04-25T22:40:13.600688+0000","last_became_peered":"2024-04-25T22:40:13.600688+0000","last_unstale":"2024-04-25T22:40:15.618805+0000","last_undegraded":"2024-04-25T22:40:15.618805+0000","last_fullsized":"2024-04-25T22:40:15.618805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:36.157648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616497+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:40:15.616497+0000","last_peered":"2024-04-25T22:40:15.616497+0000","last_clean":"2024-04-25T22:40:15.616497+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:40:15.616497+0000","last_undegraded":"2024-04-25T22:40:15.616497+0000","last_fullsized":"2024-04-25T22:40:15.616497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617642+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:40:15.617642+0000","last_peered":"2024-04-25T22:40:15.617642+0000","last_clean":"2024-04-25T22:40:15.617642+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:40:15.617642+0000","last_undegraded":"2024-04-25T22:40:15.617642+0000","last_fullsized":"2024-04-25T22:40:15.617642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615001+0000","last_change":"2024-04-25T22:40:14.625843+0000","last_active":"2024-04-25T22:40:15.615001+0000","last_peered":"2024-04-25T22:40:15.615001+0000","last_clean":"2024-04-25T22:40:15.615001+0000","last_became_active":"2024-04-25T22:40:14.625187+0000","last_became_peered":"2024-04-25T22:40:14.625187+0000","last_unstale":"2024-04-25T22:40:15.615001+0000","last_undegraded":"2024-04-25T22:40:15.615001+0000","last_fullsized":"2024-04-25T22:40:15.615001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615306+0000","last_change":"2024-04-25T22:40:13.581857+0000","last_active":"2024-04-25T22:40:15.615306+0000","last_peered":"2024-04-25T22:40:15.615306+0000","last_clean":"2024-04-25T22:40:15.615306+0000","last_became_active":"2024-04-25T22:40:13.581263+0000","last_became_peered":"2024-04-25T22:40:13.581263+0000","last_unstale":"2024-04-25T22:40:15.615306+0000","last_undegraded":"2024-04-25T22:40:15.615306+0000","last_fullsized":"2024-04-25T22:40:15.615306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:54:01.709709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617001+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:40:15.617001+0000","last_peered":"2024-04-25T22:40:15.617001+0000","last_clean":"2024-04-25T22:40:15.617001+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:40:15.617001+0000","last_undegraded":"2024-04-25T22:40:15.617001+0000","last_fullsized":"2024-04-25T22:40:15.617001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616780+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:40:15.616780+0000","last_peered":"2024-04-25T22:40:15.616780+0000","last_clean":"2024-04-25T22:40:15.616780+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:40:15.616780+0000","last_undegraded":"2024-04-25T22:40:15.616780+0000","last_fullsized":"2024-04-25T22:40:15.616780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618553+0000","last_change":"2024-04-25T22:40:14.621941+0000","last_active":"2024-04-25T22:40:15.618553+0000","last_peered":"2024-04-25T22:40:15.618553+0000","last_clean":"2024-04-25T22:40:15.618553+0000","last_became_active":"2024-04-25T22:40:14.614196+0000","last_became_peered":"2024-04-25T22:40:14.614196+0000","last_unstale":"2024-04-25T22:40:15.618553+0000","last_undegraded":"2024-04-25T22:40:15.618553+0000","last_fullsized":"2024-04-25T22:40:15.618553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:24.895025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657287+0000","last_change":"2024-04-25T22:40:13.599695+0000","last_active":"2024-04-25T22:40:15.657287+0000","last_peered":"2024-04-25T22:40:15.657287+0000","last_clean":"2024-04-25T22:40:15.657287+0000","last_became_active":"2024-04-25T22:40:13.598805+0000","last_became_peered":"2024-04-25T22:40:13.598805+0000","last_unstale":"2024-04-25T22:40:15.657287+0000","last_undegraded":"2024-04-25T22:40:15.657287+0000","last_fullsized":"2024-04-25T22:40:15.657287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:56.307032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617569+0000","last_change":"2024-04-25T22:40:14.614275+0000","last_active":"2024-04-25T22:40:15.617569+0000","last_peered":"2024-04-25T22:40:15.617569+0000","last_clean":"2024-04-25T22:40:15.617569+0000","last_became_active":"2024-04-25T22:40:14.613038+0000","last_became_peered":"2024-04-25T22:40:14.613038+0000","last_unstale":"2024-04-25T22:40:15.617569+0000","last_undegraded":"2024-04-25T22:40:15.617569+0000","last_fullsized":"2024-04-25T22:40:15.617569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:14:02.343388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657203+0000","last_change":"2024-04-25T22:40:13.597555+0000","last_active":"2024-04-25T22:40:15.657203+0000","last_peered":"2024-04-25T22:40:15.657203+0000","last_clean":"2024-04-25T22:40:15.657203+0000","last_became_active":"2024-04-25T22:40:13.596623+0000","last_became_peered":"2024-04-25T22:40:13.596623+0000","last_unstale":"2024-04-25T22:40:15.657203+0000","last_undegraded":"2024-04-25T22:40:15.657203+0000","last_fullsized":"2024-04-25T22:40:15.657203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:29:00.157478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616173+0000","last_change":"2024-04-25T22:40:14.627280+0000","last_active":"2024-04-25T22:40:15.616173+0000","last_peered":"2024-04-25T22:40:15.616173+0000","last_clean":"2024-04-25T22:40:15.616173+0000","last_became_active":"2024-04-25T22:40:14.624656+0000","last_became_peered":"2024-04-25T22:40:14.624656+0000","last_unstale":"2024-04-25T22:40:15.616173+0000","last_undegraded":"2024-04-25T22:40:15.616173+0000","last_fullsized":"2024-04-25T22:40:15.616173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":222,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616001+0000","last_change":"2024-04-25T22:40:04.317146+0000","last_active":"2024-04-25T22:40:15.616001+0000","last_peered":"2024-04-25T22:40:15.616001+0000","last_clean":"2024-04-25T22:40:15.616001+0000","last_became_active":"2024-04-25T22:40:04.316527+0000","last_became_peered":"2024-04-25T22:40:04.316527+0000","last_unstale":"2024-04-25T22:40:15.616001+0000","last_undegraded":"2024-04-25T22:40:15.616001+0000","last_fullsized":"2024-04-25T22:40:15.616001+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:25.669997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617484+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:40:15.617484+0000","last_peered":"2024-04-25T22:40:15.617484+0000","last_clean":"2024-04-25T22:40:15.617484+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:40:15.617484+0000","last_undegraded":"2024-04-25T22:40:15.617484+0000","last_fullsized":"2024-04-25T22:40:15.617484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614355+0000","last_change":"2024-04-25T22:40:13.591980+0000","last_active":"2024-04-25T22:40:15.614355+0000","last_peered":"2024-04-25T22:40:15.614355+0000","last_clean":"2024-04-25T22:40:15.614355+0000","last_became_active":"2024-04-25T22:40:13.591152+0000","last_became_peered":"2024-04-25T22:40:13.591152+0000","last_unstale":"2024-04-25T22:40:15.614355+0000","last_undegraded":"2024-04-25T22:40:15.614355+0000","last_fullsized":"2024-04-25T22:40:15.614355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618637+0000","last_change":"2024-04-25T22:40:14.621472+0000","last_active":"2024-04-25T22:40:15.618637+0000","last_peered":"2024-04-25T22:40:15.618637+0000","last_clean":"2024-04-25T22:40:15.618637+0000","last_became_active":"2024-04-25T22:40:14.613608+0000","last_became_peered":"2024-04-25T22:40:14.613608+0000","last_unstale":"2024-04-25T22:40:15.618637+0000","last_undegraded":"2024-04-25T22:40:15.618637+0000","last_fullsized":"2024-04-25T22:40:15.618637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:51.686908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615728+0000","last_change":"2024-04-25T22:40:09.502444+0000","last_active":"2024-04-25T22:40:15.615728+0000","last_peered":"2024-04-25T22:40:15.615728+0000","last_clean":"2024-04-25T22:40:15.615728+0000","last_became_active":"2024-04-25T22:40:09.501576+0000","last_became_peered":"2024-04-25T22:40:09.501576+0000","last_unstale":"2024-04-25T22:40:15.615728+0000","last_undegraded":"2024-04-25T22:40:15.615728+0000","last_fullsized":"2024-04-25T22:40:15.615728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:35:14.955359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614468+0000","last_change":"2024-04-25T22:40:13.579430+0000","last_active":"2024-04-25T22:40:15.614468+0000","last_peered":"2024-04-25T22:40:15.614468+0000","last_clean":"2024-04-25T22:40:15.614468+0000","last_became_active":"2024-04-25T22:40:13.578601+0000","last_became_peered":"2024-04-25T22:40:13.578601+0000","last_unstale":"2024-04-25T22:40:15.614468+0000","last_undegraded":"2024-04-25T22:40:15.614468+0000","last_fullsized":"2024-04-25T22:40:15.614468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:50.274924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658863+0000","last_change":"2024-04-25T22:40:14.628709+0000","last_active":"2024-04-25T22:40:15.658863+0000","last_peered":"2024-04-25T22:40:15.658863+0000","last_clean":"2024-04-25T22:40:15.658863+0000","last_became_active":"2024-04-25T22:40:14.627641+0000","last_became_peered":"2024-04-25T22:40:14.627641+0000","last_unstale":"2024-04-25T22:40:15.658863+0000","last_undegraded":"2024-04-25T22:40:15.658863+0000","last_fullsized":"2024-04-25T22:40:15.658863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614614+0000","last_change":"2024-04-25T22:40:09.501323+0000","last_active":"2024-04-25T22:40:15.614614+0000","last_peered":"2024-04-25T22:40:15.614614+0000","last_clean":"2024-04-25T22:40:15.614614+0000","last_became_active":"2024-04-25T22:40:09.500499+0000","last_became_peered":"2024-04-25T22:40:09.500499+0000","last_unstale":"2024-04-25T22:40:15.614614+0000","last_undegraded":"2024-04-25T22:40:15.614614+0000","last_fullsized":"2024-04-25T22:40:15.614614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:30.289572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657249+0000","last_change":"2024-04-25T22:40:13.599332+0000","last_active":"2024-04-25T22:40:15.657249+0000","last_peered":"2024-04-25T22:40:15.657249+0000","last_clean":"2024-04-25T22:40:15.657249+0000","last_became_active":"2024-04-25T22:40:13.598689+0000","last_became_peered":"2024-04-25T22:40:13.598689+0000","last_unstale":"2024-04-25T22:40:15.657249+0000","last_undegraded":"2024-04-25T22:40:15.657249+0000","last_fullsized":"2024-04-25T22:40:15.657249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:36.875346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616453+0000","last_change":"2024-04-25T22:40:14.628007+0000","last_active":"2024-04-25T22:40:15.616453+0000","last_peered":"2024-04-25T22:40:15.616453+0000","last_clean":"2024-04-25T22:40:15.616453+0000","last_became_active":"2024-04-25T22:40:14.625425+0000","last_became_peered":"2024-04-25T22:40:14.625425+0000","last_unstale":"2024-04-25T22:40:15.616453+0000","last_undegraded":"2024-04-25T22:40:15.616453+0000","last_fullsized":"2024-04-25T22:40:15.616453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616734+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:40:15.616734+0000","last_peered":"2024-04-25T22:40:15.616734+0000","last_clean":"2024-04-25T22:40:15.616734+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:40:15.616734+0000","last_undegraded":"2024-04-25T22:40:15.616734+0000","last_fullsized":"2024-04-25T22:40:15.616734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617401+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:40:15.617401+0000","last_peered":"2024-04-25T22:40:15.617401+0000","last_clean":"2024-04-25T22:40:15.617401+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:40:15.617401+0000","last_undegraded":"2024-04-25T22:40:15.617401+0000","last_fullsized":"2024-04-25T22:40:15.617401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615641+0000","last_change":"2024-04-25T22:40:14.622442+0000","last_active":"2024-04-25T22:40:15.615641+0000","last_peered":"2024-04-25T22:40:15.615641+0000","last_clean":"2024-04-25T22:40:15.615641+0000","last_became_active":"2024-04-25T22:40:14.621130+0000","last_became_peered":"2024-04-25T22:40:14.621130+0000","last_unstale":"2024-04-25T22:40:15.615641+0000","last_undegraded":"2024-04-25T22:40:15.615641+0000","last_fullsized":"2024-04-25T22:40:15.615641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618860+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:40:15.618860+0000","last_peered":"2024-04-25T22:40:15.618860+0000","last_clean":"2024-04-25T22:40:15.618860+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:40:15.618860+0000","last_undegraded":"2024-04-25T22:40:15.618860+0000","last_fullsized":"2024-04-25T22:40:15.618860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615725+0000","last_change":"2024-04-25T22:40:09.501325+0000","last_active":"2024-04-25T22:40:15.615725+0000","last_peered":"2024-04-25T22:40:15.615725+0000","last_clean":"2024-04-25T22:40:15.615725+0000","last_became_active":"2024-04-25T22:40:09.500542+0000","last_became_peered":"2024-04-25T22:40:09.500542+0000","last_unstale":"2024-04-25T22:40:15.615725+0000","last_undegraded":"2024-04-25T22:40:15.615725+0000","last_fullsized":"2024-04-25T22:40:15.615725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:34:38.234538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657224+0000","last_change":"2024-04-25T22:40:14.636726+0000","last_active":"2024-04-25T22:40:15.657224+0000","last_peered":"2024-04-25T22:40:15.657224+0000","last_clean":"2024-04-25T22:40:15.657224+0000","last_became_active":"2024-04-25T22:40:14.636013+0000","last_became_peered":"2024-04-25T22:40:14.636013+0000","last_unstale":"2024-04-25T22:40:15.657224+0000","last_undegraded":"2024-04-25T22:40:15.657224+0000","last_fullsized":"2024-04-25T22:40:15.657224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:35.910752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.615587+0000","last_change":"2024-04-25T22:40:13.591256+0000","last_active":"2024-04-25T22:40:15.615587+0000","last_peered":"2024-04-25T22:40:15.615587+0000","last_clean":"2024-04-25T22:40:15.615587+0000","last_became_active":"2024-04-25T22:40:13.590744+0000","last_became_peered":"2024-04-25T22:40:13.590744+0000","last_unstale":"2024-04-25T22:40:15.615587+0000","last_undegraded":"2024-04-25T22:40:15.615587+0000","last_fullsized":"2024-04-25T22:40:15.615587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:50.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.660294+0000","last_change":"2024-04-25T22:40:09.501163+0000","last_active":"2024-04-25T22:40:15.660294+0000","last_peered":"2024-04-25T22:40:15.660294+0000","last_clean":"2024-04-25T22:40:15.660294+0000","last_became_active":"2024-04-25T22:40:09.500492+0000","last_became_peered":"2024-04-25T22:40:09.500492+0000","last_unstale":"2024-04-25T22:40:15.660294+0000","last_undegraded":"2024-04-25T22:40:15.660294+0000","last_fullsized":"2024-04-25T22:40:15.660294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:48:22.822616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658264+0000","last_change":"2024-04-25T22:40:14.638662+0000","last_active":"2024-04-25T22:40:15.658264+0000","last_peered":"2024-04-25T22:40:15.658264+0000","last_clean":"2024-04-25T22:40:15.658264+0000","last_became_active":"2024-04-25T22:40:14.638060+0000","last_became_peered":"2024-04-25T22:40:14.638060+0000","last_unstale":"2024-04-25T22:40:15.658264+0000","last_undegraded":"2024-04-25T22:40:15.658264+0000","last_fullsized":"2024-04-25T22:40:15.658264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:12.679354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616939+0000","last_change":"2024-04-25T22:40:13.592055+0000","last_active":"2024-04-25T22:40:15.616939+0000","last_peered":"2024-04-25T22:40:15.616939+0000","last_clean":"2024-04-25T22:40:15.616939+0000","last_became_active":"2024-04-25T22:40:13.591169+0000","last_became_peered":"2024-04-25T22:40:13.591169+0000","last_unstale":"2024-04-25T22:40:15.616939+0000","last_undegraded":"2024-04-25T22:40:15.616939+0000","last_fullsized":"2024-04-25T22:40:15.616939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:33.458799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616687+0000","last_change":"2024-04-25T22:40:09.501358+0000","last_active":"2024-04-25T22:40:15.616687+0000","last_peered":"2024-04-25T22:40:15.616687+0000","last_clean":"2024-04-25T22:40:15.616687+0000","last_became_active":"2024-04-25T22:40:09.500626+0000","last_became_peered":"2024-04-25T22:40:09.500626+0000","last_unstale":"2024-04-25T22:40:15.616687+0000","last_undegraded":"2024-04-25T22:40:15.616687+0000","last_fullsized":"2024-04-25T22:40:15.616687+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:55.182967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.613952+0000","last_change":"2024-04-25T22:40:14.618363+0000","last_active":"2024-04-25T22:40:15.613952+0000","last_peered":"2024-04-25T22:40:15.613952+0000","last_clean":"2024-04-25T22:40:15.613952+0000","last_became_active":"2024-04-25T22:40:14.617599+0000","last_became_peered":"2024-04-25T22:40:14.617599+0000","last_unstale":"2024-04-25T22:40:15.613952+0000","last_undegraded":"2024-04-25T22:40:15.613952+0000","last_fullsized":"2024-04-25T22:40:15.613952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:16.594231+0000","last_change":"2024-04-25T22:40:13.593400+0000","last_active":"2024-04-25T22:40:16.594231+0000","last_peered":"2024-04-25T22:40:16.594231+0000","last_clean":"2024-04-25T22:40:16.594231+0000","last_became_active":"2024-04-25T22:40:13.592338+0000","last_became_peered":"2024-04-25T22:40:13.592338+0000","last_unstale":"2024-04-25T22:40:16.594231+0000","last_undegraded":"2024-04-25T22:40:16.594231+0000","last_fullsized":"2024-04-25T22:40:16.594231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618220+0000","last_change":"2024-04-25T22:40:09.500948+0000","last_active":"2024-04-25T22:40:15.618220+0000","last_peered":"2024-04-25T22:40:15.618220+0000","last_clean":"2024-04-25T22:40:15.618220+0000","last_became_active":"2024-04-25T22:40:09.500236+0000","last_became_peered":"2024-04-25T22:40:09.500236+0000","last_unstale":"2024-04-25T22:40:15.618220+0000","last_undegraded":"2024-04-25T22:40:15.618220+0000","last_fullsized":"2024-04-25T22:40:15.618220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:02.375961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657009+0000","last_change":"2024-04-25T22:40:14.623882+0000","last_active":"2024-04-25T22:40:15.657009+0000","last_peered":"2024-04-25T22:40:15.657009+0000","last_clean":"2024-04-25T22:40:15.657009+0000","last_became_active":"2024-04-25T22:40:14.623090+0000","last_became_peered":"2024-04-25T22:40:14.623090+0000","last_unstale":"2024-04-25T22:40:15.657009+0000","last_undegraded":"2024-04-25T22:40:15.657009+0000","last_fullsized":"2024-04-25T22:40:15.657009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:52.116132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616663+0000","last_change":"2024-04-25T22:40:14.619806+0000","last_active":"2024-04-25T22:40:15.616663+0000","last_peered":"2024-04-25T22:40:15.616663+0000","last_clean":"2024-04-25T22:40:15.616663+0000","last_became_active":"2024-04-25T22:40:14.618980+0000","last_became_peered":"2024-04-25T22:40:14.618980+0000","last_unstale":"2024-04-25T22:40:15.616663+0000","last_undegraded":"2024-04-25T22:40:15.616663+0000","last_fullsized":"2024-04-25T22:40:15.616663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617318+0000","last_change":"2024-04-25T22:40:13.598003+0000","last_active":"2024-04-25T22:40:15.617318+0000","last_peered":"2024-04-25T22:40:15.617318+0000","last_clean":"2024-04-25T22:40:15.617318+0000","last_became_active":"2024-04-25T22:40:13.596631+0000","last_became_peered":"2024-04-25T22:40:13.596631+0000","last_unstale":"2024-04-25T22:40:15.617318+0000","last_undegraded":"2024-04-25T22:40:15.617318+0000","last_fullsized":"2024-04-25T22:40:15.617318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:50.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614024+0000","last_change":"2024-04-25T22:40:14.620064+0000","last_active":"2024-04-25T22:40:15.614024+0000","last_peered":"2024-04-25T22:40:15.614024+0000","last_clean":"2024-04-25T22:40:15.614024+0000","last_became_active":"2024-04-25T22:40:14.619294+0000","last_became_peered":"2024-04-25T22:40:14.619294+0000","last_unstale":"2024-04-25T22:40:15.614024+0000","last_undegraded":"2024-04-25T22:40:15.614024+0000","last_fullsized":"2024-04-25T22:40:15.614024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.660194+0000","last_change":"2024-04-25T22:40:13.600050+0000","last_active":"2024-04-25T22:40:15.660194+0000","last_peered":"2024-04-25T22:40:15.660194+0000","last_clean":"2024-04-25T22:40:15.660194+0000","last_became_active":"2024-04-25T22:40:13.599138+0000","last_became_peered":"2024-04-25T22:40:13.599138+0000","last_unstale":"2024-04-25T22:40:15.660194+0000","last_undegraded":"2024-04-25T22:40:15.660194+0000","last_fullsized":"2024-04-25T22:40:15.660194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:36.847491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.618448+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:40:15.618448+0000","last_peered":"2024-04-25T22:40:15.618448+0000","last_clean":"2024-04-25T22:40:15.618448+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:40:15.618448+0000","last_undegraded":"2024-04-25T22:40:15.618448+0000","last_fullsized":"2024-04-25T22:40:15.618448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614160+0000","last_change":"2024-04-25T22:40:14.627868+0000","last_active":"2024-04-25T22:40:15.614160+0000","last_peered":"2024-04-25T22:40:15.614160+0000","last_clean":"2024-04-25T22:40:15.614160+0000","last_became_active":"2024-04-25T22:40:14.626388+0000","last_became_peered":"2024-04-25T22:40:14.626388+0000","last_unstale":"2024-04-25T22:40:15.614160+0000","last_undegraded":"2024-04-25T22:40:15.614160+0000","last_fullsized":"2024-04-25T22:40:15.614160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616733+0000","last_change":"2024-04-25T22:40:13.593378+0000","last_active":"2024-04-25T22:40:15.616733+0000","last_peered":"2024-04-25T22:40:15.616733+0000","last_clean":"2024-04-25T22:40:15.616733+0000","last_became_active":"2024-04-25T22:40:13.592392+0000","last_became_peered":"2024-04-25T22:40:13.592392+0000","last_unstale":"2024-04-25T22:40:15.616733+0000","last_undegraded":"2024-04-25T22:40:15.616733+0000","last_fullsized":"2024-04-25T22:40:15.616733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.613799+0000","last_change":"2024-04-25T22:40:14.619640+0000","last_active":"2024-04-25T22:40:15.613799+0000","last_peered":"2024-04-25T22:40:15.613799+0000","last_clean":"2024-04-25T22:40:15.613799+0000","last_became_active":"2024-04-25T22:40:14.618088+0000","last_became_peered":"2024-04-25T22:40:14.618088+0000","last_unstale":"2024-04-25T22:40:15.613799+0000","last_undegraded":"2024-04-25T22:40:15.613799+0000","last_fullsized":"2024-04-25T22:40:15.613799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:58.322470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659293+0000","last_change":"2024-04-25T22:40:14.622624+0000","last_active":"2024-04-25T22:40:15.659293+0000","last_peered":"2024-04-25T22:40:15.659293+0000","last_clean":"2024-04-25T22:40:15.659293+0000","last_became_active":"2024-04-25T22:40:14.621883+0000","last_became_peered":"2024-04-25T22:40:14.621883+0000","last_unstale":"2024-04-25T22:40:15.659293+0000","last_undegraded":"2024-04-25T22:40:15.659293+0000","last_fullsized":"2024-04-25T22:40:15.659293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614104+0000","last_change":"2024-04-25T22:40:13.588577+0000","last_active":"2024-04-25T22:40:15.614104+0000","last_peered":"2024-04-25T22:40:15.614104+0000","last_clean":"2024-04-25T22:40:15.614104+0000","last_became_active":"2024-04-25T22:40:13.588019+0000","last_became_peered":"2024-04-25T22:40:13.588019+0000","last_unstale":"2024-04-25T22:40:15.614104+0000","last_undegraded":"2024-04-25T22:40:15.614104+0000","last_fullsized":"2024-04-25T22:40:15.614104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:07.743396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616085+0000","last_change":"2024-04-25T22:40:14.630597+0000","last_active":"2024-04-25T22:40:15.616085+0000","last_peered":"2024-04-25T22:40:15.616085+0000","last_clean":"2024-04-25T22:40:15.616085+0000","last_became_active":"2024-04-25T22:40:14.628981+0000","last_became_peered":"2024-04-25T22:40:14.628981+0000","last_unstale":"2024-04-25T22:40:15.616085+0000","last_undegraded":"2024-04-25T22:40:15.616085+0000","last_fullsized":"2024-04-25T22:40:15.616085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.614326+0000","last_change":"2024-04-25T22:40:13.581827+0000","last_active":"2024-04-25T22:40:15.614326+0000","last_peered":"2024-04-25T22:40:15.614326+0000","last_clean":"2024-04-25T22:40:15.614326+0000","last_became_active":"2024-04-25T22:40:13.581166+0000","last_became_peered":"2024-04-25T22:40:13.581166+0000","last_unstale":"2024-04-25T22:40:15.614326+0000","last_undegraded":"2024-04-25T22:40:15.614326+0000","last_fullsized":"2024-04-25T22:40:15.614326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659335+0000","last_change":"2024-04-25T22:40:14.636300+0000","last_active":"2024-04-25T22:40:15.659335+0000","last_peered":"2024-04-25T22:40:15.659335+0000","last_clean":"2024-04-25T22:40:15.659335+0000","last_became_active":"2024-04-25T22:40:14.635200+0000","last_became_peered":"2024-04-25T22:40:14.635200+0000","last_unstale":"2024-04-25T22:40:15.659335+0000","last_undegraded":"2024-04-25T22:40:15.659335+0000","last_fullsized":"2024-04-25T22:40:15.659335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.657711+0000","last_change":"2024-04-25T22:40:13.597736+0000","last_active":"2024-04-25T22:40:15.657711+0000","last_peered":"2024-04-25T22:40:15.657711+0000","last_clean":"2024-04-25T22:40:15.657711+0000","last_became_active":"2024-04-25T22:40:13.596811+0000","last_became_peered":"2024-04-25T22:40:13.596811+0000","last_unstale":"2024-04-25T22:40:15.657711+0000","last_undegraded":"2024-04-25T22:40:15.657711+0000","last_fullsized":"2024-04-25T22:40:15.657711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:14:39.783367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658355+0000","last_change":"2024-04-25T22:40:14.616725+0000","last_active":"2024-04-25T22:40:15.658355+0000","last_peered":"2024-04-25T22:40:15.658355+0000","last_clean":"2024-04-25T22:40:15.658355+0000","last_became_active":"2024-04-25T22:40:14.615881+0000","last_became_peered":"2024-04-25T22:40:14.615881+0000","last_unstale":"2024-04-25T22:40:15.658355+0000","last_undegraded":"2024-04-25T22:40:15.658355+0000","last_fullsized":"2024-04-25T22:40:15.658355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658755+0000","last_change":"2024-04-25T22:40:13.594299+0000","last_active":"2024-04-25T22:40:15.658755+0000","last_peered":"2024-04-25T22:40:15.658755+0000","last_clean":"2024-04-25T22:40:15.658755+0000","last_became_active":"2024-04-25T22:40:13.593477+0000","last_became_peered":"2024-04-25T22:40:13.593477+0000","last_unstale":"2024-04-25T22:40:15.658755+0000","last_undegraded":"2024-04-25T22:40:15.658755+0000","last_fullsized":"2024-04-25T22:40:15.658755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:55.181892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616518+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:40:15.616518+0000","last_peered":"2024-04-25T22:40:15.616518+0000","last_clean":"2024-04-25T22:40:15.616518+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:40:15.616518+0000","last_undegraded":"2024-04-25T22:40:15.616518+0000","last_fullsized":"2024-04-25T22:40:15.616518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.617388+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:40:15.617388+0000","last_peered":"2024-04-25T22:40:15.617388+0000","last_clean":"2024-04-25T22:40:15.617388+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:40:15.617388+0000","last_undegraded":"2024-04-25T22:40:15.617388+0000","last_fullsized":"2024-04-25T22:40:15.617388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616444+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:40:15.616444+0000","last_peered":"2024-04-25T22:40:15.616444+0000","last_clean":"2024-04-25T22:40:15.616444+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:40:15.616444+0000","last_undegraded":"2024-04-25T22:40:15.616444+0000","last_fullsized":"2024-04-25T22:40:15.616444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.659592+0000","last_change":"2024-04-25T22:40:13.600784+0000","last_active":"2024-04-25T22:40:15.659592+0000","last_peered":"2024-04-25T22:40:15.659592+0000","last_clean":"2024-04-25T22:40:15.659592+0000","last_became_active":"2024-04-25T22:40:13.600104+0000","last_became_peered":"2024-04-25T22:40:13.600104+0000","last_unstale":"2024-04-25T22:40:15.659592+0000","last_undegraded":"2024-04-25T22:40:15.659592+0000","last_fullsized":"2024-04-25T22:40:15.659592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:54.861491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.658308+0000","last_change":"2024-04-25T22:40:14.618046+0000","last_active":"2024-04-25T22:40:15.658308+0000","last_peered":"2024-04-25T22:40:15.658308+0000","last_clean":"2024-04-25T22:40:15.658308+0000","last_became_active":"2024-04-25T22:40:14.616356+0000","last_became_peered":"2024-04-25T22:40:14.616356+0000","last_unstale":"2024-04-25T22:40:15.658308+0000","last_undegraded":"2024-04-25T22:40:15.658308+0000","last_fullsized":"2024-04-25T22:40:15.658308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:58.322470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616346+0000","last_change":"2024-04-25T22:40:13.594172+0000","last_active":"2024-04-25T22:40:15.616346+0000","last_peered":"2024-04-25T22:40:15.616346+0000","last_clean":"2024-04-25T22:40:15.616346+0000","last_became_active":"2024-04-25T22:40:13.593428+0000","last_became_peered":"2024-04-25T22:40:13.593428+0000","last_unstale":"2024-04-25T22:40:15.616346+0000","last_undegraded":"2024-04-25T22:40:15.616346+0000","last_fullsized":"2024-04-25T22:40:15.616346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:41:51.887162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616499+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:40:15.616499+0000","last_peered":"2024-04-25T22:40:15.616499+0000","last_clean":"2024-04-25T22:40:15.616499+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:40:15.616499+0000","last_undegraded":"2024-04-25T22:40:15.616499+0000","last_fullsized":"2024-04-25T22:40:15.616499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T22:40:15.616446+0000","last_change":"2024-04-25T22:40:13.593659+0000","last_active":"2024-04-25T22:40:15.616446+0000","last_peered":"2024-04-25T22:40:15.616446+0000","last_clean":"2024-04-25T22:40:15.616446+0000","last_became_active":"2024-04-25T22:40:13.592874+0000","last_became_peered":"2024-04-25T22:40:13.592874+0000","last_unstale":"2024-04-25T22:40:15.616446+0000","last_undegraded":"2024-04-25T22:40:15.616446+0000","last_fullsized":"2024-04-25T22:40:15.616446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738379,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":58349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":782336,"data_stored":649895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":790528,"data_stored":650511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:40:33.954 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T22:40:33.954 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-25T22:40:34.293 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 19 2024-04-25T22:40:34.293 INFO:teuthology.orchestra.run.smithi057.stdout:fsid 5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d 2024-04-25T22:40:34.294 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-04-25T22:39:52.303074+0000 2024-04-25T22:40:34.294 INFO:teuthology.orchestra.run.smithi057.stdout:modified 2024-04-25T22:40:15.597829+0000 2024-04-25T22:40:34.294 INFO:teuthology.orchestra.run.smithi057.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-25T22:40:34.294 INFO:teuthology.orchestra.run.smithi057.stdout:crush_version 4 2024-04-25T22:40:34.294 INFO:teuthology.orchestra.run.smithi057.stdout:full_ratio 0.95 2024-04-25T22:40:34.294 INFO:teuthology.orchestra.run.smithi057.stdout:backfillfull_ratio 0.9 2024-04-25T22:40:34.294 INFO:teuthology.orchestra.run.smithi057.stdout:nearfull_ratio 0.85 2024-04-25T22:40:34.294 INFO:teuthology.orchestra.run.smithi057.stdout:require_min_compat_client luminous 2024-04-25T22:40:34.294 INFO:teuthology.orchestra.run.smithi057.stdout:min_compat_client jewel 2024-04-25T22:40:34.294 INFO:teuthology.orchestra.run.smithi057.stdout:require_osd_release squid 2024-04-25T22:40:34.294 INFO:teuthology.orchestra.run.smithi057.stdout:stretch_mode_enabled false 2024-04-25T22:40:34.294 INFO:teuthology.orchestra.run.smithi057.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 12 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-25T22:40:34.294 INFO:teuthology.orchestra.run.smithi057.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-25T22:40:34.295 INFO:teuthology.orchestra.run.smithi057.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-25T22:40:34.295 INFO:teuthology.orchestra.run.smithi057.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-25T22:40:34.295 INFO:teuthology.orchestra.run.smithi057.stdout:max_osd 3 2024-04-25T22:40:34.295 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6800/765118869,v1:172.21.15.122:6801/765118869] [v2:172.21.15.122:6802/765118869,v1:172.21.15.122:6803/765118869] exists,up 73d465b4-5896-4d69-80b1-7e69d31eb455 2024-04-25T22:40:34.295 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6800/2387035286,v1:172.21.15.148:6801/2387035286] [v2:172.21.15.148:6802/2387035286,v1:172.21.15.148:6803/2387035286] exists,up 8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5 2024-04-25T22:40:34.295 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.188:6800/368834361,v1:172.21.15.188:6801/368834361] [v2:172.21.15.188:6802/368834361,v1:172.21.15.188:6803/368834361] exists,up 164fc653-2135-4e9b-8826-1716fdba6ea0 2024-04-25T22:40:34.311 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6800/765118869,v1:172.21.15.122:6801/765118869] [v2:172.21.15.122:6802/765118869,v1:172.21.15.122:6803/765118869] exists,up 73d465b4-5896-4d69-80b1-7e69d31eb455', 'osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6800/2387035286,v1:172.21.15.148:6801/2387035286] [v2:172.21.15.148:6802/2387035286,v1:172.21.15.148:6803/2387035286] exists,up 8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5', 'osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.188:6800/368834361,v1:172.21.15.188:6801/368834361] [v2:172.21.15.188:6802/368834361,v1:172.21.15.188:6803/368834361] exists,up 164fc653-2135-4e9b-8826-1716fdba6ea0'] 2024-04-25T22:40:34.312 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-25T22:40:34.421 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:40:34.421 INFO:teuthology.orchestra.run.smithi057.stdout: "name": "mon.a", 2024-04-25T22:40:34.421 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster": "ceph", 2024-04-25T22:40:34.421 INFO:teuthology.orchestra.run.smithi057.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-25T22:40:34.421 INFO:teuthology.orchestra.run.smithi057.stdout: "admin_socket_mode": "", 2024-04-25T22:40:34.421 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-25T22:40:34.421 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_client_required": "cephx, none", 2024-04-25T22:40:34.421 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_cluster_required": "cephx", 2024-04-25T22:40:34.421 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_debug": "true", 2024-04-25T22:40:34.422 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-25T22:40:34.422 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-25T22:40:34.422 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_service_required": "cephx", 2024-04-25T22:40:34.422 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-25T22:40:34.422 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_supported": "cephx", 2024-04-25T22:40:34.422 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_aio": "true", 2024-04-25T22:40:34.422 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-25T22:40:34.422 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_aio_poll_ms": "250", 2024-04-25T22:40:34.422 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_aio_reap_max": "16", 2024-04-25T22:40:34.422 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_async_discard": "false", 2024-04-25T22:40:34.422 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_block_size": "4096", 2024-04-25T22:40:34.422 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_debug_aio": "false", 2024-04-25T22:40:34.422 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-25T22:40:34.422 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-25T22:40:34.423 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_debug_inflight_ios": "false", 2024-04-25T22:40:34.423 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_enable_discard": "false", 2024-04-25T22:40:34.423 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_flock_retry": "3", 2024-04-25T22:40:34.423 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-25T22:40:34.423 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_inject_crash": "0", 2024-04-25T22:40:34.423 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-25T22:40:34.423 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_ioring": "false", 2024-04-25T22:40:34.423 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_ioring_hipri": "false", 2024-04-25T22:40:34.423 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-25T22:40:34.423 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-25T22:40:34.423 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-25T22:40:34.423 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-25T22:40:34.423 INFO:teuthology.orchestra.run.smithi057.stdout: "bdev_type": "", 2024-04-25T22:40:34.423 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_alloc_size": "1048576", 2024-04-25T22:40:34.424 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_allocator": "hybrid", 2024-04-25T22:40:34.424 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_buffered_io": "true", 2024-04-25T22:40:34.424 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_check_for_zeros": "false", 2024-04-25T22:40:34.424 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-25T22:40:34.424 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-25T22:40:34.424 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_compact_log_sync": "false", 2024-04-25T22:40:34.424 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-25T22:40:34.424 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-25T22:40:34.424 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-25T22:40:34.424 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-25T22:40:34.424 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_max_log_runway": "4194304", 2024-04-25T22:40:34.424 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_max_prefetch": "1048576", 2024-04-25T22:40:34.424 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_min_flush_size": "524288", 2024-04-25T22:40:34.424 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_min_log_runway": "1048576", 2024-04-25T22:40:34.425 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_replay_recovery": "false", 2024-04-25T22:40:34.425 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-25T22:40:34.425 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-25T22:40:34.425 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_sync_write": "false", 2024-04-25T22:40:34.425 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-25T22:40:34.425 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-25T22:40:34.425 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-25T22:40:34.425 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_allocation_from_file": "true", 2024-04-25T22:40:34.425 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_allocator": "hybrid", 2024-04-25T22:40:34.425 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-25T22:40:34.425 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-25T22:40:34.425 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-25T22:40:34.425 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-25T22:40:34.425 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-25T22:40:34.425 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-25T22:40:34.426 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-25T22:40:34.426 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_block_create": "true", 2024-04-25T22:40:34.426 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_block_db_create": "false", 2024-04-25T22:40:34.426 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_block_db_path": "", 2024-04-25T22:40:34.426 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_block_db_size": "0", 2024-04-25T22:40:34.426 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_block_path": "", 2024-04-25T22:40:34.426 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_block_preallocate_file": "false", 2024-04-25T22:40:34.426 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_block_size": "107374182400", 2024-04-25T22:40:34.426 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_block_wal_create": "false", 2024-04-25T22:40:34.426 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_block_wal_path": "", 2024-04-25T22:40:34.426 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_block_wal_size": "100663296", 2024-04-25T22:40:34.426 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_bluefs": "true", 2024-04-25T22:40:34.426 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-25T22:40:34.426 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-25T22:40:34.427 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-25T22:40:34.427 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-25T22:40:34.427 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-25T22:40:34.427 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-25T22:40:34.427 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-25T22:40:34.427 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-25T22:40:34.427 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_autotune": "true", 2024-04-25T22:40:34.427 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-25T22:40:34.427 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-25T22:40:34.427 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-25T22:40:34.427 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-25T22:40:34.427 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_size": "0", 2024-04-25T22:40:34.427 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-25T22:40:34.427 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-25T22:40:34.427 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-25T22:40:34.428 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-25T22:40:34.428 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_type": "2q", 2024-04-25T22:40:34.428 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-25T22:40:34.428 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_clone_cow": "true", 2024-04-25T22:40:34.428 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-25T22:40:34.428 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-25T22:40:34.428 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-25T22:40:34.428 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-25T22:40:34.428 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-25T22:40:34.428 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-25T22:40:34.428 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-25T22:40:34.428 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_compression_mode": "none", 2024-04-25T22:40:34.428 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-25T22:40:34.428 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_csum_type": "crc32c", 2024-04-25T22:40:34.429 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-25T22:40:34.429 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_debug_freelist": "false", 2024-04-25T22:40:34.429 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-25T22:40:34.429 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-25T22:40:34.429 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-25T22:40:34.429 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-25T22:40:34.429 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-25T22:40:34.429 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-25T22:40:34.429 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-25T22:40:34.429 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-25T22:40:34.429 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-25T22:40:34.429 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-25T22:40:34.429 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-25T22:40:34.429 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-25T22:40:34.429 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-25T22:40:34.430 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_debug_small_allocations": "0", 2024-04-25T22:40:34.430 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-25T22:40:34.430 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_default_buffered_read": "true", 2024-04-25T22:40:34.430 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_default_buffered_write": "false", 2024-04-25T22:40:34.430 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-25T22:40:34.430 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-25T22:40:34.430 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-25T22:40:34.430 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_elastic_shared_blobs": "true", 2024-04-25T22:40:34.430 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-25T22:40:34.430 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-25T22:40:34.430 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-25T22:40:34.430 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-25T22:40:34.430 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-25T22:40:34.430 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fail_eio": "false", 2024-04-25T22:40:34.431 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-25T22:40:34.431 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-25T22:40:34.431 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-25T22:40:34.431 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-25T22:40:34.431 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-25T22:40:34.431 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-25T22:40:34.431 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_on_mount": "false", 2024-04-25T22:40:34.431 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-25T22:40:34.431 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_on_umount": "false", 2024-04-25T22:40:34.431 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-25T22:40:34.431 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-25T22:40:34.431 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-25T22:40:34.431 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-25T22:40:34.431 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-25T22:40:34.431 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-25T22:40:34.432 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-25T22:40:34.432 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-25T22:40:34.432 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_ignore_data_csum": "false", 2024-04-25T22:40:34.432 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-25T22:40:34.432 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-25T22:40:34.432 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-25T22:40:34.432 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-25T22:40:34.432 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_log_op_age": "5.000000", 2024-04-25T22:40:34.432 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_max_alloc_size": "0", 2024-04-25T22:40:34.432 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_max_blob_size": "0", 2024-04-25T22:40:34.432 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-25T22:40:34.432 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-25T22:40:34.432 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-25T22:40:34.432 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_max_deferred_txc": "32", 2024-04-25T22:40:34.433 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_min_alloc_size": "0", 2024-04-25T22:40:34.433 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-25T22:40:34.433 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-25T22:40:34.433 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_nid_prealloc": "1024", 2024-04-25T22:40:34.433 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-25T22:40:34.433 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-25T22:40:34.433 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-25T22:40:34.433 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-25T22:40:34.433 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_retry_disk_reads": "3", 2024-04-25T22:40:34.433 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_rocksdb_cf": "true", 2024-04-25T22:40:34.433 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-25T22:40:34.433 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-25T22:40:34.433 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-25T22:40:34.433 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-25T22:40:34.434 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-25T22:40:34.434 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-25T22:40:34.434 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_spdk_mem": "512", 2024-04-25T22:40:34.434 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-25T22:40:34.434 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-25T22:40:34.434 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-25T22:40:34.434 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-25T22:40:34.434 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-25T22:40:34.434 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-25T22:40:34.434 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-25T22:40:34.434 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_tracing": "false", 2024-04-25T22:40:34.434 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-25T22:40:34.434 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-25T22:40:34.435 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-25T22:40:34.435 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-25T22:40:34.435 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-25T22:40:34.435 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-25T22:40:34.435 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-25T22:40:34.435 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-25T22:40:34.435 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-25T22:40:34.435 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_zero_block_detection": "false", 2024-04-25T22:40:34.435 INFO:teuthology.orchestra.run.smithi057.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-25T22:40:34.435 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-25T22:40:34.435 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-25T22:40:34.435 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-25T22:40:34.435 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-25T22:40:34.435 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-25T22:40:34.436 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-25T22:40:34.436 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-25T22:40:34.436 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-25T22:40:34.436 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-25T22:40:34.436 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-25T22:40:34.436 INFO:teuthology.orchestra.run.smithi057.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-25T22:40:34.436 INFO:teuthology.orchestra.run.smithi057.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-25T22:40:34.436 INFO:teuthology.orchestra.run.smithi057.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-25T22:40:34.436 INFO:teuthology.orchestra.run.smithi057.stdout: "cephx_cluster_require_signatures": "false", 2024-04-25T22:40:34.436 INFO:teuthology.orchestra.run.smithi057.stdout: "cephx_cluster_require_version": "2", 2024-04-25T22:40:34.436 INFO:teuthology.orchestra.run.smithi057.stdout: "cephx_require_signatures": "false", 2024-04-25T22:40:34.436 INFO:teuthology.orchestra.run.smithi057.stdout: "cephx_require_version": "2", 2024-04-25T22:40:34.436 INFO:teuthology.orchestra.run.smithi057.stdout: "cephx_service_require_signatures": "false", 2024-04-25T22:40:34.436 INFO:teuthology.orchestra.run.smithi057.stdout: "cephx_service_require_version": "2", 2024-04-25T22:40:34.437 INFO:teuthology.orchestra.run.smithi057.stdout: "cephx_sign_messages": "true", 2024-04-25T22:40:34.437 INFO:teuthology.orchestra.run.smithi057.stdout: "chdir": "", 2024-04-25T22:40:34.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_acl_type": "", 2024-04-25T22:40:34.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_asio_thread_count": "2", 2024-04-25T22:40:34.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_cache_mid": "0.750000", 2024-04-25T22:40:34.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_cache_size": "16384", 2024-04-25T22:40:34.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_caps_release_delay": "5", 2024-04-25T22:40:34.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_check_pool_perm": "true", 2024-04-25T22:40:34.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-25T22:40:34.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_debug_force_sync_read": "false", 2024-04-25T22:40:34.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_debug_getattr_caps": "false", 2024-04-25T22:40:34.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_debug_inject_tick_delay": "0", 2024-04-25T22:40:34.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-25T22:40:34.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_die_on_failed_remount": "false", 2024-04-25T22:40:34.438 INFO:teuthology.orchestra.run.smithi057.stdout: "client_dirsize_rbytes": "true", 2024-04-25T22:40:34.438 INFO:teuthology.orchestra.run.smithi057.stdout: "client_force_lazyio": "false", 2024-04-25T22:40:34.438 INFO:teuthology.orchestra.run.smithi057.stdout: "client_fs": "", 2024-04-25T22:40:34.438 INFO:teuthology.orchestra.run.smithi057.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-25T22:40:34.438 INFO:teuthology.orchestra.run.smithi057.stdout: "client_inject_release_failure": "false", 2024-04-25T22:40:34.438 INFO:teuthology.orchestra.run.smithi057.stdout: "client_max_inline_size": "4096", 2024-04-25T22:40:34.438 INFO:teuthology.orchestra.run.smithi057.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-25T22:40:34.438 INFO:teuthology.orchestra.run.smithi057.stdout: "client_mds_namespace": "", 2024-04-25T22:40:34.438 INFO:teuthology.orchestra.run.smithi057.stdout: "client_metadata": "", 2024-04-25T22:40:34.438 INFO:teuthology.orchestra.run.smithi057.stdout: "client_mount_gid": "-1", 2024-04-25T22:40:34.438 INFO:teuthology.orchestra.run.smithi057.stdout: "client_mount_timeout": "300", 2024-04-25T22:40:34.438 INFO:teuthology.orchestra.run.smithi057.stdout: "client_mount_uid": "-1", 2024-04-25T22:40:34.438 INFO:teuthology.orchestra.run.smithi057.stdout: "client_mountpoint": "/", 2024-04-25T22:40:34.438 INFO:teuthology.orchestra.run.smithi057.stdout: "client_notify_timeout": "10", 2024-04-25T22:40:34.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_oc": "true", 2024-04-25T22:40:34.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_oc_max_dirty": "104857600", 2024-04-25T22:40:34.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-25T22:40:34.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_oc_max_objects": "1000", 2024-04-25T22:40:34.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_oc_size": "209715200", 2024-04-25T22:40:34.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_oc_target_dirty": "8388608", 2024-04-25T22:40:34.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_permissions": "true", 2024-04-25T22:40:34.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_quota": "true", 2024-04-25T22:40:34.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_quota_df": "true", 2024-04-25T22:40:34.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_readahead_max_bytes": "0", 2024-04-25T22:40:34.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_readahead_max_periods": "4", 2024-04-25T22:40:34.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_readahead_min": "131072", 2024-04-25T22:40:34.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_reconnect_stale": "false", 2024-04-25T22:40:34.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_shutdown_timeout": "30", 2024-04-25T22:40:34.440 INFO:teuthology.orchestra.run.smithi057.stdout: "client_snapdir": ".snap", 2024-04-25T22:40:34.440 INFO:teuthology.orchestra.run.smithi057.stdout: "client_tick_interval": "1", 2024-04-25T22:40:34.440 INFO:teuthology.orchestra.run.smithi057.stdout: "client_trace": "", 2024-04-25T22:40:34.440 INFO:teuthology.orchestra.run.smithi057.stdout: "client_try_dentry_invalidate": "false", 2024-04-25T22:40:34.440 INFO:teuthology.orchestra.run.smithi057.stdout: "client_use_faked_inos": "false", 2024-04-25T22:40:34.440 INFO:teuthology.orchestra.run.smithi057.stdout: "client_use_random_mds": "false", 2024-04-25T22:40:34.440 INFO:teuthology.orchestra.run.smithi057.stdout: "clog_to_graylog": "false", 2024-04-25T22:40:34.440 INFO:teuthology.orchestra.run.smithi057.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-25T22:40:34.440 INFO:teuthology.orchestra.run.smithi057.stdout: "clog_to_graylog_port": "12201", 2024-04-25T22:40:34.440 INFO:teuthology.orchestra.run.smithi057.stdout: "clog_to_monitors": "default=true", 2024-04-25T22:40:34.440 INFO:teuthology.orchestra.run.smithi057.stdout: "clog_to_syslog": "false", 2024-04-25T22:40:34.440 INFO:teuthology.orchestra.run.smithi057.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-25T22:40:34.440 INFO:teuthology.orchestra.run.smithi057.stdout: "clog_to_syslog_level": "info", 2024-04-25T22:40:34.440 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "-", 2024-04-25T22:40:34.441 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_network": "", 2024-04-25T22:40:34.441 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_network_interface": "", 2024-04-25T22:40:34.441 INFO:teuthology.orchestra.run.smithi057.stdout: "compressor_zlib_isal": "false", 2024-04-25T22:40:34.441 INFO:teuthology.orchestra.run.smithi057.stdout: "compressor_zlib_level": "5", 2024-04-25T22:40:34.441 INFO:teuthology.orchestra.run.smithi057.stdout: "compressor_zlib_winsize": "-15", 2024-04-25T22:40:34.441 INFO:teuthology.orchestra.run.smithi057.stdout: "compressor_zstd_level": "1", 2024-04-25T22:40:34.441 INFO:teuthology.orchestra.run.smithi057.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-25T22:40:34.441 INFO:teuthology.orchestra.run.smithi057.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-25T22:40:34.441 INFO:teuthology.orchestra.run.smithi057.stdout: "crimson_alien_op_num_threads": "6", 2024-04-25T22:40:34.441 INFO:teuthology.orchestra.run.smithi057.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-25T22:40:34.441 INFO:teuthology.orchestra.run.smithi057.stdout: "crimson_osd_obc_lru_size": "512", 2024-04-25T22:40:34.441 INFO:teuthology.orchestra.run.smithi057.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-25T22:40:34.441 INFO:teuthology.orchestra.run.smithi057.stdout: "crimson_seastar_cpu_cores": "", 2024-04-25T22:40:34.441 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_location": "", 2024-04-25T22:40:34.442 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_location_hook": "", 2024-04-25T22:40:34.442 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_location_hook_timeout": "10", 2024-04-25T22:40:34.442 INFO:teuthology.orchestra.run.smithi057.stdout: "daemonize": "false", 2024-04-25T22:40:34.442 INFO:teuthology.orchestra.run.smithi057.stdout: "daos_pool": "tank", 2024-04-25T22:40:34.442 INFO:teuthology.orchestra.run.smithi057.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-25T22:40:34.442 INFO:teuthology.orchestra.run.smithi057.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-25T22:40:34.442 INFO:teuthology.orchestra.run.smithi057.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-25T22:40:34.442 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_alienstore": "0/5", 2024-04-25T22:40:34.442 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_allow_any_pool_priority": "false", 2024-04-25T22:40:34.442 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_asok": "1/5", 2024-04-25T22:40:34.442 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_asok_assert_abort": "false", 2024-04-25T22:40:34.442 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_asserts_on_shutdown": "true", 2024-04-25T22:40:34.442 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_auth": "20/20", 2024-04-25T22:40:34.442 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_bdev": "1/3", 2024-04-25T22:40:34.443 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_bluefs": "1/5", 2024-04-25T22:40:34.443 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_bluestore": "1/5", 2024-04-25T22:40:34.443 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_buffer": "0/1", 2024-04-25T22:40:34.443 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_ceph_exporter": "1/5", 2024-04-25T22:40:34.443 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_cephfs_mirror": "0/5", 2024-04-25T22:40:34.443 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_cephsqlite": "0/5", 2024-04-25T22:40:34.443 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_client": "0/5", 2024-04-25T22:40:34.443 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_compressor": "1/5", 2024-04-25T22:40:34.443 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_context": "0/1", 2024-04-25T22:40:34.443 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_crimson_interrupt": "0/5", 2024-04-25T22:40:34.443 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_crush": "1/1", 2024-04-25T22:40:34.443 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_crypto": "1/5", 2024-04-25T22:40:34.443 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_cyanstore": "0/5", 2024-04-25T22:40:34.443 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_deliberately_leak_memory": "false", 2024-04-25T22:40:34.444 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_disable_randomized_ping": "false", 2024-04-25T22:40:34.444 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_dpdk": "1/5", 2024-04-25T22:40:34.444 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_eventtrace": "1/5", 2024-04-25T22:40:34.444 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_filer": "0/1", 2024-04-25T22:40:34.444 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_filestore": "1/3", 2024-04-25T22:40:34.444 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_finisher": "1/1", 2024-04-25T22:40:34.444 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_fuse": "1/5", 2024-04-25T22:40:34.444 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_heartbeat_testing_span": "0", 2024-04-25T22:40:34.444 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_heartbeatmap": "1/5", 2024-04-25T22:40:34.444 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-25T22:40:34.444 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_javaclient": "1/5", 2024-04-25T22:40:34.444 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_journal": "1/3", 2024-04-25T22:40:34.444 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_journaler": "0/5", 2024-04-25T22:40:34.444 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_kstore": "1/5", 2024-04-25T22:40:34.444 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_lockdep": "0/1", 2024-04-25T22:40:34.445 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_mclock": "1/5", 2024-04-25T22:40:34.445 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_mds": "1/5", 2024-04-25T22:40:34.445 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_mds_balancer": "1/5", 2024-04-25T22:40:34.445 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_mds_locker": "1/5", 2024-04-25T22:40:34.445 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_mds_log": "1/5", 2024-04-25T22:40:34.445 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_mds_log_expire": "1/5", 2024-04-25T22:40:34.445 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_mds_migrator": "1/5", 2024-04-25T22:40:34.445 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_mds_quiesce": "3/5", 2024-04-25T22:40:34.445 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_memstore": "1/5", 2024-04-25T22:40:34.445 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_mgr": "2/5", 2024-04-25T22:40:34.445 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_mgrc": "1/5", 2024-04-25T22:40:34.445 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_mon": "20/20", 2024-04-25T22:40:34.445 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_monc": "0/10", 2024-04-25T22:40:34.445 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_ms": "1/1", 2024-04-25T22:40:34.446 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_none": "0/5", 2024-04-25T22:40:34.446 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_objclass": "0/5", 2024-04-25T22:40:34.446 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_objectcacher": "0/5", 2024-04-25T22:40:34.446 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_objecter": "0/1", 2024-04-25T22:40:34.446 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_optracker": "0/5", 2024-04-25T22:40:34.446 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_osd": "1/5", 2024-04-25T22:40:34.446 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_paxos": "20/20", 2024-04-25T22:40:34.446 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_perfcounter": "1/5", 2024-04-25T22:40:34.446 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_prioritycache": "1/5", 2024-04-25T22:40:34.446 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_rados": "0/5", 2024-04-25T22:40:34.446 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_rbd": "0/5", 2024-04-25T22:40:34.446 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_rbd_mirror": "0/5", 2024-04-25T22:40:34.446 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_rbd_pwl": "0/5", 2024-04-25T22:40:34.446 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_rbd_replay": "0/5", 2024-04-25T22:40:34.447 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_refs": "0/0", 2024-04-25T22:40:34.447 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_reserver": "1/1", 2024-04-25T22:40:34.447 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_rgw": "1/5", 2024-04-25T22:40:34.447 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_rgw_access": "1/5", 2024-04-25T22:40:34.447 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_rgw_datacache": "1/5", 2024-04-25T22:40:34.447 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_rgw_dbstore": "1/5", 2024-04-25T22:40:34.447 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_rgw_flight": "1/5", 2024-04-25T22:40:34.447 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_rgw_lifecycle": "1/5", 2024-04-25T22:40:34.447 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_rgw_sync": "1/5", 2024-04-25T22:40:34.447 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_rocksdb": "4/5", 2024-04-25T22:40:34.447 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_seastore": "0/5", 2024-04-25T22:40:34.447 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_seastore_backref": "0/5", 2024-04-25T22:40:34.447 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_seastore_cache": "0/5", 2024-04-25T22:40:34.447 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_seastore_cleaner": "0/5", 2024-04-25T22:40:34.448 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_seastore_device": "0/5", 2024-04-25T22:40:34.448 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_seastore_epm": "0/5", 2024-04-25T22:40:34.448 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-25T22:40:34.448 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_seastore_journal": "0/5", 2024-04-25T22:40:34.448 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_seastore_lba": "0/5", 2024-04-25T22:40:34.448 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_seastore_odata": "0/5", 2024-04-25T22:40:34.448 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_seastore_omap": "0/5", 2024-04-25T22:40:34.448 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_seastore_onode": "0/5", 2024-04-25T22:40:34.448 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_seastore_t": "0/5", 2024-04-25T22:40:34.448 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_seastore_tm": "0/5", 2024-04-25T22:40:34.448 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_striper": "0/1", 2024-04-25T22:40:34.448 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_test": "0/5", 2024-04-25T22:40:34.448 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_throttle": "1/1", 2024-04-25T22:40:34.448 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_timer": "0/1", 2024-04-25T22:40:34.449 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_tp": "0/5", 2024-04-25T22:40:34.449 INFO:teuthology.orchestra.run.smithi057.stdout: "debug_trace": "1/5", 2024-04-25T22:40:34.449 INFO:teuthology.orchestra.run.smithi057.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-25T22:40:34.449 INFO:teuthology.orchestra.run.smithi057.stdout: "device_failure_prediction_mode": "none", 2024-04-25T22:40:34.449 INFO:teuthology.orchestra.run.smithi057.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-25T22:40:34.449 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-04-25T22:40:34.449 INFO:teuthology.orchestra.run.smithi057.stdout: "err_to_graylog": "false", 2024-04-25T22:40:34.449 INFO:teuthology.orchestra.run.smithi057.stdout: "err_to_journald": "false", 2024-04-25T22:40:34.449 INFO:teuthology.orchestra.run.smithi057.stdout: "err_to_stderr": "true", 2024-04-25T22:40:34.449 INFO:teuthology.orchestra.run.smithi057.stdout: "err_to_syslog": "false", 2024-04-25T22:40:34.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event_tracing": "false", 2024-04-25T22:40:34.449 INFO:teuthology.orchestra.run.smithi057.stdout: "exporter_addr": "0.0.0.0", 2024-04-25T22:40:34.449 INFO:teuthology.orchestra.run.smithi057.stdout: "exporter_http_port": "9926", 2024-04-25T22:40:34.450 INFO:teuthology.orchestra.run.smithi057.stdout: "exporter_prio_limit": "5", 2024-04-25T22:40:34.450 INFO:teuthology.orchestra.run.smithi057.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-25T22:40:34.450 INFO:teuthology.orchestra.run.smithi057.stdout: "exporter_sort_metrics": "true", 2024-04-25T22:40:34.450 INFO:teuthology.orchestra.run.smithi057.stdout: "exporter_stats_period": "5", 2024-04-25T22:40:34.450 INFO:teuthology.orchestra.run.smithi057.stdout: "fake_statfs_for_testing": "0", 2024-04-25T22:40:34.450 INFO:teuthology.orchestra.run.smithi057.stdout: "fatal_signal_handlers": "true", 2024-04-25T22:40:34.450 INFO:teuthology.orchestra.run.smithi057.stdout: "filer_max_purge_ops": "10", 2024-04-25T22:40:34.450 INFO:teuthology.orchestra.run.smithi057.stdout: "filer_max_truncate_ops": "128", 2024-04-25T22:40:34.450 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_apply_finisher_threads": "1", 2024-04-25T22:40:34.450 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_blackhole": "false", 2024-04-25T22:40:34.450 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_btrfs_clone_range": "true", 2024-04-25T22:40:34.450 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_btrfs_snap": "true", 2024-04-25T22:40:34.450 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_caller_concurrency": "10", 2024-04-25T22:40:34.450 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_collect_device_partition_information": "true", 2024-04-25T22:40:34.451 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_commit_timeout": "600.000000", 2024-04-25T22:40:34.451 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_debug_inject_read_err": "false", 2024-04-25T22:40:34.451 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_debug_omap_check": "false", 2024-04-25T22:40:34.451 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-25T22:40:34.451 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_debug_verify_split": "false", 2024-04-25T22:40:34.451 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_dump_file": "", 2024-04-25T22:40:34.451 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-25T22:40:34.451 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-25T22:40:34.451 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_fadvise": "true", 2024-04-25T22:40:34.451 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_fail_eio": "true", 2024-04-25T22:40:34.451 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_fd_cache_shards": "16", 2024-04-25T22:40:34.451 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_fd_cache_size": "128", 2024-04-25T22:40:34.451 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_fiemap": "false", 2024-04-25T22:40:34.451 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_fiemap_threshold": "4096", 2024-04-25T22:40:34.452 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-25T22:40:34.452 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-25T22:40:34.452 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_inject_stall": "0", 2024-04-25T22:40:34.452 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_journal_parallel": "false", 2024-04-25T22:40:34.452 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_journal_trailing": "false", 2024-04-25T22:40:34.452 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_journal_writeahead": "false", 2024-04-25T22:40:34.452 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_kill_at": "0", 2024-04-25T22:40:34.452 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-25T22:40:34.452 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-25T22:40:34.452 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-25T22:40:34.452 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-25T22:40:34.452 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-25T22:40:34.452 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_max_inline_xattrs": "0", 2024-04-25T22:40:34.452 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-25T22:40:34.453 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-25T22:40:34.453 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-25T22:40:34.453 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-25T22:40:34.453 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_max_xattr_value_size": "0", 2024-04-25T22:40:34.453 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-25T22:40:34.453 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-25T22:40:34.453 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-25T22:40:34.453 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_merge_threshold": "-10", 2024-04-25T22:40:34.453 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-25T22:40:34.453 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_odsync_write": "false", 2024-04-25T22:40:34.453 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_omap_backend": "rocksdb", 2024-04-25T22:40:34.453 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_omap_backend_path": "", 2024-04-25T22:40:34.453 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-25T22:40:34.453 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-25T22:40:34.454 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-25T22:40:34.454 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_op_thread_timeout": "60", 2024-04-25T22:40:34.454 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_op_threads": "2", 2024-04-25T22:40:34.454 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_punch_hole": "false", 2024-04-25T22:40:34.454 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-25T22:40:34.454 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-25T22:40:34.454 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-25T22:40:34.454 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-25T22:40:34.454 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-25T22:40:34.454 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-25T22:40:34.454 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-25T22:40:34.455 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-25T22:40:34.455 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-25T22:40:34.455 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_queue_max_ops": "50", 2024-04-25T22:40:34.455 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-25T22:40:34.455 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_seek_data_hole": "false", 2024-04-25T22:40:34.455 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_sloppy_crc": "false", 2024-04-25T22:40:34.455 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-25T22:40:34.455 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_splice": "false", 2024-04-25T22:40:34.455 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_split_multiple": "2", 2024-04-25T22:40:34.455 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_split_rand_factor": "20", 2024-04-25T22:40:34.455 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_update_to": "1000", 2024-04-25T22:40:34.455 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-25T22:40:34.455 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-25T22:40:34.455 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-25T22:40:34.456 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-25T22:40:34.456 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-25T22:40:34.456 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-25T22:40:34.456 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_wbthrottle_enable": "true", 2024-04-25T22:40:34.456 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-25T22:40:34.456 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-25T22:40:34.456 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-25T22:40:34.456 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-25T22:40:34.456 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-25T22:40:34.456 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-25T22:40:34.456 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_xfs_extsize": "false", 2024-04-25T22:40:34.456 INFO:teuthology.orchestra.run.smithi057.stdout: "filestore_zfs_snap": "false", 2024-04-25T22:40:34.456 INFO:teuthology.orchestra.run.smithi057.stdout: "fio_dir": "/tmp/fio", 2024-04-25T22:40:34.456 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d", 2024-04-25T22:40:34.457 INFO:teuthology.orchestra.run.smithi057.stdout: "fuse_allow_other": "true", 2024-04-25T22:40:34.457 INFO:teuthology.orchestra.run.smithi057.stdout: "fuse_atomic_o_trunc": "true", 2024-04-25T22:40:34.457 INFO:teuthology.orchestra.run.smithi057.stdout: "fuse_big_writes": "true", 2024-04-25T22:40:34.457 INFO:teuthology.orchestra.run.smithi057.stdout: "fuse_debug": "false", 2024-04-25T22:40:34.457 INFO:teuthology.orchestra.run.smithi057.stdout: "fuse_default_permissions": "false", 2024-04-25T22:40:34.457 INFO:teuthology.orchestra.run.smithi057.stdout: "fuse_disable_pagecache": "false", 2024-04-25T22:40:34.457 INFO:teuthology.orchestra.run.smithi057.stdout: "fuse_max_write": "0", 2024-04-25T22:40:34.457 INFO:teuthology.orchestra.run.smithi057.stdout: "fuse_multithreaded": "true", 2024-04-25T22:40:34.457 INFO:teuthology.orchestra.run.smithi057.stdout: "fuse_require_active_mds": "true", 2024-04-25T22:40:34.457 INFO:teuthology.orchestra.run.smithi057.stdout: "fuse_set_user_groups": "true", 2024-04-25T22:40:34.457 INFO:teuthology.orchestra.run.smithi057.stdout: "fuse_splice_move": "true", 2024-04-25T22:40:34.457 INFO:teuthology.orchestra.run.smithi057.stdout: "fuse_splice_read": "true", 2024-04-25T22:40:34.457 INFO:teuthology.orchestra.run.smithi057.stdout: "fuse_splice_write": "true", 2024-04-25T22:40:34.457 INFO:teuthology.orchestra.run.smithi057.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-25T22:40:34.457 INFO:teuthology.orchestra.run.smithi057.stdout: "fuse_use_invalidate_cb": "true", 2024-04-25T22:40:34.458 INFO:teuthology.orchestra.run.smithi057.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-25T22:40:34.458 INFO:teuthology.orchestra.run.smithi057.stdout: "gss_target_name": "ceph", 2024-04-25T22:40:34.458 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_file": "", 2024-04-25T22:40:34.458 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_inject_failure": "0", 2024-04-25T22:40:34.458 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_interval": "5", 2024-04-25T22:40:34.458 INFO:teuthology.orchestra.run.smithi057.stdout: "host": "smithi057", 2024-04-25T22:40:34.458 INFO:teuthology.orchestra.run.smithi057.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-25T22:40:34.458 INFO:teuthology.orchestra.run.smithi057.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-25T22:40:34.458 INFO:teuthology.orchestra.run.smithi057.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-25T22:40:34.458 INFO:teuthology.orchestra.run.smithi057.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-25T22:40:34.458 INFO:teuthology.orchestra.run.smithi057.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-25T22:40:34.458 INFO:teuthology.orchestra.run.smithi057.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-25T22:40:34.458 INFO:teuthology.orchestra.run.smithi057.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-25T22:40:34.458 INFO:teuthology.orchestra.run.smithi057.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-25T22:40:34.459 INFO:teuthology.orchestra.run.smithi057.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-25T22:40:34.459 INFO:teuthology.orchestra.run.smithi057.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-25T22:40:34.459 INFO:teuthology.orchestra.run.smithi057.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-25T22:40:34.459 INFO:teuthology.orchestra.run.smithi057.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-25T22:40:34.459 INFO:teuthology.orchestra.run.smithi057.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-25T22:40:34.459 INFO:teuthology.orchestra.run.smithi057.stdout: "inject_early_sigterm": "false", 2024-04-25T22:40:34.459 INFO:teuthology.orchestra.run.smithi057.stdout: "jaeger_agent_port": "6799", 2024-04-25T22:40:34.459 INFO:teuthology.orchestra.run.smithi057.stdout: "jaeger_tracing_enable": "false", 2024-04-25T22:40:34.459 INFO:teuthology.orchestra.run.smithi057.stdout: "journal_aio": "true", 2024-04-25T22:40:34.459 INFO:teuthology.orchestra.run.smithi057.stdout: "journal_align_min_size": "65536", 2024-04-25T22:40:34.459 INFO:teuthology.orchestra.run.smithi057.stdout: "journal_block_align": "true", 2024-04-25T22:40:34.459 INFO:teuthology.orchestra.run.smithi057.stdout: "journal_block_size": "4096", 2024-04-25T22:40:34.459 INFO:teuthology.orchestra.run.smithi057.stdout: "journal_dio": "true", 2024-04-25T22:40:34.459 INFO:teuthology.orchestra.run.smithi057.stdout: "journal_discard": "false", 2024-04-25T22:40:34.459 INFO:teuthology.orchestra.run.smithi057.stdout: "journal_force_aio": "false", 2024-04-25T22:40:34.460 INFO:teuthology.orchestra.run.smithi057.stdout: "journal_ignore_corruption": "false", 2024-04-25T22:40:34.460 INFO:teuthology.orchestra.run.smithi057.stdout: "journal_max_write_bytes": "10485760", 2024-04-25T22:40:34.460 INFO:teuthology.orchestra.run.smithi057.stdout: "journal_max_write_entries": "100", 2024-04-25T22:40:34.460 INFO:teuthology.orchestra.run.smithi057.stdout: "journal_replay_from": "0", 2024-04-25T22:40:34.460 INFO:teuthology.orchestra.run.smithi057.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-25T22:40:34.460 INFO:teuthology.orchestra.run.smithi057.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-25T22:40:34.460 INFO:teuthology.orchestra.run.smithi057.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-25T22:40:34.460 INFO:teuthology.orchestra.run.smithi057.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-25T22:40:34.460 INFO:teuthology.orchestra.run.smithi057.stdout: "journal_write_header_frequency": "0", 2024-04-25T22:40:34.460 INFO:teuthology.orchestra.run.smithi057.stdout: "journal_zero_on_create": "false", 2024-04-25T22:40:34.460 INFO:teuthology.orchestra.run.smithi057.stdout: "journaler_prefetch_periods": "10", 2024-04-25T22:40:34.460 INFO:teuthology.orchestra.run.smithi057.stdout: "journaler_prezero_periods": "5", 2024-04-25T22:40:34.460 INFO:teuthology.orchestra.run.smithi057.stdout: "journaler_write_head_interval": "15", 2024-04-25T22:40:34.460 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "", 2024-04-25T22:40:34.461 INFO:teuthology.orchestra.run.smithi057.stdout: "keyfile": "", 2024-04-25T22:40:34.461 INFO:teuthology.orchestra.run.smithi057.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-25T22:40:34.461 INFO:teuthology.orchestra.run.smithi057.stdout: "kstore_backend": "rocksdb", 2024-04-25T22:40:34.461 INFO:teuthology.orchestra.run.smithi057.stdout: "kstore_default_stripe_size": "65536", 2024-04-25T22:40:34.461 INFO:teuthology.orchestra.run.smithi057.stdout: "kstore_fsck_on_mount": "false", 2024-04-25T22:40:34.461 INFO:teuthology.orchestra.run.smithi057.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-25T22:40:34.461 INFO:teuthology.orchestra.run.smithi057.stdout: "kstore_max_bytes": "67108864", 2024-04-25T22:40:34.461 INFO:teuthology.orchestra.run.smithi057.stdout: "kstore_max_ops": "512", 2024-04-25T22:40:34.461 INFO:teuthology.orchestra.run.smithi057.stdout: "kstore_nid_prealloc": "1024", 2024-04-25T22:40:34.461 INFO:teuthology.orchestra.run.smithi057.stdout: "kstore_onode_map_size": "1024", 2024-04-25T22:40:34.461 INFO:teuthology.orchestra.run.smithi057.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-25T22:40:34.461 INFO:teuthology.orchestra.run.smithi057.stdout: "kstore_sync_submit_transaction": "false", 2024-04-25T22:40:34.461 INFO:teuthology.orchestra.run.smithi057.stdout: "kstore_sync_transaction": "false", 2024-04-25T22:40:34.461 INFO:teuthology.orchestra.run.smithi057.stdout: "librados_thread_count": "2", 2024-04-25T22:40:34.462 INFO:teuthology.orchestra.run.smithi057.stdout: "lockdep": "false", 2024-04-25T22:40:34.462 INFO:teuthology.orchestra.run.smithi057.stdout: "lockdep_force_backtrace": "false", 2024-04-25T22:40:34.462 INFO:teuthology.orchestra.run.smithi057.stdout: "log_coarse_timestamps": "true", 2024-04-25T22:40:34.462 INFO:teuthology.orchestra.run.smithi057.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-25T22:40:34.462 INFO:teuthology.orchestra.run.smithi057.stdout: "log_flush_on_exit": "false", 2024-04-25T22:40:34.462 INFO:teuthology.orchestra.run.smithi057.stdout: "log_graylog_host": "127.0.0.1", 2024-04-25T22:40:34.462 INFO:teuthology.orchestra.run.smithi057.stdout: "log_graylog_port": "12201", 2024-04-25T22:40:34.462 INFO:teuthology.orchestra.run.smithi057.stdout: "log_max_new": "1000", 2024-04-25T22:40:34.462 INFO:teuthology.orchestra.run.smithi057.stdout: "log_max_recent": "10000", 2024-04-25T22:40:34.462 INFO:teuthology.orchestra.run.smithi057.stdout: "log_stderr_prefix": "", 2024-04-25T22:40:34.462 INFO:teuthology.orchestra.run.smithi057.stdout: "log_stop_at_utilization": "0.970000", 2024-04-25T22:40:34.462 INFO:teuthology.orchestra.run.smithi057.stdout: "log_to_file": "true", 2024-04-25T22:40:34.462 INFO:teuthology.orchestra.run.smithi057.stdout: "log_to_graylog": "false", 2024-04-25T22:40:34.462 INFO:teuthology.orchestra.run.smithi057.stdout: "log_to_journald": "false", 2024-04-25T22:40:34.463 INFO:teuthology.orchestra.run.smithi057.stdout: "log_to_stderr": "false", 2024-04-25T22:40:34.463 INFO:teuthology.orchestra.run.smithi057.stdout: "log_to_syslog": "false", 2024-04-25T22:40:34.463 INFO:teuthology.orchestra.run.smithi057.stdout: "max_rotating_auth_attempts": "10", 2024-04-25T22:40:34.463 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-25T22:40:34.463 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_action_on_write_error": "1", 2024-04-25T22:40:34.463 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_alternate_name_max": "8192", 2024-04-25T22:40:34.463 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_asio_thread_count": "2", 2024-04-25T22:40:34.463 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_export_pin": "true", 2024-04-25T22:40:34.463 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_fragment_dirs": "true", 2024-04-25T22:40:34.463 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-25T22:40:34.463 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_fragment_interval": "5", 2024-04-25T22:40:34.463 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-25T22:40:34.463 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-25T22:40:34.463 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_interval": "10", 2024-04-25T22:40:34.464 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_max": "-1", 2024-04-25T22:40:34.464 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_max_until": "-1", 2024-04-25T22:40:34.464 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_merge_size": "50", 2024-04-25T22:40:34.464 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_midchunk": "0.300000", 2024-04-25T22:40:34.464 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-25T22:40:34.464 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_min_start": "0.200000", 2024-04-25T22:40:34.464 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_minchunk": "0.001000", 2024-04-25T22:40:34.464 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_mode": "0", 2024-04-25T22:40:34.464 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_need_max": "1.200000", 2024-04-25T22:40:34.464 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_need_min": "0.800000", 2024-04-25T22:40:34.464 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_overload_epochs": "2", 2024-04-25T22:40:34.464 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-25T22:40:34.464 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-25T22:40:34.464 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_split_bits": "3", 2024-04-25T22:40:34.464 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-25T22:40:34.465 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_split_size": "10000", 2024-04-25T22:40:34.465 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-25T22:40:34.465 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_target_decay": "10.000000", 2024-04-25T22:40:34.465 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-25T22:40:34.465 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_beacon_grace": "15.000000", 2024-04-25T22:40:34.465 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_beacon_interval": "4.000000", 2024-04-25T22:40:34.465 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-25T22:40:34.465 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-25T22:40:34.465 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cache_mid": "0.700000", 2024-04-25T22:40:34.465 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-04-25T22:40:34.465 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cache_quiesce_delay": "0", 2024-04-25T22:40:34.465 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cache_quiesce_sleep": "200", 2024-04-25T22:40:34.465 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cache_quiesce_splitauth": "true", 2024-04-25T22:40:34.466 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cache_quiesce_threshold": "524288", 2024-04-25T22:40:34.466 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cache_release_free_interval": "10", 2024-04-25T22:40:34.466 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cache_reservation": "0.050000", 2024-04-25T22:40:34.466 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-25T22:40:34.466 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cache_trim_interval": "1", 2024-04-25T22:40:34.466 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cache_trim_threshold": "262144", 2024-04-25T22:40:34.466 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-25T22:40:34.466 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-25T22:40:34.466 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-25T22:40:34.466 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_client_prealloc_inos": "1000", 2024-04-25T22:40:34.466 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-25T22:40:34.466 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_connect_bootstrapping": "false", 2024-04-25T22:40:34.466 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_damage_table_max_entries": "10000", 2024-04-25T22:40:34.466 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-25T22:40:34.467 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_debug_auth_pins": "false", 2024-04-25T22:40:34.467 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_debug_frag": "false", 2024-04-25T22:40:34.467 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_debug_scatterstat": "false", 2024-04-25T22:40:34.467 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_debug_subtrees": "false", 2024-04-25T22:40:34.467 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_decay_halflife": "5.000000", 2024-04-25T22:40:34.467 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_default_dir_hash": "2", 2024-04-25T22:40:34.467 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_defer_session_stale": "true", 2024-04-25T22:40:34.467 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_deny_all_reconnect": "false", 2024-04-25T22:40:34.467 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_dir_keys_per_op": "16384", 2024-04-25T22:40:34.467 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_dir_max_commit_size": "10", 2024-04-25T22:40:34.467 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_dir_max_entries": "0", 2024-04-25T22:40:34.467 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_dir_prefetch": "true", 2024-04-25T22:40:34.467 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-25T22:40:34.467 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-25T22:40:34.467 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_dump_cache_on_map": "false", 2024-04-25T22:40:34.468 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-25T22:40:34.468 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-25T22:40:34.468 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_early_reply": "true", 2024-04-25T22:40:34.468 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_enable_op_tracker": "true", 2024-04-25T22:40:34.468 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_enforce_unique_name": "true", 2024-04-25T22:40:34.468 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-25T22:40:34.468 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-25T22:40:34.468 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_export_ephemeral_random": "true", 2024-04-25T22:40:34.468 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-25T22:40:34.468 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-25T22:40:34.468 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-25T22:40:34.468 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-25T22:40:34.468 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-25T22:40:34.468 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-25T22:40:34.469 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-25T22:40:34.469 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-25T22:40:34.469 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_health_summarize_threshold": "10", 2024-04-25T22:40:34.469 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-25T22:40:34.469 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-25T22:40:34.469 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_inject_health_dummy": "false", 2024-04-25T22:40:34.469 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-25T22:40:34.469 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_inject_migrator_session_race": "false", 2024-04-25T22:40:34.469 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-25T22:40:34.469 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-25T22:40:34.469 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-25T22:40:34.469 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_join_fs": "", 2024-04-25T22:40:34.469 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_journal_format": "1", 2024-04-25T22:40:34.469 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_kill_create_at": "0", 2024-04-25T22:40:34.469 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_kill_export_at": "0", 2024-04-25T22:40:34.470 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_kill_import_at": "0", 2024-04-25T22:40:34.470 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_kill_journal_at": "0", 2024-04-25T22:40:34.470 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_kill_journal_expire_at": "0", 2024-04-25T22:40:34.470 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_kill_journal_replay_at": "0", 2024-04-25T22:40:34.470 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_kill_link_at": "0", 2024-04-25T22:40:34.470 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_kill_mdstable_at": "0", 2024-04-25T22:40:34.470 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_kill_openc_at": "0", 2024-04-25T22:40:34.470 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_kill_rename_at": "0", 2024-04-25T22:40:34.470 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_kill_shutdown_at": "0", 2024-04-25T22:40:34.470 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-25T22:40:34.470 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log_event_large_threshold": "524288", 2024-04-25T22:40:34.470 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log_events_per_segment": "1024", 2024-04-25T22:40:34.470 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log_major_segment_event_ratio": "12", 2024-04-25T22:40:34.470 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log_max_events": "-1", 2024-04-25T22:40:34.471 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log_max_segments": "128", 2024-04-25T22:40:34.471 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log_pause": "false", 2024-04-25T22:40:34.471 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log_segment_size": "0", 2024-04-25T22:40:34.471 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-25T22:40:34.471 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log_skip_unbounded_events": "false", 2024-04-25T22:40:34.471 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-04-25T22:40:34.471 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log_trim_threshold": "128", 2024-04-25T22:40:34.471 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-04-25T22:40:34.471 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log_warn_factor": "2.000000", 2024-04-25T22:40:34.471 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_max_caps_per_client": "1048576", 2024-04-25T22:40:34.471 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_max_completed_flushes": "100000", 2024-04-25T22:40:34.471 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_max_completed_requests": "100000", 2024-04-25T22:40:34.471 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_max_export_size": "20971520", 2024-04-25T22:40:34.471 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_max_file_recover": "32", 2024-04-25T22:40:34.471 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_max_purge_files": "64", 2024-04-25T22:40:34.472 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_max_purge_ops": "8192", 2024-04-25T22:40:34.472 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-25T22:40:34.472 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-25T22:40:34.472 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_max_snaps_per_dir": "100", 2024-04-25T22:40:34.472 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_metrics_update_interval": "2", 2024-04-25T22:40:34.472 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_min_caps_per_client": "100", 2024-04-25T22:40:34.472 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_min_caps_working_set": "10000", 2024-04-25T22:40:34.472 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-25T22:40:34.472 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_numa_node": "-1", 2024-04-25T22:40:34.472 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-25T22:40:34.472 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_op_complaint_time": "30.000000", 2024-04-25T22:40:34.472 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_op_history_duration": "600", 2024-04-25T22:40:34.472 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_op_history_size": "20", 2024-04-25T22:40:34.472 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_op_history_slow_op_size": "20", 2024-04-25T22:40:34.473 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-25T22:40:34.473 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_op_log_threshold": "5", 2024-04-25T22:40:34.473 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_ping_grace": "15", 2024-04-25T22:40:34.473 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_ping_interval": "5", 2024-04-25T22:40:34.473 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-25T22:40:34.473 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-25T22:40:34.473 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_recall_max_caps": "30000", 2024-04-25T22:40:34.473 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-25T22:40:34.473 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-25T22:40:34.473 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-25T22:40:34.473 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_recall_warning_threshold": "262144", 2024-04-25T22:40:34.473 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-25T22:40:34.473 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_replay_interval": "1.000000", 2024-04-25T22:40:34.473 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-25T22:40:34.474 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-25T22:40:34.474 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_root_ino_gid": "0", 2024-04-25T22:40:34.474 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_root_ino_uid": "0", 2024-04-25T22:40:34.474 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-25T22:40:34.474 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-25T22:40:34.474 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-25T22:40:34.474 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-25T22:40:34.474 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-25T22:40:34.474 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-25T22:40:34.474 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-25T22:40:34.474 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-25T22:40:34.474 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-25T22:40:34.474 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-25T22:40:34.474 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_shutdown_check": "0", 2024-04-25T22:40:34.474 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_skip_ino": "0", 2024-04-25T22:40:34.475 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-25T22:40:34.475 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_snap_max_uid": "4294967294", 2024-04-25T22:40:34.475 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_snap_min_uid": "0", 2024-04-25T22:40:34.475 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_snap_rstat": "false", 2024-04-25T22:40:34.475 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_standby_replay_damaged": "false", 2024-04-25T22:40:34.475 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_symlink_recovery": "true", 2024-04-25T22:40:34.475 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-25T22:40:34.475 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_thrash_exports": "0", 2024-04-25T22:40:34.475 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_thrash_fragments": "0", 2024-04-25T22:40:34.475 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_tick_interval": "5.000000", 2024-04-25T22:40:34.475 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_valgrind_exit": "false", 2024-04-25T22:40:34.475 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_verify_backtrace": "1", 2024-04-25T22:40:34.475 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_verify_scatter": "false", 2024-04-25T22:40:34.475 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-25T22:40:34.475 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_wipe_sessions": "false", 2024-04-25T22:40:34.476 INFO:teuthology.orchestra.run.smithi057.stdout: "mempool_debug": "false", 2024-04-25T22:40:34.476 INFO:teuthology.orchestra.run.smithi057.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-25T22:40:34.476 INFO:teuthology.orchestra.run.smithi057.stdout: "memstore_device_bytes": "1073741824", 2024-04-25T22:40:34.476 INFO:teuthology.orchestra.run.smithi057.stdout: "memstore_page_set": "false", 2024-04-25T22:40:34.476 INFO:teuthology.orchestra.run.smithi057.stdout: "memstore_page_size": "65536", 2024-04-25T22:40:34.476 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_client_bytes": "134217728", 2024-04-25T22:40:34.476 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_client_messages": "512", 2024-04-25T22:40:34.476 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-25T22:40:34.476 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-25T22:40:34.476 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-25T22:40:34.476 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-25T22:40:34.476 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_disabled_modules": "", 2024-04-25T22:40:34.476 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-25T22:40:34.476 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_max_pg_num_change": "128", 2024-04-25T22:40:34.476 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_mds_bytes": "134217728", 2024-04-25T22:40:34.477 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_mds_messages": "128", 2024-04-25T22:40:34.477 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-25T22:40:34.477 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_mon_bytes": "134217728", 2024-04-25T22:40:34.477 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_mon_messages": "128", 2024-04-25T22:40:34.477 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_osd_bytes": "536870912", 2024-04-25T22:40:34.477 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_osd_messages": "8192", 2024-04-25T22:40:34.477 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_pool": "true", 2024-04-25T22:40:34.477 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-25T22:40:34.477 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_standby_modules": "true", 2024-04-25T22:40:34.477 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_stats_period": "5", 2024-04-25T22:40:34.477 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_stats_threshold": "5", 2024-04-25T22:40:34.477 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_tick_period": "2", 2024-04-25T22:40:34.477 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-25T22:40:34.477 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-25T22:40:34.478 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_allow_pool_delete": "true", 2024-04-25T22:40:34.478 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_allow_pool_size_one": "true", 2024-04-25T22:40:34.478 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_auth_validate_all_caps": "true", 2024-04-25T22:40:34.478 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-25T22:40:34.478 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-25T22:40:34.478 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_client_bytes": "104857600", 2024-04-25T22:40:34.478 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_client_directed_command_retry": "2", 2024-04-25T22:40:34.478 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-25T22:40:34.478 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-25T22:40:34.478 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-25T22:40:34.478 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-25T22:40:34.478 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_client_hunt_parallel": "3", 2024-04-25T22:40:34.478 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_client_log_interval": "1.000000", 2024-04-25T22:40:34.478 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-25T22:40:34.479 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_client_ping_interval": "10.000000", 2024-04-25T22:40:34.479 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-25T22:40:34.479 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_client_target_rank": "-1", 2024-04-25T22:40:34.479 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-25T22:40:34.479 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-25T22:40:34.479 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-25T22:40:34.479 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_cluster_log_file_level": "debug", 2024-04-25T22:40:34.479 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_cluster_log_to_file": "true", 2024-04-25T22:40:34.479 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-25T22:40:34.479 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-25T22:40:34.479 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-25T22:40:34.479 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_cluster_log_to_journald": "false", 2024-04-25T22:40:34.479 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-25T22:40:34.480 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-25T22:40:34.480 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-25T22:40:34.480 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-25T22:40:34.480 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_compact_on_bootstrap": "false", 2024-04-25T22:40:34.480 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_compact_on_start": "false", 2024-04-25T22:40:34.480 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_compact_on_trim": "true", 2024-04-25T22:40:34.480 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-25T22:40:34.480 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-25T22:40:34.480 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-25T22:40:34.480 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_cpu_threads": "4", 2024-04-25T22:40:34.480 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_crush_min_required_version": "hammer", 2024-04-25T22:40:34.480 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_daemon_bytes": "419430400", 2024-04-25T22:40:34.480 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-25T22:40:34.480 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_data_avail_crit": "5", 2024-04-25T22:40:34.480 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_data_avail_warn": "5", 2024-04-25T22:40:34.481 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_data_size_warn": "16106127360", 2024-04-25T22:40:34.481 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-25T22:40:34.481 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-25T22:40:34.481 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_debug_dump_json": "false", 2024-04-25T22:40:34.481 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-25T22:40:34.481 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_debug_dump_transactions": "false", 2024-04-25T22:40:34.481 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_debug_extra_checks": "false", 2024-04-25T22:40:34.481 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-25T22:40:34.481 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-25T22:40:34.481 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_debug_no_require_reef": "false", 2024-04-25T22:40:34.481 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_debug_no_require_squid": "false", 2024-04-25T22:40:34.481 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-25T22:40:34.481 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-25T22:40:34.481 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-25T22:40:34.481 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_down_mkfs_grace": "120", 2024-04-25T22:40:34.482 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_down_uptime_grace": "60", 2024-04-25T22:40:34.482 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_election_default_strategy": "1", 2024-04-25T22:40:34.482 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_election_timeout": "5.000000", 2024-04-25T22:40:34.482 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-25T22:40:34.482 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_elector_ping_divisor": "2", 2024-04-25T22:40:34.482 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-25T22:40:34.482 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_enable_op_tracker": "true", 2024-04-25T22:40:34.482 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_fake_pool_delete": "false", 2024-04-25T22:40:34.482 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_force_quorum_join": "false", 2024-04-25T22:40:34.482 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_globalid_prealloc": "10000", 2024-04-25T22:40:34.482 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_health_detail_to_clog": "false", 2024-04-25T22:40:34.482 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_health_log_update_period": "5", 2024-04-25T22:40:34.482 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_health_max_detail": "50", 2024-04-25T22:40:34.482 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_health_to_clog": "true", 2024-04-25T22:40:34.483 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_health_to_clog_interval": "600", 2024-04-25T22:40:34.483 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-25T22:40:34.483 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_host": "172.21.15.57,[v2:172.21.15.57:3301,v1:172.21.15.57:6790],[v2:172.21.15.57:3302,v1:172.21.15.57:6791]", 2024-04-25T22:40:34.483 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_host_override": "", 2024-04-25T22:40:34.483 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_initial_members": "", 2024-04-25T22:40:34.483 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-25T22:40:34.483 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-25T22:40:34.483 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-25T22:40:34.483 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-25T22:40:34.483 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-25T22:40:34.483 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_lease": "5.000000", 2024-04-25T22:40:34.483 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-25T22:40:34.483 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-25T22:40:34.483 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_log_full_interval": "50", 2024-04-25T22:40:34.484 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_log_max": "10000", 2024-04-25T22:40:34.484 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_log_max_summary": "50", 2024-04-25T22:40:34.484 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-25T22:40:34.484 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_max_log_epochs": "500", 2024-04-25T22:40:34.484 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-25T22:40:34.484 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-25T22:40:34.484 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_max_osd": "10000", 2024-04-25T22:40:34.484 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_max_pg_per_osd": "10000", 2024-04-25T22:40:34.484 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_max_pool_pg_num": "65536", 2024-04-25T22:40:34.484 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-25T22:40:34.484 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-25T22:40:34.484 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_mds_force_trim_to": "0", 2024-04-25T22:40:34.484 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_mds_skip_sanity": "false", 2024-04-25T22:40:34.484 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_memory_autotune": "true", 2024-04-25T22:40:34.485 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_memory_target": "2147483648", 2024-04-25T22:40:34.485 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_mgr_beacon_grace": "30", 2024-04-25T22:40:34.485 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-25T22:40:34.485 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_mgr_digest_period": "5", 2024-04-25T22:40:34.485 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_mgr_inactive_grace": "60", 2024-04-25T22:40:34.485 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-25T22:40:34.485 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-25T22:40:34.485 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_min_osdmap_epochs": "500", 2024-04-25T22:40:34.485 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_op_complaint_time": "30", 2024-04-25T22:40:34.485 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_op_history_duration": "600", 2024-04-25T22:40:34.485 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_op_history_size": "20", 2024-04-25T22:40:34.485 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_op_history_slow_op_size": "20", 2024-04-25T22:40:34.485 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-25T22:40:34.485 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_op_log_threshold": "5", 2024-04-25T22:40:34.486 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-25T22:40:34.486 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-25T22:40:34.486 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-25T22:40:34.486 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_auto_mark_in": "false", 2024-04-25T22:40:34.486 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-25T22:40:34.486 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-25T22:40:34.486 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-25T22:40:34.486 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_cache_size": "500", 2024-04-25T22:40:34.486 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-25T22:40:34.486 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-25T22:40:34.486 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-25T22:40:34.486 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_down_out_interval": "600", 2024-04-25T22:40:34.486 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-25T22:40:34.486 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-25T22:40:34.487 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_force_trim_to": "0", 2024-04-25T22:40:34.487 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-25T22:40:34.487 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-25T22:40:34.487 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-25T22:40:34.487 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-25T22:40:34.487 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-25T22:40:34.487 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-25T22:40:34.487 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-25T22:40:34.487 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-25T22:40:34.487 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_min_down_reporters": "2", 2024-04-25T22:40:34.487 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-25T22:40:34.487 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-25T22:40:34.487 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-25T22:40:34.487 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-25T22:40:34.488 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-25T22:40:34.488 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-25T22:40:34.488 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_report_timeout": "900", 2024-04-25T22:40:34.488 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-25T22:40:34.488 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-25T22:40:34.488 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-25T22:40:34.488 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-25T22:40:34.488 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-25T22:40:34.488 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-25T22:40:34.488 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-25T22:40:34.488 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-25T22:40:34.488 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-25T22:40:34.488 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_pg_stuck_threshold": "60", 2024-04-25T22:40:34.488 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-25T22:40:34.488 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-25T22:40:34.489 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-25T22:40:34.489 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-25T22:40:34.489 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-25T22:40:34.489 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-25T22:40:34.489 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_probe_timeout": "2.000000", 2024-04-25T22:40:34.489 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_reweight_max_change": "0.050000", 2024-04-25T22:40:34.489 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_reweight_max_osds": "4", 2024-04-25T22:40:34.489 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-25T22:40:34.489 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-25T22:40:34.489 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-25T22:40:34.489 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-25T22:40:34.489 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-25T22:40:34.489 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_scrub_interval": "86400", 2024-04-25T22:40:34.489 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_scrub_max_keys": "100", 2024-04-25T22:40:34.490 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_scrub_timeout": "300", 2024-04-25T22:40:34.490 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_session_timeout": "300", 2024-04-25T22:40:34.490 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_smart_report_timeout": "5", 2024-04-25T22:40:34.490 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_stat_smooth_intervals": "6", 2024-04-25T22:40:34.490 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-25T22:40:34.490 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_stretch_pool_min_size": "2", 2024-04-25T22:40:34.490 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_stretch_pool_size": "4", 2024-04-25T22:40:34.490 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-25T22:40:34.490 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-25T22:40:34.490 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_sync_debug": "false", 2024-04-25T22:40:34.490 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-25T22:40:34.490 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-25T22:40:34.490 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_sync_provider_kill_at": "0", 2024-04-25T22:40:34.490 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_sync_requester_kill_at": "0", 2024-04-25T22:40:34.491 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_sync_timeout": "60.000000", 2024-04-25T22:40:34.491 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_target_pg_per_osd": "100", 2024-04-25T22:40:34.491 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_tick_interval": "5", 2024-04-25T22:40:34.491 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_timecheck_interval": "300.000000", 2024-04-25T22:40:34.491 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-25T22:40:34.491 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_use_min_delay_socket": "false", 2024-04-25T22:40:34.491 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_warn_older_version_delay": "604800", 2024-04-25T22:40:34.491 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-25T22:40:34.491 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-25T22:40:34.491 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-25T22:40:34.491 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-25T22:40:34.491 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-25T22:40:34.491 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-25T22:40:34.492 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-25T22:40:34.492 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_warn_on_misplaced": "false", 2024-04-25T22:40:34.492 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-25T22:40:34.492 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_warn_on_older_version": "true", 2024-04-25T22:40:34.492 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-25T22:40:34.492 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-25T22:40:34.492 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-25T22:40:34.492 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-25T22:40:34.492 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-25T22:40:34.492 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-25T22:40:34.492 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-25T22:40:34.492 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-25T22:40:34.492 INFO:teuthology.orchestra.run.smithi057.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-25T22:40:34.492 INFO:teuthology.orchestra.run.smithi057.stdout: "monmap": "", 2024-04-25T22:40:34.493 INFO:teuthology.orchestra.run.smithi057.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-25T22:40:34.493 INFO:teuthology.orchestra.run.smithi057.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-25T22:40:34.493 INFO:teuthology.orchestra.run.smithi057.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-25T22:40:34.493 INFO:teuthology.orchestra.run.smithi057.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-25T22:40:34.493 INFO:teuthology.orchestra.run.smithi057.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-25T22:40:34.493 INFO:teuthology.orchestra.run.smithi057.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-25T22:40:34.493 INFO:teuthology.orchestra.run.smithi057.stdout: "motr_tracing_enabled": "false", 2024-04-25T22:40:34.493 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_async_op_threads": "3", 2024-04-25T22:40:34.493 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-25T22:40:34.493 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_async_rdma_cm": "false", 2024-04-25T22:40:34.493 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_async_rdma_device_name": "", 2024-04-25T22:40:34.493 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_async_rdma_dscp": "96", 2024-04-25T22:40:34.493 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-25T22:40:34.493 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-25T22:40:34.494 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_async_rdma_local_gid": "", 2024-04-25T22:40:34.494 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-25T22:40:34.494 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_async_rdma_port_num": "1", 2024-04-25T22:40:34.494 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-25T22:40:34.494 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-25T22:40:34.494 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-25T22:40:34.494 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-25T22:40:34.494 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_async_rdma_sl": "3", 2024-04-25T22:40:34.494 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_async_rdma_support_srq": "true", 2024-04-25T22:40:34.494 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_async_rdma_type": "ib", 2024-04-25T22:40:34.494 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_async_reap_threshold": "5", 2024-04-25T22:40:34.494 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_bind_before_connect": "false", 2024-04-25T22:40:34.494 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_bind_ipv4": "true", 2024-04-25T22:40:34.494 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_bind_ipv6": "false", 2024-04-25T22:40:34.495 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_bind_msgr1": "true", 2024-04-25T22:40:34.495 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_bind_msgr2": "true", 2024-04-25T22:40:34.495 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_bind_port_max": "7568", 2024-04-25T22:40:34.495 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_bind_port_min": "6800", 2024-04-25T22:40:34.495 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-25T22:40:34.495 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_bind_retry_count": "3", 2024-04-25T22:40:34.495 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_bind_retry_delay": "5", 2024-04-25T22:40:34.495 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_blackhole_client": "false", 2024-04-25T22:40:34.495 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_blackhole_mds": "false", 2024-04-25T22:40:34.495 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_blackhole_mgr": "false", 2024-04-25T22:40:34.495 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_blackhole_mon": "false", 2024-04-25T22:40:34.495 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_blackhole_osd": "false", 2024-04-25T22:40:34.495 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_client_mode": "crc secure", 2024-04-25T22:40:34.495 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_cluster_mode": "crc secure", 2024-04-25T22:40:34.495 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_cluster_type": "", 2024-04-25T22:40:34.496 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_compress_secure": "false", 2024-04-25T22:40:34.496 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_connection_idle_timeout": "900", 2024-04-25T22:40:34.496 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_connection_ready_timeout": "10", 2024-04-25T22:40:34.496 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_crc_data": "true", 2024-04-25T22:40:34.496 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_crc_header": "true", 2024-04-25T22:40:34.496 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_die_on_bad_msg": "false", 2024-04-25T22:40:34.496 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_die_on_bug": "true", 2024-04-25T22:40:34.496 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_die_on_old_message": "true", 2024-04-25T22:40:34.496 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_die_on_skipped_message": "false", 2024-04-25T22:40:34.496 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-25T22:40:34.496 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-25T22:40:34.496 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_dpdk_coremask": "0xF", 2024-04-25T22:40:34.496 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-25T22:40:34.496 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-25T22:40:34.497 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_dpdk_enable_tso": "true", 2024-04-25T22:40:34.497 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-25T22:40:34.497 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-25T22:40:34.497 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_dpdk_hugepages": "", 2024-04-25T22:40:34.497 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-25T22:40:34.497 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-25T22:40:34.497 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_dpdk_lro": "true", 2024-04-25T22:40:34.497 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_dpdk_memory_channel": "4", 2024-04-25T22:40:34.497 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-25T22:40:34.497 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_dpdk_pmd": "", 2024-04-25T22:40:34.497 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_dpdk_port_id": "0", 2024-04-25T22:40:34.497 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-25T22:40:34.497 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-25T22:40:34.497 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_dump_on_send": "false", 2024-04-25T22:40:34.498 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_initial_backoff": "0.200000", 2024-04-25T22:40:34.498 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_inject_delay_max": "1.000000", 2024-04-25T22:40:34.498 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-25T22:40:34.498 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_inject_delay_type": "", 2024-04-25T22:40:34.498 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-25T22:40:34.498 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_inject_network_congestion": "0", 2024-04-25T22:40:34.498 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_inject_socket_failures": "0", 2024-04-25T22:40:34.498 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_learn_addr_from_peer": "true", 2024-04-25T22:40:34.498 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_max_accept_failures": "4", 2024-04-25T22:40:34.498 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_max_backoff": "15.000000", 2024-04-25T22:40:34.498 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_mon_client_mode": "secure crc", 2024-04-25T22:40:34.498 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-25T22:40:34.498 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_mon_service_mode": "secure crc", 2024-04-25T22:40:34.499 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_osd_compress_min_size": "1024", 2024-04-25T22:40:34.499 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_osd_compress_mode": "none", 2024-04-25T22:40:34.499 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-25T22:40:34.499 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-25T22:40:34.499 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_pq_min_cost": "65536", 2024-04-25T22:40:34.499 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_public_type": "", 2024-04-25T22:40:34.499 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_service_mode": "crc secure", 2024-04-25T22:40:34.499 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_tcp_listen_backlog": "512", 2024-04-25T22:40:34.499 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_tcp_nodelay": "true", 2024-04-25T22:40:34.499 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-25T22:40:34.499 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_tcp_rcvbuf": "0", 2024-04-25T22:40:34.499 INFO:teuthology.orchestra.run.smithi057.stdout: "ms_type": "async+posix", 2024-04-25T22:40:34.499 INFO:teuthology.orchestra.run.smithi057.stdout: "no_config_file": "false", 2024-04-25T22:40:34.499 INFO:teuthology.orchestra.run.smithi057.stdout: "objecter_completion_locks_per_session": "32", 2024-04-25T22:40:34.499 INFO:teuthology.orchestra.run.smithi057.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-25T22:40:34.500 INFO:teuthology.orchestra.run.smithi057.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-25T22:40:34.500 INFO:teuthology.orchestra.run.smithi057.stdout: "objecter_inflight_ops": "1024", 2024-04-25T22:40:34.500 INFO:teuthology.orchestra.run.smithi057.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-25T22:40:34.500 INFO:teuthology.orchestra.run.smithi057.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-25T22:40:34.500 INFO:teuthology.orchestra.run.smithi057.stdout: "objecter_tick_interval": "5.000000", 2024-04-25T22:40:34.500 INFO:teuthology.orchestra.run.smithi057.stdout: "objecter_timeout": "10.000000", 2024-04-25T22:40:34.500 INFO:teuthology.orchestra.run.smithi057.stdout: "objectstore_blackhole": "false", 2024-04-25T22:40:34.500 INFO:teuthology.orchestra.run.smithi057.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-04-25T22:40:34.500 INFO:teuthology.orchestra.run.smithi057.stdout: "openssl_engine_opts": "", 2024-04-25T22:40:34.500 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_agent_delay_time": "5.000000", 2024-04-25T22:40:34.500 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_agent_hist_halflife": "1000", 2024-04-25T22:40:34.500 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_agent_max_low_ops": "2", 2024-04-25T22:40:34.500 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_agent_max_ops": "4", 2024-04-25T22:40:34.500 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-25T22:40:34.501 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-25T22:40:34.501 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_agent_slop": "0.020000", 2024-04-25T22:40:34.501 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-25T22:40:34.501 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-25T22:40:34.501 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_asio_thread_count": "2", 2024-04-25T22:40:34.501 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_async_recovery_min_cost": "100", 2024-04-25T22:40:34.501 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-25T22:40:34.501 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-25T22:40:34.501 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_backfill_scan_max": "512", 2024-04-25T22:40:34.501 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_backfill_scan_min": "64", 2024-04-25T22:40:34.501 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_backoff_on_degraded": "false", 2024-04-25T22:40:34.501 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_backoff_on_peering": "false", 2024-04-25T22:40:34.501 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_backoff_on_unfound": "true", 2024-04-25T22:40:34.501 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_beacon_report_interval": "300", 2024-04-25T22:40:34.502 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_bench_duration": "30", 2024-04-25T22:40:34.502 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-25T22:40:34.502 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_bench_max_block_size": "67108864", 2024-04-25T22:40:34.502 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-25T22:40:34.502 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_blkin_trace_all": "false", 2024-04-25T22:40:34.502 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-25T22:40:34.502 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-25T22:40:34.502 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-25T22:40:34.502 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-25T22:40:34.502 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_check_for_log_corruption": "false", 2024-04-25T22:40:34.502 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-25T22:40:34.502 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-25T22:40:34.502 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-04-25T22:40:34.502 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-25T22:40:34.503 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_class_update_on_start": "true", 2024-04-25T22:40:34.503 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_client_message_cap": "256", 2024-04-25T22:40:34.503 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_client_message_size_cap": "524288000", 2024-04-25T22:40:34.503 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_client_op_priority": "63", 2024-04-25T22:40:34.503 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_client_watch_timeout": "30", 2024-04-25T22:40:34.503 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_command_max_records": "256", 2024-04-25T22:40:34.503 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_compact_on_start": "false", 2024-04-25T22:40:34.503 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-25T22:40:34.503 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-25T22:40:34.503 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-25T22:40:34.503 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_crush_update_on_start": "true", 2024-04-25T22:40:34.503 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_crush_update_weight_set": "true", 2024-04-25T22:40:34.503 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-25T22:40:34.503 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-25T22:40:34.503 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-25T22:40:34.504 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-25T22:40:34.504 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-25T22:40:34.504 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_feed_pullee": "-1", 2024-04-25T22:40:34.504 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-25T22:40:34.504 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-25T22:40:34.504 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-25T22:40:34.504 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_misdirected_ops": "false", 2024-04-25T22:40:34.504 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_no_acting_change": "false", 2024-04-25T22:40:34.504 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_no_purge_strays": "false", 2024-04-25T22:40:34.504 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_op_order": "false", 2024-04-25T22:40:34.504 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-25T22:40:34.504 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-25T22:40:34.504 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-25T22:40:34.505 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-25T22:40:34.505 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_shutdown": "false", 2024-04-25T22:40:34.505 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-25T22:40:34.505 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-25T22:40:34.505 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_trim_objects": "false", 2024-04-25T22:40:34.505 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-25T22:40:34.505 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-25T22:40:34.505 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_verify_snaps": "false", 2024-04-25T22:40:34.505 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-25T22:40:34.505 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-25T22:40:34.505 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_deep_scrub_keys": "1024", 2024-04-25T22:40:34.505 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-25T22:40:34.505 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-25T22:40:34.505 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-25T22:40:34.505 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_deep_scrub_stride": "524288", 2024-04-25T22:40:34.506 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-25T22:40:34.506 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-25T22:40:34.506 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_default_notify_timeout": "30", 2024-04-25T22:40:34.506 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_delete_sleep": "0.000000", 2024-04-25T22:40:34.506 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-25T22:40:34.506 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-25T22:40:34.506 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-25T22:40:34.506 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_discard_disconnected_ops": "true", 2024-04-25T22:40:34.506 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_enable_op_tracker": "true", 2024-04-25T22:40:34.506 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-25T22:40:34.506 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-25T22:40:34.506 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-25T22:40:34.506 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-25T22:40:34.507 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_fast_info": "true", 2024-04-25T22:40:34.507 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_fast_shutdown": "true", 2024-04-25T22:40:34.507 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-25T22:40:34.507 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-25T22:40:34.507 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-25T22:40:34.507 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-25T22:40:34.507 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-25T22:40:34.507 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_function_tracing": "false", 2024-04-25T22:40:34.507 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_heartbeat_grace": "20", 2024-04-25T22:40:34.507 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_heartbeat_interval": "6", 2024-04-25T22:40:34.507 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-25T22:40:34.507 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_heartbeat_min_peers": "10", 2024-04-25T22:40:34.507 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_heartbeat_min_size": "2000", 2024-04-25T22:40:34.507 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_heartbeat_stale": "600", 2024-04-25T22:40:34.508 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-25T22:40:34.508 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_hit_set_max_size": "100000", 2024-04-25T22:40:34.508 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_hit_set_min_size": "1000", 2024-04-25T22:40:34.508 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-25T22:40:34.508 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-25T22:40:34.508 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-25T22:40:34.508 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-25T22:40:34.508 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-25T22:40:34.508 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-25T22:40:34.508 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_journal_size": "5120", 2024-04-25T22:40:34.508 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_kill_backfill_at": "0", 2024-04-25T22:40:34.508 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-25T22:40:34.508 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_map_cache_size": "50", 2024-04-25T22:40:34.508 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_map_dedup": "true", 2024-04-25T22:40:34.508 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_map_message_max": "40", 2024-04-25T22:40:34.508 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-25T22:40:34.509 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_map_share_max_epochs": "40", 2024-04-25T22:40:34.509 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_attr_name_len": "100", 2024-04-25T22:40:34.509 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_attr_size": "0", 2024-04-25T22:40:34.509 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_backfills": "1", 2024-04-25T22:40:34.509 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_markdown_count": "5", 2024-04-25T22:40:34.509 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_markdown_period": "600", 2024-04-25T22:40:34.509 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_object_name_len": "2048", 2024-04-25T22:40:34.509 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_object_namespace_len": "256", 2024-04-25T22:40:34.509 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_object_size": "134217728", 2024-04-25T22:40:34.509 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-25T22:40:34.509 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-25T22:40:34.509 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_pg_blocked_by": "16", 2024-04-25T22:40:34.509 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_pg_log_entries": "10000", 2024-04-25T22:40:34.509 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-25T22:40:34.509 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_pgls": "1024", 2024-04-25T22:40:34.510 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_push_cost": "8388608", 2024-04-25T22:40:34.510 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_push_objects": "10", 2024-04-25T22:40:34.510 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_scrubs": "3", 2024-04-25T22:40:34.510 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-25T22:40:34.510 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_trimming_pgs": "2", 2024-04-25T22:40:34.510 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_write_op_reply_len": "64", 2024-04-25T22:40:34.510 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_max_write_size": "90", 2024-04-25T22:40:34.510 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-25T22:40:34.510 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-25T22:40:34.510 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-25T22:40:34.510 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-25T22:40:34.510 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-25T22:40:34.510 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-25T22:40:34.511 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-25T22:40:34.511 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-25T22:40:34.511 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mclock_profile": "balanced", 2024-04-25T22:40:34.511 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-25T22:40:34.511 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-25T22:40:34.511 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-25T22:40:34.511 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-25T22:40:34.511 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-25T22:40:34.511 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-25T22:40:34.511 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-25T22:40:34.511 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-25T22:40:34.511 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-25T22:40:34.511 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-25T22:40:34.511 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-25T22:40:34.511 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_memory_base": "805306368", 2024-04-25T22:40:34.511 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_memory_cache_min": "134217728", 2024-04-25T22:40:34.512 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-25T22:40:34.512 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-25T22:40:34.512 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_memory_target": "4294967296", 2024-04-25T22:40:34.512 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_memory_target_autotune": "false", 2024-04-25T22:40:34.512 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-25T22:40:34.512 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_min_pg_log_entries": "250", 2024-04-25T22:40:34.512 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_min_recovery_priority": "0", 2024-04-25T22:40:34.512 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-25T22:40:34.512 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-25T22:40:34.512 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mon_report_interval": "5", 2024-04-25T22:40:34.512 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-25T22:40:34.512 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-25T22:40:34.512 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_num_cache_shards": "32", 2024-04-25T22:40:34.512 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_num_op_tracker_shard": "32", 2024-04-25T22:40:34.513 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_numa_auto_affinity": "true", 2024-04-25T22:40:34.513 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_numa_node": "-1", 2024-04-25T22:40:34.513 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_numa_prefer_iface": "true", 2024-04-25T22:40:34.513 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-25T22:40:34.513 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_objecter_finishers": "1", 2024-04-25T22:40:34.513 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_objectstore": "bluestore", 2024-04-25T22:40:34.513 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_objectstore_fuse": "false", 2024-04-25T22:40:34.513 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_objectstore_tracing": "false", 2024-04-25T22:40:34.513 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_op_complaint_time": "30.000000", 2024-04-25T22:40:34.513 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_op_history_duration": "600", 2024-04-25T22:40:34.513 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_op_history_size": "20", 2024-04-25T22:40:34.513 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_op_history_slow_op_size": "20", 2024-04-25T22:40:34.513 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-25T22:40:34.513 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_op_log_threshold": "5", 2024-04-25T22:40:34.513 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_op_num_shards": "0", 2024-04-25T22:40:34.514 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_op_num_shards_hdd": "5", 2024-04-25T22:40:34.514 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_op_num_shards_ssd": "8", 2024-04-25T22:40:34.514 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-25T22:40:34.514 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-25T22:40:34.514 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-25T22:40:34.514 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-25T22:40:34.514 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_op_pq_min_cost": "65536", 2024-04-25T22:40:34.514 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-25T22:40:34.514 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_op_queue_cut_off": "high", 2024-04-25T22:40:34.514 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-25T22:40:34.514 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_op_thread_timeout": "15", 2024-04-25T22:40:34.514 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_open_classes_on_start": "true", 2024-04-25T22:40:34.514 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_os_flags": "0", 2024-04-25T22:40:34.515 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_peering_op_priority": "255", 2024-04-25T22:40:34.515 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pg_delete_cost": "1048576", 2024-04-25T22:40:34.515 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pg_delete_priority": "5", 2024-04-25T22:40:34.515 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-25T22:40:34.515 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-25T22:40:34.515 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-25T22:40:34.515 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pg_log_trim_max": "10000", 2024-04-25T22:40:34.515 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pg_log_trim_min": "100", 2024-04-25T22:40:34.515 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-25T22:40:34.515 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-25T22:40:34.515 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-04-25T22:40:34.515 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-04-25T22:40:34.515 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-25T22:40:34.515 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-25T22:40:34.516 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-25T22:40:34.516 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-25T22:40:34.516 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-25T22:40:34.516 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-25T22:40:34.516 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_crimson": "false", 2024-04-25T22:40:34.516 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-25T22:40:34.516 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-25T22:40:34.516 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-25T22:40:34.516 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-25T22:40:34.516 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-25T22:40:34.516 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-25T22:40:34.516 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-25T22:40:34.516 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-25T22:40:34.516 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_flags": "0", 2024-04-25T22:40:34.517 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-25T22:40:34.517 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_min_size": "0", 2024-04-25T22:40:34.517 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-25T22:40:34.517 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_pg_num": "32", 2024-04-25T22:40:34.517 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_pgp_num": "0", 2024-04-25T22:40:34.517 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-25T22:40:34.517 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_read_ratio": "70", 2024-04-25T22:40:34.517 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_size": "2", 2024-04-25T22:40:34.517 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_default_type": "replicated", 2024-04-25T22:40:34.517 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-25T22:40:34.517 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-25T22:40:34.517 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_push_per_object_cost": "1000", 2024-04-25T22:40:34.517 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-25T22:40:34.517 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_recover_clone_overlap": "true", 2024-04-25T22:40:34.518 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-25T22:40:34.518 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_recovery_cost": "20971520", 2024-04-25T22:40:34.518 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-25T22:40:34.518 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_recovery_max_active": "0", 2024-04-25T22:40:34.518 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-25T22:40:34.518 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-25T22:40:34.518 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-25T22:40:34.518 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-25T22:40:34.518 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_recovery_max_single_start": "1", 2024-04-25T22:40:34.518 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_recovery_op_priority": "3", 2024-04-25T22:40:34.518 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-25T22:40:34.518 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_recovery_priority": "5", 2024-04-25T22:40:34.518 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-25T22:40:34.518 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_recovery_sleep": "0.000000", 2024-04-25T22:40:34.519 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-25T22:40:34.519 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-25T22:40:34.519 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-25T22:40:34.519 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_repair_during_recovery": "false", 2024-04-25T22:40:34.519 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_requested_scrub_priority": "120", 2024-04-25T22:40:34.519 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-25T22:40:34.519 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-25T22:40:34.519 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_auto_repair": "false", 2024-04-25T22:40:34.519 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-25T22:40:34.519 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-25T22:40:34.519 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_begin_hour": "0", 2024-04-25T22:40:34.519 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_begin_week_day": "0", 2024-04-25T22:40:34.519 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_chunk_max": "25", 2024-04-25T22:40:34.519 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_chunk_min": "5", 2024-04-25T22:40:34.520 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_cost": "52428800", 2024-04-25T22:40:34.520 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_disable_reservation_queuing": "true", 2024-04-25T22:40:34.520 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_during_recovery": "false", 2024-04-25T22:40:34.520 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_end_hour": "0", 2024-04-25T22:40:34.520 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_end_week_day": "0", 2024-04-25T22:40:34.520 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_event_cost": "4096", 2024-04-25T22:40:34.520 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-25T22:40:34.520 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-25T22:40:34.520 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_invalid_stats": "true", 2024-04-25T22:40:34.520 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-25T22:40:34.520 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-25T22:40:34.520 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_max_preemptions": "5", 2024-04-25T22:40:34.520 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-25T22:40:34.520 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_priority": "5", 2024-04-25T22:40:34.520 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_reservation_timeout": "300000", 2024-04-25T22:40:34.521 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_scrub_sleep": "0.000000", 2024-04-25T22:40:34.521 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-25T22:40:34.521 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-25T22:40:34.521 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-25T22:40:34.521 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_skip_data_digest": "false", 2024-04-25T22:40:34.521 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_smart_report_timeout": "5", 2024-04-25T22:40:34.521 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_snap_trim_cost": "1048576", 2024-04-25T22:40:34.521 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_snap_trim_priority": "5", 2024-04-25T22:40:34.521 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-25T22:40:34.521 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-25T22:40:34.521 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-25T22:40:34.521 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-25T22:40:34.521 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-25T22:40:34.521 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-25T22:40:34.522 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-25T22:40:34.522 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_target_transaction_size": "30", 2024-04-25T22:40:34.522 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-25T22:40:34.522 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-25T22:40:34.522 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-25T22:40:34.522 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-25T22:40:34.522 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-25T22:40:34.522 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-25T22:40:34.522 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-25T22:40:34.522 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-25T22:40:34.522 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-25T22:40:34.522 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-25T22:40:34.522 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_tracing": "false", 2024-04-25T22:40:34.522 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_use_stale_snap": "false", 2024-04-25T22:40:34.522 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-25T22:40:34.523 INFO:teuthology.orchestra.run.smithi057.stdout: "osdc_blkin_trace_all": "false", 2024-04-25T22:40:34.523 INFO:teuthology.orchestra.run.smithi057.stdout: "paxos_kill_at": "0", 2024-04-25T22:40:34.523 INFO:teuthology.orchestra.run.smithi057.stdout: "paxos_max_join_drift": "10", 2024-04-25T22:40:34.523 INFO:teuthology.orchestra.run.smithi057.stdout: "paxos_min": "500", 2024-04-25T22:40:34.523 INFO:teuthology.orchestra.run.smithi057.stdout: "paxos_min_wait": "0.050000", 2024-04-25T22:40:34.523 INFO:teuthology.orchestra.run.smithi057.stdout: "paxos_propose_interval": "1.000000", 2024-04-25T22:40:34.523 INFO:teuthology.orchestra.run.smithi057.stdout: "paxos_service_trim_max": "500", 2024-04-25T22:40:34.523 INFO:teuthology.orchestra.run.smithi057.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-25T22:40:34.523 INFO:teuthology.orchestra.run.smithi057.stdout: "paxos_service_trim_min": "250", 2024-04-25T22:40:34.523 INFO:teuthology.orchestra.run.smithi057.stdout: "paxos_stash_full_interval": "25", 2024-04-25T22:40:34.523 INFO:teuthology.orchestra.run.smithi057.stdout: "paxos_trim_max": "500", 2024-04-25T22:40:34.523 INFO:teuthology.orchestra.run.smithi057.stdout: "paxos_trim_min": "250", 2024-04-25T22:40:34.523 INFO:teuthology.orchestra.run.smithi057.stdout: "perf": "true", 2024-04-25T22:40:34.523 INFO:teuthology.orchestra.run.smithi057.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-25T22:40:34.524 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-25T22:40:34.524 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin_dir": "/usr/lib/ceph", 2024-04-25T22:40:34.524 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "-", 2024-04-25T22:40:34.524 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrv": "", 2024-04-25T22:40:34.524 INFO:teuthology.orchestra.run.smithi057.stdout: "public_bind_addr": "-", 2024-04-25T22:40:34.524 INFO:teuthology.orchestra.run.smithi057.stdout: "public_network": "", 2024-04-25T22:40:34.524 INFO:teuthology.orchestra.run.smithi057.stdout: "public_network_interface": "", 2024-04-25T22:40:34.524 INFO:teuthology.orchestra.run.smithi057.stdout: "qat_compressor_enabled": "false", 2024-04-25T22:40:34.524 INFO:teuthology.orchestra.run.smithi057.stdout: "qat_compressor_session_max_number": "256", 2024-04-25T22:40:34.524 INFO:teuthology.orchestra.run.smithi057.stdout: "rados_mon_op_timeout": "0", 2024-04-25T22:40:34.524 INFO:teuthology.orchestra.run.smithi057.stdout: "rados_osd_op_timeout": "0", 2024-04-25T22:40:34.524 INFO:teuthology.orchestra.run.smithi057.stdout: "rados_tracing": "false", 2024-04-25T22:40:34.524 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_atime_update_interval": "60", 2024-04-25T22:40:34.524 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-25T22:40:34.525 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_balance_parent_reads": "false", 2024-04-25T22:40:34.525 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_balance_snap_reads": "false", 2024-04-25T22:40:34.525 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_blkin_trace_all": "false", 2024-04-25T22:40:34.525 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-25T22:40:34.525 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-25T22:40:34.525 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_cache": "true", 2024-04-25T22:40:34.525 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-25T22:40:34.525 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-25T22:40:34.525 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-25T22:40:34.525 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-25T22:40:34.525 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_cache_policy": "writearound", 2024-04-25T22:40:34.525 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_cache_size": "33554432", 2024-04-25T22:40:34.525 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-25T22:40:34.526 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-25T22:40:34.526 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_clone_copy_on_read": "false", 2024-04-25T22:40:34.526 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_compression_hint": "none", 2024-04-25T22:40:34.526 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_concurrent_management_ops": "10", 2024-04-25T22:40:34.526 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-25T22:40:34.526 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_default_clone_format": "auto", 2024-04-25T22:40:34.526 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_default_data_pool": "", 2024-04-25T22:40:34.526 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_default_features": "61", 2024-04-25T22:40:34.526 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_default_format": "2", 2024-04-25T22:40:34.526 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_default_map_options": "", 2024-04-25T22:40:34.526 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_default_order": "22", 2024-04-25T22:40:34.526 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_default_pool": "rbd", 2024-04-25T22:40:34.526 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-25T22:40:34.527 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_default_stripe_count": "0", 2024-04-25T22:40:34.527 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_default_stripe_unit": "0", 2024-04-25T22:40:34.527 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-25T22:40:34.527 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-25T22:40:34.527 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-25T22:40:34.527 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_enable_alloc_hint": "true", 2024-04-25T22:40:34.527 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-25T22:40:34.527 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_io_scheduler": "simple", 2024-04-25T22:40:34.527 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-25T22:40:34.527 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-25T22:40:34.527 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-25T22:40:34.527 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-25T22:40:34.527 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-25T22:40:34.527 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-25T22:40:34.528 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-25T22:40:34.528 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-25T22:40:34.528 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-25T22:40:34.528 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_journal_order": "24", 2024-04-25T22:40:34.528 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_journal_pool": "", 2024-04-25T22:40:34.528 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_journal_splay_width": "4", 2024-04-25T22:40:34.528 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_localize_parent_reads": "false", 2024-04-25T22:40:34.528 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_localize_snap_reads": "false", 2024-04-25T22:40:34.528 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-25T22:40:34.528 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-25T22:40:34.528 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-25T22:40:34.528 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-25T22:40:34.528 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-25T22:40:34.529 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-25T22:40:34.529 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-25T22:40:34.529 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-25T22:40:34.529 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-25T22:40:34.529 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-25T22:40:34.529 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-25T22:40:34.529 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-25T22:40:34.529 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-25T22:40:34.529 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-25T22:40:34.529 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-25T22:40:34.529 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-25T22:40:34.529 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-25T22:40:34.529 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-25T22:40:34.529 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-25T22:40:34.530 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-25T22:40:34.530 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-25T22:40:34.530 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-25T22:40:34.530 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-25T22:40:34.530 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-25T22:40:34.530 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-25T22:40:34.530 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-25T22:40:34.530 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-25T22:40:34.530 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-25T22:40:34.530 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-25T22:40:34.530 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-25T22:40:34.530 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-25T22:40:34.530 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_mtime_update_interval": "60", 2024-04-25T22:40:34.530 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_non_blocking_aio": "true", 2024-04-25T22:40:34.531 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_op_thread_timeout": "60", 2024-04-25T22:40:34.531 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_op_threads": "1", 2024-04-25T22:40:34.531 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_parent_cache_enabled": "false", 2024-04-25T22:40:34.531 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-25T22:40:34.531 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-25T22:40:34.531 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-25T22:40:34.531 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_plugins": "", 2024-04-25T22:40:34.531 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_qos_bps_burst": "0", 2024-04-25T22:40:34.531 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-25T22:40:34.531 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_qos_bps_limit": "0", 2024-04-25T22:40:34.531 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_qos_exclude_ops": "0", 2024-04-25T22:40:34.531 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_qos_iops_burst": "0", 2024-04-25T22:40:34.531 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-25T22:40:34.531 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_qos_iops_limit": "0", 2024-04-25T22:40:34.532 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-25T22:40:34.532 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-25T22:40:34.532 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-25T22:40:34.532 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-25T22:40:34.532 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-25T22:40:34.532 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-25T22:40:34.532 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-25T22:40:34.532 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-25T22:40:34.532 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-25T22:40:34.532 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-25T22:40:34.532 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-25T22:40:34.532 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-25T22:40:34.532 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-25T22:40:34.532 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-25T22:40:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_read_from_replica_policy": "default", 2024-04-25T22:40:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-25T22:40:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-25T22:40:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-25T22:40:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-25T22:40:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_skip_partial_discard": "true", 2024-04-25T22:40:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-25T22:40:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_tracing": "false", 2024-04-25T22:40:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_validate_names": "true", 2024-04-25T22:40:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd_validate_pool": "true", 2024-04-25T22:40:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "restapi_base_url": "", 2024-04-25T22:40:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "restapi_log_level": "", 2024-04-25T22:40:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_acl_grants_max_num": "100", 2024-04-25T22:40:34.533 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_admin_entry": "admin", 2024-04-25T22:40:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-25T22:40:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_backend_store": "rados", 2024-04-25T22:40:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_barbican_url": "", 2024-04-25T22:40:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_beast_enable_async": "true", 2024-04-25T22:40:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_bucket_counters_cache": "false", 2024-04-25T22:40:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-04-25T22:40:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-25T22:40:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-25T22:40:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-25T22:40:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-25T22:40:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-25T22:40:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-25T22:40:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-25T22:40:34.534 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_cache_enabled": "true", 2024-04-25T22:40:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_cache_expiry_interval": "900", 2024-04-25T22:40:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_cache_lru_size": "10000", 2024-04-25T22:40:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_config_store": "rados", 2024-04-25T22:40:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_content_length_compat": "false", 2024-04-25T22:40:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_copy_obj_progress": "true", 2024-04-25T22:40:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-25T22:40:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_cors_rules_max_num": "100", 2024-04-25T22:40:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_cross_domain_policy": "", 2024-04-25T22:40:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-25T22:40:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_kmip_addr": "", 2024-04-25T22:40:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-25T22:40:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-25T22:40:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-25T22:40:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-25T22:40:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_kmip_password": "", 2024-04-25T22:40:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-25T22:40:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_kmip_username": "", 2024-04-25T22:40:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_require_ssl": "true", 2024-04-25T22:40:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-25T22:40:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-25T22:40:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-25T22:40:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-25T22:40:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-25T22:40:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-25T22:40:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-25T22:40:34.536 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-25T22:40:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-25T22:40:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-25T22:40:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-25T22:40:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-25T22:40:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-25T22:40:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-25T22:40:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-25T22:40:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_vault_addr": "", 2024-04-25T22:40:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_vault_auth": "token", 2024-04-25T22:40:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_vault_namespace": "", 2024-04-25T22:40:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_vault_prefix": "", 2024-04-25T22:40:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-25T22:40:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-25T22:40:34.537 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-25T22:40:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-25T22:40:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_vault_token_file": "", 2024-04-25T22:40:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-25T22:40:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_curl_buffersize": "524288", 2024-04-25T22:40:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-25T22:40:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_curl_low_speed_time": "300", 2024-04-25T22:40:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-25T22:40:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-25T22:40:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-25T22:40:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-25T22:40:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-25T22:40:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-25T22:40:34.538 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-25T22:40:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-25T22:40:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-25T22:40:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-25T22:40:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_d4n_host": "127.0.0.1", 2024-04-25T22:40:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_d4n_port": "6379", 2024-04-25T22:40:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-25T22:40:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_data_log_changes_size": "1000", 2024-04-25T22:40:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_data_log_num_shards": "128", 2024-04-25T22:40:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-25T22:40:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_data_log_window": "30", 2024-04-25T22:40:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-25T22:40:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-25T22:40:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-25T22:40:34.539 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-04-25T22:40:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-25T22:40:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-25T22:40:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-25T22:40:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-25T22:40:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-25T22:40:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-25T22:40:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-25T22:40:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-25T22:40:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-25T22:40:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-25T22:40:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-25T22:40:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-25T22:40:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-25T22:40:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-25T22:40:34.540 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-25T22:40:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-25T22:40:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-25T22:40:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-25T22:40:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-25T22:40:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-25T22:40:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-25T22:40:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_dns_name": "", 2024-04-25T22:40:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_dns_s3website_name": "", 2024-04-25T22:40:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_dynamic_resharding": "true", 2024-04-25T22:40:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-25T22:40:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_enable_gc_threads": "true", 2024-04-25T22:40:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_enable_lc_threads": "true", 2024-04-25T22:40:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_enable_ops_log": "false", 2024-04-25T22:40:34.541 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_enable_quota_threads": "true", 2024-04-25T22:40:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_enable_static_website": "false", 2024-04-25T22:40:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_enable_usage_log": "false", 2024-04-25T22:40:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_enforce_swift_acls": "true", 2024-04-25T22:40:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_exit_timeout_secs": "120", 2024-04-25T22:40:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_expose_bucket": "false", 2024-04-25T22:40:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_extended_http_attrs": "", 2024-04-25T22:40:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_filter": "none", 2024-04-25T22:40:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-25T22:40:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_frontends": "beast port=7480", 2024-04-25T22:40:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-25T22:40:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_gc_max_deferred": "50", 2024-04-25T22:40:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-25T22:40:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_gc_max_objs": "32", 2024-04-25T22:40:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-25T22:40:34.542 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-25T22:40:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-25T22:40:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-25T22:40:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_gc_processor_period": "3600", 2024-04-25T22:40:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-25T22:40:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-25T22:40:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-25T22:40:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-25T22:40:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_init_timeout": "300", 2024-04-25T22:40:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-25T22:40:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-25T22:40:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_kafka_connection_idle": "300", 2024-04-25T22:40:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_kafka_message_timeout": "5000", 2024-04-25T22:40:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_kafka_sleep_timeout": "10", 2024-04-25T22:40:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-25T22:40:34.543 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-04-25T22:40:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-25T22:40:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_admin_domain": "", 2024-04-25T22:40:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_admin_password": "", 2024-04-25T22:40:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_admin_password_path": "", 2024-04-25T22:40:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_admin_project": "", 2024-04-25T22:40:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_admin_tenant": "", 2024-04-25T22:40:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_admin_token": "", 2024-04-25T22:40:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_admin_token_path": "", 2024-04-25T22:40:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_admin_user": "", 2024-04-25T22:40:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_api_version": "2", 2024-04-25T22:40:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_barbican_domain": "", 2024-04-25T22:40:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_barbican_password": "", 2024-04-25T22:40:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_barbican_project": "", 2024-04-25T22:40:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-25T22:40:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_barbican_user": "", 2024-04-25T22:40:34.544 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-25T22:40:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-25T22:40:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-25T22:40:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-25T22:40:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-25T22:40:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_url": "", 2024-04-25T22:40:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-25T22:40:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_lc_debug_interval": "-1", 2024-04-25T22:40:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_lc_lock_max_time": "90", 2024-04-25T22:40:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_lc_max_objs": "32", 2024-04-25T22:40:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_lc_max_rules": "1000", 2024-04-25T22:40:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_lc_max_worker": "3", 2024-04-25T22:40:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-25T22:40:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_lc_thread_delay": "0", 2024-04-25T22:40:34.545 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-25T22:40:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_ldap_dnattr": "uid", 2024-04-25T22:40:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-25T22:40:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_ldap_searchfilter": "", 2024-04-25T22:40:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-25T22:40:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_ldap_uri": "", 2024-04-25T22:40:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-25T22:40:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-25T22:40:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-25T22:40:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_log_http_headers": "", 2024-04-25T22:40:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-25T22:40:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-25T22:40:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_log_object_name_utc": "false", 2024-04-25T22:40:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-04-25T22:40:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-04-25T22:40:34.546 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_max_attr_name_len": "0", 2024-04-25T22:40:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_max_attr_size": "0", 2024-04-25T22:40:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-25T22:40:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_max_chunk_size": "4194304", 2024-04-25T22:40:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-25T22:40:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-25T22:40:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-25T22:40:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_max_listing_results": "1000", 2024-04-25T22:40:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_max_notify_retries": "10", 2024-04-25T22:40:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-25T22:40:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_max_put_param_size": "1048576", 2024-04-25T22:40:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_max_put_size": "5368709120", 2024-04-25T22:40:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_max_slo_entries": "1000", 2024-04-25T22:40:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_md_log_max_shards": "64", 2024-04-25T22:40:34.547 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-25T22:40:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-25T22:40:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-25T22:40:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-25T22:40:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_mp_lock_max_time": "600", 2024-04-25T22:40:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-25T22:40:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-25T22:40:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-25T22:40:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-25T22:40:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-25T22:40:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-25T22:40:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-25T22:40:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-25T22:40:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_nfs_max_gc": "300", 2024-04-25T22:40:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-25T22:40:34.548 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-25T22:40:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-25T22:40:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-25T22:40:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-25T22:40:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-25T22:40:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-25T22:40:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_num_async_rados_threads": "32", 2024-04-25T22:40:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_num_control_oids": "8", 2024-04-25T22:40:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_numa_node": "-1", 2024-04-25T22:40:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-25T22:40:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-25T22:40:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_objexp_chunk_size": "100", 2024-04-25T22:40:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_objexp_gc_interval": "600", 2024-04-25T22:40:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-25T22:40:34.549 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-25T22:40:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-25T22:40:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_op_thread_timeout": "600", 2024-04-25T22:40:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_op_tracing": "false", 2024-04-25T22:40:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_opa_token": "", 2024-04-25T22:40:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_opa_url": "", 2024-04-25T22:40:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_opa_verify_ssl": "true", 2024-04-25T22:40:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-25T22:40:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-25T22:40:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_ops_log_rados": "false", 2024-04-25T22:40:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_ops_log_socket_path": "", 2024-04-25T22:40:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-25T22:40:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-25T22:40:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-25T22:40:34.550 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_period_push_interval": "2.000000", 2024-04-25T22:40:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-25T22:40:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-25T22:40:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-25T22:40:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-04-25T22:40:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_posix_cache_lanes": "3", 2024-04-25T22:40:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-04-25T22:40:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_posix_cache_max_buckets": "100", 2024-04-25T22:40:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_posix_cache_partitions": "3", 2024-04-25T22:40:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-04-25T22:40:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_print_continue": "true", 2024-04-25T22:40:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-25T22:40:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-25T22:40:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-25T22:40:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-25T22:40:34.551 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-25T22:40:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_rados_tracing": "false", 2024-04-25T22:40:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_realm": "", 2024-04-25T22:40:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_realm_id": "", 2024-04-25T22:40:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-25T22:40:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_region": "", 2024-04-25T22:40:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-25T22:40:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-25T22:40:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-25T22:40:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-25T22:40:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_request_uri": "", 2024-04-25T22:40:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_reshard_batch_size": "64", 2024-04-25T22:40:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-25T22:40:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_reshard_max_aio": "128", 2024-04-25T22:40:34.552 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_reshard_num_logs": "16", 2024-04-25T22:40:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_reshard_thread_interval": "600", 2024-04-25T22:40:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_resolve_cname": "false", 2024-04-25T22:40:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-25T22:40:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_run_sync_thread": "true", 2024-04-25T22:40:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-04-25T22:40:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-25T22:40:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-25T22:40:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-25T22:40:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-25T22:40:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-25T22:40:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-25T22:40:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-25T22:40:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-25T22:40:34.553 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_scheduler_type": "throttler", 2024-04-25T22:40:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_script_uri": "", 2024-04-25T22:40:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_service_provider_name": "", 2024-04-25T22:40:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-25T22:40:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_sts_client_id": "", 2024-04-25T22:40:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_sts_client_secret": "", 2024-04-25T22:40:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_sts_entry": "sts", 2024-04-25T22:40:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_sts_key": "sts", 2024-04-25T22:40:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-25T22:40:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_sts_min_session_duration": "900", 2024-04-25T22:40:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_sts_token_introspection_url": "", 2024-04-25T22:40:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_swift_account_in_url": "false", 2024-04-25T22:40:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_swift_auth_entry": "auth", 2024-04-25T22:40:34.554 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_swift_auth_url": "", 2024-04-25T22:40:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_swift_custom_header": "", 2024-04-25T22:40:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-25T22:40:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_swift_need_stats": "true", 2024-04-25T22:40:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_swift_tenant_name": "", 2024-04-25T22:40:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_swift_token_expiration": "86400", 2024-04-25T22:40:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_swift_url": "", 2024-04-25T22:40:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_swift_url_prefix": "swift", 2024-04-25T22:40:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-25T22:40:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-25T22:40:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-25T22:40:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_sync_lease_period": "120", 2024-04-25T22:40:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-25T22:40:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-25T22:40:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-25T22:40:34.555 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-25T22:40:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-25T22:40:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-25T22:40:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-25T22:40:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-25T22:40:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-25T22:40:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_thread_pool_size": "512", 2024-04-25T22:40:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_topic_persistency_max_retries": "0", 2024-04-25T22:40:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-04-25T22:40:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-04-25T22:40:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_topic_require_publish_policy": "false", 2024-04-25T22:40:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_torrent_comment": "", 2024-04-25T22:40:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_torrent_createby": "", 2024-04-25T22:40:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_torrent_encoding": "", 2024-04-25T22:40:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_torrent_flag": "false", 2024-04-25T22:40:34.556 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_torrent_max_size": "5368709120", 2024-04-25T22:40:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_torrent_origin": "", 2024-04-25T22:40:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-25T22:40:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_torrent_tracker": "", 2024-04-25T22:40:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_trust_forwarded_https": "false", 2024-04-25T22:40:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-25T22:40:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-25T22:40:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_usage_max_shards": "32", 2024-04-25T22:40:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_usage_max_user_shards": "1", 2024-04-25T22:40:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_use_opa_authz": "false", 2024-04-25T22:40:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_user_counters_cache": "false", 2024-04-25T22:40:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_user_counters_cache_size": "10000", 2024-04-25T22:40:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-25T22:40:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-25T22:40:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_user_max_buckets": "1000", 2024-04-25T22:40:34.557 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_user_policies_max_num": "100", 2024-04-25T22:40:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-25T22:40:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-25T22:40:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-25T22:40:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-25T22:40:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_user_unique_email": "true", 2024-04-25T22:40:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_verify_ssl": "true", 2024-04-25T22:40:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-25T22:40:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_zone": "", 2024-04-25T22:40:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_zone_id": "", 2024-04-25T22:40:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-25T22:40:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_zonegroup": "", 2024-04-25T22:40:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_zonegroup_id": "", 2024-04-25T22:40:34.558 INFO:teuthology.orchestra.run.smithi057.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-25T22:40:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "rgwlc_auto_session_clear": "true", 2024-04-25T22:40:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-25T22:40:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_block_size": "4096", 2024-04-25T22:40:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-25T22:40:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-25T22:40:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-25T22:40:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-25T22:40:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-25T22:40:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_cache_size": "536870912", 2024-04-25T22:40:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-25T22:40:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-25T22:40:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-25T22:40:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-25T22:40:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-25T22:40:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-25T22:40:34.559 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-25T22:40:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-25T22:40:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_index_type": "binary_search", 2024-04-25T22:40:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-25T22:40:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-25T22:40:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_partition_filters": "false", 2024-04-25T22:40:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_perf": "false", 2024-04-25T22:40:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-25T22:40:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-25T22:40:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-25T22:40:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "run_dir": "/var/run/ceph", 2024-04-25T22:40:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "seastore_block_create": "true", 2024-04-25T22:40:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "seastore_cache_lru_size": "67108864", 2024-04-25T22:40:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-25T22:40:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "seastore_data_delta_based_overwrite": "0", 2024-04-25T22:40:34.560 INFO:teuthology.orchestra.run.smithi057.stdout: "seastore_default_max_object_size": "16777216", 2024-04-25T22:40:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-25T22:40:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: "seastore_device_size": "53687091200", 2024-04-25T22:40:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: "seastore_journal_batch_capacity": "16", 2024-04-25T22:40:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-25T22:40:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-25T22:40:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-25T22:40:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: "seastore_main_device_type": "SSD", 2024-04-25T22:40:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-25T22:40:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-25T22:40:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-25T22:40:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-25T22:40:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-25T22:40:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: "seastore_segment_size": "67108864", 2024-04-25T22:40:34.561 INFO:teuthology.orchestra.run.smithi057.stdout: "set_keepcaps": "false", 2024-04-25T22:40:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: "setgroup": "", 2024-04-25T22:40:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: "setuser": "", 2024-04-25T22:40:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: "setuser_match_path": "", 2024-04-25T22:40:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-25T22:40:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: "thp": "false", 2024-04-25T22:40:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: "threadpool_default_timeout": "60", 2024-04-25T22:40:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-25T22:40:34.562 INFO:teuthology.orchestra.run.smithi057.stdout: "throttler_perf_counter": "true" 2024-04-25T22:40:34.562 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:40:34.564 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-25T22:40:34.706 INFO:teuthology.orchestra.run.smithi057.stdout:mon.a: {} 2024-04-25T22:40:34.706 INFO:teuthology.orchestra.run.smithi057.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:40:34.715 INFO:teuthology.orchestra.run.smithi057.stdout:mon.b: {} 2024-04-25T22:40:34.715 INFO:teuthology.orchestra.run.smithi057.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:40:34.724 INFO:teuthology.orchestra.run.smithi057.stdout:mon.c: {} 2024-04-25T22:40:34.724 INFO:teuthology.orchestra.run.smithi057.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:40:34.739 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-25T22:40:34.740 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T22:40:34.766 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T22:40:34.766 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-25T22:40:34.766 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-25T22:40:34.766 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T22:40:34.767 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T22:40:34.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:40:34.767 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2024-04-25T22:40:34.767 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-25T22:40:34.767 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:40:34.768 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:40:34.768 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-25T22:40:34.768 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.000000 2024-04-25T22:40:34.768 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0 2024-04-25T22:40:34.768 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-25T22:40:34.769 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-25T22:40:34.769 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:40:34.769 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-25T22:40:34.770 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:40:34.770 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-25T22:40:34.770 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:40:34.772 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:34.772+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:34.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:40:34.777 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link delete ceph-brx 2024-04-25T22:40:34.831 INFO:teuthology.orchestra.run.smithi057.stderr:Cannot find device "ceph-brx" 2024-04-25T22:40:34.832 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:40:34.832 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T22:40:34.832 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T22:40:34.871 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:34.873+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:34.903 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:40:34.903 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:40:34.904 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:40:34.904 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:40:34.910 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:40:34.910 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:40:34.918 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:40:34.931 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:40:34.931 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:40:34.951 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:40:34.952 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:40:34.972 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:34.973+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:35.043 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:35.043 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:35.057 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:40:35.074 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:35.074+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:35.174 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:35.172+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:35.180 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:35.180 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:35.195 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T22:40:35.196 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:40:35.213 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T22:40:35.213 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T22:40:35.213 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi057.front.sepia.ceph.com 2024-04-25T22:40:35.213 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T22:40:35.214 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T22:40:35.214 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T22:40:35.214 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T22:40:35.214 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T22:40:35.214 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T22:40:35.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:40:35.214 DEBUG:teuthology.orchestra.run.smithi057:> ip addr 2024-04-25T22:40:35.219 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T22:40:35.219 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T22:40:35.219 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T22:40:35.219 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-04-25T22:40:35.219 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2024-04-25T22:40:35.219 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-04-25T22:40:35.219 INFO:teuthology.orchestra.run.smithi057.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T22:40:35.220 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:86 brd ff:ff:ff:ff:ff:ff 2024-04-25T22:40:35.220 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f0 2024-04-25T22:40:35.220 INFO:teuthology.orchestra.run.smithi057.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T22:40:35.220 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:87 brd ff:ff:ff:ff:ff:ff 2024-04-25T22:40:35.220 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f1 2024-04-25T22:40:35.220 INFO:teuthology.orchestra.run.smithi057.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T22:40:35.220 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T22:40:35.220 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f0 2024-04-25T22:40:35.220 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.21.15.57/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T22:40:35.220 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft 42456sec preferred_lft 42456sec 2024-04-25T22:40:35.220 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::ec4:7aff:febd:1562/64 scope link 2024-04-25T22:40:35.220 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-04-25T22:40:35.220 INFO:teuthology.orchestra.run.smithi057.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T22:40:35.221 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T22:40:35.221 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f1 2024-04-25T22:40:35.221 INFO:teuthology.orchestra.run.smithi057.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T22:40:35.221 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 02:42:00:ff:71:4e brd ff:ff:ff:ff:ff:ff 2024-04-25T22:40:35.221 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T22:40:35.221 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-04-25T22:40:35.221 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T22:40:35.221 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T22:40:35.221 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-04-25T22:40:35.221 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add name ceph-brx type bridge 2024-04-25T22:40:35.222 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr flush dev ceph-brx 2024-04-25T22:40:35.222 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set ceph-brx up 2024-04-25T22:40:35.222 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T22:40:35.222 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-04-25T22:40:35.258 INFO:teuthology.orchestra.run.smithi057.stderr:set osd.1 primary-affinity to 0 (802) 2024-04-25T22:40:35.261 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is set 2024-04-25T22:40:35.274 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:35.274+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:35.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25T22:40:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T22:40:35.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25T22:40:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:40:35.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:40:35.329 DEBUG:teuthology.orchestra.run.smithi057:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T22:40:35.333 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:35.333 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:35.348 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:40:35.376 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:35.376+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:35.378 INFO:teuthology.orchestra.run.smithi057.stdout:1 2024-04-25T22:40:35.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:40:35.380 DEBUG:teuthology.orchestra.run.smithi057:> route 2024-04-25T22:40:35.451 INFO:teuthology.orchestra.run.smithi057.stdout:Kernel IP routing table 2024-04-25T22:40:35.451 INFO:teuthology.orchestra.run.smithi057.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T22:40:35.451 INFO:teuthology.orchestra.run.smithi057.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T22:40:35.451 INFO:teuthology.orchestra.run.smithi057.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T22:40:35.451 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T22:40:35.451 INFO:teuthology.orchestra.run.smithi057.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T22:40:35.452 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T22:40:35.452 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-04-25T22:40:35.452 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T22:40:35.452 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T22:40:35.452 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T22:40:35.452 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-04-25T22:40:35.470 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:35.471 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:35.476 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:35.473+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:35.485 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:40:35.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25T22:40:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T22:40:35.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25T22:40:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:40:35.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:40:35.575 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2024-04-25T22:40:35.576 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:35.576+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:35.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:40:35.625 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list-id 2024-04-25T22:40:35.648 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:35.648 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:35.664 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:40:35.672 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T22:40:35.672 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-04-25T22:40:35.672 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:40:35.672 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T22:40:35.672 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-04-25T22:40:35.709 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:35.710+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:35.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25T22:40:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T22:40:35.778 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:35.776+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:35.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25T22:40:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:40:35.793 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T22:40:35.793 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T22:40:35.793 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-04-25T22:40:35.793 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T22:40:35.793 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T22:40:35.793 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T22:40:35.793 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T22:40:35.793 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T22:40:35.794 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-04-25T22:40:35.795 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:35.795 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:35.809 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:40:35.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25T22:40:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T22:40:35.879 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:35.876+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:35.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25T22:40:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:40:35.896 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T22:40:35.896 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-04-25T22:40:35.896 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set brx.0 up 2024-04-25T22:40:35.897 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T22:40:35.897 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-04-25T22:40:35.972 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:35.972 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:35.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25T22:40:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T22:40:35.980 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:35.978+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:35.987 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:40:35.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25T22:40:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:40:35.998 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-25T22:40:35.998 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T22:40:35.998 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T22:40:36.043 INFO:teuthology.orchestra.run.smithi057.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T22:40:36.043 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T22:40:36.043 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T22:40:36.081 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:36.082+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:36.090 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2024-04-25T22:40:36.141 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T22:40:36.158 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:36.158 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:36.174 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:40:36.188 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2024-04-25T22:40:36.189 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2024-04-25T22:40:36.189 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2024-04-25T22:40:36.189 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2024-04-25T22:40:36.189 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2024-04-25T22:40:36.189 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2024-04-25T22:40:36.189 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2024-04-25T22:40:36.189 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2024-04-25T22:40:36.189 INFO:teuthology.orchestra.run.smithi057.stdout:/run/lock 2024-04-25T22:40:36.189 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2024-04-25T22:40:36.189 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2024-04-25T22:40:36.189 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/bpf 2024-04-25T22:40:36.189 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T22:40:36.190 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2024-04-25T22:40:36.190 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2024-04-25T22:40:36.190 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2024-04-25T22:40:36.190 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2024-04-25T22:40:36.190 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/fs/nfsd 2024-04-25T22:40:36.190 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2024-04-25T22:40:36.190 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2024-04-25T22:40:36.190 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T22:40:36.190 INFO:teuthology.orchestra.run.smithi057.stdout:/run/rpc_pipefs 2024-04-25T22:40:36.190 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2024-04-25T22:40:36.190 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2024-04-25T22:40:36.190 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2024-04-25T22:40:36.190 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:40:36.190 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:40:36.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:40:36.191 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2024-04-25T22:40:36.217 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:36.218+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:36.240 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T22:40:36.240 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-25T22:40:36.282 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:36.282+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:36.285 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2024-04-25T22:40:36.297 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T22:40:36.313 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:36.313 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:36.328 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:40:36.344 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2024-04-25T22:40:36.344 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2024-04-25T22:40:36.344 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2024-04-25T22:40:36.344 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2024-04-25T22:40:36.344 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2024-04-25T22:40:36.344 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2024-04-25T22:40:36.344 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2024-04-25T22:40:36.344 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2024-04-25T22:40:36.344 INFO:teuthology.orchestra.run.smithi057.stdout:/run/lock 2024-04-25T22:40:36.345 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2024-04-25T22:40:36.345 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2024-04-25T22:40:36.345 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/bpf 2024-04-25T22:40:36.345 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T22:40:36.345 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2024-04-25T22:40:36.345 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2024-04-25T22:40:36.345 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2024-04-25T22:40:36.345 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2024-04-25T22:40:36.345 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/fs/nfsd 2024-04-25T22:40:36.345 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2024-04-25T22:40:36.345 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2024-04-25T22:40:36.345 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T22:40:36.345 INFO:teuthology.orchestra.run.smithi057.stdout:/run/rpc_pipefs 2024-04-25T22:40:36.345 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2024-04-25T22:40:36.346 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2024-04-25T22:40:36.346 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2024-04-25T22:40:36.346 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:40:36.346 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:40:36.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:40:36.347 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2024-04-25T22:40:36.377 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:2024-04-25T22:40:36.372+0000 7ff958d17580 -1 init, newargv = 0x55ebe1ed7680 newargc=15 2024-04-25T22:40:36.378 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:ceph-fuse[22831]: starting ceph client 2024-04-25T22:40:36.382 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:36.381+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:36.383 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:ceph-fuse[22831]: starting fuse 2024-04-25T22:40:36.444 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:36.445 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:36.459 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:40:36.483 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:36.485+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:36.576 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:36.576 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:36.585 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:36.585+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:36.589 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:40:36.685 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:36.685+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:36.722 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:36.722 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:36.736 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:40:36.822 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:36.821+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:36.887 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:36.886+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:36.900 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:36.900 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:36.914 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:40:36.969 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:40:37.001 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:37.001+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:37.074 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:37.074 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:37.088 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:40:37.129 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:40:37.129 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:40:37.130 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:37.129+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:37.149 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:40:37.149 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:40:37.167 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:40:37.167 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:40:37.190 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:37.189+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:37.219 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:37.219 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:37.219 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:40:37.219 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:37.233 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:40:37.284 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:40:37.291 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:37.290+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:37.349 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:37.349 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:37.349 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:40:37.350 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:40:37.350 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:37.363 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:40:37.405 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:37.406+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:37.484 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2024-04-25T22:40:37.493 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:37.494+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:37.497 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T22:40:37.530 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:40:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:40:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:40:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.932957741999999, 2024-04-25T22:40:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:40:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:40:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:40:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:40:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:40:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:40:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:40:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:40:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:40:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:40:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:40:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:40:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:40:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:40:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:40:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:40:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:40:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:40:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:40:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:40:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:40:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:40:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:40:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:40:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:40:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:40:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:40:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.932820486000001, 2024-04-25T22:40:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:40:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:40:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:40:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:40:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:40:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:40:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:40:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:40:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:40:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:40:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:40:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:40:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:40:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:40:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:40:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:40:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:40:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:40:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:40:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:40:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:40:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:40:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:40:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:40:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:40:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:40:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:40:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.932732934000001, 2024-04-25T22:40:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:40:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:40:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:40:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:40:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:40:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:40:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:40:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:40:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:40:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:40:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:40:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:40:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:40:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:40:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:40:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:40:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:40:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:40:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:40:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:40:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:40:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:40:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:40:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:40:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:40:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:40:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:40:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.932629108, 2024-04-25T22:40:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:40:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:40:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:40:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:40:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:40:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:40:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:40:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:40:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:40:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:40:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:40:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:40:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:40:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:40:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:40:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:40:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:40:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:40:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:40:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:40:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:40:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:40:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:40:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:40:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:40:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:40:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:40:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.932560318, 2024-04-25T22:40:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:40:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:40:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:40:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:40:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:40:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:40:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:40:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:40:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:40:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:40:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:40:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:40:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:40:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:40:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:40:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:40:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:40:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:40:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:40:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:40:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:40:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:40:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:40:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:40:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:40:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:40:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:40:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.932491232, 2024-04-25T22:40:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:40:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:40:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:40:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:40:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:40:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:40:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:40:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:40:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:40:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:40:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:40:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:40:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:40:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:40:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:40:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:40:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:40:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:40:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:40:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:40:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:40:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:40:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:40:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:40:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:40:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:40:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:40:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.932395118999999, 2024-04-25T22:40:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:40:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:40:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:40:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:40:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:40:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:40:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:40:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:40:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:40:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:40:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:40:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:40:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:40:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:40:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:40:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:40:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:40:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:40:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:40:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.932329457000002, 2024-04-25T22:40:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:40:37.570 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:37.570 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:37.570 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:37.570 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:37.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.570 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:37.570 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:37.570 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.570 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.570 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:37.570 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:37.570 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.570 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:37.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:40:37.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:40:37.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:37.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:40:37.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:40:37.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:37.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:40:37.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:40:37.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:37.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:40:37.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:40:37.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:40:37.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:40:37.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:37.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:40:37.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:40:37.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:40:37.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:40:37.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:37.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:40:37.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:40:37.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:37.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:40:37.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:40:37.573 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.573 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.574 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.574 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.574 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:37.574 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:37.574 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.932260329999998, 2024-04-25T22:40:37.574 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:40:37.574 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:37.574 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:37.574 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:37.574 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:37.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.574 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:37.574 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:37.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:37.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:37.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:37.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:40:37.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:40:37.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:37.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:40:37.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:40:37.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:37.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:40:37.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:40:37.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:37.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:40:37.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:40:37.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:40:37.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:40:37.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:37.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:40:37.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:40:37.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:40:37.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:40:37.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:37.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:40:37.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:40:37.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:37.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:40:37.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:40:37.578 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.578 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.578 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.578 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:40:37.578 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:37.579 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.921443673999999, 2024-04-25T22:40:37.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:40:37.579 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:37.579 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:37.579 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:37.579 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:37.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:37.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:37.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:37.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:37.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:37.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:40:37.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:40:37.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:37.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:40:37.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:40:37.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:37.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:40:37.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:40:37.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:37.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:40:37.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:40:37.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:40:37.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:40:37.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:37.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:40:37.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:40:37.581 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.582 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.582 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.582 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 3 lcod 18'1)", 2024-04-25T22:40:37.582 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.623947+0000", 2024-04-25T22:40:37.582 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.904624577, 2024-04-25T22:40:37.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085957999999999998, 2024-04-25T22:40:37.582 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:37.582 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:37.582 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:37.582 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:37.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:37.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.623947+0000", 2024-04-25T22:40:37.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:37.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.623947+0000", 2024-04-25T22:40:37.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:37.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.623948+0000", 2024-04-25T22:40:37.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3300000000000002e-07 2024-04-25T22:40:37.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:37.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.623953+0000", 2024-04-25T22:40:37.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2329999999999997e-06 2024-04-25T22:40:37.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:37.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.623969+0000", 2024-04-25T22:40:37.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6197000000000001e-05 2024-04-25T22:40:37.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:37.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.623987+0000", 2024-04-25T22:40:37.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7540000000000001e-05 2024-04-25T22:40:37.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624548+0000", 2024-04-25T22:40:37.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00056116200000000003 2024-04-25T22:40:37.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:37.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624807+0000", 2024-04-25T22:40:37.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025891500000000002 2024-04-25T22:40:37.585 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.585 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.585 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.585 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:37.585 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:37.585 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.904545321000001, 2024-04-25T22:40:37.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:40:37.586 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:37.586 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:37.586 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:37.586 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:37.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.586 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:37.586 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:37.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.586 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.586 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:37.586 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:37.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.586 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:37.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:37.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:40:37.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:37.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:40:37.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:40:37.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:37.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:40:37.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:40:37.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:37.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:40:37.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:40:37.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:40:37.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:40:37.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:37.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:40:37.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:40:37.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:37.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:40:37.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:40:37.589 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.589 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.589 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.589 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:37.589 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:37.589 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.903724431000001, 2024-04-25T22:40:37.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:40:37.589 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:37.590 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:37.590 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:37.590 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:37.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:37.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:37.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:37.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:37.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.591 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:37.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:40:37.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:40:37.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.591 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:37.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:40:37.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:40:37.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.591 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:37.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:40:37.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:40:37.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.592 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:37.592 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:40:37.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:40:37.592 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.592 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.592 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.592 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:40:37.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:40:37.592 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.592 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.592 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:37.592 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:40:37.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:40:37.592 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:37.593 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:40:37.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:40:37.593 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.593 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.593 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.593 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:37.593 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:37.593 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.902023703000001, 2024-04-25T22:40:37.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:40:37.593 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:37.593 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:37.593 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:37.594 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:37.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:37.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:37.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:37.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:37.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:37.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:40:37.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:40:37.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:37.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:40:37.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:40:37.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:37.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:40:37.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:40:37.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:37.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:40:37.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:40:37.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:40:37.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:40:37.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:37.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:40:37.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:40:37.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:37.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:40:37.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:40:37.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:37.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:40:37.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:40:37.597 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.597 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.597 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.597 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:37.597 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:37.597 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.901427028000001, 2024-04-25T22:40:37.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:40:37.597 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:37.597 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:37.598 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:37.598 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:37.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:37.598 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:37.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:37.598 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:37.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:37.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:40:37.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:40:37.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:37.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:40:37.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:40:37.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:37.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:40:37.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:40:37.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:37.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:40:37.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:40:37.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:40:37.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:40:37.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:37.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:40:37.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:40:37.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:37.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:40:37.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:40:37.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:37.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:40:37.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:40:37.601 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.601 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.601 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.601 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e18/16 ondisk, result = 0)", 2024-04-25T22:40:37.601 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636530+0000", 2024-04-25T22:40:37.602 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.892041802000001, 2024-04-25T22:40:37.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086108500000000004, 2024-04-25T22:40:37.602 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:37.602 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:37.602 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:37.602 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:37.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:37.602 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636530+0000", 2024-04-25T22:40:37.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:37.603 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636530+0000", 2024-04-25T22:40:37.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:37.603 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636531+0000", 2024-04-25T22:40:37.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:40:37.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:37.603 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636535+0000", 2024-04-25T22:40:37.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3579999999999996e-06 2024-04-25T22:40:37.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:37.603 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636555+0000", 2024-04-25T22:40:37.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9647999999999999e-05 2024-04-25T22:40:37.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:37.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636565+0000", 2024-04-25T22:40:37.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0231000000000001e-05 2024-04-25T22:40:37.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637201+0000", 2024-04-25T22:40:37.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00063605599999999997 2024-04-25T22:40:37.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:37.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637219+0000", 2024-04-25T22:40:37.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8159e-05 2024-04-25T22:40:37.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.605 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:37.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637391+0000", 2024-04-25T22:40:37.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017191299999999999 2024-04-25T22:40:37.605 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.605 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.605 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.605 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:40:37.605 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:37.605 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.891991302000001, 2024-04-25T22:40:37.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:40:37.606 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:37.606 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:37.606 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:37.606 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:37.606 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:37.606 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:37.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.606 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.606 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:37.606 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:37.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:37.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:37.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:40:37.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:37.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:40:37.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:40:37.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:37.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:40:37.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:40:37.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:37.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:40:37.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:40:37.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:40:37.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:40:37.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:37.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:40:37.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:40:37.608 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.609 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.609 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.609 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.609 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:37.609 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:37.609 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.891343876000001, 2024-04-25T22:40:37.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:40:37.609 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:37.609 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:37.609 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:37.609 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:37.609 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.609 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:37.609 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:37.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.610 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.610 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.610 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:37.610 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:37.610 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.610 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.610 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.610 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:37.610 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:40:37.610 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:40:37.610 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.610 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.610 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:37.610 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:40:37.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:40:37.611 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:37.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:40:37.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:40:37.611 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:37.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:40:37.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:40:37.611 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:40:37.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:40:37.611 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.612 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.612 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:37.612 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:40:37.612 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:40:37.612 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.612 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.612 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:37.612 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:40:37.612 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:40:37.612 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.612 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.612 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:37.612 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:40:37.612 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:40:37.612 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.613 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.613 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.613 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.613 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.613 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:37.613 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:37.613 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.889903057000001, 2024-04-25T22:40:37.613 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:40:37.613 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:37.613 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:37.613 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:37.613 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:37.613 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.613 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:37.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:37.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.614 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:37.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:37.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.614 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:37.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:40:37.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:40:37.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.614 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:37.615 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:40:37.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:40:37.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.615 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:37.615 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:40:37.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:40:37.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.615 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:37.615 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:40:37.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:40:37.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.616 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.616 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:40:37.616 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:40:37.616 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.616 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.616 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:37.616 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:40:37.616 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:40:37.616 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.616 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.616 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:37.616 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:40:37.616 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:40:37.616 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.616 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.617 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:37.617 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:40:37.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:40:37.617 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.617 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.617 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.617 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.617 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:40:37.617 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:37.617 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.937464613, 2024-04-25T22:40:37.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:40:37.617 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:37.617 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:37.617 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:37.618 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:37.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:37.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:37.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:37.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:37.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:37.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:37.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:40:37.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:40:37.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:37.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:40:37.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:40:37.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:37.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:40:37.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:40:37.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:37.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:40:37.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:40:37.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:37.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:40:37.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:40:37.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:37.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:40:37.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:40:37.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:37.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:40:37.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:40:37.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:37.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:40:37.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:40:37.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:37.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:40:37.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:40:37.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:37.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:40:37.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:40:37.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:37.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:37.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:37.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:40:37.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:40:37.622 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.622 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.622 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.622 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:37.622 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:37.622 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:37.624 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:40:37.625 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:37.624+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:37.629 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2024-04-25T22:40:37.629 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2024-04-25T22:40:37.629 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2024-04-25T22:40:37.629 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2024-04-25T22:40:37.630 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2024-04-25T22:40:37.630 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2024-04-25T22:40:37.630 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2024-04-25T22:40:37.630 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2024-04-25T22:40:37.630 INFO:teuthology.orchestra.run.smithi057.stdout:/run/lock 2024-04-25T22:40:37.630 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2024-04-25T22:40:37.630 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2024-04-25T22:40:37.630 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/bpf 2024-04-25T22:40:37.630 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T22:40:37.630 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2024-04-25T22:40:37.630 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2024-04-25T22:40:37.630 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2024-04-25T22:40:37.630 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2024-04-25T22:40:37.631 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/fs/nfsd 2024-04-25T22:40:37.631 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2024-04-25T22:40:37.631 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2024-04-25T22:40:37.631 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T22:40:37.631 INFO:teuthology.orchestra.run.smithi057.stdout:/run/rpc_pipefs 2024-04-25T22:40:37.631 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2024-04-25T22:40:37.631 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2024-04-25T22:40:37.631 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2024-04-25T22:40:37.631 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:40:37.631 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:40:37.631 INFO:teuthology.orchestra.run.smithi057.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-25T22:40:37.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:40:37.632 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2024-04-25T22:40:37.680 INFO:teuthology.orchestra.run.smithi057.stdout:45 2024-04-25T22:40:37.680 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-25T22:40:37.680 DEBUG:teuthology.orchestra.run.smithi057:> sudo stdin-killer -- python3 -c ' 2024-04-25T22:40:37.680 DEBUG:teuthology.orchestra.run.smithi057:> import glob 2024-04-25T22:40:37.680 DEBUG:teuthology.orchestra.run.smithi057:> import re 2024-04-25T22:40:37.681 DEBUG:teuthology.orchestra.run.smithi057:> import os 2024-04-25T22:40:37.681 DEBUG:teuthology.orchestra.run.smithi057:> import subprocess 2024-04-25T22:40:37.681 DEBUG:teuthology.orchestra.run.smithi057:> 2024-04-25T22:40:37.681 DEBUG:teuthology.orchestra.run.smithi057:> def _find_admin_socket(client_name): 2024-04-25T22:40:37.681 DEBUG:teuthology.orchestra.run.smithi057:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T22:40:37.681 DEBUG:teuthology.orchestra.run.smithi057:> files = glob.glob(asok_path) 2024-04-25T22:40:37.681 DEBUG:teuthology.orchestra.run.smithi057:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T22:40:37.681 DEBUG:teuthology.orchestra.run.smithi057:> 2024-04-25T22:40:37.681 DEBUG:teuthology.orchestra.run.smithi057:> # Given a non-glob path, it better be there 2024-04-25T22:40:37.681 DEBUG:teuthology.orchestra.run.smithi057:> if "*" not in asok_path: 2024-04-25T22:40:37.681 DEBUG:teuthology.orchestra.run.smithi057:> assert(len(files) == 1) 2024-04-25T22:40:37.681 DEBUG:teuthology.orchestra.run.smithi057:> return files[0] 2024-04-25T22:40:37.681 DEBUG:teuthology.orchestra.run.smithi057:> 2024-04-25T22:40:37.681 DEBUG:teuthology.orchestra.run.smithi057:> for f in files: 2024-04-25T22:40:37.681 DEBUG:teuthology.orchestra.run.smithi057:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T22:40:37.681 DEBUG:teuthology.orchestra.run.smithi057:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T22:40:37.681 DEBUG:teuthology.orchestra.run.smithi057:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T22:40:37.682 DEBUG:teuthology.orchestra.run.smithi057:> contents = proc_f.read() 2024-04-25T22:40:37.682 DEBUG:teuthology.orchestra.run.smithi057:> if mountpoint in contents: 2024-04-25T22:40:37.682 DEBUG:teuthology.orchestra.run.smithi057:> return f 2024-04-25T22:40:37.682 DEBUG:teuthology.orchestra.run.smithi057:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T22:40:37.682 DEBUG:teuthology.orchestra.run.smithi057:> 2024-04-25T22:40:37.682 DEBUG:teuthology.orchestra.run.smithi057:> print(_find_admin_socket("client.0")) 2024-04-25T22:40:37.682 DEBUG:teuthology.orchestra.run.smithi057:> ' 2024-04-25T22:40:37.724 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:37.725+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:37.754 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:40:37.754 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:40:37.754 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:40:37.754 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:40:37.768 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:40:37.807 INFO:teuthology.orchestra.run.smithi057.stdout:/var/run/ceph/ceph-client.0.22831.asok 2024-04-25T22:40:37.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-25T22:40:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:40:37.819 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.22831.asok 2024-04-25T22:40:37.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:40:37.819 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.22831.asok status 2024-04-25T22:40:37.825 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:37.826+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:37.883 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:40:37.883 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:40:37.883 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:40:37.883 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:40:37.883 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:40:37.898 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:40:37.925 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:37.925+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:37.983 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:40:37.983 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": { 2024-04-25T22:40:37.983 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_sha1": "d2c45d977142e024a59b68a8f1dce8f0b9840551", 2024-04-25T22:40:37.983 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_version": "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)", 2024-04-25T22:40:37.983 INFO:teuthology.orchestra.run.smithi057.stdout: "entity_id": "0", 2024-04-25T22:40:37.983 INFO:teuthology.orchestra.run.smithi057.stdout: "hostname": "smithi057", 2024-04-25T22:40:37.983 INFO:teuthology.orchestra.run.smithi057.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-25T22:40:37.983 INFO:teuthology.orchestra.run.smithi057.stdout: "pid": "22831", 2024-04-25T22:40:37.984 INFO:teuthology.orchestra.run.smithi057.stdout: "root": "/" 2024-04-25T22:40:37.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:37.984 INFO:teuthology.orchestra.run.smithi057.stdout: "dentry_count": 0, 2024-04-25T22:40:37.984 INFO:teuthology.orchestra.run.smithi057.stdout: "dentry_pinned_count": 0, 2024-04-25T22:40:37.984 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4529, 2024-04-25T22:40:37.984 INFO:teuthology.orchestra.run.smithi057.stdout: "inst": { 2024-04-25T22:40:37.984 INFO:teuthology.orchestra.run.smithi057.stdout: "name": { 2024-04-25T22:40:37.984 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "client", 2024-04-25T22:40:37.984 INFO:teuthology.orchestra.run.smithi057.stdout: "num": 4529 2024-04-25T22:40:37.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:37.984 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": { 2024-04-25T22:40:37.984 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:37.984 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "192.168.0.1:0", 2024-04-25T22:40:37.984 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 225458868 2024-04-25T22:40:37.985 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:37.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:37.985 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": { 2024-04-25T22:40:37.985 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:37.985 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "192.168.0.1:0", 2024-04-25T22:40:37.985 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 225458868 2024-04-25T22:40:37.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:37.985 INFO:teuthology.orchestra.run.smithi057.stdout: "inst_str": "client.4529 192.168.0.1:0/225458868", 2024-04-25T22:40:37.985 INFO:teuthology.orchestra.run.smithi057.stdout: "addr_str": "192.168.0.1:0/225458868", 2024-04-25T22:40:37.985 INFO:teuthology.orchestra.run.smithi057.stdout: "inode_count": 1, 2024-04-25T22:40:37.985 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_epoch": 5, 2024-04-25T22:40:37.985 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_epoch": 21, 2024-04-25T22:40:37.985 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_epoch_barrier": 0, 2024-04-25T22:40:37.985 INFO:teuthology.orchestra.run.smithi057.stdout: "blocklisted": false, 2024-04-25T22:40:37.986 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs" 2024-04-25T22:40:37.986 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:40:37.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:40:37.998 DEBUG:teuthology.orchestra.run.smithi057:> stat --file-system '--printf=%T 2024-04-25T22:40:37.998 DEBUG:teuthology.orchestra.run.smithi057:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-25T22:40:38.005 INFO:teuthology.orchestra.run.smithi057.stdout:fuseblk 2024-04-25T22:40:38.005 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-25T22:40:38.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:40:38.006 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T22:40:38.026 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:40:38.026 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:40:38.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:40:38.026 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:40:38.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.027 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.027 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:40:38.027 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.429097189, 2024-04-25T22:40:38.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:40:38.027 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:38.027 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:38.027 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.027 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:38.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:38.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:40:38.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:38.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:40:38.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:38.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:40:38.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:40:38.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:38.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:40:38.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:40:38.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:38.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:40:38.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:40:38.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:40:38.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:40:38.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:40:38.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:40:38.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:38.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:40:38.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:40:38.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:40:38.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:40:38.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:38.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:40:38.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:40:38.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:38.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:40:38.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:40:38.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:40:38.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:40:38.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:38.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:40:38.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:40:38.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:38.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:40:38.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:40:38.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:38.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:40:38.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:40:38.032 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.032 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.032 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.033 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.033 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:40:38.033 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.429009176000001, 2024-04-25T22:40:38.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:40:38.033 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:38.033 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:38.033 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.033 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:38.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:38.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:40:38.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:38.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:40:38.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:38.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:40:38.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:40:38.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:38.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:40:38.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:40:38.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:38.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:40:38.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:40:38.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:40:38.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:40:38.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:40:38.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:40:38.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:38.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:38.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:40:38.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:40:38.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:40:38.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:38.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:40:38.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:40:38.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:38.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:40:38.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:40:38.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:38.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:40:38.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:40:38.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:40:38.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:40:38.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:38.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:40:38.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:40:38.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:38.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:40:38.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:40:38.038 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.038 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.038 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.039 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.039 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:40:38.039 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.428937053999999, 2024-04-25T22:40:38.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:40:38.039 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:38.039 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:38.039 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.039 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:38.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:38.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:40:38.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:38.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:40:38.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:38.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:40:38.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:40:38.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:38.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:40:38.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:40:38.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:38.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:40:38.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:40:38.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:40:38.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:40:38.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:40:38.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:40:38.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:38.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:40:38.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:40:38.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:40:38.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:40:38.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:38.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:40:38.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:40:38.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:38.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:40:38.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:40:38.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:40:38.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:40:38.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:38.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:40:38.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:40:38.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:38.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:40:38.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:40:38.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:38.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:40:38.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:40:38.044 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.044 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.044 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.045 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.045 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:40:38.045 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.428828741, 2024-04-25T22:40:38.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:40:38.045 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:38.045 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:38.045 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.045 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:38.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:38.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:40:38.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:38.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:40:38.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:38.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:40:38.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:40:38.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:38.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:40:38.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:40:38.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:38.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:40:38.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:40:38.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:40:38.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:40:38.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:40:38.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:40:38.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:38.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:40:38.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:40:38.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:40:38.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:40:38.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:38.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:40:38.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:40:38.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:38.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:40:38.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:40:38.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:40:38.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:40:38.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:38.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:40:38.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:40:38.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:38.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:40:38.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:40:38.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:38.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:40:38.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:40:38.050 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.050 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.050 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.051 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.051 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:40:38.051 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.428762084999999, 2024-04-25T22:40:38.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:40:38.051 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:38.051 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:38.051 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.051 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:38.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:38.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:40:38.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:38.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:40:38.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:38.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:40:38.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:40:38.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:38.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:40:38.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:40:38.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:38.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:40:38.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:40:38.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:40:38.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:40:38.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:40:38.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:40:38.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:38.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:40:38.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:40:38.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:40:38.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:40:38.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:38.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:40:38.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:40:38.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:38.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:40:38.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:40:38.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:40:38.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:40:38.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:38.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:40:38.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:40:38.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:38.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:40:38.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:40:38.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:38.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:40:38.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:40:38.056 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.056 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.056 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.057 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.057 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:40:38.057 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.428671488999999, 2024-04-25T22:40:38.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:40:38.057 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:38.057 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:38.057 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.057 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:38.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:38.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:40:38.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:38.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:40:38.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:38.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:40:38.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:40:38.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:38.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:40:38.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:40:38.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:38.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:40:38.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:40:38.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:40:38.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:40:38.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:40:38.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:40:38.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:38.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:40:38.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:40:38.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:40:38.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:40:38.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:38.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:40:38.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:40:38.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:38.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:40:38.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:40:38.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:38.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:40:38.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:40:38.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:40:38.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:40:38.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:38.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:40:38.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:40:38.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:38.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:40:38.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:40:38.064 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.064 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.064 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.064 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.064 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:40:38.064 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.428606916, 2024-04-25T22:40:38.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:40:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:40:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:40:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:40:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:40:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:40:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:40:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:40:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:40:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:40:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:40:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:40:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:40:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:40:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:40:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:40:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:40:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:40:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:40:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:40:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:40:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:40:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:40:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:40:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:40:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:40:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:40:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:40:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:40:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:40:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.428541493000001, 2024-04-25T22:40:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:40:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:40:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:40:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:40:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:40:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:40:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:40:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:40:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:40:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:40:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:40:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:40:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:40:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:40:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:40:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:40:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:40:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:40:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:40:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:40:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:40:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:40:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:40:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:40:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:40:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:40:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:40:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:40:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:40:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:40:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.428485426999998, 2024-04-25T22:40:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:40:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:40:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:40:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:40:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:40:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:40:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:40:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:40:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:40:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:40:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:40:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:40:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:40:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:40:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:40:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:40:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:40:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:40:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:40:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:40:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:40:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:40:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:40:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:40:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:40:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:40:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:40:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:40:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:40:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:40:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.428418320999999, 2024-04-25T22:40:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:40:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:40:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:40:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:40:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:40:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:40:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:40:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:40:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:40:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:40:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:40:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:40:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:40:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:40:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:40:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:40:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:40:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:40:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:40:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:40:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:40:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:40:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:40:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:40:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:40:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:40:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:40:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:40:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:40:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:40:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.428363198, 2024-04-25T22:40:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:40:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:40:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:40:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:40:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:40:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:40:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:40:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:40:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:40:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:40:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:40:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:40:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:40:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:40:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:40:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:40:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:40:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:40:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:40:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:40:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:40:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:40:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:40:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:40:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:40:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:40:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:40:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:40:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:40:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:40:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:40:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.428260958999999, 2024-04-25T22:40:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:40:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:40:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:40:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:40:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:40:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:40:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:40:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:40:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:40:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:40:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:40:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:40:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:40:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:40:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:40:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:40:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:40:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:40:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:40:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:40:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:40:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:40:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:40:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:40:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:40:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:40:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:40:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:40:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:40:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:40:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:40:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.428202135999999, 2024-04-25T22:40:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:40:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:40:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:40:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:40:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:40:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:40:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:40:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:40:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:40:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:40:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:40:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:40:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:40:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:40:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:40:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:40:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:40:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:40:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:40:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:40:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:40:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:40:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:40:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:40:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:40:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:40:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:40:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:40:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:40:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:40:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:40:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.428123403000001, 2024-04-25T22:40:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:40:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:40:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:40:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:40:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:40:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:40:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:40:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:40:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:40:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:40:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:40:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:40:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:40:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:40:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:40:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:40:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:40:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:40:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:40:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:40:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:40:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:40:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:40:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:40:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:40:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:40:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:40:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:40:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:40:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:40:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.428083990000001, 2024-04-25T22:40:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:40:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:40:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:40:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:40:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:40:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:40:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:40:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:40:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:40:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:40:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:40:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:40:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:40:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:40:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:40:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:40:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:40:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:40:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:40:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:40:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:40:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:40:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:40:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:40:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:40:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:40:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:40:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:40:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:40:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:40:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.428014143999999, 2024-04-25T22:40:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:40:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:40:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:40:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:40:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:40:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:40:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:40:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:40:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:40:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:40:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:40:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:40:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:40:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:40:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:40:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:40:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:40:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:40:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:40:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:40:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:40:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:40:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:40:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:40:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:40:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:40:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:40:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:40:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:40:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:40:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.427964407000001, 2024-04-25T22:40:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:40:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:40:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:40:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:40:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:40:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:40:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:40:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:40:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:40:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:40:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:40:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:40:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:40:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:40:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:40:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:40:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:40:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:40:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:40:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:40:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:40:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:40:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:40:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:40:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:40:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:40:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:40:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:40:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:40:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:40:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:40:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.427879791999999, 2024-04-25T22:40:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:40:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:40:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:40:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:40:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:40:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:40:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:40:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:40:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:40:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:40:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:40:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:40:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:40:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:40:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:40:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:40:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:40:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:40:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:40:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:40:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:40:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:40:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:40:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:40:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:40:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:40:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:40:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:40:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:40:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:40:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.427816142000001, 2024-04-25T22:40:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:40:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:40:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:40:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:40:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:40:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:40:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:40:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:40:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:40:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:40:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:40:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:40:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:40:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:40:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:40:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:40:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:40:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:40:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:40:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:40:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:40:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:40:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:40:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.420812611999999, 2024-04-25T22:40:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:40:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:40:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:40:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:40:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:40:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:40:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:40:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:40:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:40:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:40:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:40:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:40:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:40:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:40:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:40:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:40:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:40:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:40:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:40:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:38.143 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:40:38.143 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:38.024+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:38.144 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:40:38.158 INFO:teuthology.run_tasks:Running task workunit... 2024-04-25T22:40:38.170 INFO:tasks.workunit:Pulling workunits from ref b22e2ebdeb24376882b7bda2a7329c8cccc2276a 2024-04-25T22:40:38.171 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T22:40:38.171 INFO:tasks.workunit:timeout=3h 2024-04-25T22:40:38.171 INFO:tasks.workunit:cleanup=True 2024-04-25T22:40:38.171 DEBUG:teuthology.orchestra.run.smithi057:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T22:40:38.188 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:38.187+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:38.205 INFO:teuthology.orchestra.run.smithi057.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-25T22:40:38.205 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-25T22:40:38.205 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-04-25T22:40:38.205 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:40:38.205 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-25T22:40:38.205 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-25 22:40:14.586636756 +0000 2024-04-25T22:40:38.205 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-25 22:40:38.157121064 +0000 2024-04-25T22:40:38.205 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-04-25T22:40:38.205 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-25T22:40:38.205 DEBUG:teuthology.orchestra.run.smithi057:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-25T22:40:38.246 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:38.247+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:38.268 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b22e2ebdeb24376882b7bda2a7329c8cccc2276a 2024-04-25T22:40:38.274 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:40:38.275 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:40:38.275 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-04-25T22:40:38.275 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:40:38.289 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:40:38.315 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is set 2024-04-25T22:40:38.322 INFO:tasks.workunit.client.0.smithi057.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T22:40:38.347 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:38.343+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:38.412 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:40:38.412 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:40:38.412 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-04-25T22:40:38.412 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-04-25T22:40:38.412 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:40:38.427 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:40:38.448 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:38.446+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:38.547 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:40:38.548 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-04-25T22:40:38.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-04-25T22:40:38.548 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-04-25T22:40:38.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.548 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:111 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'73, mlcod=11'69)", 2024-04-25T22:40:38.548 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:40:38.548 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.846569277, 2024-04-25T22:40:38.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055481899999999997, 2024-04-25T22:40:38.549 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:38.549 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:38.549 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.549 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:38.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:38.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:40:38.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:38.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:40:38.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:38.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700271+0000", 2024-04-25T22:40:38.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:40:38.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:38.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700278+0000", 2024-04-25T22:40:38.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-04-25T22:40:38.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:38.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700323+0000", 2024-04-25T22:40:38.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4212999999999998e-05 2024-04-25T22:40:38.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700333+0000", 2024-04-25T22:40:38.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0433e-05 2024-04-25T22:40:38.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:38.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700662+0000", 2024-04-25T22:40:38.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032862800000000003 2024-04-25T22:40:38.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:38.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700692+0000", 2024-04-25T22:40:38.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0395999999999998e-05 2024-04-25T22:40:38.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:38.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705728+0000", 2024-04-25T22:40:38.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050361939999999999 2024-04-25T22:40:38.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:38.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705818+0000", 2024-04-25T22:40:38.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9573000000000005e-05 2024-04-25T22:40:38.554 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.554 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.555 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.555 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-25T22:40:38.555 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:40:38.555 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.846024425000003, 2024-04-25T22:40:38.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005065501, 2024-04-25T22:40:38.555 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:38.555 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:38.556 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.556 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:38.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:38.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:40:38.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:38.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:40:38.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:38.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700816+0000", 2024-04-25T22:40:38.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.24e-06 2024-04-25T22:40:38.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:38.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700914+0000", 2024-04-25T22:40:38.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8057e-05 2024-04-25T22:40:38.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:38.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700931+0000", 2024-04-25T22:40:38.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7745999999999999e-05 2024-04-25T22:40:38.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700941+0000", 2024-04-25T22:40:38.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5699999999999999e-06 2024-04-25T22:40:38.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:38.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701162+0000", 2024-04-25T22:40:38.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000221392 2024-04-25T22:40:38.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:38.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701194+0000", 2024-04-25T22:40:38.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1745999999999997e-05 2024-04-25T22:40:38.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:38.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705821+0000", 2024-04-25T22:40:38.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046269869999999999 2024-04-25T22:40:38.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:38.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705880+0000", 2024-04-25T22:40:38.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8763e-05 2024-04-25T22:40:38.561 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.561 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.561 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.561 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:118 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'80, mlcod=11'78)", 2024-04-25T22:40:38.562 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:40:38.562 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.838668814999998, 2024-04-25T22:40:38.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047806089999999999, 2024-04-25T22:40:38.562 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:38.562 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:38.562 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.562 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:38.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:38.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:40:38.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:38.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:40:38.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:38.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708172+0000", 2024-04-25T22:40:38.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0600000000000002e-06 2024-04-25T22:40:38.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:38.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708291+0000", 2024-04-25T22:40:38.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118892 2024-04-25T22:40:38.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:38.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708320+0000", 2024-04-25T22:40:38.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8822999999999998e-05 2024-04-25T22:40:38.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708337+0000", 2024-04-25T22:40:38.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7586999999999999e-05 2024-04-25T22:40:38.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:38.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708512+0000", 2024-04-25T22:40:38.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017439500000000001 2024-04-25T22:40:38.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:38.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708551+0000", 2024-04-25T22:40:38.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.909e-05 2024-04-25T22:40:38.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:38.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712865+0000", 2024-04-25T22:40:38.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043142069999999996 2024-04-25T22:40:38.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:38.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712951+0000", 2024-04-25T22:40:38.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5555000000000003e-05 2024-04-25T22:40:38.567 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.568 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.568 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.568 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:120 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'82, mlcod=11'78)", 2024-04-25T22:40:38.568 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:40:38.568 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.837662772999998, 2024-04-25T22:40:38.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047170700000000003, 2024-04-25T22:40:38.569 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:38.569 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:38.569 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.569 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:38.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:38.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:40:38.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:38.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:40:38.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:38.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709177+0000", 2024-04-25T22:40:38.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.19e-06 2024-04-25T22:40:38.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:38.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709315+0000", 2024-04-25T22:40:38.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000137429 2024-04-25T22:40:38.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:38.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709341+0000", 2024-04-25T22:40:38.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:40:38.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709353+0000", 2024-04-25T22:40:38.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2027e-05 2024-04-25T22:40:38.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:38.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710040+0000", 2024-04-25T22:40:38.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068710799999999997 2024-04-25T22:40:38.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:38.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710076+0000", 2024-04-25T22:40:38.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5982999999999998e-05 2024-04-25T22:40:38.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:38.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713802+0000", 2024-04-25T22:40:38.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037255750000000001 2024-04-25T22:40:38.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:38.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713893+0000", 2024-04-25T22:40:38.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1201999999999999e-05 2024-04-25T22:40:38.573 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.573 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.574 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.574 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:121 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'83, mlcod=11'78)", 2024-04-25T22:40:38.574 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:40:38.574 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.837116137000002, 2024-04-25T22:40:38.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0049043919999999996, 2024-04-25T22:40:38.574 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:38.574 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:38.574 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.574 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:38.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:38.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:40:38.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:38.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:40:38.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:38.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709724+0000", 2024-04-25T22:40:38.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.483e-06 2024-04-25T22:40:38.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:38.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709872+0000", 2024-04-25T22:40:38.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147446 2024-04-25T22:40:38.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:38.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709891+0000", 2024-04-25T22:40:38.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9245999999999998e-05 2024-04-25T22:40:38.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709900+0000", 2024-04-25T22:40:38.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1439999999999992e-06 2024-04-25T22:40:38.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:38.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713091+0000", 2024-04-25T22:40:38.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031910710000000002 2024-04-25T22:40:38.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:38.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713122+0000", 2024-04-25T22:40:38.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.048e-05 2024-04-25T22:40:38.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:38.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714538+0000", 2024-04-25T22:40:38.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014160030000000001 2024-04-25T22:40:38.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:38.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714627+0000", 2024-04-25T22:40:38.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518999999999995e-05 2024-04-25T22:40:38.578 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.578 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.578 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.579 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.579 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:40:38.579 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.946726757, 2024-04-25T22:40:38.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022089675999999999, 2024-04-25T22:40:38.579 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:38.579 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:38.579 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.579 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:38.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:38.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:40:38.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:38.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:40:38.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:38.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600120+0000", 2024-04-25T22:40:38.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1259999999999998e-06 2024-04-25T22:40:38.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:38.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600153+0000", 2024-04-25T22:40:38.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3186999999999999e-05 2024-04-25T22:40:38.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:38.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600181+0000", 2024-04-25T22:40:38.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7676000000000001e-05 2024-04-25T22:40:38.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600205+0000", 2024-04-25T22:40:38.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:40:38.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:38.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600467+0000", 2024-04-25T22:40:38.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026186800000000001 2024-04-25T22:40:38.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:38.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600809+0000", 2024-04-25T22:40:38.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034138400000000002 2024-04-25T22:40:38.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:38.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.601892+0000", 2024-04-25T22:40:38.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010831910000000001 2024-04-25T22:40:38.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:38.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611054+0000", 2024-04-25T22:40:38.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0091620940000000008 2024-04-25T22:40:38.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621965+0000", 2024-04-25T22:40:38.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010911044999999999 2024-04-25T22:40:38.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:38.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622090+0000", 2024-04-25T22:40:38.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012522 2024-04-25T22:40:38.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:38.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622202+0000", 2024-04-25T22:40:38.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011164500000000001 2024-04-25T22:40:38.585 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.585 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.585 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.585 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.585 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:40:38.585 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.946583702000002, 2024-04-25T22:40:38.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035756228000000001, 2024-04-25T22:40:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:40:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:40:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600257+0000", 2024-04-25T22:40:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8300000000000001e-06 2024-04-25T22:40:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600267+0000", 2024-04-25T22:40:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6539999999999994e-06 2024-04-25T22:40:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600293+0000", 2024-04-25T22:40:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5996e-05 2024-04-25T22:40:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600309+0000", 2024-04-25T22:40:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6206e-05 2024-04-25T22:40:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603757+0000", 2024-04-25T22:40:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003448244 2024-04-25T22:40:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604779+0000", 2024-04-25T22:40:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010216820000000001 2024-04-25T22:40:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605127+0000", 2024-04-25T22:40:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034820100000000002 2024-04-25T22:40:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611082+0000", 2024-04-25T22:40:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0059550640000000004 2024-04-25T22:40:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635779+0000", 2024-04-25T22:40:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024696665999999999 2024-04-25T22:40:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635915+0000", 2024-04-25T22:40:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000135809 2024-04-25T22:40:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636011+0000", 2024-04-25T22:40:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6875999999999999e-05 2024-04-25T22:40:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:40:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.946506489000001, 2024-04-25T22:40:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035327031000000002, 2024-04-25T22:40:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:40:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:40:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600334+0000", 2024-04-25T22:40:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:40:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600347+0000", 2024-04-25T22:40:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3593e-05 2024-04-25T22:40:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600371+0000", 2024-04-25T22:40:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.313e-05 2024-04-25T22:40:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600390+0000", 2024-04-25T22:40:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.908e-05 2024-04-25T22:40:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602756+0000", 2024-04-25T22:40:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023662560000000002 2024-04-25T22:40:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603021+0000", 2024-04-25T22:40:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026546399999999998 2024-04-25T22:40:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603304+0000", 2024-04-25T22:40:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028308800000000002 2024-04-25T22:40:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611075+0000", 2024-04-25T22:40:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077703900000000003 2024-04-25T22:40:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635414+0000", 2024-04-25T22:40:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024339326000000001 2024-04-25T22:40:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635544+0000", 2024-04-25T22:40:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012948199999999999 2024-04-25T22:40:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635659+0000", 2024-04-25T22:40:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000115809 2024-04-25T22:40:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:40:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.946346563999999, 2024-04-25T22:40:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035594492999999998, 2024-04-25T22:40:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:40:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:40:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600494+0000", 2024-04-25T22:40:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:40:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600502+0000", 2024-04-25T22:40:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3769999999999996e-06 2024-04-25T22:40:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600522+0000", 2024-04-25T22:40:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9919999999999999e-05 2024-04-25T22:40:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600539+0000", 2024-04-25T22:40:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.649e-05 2024-04-25T22:40:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604846+0000", 2024-04-25T22:40:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043075199999999996 2024-04-25T22:40:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605057+0000", 2024-04-25T22:40:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00021085200000000001 2024-04-25T22:40:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605378+0000", 2024-04-25T22:40:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032074799999999999 2024-04-25T22:40:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611089+0000", 2024-04-25T22:40:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057110249999999998 2024-04-25T22:40:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635844+0000", 2024-04-25T22:40:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024755355999999999 2024-04-25T22:40:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635986+0000", 2024-04-25T22:40:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141512 2024-04-25T22:40:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636087+0000", 2024-04-25T22:40:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101183 2024-04-25T22:40:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:40:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.946273953999999, 2024-04-25T22:40:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021266723000000001, 2024-04-25T22:40:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:40:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:40:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600566+0000", 2024-04-25T22:40:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4959999999999999e-06 2024-04-25T22:40:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600574+0000", 2024-04-25T22:40:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-06 2024-04-25T22:40:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600592+0000", 2024-04-25T22:40:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8479999999999999e-05 2024-04-25T22:40:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600610+0000", 2024-04-25T22:40:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7567e-05 2024-04-25T22:40:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602679+0000", 2024-04-25T22:40:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020692739999999999 2024-04-25T22:40:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602945+0000", 2024-04-25T22:40:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026640399999999998 2024-04-25T22:40:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603115+0000", 2024-04-25T22:40:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000169996 2024-04-25T22:40:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608398+0000", 2024-04-25T22:40:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052826289999999996 2024-04-25T22:40:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621588+0000", 2024-04-25T22:40:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013190489 2024-04-25T22:40:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621733+0000", 2024-04-25T22:40:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014462500000000001 2024-04-25T22:40:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621832+0000", 2024-04-25T22:40:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8603000000000004e-05 2024-04-25T22:40:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:40:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.946206228000001, 2024-04-25T22:40:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034747924999999999, 2024-04-25T22:40:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:40:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:40:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600634+0000", 2024-04-25T22:40:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-04-25T22:40:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600642+0000", 2024-04-25T22:40:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8169999999999999e-06 2024-04-25T22:40:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600660+0000", 2024-04-25T22:40:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8513e-05 2024-04-25T22:40:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600676+0000", 2024-04-25T22:40:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6019999999999999e-05 2024-04-25T22:40:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603748+0000", 2024-04-25T22:40:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030718329999999999 2024-04-25T22:40:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604752+0000", 2024-04-25T22:40:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001003603 2024-04-25T22:40:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605117+0000", 2024-04-25T22:40:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00036539 2024-04-25T22:40:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608459+0000", 2024-04-25T22:40:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033413879999999998 2024-04-25T22:40:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635106+0000", 2024-04-25T22:40:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026647607 2024-04-25T22:40:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635273+0000", 2024-04-25T22:40:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000166689 2024-04-25T22:40:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635381+0000", 2024-04-25T22:40:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107642 2024-04-25T22:40:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:40:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.946142998999999, 2024-04-25T22:40:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040419292000000002, 2024-04-25T22:40:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:40:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:40:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600697+0000", 2024-04-25T22:40:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1999999999999999e-06 2024-04-25T22:40:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600704+0000", 2024-04-25T22:40:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5570000000000001e-06 2024-04-25T22:40:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600724+0000", 2024-04-25T22:40:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0023000000000001e-05 2024-04-25T22:40:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600738+0000", 2024-04-25T22:40:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4372999999999999e-05 2024-04-25T22:40:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.612532+0000", 2024-04-25T22:40:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011793606 2024-04-25T22:40:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613354+0000", 2024-04-25T22:40:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00082244100000000004 2024-04-25T22:40:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613726+0000", 2024-04-25T22:40:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00037226000000000002 2024-04-25T22:40:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618891+0000", 2024-04-25T22:40:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051649199999999999 2024-04-25T22:40:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.640874+0000", 2024-04-25T22:40:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021982640000000001 2024-04-25T22:40:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641019+0000", 2024-04-25T22:40:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000145339 2024-04-25T22:40:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641115+0000", 2024-04-25T22:40:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5933000000000005e-05 2024-04-25T22:40:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:40:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.946056969000001, 2024-04-25T22:40:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036502711, 2024-04-25T22:40:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:40:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:40:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:40:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600783+0000", 2024-04-25T22:40:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.533e-06 2024-04-25T22:40:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600790+0000", 2024-04-25T22:40:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0439999999999998e-06 2024-04-25T22:40:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600811+0000", 2024-04-25T22:40:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0449e-05 2024-04-25T22:40:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600825+0000", 2024-04-25T22:40:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4293e-05 2024-04-25T22:40:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602304+0000", 2024-04-25T22:40:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001478629 2024-04-25T22:40:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602587+0000", 2024-04-25T22:40:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028350800000000002 2024-04-25T22:40:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.637285+0000", 2024-04-25T22:40:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034697255000000003 2024-04-25T22:40:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:40:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.945991403000001, 2024-04-25T22:40:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017311460000000001, 2024-04-25T22:40:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:40:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:40:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:40:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600849+0000", 2024-04-25T22:40:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2899999999999999e-06 2024-04-25T22:40:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600866+0000", 2024-04-25T22:40:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6793e-05 2024-04-25T22:40:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600886+0000", 2024-04-25T22:40:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0772999999999999e-05 2024-04-25T22:40:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600904+0000", 2024-04-25T22:40:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7697e-05 2024-04-25T22:40:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602796+0000", 2024-04-25T22:40:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018920149999999999 2024-04-25T22:40:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602962+0000", 2024-04-25T22:40:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016590600000000001 2024-04-25T22:40:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618159+0000", 2024-04-25T22:40:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015196985999999999 2024-04-25T22:40:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:40:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.931115662, 2024-04-25T22:40:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006380269, 2024-04-25T22:40:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:40:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:40:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615724+0000", 2024-04-25T22:40:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.094e-06 2024-04-25T22:40:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615734+0000", 2024-04-25T22:40:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.363e-06 2024-04-25T22:40:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615751+0000", 2024-04-25T22:40:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:40:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615773+0000", 2024-04-25T22:40:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.154e-05 2024-04-25T22:40:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616485+0000", 2024-04-25T22:40:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00071225100000000001 2024-04-25T22:40:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616528+0000", 2024-04-25T22:40:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3606000000000002e-05 2024-04-25T22:40:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622030+0000", 2024-04-25T22:40:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055010750000000002 2024-04-25T22:40:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622103+0000", 2024-04-25T22:40:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3930000000000005e-05 2024-04-25T22:40:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:40:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:40:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.930202725000001, 2024-04-25T22:40:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046420649999999999, 2024-04-25T22:40:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-04-25T22:40:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:40:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:40:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616637+0000", 2024-04-25T22:40:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0299999999999998e-07 2024-04-25T22:40:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616653+0000", 2024-04-25T22:40:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5843000000000001e-05 2024-04-25T22:40:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616690+0000", 2024-04-25T22:40:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7466999999999999e-05 2024-04-25T22:40:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616729+0000", 2024-04-25T22:40:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8810000000000003e-05 2024-04-25T22:40:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617251+0000", 2024-04-25T22:40:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00052143899999999995 2024-04-25T22:40:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621278+0000", 2024-04-25T22:40:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040277029999999997 2024-04-25T22:40:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:40:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.929179373, 2024-04-25T22:40:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0065101730000000002, 2024-04-25T22:40:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:40:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:40:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617661+0000", 2024-04-25T22:40:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:40:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617688+0000", 2024-04-25T22:40:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7589e-05 2024-04-25T22:40:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617710+0000", 2024-04-25T22:40:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1467e-05 2024-04-25T22:40:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617727+0000", 2024-04-25T22:40:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6990000000000002e-05 2024-04-25T22:40:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618559+0000", 2024-04-25T22:40:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083207400000000003 2024-04-25T22:40:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618608+0000", 2024-04-25T22:40:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8936e-05 2024-04-25T22:40:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624077+0000", 2024-04-25T22:40:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054695840000000004 2024-04-25T22:40:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624170+0000", 2024-04-25T22:40:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2305999999999993e-05 2024-04-25T22:40:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:40:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.924077865000001, 2024-04-25T22:40:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006879446, 2024-04-25T22:40:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:40:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:40:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622762+0000", 2024-04-25T22:40:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:40:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622781+0000", 2024-04-25T22:40:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8749999999999998e-05 2024-04-25T22:40:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622802+0000", 2024-04-25T22:40:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1650000000000001e-05 2024-04-25T22:40:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622816+0000", 2024-04-25T22:40:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3556e-05 2024-04-25T22:40:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623700+0000", 2024-04-25T22:40:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00088389299999999996 2024-04-25T22:40:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623741+0000", 2024-04-25T22:40:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1023999999999999e-05 2024-04-25T22:40:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629543+0000", 2024-04-25T22:40:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058023980000000003 2024-04-25T22:40:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629640+0000", 2024-04-25T22:40:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7381999999999997e-05 2024-04-25T22:40:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:40:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.923816661, 2024-04-25T22:40:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067054879999999999, 2024-04-25T22:40:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:40:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:40:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623032+0000", 2024-04-25T22:40:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.9930000000000007e-06 2024-04-25T22:40:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623043+0000", 2024-04-25T22:40:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0387000000000001e-05 2024-04-25T22:40:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623064+0000", 2024-04-25T22:40:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1849999999999999e-05 2024-04-25T22:40:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623079+0000", 2024-04-25T22:40:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4093e-05 2024-04-25T22:40:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624384+0000", 2024-04-25T22:40:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013054539999999999 2024-04-25T22:40:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624421+0000", 2024-04-25T22:40:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7088999999999997e-05 2024-04-25T22:40:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629645+0000", 2024-04-25T22:40:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052241400000000004 2024-04-25T22:40:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629728+0000", 2024-04-25T22:40:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2482000000000001e-05 2024-04-25T22:40:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2024-04-25T22:40:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:40:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.923733548000001, 2024-04-25T22:40:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078029559999999998, 2024-04-25T22:40:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:40:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:40:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623106+0000", 2024-04-25T22:40:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.64e-07 2024-04-25T22:40:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623141+0000", 2024-04-25T22:40:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4678999999999998e-05 2024-04-25T22:40:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623153+0000", 2024-04-25T22:40:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1759999999999999e-05 2024-04-25T22:40:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623161+0000", 2024-04-25T22:40:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8299999999999996e-06 2024-04-25T22:40:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623834+0000", 2024-04-25T22:40:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067394500000000001 2024-04-25T22:40:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623883+0000", 2024-04-25T22:40:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8640000000000002e-05 2024-04-25T22:40:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630807+0000", 2024-04-25T22:40:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069238859999999998 2024-04-25T22:40:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630908+0000", 2024-04-25T22:40:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101252 2024-04-25T22:40:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:38.669 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:40:38.671 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:40:38.671 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:38.670+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:38.772 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:38.771+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:38.805 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:38.805 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:38.805 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:40:38.805 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:38.819 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:40:38.872 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:38.870+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:38.935 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:38.935 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:38.935 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:40:38.935 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:40:38.935 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:38.949 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:40:38.973 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:38.973+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:39.074 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:39.074+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:39.113 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:39.113 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:40:39.113 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:40:39.113 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:40:39.113 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.113 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:39.113 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:39.113 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.515910772000002, 2024-04-25T22:40:39.113 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:40:39.113 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:39.113 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:39.114 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:39.114 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:39.114 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.114 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:39.114 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:39.114 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.114 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.114 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.114 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:39.114 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:39.114 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.114 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.114 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.114 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:39.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:40:39.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:40:39.115 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.115 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:39.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:40:39.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:40:39.115 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.115 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:39.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:40:39.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:40:39.115 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:39.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:40:39.116 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:40:39.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:40:39.116 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:40:39.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:39.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:40:39.116 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:40:39.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:40:39.117 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:40:39.117 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:39.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:40:39.117 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:40:39.117 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:39.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:40:39.117 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:40:39.118 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.118 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.118 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:39.118 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:40:39.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:40:39.118 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.118 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.118 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:39.118 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:40:39.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:40:39.118 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.118 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.118 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:39.118 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:40:39.119 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:40:39.119 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.119 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.119 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:39.119 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:40:39.119 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:40:39.119 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.119 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.119 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.119 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.119 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.119 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:39.119 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:39.119 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.515773515999999, 2024-04-25T22:40:39.120 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:40:39.120 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:39.120 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:39.120 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:39.120 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:39.120 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.120 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:39.120 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:39.120 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.120 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.120 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.120 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:39.120 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:39.120 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.120 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:39.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:40:39.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:40:39.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:39.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:40:39.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:40:39.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:39.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:40:39.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:40:39.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:39.122 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:40:39.122 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:40:39.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.122 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:40:39.122 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:40:39.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:39.122 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:40:39.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:40:39.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.123 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.123 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:40:39.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:40:39.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.123 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:39.123 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:40:39.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:40:39.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.123 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:39.123 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:40:39.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:40:39.124 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:39.124 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:40:39.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:40:39.124 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:39.124 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:40:39.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:40:39.124 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:39.124 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:40:39.125 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:40:39.125 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.125 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.125 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:39.125 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:40:39.125 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:40:39.125 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.125 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.125 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.125 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.125 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.125 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:39.125 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:39.125 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.515685963999999, 2024-04-25T22:40:39.125 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:40:39.126 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:39.126 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:39.126 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:39.126 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:39.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.126 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:39.126 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:39.126 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.126 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.126 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:39.126 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:39.126 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.126 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:39.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:40:39.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:40:39.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:39.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:40:39.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:40:39.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:39.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:40:39.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:40:39.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:39.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:40:39.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:40:39.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:40:39.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:40:39.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:39.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:40:39.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:40:39.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.129 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.129 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:40:39.129 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:40:39.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.129 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:39.129 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:40:39.129 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:40:39.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.129 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:39.129 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:40:39.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:40:39.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:39.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:40:39.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:40:39.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:39.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:40:39.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:40:39.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:39.131 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:40:39.131 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:40:39.131 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.131 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:39.131 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:40:39.131 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:40:39.131 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.131 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.131 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.131 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.131 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:39.131 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:39.131 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.515582137999999, 2024-04-25T22:40:39.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:40:39.132 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:39.132 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:39.132 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:39.132 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:39.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:39.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:39.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:39.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:39.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:39.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:40:39.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:40:39.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:39.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:40:39.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:40:39.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:39.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:40:39.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:40:39.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:39.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:40:39.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:40:39.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:40:39.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:40:39.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:39.135 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:40:39.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:40:39.135 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.135 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.135 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.135 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:40:39.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:40:39.135 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.135 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.135 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:39.135 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:40:39.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:40:39.135 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.135 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.136 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:39.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:40:39.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:40:39.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.136 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:39.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:40:39.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:40:39.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.136 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:39.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:40:39.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:40:39.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.137 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:39.137 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:40:39.137 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:40:39.137 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.137 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.137 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:39.137 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:40:39.137 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:40:39.137 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.137 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.137 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.137 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.137 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.137 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:39.138 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:39.138 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.515513347999999, 2024-04-25T22:40:39.138 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:40:39.138 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:39.138 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:39.138 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:39.138 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:39.138 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.138 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:39.138 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:39.138 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.138 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.138 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.138 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:39.139 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:39.139 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.139 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.139 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.139 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:39.139 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:40:39.139 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:40:39.139 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.139 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.139 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:39.139 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:40:39.139 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:40:39.139 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.139 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.139 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:39.140 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:40:39.140 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:40:39.140 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.140 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.140 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:39.140 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:40:39.140 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:40:39.140 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.140 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.140 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.140 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:40:39.140 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:40:39.140 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.140 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.140 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:39.141 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:40:39.141 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:40:39.141 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.141 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.141 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.141 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:40:39.141 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:40:39.141 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.141 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.141 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:39.141 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:40:39.141 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:40:39.141 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.141 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.142 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:39.142 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:40:39.142 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:40:39.142 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.142 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.142 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:39.142 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:40:39.142 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:40:39.142 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.142 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.142 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:39.142 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:40:39.142 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:40:39.142 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.143 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.143 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:39.143 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:40:39.143 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:40:39.143 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.143 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.143 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:39.143 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:40:39.143 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:40:39.143 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.143 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.143 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.143 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.144 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.144 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:39.144 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:39.144 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.515444261999999, 2024-04-25T22:40:39.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:40:39.144 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:39.144 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:39.144 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:39.144 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:39.144 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.144 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:39.144 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:39.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.144 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.144 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:39.145 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:39.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:39.145 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:40:39.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:40:39.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:39.145 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:40:39.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:40:39.146 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.146 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.146 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:39.146 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:40:39.146 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:40:39.146 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.146 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.146 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:39.146 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:40:39.146 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:40:39.146 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.146 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.146 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.146 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:40:39.147 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:40:39.147 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.147 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.147 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:39.147 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:40:39.147 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:40:39.147 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.147 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.147 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.147 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:40:39.147 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:40:39.147 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.147 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.147 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:39.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:40:39.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:40:39.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:39.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:40:39.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:40:39.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:39.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:40:39.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:40:39.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:39.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:40:39.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:40:39.149 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.149 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:39.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:40:39.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:40:39.149 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.149 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:39.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:40:39.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:40:39.149 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.149 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.149 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.150 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.150 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.150 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:39.150 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:39.150 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.515348149000001, 2024-04-25T22:40:39.150 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:40:39.150 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:39.150 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:39.150 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:39.150 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:39.150 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.150 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:39.150 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:39.150 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.151 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.151 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.151 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:39.151 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:39.151 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.151 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.151 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.151 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:39.151 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:40:39.152 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:40:39.152 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.152 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.152 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:39.152 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:40:39.152 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:40:39.152 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.152 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.152 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:39.152 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:40:39.152 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:40:39.152 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.152 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.152 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:39.152 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:40:39.153 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:40:39.153 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.153 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.153 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.153 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:40:39.153 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:40:39.153 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.153 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.153 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:39.153 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:40:39.153 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:40:39.153 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.153 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.153 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:40:39.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:40:39.154 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:39.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:40:39.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:40:39.154 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:39.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:40:39.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:40:39.154 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.155 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.155 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.155 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.155 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.155 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:39.155 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:39.155 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.515282487, 2024-04-25T22:40:39.155 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:40:39.155 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:39.155 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:39.155 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:39.155 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:39.155 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.155 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:39.155 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:39.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:39.156 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:39.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:39.156 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:40:39.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:40:39.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:39.156 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:40:39.157 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:40:39.157 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.157 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.157 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:39.157 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:40:39.157 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:40:39.157 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.157 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.157 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:39.157 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:40:39.157 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:40:39.157 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.157 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.157 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.158 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:40:39.158 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:40:39.158 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.158 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.158 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:39.158 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:40:39.158 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:40:39.158 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.158 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.158 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.158 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:40:39.158 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:40:39.158 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.158 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.158 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:39.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:40:39.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:40:39.159 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:39.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:40:39.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:40:39.159 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.159 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.159 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.159 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.159 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:39.159 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:39.160 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.515213360000001, 2024-04-25T22:40:39.160 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:40:39.160 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:39.160 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:39.160 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:39.160 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:39.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.160 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:39.160 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:39.160 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.160 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:39.160 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:39.160 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:39.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:40:39.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:40:39.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:39.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:40:39.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:40:39.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:39.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:40:39.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:40:39.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:39.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:40:39.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:40:39.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:40:39.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:40:39.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:39.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:40:39.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:40:39.163 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.163 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.163 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:40:39.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:40:39.163 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.163 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:39.163 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:40:39.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:40:39.163 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.163 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:39.163 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:40:39.164 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:40:39.164 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.164 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.164 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.164 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.164 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:40:39.164 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:39.164 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.504396704000001, 2024-04-25T22:40:39.164 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:40:39.164 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:39.164 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:39.164 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:39.164 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:39.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.164 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:39.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:39.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:39.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:39.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:39.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:40:39.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:40:39.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:39.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:40:39.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:40:39.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:39.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:40:39.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:40:39.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:39.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:40:39.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:40:39.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.167 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.167 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:40:39.167 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:40:39.167 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.167 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:39.167 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:40:39.167 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:40:39.167 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.167 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.167 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.167 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.167 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:39.167 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:39.168 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.487498350999999, 2024-04-25T22:40:39.168 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:40:39.168 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:39.168 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:39.168 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:39.168 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:39.168 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.168 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:39.168 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:39.168 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.168 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.168 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.168 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:39.168 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:39.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:39.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:39.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:40:39.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:39.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:40:39.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:40:39.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:39.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:40:39.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:40:39.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:39.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:40:39.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:40:39.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:40:39.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:40:39.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:39.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:40:39.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:40:39.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:39.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:40:39.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:40:39.171 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.171 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.171 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.171 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:39.172 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:39.172 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.486677460999999, 2024-04-25T22:40:39.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:40:39.172 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:39.172 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:39.172 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:39.172 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:39.172 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.172 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:39.172 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:39.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.172 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.172 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.172 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:39.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:39.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:39.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:40:39.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:40:39.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:39.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:40:39.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:40:39.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:39.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:40:39.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:40:39.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:39.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:40:39.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:40:39.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:40:39.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:40:39.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:39.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:40:39.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:40:39.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:39.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:40:39.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:40:39.175 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.175 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.175 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.175 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:39.175 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:39.175 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.484976733, 2024-04-25T22:40:39.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:40:39.176 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:39.176 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:39.176 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:39.176 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:39.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:39.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:39.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:39.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:39.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:39.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:40:39.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:40:39.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:39.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:40:39.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:40:39.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:39.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:40:39.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:40:39.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:39.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:40:39.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:40:39.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:40:39.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:40:39.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:39.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:40:39.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:40:39.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:39.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:40:39.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:40:39.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:39.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:40:39.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:40:39.179 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.179 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.179 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.180 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:39.180 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:39.180 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.484380057999999, 2024-04-25T22:40:39.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:40:39.180 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:39.180 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:39.180 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:39.180 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:39.180 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.180 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:39.180 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:39.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.180 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.180 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:39.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:39.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:39.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:40:39.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:40:39.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:39.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:40:39.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:40:39.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:39.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:40:39.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:40:39.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:39.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:40:39.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:40:39.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:40:39.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:40:39.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:39.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:40:39.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:40:39.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:39.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:40:39.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:40:39.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:39.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:40:39.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:40:39.184 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.184 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.184 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.184 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e18/16 ondisk, result = 0)", 2024-04-25T22:40:39.184 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636530+0000", 2024-04-25T22:40:39.184 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.474994832, 2024-04-25T22:40:39.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086108500000000004, 2024-04-25T22:40:39.184 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:39.184 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:39.184 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:39.184 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:39.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:39.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636530+0000", 2024-04-25T22:40:39.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:39.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636530+0000", 2024-04-25T22:40:39.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:39.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636531+0000", 2024-04-25T22:40:39.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:40:39.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:39.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636535+0000", 2024-04-25T22:40:39.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3579999999999996e-06 2024-04-25T22:40:39.186 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:39.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636555+0000", 2024-04-25T22:40:39.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9647999999999999e-05 2024-04-25T22:40:39.186 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:39.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636565+0000", 2024-04-25T22:40:39.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0231000000000001e-05 2024-04-25T22:40:39.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637201+0000", 2024-04-25T22:40:39.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00063605599999999997 2024-04-25T22:40:39.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:39.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637219+0000", 2024-04-25T22:40:39.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8159e-05 2024-04-25T22:40:39.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:39.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637391+0000", 2024-04-25T22:40:39.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017191299999999999 2024-04-25T22:40:39.188 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.188 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.188 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.188 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.188 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.188 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:40:39.188 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:39.188 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.474944332, 2024-04-25T22:40:39.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:40:39.188 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:39.188 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:39.188 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:39.188 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:39.188 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:39.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:39.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:39.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:39.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:39.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:39.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:40:39.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:39.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:40:39.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:40:39.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:39.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:40:39.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:40:39.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:39.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:40:39.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:40:39.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:40:39.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:40:39.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:39.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:40:39.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:40:39.191 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.191 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.191 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.192 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:39.192 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:39.192 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.474296905999999, 2024-04-25T22:40:39.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:40:39.192 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:39.192 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:39.192 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:39.192 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:39.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:39.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:39.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.193 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:39.193 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:39.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.193 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.193 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:39.193 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:40:39.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:40:39.193 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.193 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:39.193 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:40:39.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:40:39.193 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:39.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:40:39.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:40:39.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:39.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:40:39.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:40:39.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:40:39.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:40:39.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:39.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:40:39.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:40:39.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:39.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:40:39.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:40:39.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:39.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:40:39.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:40:39.196 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.196 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.196 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.196 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:39.196 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:39.196 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.472856087, 2024-04-25T22:40:39.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:40:39.196 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:39.196 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:39.196 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:39.196 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:39.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:39.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:39.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:39.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:39.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:39.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:40:39.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:40:39.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:39.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:40:39.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:40:39.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:39.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:40:39.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:40:39.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:39.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:40:39.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:40:39.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:40:39.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:40:39.199 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:39.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:40:39.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:40:39.199 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:39.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:40:39.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:40:39.199 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:39.200 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:40:39.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:40:39.200 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.200 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.200 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.200 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:40:39.200 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:39.200 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.520417643000002, 2024-04-25T22:40:39.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:40:39.200 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:39.201 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:39.201 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:39.201 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:39.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:39.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:39.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:39.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:39.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:39.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:40:39.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:40:39.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:39.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:40:39.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:40:39.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:39.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:40:39.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:40:39.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:39.203 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:40:39.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:40:39.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.203 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:40:39.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:40:39.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:39.203 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:40:39.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:40:39.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:39.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:40:39.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:40:39.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:39.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:40:39.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:40:39.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:39.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:40:39.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:40:39.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:39.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:40:39.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:40:39.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:39.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:40:39.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:40:39.205 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.205 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.205 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.205 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:40:39.205 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:39.206 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.51775831900000002, 2024-04-25T22:40:39.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:40:39.206 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:39.206 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:39.206 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:39.206 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:39.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:39.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:39.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.206 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:39.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:39.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:39.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.207 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:39.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:40:39.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:40:39.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.207 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:39.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:40:39.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:40:39.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.207 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:39.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:40:39.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:40:39.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.208 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:39.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:40:39.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:40:39.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.208 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:39.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:40:39.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:40:39.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.208 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:39.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:40:39.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:40:39.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:39.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:40:39.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:40:39.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:39.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:40:39.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:40:39.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:39.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:40:39.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:40:39.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:39.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:40:39.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:40:39.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:39.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:39.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:39.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:40:39.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:40:39.210 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.210 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.210 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.211 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:39.211 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:39.211 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:39.211 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:40:39.212 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:39.211+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:39.213 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:40:39.313 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:39.314+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:39.345 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:40:39.345 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:40:39.345 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:40:39.345 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:40:39.359 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:40:39.370 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:40:39.370 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:40:39.391 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:40:39.391 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:40:39.412 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:40:39.412 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:40:39.413 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:39.411+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:39.483 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:39.483 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:39.497 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:40:39.515 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:39.514+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:39.616 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:39.617+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:39.660 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:39.660 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:39.674 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:40:39.717 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:39.718+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:39.804 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:39.804 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:39.818 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:39.818+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:39.820 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:40:39.918 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:39.918+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:39.945 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:39.945 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:39.960 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:40:40.019 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:40.018+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:40.076 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:40.076 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:40.090 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:40:40.120 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:40.117+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:40.221 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:40.221 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:40.221 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:40.222+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:40.235 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:40:40.284 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:40:40.284 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T22:40:40.325 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:40.326+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:40.342 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:40:40.398 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:40.398 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:40.412 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:40:40.422 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:40.419+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:40.523 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:40.523+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:40.577 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:40.577 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:40.593 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:40:40.624 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:40.624+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:40.723 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:40.723 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:40.725 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:40.723+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:40.737 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:40:40.825 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:40.826+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:40.902 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:40.902 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:40.918 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:40:40.964 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:40.963+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:41.028 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:41.027+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:41.043 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:41.043 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:41.058 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:40:41.129 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:41.127+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:41.190 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:41.191 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:41.204 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:40:41.250 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:41.252+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:41.327 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:41.327 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:41.330 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:41.331+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:41.341 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:40:41.343 INFO:teuthology.orchestra.run.smithi057.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T22:40:41.357 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is unset 2024-04-25T22:40:41.372 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T22:40:41.430 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:41.431+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:41.432 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:40:41.505 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:41.506 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:41.520 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:40:41.532 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:41.532+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:41.578 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:40:41.578 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:40:41.599 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:40:41.599 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:40:41.617 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:40:41.617 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:40:41.632 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:41.630+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:41.651 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:41.651 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:41.651 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:40:41.651 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:41.665 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:40:41.735 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:41.731+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:41.836 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:41.836 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:41.836 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:40:41.836 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:40:41.837 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:41.837 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:41.835+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:41.851 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:40:41.937 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:41.938+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:41.975 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:41.975 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:40:41.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:40:41.975 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:40:41.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.975 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.378090110999999, 2024-04-25T22:40:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:40:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:40:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:40:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:40:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:40:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:40:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:40:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:40:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:40:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:40:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:40:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:40:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:40:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:40:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:40:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:40:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:40:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:40:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:40:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:40:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:40:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:40:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:40:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:40:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:40:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:40:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:40:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.377952855, 2024-04-25T22:40:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:40:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:40:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:40:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:40:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:40:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:40:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:40:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:40:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:40:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:40:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:40:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:40:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:40:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:40:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:40:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:40:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:40:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:40:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:40:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:40:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:40:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:40:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:40:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:40:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:40:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:40:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:40:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.377865303, 2024-04-25T22:40:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:40:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:40:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:40:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:40:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:40:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:40:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:40:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:40:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:40:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:40:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:40:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:40:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:40:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:40:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:40:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:40:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:40:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:40:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:40:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:40:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:40:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:40:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:40:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:40:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:40:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:40:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:40:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.377761477, 2024-04-25T22:40:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:40:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:40:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:40:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:40:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:40:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:40:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:40:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:40:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:40:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:40:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:40:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:40:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:40:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:40:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:40:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:40:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:40:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:40:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:40:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:40:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:40:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:40:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:40:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:40:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:40:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:40:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:40:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.377692687, 2024-04-25T22:40:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:40:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:40:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:40:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:40:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:40:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:40:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:40:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:40:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:40:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:40:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:40:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:40:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:40:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:40:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:40:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:40:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:40:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:40:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:40:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:40:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:40:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:40:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:40:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:40:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:40:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:40:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:40:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.377623601, 2024-04-25T22:40:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:40:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:40:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:40:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:40:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:40:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:40:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:40:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:40:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:40:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:40:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:40:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:40:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:40:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:40:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:40:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:40:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:40:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:40:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:40:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:40:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:40:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:40:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:40:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:40:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:40:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:40:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:40:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.377527487999998, 2024-04-25T22:40:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:40:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:40:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:40:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:40:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:40:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:40:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:40:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:40:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:40:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:40:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:40:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:40:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:40:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:40:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:40:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:40:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:40:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:40:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:40:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.377461826000001, 2024-04-25T22:40:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:40:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:40:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:40:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:40:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:40:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:40:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:40:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:40:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:40:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:40:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:40:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:40:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:40:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:40:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:40:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:40:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:40:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:40:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:40:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.377392699000001, 2024-04-25T22:40:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:40:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:40:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:40:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:40:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:40:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:40:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:40:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:40:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:40:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:40:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:40:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:40:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:40:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:40:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:40:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:40:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:40:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:40:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:40:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:40:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.366576042999998, 2024-04-25T22:40:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:40:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:40:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:40:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:40:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:40:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:40:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:40:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:40:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:40:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:40:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:40:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:40:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:40:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.34967769, 2024-04-25T22:40:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:40:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:40:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:40:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:40:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:40:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:40:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:40:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:40:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:40:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:40:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:40:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:40:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:40:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:40:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.3488568, 2024-04-25T22:40:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:40:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:40:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:40:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:40:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:40:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:40:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:40:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:40:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:40:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:40:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:40:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:40:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:40:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:40:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:40:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.347156072000001, 2024-04-25T22:40:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:40:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:40:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:40:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:40:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:40:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:40:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:40:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:40:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:40:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:40:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:40:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:40:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:40:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:40:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:40:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:40:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:40:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.346559397, 2024-04-25T22:40:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:40:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:40:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:40:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:40:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:40:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:40:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:40:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:40:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:40:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:40:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:40:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:40:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:40:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:40:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:40:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:40:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:40:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e18/16 ondisk, result = 0)", 2024-04-25T22:40:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636530+0000", 2024-04-25T22:40:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.337174171000001, 2024-04-25T22:40:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086108500000000004, 2024-04-25T22:40:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636530+0000", 2024-04-25T22:40:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636530+0000", 2024-04-25T22:40:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636531+0000", 2024-04-25T22:40:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:40:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636535+0000", 2024-04-25T22:40:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3579999999999996e-06 2024-04-25T22:40:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636555+0000", 2024-04-25T22:40:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9647999999999999e-05 2024-04-25T22:40:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636565+0000", 2024-04-25T22:40:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0231000000000001e-05 2024-04-25T22:40:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637201+0000", 2024-04-25T22:40:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00063605599999999997 2024-04-25T22:40:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637219+0000", 2024-04-25T22:40:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8159e-05 2024-04-25T22:40:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637391+0000", 2024-04-25T22:40:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017191299999999999 2024-04-25T22:40:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:40:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.337123671000001, 2024-04-25T22:40:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:40:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:40:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:40:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:40:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:40:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:40:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:40:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:40:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:40:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:40:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:40:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:40:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.336476245, 2024-04-25T22:40:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:40:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:40:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:40:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:40:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:40:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:40:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:40:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:40:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:40:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:40:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:40:42.053 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:40:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:40:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:40:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:40:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:40:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:40:42.054 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.335035426000001, 2024-04-25T22:40:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:40:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:42.055 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:40:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:40:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.056 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:40:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:40:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:40:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:40:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:40:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:40:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.057 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.058 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:40:42.058 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:40:42.058 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.058 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.058 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:42.058 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:40:42.058 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:40:42.058 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.058 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.058 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:42.058 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:40:42.058 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:40:42.058 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.058 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.058 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:42.058 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:40:42.059 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:40:42.059 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.059 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:42.059 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.059 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.059 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.059 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:40:42.059 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:42.059 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 25.382596981999999, 2024-04-25T22:40:42.059 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:40:42.059 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:42.059 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:42.059 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.059 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:42.059 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.059 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:42.060 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:42.060 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.060 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.060 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.060 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:42.060 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:42.060 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.060 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.060 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.060 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:42.060 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:40:42.060 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:40:42.060 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.060 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.060 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:42.060 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:40:42.061 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:40:42.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.061 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.061 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:42.061 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:40:42.061 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:40:42.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.061 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.061 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.061 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:40:42.061 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:40:42.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.061 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.061 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.061 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:40:42.061 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:40:42.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.062 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.062 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:42.062 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:40:42.062 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:40:42.062 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.062 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.062 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:42.062 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:40:42.062 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:40:42.062 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.062 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.062 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:42.062 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:40:42.062 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:40:42.062 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.063 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.063 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.063 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:40:42.063 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:40:42.063 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.063 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.063 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:42.063 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:40:42.063 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:40:42.063 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.063 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.063 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:42.063 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:40:42.063 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:40:42.064 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.064 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:42.064 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.064 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.064 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.064 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:40:42.064 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:42.064 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 3.3799376580000002, 2024-04-25T22:40:42.064 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:40:42.064 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:42.064 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:42.064 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.064 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:42.064 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.065 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:42.065 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:42.065 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.065 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.065 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.065 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:42.065 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:42.065 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:42.065 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.065 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.065 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:42.065 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:40:42.065 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:40:42.065 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.065 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.065 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:42.065 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:40:42.066 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:40:42.066 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.066 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.066 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:42.066 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:40:42.066 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:40:42.066 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.066 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.066 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.066 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:40:42.066 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:40:42.066 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.066 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.066 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:42.067 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:40:42.067 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:40:42.067 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.067 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.067 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:42.067 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:40:42.067 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:40:42.067 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.067 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.067 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:42.067 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:40:42.067 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:40:42.067 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.067 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.067 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:42.067 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:40:42.068 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:40:42.068 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.068 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.068 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.068 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:40:42.068 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:40:42.068 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.068 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.068 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:42.068 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:40:42.068 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:40:42.068 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:42.068 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:42.068 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:42.068 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:40:42.068 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:40:42.068 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.069 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:42.069 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.069 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:42.069 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:42.069 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:42.070 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:40:42.071 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:42.067+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:42.171 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:42.167+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:42.203 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:40:42.204 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:40:42.204 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:40:42.204 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:40:42.218 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:40:42.271 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:42.272+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:42.372 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:42.371+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:42.377 INFO:teuthology.orchestra.run.smithi057.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T22:40:42.382 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:40:42.382 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:40:42.382 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:40:42.382 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:40:42.382 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:40:42.397 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:40:42.403 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T22:40:42.473 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:42.474+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:42.565 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:40:42.566 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:40:42.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:40:42.566 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:40:42.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.566 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.566 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:40:42.566 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.970239281000001, 2024-04-25T22:40:42.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:40:42.566 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:42.566 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:42.566 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.567 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:42.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:42.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:40:42.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:42.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:40:42.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:42.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:40:42.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:40:42.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:42.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:40:42.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:40:42.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:42.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:40:42.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:40:42.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:40:42.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:40:42.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:40:42.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:40:42.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:42.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:40:42.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:40:42.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:40:42.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:40:42.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:42.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:40:42.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:40:42.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:42.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:40:42.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:40:42.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:40:42.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:40:42.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:42.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:40:42.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:40:42.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:42.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:40:42.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:40:42.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:42.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:40:42.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:40:42.572 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.572 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.572 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.572 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.572 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:40:42.572 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.970151267999999, 2024-04-25T22:40:42.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:40:42.572 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:42.572 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:42.572 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.572 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:42.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:42.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:40:42.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:42.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:40:42.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:42.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:40:42.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:40:42.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:42.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:40:42.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:40:42.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:42.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:40:42.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:40:42.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:40:42.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:40:42.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:40:42.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:40:42.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:42.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:42.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:40:42.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:40:42.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:40:42.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:42.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:40:42.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:40:42.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:42.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:40:42.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:40:42.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:42.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:40:42.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:40:42.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:40:42.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:40:42.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:42.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:40:42.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:40:42.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:42.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:40:42.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:40:42.577 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.577 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.578 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.578 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:40:42.578 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.970079146, 2024-04-25T22:40:42.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:40:42.578 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:42.578 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:42.578 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.578 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:42.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:42.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:40:42.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:42.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:40:42.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:42.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:40:42.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:40:42.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:42.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:40:42.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:40:42.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:42.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:40:42.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:40:42.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:40:42.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:40:42.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:40:42.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:40:42.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:42.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:40:42.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:40:42.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:40:42.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:40:42.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:42.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:40:42.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:40:42.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:42.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:40:42.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:40:42.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:40:42.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:40:42.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:42.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:40:42.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:40:42.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:42.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:40:42.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:40:42.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:42.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:40:42.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:40:42.583 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.583 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.583 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.584 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.584 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:40:42.584 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.969970833000001, 2024-04-25T22:40:42.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:40:42.584 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:42.584 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:42.584 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.584 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:42.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:42.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:40:42.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:42.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:40:42.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:42.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:40:42.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:40:42.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:42.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:40:42.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:40:42.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:42.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:40:42.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:40:42.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:40:42.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:40:42.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:40:42.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:40:42.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:42.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:40:42.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:40:42.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:40:42.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:40:42.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:42.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:40:42.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:40:42.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:42.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:40:42.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:40:42.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:40:42.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:40:42.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:42.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:40:42.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:40:42.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:42.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:40:42.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:40:42.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:42.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:40:42.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:40:42.589 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.589 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.589 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.590 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.590 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:40:42.590 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.969904177, 2024-04-25T22:40:42.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:40:42.590 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:42.590 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:42.590 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.590 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:42.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:42.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:40:42.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:42.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:40:42.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:42.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:40:42.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:40:42.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:42.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:40:42.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:40:42.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:42.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:40:42.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:40:42.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:40:42.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:40:42.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:40:42.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:40:42.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:42.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:40:42.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:40:42.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:40:42.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:40:42.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:42.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:40:42.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:40:42.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:42.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:40:42.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:40:42.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:40:42.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:40:42.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:42.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:40:42.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:40:42.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:42.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:40:42.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:40:42.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:42.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:40:42.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:40:42.596 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.596 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.596 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.596 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.596 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:40:42.596 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.969813581, 2024-04-25T22:40:42.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:40:42.596 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:42.596 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:42.596 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.596 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:42.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:42.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:40:42.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:42.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:40:42.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:42.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:40:42.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:40:42.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:42.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:40:42.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:40:42.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:42.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:40:42.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:40:42.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:40:42.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:40:42.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:40:42.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:40:42.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:42.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:40:42.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:40:42.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:40:42.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:40:42.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:42.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:40:42.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:40:42.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:42.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:40:42.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:40:42.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:42.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:40:42.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:40:42.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:40:42.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:40:42.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:42.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:40:42.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:40:42.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:42.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:40:42.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:40:42.601 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.601 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.601 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.602 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.602 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:40:42.602 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.969749008000001, 2024-04-25T22:40:42.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:40:42.602 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:42.602 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:42.602 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.602 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:42.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:42.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:40:42.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:42.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:40:42.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:42.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:40:42.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:40:42.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:42.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:40:42.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:40:42.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:42.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:40:42.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:40:42.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:40:42.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:40:42.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:40:42.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:40:42.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:42.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:40:42.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:40:42.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:40:42.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:40:42.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:42.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:40:42.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:40:42.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:42.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:40:42.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:40:42.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:40:42.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:40:42.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:42.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:40:42.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:40:42.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:42.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:40:42.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:40:42.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:42.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:40:42.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:40:42.607 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.607 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.608 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.608 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.608 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:40:42.608 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.969683584999999, 2024-04-25T22:40:42.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:40:42.608 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:42.608 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:42.608 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.608 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:42.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:42.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:40:42.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:42.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:40:42.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:42.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:40:42.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:40:42.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:42.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:40:42.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:40:42.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:42.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:40:42.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:40:42.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:40:42.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:40:42.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:40:42.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:40:42.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:42.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:40:42.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:40:42.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:40:42.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:40:42.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:42.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:40:42.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:40:42.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:42.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:40:42.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:40:42.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:42.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:40:42.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:40:42.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:40:42.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:40:42.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:42.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:40:42.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:40:42.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:42.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:40:42.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:40:42.613 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.613 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.613 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.614 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.614 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:40:42.614 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.969627518999999, 2024-04-25T22:40:42.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:40:42.614 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:42.614 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:42.614 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.614 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:42.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:42.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:40:42.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:42.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:40:42.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:42.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:40:42.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:40:42.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:42.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:40:42.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:40:42.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:42.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:40:42.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:40:42.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:40:42.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:40:42.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:40:42.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:40:42.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:42.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:40:42.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:40:42.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:40:42.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:40:42.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:42.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:40:42.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:40:42.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:42.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:40:42.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:40:42.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:40:42.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:40:42.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:42.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:40:42.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:40:42.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:42.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:40:42.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:40:42.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:42.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:40:42.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:40:42.619 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.619 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.619 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.619 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.620 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:40:42.620 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.969560413, 2024-04-25T22:40:42.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:40:42.620 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:42.620 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:42.620 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.620 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:42.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:42.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:40:42.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:42.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:40:42.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:42.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:40:42.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:40:42.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:42.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:40:42.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:40:42.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:42.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:40:42.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:40:42.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:40:42.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:40:42.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:40:42.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:40:42.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:42.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:40:42.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:40:42.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:40:42.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:40:42.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:42.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:40:42.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:40:42.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:42.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:40:42.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:40:42.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:40:42.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:40:42.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:42.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:40:42.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:40:42.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:42.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:40:42.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:40:42.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:42.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:40:42.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:40:42.625 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.625 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.625 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.625 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.625 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:40:42.625 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.969505290000001, 2024-04-25T22:40:42.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:40:42.625 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:42.625 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:42.626 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.626 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:42.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:42.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:40:42.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:42.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:40:42.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:42.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:40:42.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:40:42.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:42.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:40:42.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:40:42.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:42.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:40:42.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:40:42.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:40:42.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:40:42.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:40:42.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:40:42.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:42.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:40:42.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:40:42.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:40:42.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:40:42.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:42.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:40:42.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:40:42.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:40:42.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:40:42.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:40:42.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:40:42.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:40:42.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:42.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:40:42.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:40:42.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:42.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:40:42.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:40:42.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:42.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:40:42.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:40:42.631 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.631 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.631 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.631 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.631 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:40:42.631 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.969403051, 2024-04-25T22:40:42.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:40:42.631 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:42.631 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:42.631 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.631 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:42.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:42.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:40:42.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:42.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:40:42.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:42.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:40:42.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:40:42.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:42.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:40:42.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:40:42.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:42.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:40:42.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:40:42.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:40:42.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:40:42.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:40:42.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:40:42.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:42.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:40:42.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:40:42.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:40:42.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:40:42.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:42.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:40:42.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:40:42.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:40:42.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:40:42.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:40:42.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:40:42.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:40:42.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:42.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:40:42.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:40:42.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:42.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:40:42.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:40:42.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:42.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:40:42.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:40:42.636 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.637 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.637 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.637 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.637 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:40:42.637 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.969344228000001, 2024-04-25T22:40:42.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:40:42.637 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:42.637 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:42.637 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.637 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:42.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:42.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:40:42.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:42.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:40:42.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:42.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:40:42.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:40:42.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:42.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:40:42.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:40:42.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:42.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:40:42.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:40:42.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:40:42.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:40:42.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:40:42.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:40:42.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:42.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:40:42.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:40:42.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:40:42.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:40:42.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:42.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:40:42.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:40:42.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:40:42.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:40:42.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:40:42.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:42.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:40:42.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:40:42.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:40:42.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:40:42.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:42.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:40:42.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:40:42.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:42.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:40:42.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:40:42.642 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.642 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.642 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.643 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.643 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:40:42.643 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.969265494999998, 2024-04-25T22:40:42.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:40:42.643 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:42.643 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:42.643 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.643 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:42.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:42.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:40:42.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:42.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:40:42.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:42.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:40:42.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:40:42.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:42.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:40:42.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:40:42.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:42.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:40:42.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:40:42.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:40:42.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:40:42.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:40:42.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:40:42.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:42.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:40:42.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:40:42.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:40:42.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:40:42.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:42.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:40:42.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:40:42.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:42.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:40:42.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:40:42.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:42.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:40:42.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:40:42.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:40:42.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:40:42.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:42.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:40:42.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:40:42.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:42.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:40:42.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:40:42.648 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.648 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.648 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.649 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.649 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:40:42.649 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.969226081999999, 2024-04-25T22:40:42.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:40:42.649 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:42.649 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:42.649 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.649 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:42.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:42.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:40:42.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:42.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:40:42.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:42.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:40:42.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:40:42.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:42.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:40:42.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:40:42.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:42.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:40:42.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:40:42.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:40:42.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:40:42.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:40:42.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:40:42.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:42.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:40:42.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:40:42.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:40:42.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:40:42.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:42.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:40:42.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:40:42.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:42.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:40:42.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:40:42.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:40:42.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:40:42.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:42.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:40:42.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:40:42.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:42.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:40:42.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:40:42.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:42.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:40:42.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:40:42.654 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.654 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.654 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.654 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.654 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:40:42.654 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.969156236, 2024-04-25T22:40:42.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:40:42.655 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:42.655 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:42.655 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.655 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:42.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:42.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:40:42.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:42.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:40:42.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:42.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:40:42.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:40:42.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:42.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:40:42.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:40:42.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:42.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:40:42.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:40:42.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:40:42.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:40:42.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:40:42.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:40:42.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:42.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:40:42.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:40:42.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:40:42.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:40:42.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:42.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:40:42.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:40:42.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:42.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:40:42.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:40:42.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:40:42.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:40:42.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:42.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:40:42.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:40:42.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:42.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:40:42.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:40:42.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:42.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:40:42.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:40:42.660 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.660 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.660 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.660 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.660 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:40:42.661 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.969106498999999, 2024-04-25T22:40:42.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:40:42.661 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:42.661 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:42.661 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.661 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:42.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:42.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:40:42.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:42.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:40:42.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:42.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:40:42.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:40:42.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:42.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:40:42.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:40:42.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:42.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:40:42.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:40:42.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:40:42.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:40:42.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:40:42.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:40:42.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:42.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:40:42.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:40:42.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:40:42.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:40:42.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:42.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:40:42.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:40:42.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:40:42.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:40:42.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:40:42.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:42.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:40:42.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:40:42.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:40:42.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:40:42.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:42.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:40:42.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:40:42.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:42.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:40:42.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:40:42.666 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.666 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.666 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.666 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.666 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:40:42.667 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.969021884, 2024-04-25T22:40:42.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:40:42.667 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:42.667 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:42.667 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.667 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:42.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:42.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:40:42.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:42.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:40:42.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:42.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:40:42.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:40:42.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:42.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:40:42.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:40:42.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:42.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:40:42.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:40:42.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:40:42.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:40:42.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:40:42.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:40:42.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:42.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:40:42.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:40:42.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:40:42.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:40:42.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:42.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:40:42.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:40:42.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:42.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:40:42.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:40:42.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:42.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:40:42.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:40:42.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:42.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:40:42.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:40:42.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:42.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:40:42.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:40:42.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:42.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:40:42.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:40:42.672 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.672 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.672 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.672 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:42.672 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:40:42.672 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.968958233999999, 2024-04-25T22:40:42.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:40:42.673 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:42.673 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:42.673 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:40:42.673 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:42.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:42.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:40:42.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:42.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:40:42.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:42.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:40:42.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:40:42.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:42.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:40:42.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:40:42.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:42.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:40:42.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:40:42.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:40:42.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:40:42.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:40:42.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:40:42.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:42.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:40:42.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:40:42.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:40:42.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:40:42.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:42.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:40:42.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:40:42.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:42.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:40:42.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:40:42.677 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.677 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.677 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.677 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:42.677 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:40:42.677 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.961954704, 2024-04-25T22:40:42.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:40:42.677 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:42.677 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:42.677 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:42.677 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:42.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:42.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:40:42.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:42.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:40:42.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:42.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:42.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:40:42.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:40:42.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:42.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:40:42.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:40:42.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:42.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:40:42.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:40:42.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:42.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:40:42.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:40:42.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:42.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:40:42.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:40:42.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:42.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:40:42.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:40:42.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:42.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:40:42.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:40:42.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:42.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:42.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:42.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:40:42.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:40:42.681 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.681 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.681 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.681 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:42.681 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:42.681 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:40:42.683 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:40:42.683 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:42.679+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:42.784 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:42.783+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:42.814 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:40:42.814 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:40:42.814 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-04-25T22:40:42.814 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:40:42.828 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:40:42.884 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:42.883+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:42.950 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:40:42.951 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:40:42.951 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-04-25T22:40:42.951 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-04-25T22:40:42.951 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:40:42.966 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:40:42.985 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:42.987+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:43.086 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:43.087+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:43.090 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:40:43.090 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-04-25T22:40:43.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-04-25T22:40:43.090 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-04-25T22:40:43.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.090 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:111 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'73, mlcod=11'69)", 2024-04-25T22:40:43.090 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:40:43.090 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.389467609, 2024-04-25T22:40:43.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055481899999999997, 2024-04-25T22:40:43.090 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:43.090 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:43.090 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.091 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:43.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:43.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:40:43.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:43.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:40:43.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:43.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700271+0000", 2024-04-25T22:40:43.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:40:43.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:43.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700278+0000", 2024-04-25T22:40:43.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-04-25T22:40:43.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:43.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700323+0000", 2024-04-25T22:40:43.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4212999999999998e-05 2024-04-25T22:40:43.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700333+0000", 2024-04-25T22:40:43.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0433e-05 2024-04-25T22:40:43.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:43.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700662+0000", 2024-04-25T22:40:43.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032862800000000003 2024-04-25T22:40:43.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:43.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700692+0000", 2024-04-25T22:40:43.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0395999999999998e-05 2024-04-25T22:40:43.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:43.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705728+0000", 2024-04-25T22:40:43.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050361939999999999 2024-04-25T22:40:43.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:43.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705818+0000", 2024-04-25T22:40:43.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9573000000000005e-05 2024-04-25T22:40:43.094 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.094 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.094 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.094 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-25T22:40:43.094 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:40:43.094 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.388922757000003, 2024-04-25T22:40:43.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005065501, 2024-04-25T22:40:43.095 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:43.095 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:43.095 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.095 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:43.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:43.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:40:43.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:43.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:40:43.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:43.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700816+0000", 2024-04-25T22:40:43.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.24e-06 2024-04-25T22:40:43.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:43.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700914+0000", 2024-04-25T22:40:43.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8057e-05 2024-04-25T22:40:43.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:43.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700931+0000", 2024-04-25T22:40:43.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7745999999999999e-05 2024-04-25T22:40:43.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700941+0000", 2024-04-25T22:40:43.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5699999999999999e-06 2024-04-25T22:40:43.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:43.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701162+0000", 2024-04-25T22:40:43.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000221392 2024-04-25T22:40:43.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:43.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701194+0000", 2024-04-25T22:40:43.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1745999999999997e-05 2024-04-25T22:40:43.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:43.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705821+0000", 2024-04-25T22:40:43.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046269869999999999 2024-04-25T22:40:43.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:43.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705880+0000", 2024-04-25T22:40:43.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8763e-05 2024-04-25T22:40:43.098 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.098 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.098 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.099 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:118 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'80, mlcod=11'78)", 2024-04-25T22:40:43.099 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:40:43.099 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.381567146999998, 2024-04-25T22:40:43.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047806089999999999, 2024-04-25T22:40:43.099 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:43.099 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:43.099 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.099 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:43.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:43.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:40:43.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:43.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:40:43.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:43.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708172+0000", 2024-04-25T22:40:43.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0600000000000002e-06 2024-04-25T22:40:43.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:43.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708291+0000", 2024-04-25T22:40:43.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118892 2024-04-25T22:40:43.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:43.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708320+0000", 2024-04-25T22:40:43.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8822999999999998e-05 2024-04-25T22:40:43.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708337+0000", 2024-04-25T22:40:43.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7586999999999999e-05 2024-04-25T22:40:43.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:43.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708512+0000", 2024-04-25T22:40:43.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017439500000000001 2024-04-25T22:40:43.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:43.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708551+0000", 2024-04-25T22:40:43.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.909e-05 2024-04-25T22:40:43.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:43.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712865+0000", 2024-04-25T22:40:43.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043142069999999996 2024-04-25T22:40:43.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:43.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712951+0000", 2024-04-25T22:40:43.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5555000000000003e-05 2024-04-25T22:40:43.102 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.102 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.103 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.103 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:120 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'82, mlcod=11'78)", 2024-04-25T22:40:43.103 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:40:43.103 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.380561104999998, 2024-04-25T22:40:43.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047170700000000003, 2024-04-25T22:40:43.103 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:43.103 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:43.103 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.103 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:43.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:43.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:40:43.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:43.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:40:43.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:43.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709177+0000", 2024-04-25T22:40:43.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.19e-06 2024-04-25T22:40:43.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:43.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709315+0000", 2024-04-25T22:40:43.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000137429 2024-04-25T22:40:43.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:43.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709341+0000", 2024-04-25T22:40:43.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:40:43.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709353+0000", 2024-04-25T22:40:43.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2027e-05 2024-04-25T22:40:43.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:43.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710040+0000", 2024-04-25T22:40:43.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068710799999999997 2024-04-25T22:40:43.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:43.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710076+0000", 2024-04-25T22:40:43.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5982999999999998e-05 2024-04-25T22:40:43.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:43.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713802+0000", 2024-04-25T22:40:43.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037255750000000001 2024-04-25T22:40:43.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:43.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713893+0000", 2024-04-25T22:40:43.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1201999999999999e-05 2024-04-25T22:40:43.107 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.107 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.107 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.107 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:121 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'83, mlcod=11'78)", 2024-04-25T22:40:43.107 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:40:43.107 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.380014469000002, 2024-04-25T22:40:43.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0049043919999999996, 2024-04-25T22:40:43.107 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:43.107 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:43.107 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.107 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:43.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:43.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:40:43.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:43.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:40:43.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:43.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709724+0000", 2024-04-25T22:40:43.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.483e-06 2024-04-25T22:40:43.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:43.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709872+0000", 2024-04-25T22:40:43.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147446 2024-04-25T22:40:43.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:43.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709891+0000", 2024-04-25T22:40:43.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9245999999999998e-05 2024-04-25T22:40:43.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709900+0000", 2024-04-25T22:40:43.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1439999999999992e-06 2024-04-25T22:40:43.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:43.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713091+0000", 2024-04-25T22:40:43.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031910710000000002 2024-04-25T22:40:43.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:43.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713122+0000", 2024-04-25T22:40:43.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.048e-05 2024-04-25T22:40:43.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:43.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714538+0000", 2024-04-25T22:40:43.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014160030000000001 2024-04-25T22:40:43.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:43.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714627+0000", 2024-04-25T22:40:43.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518999999999995e-05 2024-04-25T22:40:43.111 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.111 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.111 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.111 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:43.111 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:40:43.111 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.489625089, 2024-04-25T22:40:43.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022089675999999999, 2024-04-25T22:40:43.111 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:43.111 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:43.112 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.112 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:43.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:43.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:40:43.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:43.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:40:43.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:43.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600120+0000", 2024-04-25T22:40:43.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1259999999999998e-06 2024-04-25T22:40:43.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:43.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600153+0000", 2024-04-25T22:40:43.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3186999999999999e-05 2024-04-25T22:40:43.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:43.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600181+0000", 2024-04-25T22:40:43.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7676000000000001e-05 2024-04-25T22:40:43.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600205+0000", 2024-04-25T22:40:43.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:40:43.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:43.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600467+0000", 2024-04-25T22:40:43.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026186800000000001 2024-04-25T22:40:43.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:43.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600809+0000", 2024-04-25T22:40:43.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034138400000000002 2024-04-25T22:40:43.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:43.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.601892+0000", 2024-04-25T22:40:43.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010831910000000001 2024-04-25T22:40:43.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:43.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611054+0000", 2024-04-25T22:40:43.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0091620940000000008 2024-04-25T22:40:43.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:43.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621965+0000", 2024-04-25T22:40:43.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010911044999999999 2024-04-25T22:40:43.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:43.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622090+0000", 2024-04-25T22:40:43.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012522 2024-04-25T22:40:43.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:43.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622202+0000", 2024-04-25T22:40:43.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011164500000000001 2024-04-25T22:40:43.116 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.116 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.116 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.116 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:43.116 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:40:43.117 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.489482034000002, 2024-04-25T22:40:43.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035756228000000001, 2024-04-25T22:40:43.117 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:43.117 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:43.117 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.117 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:43.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:43.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:40:43.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:43.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:40:43.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:43.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600257+0000", 2024-04-25T22:40:43.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8300000000000001e-06 2024-04-25T22:40:43.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:43.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600267+0000", 2024-04-25T22:40:43.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6539999999999994e-06 2024-04-25T22:40:43.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:43.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600293+0000", 2024-04-25T22:40:43.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5996e-05 2024-04-25T22:40:43.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600309+0000", 2024-04-25T22:40:43.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6206e-05 2024-04-25T22:40:43.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:43.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603757+0000", 2024-04-25T22:40:43.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003448244 2024-04-25T22:40:43.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:43.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604779+0000", 2024-04-25T22:40:43.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010216820000000001 2024-04-25T22:40:43.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:43.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605127+0000", 2024-04-25T22:40:43.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034820100000000002 2024-04-25T22:40:43.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:43.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611082+0000", 2024-04-25T22:40:43.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0059550640000000004 2024-04-25T22:40:43.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:43.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635779+0000", 2024-04-25T22:40:43.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024696665999999999 2024-04-25T22:40:43.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:43.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635915+0000", 2024-04-25T22:40:43.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000135809 2024-04-25T22:40:43.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:43.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636011+0000", 2024-04-25T22:40:43.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6875999999999999e-05 2024-04-25T22:40:43.121 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.121 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.121 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.122 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:43.122 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:40:43.122 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.489404821000001, 2024-04-25T22:40:43.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035327031000000002, 2024-04-25T22:40:43.122 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:43.122 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:43.122 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.122 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:43.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:43.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:40:43.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:43.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:40:43.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:43.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600334+0000", 2024-04-25T22:40:43.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:40:43.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:43.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600347+0000", 2024-04-25T22:40:43.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3593e-05 2024-04-25T22:40:43.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:43.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600371+0000", 2024-04-25T22:40:43.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.313e-05 2024-04-25T22:40:43.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600390+0000", 2024-04-25T22:40:43.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.908e-05 2024-04-25T22:40:43.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:43.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602756+0000", 2024-04-25T22:40:43.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023662560000000002 2024-04-25T22:40:43.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:43.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603021+0000", 2024-04-25T22:40:43.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026546399999999998 2024-04-25T22:40:43.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:43.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603304+0000", 2024-04-25T22:40:43.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028308800000000002 2024-04-25T22:40:43.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:43.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611075+0000", 2024-04-25T22:40:43.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077703900000000003 2024-04-25T22:40:43.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:43.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635414+0000", 2024-04-25T22:40:43.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024339326000000001 2024-04-25T22:40:43.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:43.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635544+0000", 2024-04-25T22:40:43.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012948199999999999 2024-04-25T22:40:43.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:43.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635659+0000", 2024-04-25T22:40:43.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000115809 2024-04-25T22:40:43.126 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.126 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.127 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.127 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:43.127 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:40:43.127 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.489244895999999, 2024-04-25T22:40:43.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035594492999999998, 2024-04-25T22:40:43.127 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:43.127 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:43.127 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.127 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:43.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:43.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:40:43.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:43.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:40:43.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:43.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600494+0000", 2024-04-25T22:40:43.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:40:43.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:43.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600502+0000", 2024-04-25T22:40:43.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3769999999999996e-06 2024-04-25T22:40:43.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:43.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600522+0000", 2024-04-25T22:40:43.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9919999999999999e-05 2024-04-25T22:40:43.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600539+0000", 2024-04-25T22:40:43.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.649e-05 2024-04-25T22:40:43.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:43.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604846+0000", 2024-04-25T22:40:43.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043075199999999996 2024-04-25T22:40:43.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:43.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605057+0000", 2024-04-25T22:40:43.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00021085200000000001 2024-04-25T22:40:43.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:43.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605378+0000", 2024-04-25T22:40:43.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032074799999999999 2024-04-25T22:40:43.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:43.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611089+0000", 2024-04-25T22:40:43.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057110249999999998 2024-04-25T22:40:43.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:43.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635844+0000", 2024-04-25T22:40:43.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024755355999999999 2024-04-25T22:40:43.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:43.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635986+0000", 2024-04-25T22:40:43.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141512 2024-04-25T22:40:43.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:43.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636087+0000", 2024-04-25T22:40:43.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101183 2024-04-25T22:40:43.131 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.132 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.132 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.132 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:43.132 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:40:43.132 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.489172285999999, 2024-04-25T22:40:43.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021266723000000001, 2024-04-25T22:40:43.132 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:43.132 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:43.132 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.132 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:43.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:43.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:40:43.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:43.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:40:43.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:43.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600566+0000", 2024-04-25T22:40:43.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4959999999999999e-06 2024-04-25T22:40:43.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:43.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600574+0000", 2024-04-25T22:40:43.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-06 2024-04-25T22:40:43.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:43.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600592+0000", 2024-04-25T22:40:43.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8479999999999999e-05 2024-04-25T22:40:43.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600610+0000", 2024-04-25T22:40:43.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7567e-05 2024-04-25T22:40:43.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:43.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602679+0000", 2024-04-25T22:40:43.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020692739999999999 2024-04-25T22:40:43.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:43.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602945+0000", 2024-04-25T22:40:43.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026640399999999998 2024-04-25T22:40:43.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:43.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603115+0000", 2024-04-25T22:40:43.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000169996 2024-04-25T22:40:43.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:43.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608398+0000", 2024-04-25T22:40:43.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052826289999999996 2024-04-25T22:40:43.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:43.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621588+0000", 2024-04-25T22:40:43.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013190489 2024-04-25T22:40:43.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:43.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621733+0000", 2024-04-25T22:40:43.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014462500000000001 2024-04-25T22:40:43.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:43.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621832+0000", 2024-04-25T22:40:43.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8603000000000004e-05 2024-04-25T22:40:43.137 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.137 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.137 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.137 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:43.137 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:40:43.137 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.489104560000001, 2024-04-25T22:40:43.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034747924999999999, 2024-04-25T22:40:43.137 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:43.137 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:43.137 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.137 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:43.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:43.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:40:43.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:43.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:40:43.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:43.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600634+0000", 2024-04-25T22:40:43.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-04-25T22:40:43.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:43.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600642+0000", 2024-04-25T22:40:43.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8169999999999999e-06 2024-04-25T22:40:43.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:43.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600660+0000", 2024-04-25T22:40:43.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8513e-05 2024-04-25T22:40:43.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600676+0000", 2024-04-25T22:40:43.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6019999999999999e-05 2024-04-25T22:40:43.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:43.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603748+0000", 2024-04-25T22:40:43.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030718329999999999 2024-04-25T22:40:43.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:43.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604752+0000", 2024-04-25T22:40:43.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001003603 2024-04-25T22:40:43.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:43.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605117+0000", 2024-04-25T22:40:43.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00036539 2024-04-25T22:40:43.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:43.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608459+0000", 2024-04-25T22:40:43.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033413879999999998 2024-04-25T22:40:43.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:43.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635106+0000", 2024-04-25T22:40:43.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026647607 2024-04-25T22:40:43.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:43.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635273+0000", 2024-04-25T22:40:43.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000166689 2024-04-25T22:40:43.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:43.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635381+0000", 2024-04-25T22:40:43.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107642 2024-04-25T22:40:43.142 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.142 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.142 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.142 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:43.142 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:40:43.142 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.489041330999999, 2024-04-25T22:40:43.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040419292000000002, 2024-04-25T22:40:43.142 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:43.143 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:43.143 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.143 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:43.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:43.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:40:43.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:43.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:40:43.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:43.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600697+0000", 2024-04-25T22:40:43.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1999999999999999e-06 2024-04-25T22:40:43.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:43.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600704+0000", 2024-04-25T22:40:43.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5570000000000001e-06 2024-04-25T22:40:43.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:43.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600724+0000", 2024-04-25T22:40:43.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0023000000000001e-05 2024-04-25T22:40:43.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600738+0000", 2024-04-25T22:40:43.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4372999999999999e-05 2024-04-25T22:40:43.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:43.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.612532+0000", 2024-04-25T22:40:43.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011793606 2024-04-25T22:40:43.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:43.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613354+0000", 2024-04-25T22:40:43.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00082244100000000004 2024-04-25T22:40:43.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:43.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613726+0000", 2024-04-25T22:40:43.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00037226000000000002 2024-04-25T22:40:43.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:43.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618891+0000", 2024-04-25T22:40:43.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051649199999999999 2024-04-25T22:40:43.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:43.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.640874+0000", 2024-04-25T22:40:43.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021982640000000001 2024-04-25T22:40:43.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:43.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641019+0000", 2024-04-25T22:40:43.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000145339 2024-04-25T22:40:43.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:43.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641115+0000", 2024-04-25T22:40:43.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5933000000000005e-05 2024-04-25T22:40:43.147 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.147 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.147 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.147 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:43.147 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:40:43.148 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.488955301000001, 2024-04-25T22:40:43.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036502711, 2024-04-25T22:40:43.148 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:43.148 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:43.148 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:40:43.148 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:43.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:43.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:40:43.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:43.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:40:43.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:43.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600783+0000", 2024-04-25T22:40:43.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.533e-06 2024-04-25T22:40:43.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:43.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600790+0000", 2024-04-25T22:40:43.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0439999999999998e-06 2024-04-25T22:40:43.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:43.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600811+0000", 2024-04-25T22:40:43.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0449e-05 2024-04-25T22:40:43.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600825+0000", 2024-04-25T22:40:43.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4293e-05 2024-04-25T22:40:43.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:43.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602304+0000", 2024-04-25T22:40:43.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001478629 2024-04-25T22:40:43.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:43.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602587+0000", 2024-04-25T22:40:43.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028350800000000002 2024-04-25T22:40:43.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:43.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.637285+0000", 2024-04-25T22:40:43.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034697255000000003 2024-04-25T22:40:43.151 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.151 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.151 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.151 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:43.151 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:40:43.151 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.488889735000001, 2024-04-25T22:40:43.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017311460000000001, 2024-04-25T22:40:43.151 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:43.151 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:43.152 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:40:43.152 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:43.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:43.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:40:43.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:43.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:40:43.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:43.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600849+0000", 2024-04-25T22:40:43.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2899999999999999e-06 2024-04-25T22:40:43.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:43.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600866+0000", 2024-04-25T22:40:43.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6793e-05 2024-04-25T22:40:43.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:43.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600886+0000", 2024-04-25T22:40:43.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0772999999999999e-05 2024-04-25T22:40:43.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600904+0000", 2024-04-25T22:40:43.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7697e-05 2024-04-25T22:40:43.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:43.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602796+0000", 2024-04-25T22:40:43.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018920149999999999 2024-04-25T22:40:43.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:43.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602962+0000", 2024-04-25T22:40:43.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016590600000000001 2024-04-25T22:40:43.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:43.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618159+0000", 2024-04-25T22:40:43.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015196985999999999 2024-04-25T22:40:43.155 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.155 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.155 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.155 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:43.155 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:40:43.155 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.474013994, 2024-04-25T22:40:43.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006380269, 2024-04-25T22:40:43.155 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:43.155 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:43.155 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.155 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:43.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:43.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:40:43.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:43.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:40:43.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:43.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615724+0000", 2024-04-25T22:40:43.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.094e-06 2024-04-25T22:40:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615734+0000", 2024-04-25T22:40:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.363e-06 2024-04-25T22:40:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615751+0000", 2024-04-25T22:40:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:40:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615773+0000", 2024-04-25T22:40:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.154e-05 2024-04-25T22:40:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616485+0000", 2024-04-25T22:40:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00071225100000000001 2024-04-25T22:40:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616528+0000", 2024-04-25T22:40:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3606000000000002e-05 2024-04-25T22:40:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622030+0000", 2024-04-25T22:40:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055010750000000002 2024-04-25T22:40:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622103+0000", 2024-04-25T22:40:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3930000000000005e-05 2024-04-25T22:40:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:40:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:40:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.473101057000001, 2024-04-25T22:40:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046420649999999999, 2024-04-25T22:40:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-04-25T22:40:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:40:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:40:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616637+0000", 2024-04-25T22:40:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0299999999999998e-07 2024-04-25T22:40:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616653+0000", 2024-04-25T22:40:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5843000000000001e-05 2024-04-25T22:40:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616690+0000", 2024-04-25T22:40:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7466999999999999e-05 2024-04-25T22:40:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616729+0000", 2024-04-25T22:40:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8810000000000003e-05 2024-04-25T22:40:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617251+0000", 2024-04-25T22:40:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00052143899999999995 2024-04-25T22:40:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621278+0000", 2024-04-25T22:40:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040277029999999997 2024-04-25T22:40:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:40:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.472077705, 2024-04-25T22:40:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0065101730000000002, 2024-04-25T22:40:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:40:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:40:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617661+0000", 2024-04-25T22:40:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:40:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617688+0000", 2024-04-25T22:40:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7589e-05 2024-04-25T22:40:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617710+0000", 2024-04-25T22:40:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1467e-05 2024-04-25T22:40:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617727+0000", 2024-04-25T22:40:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6990000000000002e-05 2024-04-25T22:40:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618559+0000", 2024-04-25T22:40:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083207400000000003 2024-04-25T22:40:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618608+0000", 2024-04-25T22:40:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8936e-05 2024-04-25T22:40:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624077+0000", 2024-04-25T22:40:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054695840000000004 2024-04-25T22:40:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624170+0000", 2024-04-25T22:40:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2305999999999993e-05 2024-04-25T22:40:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:40:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.466976197000001, 2024-04-25T22:40:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006879446, 2024-04-25T22:40:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:43.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:40:43.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:43.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:40:43.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:43.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622762+0000", 2024-04-25T22:40:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:40:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622781+0000", 2024-04-25T22:40:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8749999999999998e-05 2024-04-25T22:40:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622802+0000", 2024-04-25T22:40:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1650000000000001e-05 2024-04-25T22:40:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622816+0000", 2024-04-25T22:40:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3556e-05 2024-04-25T22:40:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623700+0000", 2024-04-25T22:40:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00088389299999999996 2024-04-25T22:40:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623741+0000", 2024-04-25T22:40:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1023999999999999e-05 2024-04-25T22:40:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629543+0000", 2024-04-25T22:40:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058023980000000003 2024-04-25T22:40:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629640+0000", 2024-04-25T22:40:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7381999999999997e-05 2024-04-25T22:40:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:40:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.466714993, 2024-04-25T22:40:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067054879999999999, 2024-04-25T22:40:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:40:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:40:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623032+0000", 2024-04-25T22:40:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.9930000000000007e-06 2024-04-25T22:40:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623043+0000", 2024-04-25T22:40:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0387000000000001e-05 2024-04-25T22:40:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623064+0000", 2024-04-25T22:40:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1849999999999999e-05 2024-04-25T22:40:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623079+0000", 2024-04-25T22:40:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4093e-05 2024-04-25T22:40:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624384+0000", 2024-04-25T22:40:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013054539999999999 2024-04-25T22:40:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624421+0000", 2024-04-25T22:40:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7088999999999997e-05 2024-04-25T22:40:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629645+0000", 2024-04-25T22:40:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052241400000000004 2024-04-25T22:40:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629728+0000", 2024-04-25T22:40:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2482000000000001e-05 2024-04-25T22:40:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2024-04-25T22:40:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:40:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.466631880000001, 2024-04-25T22:40:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078029559999999998, 2024-04-25T22:40:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:40:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:40:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623106+0000", 2024-04-25T22:40:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.64e-07 2024-04-25T22:40:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623141+0000", 2024-04-25T22:40:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4678999999999998e-05 2024-04-25T22:40:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623153+0000", 2024-04-25T22:40:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1759999999999999e-05 2024-04-25T22:40:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623161+0000", 2024-04-25T22:40:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8299999999999996e-06 2024-04-25T22:40:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623834+0000", 2024-04-25T22:40:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067394500000000001 2024-04-25T22:40:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623883+0000", 2024-04-25T22:40:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8640000000000002e-05 2024-04-25T22:40:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630807+0000", 2024-04-25T22:40:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069238859999999998 2024-04-25T22:40:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:43.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630908+0000", 2024-04-25T22:40:43.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101252 2024-04-25T22:40:43.181 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.181 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.181 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.181 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:43.181 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:43.181 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:40:43.182 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:40:43.229 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:43.230+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:43.287 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:43.288+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:43.314 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:43.314 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:43.314 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:40:43.314 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:43.328 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:40:43.386 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:40:43.388 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:43.388+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:43.415 INFO:teuthology.orchestra.run.smithi057.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T22:40:43.440 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T22:40:43.441 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:40:43.489 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:43.486+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:43.491 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:43.491 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:43.491 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:40:43.491 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:40:43.491 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:43.505 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:40:43.589 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:43.588+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:43.636 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:40:43.676 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:43.676 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:40:43.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:40:43.677 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:40:43.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.677 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:43.677 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:43.677 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.079877681999999, 2024-04-25T22:40:43.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:40:43.677 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:43.677 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:43.677 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.677 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:43.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.677 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:43.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:43.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:43.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:43.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:43.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:40:43.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:40:43.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:43.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:40:43.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:40:43.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:43.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:40:43.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:40:43.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:40:43.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:40:43.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:40:43.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:40:43.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:43.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:40:43.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:40:43.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.681 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.681 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:40:43.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:40:43.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.681 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:43.681 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:40:43.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:40:43.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:43.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:40:43.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:40:43.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:43.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:40:43.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:40:43.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:43.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:40:43.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:40:43.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.683 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:43.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:40:43.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:40:43.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.683 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:43.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:40:43.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:40:43.684 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.684 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.684 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.684 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.684 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:43.684 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:43.684 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.079740426000001, 2024-04-25T22:40:43.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:40:43.684 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:43.684 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:43.684 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.685 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:43.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:43.685 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:43.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:43.685 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:43.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.686 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:43.686 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:40:43.686 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:40:43.686 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.686 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.686 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:43.686 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:40:43.686 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:40:43.686 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.686 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.686 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:43.686 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:40:43.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:40:43.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:40:43.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:40:43.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:40:43.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:40:43.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:43.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:40:43.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:40:43.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:40:43.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:40:43.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:43.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:40:43.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:40:43.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:43.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:40:43.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:40:43.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:43.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:40:43.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:40:43.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.690 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:43.690 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:40:43.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:40:43.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.690 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:43.690 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:40:43.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:40:43.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.691 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.691 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:43.691 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:40:43.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:40:43.691 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.691 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.691 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.691 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.691 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.691 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:43.691 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:43.691 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.079652874000001, 2024-04-25T22:40:43.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:40:43.692 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:43.692 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:43.692 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.692 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:43.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:43.692 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:43.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:43.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:43.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:43.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:40:43.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:40:43.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:43.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:40:43.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:40:43.694 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.694 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.694 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:43.694 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:40:43.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:40:43.694 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.694 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.694 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.694 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:40:43.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:40:43.694 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.695 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.695 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:40:43.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:40:43.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.695 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:43.695 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:40:43.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:40:43.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.695 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:40:43.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:40:43.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:43.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:40:43.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:40:43.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:43.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:40:43.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:40:43.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:43.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:40:43.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:40:43.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:43.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:40:43.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:40:43.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:43.698 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:40:43.698 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:40:43.698 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.698 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:43.698 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:40:43.698 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:40:43.698 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.698 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.698 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.698 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.699 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:43.699 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:43.699 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.079549048000001, 2024-04-25T22:40:43.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:40:43.699 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:43.699 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:43.699 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.699 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:43.699 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.699 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:43.699 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:43.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.700 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:43.700 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:43.700 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.700 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:43.700 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:40:43.700 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:40:43.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:43.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:40:43.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:40:43.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:43.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:40:43.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:40:43.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:40:43.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:40:43.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.702 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.702 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:40:43.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:40:43.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.702 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:43.702 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:40:43.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:40:43.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:40:43.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:40:43.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:43.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:40:43.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:40:43.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:43.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:40:43.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:40:43.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.704 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:43.704 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:40:43.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:40:43.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.704 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:43.704 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:40:43.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:40:43.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.704 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:43.705 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:40:43.705 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:40:43.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.705 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.705 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:43.705 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:40:43.705 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:40:43.705 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.705 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.705 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.705 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.705 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:43.706 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:43.706 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.079480258, 2024-04-25T22:40:43.706 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:40:43.706 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:43.706 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:43.706 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.706 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:43.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:43.706 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:43.706 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.706 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.707 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:43.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:43.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.707 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:43.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:40:43.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:40:43.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.707 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:43.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:40:43.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:40:43.708 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.708 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.708 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:43.708 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:40:43.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:40:43.708 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.708 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.708 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.708 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:40:43.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:40:43.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.709 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:40:43.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:40:43.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:43.709 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:40:43.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:40:43.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.710 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:40:43.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:40:43.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.710 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:43.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:40:43.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:40:43.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.710 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:43.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:40:43.711 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:40:43.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.711 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.711 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:43.711 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:40:43.711 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:40:43.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.711 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.711 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:43.711 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:40:43.711 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:40:43.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:43.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:40:43.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:40:43.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:43.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:40:43.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:40:43.712 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.712 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.712 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.713 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:43.713 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:43.713 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.079411172, 2024-04-25T22:40:43.713 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:40:43.713 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:43.713 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:43.713 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.713 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:43.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.713 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:43.713 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:43.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.714 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:43.714 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:43.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.714 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:43.714 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:40:43.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:40:43.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:43.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:40:43.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:40:43.715 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:43.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:40:43.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:40:43.715 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:40:43.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:40:43.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.716 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.716 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:40:43.716 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:40:43.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.716 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:43.716 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:40:43.716 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:40:43.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.716 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:40:43.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:40:43.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:43.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:40:43.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:40:43.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:43.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:40:43.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:40:43.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.718 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.718 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:43.718 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:40:43.718 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:40:43.718 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.718 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.718 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:43.718 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:40:43.718 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:40:43.718 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.718 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:43.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:40:43.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:40:43.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:43.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:40:43.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:40:43.719 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.719 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.719 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.720 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:43.720 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:43.720 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.079315058999999, 2024-04-25T22:40:43.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:40:43.720 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:43.720 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:43.720 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:43.720 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:43.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.720 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:43.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:43.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:43.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:43.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:43.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:40:43.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:40:43.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:43.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:40:43.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:40:43.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.723 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:43.723 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:40:43.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:40:43.723 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.723 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.723 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:40:43.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:40:43.723 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.723 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.723 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:40:43.724 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:40:43.724 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.724 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.724 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:43.724 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:40:43.724 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:40:43.724 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.724 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.724 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:40:43.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:40:43.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:43.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:40:43.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:40:43.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:43.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:40:43.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:40:43.726 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.726 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.726 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.726 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:43.726 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:43.726 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.079249397000002, 2024-04-25T22:40:43.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:40:43.726 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:43.726 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:43.727 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:43.727 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:43.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:43.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:43.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:43.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:43.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:43.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:40:43.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:40:43.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:43.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:40:43.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:40:43.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:43.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:40:43.729 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:40:43.729 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.729 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.729 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.729 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:40:43.729 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:40:43.729 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.729 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.729 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.729 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:40:43.729 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:40:43.729 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:43.730 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:40:43.730 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:40:43.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.730 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:40:43.730 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:40:43.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:43.731 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:40:43.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:40:43.731 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.731 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.731 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:43.731 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:40:43.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:40:43.731 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.731 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.731 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.731 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.731 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.731 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:43.731 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:43.732 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.079180269999998, 2024-04-25T22:40:43.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:40:43.732 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:43.732 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:43.732 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:43.732 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:43.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.732 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:43.732 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:43.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.732 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.732 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:43.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:43.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:43.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:40:43.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:40:43.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:43.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:40:43.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:40:43.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:43.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:40:43.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:40:43.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:40:43.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:40:43.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:40:43.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:40:43.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:43.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:40:43.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:40:43.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:40:43.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:40:43.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:43.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:40:43.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:40:43.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:43.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:40:43.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:40:43.736 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.736 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.736 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.736 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:40:43.736 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:43.737 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.068363613999999, 2024-04-25T22:40:43.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:40:43.737 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:43.737 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:43.737 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:43.737 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:43.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:43.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:43.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:43.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:43.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:43.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:40:43.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:40:43.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:43.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:40:43.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:40:43.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:43.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:40:43.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:40:43.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:40:43.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:40:43.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:40:43.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:40:43.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:43.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:40:43.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:40:43.740 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.740 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.740 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.741 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:43.741 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:43.741 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.051465261000001, 2024-04-25T22:40:43.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:40:43.741 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:43.741 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:43.741 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:43.741 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:43.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:43.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:43.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:40:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:40:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:40:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:40:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:40:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:40:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:40:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:40:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:40:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:40:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:40:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:40:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:40:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.050644371000001, 2024-04-25T22:40:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:40:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:40:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:40:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:40:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:40:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:40:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:40:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:40:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:40:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:40:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:40:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:40:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:40:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:40:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:40:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.048943643000001, 2024-04-25T22:40:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:40:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:40:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:40:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:40:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:40:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:40:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:40:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:40:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:40:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:40:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:40:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:40:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:40:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:40:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:40:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:40:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:40:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.048346968000001, 2024-04-25T22:40:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:40:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:40:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:40:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:40:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:40:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:40:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:40:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:40:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:40:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:40:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:40:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:40:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:40:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:40:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:40:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:40:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:40:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e18/16 ondisk, result = 0)", 2024-04-25T22:40:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636530+0000", 2024-04-25T22:40:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.038961742000001, 2024-04-25T22:40:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086108500000000004, 2024-04-25T22:40:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636530+0000", 2024-04-25T22:40:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636530+0000", 2024-04-25T22:40:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636531+0000", 2024-04-25T22:40:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:40:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636535+0000", 2024-04-25T22:40:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3579999999999996e-06 2024-04-25T22:40:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636555+0000", 2024-04-25T22:40:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9647999999999999e-05 2024-04-25T22:40:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636565+0000", 2024-04-25T22:40:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0231000000000001e-05 2024-04-25T22:40:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637201+0000", 2024-04-25T22:40:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00063605599999999997 2024-04-25T22:40:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637219+0000", 2024-04-25T22:40:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8159e-05 2024-04-25T22:40:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637391+0000", 2024-04-25T22:40:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017191299999999999 2024-04-25T22:40:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:40:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.038911242000001, 2024-04-25T22:40:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:40:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:40:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:40:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:40:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:40:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:40:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:40:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:40:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:40:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:40:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:40:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:40:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.038263816000001, 2024-04-25T22:40:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:40:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:40:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:40:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:40:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:40:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:40:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:40:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:40:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:40:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:40:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:40:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:40:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:40:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:40:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:40:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:40:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:40:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.036822997000002, 2024-04-25T22:40:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:40:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:40:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:40:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:40:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:40:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:40:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:40:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:40:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:40:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:40:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:40:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:40:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:40:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:40:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:40:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:40:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:40:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:40:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.084384553, 2024-04-25T22:40:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:40:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:40:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:40:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:40:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:40:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:40:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:40:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:40:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:40:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:40:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:40:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:40:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:40:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:40:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:40:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:40:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:40:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:40:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:40:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:40:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:40:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:40:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:40:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:40:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 5.0817252289999999, 2024-04-25T22:40:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:40:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:40:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:40:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:40:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:40:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:40:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:40:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:40:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:40:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:40:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:40:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:40:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:40:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:40:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:40:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:40:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:40:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:40:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:40:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:40:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:40:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:40:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:40:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:43.791 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:43.792 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:40:43.793 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:40:43.795 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:43.790+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:43.796 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:40:43.797 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:43.798 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:40:43.807 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-04-25T22:40:43.413551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596050,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":253,"num_write_kb":3480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91188,"kb_used_data":1808,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024332,"statfs":{"total":289910292480,"available":289816915968,"internally_reserved":0,"allocated":1851392,"data_stored":1416083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2831,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.100153"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356741+0000","last_change":"2024-04-25T22:40:36.296993+0000","last_active":"2024-04-25T22:40:41.356741+0000","last_peered":"2024-04-25T22:40:41.356741+0000","last_clean":"2024-04-25T22:40:41.356741+0000","last_became_active":"2024-04-25T22:40:36.296111+0000","last_became_peered":"2024-04-25T22:40:36.296111+0000","last_unstale":"2024-04-25T22:40:41.356741+0000","last_undegraded":"2024-04-25T22:40:41.356741+0000","last_fullsized":"2024-04-25T22:40:41.356741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:03.272640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355742+0000","last_change":"2024-04-25T22:40:36.295443+0000","last_active":"2024-04-25T22:40:41.355742+0000","last_peered":"2024-04-25T22:40:41.355742+0000","last_clean":"2024-04-25T22:40:41.355742+0000","last_became_active":"2024-04-25T22:40:36.294248+0000","last_became_peered":"2024-04-25T22:40:36.294248+0000","last_unstale":"2024-04-25T22:40:41.355742+0000","last_undegraded":"2024-04-25T22:40:41.355742+0000","last_fullsized":"2024-04-25T22:40:41.355742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:25.839134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362638+0000","last_change":"2024-04-25T22:40:14.626211+0000","last_active":"2024-04-25T22:40:41.362638+0000","last_peered":"2024-04-25T22:40:41.362638+0000","last_clean":"2024-04-25T22:40:41.362638+0000","last_became_active":"2024-04-25T22:40:14.622625+0000","last_became_peered":"2024-04-25T22:40:14.622625+0000","last_unstale":"2024-04-25T22:40:41.362638+0000","last_undegraded":"2024-04-25T22:40:41.362638+0000","last_fullsized":"2024-04-25T22:40:41.362638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:35.993000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362024+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:40:41.362024+0000","last_peered":"2024-04-25T22:40:41.362024+0000","last_clean":"2024-04-25T22:40:41.362024+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:40:41.362024+0000","last_undegraded":"2024-04-25T22:40:41.362024+0000","last_fullsized":"2024-04-25T22:40:41.362024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354511+0000","last_change":"2024-04-25T22:40:36.294687+0000","last_active":"2024-04-25T22:40:41.354511+0000","last_peered":"2024-04-25T22:40:41.354511+0000","last_clean":"2024-04-25T22:40:41.354511+0000","last_became_active":"2024-04-25T22:40:36.294114+0000","last_became_peered":"2024-04-25T22:40:36.294114+0000","last_unstale":"2024-04-25T22:40:41.354511+0000","last_undegraded":"2024-04-25T22:40:41.354511+0000","last_fullsized":"2024-04-25T22:40:41.354511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:39:22.907771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361357+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:40:41.361357+0000","last_peered":"2024-04-25T22:40:41.361357+0000","last_clean":"2024-04-25T22:40:41.361357+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:40:41.361357+0000","last_undegraded":"2024-04-25T22:40:41.361357+0000","last_fullsized":"2024-04-25T22:40:41.361357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361192+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:40:41.361192+0000","last_peered":"2024-04-25T22:40:41.361192+0000","last_clean":"2024-04-25T22:40:41.361192+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:40:41.361192+0000","last_undegraded":"2024-04-25T22:40:41.361192+0000","last_fullsized":"2024-04-25T22:40:41.361192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360899+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:40:41.360899+0000","last_peered":"2024-04-25T22:40:41.360899+0000","last_clean":"2024-04-25T22:40:41.360899+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:40:41.360899+0000","last_undegraded":"2024-04-25T22:40:41.360899+0000","last_fullsized":"2024-04-25T22:40:41.360899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356162+0000","last_change":"2024-04-25T22:40:14.625922+0000","last_active":"2024-04-25T22:40:41.356162+0000","last_peered":"2024-04-25T22:40:41.356162+0000","last_clean":"2024-04-25T22:40:41.356162+0000","last_became_active":"2024-04-25T22:40:14.624594+0000","last_became_peered":"2024-04-25T22:40:14.624594+0000","last_unstale":"2024-04-25T22:40:41.356162+0000","last_undegraded":"2024-04-25T22:40:41.356162+0000","last_fullsized":"2024-04-25T22:40:41.356162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355788+0000","last_change":"2024-04-25T22:40:36.298225+0000","last_active":"2024-04-25T22:40:41.355788+0000","last_peered":"2024-04-25T22:40:41.355788+0000","last_clean":"2024-04-25T22:40:41.355788+0000","last_became_active":"2024-04-25T22:40:36.296299+0000","last_became_peered":"2024-04-25T22:40:36.296299+0000","last_unstale":"2024-04-25T22:40:41.355788+0000","last_undegraded":"2024-04-25T22:40:41.355788+0000","last_fullsized":"2024-04-25T22:40:41.355788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:02.464879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362915+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:40:41.362915+0000","last_peered":"2024-04-25T22:40:41.362915+0000","last_clean":"2024-04-25T22:40:41.362915+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:40:41.362915+0000","last_undegraded":"2024-04-25T22:40:41.362915+0000","last_fullsized":"2024-04-25T22:40:41.362915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361476+0000","last_change":"2024-04-25T22:40:36.305351+0000","last_active":"2024-04-25T22:40:41.361476+0000","last_peered":"2024-04-25T22:40:41.361476+0000","last_clean":"2024-04-25T22:40:41.361476+0000","last_became_active":"2024-04-25T22:40:36.303042+0000","last_became_peered":"2024-04-25T22:40:36.303042+0000","last_unstale":"2024-04-25T22:40:41.361476+0000","last_undegraded":"2024-04-25T22:40:41.361476+0000","last_fullsized":"2024-04-25T22:40:41.361476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:37.971547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354785+0000","last_change":"2024-04-25T22:40:36.296904+0000","last_active":"2024-04-25T22:40:41.354785+0000","last_peered":"2024-04-25T22:40:41.354785+0000","last_clean":"2024-04-25T22:40:41.354785+0000","last_became_active":"2024-04-25T22:40:36.295964+0000","last_became_peered":"2024-04-25T22:40:36.295964+0000","last_unstale":"2024-04-25T22:40:41.354785+0000","last_undegraded":"2024-04-25T22:40:41.354785+0000","last_fullsized":"2024-04-25T22:40:41.354785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:24.977111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361635+0000","last_change":"2024-04-25T22:40:14.616800+0000","last_active":"2024-04-25T22:40:41.361635+0000","last_peered":"2024-04-25T22:40:41.361635+0000","last_clean":"2024-04-25T22:40:41.361635+0000","last_became_active":"2024-04-25T22:40:14.612887+0000","last_became_peered":"2024-04-25T22:40:14.612887+0000","last_unstale":"2024-04-25T22:40:41.361635+0000","last_undegraded":"2024-04-25T22:40:41.361635+0000","last_fullsized":"2024-04-25T22:40:41.361635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361452+0000","last_change":"2024-04-25T22:40:14.615520+0000","last_active":"2024-04-25T22:40:41.361452+0000","last_peered":"2024-04-25T22:40:41.361452+0000","last_clean":"2024-04-25T22:40:41.361452+0000","last_became_active":"2024-04-25T22:40:14.613556+0000","last_became_peered":"2024-04-25T22:40:14.613556+0000","last_unstale":"2024-04-25T22:40:41.361452+0000","last_undegraded":"2024-04-25T22:40:41.361452+0000","last_fullsized":"2024-04-25T22:40:41.361452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360904+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:40:41.360904+0000","last_peered":"2024-04-25T22:40:41.360904+0000","last_clean":"2024-04-25T22:40:41.360904+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:40:41.360904+0000","last_undegraded":"2024-04-25T22:40:41.360904+0000","last_fullsized":"2024-04-25T22:40:41.360904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.357038+0000","last_change":"2024-04-25T22:40:14.628222+0000","last_active":"2024-04-25T22:40:41.357038+0000","last_peered":"2024-04-25T22:40:41.357038+0000","last_clean":"2024-04-25T22:40:41.357038+0000","last_became_active":"2024-04-25T22:40:14.626913+0000","last_became_peered":"2024-04-25T22:40:14.626913+0000","last_unstale":"2024-04-25T22:40:41.357038+0000","last_undegraded":"2024-04-25T22:40:41.357038+0000","last_fullsized":"2024-04-25T22:40:41.357038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356503+0000","last_change":"2024-04-25T22:40:36.300373+0000","last_active":"2024-04-25T22:40:41.356503+0000","last_peered":"2024-04-25T22:40:41.356503+0000","last_clean":"2024-04-25T22:40:41.356503+0000","last_became_active":"2024-04-25T22:40:36.299647+0000","last_became_peered":"2024-04-25T22:40:36.299647+0000","last_unstale":"2024-04-25T22:40:41.356503+0000","last_undegraded":"2024-04-25T22:40:41.356503+0000","last_fullsized":"2024-04-25T22:40:41.356503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:19.327397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355804+0000","last_change":"2024-04-25T22:40:14.623704+0000","last_active":"2024-04-25T22:40:41.355804+0000","last_peered":"2024-04-25T22:40:41.355804+0000","last_clean":"2024-04-25T22:40:41.355804+0000","last_became_active":"2024-04-25T22:40:14.623146+0000","last_became_peered":"2024-04-25T22:40:14.623146+0000","last_unstale":"2024-04-25T22:40:41.355804+0000","last_undegraded":"2024-04-25T22:40:41.355804+0000","last_fullsized":"2024-04-25T22:40:41.355804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362269+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:40:41.362269+0000","last_peered":"2024-04-25T22:40:41.362269+0000","last_clean":"2024-04-25T22:40:41.362269+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:40:41.362269+0000","last_undegraded":"2024-04-25T22:40:41.362269+0000","last_fullsized":"2024-04-25T22:40:41.362269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361789+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:40:41.361789+0000","last_peered":"2024-04-25T22:40:41.361789+0000","last_clean":"2024-04-25T22:40:41.361789+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:40:41.361789+0000","last_undegraded":"2024-04-25T22:40:41.361789+0000","last_fullsized":"2024-04-25T22:40:41.361789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360908+0000","last_change":"2024-04-25T22:40:36.305858+0000","last_active":"2024-04-25T22:40:41.360908+0000","last_peered":"2024-04-25T22:40:41.360908+0000","last_clean":"2024-04-25T22:40:41.360908+0000","last_became_active":"2024-04-25T22:40:36.304730+0000","last_became_peered":"2024-04-25T22:40:36.304730+0000","last_unstale":"2024-04-25T22:40:41.360908+0000","last_undegraded":"2024-04-25T22:40:41.360908+0000","last_fullsized":"2024-04-25T22:40:41.360908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:44.949501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.353984+0000","last_change":"2024-04-25T22:40:14.617094+0000","last_active":"2024-04-25T22:40:41.353984+0000","last_peered":"2024-04-25T22:40:41.353984+0000","last_clean":"2024-04-25T22:40:41.353984+0000","last_became_active":"2024-04-25T22:40:14.615818+0000","last_became_peered":"2024-04-25T22:40:14.615818+0000","last_unstale":"2024-04-25T22:40:41.353984+0000","last_undegraded":"2024-04-25T22:40:41.353984+0000","last_fullsized":"2024-04-25T22:40:41.353984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:30:53.093623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354010+0000","last_change":"2024-04-25T22:40:36.293289+0000","last_active":"2024-04-25T22:40:41.354010+0000","last_peered":"2024-04-25T22:40:41.354010+0000","last_clean":"2024-04-25T22:40:41.354010+0000","last_became_active":"2024-04-25T22:40:36.292483+0000","last_became_peered":"2024-04-25T22:40:36.292483+0000","last_unstale":"2024-04-25T22:40:41.354010+0000","last_undegraded":"2024-04-25T22:40:41.354010+0000","last_fullsized":"2024-04-25T22:40:41.354010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:51.686908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363394+0000","last_change":"2024-04-25T22:40:36.304773+0000","last_active":"2024-04-25T22:40:41.363394+0000","last_peered":"2024-04-25T22:40:41.363394+0000","last_clean":"2024-04-25T22:40:41.363394+0000","last_became_active":"2024-04-25T22:40:36.304073+0000","last_became_peered":"2024-04-25T22:40:36.304073+0000","last_unstale":"2024-04-25T22:40:41.363394+0000","last_undegraded":"2024-04-25T22:40:41.363394+0000","last_fullsized":"2024-04-25T22:40:41.363394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:02.464879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356234+0000","last_change":"2024-04-25T22:40:14.625933+0000","last_active":"2024-04-25T22:40:41.356234+0000","last_peered":"2024-04-25T22:40:41.356234+0000","last_clean":"2024-04-25T22:40:41.356234+0000","last_became_active":"2024-04-25T22:40:14.625123+0000","last_became_peered":"2024-04-25T22:40:14.625123+0000","last_unstale":"2024-04-25T22:40:41.356234+0000","last_undegraded":"2024-04-25T22:40:41.356234+0000","last_fullsized":"2024-04-25T22:40:41.356234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363088+0000","last_change":"2024-04-25T22:40:14.630596+0000","last_active":"2024-04-25T22:40:41.363088+0000","last_peered":"2024-04-25T22:40:41.363088+0000","last_clean":"2024-04-25T22:40:41.363088+0000","last_became_active":"2024-04-25T22:40:14.625407+0000","last_became_peered":"2024-04-25T22:40:14.625407+0000","last_unstale":"2024-04-25T22:40:41.363088+0000","last_undegraded":"2024-04-25T22:40:41.363088+0000","last_fullsized":"2024-04-25T22:40:41.363088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:20:05.398182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361749+0000","last_change":"2024-04-25T22:40:36.303740+0000","last_active":"2024-04-25T22:40:41.361749+0000","last_peered":"2024-04-25T22:40:41.361749+0000","last_clean":"2024-04-25T22:40:41.361749+0000","last_became_active":"2024-04-25T22:40:36.303305+0000","last_became_peered":"2024-04-25T22:40:36.303305+0000","last_unstale":"2024-04-25T22:40:41.361749+0000","last_undegraded":"2024-04-25T22:40:41.361749+0000","last_fullsized":"2024-04-25T22:40:41.361749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:03.272640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355393+0000","last_change":"2024-04-25T22:40:14.620608+0000","last_active":"2024-04-25T22:40:41.355393+0000","last_peered":"2024-04-25T22:40:41.355393+0000","last_clean":"2024-04-25T22:40:41.355393+0000","last_became_active":"2024-04-25T22:40:14.618171+0000","last_became_peered":"2024-04-25T22:40:14.618171+0000","last_unstale":"2024-04-25T22:40:41.355393+0000","last_undegraded":"2024-04-25T22:40:41.355393+0000","last_fullsized":"2024-04-25T22:40:41.355393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361247+0000","last_change":"2024-04-25T22:40:36.305391+0000","last_active":"2024-04-25T22:40:41.361247+0000","last_peered":"2024-04-25T22:40:41.361247+0000","last_clean":"2024-04-25T22:40:41.361247+0000","last_became_active":"2024-04-25T22:40:36.302601+0000","last_became_peered":"2024-04-25T22:40:36.302601+0000","last_unstale":"2024-04-25T22:40:41.361247+0000","last_undegraded":"2024-04-25T22:40:41.361247+0000","last_fullsized":"2024-04-25T22:40:41.361247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:54.909669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354087+0000","last_change":"2024-04-25T22:40:14.618468+0000","last_active":"2024-04-25T22:40:41.354087+0000","last_peered":"2024-04-25T22:40:41.354087+0000","last_clean":"2024-04-25T22:40:41.354087+0000","last_became_active":"2024-04-25T22:40:14.617312+0000","last_became_peered":"2024-04-25T22:40:14.617312+0000","last_unstale":"2024-04-25T22:40:41.354087+0000","last_undegraded":"2024-04-25T22:40:41.354087+0000","last_fullsized":"2024-04-25T22:40:41.354087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:12.679354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361922+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:40:41.361922+0000","last_peered":"2024-04-25T22:40:41.361922+0000","last_clean":"2024-04-25T22:40:41.361922+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:40:41.361922+0000","last_undegraded":"2024-04-25T22:40:41.361922+0000","last_fullsized":"2024-04-25T22:40:41.361922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355454+0000","last_change":"2024-04-25T22:40:36.296749+0000","last_active":"2024-04-25T22:40:41.355454+0000","last_peered":"2024-04-25T22:40:41.355454+0000","last_clean":"2024-04-25T22:40:41.355454+0000","last_became_active":"2024-04-25T22:40:36.295933+0000","last_became_peered":"2024-04-25T22:40:36.295933+0000","last_unstale":"2024-04-25T22:40:41.355454+0000","last_undegraded":"2024-04-25T22:40:41.355454+0000","last_fullsized":"2024-04-25T22:40:41.355454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:18.491547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362634+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:40:41.362634+0000","last_peered":"2024-04-25T22:40:41.362634+0000","last_clean":"2024-04-25T22:40:41.362634+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:40:41.362634+0000","last_undegraded":"2024-04-25T22:40:41.362634+0000","last_fullsized":"2024-04-25T22:40:41.362634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355458+0000","last_change":"2024-04-25T22:40:36.298200+0000","last_active":"2024-04-25T22:40:41.355458+0000","last_peered":"2024-04-25T22:40:41.355458+0000","last_clean":"2024-04-25T22:40:41.355458+0000","last_became_active":"2024-04-25T22:40:36.296613+0000","last_became_peered":"2024-04-25T22:40:36.296613+0000","last_unstale":"2024-04-25T22:40:41.355458+0000","last_undegraded":"2024-04-25T22:40:41.355458+0000","last_fullsized":"2024-04-25T22:40:41.355458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:12.611590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354817+0000","last_change":"2024-04-25T22:40:13.581241+0000","last_active":"2024-04-25T22:40:41.354817+0000","last_peered":"2024-04-25T22:40:41.354817+0000","last_clean":"2024-04-25T22:40:41.354817+0000","last_became_active":"2024-04-25T22:40:13.580442+0000","last_became_peered":"2024-04-25T22:40:13.580442+0000","last_unstale":"2024-04-25T22:40:41.354817+0000","last_undegraded":"2024-04-25T22:40:41.354817+0000","last_fullsized":"2024-04-25T22:40:41.354817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:50:49.280995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356712+0000","last_change":"2024-04-25T22:40:14.631577+0000","last_active":"2024-04-25T22:40:41.356712+0000","last_peered":"2024-04-25T22:40:41.356712+0000","last_clean":"2024-04-25T22:40:41.356712+0000","last_became_active":"2024-04-25T22:40:14.630371+0000","last_became_peered":"2024-04-25T22:40:14.630371+0000","last_unstale":"2024-04-25T22:40:41.356712+0000","last_undegraded":"2024-04-25T22:40:41.356712+0000","last_fullsized":"2024-04-25T22:40:41.356712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360875+0000","last_change":"2024-04-25T22:40:36.306844+0000","last_active":"2024-04-25T22:40:41.360875+0000","last_peered":"2024-04-25T22:40:41.360875+0000","last_clean":"2024-04-25T22:40:41.360875+0000","last_became_active":"2024-04-25T22:40:36.303223+0000","last_became_peered":"2024-04-25T22:40:36.303223+0000","last_unstale":"2024-04-25T22:40:41.360875+0000","last_undegraded":"2024-04-25T22:40:41.360875+0000","last_fullsized":"2024-04-25T22:40:41.360875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:21.069965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356213+0000","last_change":"2024-04-25T22:40:14.630012+0000","last_active":"2024-04-25T22:40:41.356213+0000","last_peered":"2024-04-25T22:40:41.356213+0000","last_clean":"2024-04-25T22:40:41.356213+0000","last_became_active":"2024-04-25T22:40:14.628677+0000","last_became_peered":"2024-04-25T22:40:14.628677+0000","last_unstale":"2024-04-25T22:40:41.356213+0000","last_undegraded":"2024-04-25T22:40:41.356213+0000","last_fullsized":"2024-04-25T22:40:41.356213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361374+0000","last_change":"2024-04-25T22:40:13.599918+0000","last_active":"2024-04-25T22:40:41.361374+0000","last_peered":"2024-04-25T22:40:41.361374+0000","last_clean":"2024-04-25T22:40:41.361374+0000","last_became_active":"2024-04-25T22:40:13.596461+0000","last_became_peered":"2024-04-25T22:40:13.596461+0000","last_unstale":"2024-04-25T22:40:41.361374+0000","last_undegraded":"2024-04-25T22:40:41.361374+0000","last_fullsized":"2024-04-25T22:40:41.361374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:41:51.887162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363904+0000","last_change":"2024-04-25T22:40:13.598294+0000","last_active":"2024-04-25T22:40:41.363904+0000","last_peered":"2024-04-25T22:40:41.363904+0000","last_clean":"2024-04-25T22:40:41.363904+0000","last_became_active":"2024-04-25T22:40:13.596687+0000","last_became_peered":"2024-04-25T22:40:13.596687+0000","last_unstale":"2024-04-25T22:40:41.363904+0000","last_undegraded":"2024-04-25T22:40:41.363904+0000","last_fullsized":"2024-04-25T22:40:41.363904+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:50:49.280995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360548+0000","last_change":"2024-04-25T22:40:36.302843+0000","last_active":"2024-04-25T22:40:41.360548+0000","last_peered":"2024-04-25T22:40:41.360548+0000","last_clean":"2024-04-25T22:40:41.360548+0000","last_became_active":"2024-04-25T22:40:36.302275+0000","last_became_peered":"2024-04-25T22:40:36.302275+0000","last_unstale":"2024-04-25T22:40:41.360548+0000","last_undegraded":"2024-04-25T22:40:41.360548+0000","last_fullsized":"2024-04-25T22:40:41.360548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:24.977111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362453+0000","last_change":"2024-04-25T22:40:36.304995+0000","last_active":"2024-04-25T22:40:41.362453+0000","last_peered":"2024-04-25T22:40:41.362453+0000","last_clean":"2024-04-25T22:40:41.362453+0000","last_became_active":"2024-04-25T22:40:36.304133+0000","last_became_peered":"2024-04-25T22:40:36.304133+0000","last_unstale":"2024-04-25T22:40:41.362453+0000","last_undegraded":"2024-04-25T22:40:41.362453+0000","last_fullsized":"2024-04-25T22:40:41.362453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:06:24.787279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354397+0000","last_change":"2024-04-25T22:40:36.295350+0000","last_active":"2024-04-25T22:40:41.354397+0000","last_peered":"2024-04-25T22:40:41.354397+0000","last_clean":"2024-04-25T22:40:41.354397+0000","last_became_active":"2024-04-25T22:40:36.294081+0000","last_became_peered":"2024-04-25T22:40:36.294081+0000","last_unstale":"2024-04-25T22:40:41.354397+0000","last_undegraded":"2024-04-25T22:40:41.354397+0000","last_fullsized":"2024-04-25T22:40:41.354397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:57:06.769650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363790+0000","last_change":"2024-04-25T22:40:13.601404+0000","last_active":"2024-04-25T22:40:41.363790+0000","last_peered":"2024-04-25T22:40:41.363790+0000","last_clean":"2024-04-25T22:40:41.363790+0000","last_became_active":"2024-04-25T22:40:13.600688+0000","last_became_peered":"2024-04-25T22:40:13.600688+0000","last_unstale":"2024-04-25T22:40:41.363790+0000","last_undegraded":"2024-04-25T22:40:41.363790+0000","last_fullsized":"2024-04-25T22:40:41.363790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:36.157648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361796+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:40:41.361796+0000","last_peered":"2024-04-25T22:40:41.361796+0000","last_clean":"2024-04-25T22:40:41.361796+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:40:41.361796+0000","last_undegraded":"2024-04-25T22:40:41.361796+0000","last_fullsized":"2024-04-25T22:40:41.361796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362822+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:40:41.362822+0000","last_peered":"2024-04-25T22:40:41.362822+0000","last_clean":"2024-04-25T22:40:41.362822+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:40:41.362822+0000","last_undegraded":"2024-04-25T22:40:41.362822+0000","last_fullsized":"2024-04-25T22:40:41.362822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355530+0000","last_change":"2024-04-25T22:40:14.625843+0000","last_active":"2024-04-25T22:40:41.355530+0000","last_peered":"2024-04-25T22:40:41.355530+0000","last_clean":"2024-04-25T22:40:41.355530+0000","last_became_active":"2024-04-25T22:40:14.625187+0000","last_became_peered":"2024-04-25T22:40:14.625187+0000","last_unstale":"2024-04-25T22:40:41.355530+0000","last_undegraded":"2024-04-25T22:40:41.355530+0000","last_fullsized":"2024-04-25T22:40:41.355530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355803+0000","last_change":"2024-04-25T22:40:13.581857+0000","last_active":"2024-04-25T22:40:41.355803+0000","last_peered":"2024-04-25T22:40:41.355803+0000","last_clean":"2024-04-25T22:40:41.355803+0000","last_became_active":"2024-04-25T22:40:13.581263+0000","last_became_peered":"2024-04-25T22:40:13.581263+0000","last_unstale":"2024-04-25T22:40:41.355803+0000","last_undegraded":"2024-04-25T22:40:41.355803+0000","last_fullsized":"2024-04-25T22:40:41.355803+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:54:01.709709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362481+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:40:41.362481+0000","last_peered":"2024-04-25T22:40:41.362481+0000","last_clean":"2024-04-25T22:40:41.362481+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:40:41.362481+0000","last_undegraded":"2024-04-25T22:40:41.362481+0000","last_fullsized":"2024-04-25T22:40:41.362481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362917+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:40:41.362917+0000","last_peered":"2024-04-25T22:40:41.362917+0000","last_clean":"2024-04-25T22:40:41.362917+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:40:41.362917+0000","last_undegraded":"2024-04-25T22:40:41.362917+0000","last_fullsized":"2024-04-25T22:40:41.362917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363547+0000","last_change":"2024-04-25T22:40:14.621941+0000","last_active":"2024-04-25T22:40:41.363547+0000","last_peered":"2024-04-25T22:40:41.363547+0000","last_clean":"2024-04-25T22:40:41.363547+0000","last_became_active":"2024-04-25T22:40:14.614196+0000","last_became_peered":"2024-04-25T22:40:14.614196+0000","last_unstale":"2024-04-25T22:40:41.363547+0000","last_undegraded":"2024-04-25T22:40:41.363547+0000","last_fullsized":"2024-04-25T22:40:41.363547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:24.895025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361217+0000","last_change":"2024-04-25T22:40:36.305242+0000","last_active":"2024-04-25T22:40:41.361217+0000","last_peered":"2024-04-25T22:40:41.361217+0000","last_clean":"2024-04-25T22:40:41.361217+0000","last_became_active":"2024-04-25T22:40:36.302259+0000","last_became_peered":"2024-04-25T22:40:36.302259+0000","last_unstale":"2024-04-25T22:40:41.361217+0000","last_undegraded":"2024-04-25T22:40:41.361217+0000","last_fullsized":"2024-04-25T22:40:41.361217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:48.252489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362510+0000","last_change":"2024-04-25T22:40:14.614275+0000","last_active":"2024-04-25T22:40:41.362510+0000","last_peered":"2024-04-25T22:40:41.362510+0000","last_clean":"2024-04-25T22:40:41.362510+0000","last_became_active":"2024-04-25T22:40:14.613038+0000","last_became_peered":"2024-04-25T22:40:14.613038+0000","last_unstale":"2024-04-25T22:40:41.362510+0000","last_undegraded":"2024-04-25T22:40:41.362510+0000","last_fullsized":"2024-04-25T22:40:41.362510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:14:02.343388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354129+0000","last_change":"2024-04-25T22:40:36.293392+0000","last_active":"2024-04-25T22:40:41.354129+0000","last_peered":"2024-04-25T22:40:41.354129+0000","last_clean":"2024-04-25T22:40:41.354129+0000","last_became_active":"2024-04-25T22:40:36.292567+0000","last_became_peered":"2024-04-25T22:40:36.292567+0000","last_unstale":"2024-04-25T22:40:41.354129+0000","last_undegraded":"2024-04-25T22:40:41.354129+0000","last_fullsized":"2024-04-25T22:40:41.354129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:21.419443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356361+0000","last_change":"2024-04-25T22:40:14.627280+0000","last_active":"2024-04-25T22:40:41.356361+0000","last_peered":"2024-04-25T22:40:41.356361+0000","last_clean":"2024-04-25T22:40:41.356361+0000","last_became_active":"2024-04-25T22:40:14.624656+0000","last_became_peered":"2024-04-25T22:40:14.624656+0000","last_unstale":"2024-04-25T22:40:41.356361+0000","last_undegraded":"2024-04-25T22:40:41.356361+0000","last_fullsized":"2024-04-25T22:40:41.356361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":230,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362199+0000","last_change":"2024-04-25T22:40:04.317146+0000","last_active":"2024-04-25T22:40:41.362199+0000","last_peered":"2024-04-25T22:40:41.362199+0000","last_clean":"2024-04-25T22:40:41.362199+0000","last_became_active":"2024-04-25T22:40:04.316527+0000","last_became_peered":"2024-04-25T22:40:04.316527+0000","last_unstale":"2024-04-25T22:40:41.362199+0000","last_undegraded":"2024-04-25T22:40:41.362199+0000","last_fullsized":"2024-04-25T22:40:41.362199+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:25.669997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363214+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:40:41.363214+0000","last_peered":"2024-04-25T22:40:41.363214+0000","last_clean":"2024-04-25T22:40:41.363214+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:40:41.363214+0000","last_undegraded":"2024-04-25T22:40:41.363214+0000","last_fullsized":"2024-04-25T22:40:41.363214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355004+0000","last_change":"2024-04-25T22:40:13.591980+0000","last_active":"2024-04-25T22:40:41.355004+0000","last_peered":"2024-04-25T22:40:41.355004+0000","last_clean":"2024-04-25T22:40:41.355004+0000","last_became_active":"2024-04-25T22:40:13.591152+0000","last_became_peered":"2024-04-25T22:40:13.591152+0000","last_unstale":"2024-04-25T22:40:41.355004+0000","last_undegraded":"2024-04-25T22:40:41.355004+0000","last_fullsized":"2024-04-25T22:40:41.355004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363654+0000","last_change":"2024-04-25T22:40:14.621472+0000","last_active":"2024-04-25T22:40:41.363654+0000","last_peered":"2024-04-25T22:40:41.363654+0000","last_clean":"2024-04-25T22:40:41.363654+0000","last_became_active":"2024-04-25T22:40:14.613608+0000","last_became_peered":"2024-04-25T22:40:14.613608+0000","last_unstale":"2024-04-25T22:40:41.363654+0000","last_undegraded":"2024-04-25T22:40:41.363654+0000","last_fullsized":"2024-04-25T22:40:41.363654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:51.686908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361930+0000","last_change":"2024-04-25T22:40:09.502444+0000","last_active":"2024-04-25T22:40:41.361930+0000","last_peered":"2024-04-25T22:40:41.361930+0000","last_clean":"2024-04-25T22:40:41.361930+0000","last_became_active":"2024-04-25T22:40:09.501576+0000","last_became_peered":"2024-04-25T22:40:09.501576+0000","last_unstale":"2024-04-25T22:40:41.361930+0000","last_undegraded":"2024-04-25T22:40:41.361930+0000","last_fullsized":"2024-04-25T22:40:41.361930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:35:14.955359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354744+0000","last_change":"2024-04-25T22:40:13.579430+0000","last_active":"2024-04-25T22:40:41.354744+0000","last_peered":"2024-04-25T22:40:41.354744+0000","last_clean":"2024-04-25T22:40:41.354744+0000","last_became_active":"2024-04-25T22:40:13.578601+0000","last_became_peered":"2024-04-25T22:40:13.578601+0000","last_unstale":"2024-04-25T22:40:41.354744+0000","last_undegraded":"2024-04-25T22:40:41.354744+0000","last_fullsized":"2024-04-25T22:40:41.354744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:50.274924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355958+0000","last_change":"2024-04-25T22:40:36.298928+0000","last_active":"2024-04-25T22:40:41.355958+0000","last_peered":"2024-04-25T22:40:41.355958+0000","last_clean":"2024-04-25T22:40:41.355958+0000","last_became_active":"2024-04-25T22:40:36.298266+0000","last_became_peered":"2024-04-25T22:40:36.298266+0000","last_unstale":"2024-04-25T22:40:41.355958+0000","last_undegraded":"2024-04-25T22:40:41.355958+0000","last_fullsized":"2024-04-25T22:40:41.355958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:49.281475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355100+0000","last_change":"2024-04-25T22:40:09.501323+0000","last_active":"2024-04-25T22:40:41.355100+0000","last_peered":"2024-04-25T22:40:41.355100+0000","last_clean":"2024-04-25T22:40:41.355100+0000","last_became_active":"2024-04-25T22:40:09.500499+0000","last_became_peered":"2024-04-25T22:40:09.500499+0000","last_unstale":"2024-04-25T22:40:41.355100+0000","last_undegraded":"2024-04-25T22:40:41.355100+0000","last_fullsized":"2024-04-25T22:40:41.355100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:30.289572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360548+0000","last_change":"2024-04-25T22:40:36.303534+0000","last_active":"2024-04-25T22:40:41.360548+0000","last_peered":"2024-04-25T22:40:41.360548+0000","last_clean":"2024-04-25T22:40:41.360548+0000","last_became_active":"2024-04-25T22:40:36.302351+0000","last_became_peered":"2024-04-25T22:40:36.302351+0000","last_unstale":"2024-04-25T22:40:41.360548+0000","last_undegraded":"2024-04-25T22:40:41.360548+0000","last_fullsized":"2024-04-25T22:40:41.360548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:31:09.162739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356459+0000","last_change":"2024-04-25T22:40:14.628007+0000","last_active":"2024-04-25T22:40:41.356459+0000","last_peered":"2024-04-25T22:40:41.356459+0000","last_clean":"2024-04-25T22:40:41.356459+0000","last_became_active":"2024-04-25T22:40:14.625425+0000","last_became_peered":"2024-04-25T22:40:14.625425+0000","last_unstale":"2024-04-25T22:40:41.356459+0000","last_undegraded":"2024-04-25T22:40:41.356459+0000","last_fullsized":"2024-04-25T22:40:41.356459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363258+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:40:41.363258+0000","last_peered":"2024-04-25T22:40:41.363258+0000","last_clean":"2024-04-25T22:40:41.363258+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:40:41.363258+0000","last_undegraded":"2024-04-25T22:40:41.363258+0000","last_fullsized":"2024-04-25T22:40:41.363258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362815+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:40:41.362815+0000","last_peered":"2024-04-25T22:40:41.362815+0000","last_clean":"2024-04-25T22:40:41.362815+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:40:41.362815+0000","last_undegraded":"2024-04-25T22:40:41.362815+0000","last_fullsized":"2024-04-25T22:40:41.362815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356113+0000","last_change":"2024-04-25T22:40:14.622442+0000","last_active":"2024-04-25T22:40:41.356113+0000","last_peered":"2024-04-25T22:40:41.356113+0000","last_clean":"2024-04-25T22:40:41.356113+0000","last_became_active":"2024-04-25T22:40:14.621130+0000","last_became_peered":"2024-04-25T22:40:14.621130+0000","last_unstale":"2024-04-25T22:40:41.356113+0000","last_undegraded":"2024-04-25T22:40:41.356113+0000","last_fullsized":"2024-04-25T22:40:41.356113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363897+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:40:41.363897+0000","last_peered":"2024-04-25T22:40:41.363897+0000","last_clean":"2024-04-25T22:40:41.363897+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:40:41.363897+0000","last_undegraded":"2024-04-25T22:40:41.363897+0000","last_fullsized":"2024-04-25T22:40:41.363897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356455+0000","last_change":"2024-04-25T22:40:09.501325+0000","last_active":"2024-04-25T22:40:41.356455+0000","last_peered":"2024-04-25T22:40:41.356455+0000","last_clean":"2024-04-25T22:40:41.356455+0000","last_became_active":"2024-04-25T22:40:09.500542+0000","last_became_peered":"2024-04-25T22:40:09.500542+0000","last_unstale":"2024-04-25T22:40:41.356455+0000","last_undegraded":"2024-04-25T22:40:41.356455+0000","last_fullsized":"2024-04-25T22:40:41.356455+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:34:38.234538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360953+0000","last_change":"2024-04-25T22:40:36.306443+0000","last_active":"2024-04-25T22:40:41.360953+0000","last_peered":"2024-04-25T22:40:41.360953+0000","last_clean":"2024-04-25T22:40:41.360953+0000","last_became_active":"2024-04-25T22:40:36.303568+0000","last_became_peered":"2024-04-25T22:40:36.303568+0000","last_unstale":"2024-04-25T22:40:41.360953+0000","last_undegraded":"2024-04-25T22:40:41.360953+0000","last_fullsized":"2024-04-25T22:40:41.360953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:43:42.692718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356448+0000","last_change":"2024-04-25T22:40:13.591256+0000","last_active":"2024-04-25T22:40:41.356448+0000","last_peered":"2024-04-25T22:40:41.356448+0000","last_clean":"2024-04-25T22:40:41.356448+0000","last_became_active":"2024-04-25T22:40:13.590744+0000","last_became_peered":"2024-04-25T22:40:13.590744+0000","last_unstale":"2024-04-25T22:40:41.356448+0000","last_undegraded":"2024-04-25T22:40:41.356448+0000","last_fullsized":"2024-04-25T22:40:41.356448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:50.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355865+0000","last_change":"2024-04-25T22:40:36.300605+0000","last_active":"2024-04-25T22:40:41.355865+0000","last_peered":"2024-04-25T22:40:41.355865+0000","last_clean":"2024-04-25T22:40:41.355865+0000","last_became_active":"2024-04-25T22:40:36.299998+0000","last_became_peered":"2024-04-25T22:40:36.299998+0000","last_unstale":"2024-04-25T22:40:41.355865+0000","last_undegraded":"2024-04-25T22:40:41.355865+0000","last_fullsized":"2024-04-25T22:40:41.355865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:49.794261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361244+0000","last_change":"2024-04-25T22:40:36.305326+0000","last_active":"2024-04-25T22:40:41.361244+0000","last_peered":"2024-04-25T22:40:41.361244+0000","last_clean":"2024-04-25T22:40:41.361244+0000","last_became_active":"2024-04-25T22:40:36.302867+0000","last_became_peered":"2024-04-25T22:40:36.302867+0000","last_unstale":"2024-04-25T22:40:41.361244+0000","last_undegraded":"2024-04-25T22:40:41.361244+0000","last_fullsized":"2024-04-25T22:40:41.361244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:19.327397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.357090+0000","last_change":"2024-04-25T22:40:13.592055+0000","last_active":"2024-04-25T22:40:41.357090+0000","last_peered":"2024-04-25T22:40:41.357090+0000","last_clean":"2024-04-25T22:40:41.357090+0000","last_became_active":"2024-04-25T22:40:13.591169+0000","last_became_peered":"2024-04-25T22:40:13.591169+0000","last_unstale":"2024-04-25T22:40:41.357090+0000","last_undegraded":"2024-04-25T22:40:41.357090+0000","last_fullsized":"2024-04-25T22:40:41.357090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:33.458799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356853+0000","last_change":"2024-04-25T22:40:09.501358+0000","last_active":"2024-04-25T22:40:41.356853+0000","last_peered":"2024-04-25T22:40:41.356853+0000","last_clean":"2024-04-25T22:40:41.356853+0000","last_became_active":"2024-04-25T22:40:09.500626+0000","last_became_peered":"2024-04-25T22:40:09.500626+0000","last_unstale":"2024-04-25T22:40:41.356853+0000","last_undegraded":"2024-04-25T22:40:41.356853+0000","last_fullsized":"2024-04-25T22:40:41.356853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:55.182967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354447+0000","last_change":"2024-04-25T22:40:14.618363+0000","last_active":"2024-04-25T22:40:41.354447+0000","last_peered":"2024-04-25T22:40:41.354447+0000","last_clean":"2024-04-25T22:40:41.354447+0000","last_became_active":"2024-04-25T22:40:14.617599+0000","last_became_peered":"2024-04-25T22:40:14.617599+0000","last_unstale":"2024-04-25T22:40:41.354447+0000","last_undegraded":"2024-04-25T22:40:41.354447+0000","last_fullsized":"2024-04-25T22:40:41.354447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"22'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356747+0000","last_change":"2024-04-25T22:40:13.593400+0000","last_active":"2024-04-25T22:40:41.356747+0000","last_peered":"2024-04-25T22:40:41.356747+0000","last_clean":"2024-04-25T22:40:41.356747+0000","last_became_active":"2024-04-25T22:40:13.592338+0000","last_became_peered":"2024-04-25T22:40:13.592338+0000","last_unstale":"2024-04-25T22:40:41.356747+0000","last_undegraded":"2024-04-25T22:40:41.356747+0000","last_fullsized":"2024-04-25T22:40:41.356747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.364044+0000","last_change":"2024-04-25T22:40:09.500948+0000","last_active":"2024-04-25T22:40:41.364044+0000","last_peered":"2024-04-25T22:40:41.364044+0000","last_clean":"2024-04-25T22:40:41.364044+0000","last_became_active":"2024-04-25T22:40:09.500236+0000","last_became_peered":"2024-04-25T22:40:09.500236+0000","last_unstale":"2024-04-25T22:40:41.364044+0000","last_undegraded":"2024-04-25T22:40:41.364044+0000","last_fullsized":"2024-04-25T22:40:41.364044+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:02.375961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360763+0000","last_change":"2024-04-25T22:40:36.306177+0000","last_active":"2024-04-25T22:40:41.360763+0000","last_peered":"2024-04-25T22:40:41.360763+0000","last_clean":"2024-04-25T22:40:41.360763+0000","last_became_active":"2024-04-25T22:40:36.304767+0000","last_became_peered":"2024-04-25T22:40:36.304767+0000","last_unstale":"2024-04-25T22:40:41.360763+0000","last_undegraded":"2024-04-25T22:40:41.360763+0000","last_fullsized":"2024-04-25T22:40:41.360763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:31.194700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362158+0000","last_change":"2024-04-25T22:40:14.619806+0000","last_active":"2024-04-25T22:40:41.362158+0000","last_peered":"2024-04-25T22:40:41.362158+0000","last_clean":"2024-04-25T22:40:41.362158+0000","last_became_active":"2024-04-25T22:40:14.618980+0000","last_became_peered":"2024-04-25T22:40:14.618980+0000","last_unstale":"2024-04-25T22:40:41.362158+0000","last_undegraded":"2024-04-25T22:40:41.362158+0000","last_fullsized":"2024-04-25T22:40:41.362158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"21'9","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362739+0000","last_change":"2024-04-25T22:40:13.598003+0000","last_active":"2024-04-25T22:40:41.362739+0000","last_peered":"2024-04-25T22:40:41.362739+0000","last_clean":"2024-04-25T22:40:41.362739+0000","last_became_active":"2024-04-25T22:40:13.596631+0000","last_became_peered":"2024-04-25T22:40:13.596631+0000","last_unstale":"2024-04-25T22:40:41.362739+0000","last_undegraded":"2024-04-25T22:40:41.362739+0000","last_fullsized":"2024-04-25T22:40:41.362739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:50.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4884,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354503+0000","last_change":"2024-04-25T22:40:14.620064+0000","last_active":"2024-04-25T22:40:41.354503+0000","last_peered":"2024-04-25T22:40:41.354503+0000","last_clean":"2024-04-25T22:40:41.354503+0000","last_became_active":"2024-04-25T22:40:14.619294+0000","last_became_peered":"2024-04-25T22:40:14.619294+0000","last_unstale":"2024-04-25T22:40:41.354503+0000","last_undegraded":"2024-04-25T22:40:41.354503+0000","last_fullsized":"2024-04-25T22:40:41.354503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363378+0000","last_change":"2024-04-25T22:40:36.307956+0000","last_active":"2024-04-25T22:40:41.363378+0000","last_peered":"2024-04-25T22:40:41.363378+0000","last_clean":"2024-04-25T22:40:41.363378+0000","last_became_active":"2024-04-25T22:40:36.306587+0000","last_became_peered":"2024-04-25T22:40:36.306587+0000","last_unstale":"2024-04-25T22:40:41.363378+0000","last_undegraded":"2024-04-25T22:40:41.363378+0000","last_fullsized":"2024-04-25T22:40:41.363378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:32.249184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363503+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:40:41.363503+0000","last_peered":"2024-04-25T22:40:41.363503+0000","last_clean":"2024-04-25T22:40:41.363503+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:40:41.363503+0000","last_undegraded":"2024-04-25T22:40:41.363503+0000","last_fullsized":"2024-04-25T22:40:41.363503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354262+0000","last_change":"2024-04-25T22:40:14.627868+0000","last_active":"2024-04-25T22:40:41.354262+0000","last_peered":"2024-04-25T22:40:41.354262+0000","last_clean":"2024-04-25T22:40:41.354262+0000","last_became_active":"2024-04-25T22:40:14.626388+0000","last_became_peered":"2024-04-25T22:40:14.626388+0000","last_unstale":"2024-04-25T22:40:41.354262+0000","last_undegraded":"2024-04-25T22:40:41.354262+0000","last_fullsized":"2024-04-25T22:40:41.354262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356821+0000","last_change":"2024-04-25T22:40:13.593378+0000","last_active":"2024-04-25T22:40:41.356821+0000","last_peered":"2024-04-25T22:40:41.356821+0000","last_clean":"2024-04-25T22:40:41.356821+0000","last_became_active":"2024-04-25T22:40:13.592392+0000","last_became_peered":"2024-04-25T22:40:13.592392+0000","last_unstale":"2024-04-25T22:40:41.356821+0000","last_undegraded":"2024-04-25T22:40:41.356821+0000","last_fullsized":"2024-04-25T22:40:41.356821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354279+0000","last_change":"2024-04-25T22:40:14.619640+0000","last_active":"2024-04-25T22:40:41.354279+0000","last_peered":"2024-04-25T22:40:41.354279+0000","last_clean":"2024-04-25T22:40:41.354279+0000","last_became_active":"2024-04-25T22:40:14.618088+0000","last_became_peered":"2024-04-25T22:40:14.618088+0000","last_unstale":"2024-04-25T22:40:41.354279+0000","last_undegraded":"2024-04-25T22:40:41.354279+0000","last_fullsized":"2024-04-25T22:40:41.354279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:58.322470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363569+0000","last_change":"2024-04-25T22:40:36.304451+0000","last_active":"2024-04-25T22:40:41.363569+0000","last_peered":"2024-04-25T22:40:41.363569+0000","last_clean":"2024-04-25T22:40:41.363569+0000","last_became_active":"2024-04-25T22:40:36.303841+0000","last_became_peered":"2024-04-25T22:40:36.303841+0000","last_unstale":"2024-04-25T22:40:41.363569+0000","last_undegraded":"2024-04-25T22:40:41.363569+0000","last_fullsized":"2024-04-25T22:40:41.363569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:12.611590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354759+0000","last_change":"2024-04-25T22:40:13.588577+0000","last_active":"2024-04-25T22:40:41.354759+0000","last_peered":"2024-04-25T22:40:41.354759+0000","last_clean":"2024-04-25T22:40:41.354759+0000","last_became_active":"2024-04-25T22:40:13.588019+0000","last_became_peered":"2024-04-25T22:40:13.588019+0000","last_unstale":"2024-04-25T22:40:41.354759+0000","last_undegraded":"2024-04-25T22:40:41.354759+0000","last_fullsized":"2024-04-25T22:40:41.354759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:07.743396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356231+0000","last_change":"2024-04-25T22:40:14.630597+0000","last_active":"2024-04-25T22:40:41.356231+0000","last_peered":"2024-04-25T22:40:41.356231+0000","last_clean":"2024-04-25T22:40:41.356231+0000","last_became_active":"2024-04-25T22:40:14.628981+0000","last_became_peered":"2024-04-25T22:40:14.628981+0000","last_unstale":"2024-04-25T22:40:41.356231+0000","last_undegraded":"2024-04-25T22:40:41.356231+0000","last_fullsized":"2024-04-25T22:40:41.356231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354747+0000","last_change":"2024-04-25T22:40:13.581827+0000","last_active":"2024-04-25T22:40:41.354747+0000","last_peered":"2024-04-25T22:40:41.354747+0000","last_clean":"2024-04-25T22:40:41.354747+0000","last_became_active":"2024-04-25T22:40:13.581166+0000","last_became_peered":"2024-04-25T22:40:13.581166+0000","last_unstale":"2024-04-25T22:40:41.354747+0000","last_undegraded":"2024-04-25T22:40:41.354747+0000","last_fullsized":"2024-04-25T22:40:41.354747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362067+0000","last_change":"2024-04-25T22:40:36.308091+0000","last_active":"2024-04-25T22:40:41.362067+0000","last_peered":"2024-04-25T22:40:41.362067+0000","last_clean":"2024-04-25T22:40:41.362067+0000","last_became_active":"2024-04-25T22:40:36.307377+0000","last_became_peered":"2024-04-25T22:40:36.307377+0000","last_unstale":"2024-04-25T22:40:41.362067+0000","last_undegraded":"2024-04-25T22:40:41.362067+0000","last_fullsized":"2024-04-25T22:40:41.362067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:49.433865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354228+0000","last_change":"2024-04-25T22:40:36.293407+0000","last_active":"2024-04-25T22:40:41.354228+0000","last_peered":"2024-04-25T22:40:41.354228+0000","last_clean":"2024-04-25T22:40:41.354228+0000","last_became_active":"2024-04-25T22:40:36.292707+0000","last_became_peered":"2024-04-25T22:40:36.292707+0000","last_unstale":"2024-04-25T22:40:41.354228+0000","last_undegraded":"2024-04-25T22:40:41.354228+0000","last_fullsized":"2024-04-25T22:40:41.354228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:40:02.440775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355384+0000","last_change":"2024-04-25T22:40:36.298814+0000","last_active":"2024-04-25T22:40:41.355384+0000","last_peered":"2024-04-25T22:40:41.355384+0000","last_clean":"2024-04-25T22:40:41.355384+0000","last_became_active":"2024-04-25T22:40:36.298369+0000","last_became_peered":"2024-04-25T22:40:36.298369+0000","last_unstale":"2024-04-25T22:40:41.355384+0000","last_undegraded":"2024-04-25T22:40:41.355384+0000","last_fullsized":"2024-04-25T22:40:41.355384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:06:25.816264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361249+0000","last_change":"2024-04-25T22:40:36.306430+0000","last_active":"2024-04-25T22:40:41.361249+0000","last_peered":"2024-04-25T22:40:41.361249+0000","last_clean":"2024-04-25T22:40:41.361249+0000","last_became_active":"2024-04-25T22:40:36.305851+0000","last_became_peered":"2024-04-25T22:40:36.305851+0000","last_unstale":"2024-04-25T22:40:41.361249+0000","last_undegraded":"2024-04-25T22:40:41.361249+0000","last_fullsized":"2024-04-25T22:40:41.361249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:19.231988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361543+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:40:41.361543+0000","last_peered":"2024-04-25T22:40:41.361543+0000","last_clean":"2024-04-25T22:40:41.361543+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:40:41.361543+0000","last_undegraded":"2024-04-25T22:40:41.361543+0000","last_fullsized":"2024-04-25T22:40:41.361543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362533+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:40:41.362533+0000","last_peered":"2024-04-25T22:40:41.362533+0000","last_clean":"2024-04-25T22:40:41.362533+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:40:41.362533+0000","last_undegraded":"2024-04-25T22:40:41.362533+0000","last_fullsized":"2024-04-25T22:40:41.362533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361906+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:40:41.361906+0000","last_peered":"2024-04-25T22:40:41.361906+0000","last_clean":"2024-04-25T22:40:41.361906+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:40:41.361906+0000","last_undegraded":"2024-04-25T22:40:41.361906+0000","last_fullsized":"2024-04-25T22:40:41.361906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362343+0000","last_change":"2024-04-25T22:40:36.307498+0000","last_active":"2024-04-25T22:40:41.362343+0000","last_peered":"2024-04-25T22:40:41.362343+0000","last_clean":"2024-04-25T22:40:41.362343+0000","last_became_active":"2024-04-25T22:40:36.305913+0000","last_became_peered":"2024-04-25T22:40:36.305913+0000","last_unstale":"2024-04-25T22:40:41.362343+0000","last_undegraded":"2024-04-25T22:40:41.362343+0000","last_fullsized":"2024-04-25T22:40:41.362343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:45:54.627527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355077+0000","last_change":"2024-04-25T22:40:36.296798+0000","last_active":"2024-04-25T22:40:41.355077+0000","last_peered":"2024-04-25T22:40:41.355077+0000","last_clean":"2024-04-25T22:40:41.355077+0000","last_became_active":"2024-04-25T22:40:36.295967+0000","last_became_peered":"2024-04-25T22:40:36.295967+0000","last_unstale":"2024-04-25T22:40:41.355077+0000","last_undegraded":"2024-04-25T22:40:41.355077+0000","last_fullsized":"2024-04-25T22:40:41.355077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:47:46.321875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356527+0000","last_change":"2024-04-25T22:40:13.594172+0000","last_active":"2024-04-25T22:40:41.356527+0000","last_peered":"2024-04-25T22:40:41.356527+0000","last_clean":"2024-04-25T22:40:41.356527+0000","last_became_active":"2024-04-25T22:40:13.593428+0000","last_became_peered":"2024-04-25T22:40:13.593428+0000","last_unstale":"2024-04-25T22:40:41.356527+0000","last_undegraded":"2024-04-25T22:40:41.356527+0000","last_fullsized":"2024-04-25T22:40:41.356527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:41:51.887162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361647+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:40:41.361647+0000","last_peered":"2024-04-25T22:40:41.361647+0000","last_clean":"2024-04-25T22:40:41.361647+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:40:41.361647+0000","last_undegraded":"2024-04-25T22:40:41.361647+0000","last_fullsized":"2024-04-25T22:40:41.361647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356559+0000","last_change":"2024-04-25T22:40:13.593659+0000","last_active":"2024-04-25T22:40:41.356559+0000","last_peered":"2024-04-25T22:40:41.356559+0000","last_clean":"2024-04-25T22:40:41.356559+0000","last_became_active":"2024-04-25T22:40:13.592874+0000","last_became_peered":"2024-04-25T22:40:13.592874+0000","last_unstale":"2024-04-25T22:40:41.356559+0000","last_undegraded":"2024-04-25T22:40:41.356559+0000","last_fullsized":"2024-04-25T22:40:41.356559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5682,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":75277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738380,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":819200,"data_stored":670095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":827392,"data_stored":670711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:40:43.811 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:40:43.812 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:40:43.812 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:40:43.828 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:40:43.828 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:40:43.894 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:43.894+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:43.930 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:43.930 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:43.944 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:40:43.994 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:43.991+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:44.068 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:44.068 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:44.082 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:40:44.096 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:44.094+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:44.101 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:44.102 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:40:44.117 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-04-25T22:40:43.413551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596050,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":253,"num_write_kb":3480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91188,"kb_used_data":1808,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024332,"statfs":{"total":289910292480,"available":289816915968,"internally_reserved":0,"allocated":1851392,"data_stored":1416083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2831,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.100153"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356741+0000","last_change":"2024-04-25T22:40:36.296993+0000","last_active":"2024-04-25T22:40:41.356741+0000","last_peered":"2024-04-25T22:40:41.356741+0000","last_clean":"2024-04-25T22:40:41.356741+0000","last_became_active":"2024-04-25T22:40:36.296111+0000","last_became_peered":"2024-04-25T22:40:36.296111+0000","last_unstale":"2024-04-25T22:40:41.356741+0000","last_undegraded":"2024-04-25T22:40:41.356741+0000","last_fullsized":"2024-04-25T22:40:41.356741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:03.272640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355742+0000","last_change":"2024-04-25T22:40:36.295443+0000","last_active":"2024-04-25T22:40:41.355742+0000","last_peered":"2024-04-25T22:40:41.355742+0000","last_clean":"2024-04-25T22:40:41.355742+0000","last_became_active":"2024-04-25T22:40:36.294248+0000","last_became_peered":"2024-04-25T22:40:36.294248+0000","last_unstale":"2024-04-25T22:40:41.355742+0000","last_undegraded":"2024-04-25T22:40:41.355742+0000","last_fullsized":"2024-04-25T22:40:41.355742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:25.839134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362638+0000","last_change":"2024-04-25T22:40:14.626211+0000","last_active":"2024-04-25T22:40:41.362638+0000","last_peered":"2024-04-25T22:40:41.362638+0000","last_clean":"2024-04-25T22:40:41.362638+0000","last_became_active":"2024-04-25T22:40:14.622625+0000","last_became_peered":"2024-04-25T22:40:14.622625+0000","last_unstale":"2024-04-25T22:40:41.362638+0000","last_undegraded":"2024-04-25T22:40:41.362638+0000","last_fullsized":"2024-04-25T22:40:41.362638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:35.993000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362024+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:40:41.362024+0000","last_peered":"2024-04-25T22:40:41.362024+0000","last_clean":"2024-04-25T22:40:41.362024+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:40:41.362024+0000","last_undegraded":"2024-04-25T22:40:41.362024+0000","last_fullsized":"2024-04-25T22:40:41.362024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354511+0000","last_change":"2024-04-25T22:40:36.294687+0000","last_active":"2024-04-25T22:40:41.354511+0000","last_peered":"2024-04-25T22:40:41.354511+0000","last_clean":"2024-04-25T22:40:41.354511+0000","last_became_active":"2024-04-25T22:40:36.294114+0000","last_became_peered":"2024-04-25T22:40:36.294114+0000","last_unstale":"2024-04-25T22:40:41.354511+0000","last_undegraded":"2024-04-25T22:40:41.354511+0000","last_fullsized":"2024-04-25T22:40:41.354511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:39:22.907771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361357+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:40:41.361357+0000","last_peered":"2024-04-25T22:40:41.361357+0000","last_clean":"2024-04-25T22:40:41.361357+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:40:41.361357+0000","last_undegraded":"2024-04-25T22:40:41.361357+0000","last_fullsized":"2024-04-25T22:40:41.361357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361192+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:40:41.361192+0000","last_peered":"2024-04-25T22:40:41.361192+0000","last_clean":"2024-04-25T22:40:41.361192+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:40:41.361192+0000","last_undegraded":"2024-04-25T22:40:41.361192+0000","last_fullsized":"2024-04-25T22:40:41.361192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360899+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:40:41.360899+0000","last_peered":"2024-04-25T22:40:41.360899+0000","last_clean":"2024-04-25T22:40:41.360899+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:40:41.360899+0000","last_undegraded":"2024-04-25T22:40:41.360899+0000","last_fullsized":"2024-04-25T22:40:41.360899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356162+0000","last_change":"2024-04-25T22:40:14.625922+0000","last_active":"2024-04-25T22:40:41.356162+0000","last_peered":"2024-04-25T22:40:41.356162+0000","last_clean":"2024-04-25T22:40:41.356162+0000","last_became_active":"2024-04-25T22:40:14.624594+0000","last_became_peered":"2024-04-25T22:40:14.624594+0000","last_unstale":"2024-04-25T22:40:41.356162+0000","last_undegraded":"2024-04-25T22:40:41.356162+0000","last_fullsized":"2024-04-25T22:40:41.356162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355788+0000","last_change":"2024-04-25T22:40:36.298225+0000","last_active":"2024-04-25T22:40:41.355788+0000","last_peered":"2024-04-25T22:40:41.355788+0000","last_clean":"2024-04-25T22:40:41.355788+0000","last_became_active":"2024-04-25T22:40:36.296299+0000","last_became_peered":"2024-04-25T22:40:36.296299+0000","last_unstale":"2024-04-25T22:40:41.355788+0000","last_undegraded":"2024-04-25T22:40:41.355788+0000","last_fullsized":"2024-04-25T22:40:41.355788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:02.464879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362915+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:40:41.362915+0000","last_peered":"2024-04-25T22:40:41.362915+0000","last_clean":"2024-04-25T22:40:41.362915+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:40:41.362915+0000","last_undegraded":"2024-04-25T22:40:41.362915+0000","last_fullsized":"2024-04-25T22:40:41.362915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361476+0000","last_change":"2024-04-25T22:40:36.305351+0000","last_active":"2024-04-25T22:40:41.361476+0000","last_peered":"2024-04-25T22:40:41.361476+0000","last_clean":"2024-04-25T22:40:41.361476+0000","last_became_active":"2024-04-25T22:40:36.303042+0000","last_became_peered":"2024-04-25T22:40:36.303042+0000","last_unstale":"2024-04-25T22:40:41.361476+0000","last_undegraded":"2024-04-25T22:40:41.361476+0000","last_fullsized":"2024-04-25T22:40:41.361476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:37.971547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354785+0000","last_change":"2024-04-25T22:40:36.296904+0000","last_active":"2024-04-25T22:40:41.354785+0000","last_peered":"2024-04-25T22:40:41.354785+0000","last_clean":"2024-04-25T22:40:41.354785+0000","last_became_active":"2024-04-25T22:40:36.295964+0000","last_became_peered":"2024-04-25T22:40:36.295964+0000","last_unstale":"2024-04-25T22:40:41.354785+0000","last_undegraded":"2024-04-25T22:40:41.354785+0000","last_fullsized":"2024-04-25T22:40:41.354785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:24.977111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361635+0000","last_change":"2024-04-25T22:40:14.616800+0000","last_active":"2024-04-25T22:40:41.361635+0000","last_peered":"2024-04-25T22:40:41.361635+0000","last_clean":"2024-04-25T22:40:41.361635+0000","last_became_active":"2024-04-25T22:40:14.612887+0000","last_became_peered":"2024-04-25T22:40:14.612887+0000","last_unstale":"2024-04-25T22:40:41.361635+0000","last_undegraded":"2024-04-25T22:40:41.361635+0000","last_fullsized":"2024-04-25T22:40:41.361635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361452+0000","last_change":"2024-04-25T22:40:14.615520+0000","last_active":"2024-04-25T22:40:41.361452+0000","last_peered":"2024-04-25T22:40:41.361452+0000","last_clean":"2024-04-25T22:40:41.361452+0000","last_became_active":"2024-04-25T22:40:14.613556+0000","last_became_peered":"2024-04-25T22:40:14.613556+0000","last_unstale":"2024-04-25T22:40:41.361452+0000","last_undegraded":"2024-04-25T22:40:41.361452+0000","last_fullsized":"2024-04-25T22:40:41.361452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360904+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:40:41.360904+0000","last_peered":"2024-04-25T22:40:41.360904+0000","last_clean":"2024-04-25T22:40:41.360904+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:40:41.360904+0000","last_undegraded":"2024-04-25T22:40:41.360904+0000","last_fullsized":"2024-04-25T22:40:41.360904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.357038+0000","last_change":"2024-04-25T22:40:14.628222+0000","last_active":"2024-04-25T22:40:41.357038+0000","last_peered":"2024-04-25T22:40:41.357038+0000","last_clean":"2024-04-25T22:40:41.357038+0000","last_became_active":"2024-04-25T22:40:14.626913+0000","last_became_peered":"2024-04-25T22:40:14.626913+0000","last_unstale":"2024-04-25T22:40:41.357038+0000","last_undegraded":"2024-04-25T22:40:41.357038+0000","last_fullsized":"2024-04-25T22:40:41.357038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356503+0000","last_change":"2024-04-25T22:40:36.300373+0000","last_active":"2024-04-25T22:40:41.356503+0000","last_peered":"2024-04-25T22:40:41.356503+0000","last_clean":"2024-04-25T22:40:41.356503+0000","last_became_active":"2024-04-25T22:40:36.299647+0000","last_became_peered":"2024-04-25T22:40:36.299647+0000","last_unstale":"2024-04-25T22:40:41.356503+0000","last_undegraded":"2024-04-25T22:40:41.356503+0000","last_fullsized":"2024-04-25T22:40:41.356503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:19.327397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355804+0000","last_change":"2024-04-25T22:40:14.623704+0000","last_active":"2024-04-25T22:40:41.355804+0000","last_peered":"2024-04-25T22:40:41.355804+0000","last_clean":"2024-04-25T22:40:41.355804+0000","last_became_active":"2024-04-25T22:40:14.623146+0000","last_became_peered":"2024-04-25T22:40:14.623146+0000","last_unstale":"2024-04-25T22:40:41.355804+0000","last_undegraded":"2024-04-25T22:40:41.355804+0000","last_fullsized":"2024-04-25T22:40:41.355804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362269+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:40:41.362269+0000","last_peered":"2024-04-25T22:40:41.362269+0000","last_clean":"2024-04-25T22:40:41.362269+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:40:41.362269+0000","last_undegraded":"2024-04-25T22:40:41.362269+0000","last_fullsized":"2024-04-25T22:40:41.362269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361789+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:40:41.361789+0000","last_peered":"2024-04-25T22:40:41.361789+0000","last_clean":"2024-04-25T22:40:41.361789+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:40:41.361789+0000","last_undegraded":"2024-04-25T22:40:41.361789+0000","last_fullsized":"2024-04-25T22:40:41.361789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360908+0000","last_change":"2024-04-25T22:40:36.305858+0000","last_active":"2024-04-25T22:40:41.360908+0000","last_peered":"2024-04-25T22:40:41.360908+0000","last_clean":"2024-04-25T22:40:41.360908+0000","last_became_active":"2024-04-25T22:40:36.304730+0000","last_became_peered":"2024-04-25T22:40:36.304730+0000","last_unstale":"2024-04-25T22:40:41.360908+0000","last_undegraded":"2024-04-25T22:40:41.360908+0000","last_fullsized":"2024-04-25T22:40:41.360908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:44.949501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.353984+0000","last_change":"2024-04-25T22:40:14.617094+0000","last_active":"2024-04-25T22:40:41.353984+0000","last_peered":"2024-04-25T22:40:41.353984+0000","last_clean":"2024-04-25T22:40:41.353984+0000","last_became_active":"2024-04-25T22:40:14.615818+0000","last_became_peered":"2024-04-25T22:40:14.615818+0000","last_unstale":"2024-04-25T22:40:41.353984+0000","last_undegraded":"2024-04-25T22:40:41.353984+0000","last_fullsized":"2024-04-25T22:40:41.353984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:30:53.093623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354010+0000","last_change":"2024-04-25T22:40:36.293289+0000","last_active":"2024-04-25T22:40:41.354010+0000","last_peered":"2024-04-25T22:40:41.354010+0000","last_clean":"2024-04-25T22:40:41.354010+0000","last_became_active":"2024-04-25T22:40:36.292483+0000","last_became_peered":"2024-04-25T22:40:36.292483+0000","last_unstale":"2024-04-25T22:40:41.354010+0000","last_undegraded":"2024-04-25T22:40:41.354010+0000","last_fullsized":"2024-04-25T22:40:41.354010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:51.686908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363394+0000","last_change":"2024-04-25T22:40:36.304773+0000","last_active":"2024-04-25T22:40:41.363394+0000","last_peered":"2024-04-25T22:40:41.363394+0000","last_clean":"2024-04-25T22:40:41.363394+0000","last_became_active":"2024-04-25T22:40:36.304073+0000","last_became_peered":"2024-04-25T22:40:36.304073+0000","last_unstale":"2024-04-25T22:40:41.363394+0000","last_undegraded":"2024-04-25T22:40:41.363394+0000","last_fullsized":"2024-04-25T22:40:41.363394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:02.464879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356234+0000","last_change":"2024-04-25T22:40:14.625933+0000","last_active":"2024-04-25T22:40:41.356234+0000","last_peered":"2024-04-25T22:40:41.356234+0000","last_clean":"2024-04-25T22:40:41.356234+0000","last_became_active":"2024-04-25T22:40:14.625123+0000","last_became_peered":"2024-04-25T22:40:14.625123+0000","last_unstale":"2024-04-25T22:40:41.356234+0000","last_undegraded":"2024-04-25T22:40:41.356234+0000","last_fullsized":"2024-04-25T22:40:41.356234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363088+0000","last_change":"2024-04-25T22:40:14.630596+0000","last_active":"2024-04-25T22:40:41.363088+0000","last_peered":"2024-04-25T22:40:41.363088+0000","last_clean":"2024-04-25T22:40:41.363088+0000","last_became_active":"2024-04-25T22:40:14.625407+0000","last_became_peered":"2024-04-25T22:40:14.625407+0000","last_unstale":"2024-04-25T22:40:41.363088+0000","last_undegraded":"2024-04-25T22:40:41.363088+0000","last_fullsized":"2024-04-25T22:40:41.363088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:20:05.398182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361749+0000","last_change":"2024-04-25T22:40:36.303740+0000","last_active":"2024-04-25T22:40:41.361749+0000","last_peered":"2024-04-25T22:40:41.361749+0000","last_clean":"2024-04-25T22:40:41.361749+0000","last_became_active":"2024-04-25T22:40:36.303305+0000","last_became_peered":"2024-04-25T22:40:36.303305+0000","last_unstale":"2024-04-25T22:40:41.361749+0000","last_undegraded":"2024-04-25T22:40:41.361749+0000","last_fullsized":"2024-04-25T22:40:41.361749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:03.272640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355393+0000","last_change":"2024-04-25T22:40:14.620608+0000","last_active":"2024-04-25T22:40:41.355393+0000","last_peered":"2024-04-25T22:40:41.355393+0000","last_clean":"2024-04-25T22:40:41.355393+0000","last_became_active":"2024-04-25T22:40:14.618171+0000","last_became_peered":"2024-04-25T22:40:14.618171+0000","last_unstale":"2024-04-25T22:40:41.355393+0000","last_undegraded":"2024-04-25T22:40:41.355393+0000","last_fullsized":"2024-04-25T22:40:41.355393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361247+0000","last_change":"2024-04-25T22:40:36.305391+0000","last_active":"2024-04-25T22:40:41.361247+0000","last_peered":"2024-04-25T22:40:41.361247+0000","last_clean":"2024-04-25T22:40:41.361247+0000","last_became_active":"2024-04-25T22:40:36.302601+0000","last_became_peered":"2024-04-25T22:40:36.302601+0000","last_unstale":"2024-04-25T22:40:41.361247+0000","last_undegraded":"2024-04-25T22:40:41.361247+0000","last_fullsized":"2024-04-25T22:40:41.361247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:54.909669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354087+0000","last_change":"2024-04-25T22:40:14.618468+0000","last_active":"2024-04-25T22:40:41.354087+0000","last_peered":"2024-04-25T22:40:41.354087+0000","last_clean":"2024-04-25T22:40:41.354087+0000","last_became_active":"2024-04-25T22:40:14.617312+0000","last_became_peered":"2024-04-25T22:40:14.617312+0000","last_unstale":"2024-04-25T22:40:41.354087+0000","last_undegraded":"2024-04-25T22:40:41.354087+0000","last_fullsized":"2024-04-25T22:40:41.354087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:12.679354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361922+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:40:41.361922+0000","last_peered":"2024-04-25T22:40:41.361922+0000","last_clean":"2024-04-25T22:40:41.361922+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:40:41.361922+0000","last_undegraded":"2024-04-25T22:40:41.361922+0000","last_fullsized":"2024-04-25T22:40:41.361922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355454+0000","last_change":"2024-04-25T22:40:36.296749+0000","last_active":"2024-04-25T22:40:41.355454+0000","last_peered":"2024-04-25T22:40:41.355454+0000","last_clean":"2024-04-25T22:40:41.355454+0000","last_became_active":"2024-04-25T22:40:36.295933+0000","last_became_peered":"2024-04-25T22:40:36.295933+0000","last_unstale":"2024-04-25T22:40:41.355454+0000","last_undegraded":"2024-04-25T22:40:41.355454+0000","last_fullsized":"2024-04-25T22:40:41.355454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:18.491547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362634+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:40:41.362634+0000","last_peered":"2024-04-25T22:40:41.362634+0000","last_clean":"2024-04-25T22:40:41.362634+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:40:41.362634+0000","last_undegraded":"2024-04-25T22:40:41.362634+0000","last_fullsized":"2024-04-25T22:40:41.362634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355458+0000","last_change":"2024-04-25T22:40:36.298200+0000","last_active":"2024-04-25T22:40:41.355458+0000","last_peered":"2024-04-25T22:40:41.355458+0000","last_clean":"2024-04-25T22:40:41.355458+0000","last_became_active":"2024-04-25T22:40:36.296613+0000","last_became_peered":"2024-04-25T22:40:36.296613+0000","last_unstale":"2024-04-25T22:40:41.355458+0000","last_undegraded":"2024-04-25T22:40:41.355458+0000","last_fullsized":"2024-04-25T22:40:41.355458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:12.611590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354817+0000","last_change":"2024-04-25T22:40:13.581241+0000","last_active":"2024-04-25T22:40:41.354817+0000","last_peered":"2024-04-25T22:40:41.354817+0000","last_clean":"2024-04-25T22:40:41.354817+0000","last_became_active":"2024-04-25T22:40:13.580442+0000","last_became_peered":"2024-04-25T22:40:13.580442+0000","last_unstale":"2024-04-25T22:40:41.354817+0000","last_undegraded":"2024-04-25T22:40:41.354817+0000","last_fullsized":"2024-04-25T22:40:41.354817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:50:49.280995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356712+0000","last_change":"2024-04-25T22:40:14.631577+0000","last_active":"2024-04-25T22:40:41.356712+0000","last_peered":"2024-04-25T22:40:41.356712+0000","last_clean":"2024-04-25T22:40:41.356712+0000","last_became_active":"2024-04-25T22:40:14.630371+0000","last_became_peered":"2024-04-25T22:40:14.630371+0000","last_unstale":"2024-04-25T22:40:41.356712+0000","last_undegraded":"2024-04-25T22:40:41.356712+0000","last_fullsized":"2024-04-25T22:40:41.356712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360875+0000","last_change":"2024-04-25T22:40:36.306844+0000","last_active":"2024-04-25T22:40:41.360875+0000","last_peered":"2024-04-25T22:40:41.360875+0000","last_clean":"2024-04-25T22:40:41.360875+0000","last_became_active":"2024-04-25T22:40:36.303223+0000","last_became_peered":"2024-04-25T22:40:36.303223+0000","last_unstale":"2024-04-25T22:40:41.360875+0000","last_undegraded":"2024-04-25T22:40:41.360875+0000","last_fullsized":"2024-04-25T22:40:41.360875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:21.069965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356213+0000","last_change":"2024-04-25T22:40:14.630012+0000","last_active":"2024-04-25T22:40:41.356213+0000","last_peered":"2024-04-25T22:40:41.356213+0000","last_clean":"2024-04-25T22:40:41.356213+0000","last_became_active":"2024-04-25T22:40:14.628677+0000","last_became_peered":"2024-04-25T22:40:14.628677+0000","last_unstale":"2024-04-25T22:40:41.356213+0000","last_undegraded":"2024-04-25T22:40:41.356213+0000","last_fullsized":"2024-04-25T22:40:41.356213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361374+0000","last_change":"2024-04-25T22:40:13.599918+0000","last_active":"2024-04-25T22:40:41.361374+0000","last_peered":"2024-04-25T22:40:41.361374+0000","last_clean":"2024-04-25T22:40:41.361374+0000","last_became_active":"2024-04-25T22:40:13.596461+0000","last_became_peered":"2024-04-25T22:40:13.596461+0000","last_unstale":"2024-04-25T22:40:41.361374+0000","last_undegraded":"2024-04-25T22:40:41.361374+0000","last_fullsized":"2024-04-25T22:40:41.361374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:41:51.887162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363904+0000","last_change":"2024-04-25T22:40:13.598294+0000","last_active":"2024-04-25T22:40:41.363904+0000","last_peered":"2024-04-25T22:40:41.363904+0000","last_clean":"2024-04-25T22:40:41.363904+0000","last_became_active":"2024-04-25T22:40:13.596687+0000","last_became_peered":"2024-04-25T22:40:13.596687+0000","last_unstale":"2024-04-25T22:40:41.363904+0000","last_undegraded":"2024-04-25T22:40:41.363904+0000","last_fullsized":"2024-04-25T22:40:41.363904+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:50:49.280995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360548+0000","last_change":"2024-04-25T22:40:36.302843+0000","last_active":"2024-04-25T22:40:41.360548+0000","last_peered":"2024-04-25T22:40:41.360548+0000","last_clean":"2024-04-25T22:40:41.360548+0000","last_became_active":"2024-04-25T22:40:36.302275+0000","last_became_peered":"2024-04-25T22:40:36.302275+0000","last_unstale":"2024-04-25T22:40:41.360548+0000","last_undegraded":"2024-04-25T22:40:41.360548+0000","last_fullsized":"2024-04-25T22:40:41.360548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:24.977111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362453+0000","last_change":"2024-04-25T22:40:36.304995+0000","last_active":"2024-04-25T22:40:41.362453+0000","last_peered":"2024-04-25T22:40:41.362453+0000","last_clean":"2024-04-25T22:40:41.362453+0000","last_became_active":"2024-04-25T22:40:36.304133+0000","last_became_peered":"2024-04-25T22:40:36.304133+0000","last_unstale":"2024-04-25T22:40:41.362453+0000","last_undegraded":"2024-04-25T22:40:41.362453+0000","last_fullsized":"2024-04-25T22:40:41.362453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:06:24.787279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354397+0000","last_change":"2024-04-25T22:40:36.295350+0000","last_active":"2024-04-25T22:40:41.354397+0000","last_peered":"2024-04-25T22:40:41.354397+0000","last_clean":"2024-04-25T22:40:41.354397+0000","last_became_active":"2024-04-25T22:40:36.294081+0000","last_became_peered":"2024-04-25T22:40:36.294081+0000","last_unstale":"2024-04-25T22:40:41.354397+0000","last_undegraded":"2024-04-25T22:40:41.354397+0000","last_fullsized":"2024-04-25T22:40:41.354397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:57:06.769650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363790+0000","last_change":"2024-04-25T22:40:13.601404+0000","last_active":"2024-04-25T22:40:41.363790+0000","last_peered":"2024-04-25T22:40:41.363790+0000","last_clean":"2024-04-25T22:40:41.363790+0000","last_became_active":"2024-04-25T22:40:13.600688+0000","last_became_peered":"2024-04-25T22:40:13.600688+0000","last_unstale":"2024-04-25T22:40:41.363790+0000","last_undegraded":"2024-04-25T22:40:41.363790+0000","last_fullsized":"2024-04-25T22:40:41.363790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:36.157648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361796+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:40:41.361796+0000","last_peered":"2024-04-25T22:40:41.361796+0000","last_clean":"2024-04-25T22:40:41.361796+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:40:41.361796+0000","last_undegraded":"2024-04-25T22:40:41.361796+0000","last_fullsized":"2024-04-25T22:40:41.361796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362822+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:40:41.362822+0000","last_peered":"2024-04-25T22:40:41.362822+0000","last_clean":"2024-04-25T22:40:41.362822+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:40:41.362822+0000","last_undegraded":"2024-04-25T22:40:41.362822+0000","last_fullsized":"2024-04-25T22:40:41.362822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355530+0000","last_change":"2024-04-25T22:40:14.625843+0000","last_active":"2024-04-25T22:40:41.355530+0000","last_peered":"2024-04-25T22:40:41.355530+0000","last_clean":"2024-04-25T22:40:41.355530+0000","last_became_active":"2024-04-25T22:40:14.625187+0000","last_became_peered":"2024-04-25T22:40:14.625187+0000","last_unstale":"2024-04-25T22:40:41.355530+0000","last_undegraded":"2024-04-25T22:40:41.355530+0000","last_fullsized":"2024-04-25T22:40:41.355530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355803+0000","last_change":"2024-04-25T22:40:13.581857+0000","last_active":"2024-04-25T22:40:41.355803+0000","last_peered":"2024-04-25T22:40:41.355803+0000","last_clean":"2024-04-25T22:40:41.355803+0000","last_became_active":"2024-04-25T22:40:13.581263+0000","last_became_peered":"2024-04-25T22:40:13.581263+0000","last_unstale":"2024-04-25T22:40:41.355803+0000","last_undegraded":"2024-04-25T22:40:41.355803+0000","last_fullsized":"2024-04-25T22:40:41.355803+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:54:01.709709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362481+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:40:41.362481+0000","last_peered":"2024-04-25T22:40:41.362481+0000","last_clean":"2024-04-25T22:40:41.362481+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:40:41.362481+0000","last_undegraded":"2024-04-25T22:40:41.362481+0000","last_fullsized":"2024-04-25T22:40:41.362481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362917+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:40:41.362917+0000","last_peered":"2024-04-25T22:40:41.362917+0000","last_clean":"2024-04-25T22:40:41.362917+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:40:41.362917+0000","last_undegraded":"2024-04-25T22:40:41.362917+0000","last_fullsized":"2024-04-25T22:40:41.362917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363547+0000","last_change":"2024-04-25T22:40:14.621941+0000","last_active":"2024-04-25T22:40:41.363547+0000","last_peered":"2024-04-25T22:40:41.363547+0000","last_clean":"2024-04-25T22:40:41.363547+0000","last_became_active":"2024-04-25T22:40:14.614196+0000","last_became_peered":"2024-04-25T22:40:14.614196+0000","last_unstale":"2024-04-25T22:40:41.363547+0000","last_undegraded":"2024-04-25T22:40:41.363547+0000","last_fullsized":"2024-04-25T22:40:41.363547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:24.895025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361217+0000","last_change":"2024-04-25T22:40:36.305242+0000","last_active":"2024-04-25T22:40:41.361217+0000","last_peered":"2024-04-25T22:40:41.361217+0000","last_clean":"2024-04-25T22:40:41.361217+0000","last_became_active":"2024-04-25T22:40:36.302259+0000","last_became_peered":"2024-04-25T22:40:36.302259+0000","last_unstale":"2024-04-25T22:40:41.361217+0000","last_undegraded":"2024-04-25T22:40:41.361217+0000","last_fullsized":"2024-04-25T22:40:41.361217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:48.252489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362510+0000","last_change":"2024-04-25T22:40:14.614275+0000","last_active":"2024-04-25T22:40:41.362510+0000","last_peered":"2024-04-25T22:40:41.362510+0000","last_clean":"2024-04-25T22:40:41.362510+0000","last_became_active":"2024-04-25T22:40:14.613038+0000","last_became_peered":"2024-04-25T22:40:14.613038+0000","last_unstale":"2024-04-25T22:40:41.362510+0000","last_undegraded":"2024-04-25T22:40:41.362510+0000","last_fullsized":"2024-04-25T22:40:41.362510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:14:02.343388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354129+0000","last_change":"2024-04-25T22:40:36.293392+0000","last_active":"2024-04-25T22:40:41.354129+0000","last_peered":"2024-04-25T22:40:41.354129+0000","last_clean":"2024-04-25T22:40:41.354129+0000","last_became_active":"2024-04-25T22:40:36.292567+0000","last_became_peered":"2024-04-25T22:40:36.292567+0000","last_unstale":"2024-04-25T22:40:41.354129+0000","last_undegraded":"2024-04-25T22:40:41.354129+0000","last_fullsized":"2024-04-25T22:40:41.354129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:21.419443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356361+0000","last_change":"2024-04-25T22:40:14.627280+0000","last_active":"2024-04-25T22:40:41.356361+0000","last_peered":"2024-04-25T22:40:41.356361+0000","last_clean":"2024-04-25T22:40:41.356361+0000","last_became_active":"2024-04-25T22:40:14.624656+0000","last_became_peered":"2024-04-25T22:40:14.624656+0000","last_unstale":"2024-04-25T22:40:41.356361+0000","last_undegraded":"2024-04-25T22:40:41.356361+0000","last_fullsized":"2024-04-25T22:40:41.356361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":230,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362199+0000","last_change":"2024-04-25T22:40:04.317146+0000","last_active":"2024-04-25T22:40:41.362199+0000","last_peered":"2024-04-25T22:40:41.362199+0000","last_clean":"2024-04-25T22:40:41.362199+0000","last_became_active":"2024-04-25T22:40:04.316527+0000","last_became_peered":"2024-04-25T22:40:04.316527+0000","last_unstale":"2024-04-25T22:40:41.362199+0000","last_undegraded":"2024-04-25T22:40:41.362199+0000","last_fullsized":"2024-04-25T22:40:41.362199+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:25.669997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363214+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:40:41.363214+0000","last_peered":"2024-04-25T22:40:41.363214+0000","last_clean":"2024-04-25T22:40:41.363214+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:40:41.363214+0000","last_undegraded":"2024-04-25T22:40:41.363214+0000","last_fullsized":"2024-04-25T22:40:41.363214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355004+0000","last_change":"2024-04-25T22:40:13.591980+0000","last_active":"2024-04-25T22:40:41.355004+0000","last_peered":"2024-04-25T22:40:41.355004+0000","last_clean":"2024-04-25T22:40:41.355004+0000","last_became_active":"2024-04-25T22:40:13.591152+0000","last_became_peered":"2024-04-25T22:40:13.591152+0000","last_unstale":"2024-04-25T22:40:41.355004+0000","last_undegraded":"2024-04-25T22:40:41.355004+0000","last_fullsized":"2024-04-25T22:40:41.355004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363654+0000","last_change":"2024-04-25T22:40:14.621472+0000","last_active":"2024-04-25T22:40:41.363654+0000","last_peered":"2024-04-25T22:40:41.363654+0000","last_clean":"2024-04-25T22:40:41.363654+0000","last_became_active":"2024-04-25T22:40:14.613608+0000","last_became_peered":"2024-04-25T22:40:14.613608+0000","last_unstale":"2024-04-25T22:40:41.363654+0000","last_undegraded":"2024-04-25T22:40:41.363654+0000","last_fullsized":"2024-04-25T22:40:41.363654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:51.686908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361930+0000","last_change":"2024-04-25T22:40:09.502444+0000","last_active":"2024-04-25T22:40:41.361930+0000","last_peered":"2024-04-25T22:40:41.361930+0000","last_clean":"2024-04-25T22:40:41.361930+0000","last_became_active":"2024-04-25T22:40:09.501576+0000","last_became_peered":"2024-04-25T22:40:09.501576+0000","last_unstale":"2024-04-25T22:40:41.361930+0000","last_undegraded":"2024-04-25T22:40:41.361930+0000","last_fullsized":"2024-04-25T22:40:41.361930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:35:14.955359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354744+0000","last_change":"2024-04-25T22:40:13.579430+0000","last_active":"2024-04-25T22:40:41.354744+0000","last_peered":"2024-04-25T22:40:41.354744+0000","last_clean":"2024-04-25T22:40:41.354744+0000","last_became_active":"2024-04-25T22:40:13.578601+0000","last_became_peered":"2024-04-25T22:40:13.578601+0000","last_unstale":"2024-04-25T22:40:41.354744+0000","last_undegraded":"2024-04-25T22:40:41.354744+0000","last_fullsized":"2024-04-25T22:40:41.354744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:50.274924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355958+0000","last_change":"2024-04-25T22:40:36.298928+0000","last_active":"2024-04-25T22:40:41.355958+0000","last_peered":"2024-04-25T22:40:41.355958+0000","last_clean":"2024-04-25T22:40:41.355958+0000","last_became_active":"2024-04-25T22:40:36.298266+0000","last_became_peered":"2024-04-25T22:40:36.298266+0000","last_unstale":"2024-04-25T22:40:41.355958+0000","last_undegraded":"2024-04-25T22:40:41.355958+0000","last_fullsized":"2024-04-25T22:40:41.355958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:49.281475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355100+0000","last_change":"2024-04-25T22:40:09.501323+0000","last_active":"2024-04-25T22:40:41.355100+0000","last_peered":"2024-04-25T22:40:41.355100+0000","last_clean":"2024-04-25T22:40:41.355100+0000","last_became_active":"2024-04-25T22:40:09.500499+0000","last_became_peered":"2024-04-25T22:40:09.500499+0000","last_unstale":"2024-04-25T22:40:41.355100+0000","last_undegraded":"2024-04-25T22:40:41.355100+0000","last_fullsized":"2024-04-25T22:40:41.355100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:30.289572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360548+0000","last_change":"2024-04-25T22:40:36.303534+0000","last_active":"2024-04-25T22:40:41.360548+0000","last_peered":"2024-04-25T22:40:41.360548+0000","last_clean":"2024-04-25T22:40:41.360548+0000","last_became_active":"2024-04-25T22:40:36.302351+0000","last_became_peered":"2024-04-25T22:40:36.302351+0000","last_unstale":"2024-04-25T22:40:41.360548+0000","last_undegraded":"2024-04-25T22:40:41.360548+0000","last_fullsized":"2024-04-25T22:40:41.360548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:31:09.162739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356459+0000","last_change":"2024-04-25T22:40:14.628007+0000","last_active":"2024-04-25T22:40:41.356459+0000","last_peered":"2024-04-25T22:40:41.356459+0000","last_clean":"2024-04-25T22:40:41.356459+0000","last_became_active":"2024-04-25T22:40:14.625425+0000","last_became_peered":"2024-04-25T22:40:14.625425+0000","last_unstale":"2024-04-25T22:40:41.356459+0000","last_undegraded":"2024-04-25T22:40:41.356459+0000","last_fullsized":"2024-04-25T22:40:41.356459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363258+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:40:41.363258+0000","last_peered":"2024-04-25T22:40:41.363258+0000","last_clean":"2024-04-25T22:40:41.363258+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:40:41.363258+0000","last_undegraded":"2024-04-25T22:40:41.363258+0000","last_fullsized":"2024-04-25T22:40:41.363258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362815+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:40:41.362815+0000","last_peered":"2024-04-25T22:40:41.362815+0000","last_clean":"2024-04-25T22:40:41.362815+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:40:41.362815+0000","last_undegraded":"2024-04-25T22:40:41.362815+0000","last_fullsized":"2024-04-25T22:40:41.362815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356113+0000","last_change":"2024-04-25T22:40:14.622442+0000","last_active":"2024-04-25T22:40:41.356113+0000","last_peered":"2024-04-25T22:40:41.356113+0000","last_clean":"2024-04-25T22:40:41.356113+0000","last_became_active":"2024-04-25T22:40:14.621130+0000","last_became_peered":"2024-04-25T22:40:14.621130+0000","last_unstale":"2024-04-25T22:40:41.356113+0000","last_undegraded":"2024-04-25T22:40:41.356113+0000","last_fullsized":"2024-04-25T22:40:41.356113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363897+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:40:41.363897+0000","last_peered":"2024-04-25T22:40:41.363897+0000","last_clean":"2024-04-25T22:40:41.363897+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:40:41.363897+0000","last_undegraded":"2024-04-25T22:40:41.363897+0000","last_fullsized":"2024-04-25T22:40:41.363897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356455+0000","last_change":"2024-04-25T22:40:09.501325+0000","last_active":"2024-04-25T22:40:41.356455+0000","last_peered":"2024-04-25T22:40:41.356455+0000","last_clean":"2024-04-25T22:40:41.356455+0000","last_became_active":"2024-04-25T22:40:09.500542+0000","last_became_peered":"2024-04-25T22:40:09.500542+0000","last_unstale":"2024-04-25T22:40:41.356455+0000","last_undegraded":"2024-04-25T22:40:41.356455+0000","last_fullsized":"2024-04-25T22:40:41.356455+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:34:38.234538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360953+0000","last_change":"2024-04-25T22:40:36.306443+0000","last_active":"2024-04-25T22:40:41.360953+0000","last_peered":"2024-04-25T22:40:41.360953+0000","last_clean":"2024-04-25T22:40:41.360953+0000","last_became_active":"2024-04-25T22:40:36.303568+0000","last_became_peered":"2024-04-25T22:40:36.303568+0000","last_unstale":"2024-04-25T22:40:41.360953+0000","last_undegraded":"2024-04-25T22:40:41.360953+0000","last_fullsized":"2024-04-25T22:40:41.360953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:43:42.692718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356448+0000","last_change":"2024-04-25T22:40:13.591256+0000","last_active":"2024-04-25T22:40:41.356448+0000","last_peered":"2024-04-25T22:40:41.356448+0000","last_clean":"2024-04-25T22:40:41.356448+0000","last_became_active":"2024-04-25T22:40:13.590744+0000","last_became_peered":"2024-04-25T22:40:13.590744+0000","last_unstale":"2024-04-25T22:40:41.356448+0000","last_undegraded":"2024-04-25T22:40:41.356448+0000","last_fullsized":"2024-04-25T22:40:41.356448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:50.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355865+0000","last_change":"2024-04-25T22:40:36.300605+0000","last_active":"2024-04-25T22:40:41.355865+0000","last_peered":"2024-04-25T22:40:41.355865+0000","last_clean":"2024-04-25T22:40:41.355865+0000","last_became_active":"2024-04-25T22:40:36.299998+0000","last_became_peered":"2024-04-25T22:40:36.299998+0000","last_unstale":"2024-04-25T22:40:41.355865+0000","last_undegraded":"2024-04-25T22:40:41.355865+0000","last_fullsized":"2024-04-25T22:40:41.355865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:49.794261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361244+0000","last_change":"2024-04-25T22:40:36.305326+0000","last_active":"2024-04-25T22:40:41.361244+0000","last_peered":"2024-04-25T22:40:41.361244+0000","last_clean":"2024-04-25T22:40:41.361244+0000","last_became_active":"2024-04-25T22:40:36.302867+0000","last_became_peered":"2024-04-25T22:40:36.302867+0000","last_unstale":"2024-04-25T22:40:41.361244+0000","last_undegraded":"2024-04-25T22:40:41.361244+0000","last_fullsized":"2024-04-25T22:40:41.361244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:19.327397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.357090+0000","last_change":"2024-04-25T22:40:13.592055+0000","last_active":"2024-04-25T22:40:41.357090+0000","last_peered":"2024-04-25T22:40:41.357090+0000","last_clean":"2024-04-25T22:40:41.357090+0000","last_became_active":"2024-04-25T22:40:13.591169+0000","last_became_peered":"2024-04-25T22:40:13.591169+0000","last_unstale":"2024-04-25T22:40:41.357090+0000","last_undegraded":"2024-04-25T22:40:41.357090+0000","last_fullsized":"2024-04-25T22:40:41.357090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:33.458799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356853+0000","last_change":"2024-04-25T22:40:09.501358+0000","last_active":"2024-04-25T22:40:41.356853+0000","last_peered":"2024-04-25T22:40:41.356853+0000","last_clean":"2024-04-25T22:40:41.356853+0000","last_became_active":"2024-04-25T22:40:09.500626+0000","last_became_peered":"2024-04-25T22:40:09.500626+0000","last_unstale":"2024-04-25T22:40:41.356853+0000","last_undegraded":"2024-04-25T22:40:41.356853+0000","last_fullsized":"2024-04-25T22:40:41.356853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:55.182967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354447+0000","last_change":"2024-04-25T22:40:14.618363+0000","last_active":"2024-04-25T22:40:41.354447+0000","last_peered":"2024-04-25T22:40:41.354447+0000","last_clean":"2024-04-25T22:40:41.354447+0000","last_became_active":"2024-04-25T22:40:14.617599+0000","last_became_peered":"2024-04-25T22:40:14.617599+0000","last_unstale":"2024-04-25T22:40:41.354447+0000","last_undegraded":"2024-04-25T22:40:41.354447+0000","last_fullsized":"2024-04-25T22:40:41.354447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"22'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356747+0000","last_change":"2024-04-25T22:40:13.593400+0000","last_active":"2024-04-25T22:40:41.356747+0000","last_peered":"2024-04-25T22:40:41.356747+0000","last_clean":"2024-04-25T22:40:41.356747+0000","last_became_active":"2024-04-25T22:40:13.592338+0000","last_became_peered":"2024-04-25T22:40:13.592338+0000","last_unstale":"2024-04-25T22:40:41.356747+0000","last_undegraded":"2024-04-25T22:40:41.356747+0000","last_fullsized":"2024-04-25T22:40:41.356747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.364044+0000","last_change":"2024-04-25T22:40:09.500948+0000","last_active":"2024-04-25T22:40:41.364044+0000","last_peered":"2024-04-25T22:40:41.364044+0000","last_clean":"2024-04-25T22:40:41.364044+0000","last_became_active":"2024-04-25T22:40:09.500236+0000","last_became_peered":"2024-04-25T22:40:09.500236+0000","last_unstale":"2024-04-25T22:40:41.364044+0000","last_undegraded":"2024-04-25T22:40:41.364044+0000","last_fullsized":"2024-04-25T22:40:41.364044+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:02.375961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360763+0000","last_change":"2024-04-25T22:40:36.306177+0000","last_active":"2024-04-25T22:40:41.360763+0000","last_peered":"2024-04-25T22:40:41.360763+0000","last_clean":"2024-04-25T22:40:41.360763+0000","last_became_active":"2024-04-25T22:40:36.304767+0000","last_became_peered":"2024-04-25T22:40:36.304767+0000","last_unstale":"2024-04-25T22:40:41.360763+0000","last_undegraded":"2024-04-25T22:40:41.360763+0000","last_fullsized":"2024-04-25T22:40:41.360763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:31.194700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362158+0000","last_change":"2024-04-25T22:40:14.619806+0000","last_active":"2024-04-25T22:40:41.362158+0000","last_peered":"2024-04-25T22:40:41.362158+0000","last_clean":"2024-04-25T22:40:41.362158+0000","last_became_active":"2024-04-25T22:40:14.618980+0000","last_became_peered":"2024-04-25T22:40:14.618980+0000","last_unstale":"2024-04-25T22:40:41.362158+0000","last_undegraded":"2024-04-25T22:40:41.362158+0000","last_fullsized":"2024-04-25T22:40:41.362158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"21'9","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362739+0000","last_change":"2024-04-25T22:40:13.598003+0000","last_active":"2024-04-25T22:40:41.362739+0000","last_peered":"2024-04-25T22:40:41.362739+0000","last_clean":"2024-04-25T22:40:41.362739+0000","last_became_active":"2024-04-25T22:40:13.596631+0000","last_became_peered":"2024-04-25T22:40:13.596631+0000","last_unstale":"2024-04-25T22:40:41.362739+0000","last_undegraded":"2024-04-25T22:40:41.362739+0000","last_fullsized":"2024-04-25T22:40:41.362739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:50.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4884,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354503+0000","last_change":"2024-04-25T22:40:14.620064+0000","last_active":"2024-04-25T22:40:41.354503+0000","last_peered":"2024-04-25T22:40:41.354503+0000","last_clean":"2024-04-25T22:40:41.354503+0000","last_became_active":"2024-04-25T22:40:14.619294+0000","last_became_peered":"2024-04-25T22:40:14.619294+0000","last_unstale":"2024-04-25T22:40:41.354503+0000","last_undegraded":"2024-04-25T22:40:41.354503+0000","last_fullsized":"2024-04-25T22:40:41.354503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363378+0000","last_change":"2024-04-25T22:40:36.307956+0000","last_active":"2024-04-25T22:40:41.363378+0000","last_peered":"2024-04-25T22:40:41.363378+0000","last_clean":"2024-04-25T22:40:41.363378+0000","last_became_active":"2024-04-25T22:40:36.306587+0000","last_became_peered":"2024-04-25T22:40:36.306587+0000","last_unstale":"2024-04-25T22:40:41.363378+0000","last_undegraded":"2024-04-25T22:40:41.363378+0000","last_fullsized":"2024-04-25T22:40:41.363378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:32.249184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363503+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:40:41.363503+0000","last_peered":"2024-04-25T22:40:41.363503+0000","last_clean":"2024-04-25T22:40:41.363503+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:40:41.363503+0000","last_undegraded":"2024-04-25T22:40:41.363503+0000","last_fullsized":"2024-04-25T22:40:41.363503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354262+0000","last_change":"2024-04-25T22:40:14.627868+0000","last_active":"2024-04-25T22:40:41.354262+0000","last_peered":"2024-04-25T22:40:41.354262+0000","last_clean":"2024-04-25T22:40:41.354262+0000","last_became_active":"2024-04-25T22:40:14.626388+0000","last_became_peered":"2024-04-25T22:40:14.626388+0000","last_unstale":"2024-04-25T22:40:41.354262+0000","last_undegraded":"2024-04-25T22:40:41.354262+0000","last_fullsized":"2024-04-25T22:40:41.354262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356821+0000","last_change":"2024-04-25T22:40:13.593378+0000","last_active":"2024-04-25T22:40:41.356821+0000","last_peered":"2024-04-25T22:40:41.356821+0000","last_clean":"2024-04-25T22:40:41.356821+0000","last_became_active":"2024-04-25T22:40:13.592392+0000","last_became_peered":"2024-04-25T22:40:13.592392+0000","last_unstale":"2024-04-25T22:40:41.356821+0000","last_undegraded":"2024-04-25T22:40:41.356821+0000","last_fullsized":"2024-04-25T22:40:41.356821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354279+0000","last_change":"2024-04-25T22:40:14.619640+0000","last_active":"2024-04-25T22:40:41.354279+0000","last_peered":"2024-04-25T22:40:41.354279+0000","last_clean":"2024-04-25T22:40:41.354279+0000","last_became_active":"2024-04-25T22:40:14.618088+0000","last_became_peered":"2024-04-25T22:40:14.618088+0000","last_unstale":"2024-04-25T22:40:41.354279+0000","last_undegraded":"2024-04-25T22:40:41.354279+0000","last_fullsized":"2024-04-25T22:40:41.354279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:58.322470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363569+0000","last_change":"2024-04-25T22:40:36.304451+0000","last_active":"2024-04-25T22:40:41.363569+0000","last_peered":"2024-04-25T22:40:41.363569+0000","last_clean":"2024-04-25T22:40:41.363569+0000","last_became_active":"2024-04-25T22:40:36.303841+0000","last_became_peered":"2024-04-25T22:40:36.303841+0000","last_unstale":"2024-04-25T22:40:41.363569+0000","last_undegraded":"2024-04-25T22:40:41.363569+0000","last_fullsized":"2024-04-25T22:40:41.363569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:12.611590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354759+0000","last_change":"2024-04-25T22:40:13.588577+0000","last_active":"2024-04-25T22:40:41.354759+0000","last_peered":"2024-04-25T22:40:41.354759+0000","last_clean":"2024-04-25T22:40:41.354759+0000","last_became_active":"2024-04-25T22:40:13.588019+0000","last_became_peered":"2024-04-25T22:40:13.588019+0000","last_unstale":"2024-04-25T22:40:41.354759+0000","last_undegraded":"2024-04-25T22:40:41.354759+0000","last_fullsized":"2024-04-25T22:40:41.354759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:07.743396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356231+0000","last_change":"2024-04-25T22:40:14.630597+0000","last_active":"2024-04-25T22:40:41.356231+0000","last_peered":"2024-04-25T22:40:41.356231+0000","last_clean":"2024-04-25T22:40:41.356231+0000","last_became_active":"2024-04-25T22:40:14.628981+0000","last_became_peered":"2024-04-25T22:40:14.628981+0000","last_unstale":"2024-04-25T22:40:41.356231+0000","last_undegraded":"2024-04-25T22:40:41.356231+0000","last_fullsized":"2024-04-25T22:40:41.356231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354747+0000","last_change":"2024-04-25T22:40:13.581827+0000","last_active":"2024-04-25T22:40:41.354747+0000","last_peered":"2024-04-25T22:40:41.354747+0000","last_clean":"2024-04-25T22:40:41.354747+0000","last_became_active":"2024-04-25T22:40:13.581166+0000","last_became_peered":"2024-04-25T22:40:13.581166+0000","last_unstale":"2024-04-25T22:40:41.354747+0000","last_undegraded":"2024-04-25T22:40:41.354747+0000","last_fullsized":"2024-04-25T22:40:41.354747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362067+0000","last_change":"2024-04-25T22:40:36.308091+0000","last_active":"2024-04-25T22:40:41.362067+0000","last_peered":"2024-04-25T22:40:41.362067+0000","last_clean":"2024-04-25T22:40:41.362067+0000","last_became_active":"2024-04-25T22:40:36.307377+0000","last_became_peered":"2024-04-25T22:40:36.307377+0000","last_unstale":"2024-04-25T22:40:41.362067+0000","last_undegraded":"2024-04-25T22:40:41.362067+0000","last_fullsized":"2024-04-25T22:40:41.362067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:49.433865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354228+0000","last_change":"2024-04-25T22:40:36.293407+0000","last_active":"2024-04-25T22:40:41.354228+0000","last_peered":"2024-04-25T22:40:41.354228+0000","last_clean":"2024-04-25T22:40:41.354228+0000","last_became_active":"2024-04-25T22:40:36.292707+0000","last_became_peered":"2024-04-25T22:40:36.292707+0000","last_unstale":"2024-04-25T22:40:41.354228+0000","last_undegraded":"2024-04-25T22:40:41.354228+0000","last_fullsized":"2024-04-25T22:40:41.354228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:40:02.440775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355384+0000","last_change":"2024-04-25T22:40:36.298814+0000","last_active":"2024-04-25T22:40:41.355384+0000","last_peered":"2024-04-25T22:40:41.355384+0000","last_clean":"2024-04-25T22:40:41.355384+0000","last_became_active":"2024-04-25T22:40:36.298369+0000","last_became_peered":"2024-04-25T22:40:36.298369+0000","last_unstale":"2024-04-25T22:40:41.355384+0000","last_undegraded":"2024-04-25T22:40:41.355384+0000","last_fullsized":"2024-04-25T22:40:41.355384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:06:25.816264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361249+0000","last_change":"2024-04-25T22:40:36.306430+0000","last_active":"2024-04-25T22:40:41.361249+0000","last_peered":"2024-04-25T22:40:41.361249+0000","last_clean":"2024-04-25T22:40:41.361249+0000","last_became_active":"2024-04-25T22:40:36.305851+0000","last_became_peered":"2024-04-25T22:40:36.305851+0000","last_unstale":"2024-04-25T22:40:41.361249+0000","last_undegraded":"2024-04-25T22:40:41.361249+0000","last_fullsized":"2024-04-25T22:40:41.361249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:19.231988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361543+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:40:41.361543+0000","last_peered":"2024-04-25T22:40:41.361543+0000","last_clean":"2024-04-25T22:40:41.361543+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:40:41.361543+0000","last_undegraded":"2024-04-25T22:40:41.361543+0000","last_fullsized":"2024-04-25T22:40:41.361543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362533+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:40:41.362533+0000","last_peered":"2024-04-25T22:40:41.362533+0000","last_clean":"2024-04-25T22:40:41.362533+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:40:41.362533+0000","last_undegraded":"2024-04-25T22:40:41.362533+0000","last_fullsized":"2024-04-25T22:40:41.362533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361906+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:40:41.361906+0000","last_peered":"2024-04-25T22:40:41.361906+0000","last_clean":"2024-04-25T22:40:41.361906+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:40:41.361906+0000","last_undegraded":"2024-04-25T22:40:41.361906+0000","last_fullsized":"2024-04-25T22:40:41.361906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362343+0000","last_change":"2024-04-25T22:40:36.307498+0000","last_active":"2024-04-25T22:40:41.362343+0000","last_peered":"2024-04-25T22:40:41.362343+0000","last_clean":"2024-04-25T22:40:41.362343+0000","last_became_active":"2024-04-25T22:40:36.305913+0000","last_became_peered":"2024-04-25T22:40:36.305913+0000","last_unstale":"2024-04-25T22:40:41.362343+0000","last_undegraded":"2024-04-25T22:40:41.362343+0000","last_fullsized":"2024-04-25T22:40:41.362343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:45:54.627527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355077+0000","last_change":"2024-04-25T22:40:36.296798+0000","last_active":"2024-04-25T22:40:41.355077+0000","last_peered":"2024-04-25T22:40:41.355077+0000","last_clean":"2024-04-25T22:40:41.355077+0000","last_became_active":"2024-04-25T22:40:36.295967+0000","last_became_peered":"2024-04-25T22:40:36.295967+0000","last_unstale":"2024-04-25T22:40:41.355077+0000","last_undegraded":"2024-04-25T22:40:41.355077+0000","last_fullsized":"2024-04-25T22:40:41.355077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:47:46.321875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356527+0000","last_change":"2024-04-25T22:40:13.594172+0000","last_active":"2024-04-25T22:40:41.356527+0000","last_peered":"2024-04-25T22:40:41.356527+0000","last_clean":"2024-04-25T22:40:41.356527+0000","last_became_active":"2024-04-25T22:40:13.593428+0000","last_became_peered":"2024-04-25T22:40:13.593428+0000","last_unstale":"2024-04-25T22:40:41.356527+0000","last_undegraded":"2024-04-25T22:40:41.356527+0000","last_fullsized":"2024-04-25T22:40:41.356527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:41:51.887162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361647+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:40:41.361647+0000","last_peered":"2024-04-25T22:40:41.361647+0000","last_clean":"2024-04-25T22:40:41.361647+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:40:41.361647+0000","last_undegraded":"2024-04-25T22:40:41.361647+0000","last_fullsized":"2024-04-25T22:40:41.361647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356559+0000","last_change":"2024-04-25T22:40:13.593659+0000","last_active":"2024-04-25T22:40:41.356559+0000","last_peered":"2024-04-25T22:40:41.356559+0000","last_clean":"2024-04-25T22:40:41.356559+0000","last_became_active":"2024-04-25T22:40:13.592874+0000","last_became_peered":"2024-04-25T22:40:13.592874+0000","last_unstale":"2024-04-25T22:40:41.356559+0000","last_undegraded":"2024-04-25T22:40:41.356559+0000","last_fullsized":"2024-04-25T22:40:41.356559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5682,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":75277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738380,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":819200,"data_stored":670095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":827392,"data_stored":670711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:40:44.121 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T22:40:44.121 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:40:44.121 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-25T22:40:44.121 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-25T22:40:44.198 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:44.195+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:44.246 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:44.246 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:44.260 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:40:44.310 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:44.312+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:44.393 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:44.393 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:44.400 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:44.399+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:44.408 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:40:44.435 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is unset 2024-04-25T22:40:44.470 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:44.470 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:40:44.471 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 26, 2024-04-25T22:40:44.471 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d", 2024-04-25T22:40:44.471 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2024-04-25T22:39:52.303074+0000", 2024-04-25T22:40:44.471 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2024-04-25T22:40:44.419857+0000", 2024-04-25T22:40:44.471 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2024-04-25T22:40:01.251093+0000", 2024-04-25T22:40:44.471 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2024-04-25T22:39:53.230242+0000", 2024-04-25T22:40:44.471 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-25T22:40:44.471 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2024-04-25T22:40:44.471 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2024-04-25T22:40:44.471 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2024-04-25T22:40:44.471 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2024-04-25T22:40:44.471 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2024-04-25T22:40:44.471 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2024-04-25T22:40:44.471 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:40:44.472 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 4, 2024-04-25T22:40:44.472 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2024-04-25T22:40:44.472 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-25T22:40:44.472 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-25T22:40:44.472 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2024-04-25T22:40:44.472 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 4, 2024-04-25T22:40:44.472 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 3, 2024-04-25T22:40:44.472 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "luminous", 2024-04-25T22:40:44.472 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2024-04-25T22:40:44.472 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "squid", 2024-04-25T22:40:44.472 INFO:teuthology.orchestra.run.smithi057.stdout: "allow_crimson": false, 2024-04-25T22:40:44.472 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2024-04-25T22:40:44.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.472 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2024-04-25T22:40:44.473 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": ".mgr", 2024-04-25T22:40:44.473 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25T22:40:03.197725+0000", 2024-04-25T22:40:44.473 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T22:40:44.473 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T22:40:44.473 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T22:40:44.473 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T22:40:44.473 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T22:40:44.473 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T22:40:44.473 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:40:44.473 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:40:44.473 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:40:44.473 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:40:44.473 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T22:40:44.473 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:40:44.474 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2024-04-25T22:40:44.474 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2024-04-25T22:40:44.474 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2024-04-25T22:40:44.474 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2024-04-25T22:40:44.474 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2024-04-25T22:40:44.474 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T22:40:44.474 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T22:40:44.474 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T22:40:44.474 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T22:40:44.474 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T22:40:44.474 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T22:40:44.474 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T22:40:44.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.474 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "12", 2024-04-25T22:40:44.474 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T22:40:44.475 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:40:44.475 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:40:44.475 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T22:40:44.475 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:40:44.475 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T22:40:44.475 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T22:40:44.475 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T22:40:44.475 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T22:40:44.475 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T22:40:44.475 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T22:40:44.475 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T22:40:44.475 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T22:40:44.475 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T22:40:44.475 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T22:40:44.476 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T22:40:44.476 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T22:40:44.476 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T22:40:44.476 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:40:44.476 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:40:44.476 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:40:44.476 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T22:40:44.476 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T22:40:44.476 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T22:40:44.476 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T22:40:44.476 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T22:40:44.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.476 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T22:40:44.476 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T22:40:44.476 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T22:40:44.477 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:40:44.477 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:40:44.477 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:40:44.477 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:40:44.477 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T22:40:44.477 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T22:40:44.477 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T22:40:44.477 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T22:40:44.477 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2024-04-25T22:40:44.477 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_max": 32, 2024-04-25T22:40:44.477 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2024-04-25T22:40:44.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.477 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T22:40:44.477 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": {} 2024-04-25T22:40:44.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.478 INFO:teuthology.orchestra.run.smithi057.stdout: "read_balance": { 2024-04-25T22:40:44.478 INFO:teuthology.orchestra.run.smithi057.stdout: "score_type": "Fair distribution", 2024-04-25T22:40:44.478 INFO:teuthology.orchestra.run.smithi057.stdout: "score_acting": 2, 2024-04-25T22:40:44.478 INFO:teuthology.orchestra.run.smithi057.stdout: "score_stable": 2, 2024-04-25T22:40:44.478 INFO:teuthology.orchestra.run.smithi057.stdout: "optimal_score": 1, 2024-04-25T22:40:44.478 INFO:teuthology.orchestra.run.smithi057.stdout: "raw_score_acting": 2, 2024-04-25T22:40:44.478 INFO:teuthology.orchestra.run.smithi057.stdout: "raw_score_stable": 2, 2024-04-25T22:40:44.478 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-04-25T22:40:44.478 INFO:teuthology.orchestra.run.smithi057.stdout: "average_primary_affinity": 1, 2024-04-25T22:40:44.478 INFO:teuthology.orchestra.run.smithi057.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-25T22:40:44.478 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.478 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2024-04-25T22:40:44.479 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2024-04-25T22:40:44.479 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25T22:40:07.560858+0000", 2024-04-25T22:40:44.479 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T22:40:44.479 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T22:40:44.479 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T22:40:44.479 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T22:40:44.479 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T22:40:44.479 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T22:40:44.479 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:40:44.479 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:40:44.479 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:40:44.479 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:40:44.479 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T22:40:44.479 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:40:44.479 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2024-04-25T22:40:44.480 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2024-04-25T22:40:44.480 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2024-04-25T22:40:44.480 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2024-04-25T22:40:44.480 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2024-04-25T22:40:44.480 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T22:40:44.480 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T22:40:44.480 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T22:40:44.480 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T22:40:44.480 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T22:40:44.480 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T22:40:44.480 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T22:40:44.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.480 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2024-04-25T22:40:44.480 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T22:40:44.480 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:40:44.481 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:40:44.481 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T22:40:44.481 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:40:44.481 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T22:40:44.481 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T22:40:44.481 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T22:40:44.481 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T22:40:44.481 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T22:40:44.481 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T22:40:44.481 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T22:40:44.481 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T22:40:44.481 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T22:40:44.481 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T22:40:44.482 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T22:40:44.482 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T22:40:44.482 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T22:40:44.482 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:40:44.482 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:40:44.482 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:40:44.482 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T22:40:44.482 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T22:40:44.482 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T22:40:44.482 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T22:40:44.482 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T22:40:44.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.482 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T22:40:44.482 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T22:40:44.483 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T22:40:44.483 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:40:44.483 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:40:44.483 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:40:44.483 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:40:44.483 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T22:40:44.483 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T22:40:44.483 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T22:40:44.483 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T22:40:44.483 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2024-04-25T22:40:44.483 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T22:40:44.483 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2024-04-25T22:40:44.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.483 INFO:teuthology.orchestra.run.smithi057.stdout: "read_balance": { 2024-04-25T22:40:44.483 INFO:teuthology.orchestra.run.smithi057.stdout: "score_type": "Fair distribution", 2024-04-25T22:40:44.484 INFO:teuthology.orchestra.run.smithi057.stdout: "score_acting": 1, 2024-04-25T22:40:44.484 INFO:teuthology.orchestra.run.smithi057.stdout: "score_stable": 1, 2024-04-25T22:40:44.484 INFO:teuthology.orchestra.run.smithi057.stdout: "optimal_score": 1.5, 2024-04-25T22:40:44.484 INFO:teuthology.orchestra.run.smithi057.stdout: "raw_score_acting": 1.5, 2024-04-25T22:40:44.484 INFO:teuthology.orchestra.run.smithi057.stdout: "raw_score_stable": 1.5, 2024-04-25T22:40:44.484 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-04-25T22:40:44.484 INFO:teuthology.orchestra.run.smithi057.stdout: "average_primary_affinity": 1, 2024-04-25T22:40:44.484 INFO:teuthology.orchestra.run.smithi057.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-25T22:40:44.484 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.484 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 3, 2024-04-25T22:40:44.484 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_metadata", 2024-04-25T22:40:44.484 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25T22:40:12.431697+0000", 2024-04-25T22:40:44.484 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T22:40:44.485 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T22:40:44.485 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T22:40:44.485 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T22:40:44.485 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T22:40:44.485 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T22:40:44.485 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:40:44.485 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:40:44.485 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:40:44.485 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:40:44.485 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T22:40:44.485 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:40:44.485 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 32, 2024-04-25T22:40:44.485 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 32, 2024-04-25T22:40:44.485 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 32, 2024-04-25T22:40:44.485 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 32, 2024-04-25T22:40:44.486 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 32, 2024-04-25T22:40:44.486 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T22:40:44.486 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T22:40:44.486 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T22:40:44.486 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T22:40:44.486 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T22:40:44.486 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T22:40:44.486 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T22:40:44.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.486 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2024-04-25T22:40:44.486 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T22:40:44.486 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:40:44.486 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:40:44.487 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T22:40:44.487 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:40:44.487 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T22:40:44.487 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T22:40:44.487 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T22:40:44.487 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T22:40:44.487 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T22:40:44.487 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T22:40:44.487 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T22:40:44.487 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T22:40:44.487 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T22:40:44.487 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T22:40:44.487 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T22:40:44.487 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T22:40:44.488 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T22:40:44.488 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:40:44.488 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:40:44.488 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:40:44.488 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T22:40:44.488 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T22:40:44.488 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T22:40:44.488 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T22:40:44.488 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T22:40:44.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.488 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T22:40:44.488 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T22:40:44.488 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T22:40:44.488 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:40:44.489 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:40:44.489 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:40:44.489 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:40:44.489 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T22:40:44.489 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T22:40:44.489 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T22:40:44.489 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T22:40:44.489 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2024-04-25T22:40:44.489 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_bias": 4, 2024-04-25T22:40:44.489 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 16, 2024-04-25T22:40:44.489 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_priority": 5 2024-04-25T22:40:44.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.489 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T22:40:44.489 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2024-04-25T22:40:44.489 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": "cephfs" 2024-04-25T22:40:44.490 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.490 INFO:teuthology.orchestra.run.smithi057.stdout: "read_balance": { 2024-04-25T22:40:44.490 INFO:teuthology.orchestra.run.smithi057.stdout: "score_type": "Fair distribution", 2024-04-25T22:40:44.490 INFO:teuthology.orchestra.run.smithi057.stdout: "score_acting": 1.1299999952316284, 2024-04-25T22:40:44.490 INFO:teuthology.orchestra.run.smithi057.stdout: "score_stable": 1.1299999952316284, 2024-04-25T22:40:44.490 INFO:teuthology.orchestra.run.smithi057.stdout: "optimal_score": 1.5, 2024-04-25T22:40:44.490 INFO:teuthology.orchestra.run.smithi057.stdout: "raw_score_acting": 1.690000057220459, 2024-04-25T22:40:44.490 INFO:teuthology.orchestra.run.smithi057.stdout: "raw_score_stable": 1.690000057220459, 2024-04-25T22:40:44.490 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-04-25T22:40:44.490 INFO:teuthology.orchestra.run.smithi057.stdout: "average_primary_affinity": 1, 2024-04-25T22:40:44.490 INFO:teuthology.orchestra.run.smithi057.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-25T22:40:44.490 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.491 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 4, 2024-04-25T22:40:44.491 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_data", 2024-04-25T22:40:44.491 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25T22:40:12.919828+0000", 2024-04-25T22:40:44.491 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T22:40:44.491 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T22:40:44.491 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T22:40:44.491 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T22:40:44.491 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T22:40:44.491 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T22:40:44.491 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:40:44.491 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:40:44.491 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:40:44.491 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:40:44.491 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T22:40:44.492 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:40:44.492 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 64, 2024-04-25T22:40:44.492 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 64, 2024-04-25T22:40:44.492 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 64, 2024-04-25T22:40:44.492 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 64, 2024-04-25T22:40:44.492 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 64, 2024-04-25T22:40:44.492 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T22:40:44.492 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T22:40:44.492 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T22:40:44.492 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T22:40:44.492 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T22:40:44.492 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T22:40:44.492 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T22:40:44.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.493 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "19", 2024-04-25T22:40:44.493 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T22:40:44.493 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:40:44.493 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:40:44.493 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T22:40:44.493 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:40:44.493 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T22:40:44.493 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T22:40:44.493 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T22:40:44.493 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T22:40:44.493 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T22:40:44.493 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T22:40:44.493 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T22:40:44.494 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T22:40:44.494 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T22:40:44.494 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T22:40:44.494 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T22:40:44.494 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T22:40:44.494 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T22:40:44.494 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:40:44.494 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:40:44.494 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:40:44.494 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T22:40:44.494 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T22:40:44.494 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T22:40:44.494 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T22:40:44.494 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T22:40:44.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.495 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T22:40:44.495 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T22:40:44.495 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T22:40:44.495 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:40:44.495 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:40:44.495 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:40:44.495 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:40:44.495 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T22:40:44.495 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T22:40:44.495 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T22:40:44.495 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T22:40:44.495 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2024-04-25T22:40:44.495 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 64, 2024-04-25T22:40:44.496 INFO:teuthology.orchestra.run.smithi057.stdout: "target_size_ratio": 0.89999997615814209 2024-04-25T22:40:44.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.496 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T22:40:44.496 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2024-04-25T22:40:44.496 INFO:teuthology.orchestra.run.smithi057.stdout: "data": "cephfs" 2024-04-25T22:40:44.496 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.496 INFO:teuthology.orchestra.run.smithi057.stdout: "read_balance": { 2024-04-25T22:40:44.496 INFO:teuthology.orchestra.run.smithi057.stdout: "score_type": "Fair distribution", 2024-04-25T22:40:44.496 INFO:teuthology.orchestra.run.smithi057.stdout: "score_acting": 1.0299999713897705, 2024-04-25T22:40:44.496 INFO:teuthology.orchestra.run.smithi057.stdout: "score_stable": 1.0299999713897705, 2024-04-25T22:40:44.496 INFO:teuthology.orchestra.run.smithi057.stdout: "optimal_score": 1.5, 2024-04-25T22:40:44.496 INFO:teuthology.orchestra.run.smithi057.stdout: "raw_score_acting": 1.5499999523162842, 2024-04-25T22:40:44.496 INFO:teuthology.orchestra.run.smithi057.stdout: "raw_score_stable": 1.5499999523162842, 2024-04-25T22:40:44.497 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-04-25T22:40:44.497 INFO:teuthology.orchestra.run.smithi057.stdout: "average_primary_affinity": 1, 2024-04-25T22:40:44.497 INFO:teuthology.orchestra.run.smithi057.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-25T22:40:44.497 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.497 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.497 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:40:44.497 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2024-04-25T22:40:44.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.497 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2024-04-25T22:40:44.497 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "73d465b4-5896-4d69-80b1-7e69d31eb455", 2024-04-25T22:40:44.497 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T22:40:44.497 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T22:40:44.497 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T22:40:44.497 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2024-04-25T22:40:44.498 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T22:40:44.498 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T22:40:44.498 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 8, 2024-04-25T22:40:44.498 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 20, 2024-04-25T22:40:44.498 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T22:40:44.498 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T22:40:44.498 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T22:40:44.498 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:44.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.498 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:44.498 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6800", 2024-04-25T22:40:44.498 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:40:44.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.499 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:44.499 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6801", 2024-04-25T22:40:44.499 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:40:44.499 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.499 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:44.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.499 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T22:40:44.499 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:44.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.499 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:44.499 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6802", 2024-04-25T22:40:44.499 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:40:44.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.499 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:44.500 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6803", 2024-04-25T22:40:44.500 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:40:44.500 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.500 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:44.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.500 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T22:40:44.500 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:44.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.500 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:44.500 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6806", 2024-04-25T22:40:44.500 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:40:44.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.500 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:44.500 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6807", 2024-04-25T22:40:44.501 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:40:44.501 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.501 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:44.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.501 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T22:40:44.501 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:44.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.501 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:44.501 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6804", 2024-04-25T22:40:44.501 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:40:44.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.501 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:44.501 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6805", 2024-04-25T22:40:44.501 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:40:44.502 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.502 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:44.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.502 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.122:6801/765118869", 2024-04-25T22:40:44.502 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.122:6803/765118869", 2024-04-25T22:40:44.502 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.122:6807/765118869", 2024-04-25T22:40:44.502 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.122:6805/765118869", 2024-04-25T22:40:44.502 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T22:40:44.502 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T22:40:44.502 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T22:40:44.502 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:44.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.503 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2024-04-25T22:40:44.503 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5", 2024-04-25T22:40:44.503 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T22:40:44.503 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T22:40:44.503 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T22:40:44.503 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 0, 2024-04-25T22:40:44.503 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T22:40:44.503 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T22:40:44.503 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 8, 2024-04-25T22:40:44.503 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 17, 2024-04-25T22:40:44.503 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T22:40:44.503 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T22:40:44.503 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T22:40:44.503 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:44.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.504 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:44.504 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6800", 2024-04-25T22:40:44.504 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:40:44.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.504 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:44.504 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6801", 2024-04-25T22:40:44.504 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:40:44.504 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.504 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:44.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.504 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T22:40:44.504 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:44.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.504 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:44.505 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6802", 2024-04-25T22:40:44.505 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:40:44.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.505 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:44.505 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6803", 2024-04-25T22:40:44.505 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:40:44.505 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.505 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:44.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.505 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T22:40:44.505 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:44.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.506 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:44.506 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6806", 2024-04-25T22:40:44.506 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:40:44.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.506 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:44.506 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6807", 2024-04-25T22:40:44.506 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:40:44.506 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.506 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:44.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.506 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T22:40:44.507 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:44.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.507 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:44.507 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6804", 2024-04-25T22:40:44.507 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:40:44.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.507 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:44.507 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6805", 2024-04-25T22:40:44.507 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:40:44.507 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.507 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:44.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.507 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.148:6801/2387035286", 2024-04-25T22:40:44.508 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.148:6803/2387035286", 2024-04-25T22:40:44.508 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.148:6807/2387035286", 2024-04-25T22:40:44.508 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.148:6805/2387035286", 2024-04-25T22:40:44.508 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T22:40:44.508 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T22:40:44.508 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T22:40:44.508 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:44.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.508 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2024-04-25T22:40:44.508 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "164fc653-2135-4e9b-8826-1716fdba6ea0", 2024-04-25T22:40:44.508 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T22:40:44.508 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T22:40:44.508 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T22:40:44.509 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2024-04-25T22:40:44.509 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T22:40:44.509 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T22:40:44.509 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 8, 2024-04-25T22:40:44.509 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 20, 2024-04-25T22:40:44.509 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T22:40:44.509 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T22:40:44.509 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T22:40:44.509 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:44.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.509 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:44.509 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6800", 2024-04-25T22:40:44.509 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:40:44.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.510 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:44.510 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6801", 2024-04-25T22:40:44.510 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:40:44.510 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.510 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:44.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.510 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T22:40:44.510 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:44.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.510 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:44.510 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6802", 2024-04-25T22:40:44.510 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:40:44.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.511 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:44.511 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6803", 2024-04-25T22:40:44.511 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:40:44.511 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.511 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:44.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.511 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T22:40:44.511 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:44.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.511 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:44.511 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6806", 2024-04-25T22:40:44.511 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:40:44.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.512 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:44.512 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6807", 2024-04-25T22:40:44.512 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:40:44.512 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.512 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:44.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.512 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T22:40:44.512 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:44.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.512 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:44.512 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6804", 2024-04-25T22:40:44.512 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:40:44.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.513 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:44.513 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6805", 2024-04-25T22:40:44.513 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:40:44.513 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.513 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:44.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.513 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.188:6801/368834361", 2024-04-25T22:40:44.513 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.188:6803/368834361", 2024-04-25T22:40:44.513 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.188:6807/368834361", 2024-04-25T22:40:44.513 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.188:6805/368834361", 2024-04-25T22:40:44.513 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T22:40:44.513 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T22:40:44.513 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T22:40:44.513 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:44.514 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.514 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:40:44.514 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2024-04-25T22:40:44.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.514 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2024-04-25T22:40:44.514 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T22:40:44.514 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T22:40:44.514 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T22:40:44.514 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540701547738038271, 2024-04-25T22:40:44.514 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2024-04-25T22:40:44.514 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2024-04-25T22:39:58.559393+0000", 2024-04-25T22:40:44.514 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2024-04-25T22:40:44.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.515 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2024-04-25T22:40:44.515 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T22:40:44.515 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T22:40:44.515 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T22:40:44.515 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540701547738038271, 2024-04-25T22:40:44.515 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2024-04-25T22:40:44.515 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2024-04-25T22:39:58.563434+0000", 2024-04-25T22:40:44.515 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2024-04-25T22:40:44.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:44.515 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2024-04-25T22:40:44.515 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T22:40:44.515 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T22:40:44.515 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T22:40:44.516 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540701547738038271, 2024-04-25T22:40:44.516 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2024-04-25T22:40:44.516 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2024-04-25T22:39:58.557643+0000", 2024-04-25T22:40:44.516 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2024-04-25T22:40:44.516 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.516 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:40:44.516 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2024-04-25T22:40:44.516 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2024-04-25T22:40:44.516 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_primaries": [], 2024-04-25T22:40:44.516 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2024-04-25T22:40:44.516 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2024-04-25T22:40:44.516 INFO:teuthology.orchestra.run.smithi057.stdout: "blocklist": {}, 2024-04-25T22:40:44.516 INFO:teuthology.orchestra.run.smithi057.stdout: "range_blocklist": {}, 2024-04-25T22:40:44.516 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2024-04-25T22:40:44.517 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2024-04-25T22:40:44.517 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2024-04-25T22:40:44.517 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2024-04-25T22:40:44.517 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2024-04-25T22:40:44.517 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2024-04-25T22:40:44.517 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2024-04-25T22:40:44.517 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:44.517 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2024-04-25T22:40:44.517 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2024-04-25T22:40:44.517 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2024-04-25T22:40:44.517 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2024-04-25T22:40:44.517 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {}, 2024-04-25T22:40:44.517 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_mode": { 2024-04-25T22:40:44.518 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_mode_enabled": false, 2024-04-25T22:40:44.518 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_bucket_count": 0, 2024-04-25T22:40:44.518 INFO:teuthology.orchestra.run.smithi057.stdout: "degraded_stretch_mode": 0, 2024-04-25T22:40:44.518 INFO:teuthology.orchestra.run.smithi057.stdout: "recovering_stretch_mode": 0, 2024-04-25T22:40:44.518 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_mode_bucket": 0 2024-04-25T22:40:44.518 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:44.518 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:40:44.520 INFO:tasks.thrashosds.thrasher:j is {'epoch': 26, 'fsid': '5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d', 'created': '2024-04-25T22:39:52.303074+0000', 'modified': '2024-04-25T22:40:44.419857+0000', 'last_up_change': '2024-04-25T22:40:01.251093+0000', 'last_in_change': '2024-04-25T22:39:53.230242+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:40:03.197725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:40:07.560858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1, 'score_stable': 1, 'optimal_score': 1.5, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:40:12.431697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1.5, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:40:12.919828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1.5, 'raw_score_acting': 1.5499999523162842, 'raw_score_stable': 1.5499999523162842, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}], 'osds': [{'osd': 0, 'uuid': '73d465b4-5896-4d69-80b1-7e69d31eb455', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 20, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6800', 'nonce': 765118869}, {'type': 'v1', 'addr': '172.21.15.122:6801', 'nonce': 765118869}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6802', 'nonce': 765118869}, {'type': 'v1', 'addr': '172.21.15.122:6803', 'nonce': 765118869}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6806', 'nonce': 765118869}, {'type': 'v1', 'addr': '172.21.15.122:6807', 'nonce': 765118869}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6804', 'nonce': 765118869}, {'type': 'v1', 'addr': '172.21.15.122:6805', 'nonce': 765118869}]}, 'public_addr': '172.21.15.122:6801/765118869', 'cluster_addr': '172.21.15.122:6803/765118869', 'heartbeat_back_addr': '172.21.15.122:6807/765118869', 'heartbeat_front_addr': '172.21.15.122:6805/765118869', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6800', 'nonce': 2387035286}, {'type': 'v1', 'addr': '172.21.15.148:6801', 'nonce': 2387035286}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6802', 'nonce': 2387035286}, {'type': 'v1', 'addr': '172.21.15.148:6803', 'nonce': 2387035286}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6806', 'nonce': 2387035286}, {'type': 'v1', 'addr': '172.21.15.148:6807', 'nonce': 2387035286}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6804', 'nonce': 2387035286}, {'type': 'v1', 'addr': '172.21.15.148:6805', 'nonce': 2387035286}]}, 'public_addr': '172.21.15.148:6801/2387035286', 'cluster_addr': '172.21.15.148:6803/2387035286', 'heartbeat_back_addr': '172.21.15.148:6807/2387035286', 'heartbeat_front_addr': '172.21.15.148:6805/2387035286', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '164fc653-2135-4e9b-8826-1716fdba6ea0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 20, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6800', 'nonce': 368834361}, {'type': 'v1', 'addr': '172.21.15.188:6801', 'nonce': 368834361}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6802', 'nonce': 368834361}, {'type': 'v1', 'addr': '172.21.15.188:6803', 'nonce': 368834361}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6806', 'nonce': 368834361}, {'type': 'v1', 'addr': '172.21.15.188:6807', 'nonce': 368834361}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6804', 'nonce': 368834361}, {'type': 'v1', 'addr': '172.21.15.188:6805', 'nonce': 368834361}]}, 'public_addr': '172.21.15.188:6801/368834361', 'cluster_addr': '172.21.15.188:6803/368834361', 'heartbeat_back_addr': '172.21.15.188:6807/368834361', 'heartbeat_front_addr': '172.21.15.188:6805/368834361', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:39:58.559393+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:39:58.563434+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:39:58.557643+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-25T22:40:44.520 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:40:44.520 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:44.515+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:44.570 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:44.570 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:44.584 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:40:44.630 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:44.632+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:44.706 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:44.706 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:44.720 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:40:44.721 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:44.722+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:44.823 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:44.819+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:44.851 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:44.851 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:44.867 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:40:44.869 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:44.874 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:40:44.887 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-04-25T22:40:44.432272+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596050,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":253,"num_write_kb":3480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91188,"kb_used_data":1808,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024332,"statfs":{"total":289910292480,"available":289816915968,"internally_reserved":0,"allocated":1851392,"data_stored":1416083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2831,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.305115"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356741+0000","last_change":"2024-04-25T22:40:36.296993+0000","last_active":"2024-04-25T22:40:41.356741+0000","last_peered":"2024-04-25T22:40:41.356741+0000","last_clean":"2024-04-25T22:40:41.356741+0000","last_became_active":"2024-04-25T22:40:36.296111+0000","last_became_peered":"2024-04-25T22:40:36.296111+0000","last_unstale":"2024-04-25T22:40:41.356741+0000","last_undegraded":"2024-04-25T22:40:41.356741+0000","last_fullsized":"2024-04-25T22:40:41.356741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:03.272640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355742+0000","last_change":"2024-04-25T22:40:36.295443+0000","last_active":"2024-04-25T22:40:41.355742+0000","last_peered":"2024-04-25T22:40:41.355742+0000","last_clean":"2024-04-25T22:40:41.355742+0000","last_became_active":"2024-04-25T22:40:36.294248+0000","last_became_peered":"2024-04-25T22:40:36.294248+0000","last_unstale":"2024-04-25T22:40:41.355742+0000","last_undegraded":"2024-04-25T22:40:41.355742+0000","last_fullsized":"2024-04-25T22:40:41.355742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:25.839134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362638+0000","last_change":"2024-04-25T22:40:14.626211+0000","last_active":"2024-04-25T22:40:41.362638+0000","last_peered":"2024-04-25T22:40:41.362638+0000","last_clean":"2024-04-25T22:40:41.362638+0000","last_became_active":"2024-04-25T22:40:14.622625+0000","last_became_peered":"2024-04-25T22:40:14.622625+0000","last_unstale":"2024-04-25T22:40:41.362638+0000","last_undegraded":"2024-04-25T22:40:41.362638+0000","last_fullsized":"2024-04-25T22:40:41.362638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:35.993000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362024+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:40:41.362024+0000","last_peered":"2024-04-25T22:40:41.362024+0000","last_clean":"2024-04-25T22:40:41.362024+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:40:41.362024+0000","last_undegraded":"2024-04-25T22:40:41.362024+0000","last_fullsized":"2024-04-25T22:40:41.362024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354511+0000","last_change":"2024-04-25T22:40:36.294687+0000","last_active":"2024-04-25T22:40:41.354511+0000","last_peered":"2024-04-25T22:40:41.354511+0000","last_clean":"2024-04-25T22:40:41.354511+0000","last_became_active":"2024-04-25T22:40:36.294114+0000","last_became_peered":"2024-04-25T22:40:36.294114+0000","last_unstale":"2024-04-25T22:40:41.354511+0000","last_undegraded":"2024-04-25T22:40:41.354511+0000","last_fullsized":"2024-04-25T22:40:41.354511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:39:22.907771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361357+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:40:41.361357+0000","last_peered":"2024-04-25T22:40:41.361357+0000","last_clean":"2024-04-25T22:40:41.361357+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:40:41.361357+0000","last_undegraded":"2024-04-25T22:40:41.361357+0000","last_fullsized":"2024-04-25T22:40:41.361357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361192+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:40:41.361192+0000","last_peered":"2024-04-25T22:40:41.361192+0000","last_clean":"2024-04-25T22:40:41.361192+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:40:41.361192+0000","last_undegraded":"2024-04-25T22:40:41.361192+0000","last_fullsized":"2024-04-25T22:40:41.361192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360899+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:40:41.360899+0000","last_peered":"2024-04-25T22:40:41.360899+0000","last_clean":"2024-04-25T22:40:41.360899+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:40:41.360899+0000","last_undegraded":"2024-04-25T22:40:41.360899+0000","last_fullsized":"2024-04-25T22:40:41.360899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356162+0000","last_change":"2024-04-25T22:40:14.625922+0000","last_active":"2024-04-25T22:40:41.356162+0000","last_peered":"2024-04-25T22:40:41.356162+0000","last_clean":"2024-04-25T22:40:41.356162+0000","last_became_active":"2024-04-25T22:40:14.624594+0000","last_became_peered":"2024-04-25T22:40:14.624594+0000","last_unstale":"2024-04-25T22:40:41.356162+0000","last_undegraded":"2024-04-25T22:40:41.356162+0000","last_fullsized":"2024-04-25T22:40:41.356162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355788+0000","last_change":"2024-04-25T22:40:36.298225+0000","last_active":"2024-04-25T22:40:41.355788+0000","last_peered":"2024-04-25T22:40:41.355788+0000","last_clean":"2024-04-25T22:40:41.355788+0000","last_became_active":"2024-04-25T22:40:36.296299+0000","last_became_peered":"2024-04-25T22:40:36.296299+0000","last_unstale":"2024-04-25T22:40:41.355788+0000","last_undegraded":"2024-04-25T22:40:41.355788+0000","last_fullsized":"2024-04-25T22:40:41.355788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:02.464879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362915+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:40:41.362915+0000","last_peered":"2024-04-25T22:40:41.362915+0000","last_clean":"2024-04-25T22:40:41.362915+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:40:41.362915+0000","last_undegraded":"2024-04-25T22:40:41.362915+0000","last_fullsized":"2024-04-25T22:40:41.362915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361476+0000","last_change":"2024-04-25T22:40:36.305351+0000","last_active":"2024-04-25T22:40:41.361476+0000","last_peered":"2024-04-25T22:40:41.361476+0000","last_clean":"2024-04-25T22:40:41.361476+0000","last_became_active":"2024-04-25T22:40:36.303042+0000","last_became_peered":"2024-04-25T22:40:36.303042+0000","last_unstale":"2024-04-25T22:40:41.361476+0000","last_undegraded":"2024-04-25T22:40:41.361476+0000","last_fullsized":"2024-04-25T22:40:41.361476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:37.971547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354785+0000","last_change":"2024-04-25T22:40:36.296904+0000","last_active":"2024-04-25T22:40:41.354785+0000","last_peered":"2024-04-25T22:40:41.354785+0000","last_clean":"2024-04-25T22:40:41.354785+0000","last_became_active":"2024-04-25T22:40:36.295964+0000","last_became_peered":"2024-04-25T22:40:36.295964+0000","last_unstale":"2024-04-25T22:40:41.354785+0000","last_undegraded":"2024-04-25T22:40:41.354785+0000","last_fullsized":"2024-04-25T22:40:41.354785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:24.977111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361635+0000","last_change":"2024-04-25T22:40:14.616800+0000","last_active":"2024-04-25T22:40:41.361635+0000","last_peered":"2024-04-25T22:40:41.361635+0000","last_clean":"2024-04-25T22:40:41.361635+0000","last_became_active":"2024-04-25T22:40:14.612887+0000","last_became_peered":"2024-04-25T22:40:14.612887+0000","last_unstale":"2024-04-25T22:40:41.361635+0000","last_undegraded":"2024-04-25T22:40:41.361635+0000","last_fullsized":"2024-04-25T22:40:41.361635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361452+0000","last_change":"2024-04-25T22:40:14.615520+0000","last_active":"2024-04-25T22:40:41.361452+0000","last_peered":"2024-04-25T22:40:41.361452+0000","last_clean":"2024-04-25T22:40:41.361452+0000","last_became_active":"2024-04-25T22:40:14.613556+0000","last_became_peered":"2024-04-25T22:40:14.613556+0000","last_unstale":"2024-04-25T22:40:41.361452+0000","last_undegraded":"2024-04-25T22:40:41.361452+0000","last_fullsized":"2024-04-25T22:40:41.361452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360904+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:40:41.360904+0000","last_peered":"2024-04-25T22:40:41.360904+0000","last_clean":"2024-04-25T22:40:41.360904+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:40:41.360904+0000","last_undegraded":"2024-04-25T22:40:41.360904+0000","last_fullsized":"2024-04-25T22:40:41.360904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.357038+0000","last_change":"2024-04-25T22:40:14.628222+0000","last_active":"2024-04-25T22:40:41.357038+0000","last_peered":"2024-04-25T22:40:41.357038+0000","last_clean":"2024-04-25T22:40:41.357038+0000","last_became_active":"2024-04-25T22:40:14.626913+0000","last_became_peered":"2024-04-25T22:40:14.626913+0000","last_unstale":"2024-04-25T22:40:41.357038+0000","last_undegraded":"2024-04-25T22:40:41.357038+0000","last_fullsized":"2024-04-25T22:40:41.357038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356503+0000","last_change":"2024-04-25T22:40:36.300373+0000","last_active":"2024-04-25T22:40:41.356503+0000","last_peered":"2024-04-25T22:40:41.356503+0000","last_clean":"2024-04-25T22:40:41.356503+0000","last_became_active":"2024-04-25T22:40:36.299647+0000","last_became_peered":"2024-04-25T22:40:36.299647+0000","last_unstale":"2024-04-25T22:40:41.356503+0000","last_undegraded":"2024-04-25T22:40:41.356503+0000","last_fullsized":"2024-04-25T22:40:41.356503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:19.327397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355804+0000","last_change":"2024-04-25T22:40:14.623704+0000","last_active":"2024-04-25T22:40:41.355804+0000","last_peered":"2024-04-25T22:40:41.355804+0000","last_clean":"2024-04-25T22:40:41.355804+0000","last_became_active":"2024-04-25T22:40:14.623146+0000","last_became_peered":"2024-04-25T22:40:14.623146+0000","last_unstale":"2024-04-25T22:40:41.355804+0000","last_undegraded":"2024-04-25T22:40:41.355804+0000","last_fullsized":"2024-04-25T22:40:41.355804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362269+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:40:41.362269+0000","last_peered":"2024-04-25T22:40:41.362269+0000","last_clean":"2024-04-25T22:40:41.362269+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:40:41.362269+0000","last_undegraded":"2024-04-25T22:40:41.362269+0000","last_fullsized":"2024-04-25T22:40:41.362269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361789+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:40:41.361789+0000","last_peered":"2024-04-25T22:40:41.361789+0000","last_clean":"2024-04-25T22:40:41.361789+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:40:41.361789+0000","last_undegraded":"2024-04-25T22:40:41.361789+0000","last_fullsized":"2024-04-25T22:40:41.361789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360908+0000","last_change":"2024-04-25T22:40:36.305858+0000","last_active":"2024-04-25T22:40:41.360908+0000","last_peered":"2024-04-25T22:40:41.360908+0000","last_clean":"2024-04-25T22:40:41.360908+0000","last_became_active":"2024-04-25T22:40:36.304730+0000","last_became_peered":"2024-04-25T22:40:36.304730+0000","last_unstale":"2024-04-25T22:40:41.360908+0000","last_undegraded":"2024-04-25T22:40:41.360908+0000","last_fullsized":"2024-04-25T22:40:41.360908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:44.949501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.353984+0000","last_change":"2024-04-25T22:40:14.617094+0000","last_active":"2024-04-25T22:40:41.353984+0000","last_peered":"2024-04-25T22:40:41.353984+0000","last_clean":"2024-04-25T22:40:41.353984+0000","last_became_active":"2024-04-25T22:40:14.615818+0000","last_became_peered":"2024-04-25T22:40:14.615818+0000","last_unstale":"2024-04-25T22:40:41.353984+0000","last_undegraded":"2024-04-25T22:40:41.353984+0000","last_fullsized":"2024-04-25T22:40:41.353984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:30:53.093623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354010+0000","last_change":"2024-04-25T22:40:36.293289+0000","last_active":"2024-04-25T22:40:41.354010+0000","last_peered":"2024-04-25T22:40:41.354010+0000","last_clean":"2024-04-25T22:40:41.354010+0000","last_became_active":"2024-04-25T22:40:36.292483+0000","last_became_peered":"2024-04-25T22:40:36.292483+0000","last_unstale":"2024-04-25T22:40:41.354010+0000","last_undegraded":"2024-04-25T22:40:41.354010+0000","last_fullsized":"2024-04-25T22:40:41.354010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:51.686908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363394+0000","last_change":"2024-04-25T22:40:36.304773+0000","last_active":"2024-04-25T22:40:41.363394+0000","last_peered":"2024-04-25T22:40:41.363394+0000","last_clean":"2024-04-25T22:40:41.363394+0000","last_became_active":"2024-04-25T22:40:36.304073+0000","last_became_peered":"2024-04-25T22:40:36.304073+0000","last_unstale":"2024-04-25T22:40:41.363394+0000","last_undegraded":"2024-04-25T22:40:41.363394+0000","last_fullsized":"2024-04-25T22:40:41.363394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:02.464879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356234+0000","last_change":"2024-04-25T22:40:14.625933+0000","last_active":"2024-04-25T22:40:41.356234+0000","last_peered":"2024-04-25T22:40:41.356234+0000","last_clean":"2024-04-25T22:40:41.356234+0000","last_became_active":"2024-04-25T22:40:14.625123+0000","last_became_peered":"2024-04-25T22:40:14.625123+0000","last_unstale":"2024-04-25T22:40:41.356234+0000","last_undegraded":"2024-04-25T22:40:41.356234+0000","last_fullsized":"2024-04-25T22:40:41.356234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363088+0000","last_change":"2024-04-25T22:40:14.630596+0000","last_active":"2024-04-25T22:40:41.363088+0000","last_peered":"2024-04-25T22:40:41.363088+0000","last_clean":"2024-04-25T22:40:41.363088+0000","last_became_active":"2024-04-25T22:40:14.625407+0000","last_became_peered":"2024-04-25T22:40:14.625407+0000","last_unstale":"2024-04-25T22:40:41.363088+0000","last_undegraded":"2024-04-25T22:40:41.363088+0000","last_fullsized":"2024-04-25T22:40:41.363088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:20:05.398182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361749+0000","last_change":"2024-04-25T22:40:36.303740+0000","last_active":"2024-04-25T22:40:41.361749+0000","last_peered":"2024-04-25T22:40:41.361749+0000","last_clean":"2024-04-25T22:40:41.361749+0000","last_became_active":"2024-04-25T22:40:36.303305+0000","last_became_peered":"2024-04-25T22:40:36.303305+0000","last_unstale":"2024-04-25T22:40:41.361749+0000","last_undegraded":"2024-04-25T22:40:41.361749+0000","last_fullsized":"2024-04-25T22:40:41.361749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:03.272640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355393+0000","last_change":"2024-04-25T22:40:14.620608+0000","last_active":"2024-04-25T22:40:41.355393+0000","last_peered":"2024-04-25T22:40:41.355393+0000","last_clean":"2024-04-25T22:40:41.355393+0000","last_became_active":"2024-04-25T22:40:14.618171+0000","last_became_peered":"2024-04-25T22:40:14.618171+0000","last_unstale":"2024-04-25T22:40:41.355393+0000","last_undegraded":"2024-04-25T22:40:41.355393+0000","last_fullsized":"2024-04-25T22:40:41.355393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361247+0000","last_change":"2024-04-25T22:40:36.305391+0000","last_active":"2024-04-25T22:40:41.361247+0000","last_peered":"2024-04-25T22:40:41.361247+0000","last_clean":"2024-04-25T22:40:41.361247+0000","last_became_active":"2024-04-25T22:40:36.302601+0000","last_became_peered":"2024-04-25T22:40:36.302601+0000","last_unstale":"2024-04-25T22:40:41.361247+0000","last_undegraded":"2024-04-25T22:40:41.361247+0000","last_fullsized":"2024-04-25T22:40:41.361247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:54.909669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354087+0000","last_change":"2024-04-25T22:40:14.618468+0000","last_active":"2024-04-25T22:40:41.354087+0000","last_peered":"2024-04-25T22:40:41.354087+0000","last_clean":"2024-04-25T22:40:41.354087+0000","last_became_active":"2024-04-25T22:40:14.617312+0000","last_became_peered":"2024-04-25T22:40:14.617312+0000","last_unstale":"2024-04-25T22:40:41.354087+0000","last_undegraded":"2024-04-25T22:40:41.354087+0000","last_fullsized":"2024-04-25T22:40:41.354087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:12.679354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361922+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:40:41.361922+0000","last_peered":"2024-04-25T22:40:41.361922+0000","last_clean":"2024-04-25T22:40:41.361922+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:40:41.361922+0000","last_undegraded":"2024-04-25T22:40:41.361922+0000","last_fullsized":"2024-04-25T22:40:41.361922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355454+0000","last_change":"2024-04-25T22:40:36.296749+0000","last_active":"2024-04-25T22:40:41.355454+0000","last_peered":"2024-04-25T22:40:41.355454+0000","last_clean":"2024-04-25T22:40:41.355454+0000","last_became_active":"2024-04-25T22:40:36.295933+0000","last_became_peered":"2024-04-25T22:40:36.295933+0000","last_unstale":"2024-04-25T22:40:41.355454+0000","last_undegraded":"2024-04-25T22:40:41.355454+0000","last_fullsized":"2024-04-25T22:40:41.355454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:18.491547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362634+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:40:41.362634+0000","last_peered":"2024-04-25T22:40:41.362634+0000","last_clean":"2024-04-25T22:40:41.362634+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:40:41.362634+0000","last_undegraded":"2024-04-25T22:40:41.362634+0000","last_fullsized":"2024-04-25T22:40:41.362634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355458+0000","last_change":"2024-04-25T22:40:36.298200+0000","last_active":"2024-04-25T22:40:41.355458+0000","last_peered":"2024-04-25T22:40:41.355458+0000","last_clean":"2024-04-25T22:40:41.355458+0000","last_became_active":"2024-04-25T22:40:36.296613+0000","last_became_peered":"2024-04-25T22:40:36.296613+0000","last_unstale":"2024-04-25T22:40:41.355458+0000","last_undegraded":"2024-04-25T22:40:41.355458+0000","last_fullsized":"2024-04-25T22:40:41.355458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:12.611590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354817+0000","last_change":"2024-04-25T22:40:13.581241+0000","last_active":"2024-04-25T22:40:41.354817+0000","last_peered":"2024-04-25T22:40:41.354817+0000","last_clean":"2024-04-25T22:40:41.354817+0000","last_became_active":"2024-04-25T22:40:13.580442+0000","last_became_peered":"2024-04-25T22:40:13.580442+0000","last_unstale":"2024-04-25T22:40:41.354817+0000","last_undegraded":"2024-04-25T22:40:41.354817+0000","last_fullsized":"2024-04-25T22:40:41.354817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:50:49.280995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356712+0000","last_change":"2024-04-25T22:40:14.631577+0000","last_active":"2024-04-25T22:40:41.356712+0000","last_peered":"2024-04-25T22:40:41.356712+0000","last_clean":"2024-04-25T22:40:41.356712+0000","last_became_active":"2024-04-25T22:40:14.630371+0000","last_became_peered":"2024-04-25T22:40:14.630371+0000","last_unstale":"2024-04-25T22:40:41.356712+0000","last_undegraded":"2024-04-25T22:40:41.356712+0000","last_fullsized":"2024-04-25T22:40:41.356712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360875+0000","last_change":"2024-04-25T22:40:36.306844+0000","last_active":"2024-04-25T22:40:41.360875+0000","last_peered":"2024-04-25T22:40:41.360875+0000","last_clean":"2024-04-25T22:40:41.360875+0000","last_became_active":"2024-04-25T22:40:36.303223+0000","last_became_peered":"2024-04-25T22:40:36.303223+0000","last_unstale":"2024-04-25T22:40:41.360875+0000","last_undegraded":"2024-04-25T22:40:41.360875+0000","last_fullsized":"2024-04-25T22:40:41.360875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:21.069965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356213+0000","last_change":"2024-04-25T22:40:14.630012+0000","last_active":"2024-04-25T22:40:41.356213+0000","last_peered":"2024-04-25T22:40:41.356213+0000","last_clean":"2024-04-25T22:40:41.356213+0000","last_became_active":"2024-04-25T22:40:14.628677+0000","last_became_peered":"2024-04-25T22:40:14.628677+0000","last_unstale":"2024-04-25T22:40:41.356213+0000","last_undegraded":"2024-04-25T22:40:41.356213+0000","last_fullsized":"2024-04-25T22:40:41.356213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361374+0000","last_change":"2024-04-25T22:40:13.599918+0000","last_active":"2024-04-25T22:40:41.361374+0000","last_peered":"2024-04-25T22:40:41.361374+0000","last_clean":"2024-04-25T22:40:41.361374+0000","last_became_active":"2024-04-25T22:40:13.596461+0000","last_became_peered":"2024-04-25T22:40:13.596461+0000","last_unstale":"2024-04-25T22:40:41.361374+0000","last_undegraded":"2024-04-25T22:40:41.361374+0000","last_fullsized":"2024-04-25T22:40:41.361374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:41:51.887162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363904+0000","last_change":"2024-04-25T22:40:13.598294+0000","last_active":"2024-04-25T22:40:41.363904+0000","last_peered":"2024-04-25T22:40:41.363904+0000","last_clean":"2024-04-25T22:40:41.363904+0000","last_became_active":"2024-04-25T22:40:13.596687+0000","last_became_peered":"2024-04-25T22:40:13.596687+0000","last_unstale":"2024-04-25T22:40:41.363904+0000","last_undegraded":"2024-04-25T22:40:41.363904+0000","last_fullsized":"2024-04-25T22:40:41.363904+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:50:49.280995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360548+0000","last_change":"2024-04-25T22:40:36.302843+0000","last_active":"2024-04-25T22:40:41.360548+0000","last_peered":"2024-04-25T22:40:41.360548+0000","last_clean":"2024-04-25T22:40:41.360548+0000","last_became_active":"2024-04-25T22:40:36.302275+0000","last_became_peered":"2024-04-25T22:40:36.302275+0000","last_unstale":"2024-04-25T22:40:41.360548+0000","last_undegraded":"2024-04-25T22:40:41.360548+0000","last_fullsized":"2024-04-25T22:40:41.360548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:24.977111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362453+0000","last_change":"2024-04-25T22:40:36.304995+0000","last_active":"2024-04-25T22:40:41.362453+0000","last_peered":"2024-04-25T22:40:41.362453+0000","last_clean":"2024-04-25T22:40:41.362453+0000","last_became_active":"2024-04-25T22:40:36.304133+0000","last_became_peered":"2024-04-25T22:40:36.304133+0000","last_unstale":"2024-04-25T22:40:41.362453+0000","last_undegraded":"2024-04-25T22:40:41.362453+0000","last_fullsized":"2024-04-25T22:40:41.362453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:06:24.787279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354397+0000","last_change":"2024-04-25T22:40:36.295350+0000","last_active":"2024-04-25T22:40:41.354397+0000","last_peered":"2024-04-25T22:40:41.354397+0000","last_clean":"2024-04-25T22:40:41.354397+0000","last_became_active":"2024-04-25T22:40:36.294081+0000","last_became_peered":"2024-04-25T22:40:36.294081+0000","last_unstale":"2024-04-25T22:40:41.354397+0000","last_undegraded":"2024-04-25T22:40:41.354397+0000","last_fullsized":"2024-04-25T22:40:41.354397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:57:06.769650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363790+0000","last_change":"2024-04-25T22:40:13.601404+0000","last_active":"2024-04-25T22:40:41.363790+0000","last_peered":"2024-04-25T22:40:41.363790+0000","last_clean":"2024-04-25T22:40:41.363790+0000","last_became_active":"2024-04-25T22:40:13.600688+0000","last_became_peered":"2024-04-25T22:40:13.600688+0000","last_unstale":"2024-04-25T22:40:41.363790+0000","last_undegraded":"2024-04-25T22:40:41.363790+0000","last_fullsized":"2024-04-25T22:40:41.363790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:36.157648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361796+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:40:41.361796+0000","last_peered":"2024-04-25T22:40:41.361796+0000","last_clean":"2024-04-25T22:40:41.361796+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:40:41.361796+0000","last_undegraded":"2024-04-25T22:40:41.361796+0000","last_fullsized":"2024-04-25T22:40:41.361796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362822+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:40:41.362822+0000","last_peered":"2024-04-25T22:40:41.362822+0000","last_clean":"2024-04-25T22:40:41.362822+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:40:41.362822+0000","last_undegraded":"2024-04-25T22:40:41.362822+0000","last_fullsized":"2024-04-25T22:40:41.362822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355530+0000","last_change":"2024-04-25T22:40:14.625843+0000","last_active":"2024-04-25T22:40:41.355530+0000","last_peered":"2024-04-25T22:40:41.355530+0000","last_clean":"2024-04-25T22:40:41.355530+0000","last_became_active":"2024-04-25T22:40:14.625187+0000","last_became_peered":"2024-04-25T22:40:14.625187+0000","last_unstale":"2024-04-25T22:40:41.355530+0000","last_undegraded":"2024-04-25T22:40:41.355530+0000","last_fullsized":"2024-04-25T22:40:41.355530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355803+0000","last_change":"2024-04-25T22:40:13.581857+0000","last_active":"2024-04-25T22:40:41.355803+0000","last_peered":"2024-04-25T22:40:41.355803+0000","last_clean":"2024-04-25T22:40:41.355803+0000","last_became_active":"2024-04-25T22:40:13.581263+0000","last_became_peered":"2024-04-25T22:40:13.581263+0000","last_unstale":"2024-04-25T22:40:41.355803+0000","last_undegraded":"2024-04-25T22:40:41.355803+0000","last_fullsized":"2024-04-25T22:40:41.355803+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:54:01.709709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362481+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:40:41.362481+0000","last_peered":"2024-04-25T22:40:41.362481+0000","last_clean":"2024-04-25T22:40:41.362481+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:40:41.362481+0000","last_undegraded":"2024-04-25T22:40:41.362481+0000","last_fullsized":"2024-04-25T22:40:41.362481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362917+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:40:41.362917+0000","last_peered":"2024-04-25T22:40:41.362917+0000","last_clean":"2024-04-25T22:40:41.362917+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:40:41.362917+0000","last_undegraded":"2024-04-25T22:40:41.362917+0000","last_fullsized":"2024-04-25T22:40:41.362917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363547+0000","last_change":"2024-04-25T22:40:14.621941+0000","last_active":"2024-04-25T22:40:41.363547+0000","last_peered":"2024-04-25T22:40:41.363547+0000","last_clean":"2024-04-25T22:40:41.363547+0000","last_became_active":"2024-04-25T22:40:14.614196+0000","last_became_peered":"2024-04-25T22:40:14.614196+0000","last_unstale":"2024-04-25T22:40:41.363547+0000","last_undegraded":"2024-04-25T22:40:41.363547+0000","last_fullsized":"2024-04-25T22:40:41.363547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:24.895025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361217+0000","last_change":"2024-04-25T22:40:36.305242+0000","last_active":"2024-04-25T22:40:41.361217+0000","last_peered":"2024-04-25T22:40:41.361217+0000","last_clean":"2024-04-25T22:40:41.361217+0000","last_became_active":"2024-04-25T22:40:36.302259+0000","last_became_peered":"2024-04-25T22:40:36.302259+0000","last_unstale":"2024-04-25T22:40:41.361217+0000","last_undegraded":"2024-04-25T22:40:41.361217+0000","last_fullsized":"2024-04-25T22:40:41.361217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:48.252489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362510+0000","last_change":"2024-04-25T22:40:14.614275+0000","last_active":"2024-04-25T22:40:41.362510+0000","last_peered":"2024-04-25T22:40:41.362510+0000","last_clean":"2024-04-25T22:40:41.362510+0000","last_became_active":"2024-04-25T22:40:14.613038+0000","last_became_peered":"2024-04-25T22:40:14.613038+0000","last_unstale":"2024-04-25T22:40:41.362510+0000","last_undegraded":"2024-04-25T22:40:41.362510+0000","last_fullsized":"2024-04-25T22:40:41.362510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:14:02.343388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354129+0000","last_change":"2024-04-25T22:40:36.293392+0000","last_active":"2024-04-25T22:40:41.354129+0000","last_peered":"2024-04-25T22:40:41.354129+0000","last_clean":"2024-04-25T22:40:41.354129+0000","last_became_active":"2024-04-25T22:40:36.292567+0000","last_became_peered":"2024-04-25T22:40:36.292567+0000","last_unstale":"2024-04-25T22:40:41.354129+0000","last_undegraded":"2024-04-25T22:40:41.354129+0000","last_fullsized":"2024-04-25T22:40:41.354129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:21.419443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356361+0000","last_change":"2024-04-25T22:40:14.627280+0000","last_active":"2024-04-25T22:40:41.356361+0000","last_peered":"2024-04-25T22:40:41.356361+0000","last_clean":"2024-04-25T22:40:41.356361+0000","last_became_active":"2024-04-25T22:40:14.624656+0000","last_became_peered":"2024-04-25T22:40:14.624656+0000","last_unstale":"2024-04-25T22:40:41.356361+0000","last_undegraded":"2024-04-25T22:40:41.356361+0000","last_fullsized":"2024-04-25T22:40:41.356361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":230,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362199+0000","last_change":"2024-04-25T22:40:04.317146+0000","last_active":"2024-04-25T22:40:41.362199+0000","last_peered":"2024-04-25T22:40:41.362199+0000","last_clean":"2024-04-25T22:40:41.362199+0000","last_became_active":"2024-04-25T22:40:04.316527+0000","last_became_peered":"2024-04-25T22:40:04.316527+0000","last_unstale":"2024-04-25T22:40:41.362199+0000","last_undegraded":"2024-04-25T22:40:41.362199+0000","last_fullsized":"2024-04-25T22:40:41.362199+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:25.669997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363214+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:40:41.363214+0000","last_peered":"2024-04-25T22:40:41.363214+0000","last_clean":"2024-04-25T22:40:41.363214+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:40:41.363214+0000","last_undegraded":"2024-04-25T22:40:41.363214+0000","last_fullsized":"2024-04-25T22:40:41.363214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355004+0000","last_change":"2024-04-25T22:40:13.591980+0000","last_active":"2024-04-25T22:40:41.355004+0000","last_peered":"2024-04-25T22:40:41.355004+0000","last_clean":"2024-04-25T22:40:41.355004+0000","last_became_active":"2024-04-25T22:40:13.591152+0000","last_became_peered":"2024-04-25T22:40:13.591152+0000","last_unstale":"2024-04-25T22:40:41.355004+0000","last_undegraded":"2024-04-25T22:40:41.355004+0000","last_fullsized":"2024-04-25T22:40:41.355004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363654+0000","last_change":"2024-04-25T22:40:14.621472+0000","last_active":"2024-04-25T22:40:41.363654+0000","last_peered":"2024-04-25T22:40:41.363654+0000","last_clean":"2024-04-25T22:40:41.363654+0000","last_became_active":"2024-04-25T22:40:14.613608+0000","last_became_peered":"2024-04-25T22:40:14.613608+0000","last_unstale":"2024-04-25T22:40:41.363654+0000","last_undegraded":"2024-04-25T22:40:41.363654+0000","last_fullsized":"2024-04-25T22:40:41.363654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:51.686908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361930+0000","last_change":"2024-04-25T22:40:09.502444+0000","last_active":"2024-04-25T22:40:41.361930+0000","last_peered":"2024-04-25T22:40:41.361930+0000","last_clean":"2024-04-25T22:40:41.361930+0000","last_became_active":"2024-04-25T22:40:09.501576+0000","last_became_peered":"2024-04-25T22:40:09.501576+0000","last_unstale":"2024-04-25T22:40:41.361930+0000","last_undegraded":"2024-04-25T22:40:41.361930+0000","last_fullsized":"2024-04-25T22:40:41.361930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:35:14.955359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354744+0000","last_change":"2024-04-25T22:40:13.579430+0000","last_active":"2024-04-25T22:40:41.354744+0000","last_peered":"2024-04-25T22:40:41.354744+0000","last_clean":"2024-04-25T22:40:41.354744+0000","last_became_active":"2024-04-25T22:40:13.578601+0000","last_became_peered":"2024-04-25T22:40:13.578601+0000","last_unstale":"2024-04-25T22:40:41.354744+0000","last_undegraded":"2024-04-25T22:40:41.354744+0000","last_fullsized":"2024-04-25T22:40:41.354744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:50.274924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355958+0000","last_change":"2024-04-25T22:40:36.298928+0000","last_active":"2024-04-25T22:40:41.355958+0000","last_peered":"2024-04-25T22:40:41.355958+0000","last_clean":"2024-04-25T22:40:41.355958+0000","last_became_active":"2024-04-25T22:40:36.298266+0000","last_became_peered":"2024-04-25T22:40:36.298266+0000","last_unstale":"2024-04-25T22:40:41.355958+0000","last_undegraded":"2024-04-25T22:40:41.355958+0000","last_fullsized":"2024-04-25T22:40:41.355958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:49.281475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355100+0000","last_change":"2024-04-25T22:40:09.501323+0000","last_active":"2024-04-25T22:40:41.355100+0000","last_peered":"2024-04-25T22:40:41.355100+0000","last_clean":"2024-04-25T22:40:41.355100+0000","last_became_active":"2024-04-25T22:40:09.500499+0000","last_became_peered":"2024-04-25T22:40:09.500499+0000","last_unstale":"2024-04-25T22:40:41.355100+0000","last_undegraded":"2024-04-25T22:40:41.355100+0000","last_fullsized":"2024-04-25T22:40:41.355100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:30.289572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360548+0000","last_change":"2024-04-25T22:40:36.303534+0000","last_active":"2024-04-25T22:40:41.360548+0000","last_peered":"2024-04-25T22:40:41.360548+0000","last_clean":"2024-04-25T22:40:41.360548+0000","last_became_active":"2024-04-25T22:40:36.302351+0000","last_became_peered":"2024-04-25T22:40:36.302351+0000","last_unstale":"2024-04-25T22:40:41.360548+0000","last_undegraded":"2024-04-25T22:40:41.360548+0000","last_fullsized":"2024-04-25T22:40:41.360548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:31:09.162739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356459+0000","last_change":"2024-04-25T22:40:14.628007+0000","last_active":"2024-04-25T22:40:41.356459+0000","last_peered":"2024-04-25T22:40:41.356459+0000","last_clean":"2024-04-25T22:40:41.356459+0000","last_became_active":"2024-04-25T22:40:14.625425+0000","last_became_peered":"2024-04-25T22:40:14.625425+0000","last_unstale":"2024-04-25T22:40:41.356459+0000","last_undegraded":"2024-04-25T22:40:41.356459+0000","last_fullsized":"2024-04-25T22:40:41.356459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363258+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:40:41.363258+0000","last_peered":"2024-04-25T22:40:41.363258+0000","last_clean":"2024-04-25T22:40:41.363258+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:40:41.363258+0000","last_undegraded":"2024-04-25T22:40:41.363258+0000","last_fullsized":"2024-04-25T22:40:41.363258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362815+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:40:41.362815+0000","last_peered":"2024-04-25T22:40:41.362815+0000","last_clean":"2024-04-25T22:40:41.362815+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:40:41.362815+0000","last_undegraded":"2024-04-25T22:40:41.362815+0000","last_fullsized":"2024-04-25T22:40:41.362815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356113+0000","last_change":"2024-04-25T22:40:14.622442+0000","last_active":"2024-04-25T22:40:41.356113+0000","last_peered":"2024-04-25T22:40:41.356113+0000","last_clean":"2024-04-25T22:40:41.356113+0000","last_became_active":"2024-04-25T22:40:14.621130+0000","last_became_peered":"2024-04-25T22:40:14.621130+0000","last_unstale":"2024-04-25T22:40:41.356113+0000","last_undegraded":"2024-04-25T22:40:41.356113+0000","last_fullsized":"2024-04-25T22:40:41.356113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363897+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:40:41.363897+0000","last_peered":"2024-04-25T22:40:41.363897+0000","last_clean":"2024-04-25T22:40:41.363897+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:40:41.363897+0000","last_undegraded":"2024-04-25T22:40:41.363897+0000","last_fullsized":"2024-04-25T22:40:41.363897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356455+0000","last_change":"2024-04-25T22:40:09.501325+0000","last_active":"2024-04-25T22:40:41.356455+0000","last_peered":"2024-04-25T22:40:41.356455+0000","last_clean":"2024-04-25T22:40:41.356455+0000","last_became_active":"2024-04-25T22:40:09.500542+0000","last_became_peered":"2024-04-25T22:40:09.500542+0000","last_unstale":"2024-04-25T22:40:41.356455+0000","last_undegraded":"2024-04-25T22:40:41.356455+0000","last_fullsized":"2024-04-25T22:40:41.356455+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:34:38.234538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360953+0000","last_change":"2024-04-25T22:40:36.306443+0000","last_active":"2024-04-25T22:40:41.360953+0000","last_peered":"2024-04-25T22:40:41.360953+0000","last_clean":"2024-04-25T22:40:41.360953+0000","last_became_active":"2024-04-25T22:40:36.303568+0000","last_became_peered":"2024-04-25T22:40:36.303568+0000","last_unstale":"2024-04-25T22:40:41.360953+0000","last_undegraded":"2024-04-25T22:40:41.360953+0000","last_fullsized":"2024-04-25T22:40:41.360953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:43:42.692718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356448+0000","last_change":"2024-04-25T22:40:13.591256+0000","last_active":"2024-04-25T22:40:41.356448+0000","last_peered":"2024-04-25T22:40:41.356448+0000","last_clean":"2024-04-25T22:40:41.356448+0000","last_became_active":"2024-04-25T22:40:13.590744+0000","last_became_peered":"2024-04-25T22:40:13.590744+0000","last_unstale":"2024-04-25T22:40:41.356448+0000","last_undegraded":"2024-04-25T22:40:41.356448+0000","last_fullsized":"2024-04-25T22:40:41.356448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:50.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355865+0000","last_change":"2024-04-25T22:40:36.300605+0000","last_active":"2024-04-25T22:40:41.355865+0000","last_peered":"2024-04-25T22:40:41.355865+0000","last_clean":"2024-04-25T22:40:41.355865+0000","last_became_active":"2024-04-25T22:40:36.299998+0000","last_became_peered":"2024-04-25T22:40:36.299998+0000","last_unstale":"2024-04-25T22:40:41.355865+0000","last_undegraded":"2024-04-25T22:40:41.355865+0000","last_fullsized":"2024-04-25T22:40:41.355865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:49.794261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361244+0000","last_change":"2024-04-25T22:40:36.305326+0000","last_active":"2024-04-25T22:40:41.361244+0000","last_peered":"2024-04-25T22:40:41.361244+0000","last_clean":"2024-04-25T22:40:41.361244+0000","last_became_active":"2024-04-25T22:40:36.302867+0000","last_became_peered":"2024-04-25T22:40:36.302867+0000","last_unstale":"2024-04-25T22:40:41.361244+0000","last_undegraded":"2024-04-25T22:40:41.361244+0000","last_fullsized":"2024-04-25T22:40:41.361244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:19.327397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.357090+0000","last_change":"2024-04-25T22:40:13.592055+0000","last_active":"2024-04-25T22:40:41.357090+0000","last_peered":"2024-04-25T22:40:41.357090+0000","last_clean":"2024-04-25T22:40:41.357090+0000","last_became_active":"2024-04-25T22:40:13.591169+0000","last_became_peered":"2024-04-25T22:40:13.591169+0000","last_unstale":"2024-04-25T22:40:41.357090+0000","last_undegraded":"2024-04-25T22:40:41.357090+0000","last_fullsized":"2024-04-25T22:40:41.357090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:33.458799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356853+0000","last_change":"2024-04-25T22:40:09.501358+0000","last_active":"2024-04-25T22:40:41.356853+0000","last_peered":"2024-04-25T22:40:41.356853+0000","last_clean":"2024-04-25T22:40:41.356853+0000","last_became_active":"2024-04-25T22:40:09.500626+0000","last_became_peered":"2024-04-25T22:40:09.500626+0000","last_unstale":"2024-04-25T22:40:41.356853+0000","last_undegraded":"2024-04-25T22:40:41.356853+0000","last_fullsized":"2024-04-25T22:40:41.356853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:55.182967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354447+0000","last_change":"2024-04-25T22:40:14.618363+0000","last_active":"2024-04-25T22:40:41.354447+0000","last_peered":"2024-04-25T22:40:41.354447+0000","last_clean":"2024-04-25T22:40:41.354447+0000","last_became_active":"2024-04-25T22:40:14.617599+0000","last_became_peered":"2024-04-25T22:40:14.617599+0000","last_unstale":"2024-04-25T22:40:41.354447+0000","last_undegraded":"2024-04-25T22:40:41.354447+0000","last_fullsized":"2024-04-25T22:40:41.354447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"22'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356747+0000","last_change":"2024-04-25T22:40:13.593400+0000","last_active":"2024-04-25T22:40:41.356747+0000","last_peered":"2024-04-25T22:40:41.356747+0000","last_clean":"2024-04-25T22:40:41.356747+0000","last_became_active":"2024-04-25T22:40:13.592338+0000","last_became_peered":"2024-04-25T22:40:13.592338+0000","last_unstale":"2024-04-25T22:40:41.356747+0000","last_undegraded":"2024-04-25T22:40:41.356747+0000","last_fullsized":"2024-04-25T22:40:41.356747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.364044+0000","last_change":"2024-04-25T22:40:09.500948+0000","last_active":"2024-04-25T22:40:41.364044+0000","last_peered":"2024-04-25T22:40:41.364044+0000","last_clean":"2024-04-25T22:40:41.364044+0000","last_became_active":"2024-04-25T22:40:09.500236+0000","last_became_peered":"2024-04-25T22:40:09.500236+0000","last_unstale":"2024-04-25T22:40:41.364044+0000","last_undegraded":"2024-04-25T22:40:41.364044+0000","last_fullsized":"2024-04-25T22:40:41.364044+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:02.375961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.360763+0000","last_change":"2024-04-25T22:40:36.306177+0000","last_active":"2024-04-25T22:40:41.360763+0000","last_peered":"2024-04-25T22:40:41.360763+0000","last_clean":"2024-04-25T22:40:41.360763+0000","last_became_active":"2024-04-25T22:40:36.304767+0000","last_became_peered":"2024-04-25T22:40:36.304767+0000","last_unstale":"2024-04-25T22:40:41.360763+0000","last_undegraded":"2024-04-25T22:40:41.360763+0000","last_fullsized":"2024-04-25T22:40:41.360763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:31.194700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362158+0000","last_change":"2024-04-25T22:40:14.619806+0000","last_active":"2024-04-25T22:40:41.362158+0000","last_peered":"2024-04-25T22:40:41.362158+0000","last_clean":"2024-04-25T22:40:41.362158+0000","last_became_active":"2024-04-25T22:40:14.618980+0000","last_became_peered":"2024-04-25T22:40:14.618980+0000","last_unstale":"2024-04-25T22:40:41.362158+0000","last_undegraded":"2024-04-25T22:40:41.362158+0000","last_fullsized":"2024-04-25T22:40:41.362158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"21'9","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362739+0000","last_change":"2024-04-25T22:40:13.598003+0000","last_active":"2024-04-25T22:40:41.362739+0000","last_peered":"2024-04-25T22:40:41.362739+0000","last_clean":"2024-04-25T22:40:41.362739+0000","last_became_active":"2024-04-25T22:40:13.596631+0000","last_became_peered":"2024-04-25T22:40:13.596631+0000","last_unstale":"2024-04-25T22:40:41.362739+0000","last_undegraded":"2024-04-25T22:40:41.362739+0000","last_fullsized":"2024-04-25T22:40:41.362739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:50.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4884,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354503+0000","last_change":"2024-04-25T22:40:14.620064+0000","last_active":"2024-04-25T22:40:41.354503+0000","last_peered":"2024-04-25T22:40:41.354503+0000","last_clean":"2024-04-25T22:40:41.354503+0000","last_became_active":"2024-04-25T22:40:14.619294+0000","last_became_peered":"2024-04-25T22:40:14.619294+0000","last_unstale":"2024-04-25T22:40:41.354503+0000","last_undegraded":"2024-04-25T22:40:41.354503+0000","last_fullsized":"2024-04-25T22:40:41.354503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363378+0000","last_change":"2024-04-25T22:40:36.307956+0000","last_active":"2024-04-25T22:40:41.363378+0000","last_peered":"2024-04-25T22:40:41.363378+0000","last_clean":"2024-04-25T22:40:41.363378+0000","last_became_active":"2024-04-25T22:40:36.306587+0000","last_became_peered":"2024-04-25T22:40:36.306587+0000","last_unstale":"2024-04-25T22:40:41.363378+0000","last_undegraded":"2024-04-25T22:40:41.363378+0000","last_fullsized":"2024-04-25T22:40:41.363378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:32.249184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363503+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:40:41.363503+0000","last_peered":"2024-04-25T22:40:41.363503+0000","last_clean":"2024-04-25T22:40:41.363503+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:40:41.363503+0000","last_undegraded":"2024-04-25T22:40:41.363503+0000","last_fullsized":"2024-04-25T22:40:41.363503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354262+0000","last_change":"2024-04-25T22:40:14.627868+0000","last_active":"2024-04-25T22:40:41.354262+0000","last_peered":"2024-04-25T22:40:41.354262+0000","last_clean":"2024-04-25T22:40:41.354262+0000","last_became_active":"2024-04-25T22:40:14.626388+0000","last_became_peered":"2024-04-25T22:40:14.626388+0000","last_unstale":"2024-04-25T22:40:41.354262+0000","last_undegraded":"2024-04-25T22:40:41.354262+0000","last_fullsized":"2024-04-25T22:40:41.354262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356821+0000","last_change":"2024-04-25T22:40:13.593378+0000","last_active":"2024-04-25T22:40:41.356821+0000","last_peered":"2024-04-25T22:40:41.356821+0000","last_clean":"2024-04-25T22:40:41.356821+0000","last_became_active":"2024-04-25T22:40:13.592392+0000","last_became_peered":"2024-04-25T22:40:13.592392+0000","last_unstale":"2024-04-25T22:40:41.356821+0000","last_undegraded":"2024-04-25T22:40:41.356821+0000","last_fullsized":"2024-04-25T22:40:41.356821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354279+0000","last_change":"2024-04-25T22:40:14.619640+0000","last_active":"2024-04-25T22:40:41.354279+0000","last_peered":"2024-04-25T22:40:41.354279+0000","last_clean":"2024-04-25T22:40:41.354279+0000","last_became_active":"2024-04-25T22:40:14.618088+0000","last_became_peered":"2024-04-25T22:40:14.618088+0000","last_unstale":"2024-04-25T22:40:41.354279+0000","last_undegraded":"2024-04-25T22:40:41.354279+0000","last_fullsized":"2024-04-25T22:40:41.354279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:58.322470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.363569+0000","last_change":"2024-04-25T22:40:36.304451+0000","last_active":"2024-04-25T22:40:41.363569+0000","last_peered":"2024-04-25T22:40:41.363569+0000","last_clean":"2024-04-25T22:40:41.363569+0000","last_became_active":"2024-04-25T22:40:36.303841+0000","last_became_peered":"2024-04-25T22:40:36.303841+0000","last_unstale":"2024-04-25T22:40:41.363569+0000","last_undegraded":"2024-04-25T22:40:41.363569+0000","last_fullsized":"2024-04-25T22:40:41.363569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:12.611590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354759+0000","last_change":"2024-04-25T22:40:13.588577+0000","last_active":"2024-04-25T22:40:41.354759+0000","last_peered":"2024-04-25T22:40:41.354759+0000","last_clean":"2024-04-25T22:40:41.354759+0000","last_became_active":"2024-04-25T22:40:13.588019+0000","last_became_peered":"2024-04-25T22:40:13.588019+0000","last_unstale":"2024-04-25T22:40:41.354759+0000","last_undegraded":"2024-04-25T22:40:41.354759+0000","last_fullsized":"2024-04-25T22:40:41.354759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:07.743396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356231+0000","last_change":"2024-04-25T22:40:14.630597+0000","last_active":"2024-04-25T22:40:41.356231+0000","last_peered":"2024-04-25T22:40:41.356231+0000","last_clean":"2024-04-25T22:40:41.356231+0000","last_became_active":"2024-04-25T22:40:14.628981+0000","last_became_peered":"2024-04-25T22:40:14.628981+0000","last_unstale":"2024-04-25T22:40:41.356231+0000","last_undegraded":"2024-04-25T22:40:41.356231+0000","last_fullsized":"2024-04-25T22:40:41.356231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354747+0000","last_change":"2024-04-25T22:40:13.581827+0000","last_active":"2024-04-25T22:40:41.354747+0000","last_peered":"2024-04-25T22:40:41.354747+0000","last_clean":"2024-04-25T22:40:41.354747+0000","last_became_active":"2024-04-25T22:40:13.581166+0000","last_became_peered":"2024-04-25T22:40:13.581166+0000","last_unstale":"2024-04-25T22:40:41.354747+0000","last_undegraded":"2024-04-25T22:40:41.354747+0000","last_fullsized":"2024-04-25T22:40:41.354747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362067+0000","last_change":"2024-04-25T22:40:36.308091+0000","last_active":"2024-04-25T22:40:41.362067+0000","last_peered":"2024-04-25T22:40:41.362067+0000","last_clean":"2024-04-25T22:40:41.362067+0000","last_became_active":"2024-04-25T22:40:36.307377+0000","last_became_peered":"2024-04-25T22:40:36.307377+0000","last_unstale":"2024-04-25T22:40:41.362067+0000","last_undegraded":"2024-04-25T22:40:41.362067+0000","last_fullsized":"2024-04-25T22:40:41.362067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:49.433865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.354228+0000","last_change":"2024-04-25T22:40:36.293407+0000","last_active":"2024-04-25T22:40:41.354228+0000","last_peered":"2024-04-25T22:40:41.354228+0000","last_clean":"2024-04-25T22:40:41.354228+0000","last_became_active":"2024-04-25T22:40:36.292707+0000","last_became_peered":"2024-04-25T22:40:36.292707+0000","last_unstale":"2024-04-25T22:40:41.354228+0000","last_undegraded":"2024-04-25T22:40:41.354228+0000","last_fullsized":"2024-04-25T22:40:41.354228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:40:02.440775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355384+0000","last_change":"2024-04-25T22:40:36.298814+0000","last_active":"2024-04-25T22:40:41.355384+0000","last_peered":"2024-04-25T22:40:41.355384+0000","last_clean":"2024-04-25T22:40:41.355384+0000","last_became_active":"2024-04-25T22:40:36.298369+0000","last_became_peered":"2024-04-25T22:40:36.298369+0000","last_unstale":"2024-04-25T22:40:41.355384+0000","last_undegraded":"2024-04-25T22:40:41.355384+0000","last_fullsized":"2024-04-25T22:40:41.355384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:06:25.816264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361249+0000","last_change":"2024-04-25T22:40:36.306430+0000","last_active":"2024-04-25T22:40:41.361249+0000","last_peered":"2024-04-25T22:40:41.361249+0000","last_clean":"2024-04-25T22:40:41.361249+0000","last_became_active":"2024-04-25T22:40:36.305851+0000","last_became_peered":"2024-04-25T22:40:36.305851+0000","last_unstale":"2024-04-25T22:40:41.361249+0000","last_undegraded":"2024-04-25T22:40:41.361249+0000","last_fullsized":"2024-04-25T22:40:41.361249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:19.231988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361543+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:40:41.361543+0000","last_peered":"2024-04-25T22:40:41.361543+0000","last_clean":"2024-04-25T22:40:41.361543+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:40:41.361543+0000","last_undegraded":"2024-04-25T22:40:41.361543+0000","last_fullsized":"2024-04-25T22:40:41.361543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362533+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:40:41.362533+0000","last_peered":"2024-04-25T22:40:41.362533+0000","last_clean":"2024-04-25T22:40:41.362533+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:40:41.362533+0000","last_undegraded":"2024-04-25T22:40:41.362533+0000","last_fullsized":"2024-04-25T22:40:41.362533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361906+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:40:41.361906+0000","last_peered":"2024-04-25T22:40:41.361906+0000","last_clean":"2024-04-25T22:40:41.361906+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:40:41.361906+0000","last_undegraded":"2024-04-25T22:40:41.361906+0000","last_fullsized":"2024-04-25T22:40:41.361906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.362343+0000","last_change":"2024-04-25T22:40:36.307498+0000","last_active":"2024-04-25T22:40:41.362343+0000","last_peered":"2024-04-25T22:40:41.362343+0000","last_clean":"2024-04-25T22:40:41.362343+0000","last_became_active":"2024-04-25T22:40:36.305913+0000","last_became_peered":"2024-04-25T22:40:36.305913+0000","last_unstale":"2024-04-25T22:40:41.362343+0000","last_undegraded":"2024-04-25T22:40:41.362343+0000","last_fullsized":"2024-04-25T22:40:41.362343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:45:54.627527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.355077+0000","last_change":"2024-04-25T22:40:36.296798+0000","last_active":"2024-04-25T22:40:41.355077+0000","last_peered":"2024-04-25T22:40:41.355077+0000","last_clean":"2024-04-25T22:40:41.355077+0000","last_became_active":"2024-04-25T22:40:36.295967+0000","last_became_peered":"2024-04-25T22:40:36.295967+0000","last_unstale":"2024-04-25T22:40:41.355077+0000","last_undegraded":"2024-04-25T22:40:41.355077+0000","last_fullsized":"2024-04-25T22:40:41.355077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:47:46.321875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356527+0000","last_change":"2024-04-25T22:40:13.594172+0000","last_active":"2024-04-25T22:40:41.356527+0000","last_peered":"2024-04-25T22:40:41.356527+0000","last_clean":"2024-04-25T22:40:41.356527+0000","last_became_active":"2024-04-25T22:40:13.593428+0000","last_became_peered":"2024-04-25T22:40:13.593428+0000","last_unstale":"2024-04-25T22:40:41.356527+0000","last_undegraded":"2024-04-25T22:40:41.356527+0000","last_fullsized":"2024-04-25T22:40:41.356527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:41:51.887162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.361647+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:40:41.361647+0000","last_peered":"2024-04-25T22:40:41.361647+0000","last_clean":"2024-04-25T22:40:41.361647+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:40:41.361647+0000","last_undegraded":"2024-04-25T22:40:41.361647+0000","last_fullsized":"2024-04-25T22:40:41.361647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T22:40:41.356559+0000","last_change":"2024-04-25T22:40:13.593659+0000","last_active":"2024-04-25T22:40:41.356559+0000","last_peered":"2024-04-25T22:40:41.356559+0000","last_clean":"2024-04-25T22:40:41.356559+0000","last_became_active":"2024-04-25T22:40:13.592874+0000","last_became_peered":"2024-04-25T22:40:13.592874+0000","last_unstale":"2024-04-25T22:40:41.356559+0000","last_undegraded":"2024-04-25T22:40:41.356559+0000","last_fullsized":"2024-04-25T22:40:41.356559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5682,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":75277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738380,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":819200,"data_stored":670095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":827392,"data_stored":670711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:40:44.892 INFO:tasks.thrashosds.thrasher:Setting 4.2b to [0, 2] 2024-04-25T22:40:44.892 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.2b', '0', '2'] 2024-04-25T22:40:44.892 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.2b 0 2 2024-04-25T22:40:44.932 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:44.923+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:44.997 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:44.997 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:45.013 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:40:45.025 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:45.024+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:45.126 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:45.128+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:45.138 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:45.139 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:45.153 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:40:45.227 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:45.223+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:45.287 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:45.287 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:45.302 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:40:45.344 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:45.343+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:45.429 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:45.427+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:45.463 INFO:teuthology.orchestra.run.smithi057.stderr:set 4.2b pg_upmap mapping to [0,2] 2024-04-25T22:40:45.468 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:45.468 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:45.484 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:40:45.529 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:45.530+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:45.630 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:45.632+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:45.645 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:45.645 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:45.661 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:40:45.731 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:45.727+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:45.791 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:45.791 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:45.807 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:40:45.832 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:45.830+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:45.845 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:40:45.924 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:45.924 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:45.932 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:45.934+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:45.938 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:40:46.005 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:40:46.005 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:40:46.023 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:40:46.023 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:40:46.035 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:46.036+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:46.043 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:40:46.043 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:40:46.062 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:40:46.062 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-04-25T22:40:46.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-04-25T22:40:46.063 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-04-25T22:40:46.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.063 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:111 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'73, mlcod=11'69)", 2024-04-25T22:40:46.063 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:40:46.063 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.363302664000003, 2024-04-25T22:40:46.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055481899999999997, 2024-04-25T22:40:46.063 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:46.063 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:46.063 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.064 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:46.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:46.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:40:46.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:46.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:40:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700271+0000", 2024-04-25T22:40:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:40:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700278+0000", 2024-04-25T22:40:46.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-04-25T22:40:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700323+0000", 2024-04-25T22:40:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4212999999999998e-05 2024-04-25T22:40:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700333+0000", 2024-04-25T22:40:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0433e-05 2024-04-25T22:40:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700662+0000", 2024-04-25T22:40:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032862800000000003 2024-04-25T22:40:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:46.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700692+0000", 2024-04-25T22:40:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0395999999999998e-05 2024-04-25T22:40:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705728+0000", 2024-04-25T22:40:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050361939999999999 2024-04-25T22:40:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:46.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705818+0000", 2024-04-25T22:40:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9573000000000005e-05 2024-04-25T22:40:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-25T22:40:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:40:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.362757811999998, 2024-04-25T22:40:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005065501, 2024-04-25T22:40:46.069 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:40:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:40:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700816+0000", 2024-04-25T22:40:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.24e-06 2024-04-25T22:40:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700914+0000", 2024-04-25T22:40:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8057e-05 2024-04-25T22:40:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700931+0000", 2024-04-25T22:40:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7745999999999999e-05 2024-04-25T22:40:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700941+0000", 2024-04-25T22:40:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5699999999999999e-06 2024-04-25T22:40:46.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701162+0000", 2024-04-25T22:40:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000221392 2024-04-25T22:40:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701194+0000", 2024-04-25T22:40:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1745999999999997e-05 2024-04-25T22:40:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705821+0000", 2024-04-25T22:40:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046269869999999999 2024-04-25T22:40:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705880+0000", 2024-04-25T22:40:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8763e-05 2024-04-25T22:40:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.074 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:118 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'80, mlcod=11'78)", 2024-04-25T22:40:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:40:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.355402202, 2024-04-25T22:40:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047806089999999999, 2024-04-25T22:40:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:46.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:40:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:40:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708172+0000", 2024-04-25T22:40:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0600000000000002e-06 2024-04-25T22:40:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708291+0000", 2024-04-25T22:40:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118892 2024-04-25T22:40:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708320+0000", 2024-04-25T22:40:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8822999999999998e-05 2024-04-25T22:40:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708337+0000", 2024-04-25T22:40:46.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7586999999999999e-05 2024-04-25T22:40:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708512+0000", 2024-04-25T22:40:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017439500000000001 2024-04-25T22:40:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708551+0000", 2024-04-25T22:40:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.909e-05 2024-04-25T22:40:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:46.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712865+0000", 2024-04-25T22:40:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043142069999999996 2024-04-25T22:40:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712951+0000", 2024-04-25T22:40:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5555000000000003e-05 2024-04-25T22:40:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:120 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'82, mlcod=11'78)", 2024-04-25T22:40:46.079 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:40:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.35439616, 2024-04-25T22:40:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047170700000000003, 2024-04-25T22:40:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:40:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:46.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:40:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709177+0000", 2024-04-25T22:40:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.19e-06 2024-04-25T22:40:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709315+0000", 2024-04-25T22:40:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000137429 2024-04-25T22:40:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709341+0000", 2024-04-25T22:40:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:40:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709353+0000", 2024-04-25T22:40:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2027e-05 2024-04-25T22:40:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710040+0000", 2024-04-25T22:40:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068710799999999997 2024-04-25T22:40:46.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710076+0000", 2024-04-25T22:40:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5982999999999998e-05 2024-04-25T22:40:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713802+0000", 2024-04-25T22:40:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037255750000000001 2024-04-25T22:40:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:46.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713893+0000", 2024-04-25T22:40:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1201999999999999e-05 2024-04-25T22:40:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:121 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'83, mlcod=11'78)", 2024-04-25T22:40:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:40:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.353849523999997, 2024-04-25T22:40:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0049043919999999996, 2024-04-25T22:40:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:46.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:40:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:40:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709724+0000", 2024-04-25T22:40:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.483e-06 2024-04-25T22:40:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709872+0000", 2024-04-25T22:40:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147446 2024-04-25T22:40:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709891+0000", 2024-04-25T22:40:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9245999999999998e-05 2024-04-25T22:40:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709900+0000", 2024-04-25T22:40:46.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1439999999999992e-06 2024-04-25T22:40:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713091+0000", 2024-04-25T22:40:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031910710000000002 2024-04-25T22:40:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713122+0000", 2024-04-25T22:40:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.048e-05 2024-04-25T22:40:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:46.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714538+0000", 2024-04-25T22:40:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014160030000000001 2024-04-25T22:40:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714627+0000", 2024-04-25T22:40:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518999999999995e-05 2024-04-25T22:40:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:40:46.088 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 31.463460143999999, 2024-04-25T22:40:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022089675999999999, 2024-04-25T22:40:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:40:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:40:46.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600120+0000", 2024-04-25T22:40:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1259999999999998e-06 2024-04-25T22:40:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600153+0000", 2024-04-25T22:40:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3186999999999999e-05 2024-04-25T22:40:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600181+0000", 2024-04-25T22:40:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7676000000000001e-05 2024-04-25T22:40:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600205+0000", 2024-04-25T22:40:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:40:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600467+0000", 2024-04-25T22:40:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026186800000000001 2024-04-25T22:40:46.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600809+0000", 2024-04-25T22:40:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034138400000000002 2024-04-25T22:40:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.601892+0000", 2024-04-25T22:40:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010831910000000001 2024-04-25T22:40:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611054+0000", 2024-04-25T22:40:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0091620940000000008 2024-04-25T22:40:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621965+0000", 2024-04-25T22:40:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010911044999999999 2024-04-25T22:40:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622090+0000", 2024-04-25T22:40:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012522 2024-04-25T22:40:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622202+0000", 2024-04-25T22:40:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011164500000000001 2024-04-25T22:40:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.094 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:40:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 31.463317089, 2024-04-25T22:40:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035756228000000001, 2024-04-25T22:40:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.095 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:40:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:40:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600257+0000", 2024-04-25T22:40:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8300000000000001e-06 2024-04-25T22:40:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600267+0000", 2024-04-25T22:40:46.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6539999999999994e-06 2024-04-25T22:40:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600293+0000", 2024-04-25T22:40:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5996e-05 2024-04-25T22:40:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600309+0000", 2024-04-25T22:40:46.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6206e-05 2024-04-25T22:40:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603757+0000", 2024-04-25T22:40:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003448244 2024-04-25T22:40:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:46.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604779+0000", 2024-04-25T22:40:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010216820000000001 2024-04-25T22:40:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605127+0000", 2024-04-25T22:40:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034820100000000002 2024-04-25T22:40:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:46.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611082+0000", 2024-04-25T22:40:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0059550640000000004 2024-04-25T22:40:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635779+0000", 2024-04-25T22:40:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024696665999999999 2024-04-25T22:40:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:46.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635915+0000", 2024-04-25T22:40:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000135809 2024-04-25T22:40:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636011+0000", 2024-04-25T22:40:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6875999999999999e-05 2024-04-25T22:40:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:40:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 31.463239875999999, 2024-04-25T22:40:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035327031000000002, 2024-04-25T22:40:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:40:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:40:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:46.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600334+0000", 2024-04-25T22:40:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:40:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600347+0000", 2024-04-25T22:40:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3593e-05 2024-04-25T22:40:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600371+0000", 2024-04-25T22:40:46.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.313e-05 2024-04-25T22:40:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600390+0000", 2024-04-25T22:40:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.908e-05 2024-04-25T22:40:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602756+0000", 2024-04-25T22:40:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023662560000000002 2024-04-25T22:40:46.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603021+0000", 2024-04-25T22:40:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026546399999999998 2024-04-25T22:40:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603304+0000", 2024-04-25T22:40:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028308800000000002 2024-04-25T22:40:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611075+0000", 2024-04-25T22:40:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077703900000000003 2024-04-25T22:40:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635414+0000", 2024-04-25T22:40:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024339326000000001 2024-04-25T22:40:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:46.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635544+0000", 2024-04-25T22:40:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012948199999999999 2024-04-25T22:40:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635659+0000", 2024-04-25T22:40:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000115809 2024-04-25T22:40:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:40:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 31.463079951000001, 2024-04-25T22:40:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035594492999999998, 2024-04-25T22:40:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:40:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:40:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600494+0000", 2024-04-25T22:40:46.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:40:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600502+0000", 2024-04-25T22:40:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3769999999999996e-06 2024-04-25T22:40:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600522+0000", 2024-04-25T22:40:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9919999999999999e-05 2024-04-25T22:40:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600539+0000", 2024-04-25T22:40:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.649e-05 2024-04-25T22:40:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604846+0000", 2024-04-25T22:40:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043075199999999996 2024-04-25T22:40:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605057+0000", 2024-04-25T22:40:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00021085200000000001 2024-04-25T22:40:46.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605378+0000", 2024-04-25T22:40:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032074799999999999 2024-04-25T22:40:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611089+0000", 2024-04-25T22:40:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057110249999999998 2024-04-25T22:40:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635844+0000", 2024-04-25T22:40:46.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024755355999999999 2024-04-25T22:40:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635986+0000", 2024-04-25T22:40:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141512 2024-04-25T22:40:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636087+0000", 2024-04-25T22:40:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101183 2024-04-25T22:40:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:40:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 31.463007341000001, 2024-04-25T22:40:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021266723000000001, 2024-04-25T22:40:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:40:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:40:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600566+0000", 2024-04-25T22:40:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4959999999999999e-06 2024-04-25T22:40:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600574+0000", 2024-04-25T22:40:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-06 2024-04-25T22:40:46.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600592+0000", 2024-04-25T22:40:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8479999999999999e-05 2024-04-25T22:40:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600610+0000", 2024-04-25T22:40:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7567e-05 2024-04-25T22:40:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602679+0000", 2024-04-25T22:40:46.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020692739999999999 2024-04-25T22:40:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602945+0000", 2024-04-25T22:40:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026640399999999998 2024-04-25T22:40:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603115+0000", 2024-04-25T22:40:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000169996 2024-04-25T22:40:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:46.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608398+0000", 2024-04-25T22:40:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052826289999999996 2024-04-25T22:40:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621588+0000", 2024-04-25T22:40:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013190489 2024-04-25T22:40:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621733+0000", 2024-04-25T22:40:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014462500000000001 2024-04-25T22:40:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621832+0000", 2024-04-25T22:40:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8603000000000004e-05 2024-04-25T22:40:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:40:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 31.462939615, 2024-04-25T22:40:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034747924999999999, 2024-04-25T22:40:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.121 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:40:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:40:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600634+0000", 2024-04-25T22:40:46.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-04-25T22:40:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600642+0000", 2024-04-25T22:40:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8169999999999999e-06 2024-04-25T22:40:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600660+0000", 2024-04-25T22:40:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8513e-05 2024-04-25T22:40:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600676+0000", 2024-04-25T22:40:46.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6019999999999999e-05 2024-04-25T22:40:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603748+0000", 2024-04-25T22:40:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030718329999999999 2024-04-25T22:40:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604752+0000", 2024-04-25T22:40:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001003603 2024-04-25T22:40:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605117+0000", 2024-04-25T22:40:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00036539 2024-04-25T22:40:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608459+0000", 2024-04-25T22:40:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033413879999999998 2024-04-25T22:40:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:46.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635106+0000", 2024-04-25T22:40:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026647607 2024-04-25T22:40:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635273+0000", 2024-04-25T22:40:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000166689 2024-04-25T22:40:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:46.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635381+0000", 2024-04-25T22:40:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107642 2024-04-25T22:40:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:40:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 31.462876386000001, 2024-04-25T22:40:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040419292000000002, 2024-04-25T22:40:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:46.127 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:40:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:40:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600697+0000", 2024-04-25T22:40:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1999999999999999e-06 2024-04-25T22:40:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600704+0000", 2024-04-25T22:40:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5570000000000001e-06 2024-04-25T22:40:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600724+0000", 2024-04-25T22:40:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0023000000000001e-05 2024-04-25T22:40:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600738+0000", 2024-04-25T22:40:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4372999999999999e-05 2024-04-25T22:40:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.612532+0000", 2024-04-25T22:40:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011793606 2024-04-25T22:40:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613354+0000", 2024-04-25T22:40:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00082244100000000004 2024-04-25T22:40:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613726+0000", 2024-04-25T22:40:46.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00037226000000000002 2024-04-25T22:40:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618891+0000", 2024-04-25T22:40:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051649199999999999 2024-04-25T22:40:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:46.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.640874+0000", 2024-04-25T22:40:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021982640000000001 2024-04-25T22:40:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641019+0000", 2024-04-25T22:40:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000145339 2024-04-25T22:40:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641115+0000", 2024-04-25T22:40:46.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5933000000000005e-05 2024-04-25T22:40:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:40:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 31.462790355999999, 2024-04-25T22:40:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036502711, 2024-04-25T22:40:46.134 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:40:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:40:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:40:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600783+0000", 2024-04-25T22:40:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.533e-06 2024-04-25T22:40:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:46.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600790+0000", 2024-04-25T22:40:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0439999999999998e-06 2024-04-25T22:40:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600811+0000", 2024-04-25T22:40:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0449e-05 2024-04-25T22:40:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600825+0000", 2024-04-25T22:40:46.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4293e-05 2024-04-25T22:40:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602304+0000", 2024-04-25T22:40:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001478629 2024-04-25T22:40:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602587+0000", 2024-04-25T22:40:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028350800000000002 2024-04-25T22:40:46.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.637285+0000", 2024-04-25T22:40:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034697255000000003 2024-04-25T22:40:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:46.139 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:40:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 31.462724789999999, 2024-04-25T22:40:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017311460000000001, 2024-04-25T22:40:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:40:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:40:46.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:40:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600849+0000", 2024-04-25T22:40:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2899999999999999e-06 2024-04-25T22:40:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600866+0000", 2024-04-25T22:40:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6793e-05 2024-04-25T22:40:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600886+0000", 2024-04-25T22:40:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0772999999999999e-05 2024-04-25T22:40:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600904+0000", 2024-04-25T22:40:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7697e-05 2024-04-25T22:40:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602796+0000", 2024-04-25T22:40:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018920149999999999 2024-04-25T22:40:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602962+0000", 2024-04-25T22:40:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016590600000000001 2024-04-25T22:40:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618159+0000", 2024-04-25T22:40:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015196985999999999 2024-04-25T22:40:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:40:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 31.447849048999998, 2024-04-25T22:40:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006380269, 2024-04-25T22:40:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:46.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:40:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:40:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615724+0000", 2024-04-25T22:40:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.094e-06 2024-04-25T22:40:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615734+0000", 2024-04-25T22:40:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.363e-06 2024-04-25T22:40:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615751+0000", 2024-04-25T22:40:46.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:40:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615773+0000", 2024-04-25T22:40:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.154e-05 2024-04-25T22:40:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616485+0000", 2024-04-25T22:40:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00071225100000000001 2024-04-25T22:40:46.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616528+0000", 2024-04-25T22:40:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3606000000000002e-05 2024-04-25T22:40:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622030+0000", 2024-04-25T22:40:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055010750000000002 2024-04-25T22:40:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622103+0000", 2024-04-25T22:40:46.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3930000000000005e-05 2024-04-25T22:40:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:40:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:40:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 31.446936111999999, 2024-04-25T22:40:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046420649999999999, 2024-04-25T22:40:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-04-25T22:40:46.150 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:40:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:40:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616637+0000", 2024-04-25T22:40:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0299999999999998e-07 2024-04-25T22:40:46.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616653+0000", 2024-04-25T22:40:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5843000000000001e-05 2024-04-25T22:40:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616690+0000", 2024-04-25T22:40:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7466999999999999e-05 2024-04-25T22:40:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616729+0000", 2024-04-25T22:40:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8810000000000003e-05 2024-04-25T22:40:46.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617251+0000", 2024-04-25T22:40:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00052143899999999995 2024-04-25T22:40:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621278+0000", 2024-04-25T22:40:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040277029999999997 2024-04-25T22:40:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:46.153 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:40:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 31.445912759999999, 2024-04-25T22:40:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0065101730000000002, 2024-04-25T22:40:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:40:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:46.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:40:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617661+0000", 2024-04-25T22:40:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:40:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617688+0000", 2024-04-25T22:40:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7589e-05 2024-04-25T22:40:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617710+0000", 2024-04-25T22:40:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1467e-05 2024-04-25T22:40:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617727+0000", 2024-04-25T22:40:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6990000000000002e-05 2024-04-25T22:40:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618559+0000", 2024-04-25T22:40:46.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083207400000000003 2024-04-25T22:40:46.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:46.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618608+0000", 2024-04-25T22:40:46.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8936e-05 2024-04-25T22:40:46.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:46.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624077+0000", 2024-04-25T22:40:46.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054695840000000004 2024-04-25T22:40:46.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:46.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624170+0000", 2024-04-25T22:40:46.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2305999999999993e-05 2024-04-25T22:40:46.158 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.158 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.158 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.158 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:46.158 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:40:46.158 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 31.440811252, 2024-04-25T22:40:46.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006879446, 2024-04-25T22:40:46.158 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:46.158 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:46.159 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.159 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:46.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:46.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:40:46.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:46.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:40:46.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622762+0000", 2024-04-25T22:40:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:40:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622781+0000", 2024-04-25T22:40:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8749999999999998e-05 2024-04-25T22:40:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622802+0000", 2024-04-25T22:40:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1650000000000001e-05 2024-04-25T22:40:46.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622816+0000", 2024-04-25T22:40:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3556e-05 2024-04-25T22:40:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623700+0000", 2024-04-25T22:40:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00088389299999999996 2024-04-25T22:40:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623741+0000", 2024-04-25T22:40:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1023999999999999e-05 2024-04-25T22:40:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629543+0000", 2024-04-25T22:40:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058023980000000003 2024-04-25T22:40:46.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629640+0000", 2024-04-25T22:40:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7381999999999997e-05 2024-04-25T22:40:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:46.163 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:40:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 31.440550047999999, 2024-04-25T22:40:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067054879999999999, 2024-04-25T22:40:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:40:46.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:40:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623032+0000", 2024-04-25T22:40:46.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.9930000000000007e-06 2024-04-25T22:40:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623043+0000", 2024-04-25T22:40:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0387000000000001e-05 2024-04-25T22:40:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:46.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623064+0000", 2024-04-25T22:40:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1849999999999999e-05 2024-04-25T22:40:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623079+0000", 2024-04-25T22:40:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4093e-05 2024-04-25T22:40:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624384+0000", 2024-04-25T22:40:46.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013054539999999999 2024-04-25T22:40:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624421+0000", 2024-04-25T22:40:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7088999999999997e-05 2024-04-25T22:40:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629645+0000", 2024-04-25T22:40:46.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052241400000000004 2024-04-25T22:40:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629728+0000", 2024-04-25T22:40:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2482000000000001e-05 2024-04-25T22:40:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.169 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2024-04-25T22:40:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:40:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 31.440466935, 2024-04-25T22:40:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078029559999999998, 2024-04-25T22:40:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:40:46.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:40:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623106+0000", 2024-04-25T22:40:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.64e-07 2024-04-25T22:40:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623141+0000", 2024-04-25T22:40:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4678999999999998e-05 2024-04-25T22:40:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623153+0000", 2024-04-25T22:40:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1759999999999999e-05 2024-04-25T22:40:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623161+0000", 2024-04-25T22:40:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8299999999999996e-06 2024-04-25T22:40:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623834+0000", 2024-04-25T22:40:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067394500000000001 2024-04-25T22:40:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623883+0000", 2024-04-25T22:40:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8640000000000002e-05 2024-04-25T22:40:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630807+0000", 2024-04-25T22:40:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069238859999999998 2024-04-25T22:40:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:46.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630908+0000", 2024-04-25T22:40:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101252 2024-04-25T22:40:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:46.175 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:46.175 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:40:46.177 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:40:46.177 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:46.176+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:46.278 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:46.280+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:46.310 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:46.311 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:46.311 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:40:46.311 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:46.326 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:40:46.378 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:46.380+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:46.444 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:46.444 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:46.444 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:40:46.444 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:40:46.444 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:46.458 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:40:46.462 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:40:46.505 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:46.506+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:46.579 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:46.579 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:40:46.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:40:46.579 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:40:46.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.579 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:46.579 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:46.580 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.982043614999998, 2024-04-25T22:40:46.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:40:46.580 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:46.580 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:46.580 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.580 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:46.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:46.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:46.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:46.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:46.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:46.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:40:46.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:40:46.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:46.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:40:46.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:40:46.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:46.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:40:46.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:40:46.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:40:46.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:40:46.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:40:46.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:40:46.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:46.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:40:46.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:40:46.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:40:46.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:40:46.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:46.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:40:46.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:40:46.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:46.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:40:46.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:40:46.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:46.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:40:46.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:40:46.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:46.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:40:46.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:40:46.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:46.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:40:46.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:40:46.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:46.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:40:46.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:40:46.585 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.586 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.586 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.586 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.586 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:46.586 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:46.586 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.981906359, 2024-04-25T22:40:46.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:40:46.586 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:46.586 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:46.586 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.586 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:46.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.586 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:46.586 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:46.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:46.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:46.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:46.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:40:46.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:40:46.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:46.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:40:46.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:40:46.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:46.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:40:46.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:40:46.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:40:46.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:40:46.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:40:46.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:40:46.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:46.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:40:46.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:40:46.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:40:46.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:40:46.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:46.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:40:46.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:40:46.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:46.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:40:46.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:40:46.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:46.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:40:46.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:40:46.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:46.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:40:46.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:40:46.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.591 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:46.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:40:46.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:40:46.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.591 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:46.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:40:46.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:40:46.591 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.591 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.591 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.592 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.592 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:46.592 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:46.592 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.981818807, 2024-04-25T22:40:46.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:40:46.592 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:46.592 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:46.592 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.592 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:46.592 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.592 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:46.592 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:46.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.592 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:46.593 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:46.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:46.593 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:40:46.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:40:46.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:46.593 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:40:46.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:40:46.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:46.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:40:46.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:40:46.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:40:46.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:40:46.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:40:46.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:40:46.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:46.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:40:46.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:40:46.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:40:46.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:40:46.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:46.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:40:46.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:40:46.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:46.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:40:46.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:40:46.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:46.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:40:46.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:40:46.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:46.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:40:46.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:40:46.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:46.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:40:46.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:40:46.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:46.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:40:46.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:40:46.597 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.597 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.597 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.597 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:46.598 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:46.598 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.981714981, 2024-04-25T22:40:46.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:40:46.598 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:46.598 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:46.598 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.598 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:46.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:46.598 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:46.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:46.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:46.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:46.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:40:46.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:40:46.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:46.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:40:46.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:40:46.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:46.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:40:46.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:40:46.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:40:46.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:40:46.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:40:46.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:40:46.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:46.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:40:46.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:40:46.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:40:46.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:40:46.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:46.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:40:46.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:40:46.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:46.602 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:40:46.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:40:46.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:46.602 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:40:46.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:40:46.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:46.602 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:40:46.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:40:46.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:46.603 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:40:46.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:40:46.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:46.603 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:40:46.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:40:46.603 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.603 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.603 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.603 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:46.603 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:46.604 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.981646190999999, 2024-04-25T22:40:46.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:40:46.604 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:46.604 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:46.604 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.604 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:46.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:46.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:46.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:46.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:46.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.605 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:46.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:40:46.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:40:46.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.605 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:46.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:40:46.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:40:46.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.605 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:46.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:40:46.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:40:46.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.606 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.606 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:40:46.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:40:46.606 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.606 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.606 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:40:46.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:40:46.606 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.606 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:46.606 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:40:46.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:40:46.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:40:46.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:40:46.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:46.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:40:46.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:40:46.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:46.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:40:46.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:40:46.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:46.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:40:46.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:40:46.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:46.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:40:46.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:40:46.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:46.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:40:46.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:40:46.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.609 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.609 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:46.609 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:40:46.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:40:46.609 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.609 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.609 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.609 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.609 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:46.609 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:46.609 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.981577105, 2024-04-25T22:40:46.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:40:46.609 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:46.610 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:46.610 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.610 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:46.610 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.610 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:46.610 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:46.610 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.610 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.610 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.610 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:46.610 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:46.610 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.610 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.610 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:46.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:40:46.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:40:46.611 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:46.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:40:46.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:40:46.611 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:46.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:40:46.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:40:46.611 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.612 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.612 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:40:46.612 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:40:46.612 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.612 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.612 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.612 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:40:46.612 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:40:46.612 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.612 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.612 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:46.612 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:40:46.612 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:40:46.612 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.612 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.613 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.613 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:40:46.613 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:40:46.613 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.613 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.613 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:46.613 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:40:46.613 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:40:46.613 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.613 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.613 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:46.613 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:40:46.613 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:40:46.613 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.613 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:46.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:40:46.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:40:46.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.614 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:46.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:40:46.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:40:46.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.614 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:46.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:40:46.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:40:46.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.615 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:46.615 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:40:46.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:40:46.615 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.615 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.615 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.615 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:46.615 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:46.615 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.981480992000002, 2024-04-25T22:40:46.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:40:46.615 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:46.615 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:46.616 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:46.616 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:46.616 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.616 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:46.616 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:46.616 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.616 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.616 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.616 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:46.616 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:46.616 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.616 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.616 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.616 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:46.616 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:40:46.616 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:40:46.617 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.617 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:46.617 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:40:46.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:40:46.617 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.617 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:46.617 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:40:46.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:40:46.617 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.617 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.617 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:40:46.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:40:46.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:40:46.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:40:46.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:46.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:40:46.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:40:46.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:40:46.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:40:46.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:46.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:40:46.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:40:46.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:46.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:40:46.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:40:46.619 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.619 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.619 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.620 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:46.620 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:46.620 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.981415330000001, 2024-04-25T22:40:46.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:40:46.620 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:46.620 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:46.620 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:46.620 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:46.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:46.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:46.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:46.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:46.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:46.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:40:46.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:40:46.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:46.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:40:46.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:40:46.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:46.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:40:46.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:40:46.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:40:46.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:40:46.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:40:46.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:40:46.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.623 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:46.623 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:40:46.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:40:46.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.623 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.623 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:40:46.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:40:46.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.623 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:46.623 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:40:46.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:40:46.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:46.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:40:46.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:40:46.624 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.624 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.624 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.624 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:46.624 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:46.624 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.981346203000001, 2024-04-25T22:40:46.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:40:46.624 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:46.624 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:46.625 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:46.625 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:46.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:46.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:46.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:46.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:46.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:46.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:40:46.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:40:46.626 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.626 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.626 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:46.626 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:40:46.626 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:40:46.626 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.626 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.626 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:46.626 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:40:46.626 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:40:46.626 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.626 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.626 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.626 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:40:46.626 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:40:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:40:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:40:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:40:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:40:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:40:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:40:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:40:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:40:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:40:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:40:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:40:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.970529547000002, 2024-04-25T22:40:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:40:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:40:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:40:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:40:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:40:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:40:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:40:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:40:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:40:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:40:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:40:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:40:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:40:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.953631194, 2024-04-25T22:40:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:40:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:40:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:40:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:40:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:40:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:40:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:40:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:40:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:40:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:40:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:40:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:40:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:40:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:40:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.952810304, 2024-04-25T22:40:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:40:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:40:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:40:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:40:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:40:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:40:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:40:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:40:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:40:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:40:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:40:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:40:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:40:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:40:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:40:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.951109576, 2024-04-25T22:40:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:40:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:40:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:40:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:40:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:40:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:40:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:40:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:40:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:40:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:40:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:40:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:40:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:40:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:40:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:40:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:40:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:40:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.950512901, 2024-04-25T22:40:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:40:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:40:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:40:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:40:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:40:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:40:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:40:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:40:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:40:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:40:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:40:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:40:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:40:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:40:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:40:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:40:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:40:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:40:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.941077175, 2024-04-25T22:40:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:40:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:40:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:40:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:40:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:40:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:40:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:40:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:40:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:40:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:40:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:40:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:40:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.940429749, 2024-04-25T22:40:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:40:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:40:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:40:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:40:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:40:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:40:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:40:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:40:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:40:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:40:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:40:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:40:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:40:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:40:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:40:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:40:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:40:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.938988930000001, 2024-04-25T22:40:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:40:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:40:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:40:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:40:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:40:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:40:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:40:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:40:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:40:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:40:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:40:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:40:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:40:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:40:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:40:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:40:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:40:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:40:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.986550485999999, 2024-04-25T22:40:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:40:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:40:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:40:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:40:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:40:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:40:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:40:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:40:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:40:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:40:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:40:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:40:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:40:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:40:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:40:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:40:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:40:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:40:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:40:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:40:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:40:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:40:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:40:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:40:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 7.9838911619999999, 2024-04-25T22:40:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:40:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:40:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:40:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:40:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:40:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:40:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:40:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:40:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:40:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:40:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:40:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:40:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:40:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:40:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:40:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:40:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:40:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:40:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:40:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:40:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:40:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:40:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:40:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:40:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 2.9835989110000001, 2024-04-25T22:40:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:40:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:40:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:40:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:40:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:40:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:40:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:40:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:40:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:40:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:40:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:40:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:40:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:40:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:40:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:40:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:40:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:40:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:40:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:40:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:40:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:40:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:40:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:40:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:46.676 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:46.677 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:46.678+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:46.678 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:40:46.778 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:46.778+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:46.809 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:40:46.810 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:40:46.810 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:40:46.810 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:40:46.825 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:40:46.879 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:46.878+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:46.945 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:40:46.945 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:40:46.945 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:40:46.946 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:40:46.946 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:40:46.960 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:40:47.008 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:47.007+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:47.080 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:47.079+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:47.084 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:40:47.085 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:40:47.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:40:47.085 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:40:47.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.085 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.085 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:40:47.085 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.489387464000004, 2024-04-25T22:40:47.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:40:47.086 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:47.086 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:47.086 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.086 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:47.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:47.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:40:47.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:47.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:40:47.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:47.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:40:47.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:40:47.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:47.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:40:47.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:40:47.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:47.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:40:47.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:40:47.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:40:47.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:40:47.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:40:47.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:40:47.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:47.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:40:47.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:40:47.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:40:47.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:40:47.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:47.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:40:47.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:40:47.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:47.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:40:47.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:40:47.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:40:47.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:40:47.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:47.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:40:47.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:40:47.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:47.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:40:47.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:40:47.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:47.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:40:47.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:40:47.091 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.091 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.091 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.092 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.092 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:40:47.092 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.489299451000001, 2024-04-25T22:40:47.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:40:47.092 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:47.092 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:47.092 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.092 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:47.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:47.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:40:47.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:47.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:40:47.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:47.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:40:47.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:40:47.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:47.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:40:47.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:40:47.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:47.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:40:47.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:40:47.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:40:47.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:40:47.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:40:47.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:40:47.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:47.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:47.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:40:47.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:40:47.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:40:47.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:47.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:40:47.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:40:47.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:47.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:40:47.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:40:47.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:47.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:40:47.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:40:47.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:40:47.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:40:47.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:47.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:40:47.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:40:47.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:47.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:40:47.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:40:47.097 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.098 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.098 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.098 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.098 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:40:47.098 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.489227329000002, 2024-04-25T22:40:47.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:40:47.098 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:47.098 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:47.098 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.098 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:47.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:47.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:40:47.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:47.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:40:47.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:47.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:40:47.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:40:47.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:47.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:40:47.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:40:47.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:47.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:40:47.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:40:47.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:40:47.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:40:47.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:40:47.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:40:47.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:47.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:40:47.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:40:47.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:40:47.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:40:47.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:47.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:40:47.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:40:47.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:47.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:40:47.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:40:47.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:40:47.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:40:47.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:47.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:40:47.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:40:47.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:47.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:40:47.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:40:47.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:47.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:40:47.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:40:47.104 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.104 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.104 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.104 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.104 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:40:47.104 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.489119015999997, 2024-04-25T22:40:47.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:40:47.105 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:47.105 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:47.105 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.105 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:47.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:47.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:40:47.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:47.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:40:47.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:47.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:40:47.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:40:47.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:47.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:40:47.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:40:47.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:47.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:40:47.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:40:47.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:40:47.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:40:47.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:40:47.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:40:47.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:47.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:40:47.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:40:47.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:40:47.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:40:47.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:47.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:40:47.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:40:47.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:47.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:40:47.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:40:47.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:40:47.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:40:47.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:47.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:40:47.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:40:47.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:47.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:40:47.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:40:47.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:47.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:40:47.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:40:47.110 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.110 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.110 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.110 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.111 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:40:47.111 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.489052360000002, 2024-04-25T22:40:47.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:40:47.111 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:47.111 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:47.111 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.111 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:47.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:47.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:40:47.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:47.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:40:47.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:47.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:40:47.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:40:47.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:47.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:40:47.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:40:47.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:47.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:40:47.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:40:47.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:40:47.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:40:47.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:40:47.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:40:47.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:47.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:40:47.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:40:47.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:40:47.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:40:47.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:47.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:40:47.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:40:47.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:47.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:40:47.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:40:47.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:40:47.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:40:47.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:47.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:40:47.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:40:47.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:47.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:40:47.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:40:47.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:47.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:40:47.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:40:47.116 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.116 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.116 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.116 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.117 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:40:47.117 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.488961764000003, 2024-04-25T22:40:47.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:40:47.117 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:47.117 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:47.117 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.117 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:47.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:47.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:40:47.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:47.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:40:47.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:47.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:40:47.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:40:47.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:47.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:40:47.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:40:47.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:47.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:40:47.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:40:47.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:40:47.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:40:47.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:40:47.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:40:47.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:47.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:40:47.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:40:47.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:40:47.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:40:47.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:47.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:40:47.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:40:47.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:47.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:40:47.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:40:47.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:47.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:40:47.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:40:47.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:40:47.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:40:47.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:47.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:40:47.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:40:47.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:47.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:40:47.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:40:47.122 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.122 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.122 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.122 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.123 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:40:47.123 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.488897191, 2024-04-25T22:40:47.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:40:47.123 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:47.123 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:47.123 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.123 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:47.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:47.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:40:47.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:47.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:40:47.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:47.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:40:47.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:40:47.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:47.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:40:47.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:40:47.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:47.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:40:47.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:40:47.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:40:47.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:40:47.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:40:47.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:40:47.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:47.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:40:47.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:40:47.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:40:47.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:40:47.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:47.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:40:47.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:40:47.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:47.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:40:47.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:40:47.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:40:47.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:40:47.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:47.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:40:47.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:40:47.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:47.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:40:47.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:40:47.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:47.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:40:47.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:40:47.129 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.129 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.129 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.129 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.129 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:40:47.129 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.488831767999997, 2024-04-25T22:40:47.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:40:47.129 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:47.129 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:47.129 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.129 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:47.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:47.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:40:47.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:47.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:40:47.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:47.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:40:47.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:40:47.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:47.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:40:47.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:40:47.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:47.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:40:47.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:40:47.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:40:47.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:40:47.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:40:47.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:40:47.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:47.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:40:47.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:40:47.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:40:47.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:40:47.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:47.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:40:47.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:40:47.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:47.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:40:47.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:40:47.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:47.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:40:47.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:40:47.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:40:47.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:40:47.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:47.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:40:47.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:40:47.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:47.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:40:47.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:40:47.134 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.135 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.135 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.135 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.135 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:40:47.135 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.488775701999998, 2024-04-25T22:40:47.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:40:47.135 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:47.135 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:47.135 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.135 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:47.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:47.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:40:47.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:47.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:40:47.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:47.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:40:47.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:40:47.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:47.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:40:47.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:40:47.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:47.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:40:47.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:40:47.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:40:47.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:40:47.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:40:47.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:40:47.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:47.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:40:47.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:40:47.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:40:47.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:40:47.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:47.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:40:47.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:40:47.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:47.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:40:47.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:40:47.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:40:47.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:40:47.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:47.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:40:47.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:40:47.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:47.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:40:47.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:40:47.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:47.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:40:47.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:40:47.141 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.141 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.141 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.141 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.141 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:40:47.141 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.488708596000002, 2024-04-25T22:40:47.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:40:47.141 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:47.141 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:47.142 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.142 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:47.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:47.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:40:47.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:47.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:40:47.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:47.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:40:47.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:40:47.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:47.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:40:47.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:40:47.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:47.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:40:47.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:40:47.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:40:47.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:40:47.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:40:47.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:40:47.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:47.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:40:47.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:40:47.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:40:47.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:40:47.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:47.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:40:47.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:40:47.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:47.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:40:47.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:40:47.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:40:47.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:40:47.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:47.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:40:47.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:40:47.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:47.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:40:47.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:40:47.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:47.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:40:47.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:40:47.147 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.147 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.147 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.147 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.147 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:40:47.147 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.488653472999999, 2024-04-25T22:40:47.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:40:47.147 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:47.147 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:47.148 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.148 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:47.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:47.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:40:47.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:47.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:40:47.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:47.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:40:47.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:40:47.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:47.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:40:47.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:40:47.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:47.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:40:47.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:40:47.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:40:47.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:40:47.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:40:47.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:40:47.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:47.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:40:47.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:40:47.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:40:47.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:40:47.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:47.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:40:47.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:40:47.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:40:47.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:40:47.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:40:47.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:40:47.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:40:47.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:47.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:40:47.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:40:47.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:47.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:40:47.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:40:47.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:47.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:40:47.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:40:47.153 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.153 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.153 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.153 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.153 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:40:47.153 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.488551233999999, 2024-04-25T22:40:47.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:40:47.154 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:47.154 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:47.154 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.154 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:47.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:47.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:40:47.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:47.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:40:47.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:47.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:40:47.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:40:47.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:47.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:40:47.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:40:47.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:47.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:40:47.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:40:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:40:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:40:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:40:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:40:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:40:47.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:40:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:40:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:40:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:40:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:40:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:40:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:40:47.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:40:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:40:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:40:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:40:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:40:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:47.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:40:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:40:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:40:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:40:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:40:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.488492411000003, 2024-04-25T22:40:47.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:40:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:40:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:40:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:40:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:40:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:40:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:40:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:40:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:40:47.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:40:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:40:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:40:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:40:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:40:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:40:47.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:40:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:40:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:40:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:40:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:40:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:40:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:40:47.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:40:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:40:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:40:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:40:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:40:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:40:47.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:40:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:40:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:40:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.488413678000001, 2024-04-25T22:40:47.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:40:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:40:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:47.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:40:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:40:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:40:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:40:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:40:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:47.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:40:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:40:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:40:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:40:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:40:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:40:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:47.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:40:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:40:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:40:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:40:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:40:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:40:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:47.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:40:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:40:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:40:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:40:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:40:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:40:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:40:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:40:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:40:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:40:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.171 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:40:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.488374264999997, 2024-04-25T22:40:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:40:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:40:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:47.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:40:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:40:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:40:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:40:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:40:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:47.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:40:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:40:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:40:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:40:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:40:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:40:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:40:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:40:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:40:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:40:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:40:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:40:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:40:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:40:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:40:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:40:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:40:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:40:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:40:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:40:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:40:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:40:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.177 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:40:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.488304419000002, 2024-04-25T22:40:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:40:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:40:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:47.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:40:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:40:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:40:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:40:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:40:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:40:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:40:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:40:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:40:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:40:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:40:47.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:40:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:40:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:40:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:40:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:47.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:40:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:40:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:40:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:40:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:40:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:40:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:40:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:40:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:40:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:40:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:40:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:40:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.183 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:40:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.488254681999997, 2024-04-25T22:40:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:40:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:40:47.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:40:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:40:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:40:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:40:47.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:40:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:40:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:40:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:40:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:40:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:40:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:40:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:40:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:40:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:40:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:40:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:47.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:40:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:40:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:40:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:40:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:40:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:40:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:40:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:40:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:40:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:40:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:40:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:40:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:40:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.189 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:40:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.488170066999999, 2024-04-25T22:40:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:40:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:47.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:40:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:40:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:40:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:40:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:47.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:40:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:40:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:40:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:40:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:40:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:40:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:40:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:40:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:40:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:40:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:40:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:40:47.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:40:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:40:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:40:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:40:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:40:47.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:40:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:40:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:40:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:40:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:40:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:47.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:40:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:40:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:40:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.488106416999997, 2024-04-25T22:40:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:40:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:40:47.196 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:40:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:40:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:40:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:40:47.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:40:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:40:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:40:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:40:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:40:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:40:47.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:40:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:40:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:40:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:40:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:40:47.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:40:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:40:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:40:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:40:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:40:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:40:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.481102886999999, 2024-04-25T22:40:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:40:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:40:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:40:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:40:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:40:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:40:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:40:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:40:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:40:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:40:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:40:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:40:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:40:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:40:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:40:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:40:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:40:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:40:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:40:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.204 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.205 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.205 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:47.205 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:47.205 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:40:47.206 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:40:47.207 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:47.206+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:47.307 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:47.308+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:47.338 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:40:47.338 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:40:47.338 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-04-25T22:40:47.338 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:40:47.352 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:40:47.442 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:47.444+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:47.477 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is set 2024-04-25T22:40:47.510 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:47.512+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:47.514 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:40:47.514 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:40:47.514 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-04-25T22:40:47.514 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-04-25T22:40:47.514 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:40:47.528 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:40:47.611 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:47.611+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:47.695 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:40:47.695 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-04-25T22:40:47.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-04-25T22:40:47.695 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-04-25T22:40:47.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.696 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:111 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'73, mlcod=11'69)", 2024-04-25T22:40:47.696 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:40:47.696 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.995885874999999, 2024-04-25T22:40:47.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055481899999999997, 2024-04-25T22:40:47.696 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:47.696 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:47.696 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.696 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:47.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:47.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:40:47.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:47.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:40:47.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:47.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700271+0000", 2024-04-25T22:40:47.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:40:47.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:47.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700278+0000", 2024-04-25T22:40:47.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-04-25T22:40:47.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:47.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700323+0000", 2024-04-25T22:40:47.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4212999999999998e-05 2024-04-25T22:40:47.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700333+0000", 2024-04-25T22:40:47.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0433e-05 2024-04-25T22:40:47.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:47.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700662+0000", 2024-04-25T22:40:47.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032862800000000003 2024-04-25T22:40:47.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:47.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700692+0000", 2024-04-25T22:40:47.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0395999999999998e-05 2024-04-25T22:40:47.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:47.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705728+0000", 2024-04-25T22:40:47.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050361939999999999 2024-04-25T22:40:47.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:47.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705818+0000", 2024-04-25T22:40:47.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9573000000000005e-05 2024-04-25T22:40:47.700 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.700 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.700 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.700 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-25T22:40:47.700 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:40:47.700 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.995341023000002, 2024-04-25T22:40:47.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005065501, 2024-04-25T22:40:47.700 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:47.700 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:47.701 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.701 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:47.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:47.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:40:47.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:47.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:40:47.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:47.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700816+0000", 2024-04-25T22:40:47.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.24e-06 2024-04-25T22:40:47.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:47.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700914+0000", 2024-04-25T22:40:47.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8057e-05 2024-04-25T22:40:47.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:47.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700931+0000", 2024-04-25T22:40:47.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7745999999999999e-05 2024-04-25T22:40:47.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700941+0000", 2024-04-25T22:40:47.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5699999999999999e-06 2024-04-25T22:40:47.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:47.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701162+0000", 2024-04-25T22:40:47.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000221392 2024-04-25T22:40:47.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:47.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701194+0000", 2024-04-25T22:40:47.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1745999999999997e-05 2024-04-25T22:40:47.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:47.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705821+0000", 2024-04-25T22:40:47.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046269869999999999 2024-04-25T22:40:47.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:47.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705880+0000", 2024-04-25T22:40:47.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8763e-05 2024-04-25T22:40:47.704 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.704 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.704 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.704 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:118 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'80, mlcod=11'78)", 2024-04-25T22:40:47.705 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:40:47.705 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.987985412999997, 2024-04-25T22:40:47.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047806089999999999, 2024-04-25T22:40:47.705 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:47.705 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:47.705 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.705 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:47.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:47.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:40:47.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:47.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:40:47.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:47.706 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708172+0000", 2024-04-25T22:40:47.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0600000000000002e-06 2024-04-25T22:40:47.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:47.706 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708291+0000", 2024-04-25T22:40:47.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118892 2024-04-25T22:40:47.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:47.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708320+0000", 2024-04-25T22:40:47.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8822999999999998e-05 2024-04-25T22:40:47.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708337+0000", 2024-04-25T22:40:47.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7586999999999999e-05 2024-04-25T22:40:47.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:47.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708512+0000", 2024-04-25T22:40:47.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017439500000000001 2024-04-25T22:40:47.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:47.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708551+0000", 2024-04-25T22:40:47.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.909e-05 2024-04-25T22:40:47.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:47.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712865+0000", 2024-04-25T22:40:47.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043142069999999996 2024-04-25T22:40:47.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:47.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712951+0000", 2024-04-25T22:40:47.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5555000000000003e-05 2024-04-25T22:40:47.708 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.708 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.708 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:120 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'82, mlcod=11'78)", 2024-04-25T22:40:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:40:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.986979370999997, 2024-04-25T22:40:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047170700000000003, 2024-04-25T22:40:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:40:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:40:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709177+0000", 2024-04-25T22:40:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.19e-06 2024-04-25T22:40:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709315+0000", 2024-04-25T22:40:47.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000137429 2024-04-25T22:40:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709341+0000", 2024-04-25T22:40:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:40:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709353+0000", 2024-04-25T22:40:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2027e-05 2024-04-25T22:40:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710040+0000", 2024-04-25T22:40:47.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068710799999999997 2024-04-25T22:40:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710076+0000", 2024-04-25T22:40:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5982999999999998e-05 2024-04-25T22:40:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713802+0000", 2024-04-25T22:40:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037255750000000001 2024-04-25T22:40:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713893+0000", 2024-04-25T22:40:47.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1201999999999999e-05 2024-04-25T22:40:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:121 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'83, mlcod=11'78)", 2024-04-25T22:40:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:40:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.986432735000001, 2024-04-25T22:40:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0049043919999999996, 2024-04-25T22:40:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:40:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:40:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709724+0000", 2024-04-25T22:40:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.483e-06 2024-04-25T22:40:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:47.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709872+0000", 2024-04-25T22:40:47.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147446 2024-04-25T22:40:47.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709891+0000", 2024-04-25T22:40:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9245999999999998e-05 2024-04-25T22:40:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709900+0000", 2024-04-25T22:40:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1439999999999992e-06 2024-04-25T22:40:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713091+0000", 2024-04-25T22:40:47.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031910710000000002 2024-04-25T22:40:47.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:47.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713122+0000", 2024-04-25T22:40:47.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.048e-05 2024-04-25T22:40:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714538+0000", 2024-04-25T22:40:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014160030000000001 2024-04-25T22:40:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714627+0000", 2024-04-25T22:40:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518999999999995e-05 2024-04-25T22:40:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:40:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.096043354999999, 2024-04-25T22:40:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022089675999999999, 2024-04-25T22:40:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:40:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:40:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600120+0000", 2024-04-25T22:40:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1259999999999998e-06 2024-04-25T22:40:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600153+0000", 2024-04-25T22:40:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3186999999999999e-05 2024-04-25T22:40:47.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600181+0000", 2024-04-25T22:40:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7676000000000001e-05 2024-04-25T22:40:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600205+0000", 2024-04-25T22:40:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:40:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600467+0000", 2024-04-25T22:40:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026186800000000001 2024-04-25T22:40:47.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600809+0000", 2024-04-25T22:40:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034138400000000002 2024-04-25T22:40:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.601892+0000", 2024-04-25T22:40:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010831910000000001 2024-04-25T22:40:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611054+0000", 2024-04-25T22:40:47.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0091620940000000008 2024-04-25T22:40:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621965+0000", 2024-04-25T22:40:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010911044999999999 2024-04-25T22:40:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622090+0000", 2024-04-25T22:40:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012522 2024-04-25T22:40:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622202+0000", 2024-04-25T22:40:47.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011164500000000001 2024-04-25T22:40:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:40:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.095900299999997, 2024-04-25T22:40:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035756228000000001, 2024-04-25T22:40:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:47.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:40:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:40:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600257+0000", 2024-04-25T22:40:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8300000000000001e-06 2024-04-25T22:40:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600267+0000", 2024-04-25T22:40:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6539999999999994e-06 2024-04-25T22:40:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600293+0000", 2024-04-25T22:40:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5996e-05 2024-04-25T22:40:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600309+0000", 2024-04-25T22:40:47.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6206e-05 2024-04-25T22:40:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603757+0000", 2024-04-25T22:40:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003448244 2024-04-25T22:40:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604779+0000", 2024-04-25T22:40:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010216820000000001 2024-04-25T22:40:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:47.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605127+0000", 2024-04-25T22:40:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034820100000000002 2024-04-25T22:40:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611082+0000", 2024-04-25T22:40:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0059550640000000004 2024-04-25T22:40:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635779+0000", 2024-04-25T22:40:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024696665999999999 2024-04-25T22:40:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635915+0000", 2024-04-25T22:40:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000135809 2024-04-25T22:40:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636011+0000", 2024-04-25T22:40:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6875999999999999e-05 2024-04-25T22:40:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:40:47.729 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.095823086999999, 2024-04-25T22:40:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035327031000000002, 2024-04-25T22:40:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:40:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:40:47.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600334+0000", 2024-04-25T22:40:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:40:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600347+0000", 2024-04-25T22:40:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3593e-05 2024-04-25T22:40:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600371+0000", 2024-04-25T22:40:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.313e-05 2024-04-25T22:40:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600390+0000", 2024-04-25T22:40:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.908e-05 2024-04-25T22:40:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602756+0000", 2024-04-25T22:40:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023662560000000002 2024-04-25T22:40:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:47.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603021+0000", 2024-04-25T22:40:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026546399999999998 2024-04-25T22:40:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603304+0000", 2024-04-25T22:40:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028308800000000002 2024-04-25T22:40:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611075+0000", 2024-04-25T22:40:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077703900000000003 2024-04-25T22:40:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635414+0000", 2024-04-25T22:40:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024339326000000001 2024-04-25T22:40:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635544+0000", 2024-04-25T22:40:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012948199999999999 2024-04-25T22:40:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635659+0000", 2024-04-25T22:40:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000115809 2024-04-25T22:40:47.734 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:40:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.095663162000001, 2024-04-25T22:40:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035594492999999998, 2024-04-25T22:40:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:47.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:40:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:40:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600494+0000", 2024-04-25T22:40:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:40:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600502+0000", 2024-04-25T22:40:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3769999999999996e-06 2024-04-25T22:40:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600522+0000", 2024-04-25T22:40:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9919999999999999e-05 2024-04-25T22:40:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600539+0000", 2024-04-25T22:40:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.649e-05 2024-04-25T22:40:47.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604846+0000", 2024-04-25T22:40:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043075199999999996 2024-04-25T22:40:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605057+0000", 2024-04-25T22:40:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00021085200000000001 2024-04-25T22:40:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605378+0000", 2024-04-25T22:40:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032074799999999999 2024-04-25T22:40:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611089+0000", 2024-04-25T22:40:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057110249999999998 2024-04-25T22:40:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635844+0000", 2024-04-25T22:40:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024755355999999999 2024-04-25T22:40:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635986+0000", 2024-04-25T22:40:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141512 2024-04-25T22:40:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636087+0000", 2024-04-25T22:40:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101183 2024-04-25T22:40:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.740 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:40:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.095590551999997, 2024-04-25T22:40:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021266723000000001, 2024-04-25T22:40:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:40:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:47.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:40:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600566+0000", 2024-04-25T22:40:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4959999999999999e-06 2024-04-25T22:40:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600574+0000", 2024-04-25T22:40:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-06 2024-04-25T22:40:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600592+0000", 2024-04-25T22:40:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8479999999999999e-05 2024-04-25T22:40:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600610+0000", 2024-04-25T22:40:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7567e-05 2024-04-25T22:40:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602679+0000", 2024-04-25T22:40:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020692739999999999 2024-04-25T22:40:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602945+0000", 2024-04-25T22:40:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026640399999999998 2024-04-25T22:40:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603115+0000", 2024-04-25T22:40:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000169996 2024-04-25T22:40:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608398+0000", 2024-04-25T22:40:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052826289999999996 2024-04-25T22:40:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621588+0000", 2024-04-25T22:40:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013190489 2024-04-25T22:40:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621733+0000", 2024-04-25T22:40:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014462500000000001 2024-04-25T22:40:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621832+0000", 2024-04-25T22:40:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8603000000000004e-05 2024-04-25T22:40:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.745 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:40:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.095522826, 2024-04-25T22:40:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034747924999999999, 2024-04-25T22:40:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:40:47.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:40:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600634+0000", 2024-04-25T22:40:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-04-25T22:40:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600642+0000", 2024-04-25T22:40:47.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8169999999999999e-06 2024-04-25T22:40:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600660+0000", 2024-04-25T22:40:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8513e-05 2024-04-25T22:40:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600676+0000", 2024-04-25T22:40:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6019999999999999e-05 2024-04-25T22:40:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603748+0000", 2024-04-25T22:40:47.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030718329999999999 2024-04-25T22:40:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604752+0000", 2024-04-25T22:40:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001003603 2024-04-25T22:40:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605117+0000", 2024-04-25T22:40:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00036539 2024-04-25T22:40:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:47.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608459+0000", 2024-04-25T22:40:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033413879999999998 2024-04-25T22:40:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635106+0000", 2024-04-25T22:40:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026647607 2024-04-25T22:40:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635273+0000", 2024-04-25T22:40:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000166689 2024-04-25T22:40:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:47.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635381+0000", 2024-04-25T22:40:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107642 2024-04-25T22:40:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:40:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.095459597000001, 2024-04-25T22:40:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040419292000000002, 2024-04-25T22:40:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:47.751 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:40:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:40:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600697+0000", 2024-04-25T22:40:47.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1999999999999999e-06 2024-04-25T22:40:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600704+0000", 2024-04-25T22:40:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5570000000000001e-06 2024-04-25T22:40:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600724+0000", 2024-04-25T22:40:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0023000000000001e-05 2024-04-25T22:40:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600738+0000", 2024-04-25T22:40:47.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4372999999999999e-05 2024-04-25T22:40:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.612532+0000", 2024-04-25T22:40:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011793606 2024-04-25T22:40:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613354+0000", 2024-04-25T22:40:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00082244100000000004 2024-04-25T22:40:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:47.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613726+0000", 2024-04-25T22:40:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00037226000000000002 2024-04-25T22:40:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618891+0000", 2024-04-25T22:40:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051649199999999999 2024-04-25T22:40:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.640874+0000", 2024-04-25T22:40:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021982640000000001 2024-04-25T22:40:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:47.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641019+0000", 2024-04-25T22:40:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000145339 2024-04-25T22:40:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641115+0000", 2024-04-25T22:40:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5933000000000005e-05 2024-04-25T22:40:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:40:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.095373567000003, 2024-04-25T22:40:47.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036502711, 2024-04-25T22:40:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:40:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:40:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:40:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600783+0000", 2024-04-25T22:40:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.533e-06 2024-04-25T22:40:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600790+0000", 2024-04-25T22:40:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0439999999999998e-06 2024-04-25T22:40:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600811+0000", 2024-04-25T22:40:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0449e-05 2024-04-25T22:40:47.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600825+0000", 2024-04-25T22:40:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4293e-05 2024-04-25T22:40:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602304+0000", 2024-04-25T22:40:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001478629 2024-04-25T22:40:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602587+0000", 2024-04-25T22:40:47.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028350800000000002 2024-04-25T22:40:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.637285+0000", 2024-04-25T22:40:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034697255000000003 2024-04-25T22:40:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:47.760 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:40:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.095308000999999, 2024-04-25T22:40:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017311460000000001, 2024-04-25T22:40:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:40:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:40:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:47.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:40:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600849+0000", 2024-04-25T22:40:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2899999999999999e-06 2024-04-25T22:40:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600866+0000", 2024-04-25T22:40:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6793e-05 2024-04-25T22:40:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:47.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600886+0000", 2024-04-25T22:40:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0772999999999999e-05 2024-04-25T22:40:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600904+0000", 2024-04-25T22:40:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7697e-05 2024-04-25T22:40:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602796+0000", 2024-04-25T22:40:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018920149999999999 2024-04-25T22:40:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602962+0000", 2024-04-25T22:40:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016590600000000001 2024-04-25T22:40:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618159+0000", 2024-04-25T22:40:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015196985999999999 2024-04-25T22:40:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:40:47.764 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.080432260000002, 2024-04-25T22:40:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006380269, 2024-04-25T22:40:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:40:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:40:47.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615724+0000", 2024-04-25T22:40:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.094e-06 2024-04-25T22:40:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615734+0000", 2024-04-25T22:40:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.363e-06 2024-04-25T22:40:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:47.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615751+0000", 2024-04-25T22:40:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:40:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615773+0000", 2024-04-25T22:40:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.154e-05 2024-04-25T22:40:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616485+0000", 2024-04-25T22:40:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00071225100000000001 2024-04-25T22:40:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:47.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616528+0000", 2024-04-25T22:40:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3606000000000002e-05 2024-04-25T22:40:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622030+0000", 2024-04-25T22:40:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055010750000000002 2024-04-25T22:40:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622103+0000", 2024-04-25T22:40:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3930000000000005e-05 2024-04-25T22:40:47.768 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:40:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:40:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.079519323, 2024-04-25T22:40:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046420649999999999, 2024-04-25T22:40:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-04-25T22:40:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:47.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:40:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:40:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616637+0000", 2024-04-25T22:40:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0299999999999998e-07 2024-04-25T22:40:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616653+0000", 2024-04-25T22:40:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5843000000000001e-05 2024-04-25T22:40:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616690+0000", 2024-04-25T22:40:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7466999999999999e-05 2024-04-25T22:40:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616729+0000", 2024-04-25T22:40:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8810000000000003e-05 2024-04-25T22:40:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:47.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617251+0000", 2024-04-25T22:40:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00052143899999999995 2024-04-25T22:40:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621278+0000", 2024-04-25T22:40:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040277029999999997 2024-04-25T22:40:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:40:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.078495971000002, 2024-04-25T22:40:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0065101730000000002, 2024-04-25T22:40:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:40:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:40:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617661+0000", 2024-04-25T22:40:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:40:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617688+0000", 2024-04-25T22:40:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7589e-05 2024-04-25T22:40:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:47.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617710+0000", 2024-04-25T22:40:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1467e-05 2024-04-25T22:40:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617727+0000", 2024-04-25T22:40:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6990000000000002e-05 2024-04-25T22:40:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618559+0000", 2024-04-25T22:40:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083207400000000003 2024-04-25T22:40:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:47.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618608+0000", 2024-04-25T22:40:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8936e-05 2024-04-25T22:40:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624077+0000", 2024-04-25T22:40:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054695840000000004 2024-04-25T22:40:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624170+0000", 2024-04-25T22:40:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2305999999999993e-05 2024-04-25T22:40:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:40:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.073394463, 2024-04-25T22:40:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006879446, 2024-04-25T22:40:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:40:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:40:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622762+0000", 2024-04-25T22:40:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:40:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622781+0000", 2024-04-25T22:40:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8749999999999998e-05 2024-04-25T22:40:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622802+0000", 2024-04-25T22:40:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1650000000000001e-05 2024-04-25T22:40:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622816+0000", 2024-04-25T22:40:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3556e-05 2024-04-25T22:40:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623700+0000", 2024-04-25T22:40:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00088389299999999996 2024-04-25T22:40:47.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623741+0000", 2024-04-25T22:40:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1023999999999999e-05 2024-04-25T22:40:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629543+0000", 2024-04-25T22:40:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058023980000000003 2024-04-25T22:40:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629640+0000", 2024-04-25T22:40:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7381999999999997e-05 2024-04-25T22:40:47.780 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:40:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.073133259000002, 2024-04-25T22:40:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067054879999999999, 2024-04-25T22:40:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:47.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:40:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:40:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623032+0000", 2024-04-25T22:40:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.9930000000000007e-06 2024-04-25T22:40:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623043+0000", 2024-04-25T22:40:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0387000000000001e-05 2024-04-25T22:40:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623064+0000", 2024-04-25T22:40:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1849999999999999e-05 2024-04-25T22:40:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623079+0000", 2024-04-25T22:40:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4093e-05 2024-04-25T22:40:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:47.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624384+0000", 2024-04-25T22:40:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013054539999999999 2024-04-25T22:40:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624421+0000", 2024-04-25T22:40:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7088999999999997e-05 2024-04-25T22:40:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629645+0000", 2024-04-25T22:40:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052241400000000004 2024-04-25T22:40:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:47.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629728+0000", 2024-04-25T22:40:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2482000000000001e-05 2024-04-25T22:40:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2024-04-25T22:40:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:40:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.073050146, 2024-04-25T22:40:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078029559999999998, 2024-04-25T22:40:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:47.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:40:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:40:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623106+0000", 2024-04-25T22:40:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.64e-07 2024-04-25T22:40:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623141+0000", 2024-04-25T22:40:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4678999999999998e-05 2024-04-25T22:40:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623153+0000", 2024-04-25T22:40:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1759999999999999e-05 2024-04-25T22:40:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623161+0000", 2024-04-25T22:40:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8299999999999996e-06 2024-04-25T22:40:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623834+0000", 2024-04-25T22:40:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067394500000000001 2024-04-25T22:40:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623883+0000", 2024-04-25T22:40:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8640000000000002e-05 2024-04-25T22:40:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630807+0000", 2024-04-25T22:40:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069238859999999998 2024-04-25T22:40:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:47.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:47.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:47.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630908+0000", 2024-04-25T22:40:47.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101252 2024-04-25T22:40:47.789 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.789 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.789 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.789 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:47.789 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:47.789 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:40:47.791 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:40:47.791 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:47.792+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:47.892 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:47.891+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:47.924 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:47.924 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:47.924 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:40:47.925 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:47.938 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:40:47.993 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:47.992+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:48.055 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:48.055 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:48.055 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:40:48.055 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:40:48.055 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:48.060 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:40:48.069 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:40:48.094 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:48.096+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:48.186 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:48.186 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:40:48.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:40:48.186 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:40:48.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.186 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:48.186 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:48.187 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.590197107000002, 2024-04-25T22:40:48.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:40:48.187 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:48.187 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:48.187 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:48.187 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:48.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:48.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:48.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:48.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:48.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.188 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.188 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.188 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:48.188 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:40:48.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:40:48.188 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.188 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.188 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:48.188 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:40:48.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:40:48.188 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.188 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.188 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:48.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:40:48.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:40:48.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:48.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:40:48.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:40:48.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:40:48.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:40:48.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:48.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:40:48.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:40:48.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:40:48.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:40:48.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:48.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:40:48.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:40:48.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:48.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:40:48.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:40:48.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:48.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:40:48.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:40:48.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:48.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:40:48.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:40:48.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:48.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:40:48.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:40:48.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:48.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:40:48.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:40:48.192 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.192 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.192 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.193 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.193 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:48.193 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:48.193 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.590059850999999, 2024-04-25T22:40:48.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:40:48.193 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:48.193 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:48.193 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:48.193 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:48.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.193 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:48.193 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:48.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:48.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:48.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:48.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:40:48.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:40:48.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:48.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:40:48.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:40:48.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:48.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:40:48.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:40:48.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:48.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:40:48.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:40:48.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:40:48.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:40:48.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:48.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:40:48.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:40:48.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:40:48.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:40:48.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:48.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:40:48.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:40:48.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:48.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:40:48.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:40:48.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:48.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:40:48.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:40:48.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:48.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:40:48.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:40:48.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:48.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:40:48.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:40:48.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:48.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:40:48.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:40:48.199 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.199 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.199 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.199 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.199 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:48.199 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:48.199 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.589972299000003, 2024-04-25T22:40:48.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:40:48.199 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:48.199 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:48.199 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:48.200 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:48.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:48.200 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:48.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:48.200 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:48.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:48.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:40:48.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:40:48.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:48.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:40:48.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:40:48.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:48.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:40:48.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:40:48.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:48.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:40:48.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:40:48.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:40:48.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:40:48.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:48.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:40:48.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:40:48.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.203 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:40:48.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:40:48.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:48.203 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:40:48.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:40:48.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:48.203 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:40:48.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:40:48.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:48.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:40:48.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:40:48.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:48.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:40:48.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:40:48.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:48.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:40:48.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:40:48.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:48.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:40:48.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:40:48.205 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.205 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.205 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.205 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:48.205 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:48.205 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.589868473000003, 2024-04-25T22:40:48.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:40:48.206 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:48.206 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:48.206 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:48.206 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:48.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:48.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:48.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.206 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:48.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:48.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.206 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.207 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:48.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:40:48.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:40:48.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.207 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:48.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:40:48.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:40:48.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.207 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:48.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:40:48.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:40:48.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.208 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:48.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:40:48.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:40:48.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.208 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:40:48.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:40:48.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.208 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:48.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:40:48.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:40:48.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:40:48.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:40:48.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:48.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:40:48.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:40:48.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:48.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:40:48.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:40:48.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:48.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:40:48.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:40:48.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:48.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:40:48.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:40:48.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:48.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:40:48.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:40:48.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:48.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:40:48.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:40:48.211 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.211 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.211 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.211 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:48.212 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:48.212 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.589799683000003, 2024-04-25T22:40:48.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:40:48.212 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:48.212 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:48.212 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:48.212 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:48.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.212 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:48.212 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:48.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.212 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.212 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:48.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:48.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:48.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:40:48.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:40:48.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:48.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:40:48.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:40:48.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.214 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:48.214 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:40:48.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:40:48.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.214 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:48.214 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:40:48.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:40:48.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.214 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.214 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:40:48.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:40:48.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.215 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:48.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:40:48.215 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:40:48.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.215 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:40:48.215 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:40:48.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.215 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:48.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:40:48.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:40:48.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:48.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:40:48.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:40:48.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:48.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:40:48.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:40:48.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:48.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:40:48.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:40:48.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.217 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:48.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:40:48.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:40:48.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.217 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:48.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:40:48.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:40:48.217 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.217 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.218 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.218 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:48.218 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:48.218 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.589730596999999, 2024-04-25T22:40:48.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:40:48.218 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:48.218 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:48.218 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:48.218 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:48.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:48.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:48.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:48.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:48.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:48.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:40:48.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:40:48.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:48.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:40:48.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:40:48.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:48.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:40:48.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:40:48.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:48.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:40:48.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:40:48.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.221 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.221 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:40:48.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:40:48.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.221 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:48.221 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:40:48.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:40:48.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.221 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.221 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:40:48.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:40:48.222 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.222 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:48.222 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:40:48.222 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:40:48.222 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.222 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:48.222 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:40:48.222 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:40:48.222 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.222 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:48.222 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:40:48.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:40:48.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:48.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:40:48.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:40:48.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:48.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:40:48.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:40:48.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:48.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:40:48.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:40:48.224 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.224 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.224 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.224 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:48.224 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:48.224 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.589634484000001, 2024-04-25T22:40:48.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:40:48.224 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:48.224 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:48.224 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:48.225 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:48.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:48.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:48.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:48.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:48.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:48.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:40:48.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:40:48.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:48.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:40:48.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:40:48.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:48.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:40:48.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:40:48.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.227 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:48.227 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:40:48.227 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:40:48.227 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.227 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.227 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.227 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:40:48.227 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:40:48.227 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.227 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.227 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:48.227 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:40:48.227 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:40:48.227 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:40:48.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:40:48.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:48.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:40:48.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:40:48.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:48.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:40:48.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:40:48.228 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.229 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.229 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.229 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:48.229 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:48.229 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.589568821999997, 2024-04-25T22:40:48.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:40:48.229 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:48.229 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:48.229 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:48.229 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:48.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:48.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:48.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:48.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:48.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:48.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:40:48.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:40:48.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:48.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:40:48.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:40:48.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:48.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:40:48.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:40:48.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:48.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:40:48.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:40:48.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:40:48.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:40:48.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:48.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:40:48.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:40:48.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:40:48.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:40:48.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:48.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:40:48.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:40:48.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:48.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:40:48.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:40:48.233 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.233 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.233 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.234 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:48.234 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:48.234 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.589499695000001, 2024-04-25T22:40:48.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:40:48.234 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:48.234 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:48.234 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:48.234 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:48.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:48.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:48.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:48.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:48.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:48.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:40:48.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:40:48.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:48.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:40:48.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:40:48.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:48.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:40:48.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:40:48.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:48.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:40:48.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:40:48.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:40:48.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:40:48.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:48.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:40:48.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:40:48.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:40:48.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:40:48.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:48.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:40:48.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:40:48.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:48.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:40:48.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:40:48.238 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.238 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.238 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.238 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:40:48.239 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:48.239 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.578683038999998, 2024-04-25T22:40:48.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:40:48.239 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:48.239 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:48.239 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:48.239 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:48.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:48.239 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:48.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.239 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:48.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:48.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:48.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:40:48.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:40:48.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:48.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:40:48.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:40:48.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:48.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:40:48.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:40:48.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:48.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:40:48.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:40:48.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:40:48.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:40:48.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:48.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:40:48.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:40:48.242 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.242 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.242 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.242 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:48.242 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:48.242 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.561784686000003, 2024-04-25T22:40:48.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:40:48.243 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:48.243 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:48.243 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:48.243 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:48.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:48.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:48.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:48.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:48.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:48.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:48.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:40:48.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:48.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:40:48.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:40:48.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:48.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:40:48.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:40:48.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:48.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:40:48.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:40:48.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:40:48.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:40:48.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:48.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:40:48.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:40:48.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:48.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:40:48.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:40:48.246 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.246 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.246 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.246 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:48.246 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:48.247 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.560963796000003, 2024-04-25T22:40:48.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:40:48.247 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:48.247 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:48.247 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:48.247 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:48.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:48.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:48.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:48.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:48.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:48.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:40:48.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:40:48.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:48.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:40:48.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:40:48.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:48.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:40:48.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:40:48.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:48.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:40:48.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:40:48.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:40:48.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:40:48.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.250 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:48.250 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:40:48.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:40:48.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.250 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:48.250 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:40:48.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:40:48.250 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.250 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.250 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.251 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:48.251 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:48.251 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.559263068, 2024-04-25T22:40:48.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:40:48.251 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:48.251 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:48.251 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:48.251 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:48.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:48.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:48.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:48.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:48.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:48.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:40:48.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:40:48.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:48.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:40:48.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:40:48.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:48.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:40:48.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:40:48.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:48.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:40:48.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:40:48.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:40:48.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:40:48.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:48.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:40:48.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:40:48.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:48.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:40:48.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:40:48.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:48.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:40:48.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:40:48.254 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.255 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.255 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.255 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.255 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.255 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:48.255 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:48.255 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.558666393000003, 2024-04-25T22:40:48.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:40:48.255 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:48.255 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:48.255 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:48.255 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:48.255 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.255 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:48.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:48.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:48.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:48.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:48.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:40:48.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:40:48.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:48.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:40:48.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:40:48.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:48.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:40:48.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:40:48.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:48.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:40:48.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:40:48.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:40:48.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:40:48.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:48.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:40:48.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:40:48.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:48.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:40:48.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:40:48.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:48.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:40:48.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:40:48.259 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.259 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.259 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.259 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:40:48.259 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:48.259 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.549230667000003, 2024-04-25T22:40:48.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:40:48.260 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:48.260 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:48.260 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:48.260 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:48.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:48.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:48.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:48.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:48.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:48.261 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:48.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:40:48.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:48.261 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:40:48.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:40:48.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:48.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:40:48.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:40:48.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:48.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:40:48.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:40:48.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:40:48.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:40:48.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:48.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:40:48.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:40:48.263 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.263 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.263 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.263 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:48.263 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:48.263 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.548583241000003, 2024-04-25T22:40:48.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:40:48.263 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:48.264 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:48.264 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:48.264 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:48.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:48.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:48.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:48.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:48.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:48.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:40:48.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:40:48.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:48.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:40:48.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:40:48.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:48.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:40:48.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:40:48.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:48.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:40:48.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:40:48.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:40:48.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:40:48.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:48.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:40:48.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:40:48.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.267 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:48.267 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:40:48.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:40:48.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.267 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:48.267 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:40:48.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:40:48.267 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.267 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.267 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.268 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:48.268 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:48.268 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.547142422, 2024-04-25T22:40:48.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:40:48.268 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:48.268 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:48.268 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:48.268 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:48.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.268 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:48.268 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:48.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:48.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:48.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:48.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:40:48.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:40:48.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:48.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:40:48.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:40:48.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:48.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:40:48.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:40:48.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:48.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:40:48.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:40:48.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:40:48.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:40:48.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:48.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:40:48.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:40:48.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:48.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:40:48.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:40:48.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.272 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:48.272 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:40:48.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:40:48.272 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.272 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.272 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.272 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:40:48.272 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:48.272 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.594703977999998, 2024-04-25T22:40:48.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:40:48.273 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:48.273 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:48.273 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:48.273 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:48.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:48.273 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:48.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:48.273 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:48.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.274 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:48.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:40:48.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:40:48.274 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.274 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:48.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:40:48.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:40:48.274 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.274 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:48.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:40:48.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:40:48.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:48.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:40:48.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:40:48.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:40:48.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:40:48.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:48.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:40:48.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:40:48.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:48.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:40:48.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:40:48.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:48.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:40:48.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:40:48.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:48.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:40:48.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:40:48.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:48.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:40:48.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:40:48.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:48.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:40:48.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:40:48.277 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.277 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.277 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.278 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.278 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.278 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:40:48.278 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:48.278 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 9.5920446540000004, 2024-04-25T22:40:48.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:40:48.278 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:48.278 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:48.278 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:48.278 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:48.278 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.278 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:48.278 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:48.279 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.279 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:48.279 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:48.279 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.281 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:48.281 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:40:48.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:40:48.281 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:48.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:40:48.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:40:48.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:48.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:40:48.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:40:48.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:48.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:40:48.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:40:48.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:40:48.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:40:48.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:48.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:40:48.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:40:48.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:48.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:40:48.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:40:48.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.284 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.284 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:48.284 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:40:48.284 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:40:48.284 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.284 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.284 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:48.284 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:40:48.284 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:40:48.284 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.284 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.284 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:48.284 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:40:48.284 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:40:48.285 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.285 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.285 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:48.285 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:40:48.285 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:40:48.285 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.285 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.285 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.285 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.285 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.285 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:40:48.285 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:48.285 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.5917524030000001, 2024-04-25T22:40:48.285 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:40:48.286 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:48.286 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:48.286 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:48.286 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:48.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.286 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:48.286 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:48.286 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.286 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.286 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:48.286 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:48.286 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:48.286 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.287 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:48.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:40:48.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:40:48.287 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.287 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:48.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:40:48.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:40:48.287 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.287 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:48.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:40:48.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:40:48.287 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.288 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.288 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:48.288 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:40:48.288 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:40:48.288 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.288 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.288 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:48.288 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:40:48.288 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:40:48.289 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.289 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.289 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:48.289 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:40:48.289 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:40:48.289 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.289 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.289 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:48.289 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:40:48.289 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:40:48.289 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.289 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.289 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:48.289 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:40:48.290 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:40:48.290 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.290 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.290 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:48.290 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:40:48.290 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:40:48.290 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.290 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.290 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:48.290 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:40:48.290 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:40:48.290 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:48.290 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:48.290 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:48.290 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:40:48.291 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:40:48.291 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.291 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.291 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.291 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:48.291 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:48.291 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:48.292 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:40:48.293 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:40:48.293 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:40:48.294 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:40:48.294 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:40:48.295 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:40:48.295 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:40:48.296 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:48.292+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:48.393 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:48.392+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:48.429 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:48.429 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:48.445 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:40:48.494 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:48.494+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:48.565 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:48.566 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:48.581 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:40:48.595 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:48.596+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:48.696 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:48.694+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:48.704 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:48.704 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:48.718 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:40:48.797 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:48.795+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:48.849 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:48.850 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:48.864 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:40:48.910 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:48.912+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:48.979 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:48.979 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:48.993 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:40:48.999 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:48.997+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:49.099 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:49.097+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:49.155 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:49.155 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:49.170 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:40:49.214 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:49.213+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:49.300 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:49.300 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:49.300 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:49.297+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:49.314 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:40:49.401 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:49.403+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:49.479 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:49.479 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:49.493 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:40:49.501 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:40:49.502 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:49.499+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:49.603 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:49.603+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:49.609 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:49.610 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:49.625 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:40:49.704 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:49.705+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:49.754 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:49.754 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:49.768 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:40:49.805 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:49.805+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:49.889 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:49.889 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:49.903 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:40:49.906 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:49.904+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:50.006 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:50.003+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:50.020 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:50.020 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:50.034 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:40:50.107 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:50.105+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:50.166 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:50.166 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:50.181 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:40:50.208 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:50.205+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:50.296 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:40:50.305 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:50.305 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:50.309 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:50.309+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:50.319 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:40:50.410 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:50.409+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:50.441 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:50.441 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:50.455 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:40:50.458 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:40:50.459 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:40:50.477 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:40:50.478 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:40:50.487 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:40:50.487 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:40:50.488 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-25T22:40:50.488 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.000000 2024-04-25T22:40:50.488 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0 2024-04-25T22:40:50.496 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:40:50.496 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:40:50.511 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is set 2024-04-25T22:40:50.511 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:50.512+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:50.580 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:50.580 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:50.580 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:40:50.580 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:50.594 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:40:50.613 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:50.615+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:50.714 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:50.712+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:50.717 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:50.717 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:50.717 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:40:50.717 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:40:50.717 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:50.731 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:40:50.815 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:50.816+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:50.851 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:50.851 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:40:50.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:40:50.851 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:40:50.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.851 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:50.851 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:50.851 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 36.253630303000001, 2024-04-25T22:40:50.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:40:50.851 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:50.851 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:50.851 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:50.852 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:50.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:50.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:50.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:50.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:50.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:50.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:40:50.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:40:50.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:50.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:40:50.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:40:50.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:50.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:40:50.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:40:50.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:50.854 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:40:50.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:40:50.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.854 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.854 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:40:50.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:40:50.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.854 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:50.854 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:40:50.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:40:50.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:40:50.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:40:50.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:50.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:40:50.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:40:50.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:50.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:40:50.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:40:50.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:50.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:40:50.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:40:50.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:50.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:40:50.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:40:50.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:50.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:40:50.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:40:50.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:50.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:40:50.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:40:50.857 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.857 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.857 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.857 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:50.857 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:50.857 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 36.253493046999999, 2024-04-25T22:40:50.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:40:50.858 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:50.858 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:50.858 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:50.858 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:50.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:50.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:50.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:50.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:50.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:50.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:40:50.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:40:50.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:50.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:40:50.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:40:50.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:50.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:40:50.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:40:50.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:50.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:40:50.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:40:50.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:40:50.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:40:50.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:50.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:40:50.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:40:50.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:40:50.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:40:50.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:50.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:40:50.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:40:50.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:50.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:40:50.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:40:50.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:50.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:40:50.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:40:50.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:50.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:40:50.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:40:50.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:50.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:40:50.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:40:50.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:50.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:40:50.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:40:50.864 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.864 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.864 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.864 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:50.864 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:50.864 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 36.253405495000003, 2024-04-25T22:40:50.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:40:50.865 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:50.865 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:50.865 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:50.865 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:50.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:50.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:50.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:50.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:50.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:50.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:40:50.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:40:50.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:50.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:40:50.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:40:50.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:50.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:40:50.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:40:50.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:50.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:40:50.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:40:50.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:40:50.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:40:50.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:50.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:40:50.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:40:50.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:40:50.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:40:50.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:50.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:40:50.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:40:50.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:50.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:40:50.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:40:50.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:50.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:40:50.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:40:50.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:50.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:40:50.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:40:50.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:50.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:40:50.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:40:50.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:50.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:40:50.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:40:50.871 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.871 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.871 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.871 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:50.871 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:50.871 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 36.253301669000003, 2024-04-25T22:40:50.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:40:50.871 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:50.871 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:50.871 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:50.871 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:50.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:50.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:50.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:50.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:50.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:50.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:40:50.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:40:50.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:50.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:40:50.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:40:50.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:50.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:40:50.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:40:50.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:50.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:40:50.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:40:50.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:40:50.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:40:50.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:50.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:40:50.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:40:50.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:40:50.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:40:50.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:50.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:40:50.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:40:50.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:50.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:40:50.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:40:50.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:50.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:40:50.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:40:50.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:50.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:40:50.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:40:50.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:50.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:40:50.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:40:50.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:50.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:40:50.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:40:50.877 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.877 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.877 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.877 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:50.878 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:50.878 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 36.253232879000002, 2024-04-25T22:40:50.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:40:50.878 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:50.878 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:50.878 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:50.878 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:50.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:50.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:50.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:50.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:50.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:50.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:40:50.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:40:50.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:50.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:40:50.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:40:50.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:50.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:40:50.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:40:50.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:50.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:40:50.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:40:50.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:40:50.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:40:50.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:50.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:40:50.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:40:50.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:40:50.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:40:50.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:50.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:40:50.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:40:50.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.882 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:50.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:40:50.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:40:50.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.882 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:50.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:40:50.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:40:50.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:50.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:40:50.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:40:50.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:50.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:40:50.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:40:50.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:50.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:40:50.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:40:50.883 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.884 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.884 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.884 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:50.884 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:50.884 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 36.253163792999999, 2024-04-25T22:40:50.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:40:50.884 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:50.884 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:50.884 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:50.884 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:50.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:50.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:50.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:50.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:50.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:50.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:40:50.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:40:50.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:50.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:40:50.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:40:50.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:50.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:40:50.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:40:50.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:50.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:40:50.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:40:50.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:40:50.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:40:50.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:50.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:40:50.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:40:50.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:40:50.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:40:50.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:50.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:40:50.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:40:50.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:50.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:40:50.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:40:50.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:50.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:40:50.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:40:50.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:50.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:40:50.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:40:50.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:50.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:40:50.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:40:50.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:50.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:40:50.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:40:50.890 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.890 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.890 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.890 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:50.890 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:50.890 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 36.253067680000001, 2024-04-25T22:40:50.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:40:50.890 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:50.890 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:50.890 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:50.891 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:50.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:50.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:50.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:50.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:50.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:50.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:40:50.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:40:50.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:50.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:40:50.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:40:50.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:50.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:40:50.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:40:50.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:50.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:40:50.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:40:50.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:40:50.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:40:50.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:50.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:40:50.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:40:50.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:40:50.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:40:50.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:50.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:40:50.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:40:50.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:50.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:40:50.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:40:50.894 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.894 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.895 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.895 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:50.895 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:50.895 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 36.253002017999997, 2024-04-25T22:40:50.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:40:50.895 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:50.895 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:50.895 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:50.895 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:50.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:50.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:50.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:50.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:50.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:50.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:40:50.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:40:50.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:50.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:40:50.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:40:50.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:50.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:40:50.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:40:50.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:50.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:40:50.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:40:50.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:40:50.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:40:50.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:50.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:40:50.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:40:50.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:40:50.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:40:50.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:50.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:40:50.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:40:50.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:50.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:40:50.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:40:50.899 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.899 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.899 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.899 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:50.899 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:50.900 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 36.252932891, 2024-04-25T22:40:50.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:40:50.900 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:50.900 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:50.900 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:50.900 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:50.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:50.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:50.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:50.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:50.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:50.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:40:50.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:40:50.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:50.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:40:50.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:40:50.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:50.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:40:50.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:40:50.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:50.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:40:50.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:40:50.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:40:50.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:40:50.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:50.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:40:50.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:40:50.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:40:50.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:40:50.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:50.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:40:50.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:40:50.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:50.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:40:50.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:40:50.904 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.904 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.904 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.904 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:40:50.904 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:50.904 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 36.242116234999997, 2024-04-25T22:40:50.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:40:50.904 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:50.904 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:50.904 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:50.904 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:50.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:50.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:50.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:50.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:50.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:50.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:40:50.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:40:50.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:50.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:40:50.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:40:50.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:50.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:40:50.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:40:50.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:50.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:40:50.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:40:50.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:40:50.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:40:50.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:50.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:40:50.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:40:50.907 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.907 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.907 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.907 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:50.908 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:50.908 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 36.225217882000003, 2024-04-25T22:40:50.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:40:50.908 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:50.908 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:50.908 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:50.908 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:50.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:50.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:50.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:50.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:50.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:50.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:50.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:40:50.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:50.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:40:50.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:40:50.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:50.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:40:50.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:40:50.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:50.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:40:50.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:40:50.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:40:50.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:40:50.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:50.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:40:50.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:40:50.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:50.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:40:50.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:40:50.911 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.911 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.911 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.911 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:50.911 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:50.911 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 36.224396992000003, 2024-04-25T22:40:50.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:40:50.912 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:50.912 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:50.912 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:50.912 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:50.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:50.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:50.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:50.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:50.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:50.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:40:50.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:40:50.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:50.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:40:50.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:40:50.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:50.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:40:50.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:40:50.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:50.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:40:50.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:40:50.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:40:50.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:40:50.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:50.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:40:50.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:40:50.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:50.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:40:50.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:40:50.915 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.915 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.915 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.915 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:50.915 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:50.915 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 36.222696264, 2024-04-25T22:40:50.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:40:50.916 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:50.916 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:50.916 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:50.916 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:50.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:50.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:50.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:50.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:50.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:50.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:40:50.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:40:50.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:50.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:40:50.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:40:50.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:50.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:40:50.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:40:50.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:50.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:40:50.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:40:50.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:40:50.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:40:50.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:50.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:40:50.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:40:50.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:50.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:40:50.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:40:50.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:50.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:40:50.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:40:50.919 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.919 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.920 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.920 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:50.920 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:50.920 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 36.222099589000003, 2024-04-25T22:40:50.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:40:50.920 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:50.920 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:50.920 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:50.920 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:50.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:50.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:50.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:50.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:50.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:50.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:40:50.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:40:50.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:50.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:40:50.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:40:50.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:50.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:40:50.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:40:50.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:50.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:40:50.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:40:50.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:40:50.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:40:50.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:50.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:40:50.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:40:50.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:50.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:40:50.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:40:50.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:50.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:40:50.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:40:50.924 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.924 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.924 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.924 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:40:50.924 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:50.924 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 36.212663863000003, 2024-04-25T22:40:50.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:40:50.924 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:50.924 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:50.924 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:50.925 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:50.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:50.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:50.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:50.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:50.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:50.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:50.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:40:50.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:50.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:40:50.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:40:50.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:50.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:40:50.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:40:50.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:50.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:40:50.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:40:50.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:40:50.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:40:50.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:50.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:40:50.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:40:50.927 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.927 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.927 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.928 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:50.928 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:50.928 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 36.212016437000003, 2024-04-25T22:40:50.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:40:50.928 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:50.928 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:50.928 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:50.928 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:50.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:50.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:50.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:50.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:50.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:50.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:40:50.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:40:50.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:50.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:40:50.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:40:50.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:50.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:40:50.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:40:50.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:50.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:40:50.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:40:50.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:40:50.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:40:50.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:50.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:40:50.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:40:50.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:50.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:40:50.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:40:50.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:50.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:40:50.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:40:50.932 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.932 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.932 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.932 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:50.932 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:50.932 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 36.210575618, 2024-04-25T22:40:50.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:40:50.932 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:50.932 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:50.932 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:50.932 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:50.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:50.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:50.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:50.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:50.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:50.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:40:50.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:40:50.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:50.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:40:50.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:40:50.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:50.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:40:50.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:40:50.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:50.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:40:50.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:40:50.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:40:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:40:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:40:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:40:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:40:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:40:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:40:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:40:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:40:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 34.258137173999998, 2024-04-25T22:40:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:40:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:40:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:40:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:40:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:40:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:40:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:40:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:40:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:40:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:40:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:40:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:40:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:40:50.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:50.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:40:50.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:40:50.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:50.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:40:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:40:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:40:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:40:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:40:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:40:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:40:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:40:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:40:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.25547785, 2024-04-25T22:40:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:40:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:40:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:40:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:40:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:40:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:40:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:40:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:40:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:40:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:40:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:40:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:40:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:40:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:40:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:40:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:40:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:40:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:40:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:40:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:40:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:40:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:40:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:40:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:40:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 7.2551855989999998, 2024-04-25T22:40:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:40:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:40:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:40:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:40:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:40:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:40:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:40:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:40:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:40:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:40:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:40:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:40:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:40:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:40:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:40:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:40:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:40:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:40:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:40:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:40:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:40:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:40:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:40:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:50.953 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:50.955 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:50.953+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:50.955 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:40:51.055 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:51.051+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:51.089 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:40:51.089 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:40:51.089 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:40:51.089 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:40:51.104 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:40:51.156 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:51.156+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:51.257 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:51.255+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:51.266 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:40:51.266 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:40:51.266 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:40:51.266 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:40:51.266 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:40:51.280 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:40:51.358 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:51.357+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:51.453 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:40:51.453 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:40:51.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:40:51.453 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:40:51.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.454 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:51.454 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:40:51.454 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.855280182000001, 2024-04-25T22:40:51.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:40:51.454 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:51.454 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:51.455 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:51.455 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:51.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:51.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:40:51.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:51.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:40:51.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:51.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:40:51.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:40:51.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:51.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:40:51.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:40:51.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:51.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:40:51.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:40:51.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:51.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:40:51.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:40:51.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:40:51.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:40:51.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:51.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:40:51.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:40:51.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:40:51.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:40:51.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:51.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:40:51.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:40:51.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:51.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:40:51.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:40:51.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:51.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:40:51.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:40:51.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:51.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:40:51.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:40:51.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:51.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:40:51.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:40:51.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:51.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:40:51.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:40:51.465 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.465 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.465 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.465 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:51.465 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:40:51.465 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.855192168999999, 2024-04-25T22:40:51.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:40:51.466 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:51.466 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:51.466 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:51.466 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:51.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:51.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:40:51.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:51.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:40:51.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:51.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:40:51.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:40:51.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:51.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:40:51.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:40:51.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:51.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:40:51.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:40:51.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:51.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:40:51.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:40:51.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:40:51.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:40:51.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:51.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:51.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:40:51.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:40:51.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:40:51.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:51.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:40:51.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:40:51.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:51.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:40:51.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:40:51.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:51.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:40:51.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:40:51.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:51.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:40:51.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:40:51.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:51.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:40:51.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:40:51.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:51.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:40:51.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:40:51.474 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.475 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.475 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.475 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:51.475 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:40:51.475 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.855120047, 2024-04-25T22:40:51.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:40:51.475 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:51.475 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:51.476 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:51.476 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:51.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:51.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:40:51.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:51.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:40:51.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:51.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:40:51.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:40:51.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:51.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:40:51.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:40:51.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:51.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:40:51.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:40:51.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:51.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:40:51.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:40:51.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:40:51.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:40:51.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:51.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:40:51.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:40:51.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:40:51.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:40:51.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:51.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:40:51.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:40:51.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:51.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:40:51.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:40:51.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:51.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:40:51.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:40:51.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:51.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:40:51.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:40:51.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:51.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:40:51.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:40:51.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:51.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:40:51.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:40:51.485 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.485 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.485 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.485 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:51.485 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:40:51.485 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.855011734000001, 2024-04-25T22:40:51.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:40:51.486 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:51.486 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:51.486 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:51.486 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:51.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:51.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:40:51.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:51.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:40:51.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:51.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:40:51.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:40:51.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:51.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:40:51.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:40:51.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:51.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:40:51.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:40:51.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:51.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:40:51.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:40:51.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:40:51.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:40:51.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:51.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:40:51.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:40:51.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:40:51.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:40:51.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:51.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:40:51.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:40:51.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:51.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:40:51.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:40:51.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:51.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:40:51.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:40:51.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:51.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:40:51.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:40:51.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:51.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:40:51.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:40:51.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:51.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:40:51.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:40:51.495 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.496 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.496 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.496 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:51.496 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:40:51.496 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.854945078, 2024-04-25T22:40:51.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:40:51.496 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:51.497 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:51.497 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:51.497 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:51.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:51.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:40:51.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:51.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:40:51.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:51.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:40:51.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:40:51.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:51.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:40:51.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:40:51.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:51.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:40:51.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:40:51.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:51.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:40:51.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:40:51.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:40:51.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:40:51.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:51.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:40:51.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:40:51.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:40:51.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:40:51.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:51.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:40:51.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:40:51.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:51.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:40:51.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:40:51.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:51.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:40:51.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:40:51.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:51.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:40:51.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:40:51.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:51.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:40:51.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:40:51.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:51.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:40:51.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:40:51.506 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.506 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.506 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.507 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:51.507 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:40:51.507 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.854854482, 2024-04-25T22:40:51.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:40:51.507 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:51.507 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:51.507 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:51.507 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:51.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:51.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:40:51.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:51.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:40:51.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:51.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:40:51.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:40:51.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:51.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:40:51.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:40:51.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:51.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:40:51.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:40:51.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:51.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:40:51.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:40:51.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:40:51.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:40:51.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:51.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:40:51.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:40:51.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:40:51.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:40:51.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:51.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:40:51.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:40:51.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:51.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:40:51.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:40:51.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:51.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:40:51.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:40:51.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:51.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:40:51.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:40:51.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:51.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:40:51.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:40:51.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:51.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:40:51.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:40:51.515 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.516 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.516 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.516 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:51.516 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:40:51.516 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.854789908999997, 2024-04-25T22:40:51.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:40:51.516 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:51.516 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:51.517 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:51.517 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:51.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:51.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:40:51.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:51.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:40:51.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:51.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:40:51.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:40:51.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:51.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:40:51.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:40:51.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:51.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:40:51.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:40:51.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:51.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:40:51.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:40:51.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:40:51.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:40:51.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:51.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:40:51.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:40:51.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:40:51.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:40:51.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:51.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:40:51.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:40:51.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:51.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:40:51.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:40:51.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:51.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:40:51.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:40:51.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:51.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:40:51.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:40:51.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:51.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:40:51.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:40:51.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:51.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:40:51.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:40:51.522 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.522 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.522 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.522 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:51.522 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:40:51.522 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.854724486000002, 2024-04-25T22:40:51.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:40:51.523 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:51.523 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:51.523 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:51.523 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:51.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:51.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:40:51.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:51.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:40:51.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:51.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:40:51.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:40:51.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:51.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:40:51.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:40:51.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:51.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:40:51.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:40:51.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:51.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:40:51.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:40:51.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:40:51.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:40:51.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:51.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:40:51.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:40:51.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:40:51.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:40:51.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:51.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:40:51.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:40:51.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:51.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:40:51.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:40:51.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:51.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:40:51.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:40:51.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:51.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:40:51.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:40:51.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:51.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:40:51.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:40:51.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:51.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:40:51.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:40:51.528 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.528 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.528 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.529 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:51.529 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:40:51.529 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.854668420000003, 2024-04-25T22:40:51.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:40:51.529 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:51.529 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:51.529 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:51.529 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:51.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:51.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:40:51.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:51.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:40:51.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:51.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:40:51.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:40:51.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:51.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:40:51.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:40:51.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:51.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:40:51.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:40:51.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:51.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:40:51.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:40:51.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:40:51.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:40:51.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:51.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:40:51.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:40:51.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:40:51.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:40:51.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:51.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:40:51.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:40:51.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:51.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:40:51.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:40:51.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:51.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:40:51.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:40:51.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:51.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:40:51.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:40:51.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:51.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:40:51.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:40:51.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:51.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:40:51.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:40:51.534 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.535 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.535 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.535 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:51.535 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:40:51.535 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.854601314, 2024-04-25T22:40:51.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:40:51.535 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:51.535 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:51.535 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:51.535 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:51.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:51.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:40:51.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:51.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:40:51.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:51.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:40:51.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:40:51.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:51.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:40:51.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:40:51.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:51.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:40:51.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:40:51.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:51.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:40:51.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:40:51.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:40:51.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:40:51.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:51.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:40:51.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:40:51.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:40:51.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:40:51.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:51.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:40:51.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:40:51.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:51.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:40:51.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:40:51.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:51.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:40:51.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:40:51.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:51.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:40:51.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:40:51.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:51.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:40:51.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:40:51.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:51.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:40:51.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:40:51.541 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.541 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.541 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.541 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:51.541 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:40:51.541 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.854546190999997, 2024-04-25T22:40:51.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:40:51.541 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:51.541 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:51.541 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:51.541 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:51.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:51.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:40:51.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:51.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:40:51.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:51.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:40:51.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:40:51.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:51.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:40:51.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:40:51.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:51.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:40:51.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:40:51.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:51.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:40:51.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:40:51.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:40:51.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:40:51.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:51.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:40:51.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:40:51.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:40:51.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:40:51.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:51.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:40:51.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:40:51.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:40:51.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:40:51.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:40:51.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:51.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:40:51.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:40:51.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:51.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:40:51.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:40:51.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:51.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:40:51.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:40:51.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:51.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:40:51.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:40:51.547 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.547 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.547 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.547 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:51.547 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:40:51.547 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.854443951999997, 2024-04-25T22:40:51.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:40:51.547 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:51.547 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:51.547 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:51.548 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:51.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:51.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:40:51.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:51.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:40:51.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:51.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:40:51.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:40:51.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:51.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:40:51.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:40:51.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:51.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:40:51.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:40:51.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:51.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:40:51.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:40:51.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:40:51.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:40:51.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:51.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:40:51.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:40:51.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:40:51.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:40:51.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:51.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:40:51.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:40:51.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:40:51.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:40:51.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:40:51.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:51.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:40:51.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:40:51.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:51.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:40:51.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:40:51.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:51.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:40:51.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:40:51.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:51.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:40:51.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:40:51.553 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.553 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.553 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.553 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:51.553 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:40:51.553 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.854385129000001, 2024-04-25T22:40:51.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:40:51.554 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:51.554 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:51.554 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:51.554 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:51.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:51.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:40:51.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:51.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:40:51.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:51.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:40:51.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:40:51.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:51.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:40:51.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:40:51.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:51.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:40:51.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:40:51.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:51.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:40:51.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:40:51.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:40:51.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:40:51.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:51.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:40:51.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:40:51.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:40:51.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:40:51.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:51.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:40:51.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:40:51.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:40:51.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:40:51.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:40:51.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:51.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:40:51.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:40:51.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:51.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:40:51.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:40:51.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:51.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:40:51.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:40:51.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:51.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:40:51.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:40:51.560 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.560 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.560 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.560 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:51.560 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:40:51.560 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.854306395999998, 2024-04-25T22:40:51.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:40:51.560 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:51.560 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:51.560 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:51.560 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:51.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:51.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:40:51.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:51.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:40:51.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:51.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:40:51.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:40:51.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:51.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:40:51.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:40:51.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:51.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:40:51.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:40:51.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:51.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:40:51.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:40:51.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:40:51.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:40:51.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:51.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:40:51.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:40:51.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:40:51.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:40:51.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:51.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:40:51.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:40:51.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:51.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:40:51.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:40:51.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:51.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:40:51.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:40:51.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:51.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:40:51.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:40:51.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:51.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:40:51.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:40:51.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:51.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:40:51.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:40:51.566 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.566 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.566 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.566 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:51.566 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:40:51.566 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.854266983000002, 2024-04-25T22:40:51.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:40:51.566 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:51.567 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:51.567 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:51.567 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:51.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:51.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:40:51.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:51.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:40:51.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:51.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:40:51.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:40:51.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:51.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:40:51.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:40:51.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:51.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:40:51.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:40:51.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:51.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:40:51.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:40:51.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:40:51.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:40:51.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:51.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:40:51.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:40:51.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:40:51.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:40:51.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:51.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:40:51.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:40:51.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:51.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:40:51.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:40:51.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:51.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:40:51.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:40:51.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:51.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:40:51.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:40:51.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:51.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:40:51.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:40:51.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:51.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:40:51.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:40:51.572 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.572 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.572 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.572 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:51.572 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:40:51.572 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.854197137, 2024-04-25T22:40:51.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:40:51.573 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:51.573 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:51.573 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:51.573 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:51.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:51.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:40:51.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:51.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:40:51.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:51.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:40:51.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:40:51.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:51.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:40:51.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:40:51.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:51.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:40:51.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:40:51.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:51.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:40:51.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:40:51.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:40:51.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:40:51.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:51.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:40:51.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:40:51.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:40:51.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:40:51.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:51.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:40:51.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:40:51.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:51.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:40:51.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:40:51.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:51.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:40:51.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:40:51.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:51.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:40:51.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:40:51.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:51.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:40:51.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:40:51.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:51.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:40:51.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:40:51.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.578 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.578 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:51.578 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:40:51.579 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.854147400000002, 2024-04-25T22:40:51.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:40:51.579 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:51.579 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:51.579 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:51.579 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:51.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:51.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:40:51.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:51.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:40:51.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:51.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:40:51.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:40:51.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:51.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:40:51.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:40:51.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:51.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:40:51.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:40:51.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:51.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:40:51.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:40:51.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:40:51.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:40:51.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:51.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:40:51.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:40:51.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:40:51.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:40:51.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:51.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:40:51.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:40:51.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:40:51.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:40:51.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:40:51.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:51.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:40:51.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:40:51.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:51.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:40:51.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:40:51.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:51.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:40:51.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:40:51.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:51.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:40:51.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:40:51.584 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.584 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.584 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.584 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:51.585 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:40:51.585 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.854062784999996, 2024-04-25T22:40:51.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:40:51.585 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:51.585 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:51.585 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:51.585 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:51.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:51.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:40:51.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:51.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:40:51.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:51.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:40:51.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:40:51.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:51.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:40:51.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:40:51.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:51.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:40:51.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:40:51.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:51.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:40:51.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:40:51.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:40:51.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:40:51.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:51.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:40:51.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:40:51.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:40:51.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:40:51.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:51.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:40:51.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:40:51.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:51.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:40:51.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:40:51.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:51.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:40:51.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:40:51.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:51.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:40:51.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:40:51.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:51.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:40:51.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:40:51.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:51.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:40:51.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:40:51.591 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.591 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.591 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.591 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:51.591 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:40:51.591 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.853999135000002, 2024-04-25T22:40:51.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:40:51.592 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:51.592 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:51.592 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:40:51.592 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:51.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:51.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:40:51.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:51.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:40:51.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:51.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:40:51.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:40:51.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:51.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:40:51.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:40:51.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:51.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:40:51.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:40:51.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:51.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:40:51.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:40:51.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:40:51.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:40:51.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:51.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:40:51.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:40:51.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:40:51.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:40:51.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:51.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:40:51.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:40:51.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:51.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:40:51.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:40:51.596 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.596 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.596 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.596 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:51.596 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:40:51.596 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.846995605000004, 2024-04-25T22:40:51.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:40:51.596 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:51.596 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:51.596 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:51.597 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:51.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:51.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:40:51.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:51.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:40:51.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:51.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:51.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:40:51.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:40:51.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:51.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:40:51.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:40:51.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:51.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:40:51.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:40:51.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:51.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:40:51.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:40:51.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:51.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:40:51.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:40:51.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:51.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:40:51.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:40:51.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:51.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:40:51.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:40:51.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:51.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:51.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:51.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:40:51.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:40:51.600 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.600 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.600 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.600 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:51.600 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:51.600 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:40:51.602 INFO:teuthology.orchestra.run.smithi057.stderr:set osd.2 primary-affinity to 0 (802) 2024-04-25T22:40:51.603 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:40:51.604 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:51.600+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:51.703 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:51.703+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:51.732 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:40:51.732 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:40:51.732 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-04-25T22:40:51.732 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:40:51.746 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:40:51.804 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:51.805+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:51.867 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:40:51.868 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:40:51.868 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-04-25T22:40:51.868 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-04-25T22:40:51.868 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:40:51.881 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:40:51.905 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:51.907+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:51.999 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:40:51.999 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-04-25T22:40:51.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-04-25T22:40:51.999 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-04-25T22:40:51.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:51.999 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:111 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'73, mlcod=11'69)", 2024-04-25T22:40:51.999 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:40:51.999 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 47.299301102000001, 2024-04-25T22:40:51.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055481899999999997, 2024-04-25T22:40:52.000 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:52.000 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:52.000 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.000 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:52.000 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.000 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:52.000 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:40:52.000 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.000 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.000 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:52.000 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:40:52.000 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.001 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:52.001 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700271+0000", 2024-04-25T22:40:52.001 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:40:52.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.001 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:52.001 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700278+0000", 2024-04-25T22:40:52.001 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-04-25T22:40:52.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.001 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:52.001 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700323+0000", 2024-04-25T22:40:52.002 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4212999999999998e-05 2024-04-25T22:40:52.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.002 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.002 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700333+0000", 2024-04-25T22:40:52.002 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0433e-05 2024-04-25T22:40:52.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.002 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:52.002 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700662+0000", 2024-04-25T22:40:52.002 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032862800000000003 2024-04-25T22:40:52.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.003 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:52.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700692+0000", 2024-04-25T22:40:52.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0395999999999998e-05 2024-04-25T22:40:52.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.003 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:52.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705728+0000", 2024-04-25T22:40:52.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050361939999999999 2024-04-25T22:40:52.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.003 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:52.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705818+0000", 2024-04-25T22:40:52.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9573000000000005e-05 2024-04-25T22:40:52.003 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.004 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.004 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.004 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-25T22:40:52.004 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:40:52.004 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 47.298756249999997, 2024-04-25T22:40:52.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005065501, 2024-04-25T22:40:52.004 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:52.004 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:52.004 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.004 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:52.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.004 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:52.005 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:40:52.005 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.005 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:52.005 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:40:52.005 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.005 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:52.005 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700816+0000", 2024-04-25T22:40:52.005 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.24e-06 2024-04-25T22:40:52.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.006 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:52.006 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700914+0000", 2024-04-25T22:40:52.006 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8057e-05 2024-04-25T22:40:52.006 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.006 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.006 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:52.006 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700931+0000", 2024-04-25T22:40:52.006 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7745999999999999e-05 2024-04-25T22:40:52.006 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.006 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.006 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.006 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700941+0000", 2024-04-25T22:40:52.006 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5699999999999999e-06 2024-04-25T22:40:52.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.007 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:52.007 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701162+0000", 2024-04-25T22:40:52.007 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000221392 2024-04-25T22:40:52.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.007 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:52.007 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701194+0000", 2024-04-25T22:40:52.007 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1745999999999997e-05 2024-04-25T22:40:52.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.007 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:52.007 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705821+0000", 2024-04-25T22:40:52.007 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046269869999999999 2024-04-25T22:40:52.008 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.008 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.008 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:52.008 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705880+0000", 2024-04-25T22:40:52.008 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8763e-05 2024-04-25T22:40:52.008 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.008 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.008 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.008 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.008 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.008 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:118 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'80, mlcod=11'78)", 2024-04-25T22:40:52.008 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:40:52.008 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 47.291400639999999, 2024-04-25T22:40:52.008 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047806089999999999, 2024-04-25T22:40:52.009 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:52.009 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:52.009 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.009 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:52.009 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.009 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:52.009 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:40:52.009 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.009 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.009 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.009 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:52.009 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:40:52.009 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.009 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.010 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.010 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:52.010 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708172+0000", 2024-04-25T22:40:52.010 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0600000000000002e-06 2024-04-25T22:40:52.010 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.010 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.010 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:52.010 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708291+0000", 2024-04-25T22:40:52.010 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118892 2024-04-25T22:40:52.010 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.010 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.010 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:52.010 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708320+0000", 2024-04-25T22:40:52.010 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8822999999999998e-05 2024-04-25T22:40:52.011 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.011 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.011 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.011 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708337+0000", 2024-04-25T22:40:52.011 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7586999999999999e-05 2024-04-25T22:40:52.011 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.011 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.011 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:52.011 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708512+0000", 2024-04-25T22:40:52.011 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017439500000000001 2024-04-25T22:40:52.011 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.011 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.011 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:52.011 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708551+0000", 2024-04-25T22:40:52.011 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.909e-05 2024-04-25T22:40:52.012 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.012 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.012 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:52.012 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712865+0000", 2024-04-25T22:40:52.012 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043142069999999996 2024-04-25T22:40:52.012 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.012 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.012 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:52.012 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712951+0000", 2024-04-25T22:40:52.012 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5555000000000003e-05 2024-04-25T22:40:52.012 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.012 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.012 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.012 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.012 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.013 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:120 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'82, mlcod=11'78)", 2024-04-25T22:40:52.013 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:40:52.013 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 47.290394597999999, 2024-04-25T22:40:52.013 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047170700000000003, 2024-04-25T22:40:52.013 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:52.013 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:52.013 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.013 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:52.013 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.013 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:52.013 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:40:52.013 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.013 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.013 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.014 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:52.014 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:40:52.014 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.014 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.014 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.014 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:52.014 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709177+0000", 2024-04-25T22:40:52.014 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.19e-06 2024-04-25T22:40:52.014 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.014 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.014 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:52.014 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709315+0000", 2024-04-25T22:40:52.014 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000137429 2024-04-25T22:40:52.014 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.015 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.015 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:52.015 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709341+0000", 2024-04-25T22:40:52.015 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:40:52.015 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.015 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.015 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.015 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709353+0000", 2024-04-25T22:40:52.015 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2027e-05 2024-04-25T22:40:52.015 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.015 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.015 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:52.015 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710040+0000", 2024-04-25T22:40:52.015 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068710799999999997 2024-04-25T22:40:52.015 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.016 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.016 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:52.016 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710076+0000", 2024-04-25T22:40:52.016 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5982999999999998e-05 2024-04-25T22:40:52.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.016 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.016 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:52.016 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713802+0000", 2024-04-25T22:40:52.016 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037255750000000001 2024-04-25T22:40:52.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.016 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.016 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:52.016 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713893+0000", 2024-04-25T22:40:52.016 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1201999999999999e-05 2024-04-25T22:40:52.017 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.017 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.017 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.017 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.017 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:121 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'83, mlcod=11'78)", 2024-04-25T22:40:52.017 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:40:52.017 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 47.289847962000003, 2024-04-25T22:40:52.017 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0049043919999999996, 2024-04-25T22:40:52.017 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:52.017 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:52.017 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.017 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:52.018 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.018 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:52.018 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:40:52.018 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.018 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.018 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.018 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:52.018 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:40:52.018 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.018 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.018 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.018 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:52.018 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709724+0000", 2024-04-25T22:40:52.019 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.483e-06 2024-04-25T22:40:52.019 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.019 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.019 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:52.019 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709872+0000", 2024-04-25T22:40:52.019 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147446 2024-04-25T22:40:52.019 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.019 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.019 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:52.019 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709891+0000", 2024-04-25T22:40:52.019 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9245999999999998e-05 2024-04-25T22:40:52.019 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.019 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.019 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.020 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709900+0000", 2024-04-25T22:40:52.020 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1439999999999992e-06 2024-04-25T22:40:52.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.020 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.020 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:52.020 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713091+0000", 2024-04-25T22:40:52.020 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031910710000000002 2024-04-25T22:40:52.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.020 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.020 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:52.020 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713122+0000", 2024-04-25T22:40:52.020 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.048e-05 2024-04-25T22:40:52.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.020 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.021 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:52.021 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714538+0000", 2024-04-25T22:40:52.021 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014160030000000001 2024-04-25T22:40:52.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.021 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.021 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:52.021 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714627+0000", 2024-04-25T22:40:52.021 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518999999999995e-05 2024-04-25T22:40:52.021 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.021 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.021 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.021 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.021 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:52.021 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:40:52.022 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.399458582000001, 2024-04-25T22:40:52.022 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022089675999999999, 2024-04-25T22:40:52.022 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:52.022 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:52.022 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.022 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:52.022 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.022 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:52.022 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:40:52.022 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.022 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.022 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.022 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:52.022 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:40:52.023 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.023 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.023 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:52.023 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600120+0000", 2024-04-25T22:40:52.023 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1259999999999998e-06 2024-04-25T22:40:52.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.023 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.023 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:52.023 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600153+0000", 2024-04-25T22:40:52.023 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3186999999999999e-05 2024-04-25T22:40:52.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.023 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.023 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:52.024 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600181+0000", 2024-04-25T22:40:52.024 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7676000000000001e-05 2024-04-25T22:40:52.024 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.024 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.024 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.024 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600205+0000", 2024-04-25T22:40:52.024 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:40:52.024 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.024 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.024 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:52.024 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600467+0000", 2024-04-25T22:40:52.024 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026186800000000001 2024-04-25T22:40:52.024 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.024 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.024 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:52.025 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600809+0000", 2024-04-25T22:40:52.025 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034138400000000002 2024-04-25T22:40:52.025 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.025 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.025 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:52.025 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.601892+0000", 2024-04-25T22:40:52.025 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010831910000000001 2024-04-25T22:40:52.025 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.025 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.025 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:52.025 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611054+0000", 2024-04-25T22:40:52.025 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0091620940000000008 2024-04-25T22:40:52.025 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.025 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.025 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:52.026 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621965+0000", 2024-04-25T22:40:52.026 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010911044999999999 2024-04-25T22:40:52.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.026 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.026 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:52.026 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622090+0000", 2024-04-25T22:40:52.026 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012522 2024-04-25T22:40:52.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.026 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.026 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:52.026 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622202+0000", 2024-04-25T22:40:52.026 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011164500000000001 2024-04-25T22:40:52.026 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.026 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.026 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.027 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.027 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.027 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:52.027 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:40:52.027 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.399315526999999, 2024-04-25T22:40:52.027 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035756228000000001, 2024-04-25T22:40:52.027 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:52.027 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:52.027 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.027 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:52.027 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.027 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:52.027 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:40:52.027 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.028 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:52.028 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:40:52.028 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.028 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:52.028 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600257+0000", 2024-04-25T22:40:52.028 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8300000000000001e-06 2024-04-25T22:40:52.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.028 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:52.028 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600267+0000", 2024-04-25T22:40:52.028 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6539999999999994e-06 2024-04-25T22:40:52.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.029 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.029 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:52.029 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600293+0000", 2024-04-25T22:40:52.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5996e-05 2024-04-25T22:40:52.029 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.029 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.029 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.029 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600309+0000", 2024-04-25T22:40:52.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6206e-05 2024-04-25T22:40:52.029 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.029 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.029 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:52.029 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603757+0000", 2024-04-25T22:40:52.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003448244 2024-04-25T22:40:52.029 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.030 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:52.030 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604779+0000", 2024-04-25T22:40:52.030 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010216820000000001 2024-04-25T22:40:52.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.030 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:52.030 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605127+0000", 2024-04-25T22:40:52.030 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034820100000000002 2024-04-25T22:40:52.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.030 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:52.030 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611082+0000", 2024-04-25T22:40:52.030 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0059550640000000004 2024-04-25T22:40:52.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:52.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635779+0000", 2024-04-25T22:40:52.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024696665999999999 2024-04-25T22:40:52.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:52.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635915+0000", 2024-04-25T22:40:52.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000135809 2024-04-25T22:40:52.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:52.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636011+0000", 2024-04-25T22:40:52.032 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6875999999999999e-05 2024-04-25T22:40:52.032 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.032 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.032 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.032 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.032 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:52.032 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:40:52.032 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.399238314000002, 2024-04-25T22:40:52.032 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035327031000000002, 2024-04-25T22:40:52.032 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:52.032 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:52.032 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.032 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:52.032 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.033 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:52.033 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:40:52.033 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.033 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:52.033 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:40:52.033 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.033 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:52.033 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600334+0000", 2024-04-25T22:40:52.033 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:40:52.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.034 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.034 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:52.034 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600347+0000", 2024-04-25T22:40:52.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3593e-05 2024-04-25T22:40:52.034 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.034 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.034 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:52.034 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600371+0000", 2024-04-25T22:40:52.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.313e-05 2024-04-25T22:40:52.034 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.034 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.034 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.034 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600390+0000", 2024-04-25T22:40:52.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.908e-05 2024-04-25T22:40:52.034 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.035 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:52.035 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602756+0000", 2024-04-25T22:40:52.035 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023662560000000002 2024-04-25T22:40:52.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.035 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:52.035 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603021+0000", 2024-04-25T22:40:52.035 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026546399999999998 2024-04-25T22:40:52.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.035 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:52.035 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603304+0000", 2024-04-25T22:40:52.035 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028308800000000002 2024-04-25T22:40:52.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:52.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611075+0000", 2024-04-25T22:40:52.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077703900000000003 2024-04-25T22:40:52.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:52.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635414+0000", 2024-04-25T22:40:52.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024339326000000001 2024-04-25T22:40:52.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:52.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635544+0000", 2024-04-25T22:40:52.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012948199999999999 2024-04-25T22:40:52.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:52.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635659+0000", 2024-04-25T22:40:52.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000115809 2024-04-25T22:40:52.037 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.037 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.037 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.037 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:52.037 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:40:52.037 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.399078389000003, 2024-04-25T22:40:52.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035594492999999998, 2024-04-25T22:40:52.037 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:52.038 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:52.038 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.038 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:52.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:52.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:40:52.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:52.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:40:52.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.039 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:52.039 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600494+0000", 2024-04-25T22:40:52.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:40:52.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.039 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:52.039 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600502+0000", 2024-04-25T22:40:52.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3769999999999996e-06 2024-04-25T22:40:52.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.039 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:52.039 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600522+0000", 2024-04-25T22:40:52.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9919999999999999e-05 2024-04-25T22:40:52.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.040 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.040 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600539+0000", 2024-04-25T22:40:52.040 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.649e-05 2024-04-25T22:40:52.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.040 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:52.040 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604846+0000", 2024-04-25T22:40:52.040 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043075199999999996 2024-04-25T22:40:52.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.040 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:52.040 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605057+0000", 2024-04-25T22:40:52.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00021085200000000001 2024-04-25T22:40:52.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:52.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605378+0000", 2024-04-25T22:40:52.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032074799999999999 2024-04-25T22:40:52.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:52.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611089+0000", 2024-04-25T22:40:52.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057110249999999998 2024-04-25T22:40:52.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:52.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635844+0000", 2024-04-25T22:40:52.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024755355999999999 2024-04-25T22:40:52.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:52.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635986+0000", 2024-04-25T22:40:52.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141512 2024-04-25T22:40:52.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:52.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636087+0000", 2024-04-25T22:40:52.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101183 2024-04-25T22:40:52.042 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.043 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.043 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.043 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:52.043 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:40:52.043 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.399005778999999, 2024-04-25T22:40:52.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021266723000000001, 2024-04-25T22:40:52.043 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:52.043 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:52.043 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.043 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:52.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:52.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:40:52.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:52.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:40:52.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:52.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600566+0000", 2024-04-25T22:40:52.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4959999999999999e-06 2024-04-25T22:40:52.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:52.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600574+0000", 2024-04-25T22:40:52.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-06 2024-04-25T22:40:52.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:52.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600592+0000", 2024-04-25T22:40:52.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8479999999999999e-05 2024-04-25T22:40:52.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600610+0000", 2024-04-25T22:40:52.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7567e-05 2024-04-25T22:40:52.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:52.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602679+0000", 2024-04-25T22:40:52.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020692739999999999 2024-04-25T22:40:52.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:52.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602945+0000", 2024-04-25T22:40:52.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026640399999999998 2024-04-25T22:40:52.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:52.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603115+0000", 2024-04-25T22:40:52.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000169996 2024-04-25T22:40:52.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:52.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608398+0000", 2024-04-25T22:40:52.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052826289999999996 2024-04-25T22:40:52.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:52.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621588+0000", 2024-04-25T22:40:52.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013190489 2024-04-25T22:40:52.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:52.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621733+0000", 2024-04-25T22:40:52.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014462500000000001 2024-04-25T22:40:52.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.048 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:52.048 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621832+0000", 2024-04-25T22:40:52.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8603000000000004e-05 2024-04-25T22:40:52.048 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.048 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.048 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.048 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:52.048 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:40:52.048 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.398938053000002, 2024-04-25T22:40:52.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034747924999999999, 2024-04-25T22:40:52.048 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:52.048 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:52.049 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.049 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:52.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:52.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:40:52.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:52.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:40:52.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:52.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600634+0000", 2024-04-25T22:40:52.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-04-25T22:40:52.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:52.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600642+0000", 2024-04-25T22:40:52.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8169999999999999e-06 2024-04-25T22:40:52.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:52.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600660+0000", 2024-04-25T22:40:52.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8513e-05 2024-04-25T22:40:52.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600676+0000", 2024-04-25T22:40:52.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6019999999999999e-05 2024-04-25T22:40:52.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:52.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603748+0000", 2024-04-25T22:40:52.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030718329999999999 2024-04-25T22:40:52.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:52.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604752+0000", 2024-04-25T22:40:52.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001003603 2024-04-25T22:40:52.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:52.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605117+0000", 2024-04-25T22:40:52.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00036539 2024-04-25T22:40:52.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:52.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608459+0000", 2024-04-25T22:40:52.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033413879999999998 2024-04-25T22:40:52.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:52.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635106+0000", 2024-04-25T22:40:52.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026647607 2024-04-25T22:40:52.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.053 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:52.053 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635273+0000", 2024-04-25T22:40:52.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000166689 2024-04-25T22:40:52.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.053 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:52.053 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635381+0000", 2024-04-25T22:40:52.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107642 2024-04-25T22:40:52.053 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.053 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.053 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.053 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:52.053 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:40:52.054 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.398874824000004, 2024-04-25T22:40:52.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040419292000000002, 2024-04-25T22:40:52.054 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:52.054 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:52.054 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.054 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:52.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.054 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:52.054 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:40:52.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.054 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:52.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:40:52.055 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.055 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:52.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600697+0000", 2024-04-25T22:40:52.055 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1999999999999999e-06 2024-04-25T22:40:52.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.055 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:52.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600704+0000", 2024-04-25T22:40:52.055 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5570000000000001e-06 2024-04-25T22:40:52.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:52.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600724+0000", 2024-04-25T22:40:52.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0023000000000001e-05 2024-04-25T22:40:52.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600738+0000", 2024-04-25T22:40:52.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4372999999999999e-05 2024-04-25T22:40:52.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:52.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.612532+0000", 2024-04-25T22:40:52.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011793606 2024-04-25T22:40:52.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.057 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:52.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613354+0000", 2024-04-25T22:40:52.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00082244100000000004 2024-04-25T22:40:52.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.057 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:52.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613726+0000", 2024-04-25T22:40:52.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00037226000000000002 2024-04-25T22:40:52.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.057 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:52.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618891+0000", 2024-04-25T22:40:52.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051649199999999999 2024-04-25T22:40:52.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.058 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:52.058 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.640874+0000", 2024-04-25T22:40:52.058 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021982640000000001 2024-04-25T22:40:52.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.058 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:52.058 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641019+0000", 2024-04-25T22:40:52.058 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000145339 2024-04-25T22:40:52.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.058 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641115+0000", 2024-04-25T22:40:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5933000000000005e-05 2024-04-25T22:40:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:40:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.398788793999998, 2024-04-25T22:40:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036502711, 2024-04-25T22:40:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:52.059 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:40:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:40:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:40:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600783+0000", 2024-04-25T22:40:52.060 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.533e-06 2024-04-25T22:40:52.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.061 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:52.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600790+0000", 2024-04-25T22:40:52.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0439999999999998e-06 2024-04-25T22:40:52.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.061 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:52.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600811+0000", 2024-04-25T22:40:52.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0449e-05 2024-04-25T22:40:52.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.061 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600825+0000", 2024-04-25T22:40:52.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4293e-05 2024-04-25T22:40:52.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:52.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602304+0000", 2024-04-25T22:40:52.062 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001478629 2024-04-25T22:40:52.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:52.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602587+0000", 2024-04-25T22:40:52.062 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028350800000000002 2024-04-25T22:40:52.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:52.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.637285+0000", 2024-04-25T22:40:52.062 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034697255000000003 2024-04-25T22:40:52.063 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.063 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.063 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.063 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:52.063 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:40:52.063 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.398723228000001, 2024-04-25T22:40:52.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017311460000000001, 2024-04-25T22:40:52.063 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:52.063 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:52.063 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:40:52.063 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:52.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:52.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:40:52.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:52.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:40:52.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:52.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600849+0000", 2024-04-25T22:40:52.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2899999999999999e-06 2024-04-25T22:40:52.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.065 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:52.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600866+0000", 2024-04-25T22:40:52.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6793e-05 2024-04-25T22:40:52.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.065 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:52.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600886+0000", 2024-04-25T22:40:52.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0772999999999999e-05 2024-04-25T22:40:52.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.065 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600904+0000", 2024-04-25T22:40:52.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7697e-05 2024-04-25T22:40:52.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:52.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602796+0000", 2024-04-25T22:40:52.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018920149999999999 2024-04-25T22:40:52.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:52.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602962+0000", 2024-04-25T22:40:52.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016590600000000001 2024-04-25T22:40:52.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:52.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618159+0000", 2024-04-25T22:40:52.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015196985999999999 2024-04-25T22:40:52.067 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.067 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.067 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.067 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:52.067 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:40:52.067 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.383847486999997, 2024-04-25T22:40:52.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006380269, 2024-04-25T22:40:52.067 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:52.067 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:52.067 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.067 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:52.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:52.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:40:52.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:52.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:40:52.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:52.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615724+0000", 2024-04-25T22:40:52.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.094e-06 2024-04-25T22:40:52.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.069 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:52.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615734+0000", 2024-04-25T22:40:52.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.363e-06 2024-04-25T22:40:52.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.069 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:52.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615751+0000", 2024-04-25T22:40:52.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:40:52.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615773+0000", 2024-04-25T22:40:52.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.154e-05 2024-04-25T22:40:52.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:52.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616485+0000", 2024-04-25T22:40:52.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00071225100000000001 2024-04-25T22:40:52.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:52.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616528+0000", 2024-04-25T22:40:52.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3606000000000002e-05 2024-04-25T22:40:52.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:52.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622030+0000", 2024-04-25T22:40:52.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055010750000000002 2024-04-25T22:40:52.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:52.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622103+0000", 2024-04-25T22:40:52.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3930000000000005e-05 2024-04-25T22:40:52.071 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.071 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.071 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.072 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:40:52.072 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:40:52.072 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.382934550000002, 2024-04-25T22:40:52.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046420649999999999, 2024-04-25T22:40:52.072 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:52.072 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:52.072 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-04-25T22:40:52.072 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:52.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:52.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:40:52.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:52.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:40:52.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:52.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616637+0000", 2024-04-25T22:40:52.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0299999999999998e-07 2024-04-25T22:40:52.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:52.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616653+0000", 2024-04-25T22:40:52.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5843000000000001e-05 2024-04-25T22:40:52.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:52.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616690+0000", 2024-04-25T22:40:52.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7466999999999999e-05 2024-04-25T22:40:52.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616729+0000", 2024-04-25T22:40:52.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8810000000000003e-05 2024-04-25T22:40:52.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:52.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617251+0000", 2024-04-25T22:40:52.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00052143899999999995 2024-04-25T22:40:52.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:52.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621278+0000", 2024-04-25T22:40:52.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040277029999999997 2024-04-25T22:40:52.075 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.075 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.075 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.075 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:52.075 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:40:52.075 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.381911197999997, 2024-04-25T22:40:52.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0065101730000000002, 2024-04-25T22:40:52.076 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:52.076 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:52.076 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.076 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:52.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:52.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:40:52.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:52.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:40:52.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:52.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617661+0000", 2024-04-25T22:40:52.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:40:52.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:52.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617688+0000", 2024-04-25T22:40:52.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7589e-05 2024-04-25T22:40:52.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:52.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617710+0000", 2024-04-25T22:40:52.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1467e-05 2024-04-25T22:40:52.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617727+0000", 2024-04-25T22:40:52.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6990000000000002e-05 2024-04-25T22:40:52.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:52.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618559+0000", 2024-04-25T22:40:52.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083207400000000003 2024-04-25T22:40:52.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:52.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618608+0000", 2024-04-25T22:40:52.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8936e-05 2024-04-25T22:40:52.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:52.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624077+0000", 2024-04-25T22:40:52.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054695840000000004 2024-04-25T22:40:52.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:52.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624170+0000", 2024-04-25T22:40:52.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2305999999999993e-05 2024-04-25T22:40:52.079 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.079 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.080 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.080 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:52.080 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:40:52.080 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.376809690000002, 2024-04-25T22:40:52.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006879446, 2024-04-25T22:40:52.080 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:52.080 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:52.080 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.080 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:52.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:52.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:40:52.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:52.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:40:52.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:52.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622762+0000", 2024-04-25T22:40:52.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:40:52.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:52.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622781+0000", 2024-04-25T22:40:52.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8749999999999998e-05 2024-04-25T22:40:52.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:52.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622802+0000", 2024-04-25T22:40:52.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1650000000000001e-05 2024-04-25T22:40:52.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622816+0000", 2024-04-25T22:40:52.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3556e-05 2024-04-25T22:40:52.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:52.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623700+0000", 2024-04-25T22:40:52.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00088389299999999996 2024-04-25T22:40:52.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:52.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623741+0000", 2024-04-25T22:40:52.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1023999999999999e-05 2024-04-25T22:40:52.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:52.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629543+0000", 2024-04-25T22:40:52.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058023980000000003 2024-04-25T22:40:52.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:52.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629640+0000", 2024-04-25T22:40:52.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7381999999999997e-05 2024-04-25T22:40:52.084 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.084 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.084 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.084 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:52.084 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:40:52.084 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.376548485999997, 2024-04-25T22:40:52.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067054879999999999, 2024-04-25T22:40:52.084 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:52.084 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:52.085 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.085 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:52.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:52.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:40:52.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:52.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:40:52.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:52.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623032+0000", 2024-04-25T22:40:52.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.9930000000000007e-06 2024-04-25T22:40:52.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:52.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623043+0000", 2024-04-25T22:40:52.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0387000000000001e-05 2024-04-25T22:40:52.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:52.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623064+0000", 2024-04-25T22:40:52.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1849999999999999e-05 2024-04-25T22:40:52.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623079+0000", 2024-04-25T22:40:52.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4093e-05 2024-04-25T22:40:52.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:52.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624384+0000", 2024-04-25T22:40:52.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013054539999999999 2024-04-25T22:40:52.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:52.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624421+0000", 2024-04-25T22:40:52.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7088999999999997e-05 2024-04-25T22:40:52.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:52.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629645+0000", 2024-04-25T22:40:52.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052241400000000004 2024-04-25T22:40:52.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:52.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629728+0000", 2024-04-25T22:40:52.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2482000000000001e-05 2024-04-25T22:40:52.088 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.088 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.088 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.088 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2024-04-25T22:40:52.088 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:40:52.089 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.376465373000002, 2024-04-25T22:40:52.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078029559999999998, 2024-04-25T22:40:52.089 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:52.089 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:52.089 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.089 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:52.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:52.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:40:52.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:52.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:40:52.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:52.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:52.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623106+0000", 2024-04-25T22:40:52.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.64e-07 2024-04-25T22:40:52.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:52.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623141+0000", 2024-04-25T22:40:52.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4678999999999998e-05 2024-04-25T22:40:52.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:52.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623153+0000", 2024-04-25T22:40:52.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1759999999999999e-05 2024-04-25T22:40:52.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623161+0000", 2024-04-25T22:40:52.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8299999999999996e-06 2024-04-25T22:40:52.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:52.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623834+0000", 2024-04-25T22:40:52.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067394500000000001 2024-04-25T22:40:52.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:52.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623883+0000", 2024-04-25T22:40:52.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8640000000000002e-05 2024-04-25T22:40:52.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:52.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630807+0000", 2024-04-25T22:40:52.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069238859999999998 2024-04-25T22:40:52.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:52.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:52.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:52.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630908+0000", 2024-04-25T22:40:52.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101252 2024-04-25T22:40:52.092 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.092 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.092 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.092 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:52.093 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:52.093 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:40:52.094 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:40:52.095 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:52.095+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:52.195 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:52.195+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:52.224 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:52.224 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:52.224 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:40:52.224 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:52.239 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:40:52.297 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:52.296+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:52.363 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:52.364 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:52.364 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:40:52.364 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:40:52.364 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:52.377 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:40:52.397 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:52.396+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:52.497 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:52.498 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:40:52.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:40:52.498 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:40:52.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.498 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:52.498 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:52.498 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.900294979000002, 2024-04-25T22:40:52.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:40:52.498 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:52.498 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:52.498 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.499 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:52.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:52.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:52.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:52.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:52.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:52.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:40:52.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:40:52.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.500 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:52.500 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:40:52.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:40:52.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.500 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:52.500 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:40:52.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:40:52.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.500 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:40:52.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:40:52.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:40:52.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:40:52.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:52.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:40:52.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:40:52.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:40:52.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:40:52.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:52.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:40:52.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:40:52.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:52.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:40:52.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:40:52.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:52.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:40:52.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:40:52.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:52.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:40:52.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:40:52.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:52.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:40:52.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:40:52.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:52.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:40:52.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:40:52.504 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.504 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.504 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.504 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:52.504 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:52.504 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.900157723, 2024-04-25T22:40:52.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:40:52.504 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:52.504 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:52.505 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.505 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:52.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.505 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:52.505 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:52.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.505 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:52.505 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:52.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:52.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:40:52.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:40:52.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:52.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:40:52.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:40:52.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:52.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:40:52.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:40:52.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:40:52.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:40:52.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:40:52.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:40:52.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:52.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:40:52.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:40:52.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:40:52.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:40:52.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:52.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:40:52.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:40:52.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:52.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:40:52.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:40:52.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:52.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:40:52.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:40:52.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:52.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:40:52.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:40:52.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:52.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:40:52.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:40:52.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:52.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:40:52.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:40:52.510 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.510 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.510 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.510 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:52.510 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:52.510 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.900070171000003, 2024-04-25T22:40:52.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:40:52.511 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:52.511 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:52.511 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.511 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:52.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:52.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:52.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:52.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:52.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:52.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:40:52.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:40:52.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:52.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:40:52.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:40:52.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:52.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:40:52.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:40:52.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:40:52.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:40:52.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:40:52.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:40:52.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:52.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:40:52.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:40:52.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:40:52.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:40:52.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:52.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:40:52.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:40:52.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:52.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:40:52.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:40:52.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:52.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:40:52.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:40:52.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:52.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:40:52.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:40:52.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:52.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:40:52.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:40:52.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:52.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:40:52.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:40:52.516 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.516 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.516 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.516 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:52.516 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:52.516 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.899966345000003, 2024-04-25T22:40:52.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:40:52.517 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:52.517 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:52.517 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.517 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:52.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:52.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:52.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:52.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:52.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:52.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:40:52.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:40:52.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:52.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:40:52.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:40:52.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:52.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:40:52.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:40:52.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:40:52.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:40:52.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:40:52.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:40:52.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:52.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:40:52.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:40:52.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:40:52.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:40:52.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:52.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:40:52.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:40:52.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:52.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:40:52.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:40:52.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:52.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:40:52.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:40:52.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:52.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:40:52.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:40:52.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:52.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:40:52.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:40:52.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:52.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:40:52.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:40:52.522 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.522 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.522 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.522 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:52.523 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:52.523 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.899897555000003, 2024-04-25T22:40:52.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:40:52.523 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:52.523 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:52.523 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.523 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:52.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:52.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:52.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:52.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:52.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:52.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:40:52.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:40:52.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:52.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:40:52.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:40:52.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:52.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:40:52.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:40:52.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:40:52.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:40:52.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:40:52.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:40:52.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:52.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:40:52.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:40:52.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:40:52.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:40:52.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:52.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:40:52.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:40:52.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:52.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:40:52.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:40:52.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:52.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:40:52.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:40:52.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:52.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:40:52.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:40:52.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:52.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:40:52.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:40:52.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:52.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:40:52.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:40:52.528 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.528 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.528 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.529 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:52.529 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:52.529 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.899828468999999, 2024-04-25T22:40:52.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:40:52.529 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:52.529 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:52.529 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.529 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:52.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:52.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:52.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:52.530 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:52.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.530 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:52.530 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:40:52.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:40:52.530 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:52.530 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:40:52.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:40:52.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:52.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:40:52.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:40:52.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:40:52.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:40:52.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:40:52.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:40:52.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:52.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:40:52.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:40:52.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:40:52.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:40:52.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:52.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:40:52.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:40:52.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:52.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:40:52.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:40:52.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:52.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:40:52.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:40:52.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:52.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:40:52.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:40:52.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:52.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:40:52.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:40:52.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:52.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:40:52.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:40:52.534 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.535 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.535 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.535 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:52.535 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:52.535 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.899732356000001, 2024-04-25T22:40:52.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:40:52.535 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:52.535 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:52.535 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:52.535 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:52.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:52.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:52.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:52.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:52.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:52.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:40:52.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:40:52.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:52.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:40:52.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:40:52.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:52.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:40:52.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:40:52.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:40:52.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:40:52.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:40:52.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:40:52.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:52.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:40:52.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:40:52.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:40:52.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:40:52.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:52.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:40:52.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:40:52.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:52.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:40:52.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:40:52.539 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.539 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.540 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.540 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:52.540 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:52.540 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.899666693999997, 2024-04-25T22:40:52.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:40:52.540 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:52.540 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:52.540 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:52.540 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:52.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:52.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:52.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:52.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:52.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:52.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:40:52.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:40:52.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:52.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:40:52.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:40:52.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:52.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:40:52.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:40:52.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:40:52.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:40:52.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:40:52.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:40:52.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:52.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:40:52.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:40:52.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:40:52.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:40:52.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:52.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:40:52.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:40:52.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:52.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:40:52.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:40:52.544 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.544 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.544 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.545 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:52.545 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:52.545 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.899597567000001, 2024-04-25T22:40:52.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:40:52.545 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:52.545 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:52.545 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:52.545 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:52.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:52.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:52.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:52.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:52.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:52.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:40:52.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:40:52.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:52.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:40:52.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:40:52.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:52.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:40:52.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:40:52.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:40:52.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:40:52.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:40:52.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:40:52.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:52.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:40:52.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:40:52.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:40:52.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:40:52.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:52.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:40:52.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:40:52.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:52.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:40:52.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:40:52.549 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.549 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.549 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.549 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:40:52.549 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:52.549 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.888780910999998, 2024-04-25T22:40:52.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:40:52.550 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:52.550 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:52.550 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:52.550 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:52.550 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.550 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:52.550 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:52.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.550 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.550 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.550 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:52.550 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:52.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.550 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:52.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:40:52.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:40:52.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:52.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:40:52.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:40:52.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:52.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:40:52.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:40:52.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:40:52.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:40:52.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:40:52.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:40:52.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:52.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:40:52.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:40:52.553 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.553 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.553 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.553 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:52.553 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:52.553 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.871882558000003, 2024-04-25T22:40:52.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:40:52.553 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:52.553 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:52.553 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:52.553 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:52.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:52.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:52.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:52.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:52.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:52.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:52.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:40:52.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:52.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:40:52.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:40:52.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:52.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:40:52.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:40:52.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:40:52.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:40:52.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:40:52.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:40:52.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:52.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:40:52.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:40:52.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:52.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:40:52.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:40:52.556 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.557 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.557 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.557 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:52.557 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:52.557 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.871061668000003, 2024-04-25T22:40:52.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:40:52.557 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:52.557 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:52.557 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:52.557 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:52.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:52.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:52.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:52.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:52.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:52.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:40:52.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:40:52.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:52.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:40:52.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:40:52.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:52.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:40:52.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:40:52.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:40:52.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:40:52.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:40:52.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:40:52.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:52.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:40:52.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:40:52.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:52.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:40:52.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:40:52.560 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.560 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.560 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.561 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:52.561 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:52.561 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.86936094, 2024-04-25T22:40:52.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:40:52.561 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:52.561 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:52.561 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.561 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:52.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:52.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:52.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:52.562 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:52.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:52.562 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:40:52.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:40:52.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:52.562 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:40:52.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:40:52.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:52.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:40:52.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:40:52.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:40:52.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:40:52.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:40:52.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:40:52.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:52.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:40:52.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:40:52.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:52.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:40:52.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:40:52.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:52.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:40:52.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:40:52.565 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.565 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.565 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.565 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:52.565 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:52.565 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.868764265000003, 2024-04-25T22:40:52.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:40:52.565 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:52.565 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:52.565 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.565 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:52.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:52.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:52.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:52.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:52.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:52.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:40:52.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:40:52.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:52.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:40:52.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:40:52.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:52.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:40:52.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:40:52.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:40:52.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:40:52.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:40:52.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:40:52.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:52.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:40:52.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:40:52.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:52.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:40:52.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:40:52.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:52.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:40:52.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:40:52.569 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.569 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.569 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.570 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:40:52.570 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:52.570 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.859328539000003, 2024-04-25T22:40:52.570 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:40:52.570 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:52.570 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:52.570 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:52.570 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:52.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.570 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:52.570 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:52.570 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.570 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:52.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:52.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:52.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:52.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:40:52.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:52.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:40:52.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:40:52.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:52.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:40:52.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:40:52.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:40:52.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:40:52.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:40:52.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:40:52.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:52.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:40:52.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:40:52.573 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.573 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.573 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.573 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:52.573 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:52.573 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.858681113000003, 2024-04-25T22:40:52.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:40:52.573 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:52.573 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:52.574 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.574 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:52.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.574 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:52.574 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:52.574 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.574 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.574 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:52.574 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:52.574 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.574 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.574 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:52.574 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:40:52.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:40:52.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:52.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:40:52.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:40:52.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:52.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:40:52.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:40:52.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:40:52.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:40:52.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:40:52.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:40:52.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:52.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:40:52.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:40:52.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:52.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:40:52.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:40:52.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:52.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:40:52.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:40:52.577 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.577 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.577 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.577 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:52.577 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:52.577 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 37.857240294, 2024-04-25T22:40:52.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:40:52.578 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:52.578 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:52.578 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.578 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:52.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:52.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:52.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:52.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:52.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:52.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:40:52.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:40:52.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:52.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:40:52.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:40:52.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:52.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:40:52.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:40:52.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:40:52.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:40:52.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:40:52.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:40:52.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:52.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:40:52.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:40:52.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:52.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:40:52.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:40:52.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:52.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:40:52.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:40:52.581 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.582 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.582 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.582 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:40:52.582 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:52.582 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 35.904801849999998, 2024-04-25T22:40:52.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:40:52.582 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:52.582 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:52.586 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.586 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:52.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.586 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:52.586 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:52.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.586 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.586 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:52.586 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:52.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:52.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:40:52.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:40:52.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:52.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:40:52.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:40:52.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:52.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:40:52.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:40:52.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:40:52.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:40:52.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:40:52.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:40:52.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:52.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:40:52.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:40:52.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:52.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:40:52.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:40:52.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:52.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:40:52.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:40:52.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:52.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:40:52.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:40:52.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:52.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:40:52.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:40:52.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:52.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:40:52.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:40:52.591 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.591 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.591 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.591 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:40:52.591 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:52.591 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 13.902142526, 2024-04-25T22:40:52.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:40:52.591 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:52.591 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:52.591 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.592 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:52.592 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.592 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:52.592 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:52.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.592 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.592 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.592 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:52.592 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:52.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.592 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.592 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.592 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:52.592 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:40:52.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:40:52.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:52.593 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:40:52.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:40:52.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:52.593 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:40:52.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:40:52.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.593 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:40:52.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:40:52.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:40:52.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:40:52.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:52.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:40:52.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:40:52.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:52.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:40:52.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:40:52.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:52.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:40:52.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:40:52.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:52.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:40:52.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:40:52.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:52.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:40:52.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:40:52.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:52.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:40:52.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:40:52.596 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.596 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.596 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.596 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:40:52.596 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:52.596 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 8.9018502749999993, 2024-04-25T22:40:52.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:40:52.596 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:52.597 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:52.597 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:52.597 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:52.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:52.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:52.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:52.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:52.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:52.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:52.598 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:40:52.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:40:52.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:52.598 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:40:52.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:40:52.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:52.598 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:40:52.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:40:52.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:52.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:40:52.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:40:52.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:52.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:40:52.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:40:52.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:52.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:40:52.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:40:52.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:52.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:40:52.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:40:52.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:52.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:40:52.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:40:52.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:52.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:40:52.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:40:52.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:52.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:40:52.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:40:52.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:52.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:52.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:52.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:40:52.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:40:52.601 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.601 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.601 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.601 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:52.602 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:52.602 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:52.602 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:40:52.602 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:40:52.604 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:52.500+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:52.604 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:52.603+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:52.605 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:40:52.705 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:52.703+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:52.734 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:40:52.734 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:40:52.734 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:40:52.734 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:40:52.748 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:40:52.765 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:40:52.765 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:40:52.785 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:40:52.786 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:40:52.805 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:52.805+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:52.806 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:40:52.806 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:40:52.907 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:52.903+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:52.916 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:52.916 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:52.930 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:40:53.007 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:53.007+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:53.097 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:53.097 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:53.108 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:53.107+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:53.111 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:40:53.209 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:53.207+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:53.243 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:53.243 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:53.259 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:40:53.309 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:53.311+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:53.410 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:53.411+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:53.424 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:53.424 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:53.438 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:40:53.526 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:53.527+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:53.561 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is unset 2024-04-25T22:40:53.606 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:53.606 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:53.612 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:53.611+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:53.621 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:40:53.713 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:53.713+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:53.753 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:53.753 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:53.768 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:40:53.815 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:53.815+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:53.916 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:53.915+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:53.932 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:53.932 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:53.946 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:40:54.017 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:54.015+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:54.063 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:54.063 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:54.077 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:40:54.124 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:54.123+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:54.209 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:54.209 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:54.217 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:54.217+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:54.223 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:40:54.318 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:54.319+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:54.390 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:54.390 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:54.405 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:40:54.419 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:54.417+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:54.520 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:54.517+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:54.521 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:54.521 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:54.535 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:40:54.621 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:54.619+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:54.669 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:54.669 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:54.683 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:40:54.721 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:54.721+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:54.822 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:54.823+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:54.824 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:40:54.846 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:54.846 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:54.860 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:40:54.923 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:54.923+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:54.982 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:54.983 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:54.987 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:40:54.987 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:40:54.996 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:40:55.008 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:40:55.008 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:40:55.026 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:40:55.027 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:40:55.038 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:55.039+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:55.126 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:55.125+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:55.128 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:55.128 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:55.128 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:40:55.128 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:55.144 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:40:55.225 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:55.227+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:55.303 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:55.304 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:55.304 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:40:55.304 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:40:55.304 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:55.317 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:40:55.362 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:55.361+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:55.428 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:55.425+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:55.438 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:55.439 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:40:55.439 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:40:55.439 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:40:55.439 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.439 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:55.439 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:55.439 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.839903911, 2024-04-25T22:40:55.439 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:40:55.439 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:55.439 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:55.439 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:55.439 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:55.439 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.440 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:55.440 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:55.440 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.440 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.440 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.440 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:55.440 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:55.440 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.440 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.440 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.440 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:55.440 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:40:55.440 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:40:55.440 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.441 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.441 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:55.441 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:40:55.441 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:40:55.441 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.441 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.441 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:55.441 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:40:55.441 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:40:55.441 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.441 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.441 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.441 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:40:55.441 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:40:55.442 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.442 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.442 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.442 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:40:55.442 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:40:55.442 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.442 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.442 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:55.442 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:40:55.442 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:40:55.442 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.442 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.442 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:40:55.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:40:55.443 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.443 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:55.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:40:55.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:40:55.443 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.443 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:55.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:40:55.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:40:55.443 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:55.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:40:55.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:40:55.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:55.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:40:55.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:40:55.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:55.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:40:55.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:40:55.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:55.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:40:55.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:40:55.445 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.445 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.445 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.445 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:55.445 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:55.445 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.839766654999998, 2024-04-25T22:40:55.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:40:55.445 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:55.446 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:55.446 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:55.446 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:55.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.446 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:55.446 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:55.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.446 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.446 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:55.446 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:55.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.446 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.447 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:55.447 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:40:55.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:40:55.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.447 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.447 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:55.447 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:40:55.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:40:55.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.447 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.447 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:55.447 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:40:55.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:40:55.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.450 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.450 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:40:55.450 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:40:55.450 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.450 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.450 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.450 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:40:55.450 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:40:55.450 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.450 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.450 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:55.450 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:40:55.450 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:40:55.450 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.451 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.451 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.451 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:40:55.451 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:40:55.451 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.451 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.451 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:55.451 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:40:55.451 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:40:55.451 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.451 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.451 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:55.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:40:55.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:40:55.452 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:55.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:40:55.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:40:55.452 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:55.453 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:40:55.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:40:55.453 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.453 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.453 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:55.453 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:40:55.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:40:55.453 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.453 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.453 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:55.453 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:40:55.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:40:55.453 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.454 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.454 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.454 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.454 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.454 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:55.454 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:55.454 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.839679103000002, 2024-04-25T22:40:55.454 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:40:55.454 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:55.454 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:55.454 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:55.454 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:55.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.455 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:55.455 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:55.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.455 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:55.455 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:55.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.455 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:55.455 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:40:55.456 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:40:55.456 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.456 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.456 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:55.456 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:40:55.456 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:40:55.456 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.456 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.456 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:55.456 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:40:55.456 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:40:55.456 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.456 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.456 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:40:55.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:40:55.457 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.457 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.457 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:40:55.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:40:55.457 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.457 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.457 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:55.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:40:55.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:40:55.457 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.458 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.458 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.458 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:40:55.458 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:40:55.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.458 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.458 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:55.458 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:40:55.458 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:40:55.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.459 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.459 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:55.459 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:40:55.459 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:40:55.459 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.459 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.459 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:55.459 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:40:55.459 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:40:55.459 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.459 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.459 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:55.459 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:40:55.460 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:40:55.460 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.460 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.460 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:55.460 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:40:55.460 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:40:55.460 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.460 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.460 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:55.460 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:40:55.460 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:40:55.460 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.461 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.461 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.461 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.461 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.461 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:55.461 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:55.461 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.839575277000002, 2024-04-25T22:40:55.461 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:40:55.461 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:55.461 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:55.461 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:55.461 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:55.461 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.462 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:55.462 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:55.462 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.462 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.462 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.462 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:55.462 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:55.462 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.462 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.463 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:55.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:40:55.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:40:55.463 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.463 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:55.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:40:55.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:40:55.463 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.463 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:55.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:40:55.464 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:40:55.464 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.464 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.464 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.464 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:40:55.464 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:40:55.464 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.464 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.464 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.464 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:40:55.464 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:40:55.464 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.464 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.464 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:55.464 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:40:55.465 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:40:55.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.465 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.465 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.465 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:40:55.465 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:40:55.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.465 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.465 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:55.465 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:40:55.465 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:40:55.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.465 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.465 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:55.466 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:40:55.466 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:40:55.466 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.466 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.466 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:55.466 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:40:55.466 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:40:55.466 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.466 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.466 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:55.466 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:40:55.466 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:40:55.467 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.467 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.467 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:55.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:40:55.467 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:40:55.467 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.467 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.467 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:55.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:40:55.467 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:40:55.467 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.467 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.468 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.468 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.468 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.468 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:55.468 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:55.468 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.839506487000001, 2024-04-25T22:40:55.468 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:40:55.468 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:55.468 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:55.468 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:55.468 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:55.468 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.469 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:55.469 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:55.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.469 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.469 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.469 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:55.469 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:55.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.469 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.469 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.469 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:55.469 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:40:55.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:40:55.470 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.470 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.470 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:55.470 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:40:55.470 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:40:55.470 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.470 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.470 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:55.470 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:40:55.470 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:40:55.470 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.470 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:40:55.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:40:55.471 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:40:55.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:40:55.471 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:55.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:40:55.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:40:55.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.472 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:40:55.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:40:55.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:55.472 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:40:55.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:40:55.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:55.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:40:55.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:40:55.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.473 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:55.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:40:55.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:40:55.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.473 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:55.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:40:55.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:40:55.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.474 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:55.474 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:40:55.474 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:40:55.474 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.474 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:55.474 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:40:55.474 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:40:55.474 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.474 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.474 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.474 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.475 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.475 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:55.475 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:55.475 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.839437400999998, 2024-04-25T22:40:55.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:40:55.475 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:55.475 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:55.475 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:55.475 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:55.475 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.475 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:55.475 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:55.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.475 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.476 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:55.476 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:55.476 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.476 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.476 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:55.476 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:40:55.476 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:40:55.476 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:55.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:40:55.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:40:55.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:55.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:40:55.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:40:55.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:40:55.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:40:55.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.478 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.478 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:40:55.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:40:55.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.478 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:55.478 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:40:55.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:40:55.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:40:55.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:40:55.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:55.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:40:55.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:40:55.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:55.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:40:55.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:40:55.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.480 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.480 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:55.480 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:40:55.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:40:55.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.480 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.480 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:55.480 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:40:55.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:40:55.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.480 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.481 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:55.481 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:40:55.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:40:55.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.481 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.481 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:55.481 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:40:55.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:40:55.481 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.481 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.481 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.482 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.482 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:55.482 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:55.482 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.839341288, 2024-04-25T22:40:55.482 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:40:55.482 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:55.482 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:55.482 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:55.482 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:55.482 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.482 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:55.482 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:55.482 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:55.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:55.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:55.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:40:55.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:40:55.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:55.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:40:55.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:40:55.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.484 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:55.484 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:40:55.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:40:55.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.484 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.484 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:40:55.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:40:55.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.484 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.485 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:40:55.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:40:55.485 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.485 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:55.485 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:40:55.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:40:55.485 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.485 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.485 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:40:55.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:40:55.486 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.486 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.486 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:55.486 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:40:55.486 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:40:55.486 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.486 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.486 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:55.486 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:40:55.486 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:40:55.486 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.486 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.487 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.487 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.487 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:55.487 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:55.487 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.839275626000003, 2024-04-25T22:40:55.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:40:55.487 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:55.487 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:55.487 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:55.487 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:55.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:55.487 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:55.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.488 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:55.488 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:55.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.488 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:55.488 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:40:55.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:40:55.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:55.489 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:40:55.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:40:55.489 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:55.489 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:40:55.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:40:55.489 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:40:55.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:40:55.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:40:55.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:40:55.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:55.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:40:55.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:40:55.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:40:55.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:40:55.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:55.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:40:55.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:40:55.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:55.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:40:55.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:40:55.492 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.492 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.492 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.492 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:55.492 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:55.492 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.839206498999999, 2024-04-25T22:40:55.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:40:55.492 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:55.492 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:55.492 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:55.493 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:55.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.493 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:55.493 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:55.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.493 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.493 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:55.493 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:55.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.493 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.493 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:55.493 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:40:55.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:40:55.494 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.494 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.494 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:55.494 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:40:55.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:40:55.494 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.494 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.494 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:55.494 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:40:55.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:40:55.494 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.494 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.494 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:40:55.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:40:55.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:40:55.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:40:55.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:55.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:40:55.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:40:55.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:40:55.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:40:55.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:55.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:40:55.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:40:55.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:55.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:40:55.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:40:55.497 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.497 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.497 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.497 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:40:55.497 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:55.497 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.828389842999997, 2024-04-25T22:40:55.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:40:55.497 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:55.497 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:55.497 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:55.497 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:55.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:55.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:55.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:55.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:55.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:55.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:40:55.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:40:55.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:55.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:40:55.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:40:55.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:55.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:40:55.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:40:55.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.500 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:40:55.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:40:55.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.500 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.500 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:40:55.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:40:55.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.500 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:55.500 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:40:55.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:40:55.501 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.501 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.501 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.501 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:55.501 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:55.501 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.811491490000002, 2024-04-25T22:40:55.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:40:55.501 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:55.501 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:55.501 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:55.502 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:55.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:55.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:55.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:55.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:55.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:55.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:55.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:40:55.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:55.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:40:55.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:40:55.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:55.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:40:55.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:40:55.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:40:55.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:40:55.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:40:55.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:40:55.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:55.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:40:55.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:40:55.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.505 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:55.505 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:40:55.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:40:55.505 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.505 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.505 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.505 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:55.505 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:55.505 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.810670600000002, 2024-04-25T22:40:55.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:40:55.505 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:55.506 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:55.506 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:55.506 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:55.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:55.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:55.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:55.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:55.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:55.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:40:55.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:40:55.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:55.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:40:55.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:40:55.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:55.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:40:55.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:40:55.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:40:55.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:40:55.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:40:55.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:40:55.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:55.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:40:55.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:40:55.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:55.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:40:55.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:40:55.509 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.509 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.509 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.509 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:55.509 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:55.509 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.808969871999999, 2024-04-25T22:40:55.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:40:55.509 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:55.509 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:55.509 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:55.510 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:55.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:55.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:55.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:55.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:55.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:55.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:40:55.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:40:55.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:55.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:40:55.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:40:55.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:55.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:40:55.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:40:55.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:40:55.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:40:55.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:40:55.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:40:55.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:55.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:40:55.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:40:55.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:55.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:40:55.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:40:55.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:55.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:40:55.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:40:55.513 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.513 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.513 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.513 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:55.513 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:55.513 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.808373197000002, 2024-04-25T22:40:55.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:40:55.514 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:55.514 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:55.514 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:55.514 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:55.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:55.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:55.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:55.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:55.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:55.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:40:55.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:40:55.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:55.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:40:55.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:40:55.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:55.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:40:55.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:40:55.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:40:55.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:40:55.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:40:55.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:40:55.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:55.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:40:55.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:40:55.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:55.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:40:55.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:40:55.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:55.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:40:55.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:40:55.517 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.517 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.517 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.518 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:40:55.518 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:55.518 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.798937471000002, 2024-04-25T22:40:55.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:40:55.518 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:55.518 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:55.518 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:55.518 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:55.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:55.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:55.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:55.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:55.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:55.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:55.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:40:55.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:55.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:40:55.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:40:55.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:55.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:40:55.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:40:55.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:40:55.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:40:55.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:40:55.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:40:55.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:55.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:40:55.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:40:55.521 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.521 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.521 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.521 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:55.521 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:55.521 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.798290045000002, 2024-04-25T22:40:55.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:40:55.522 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:55.522 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:55.522 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:55.522 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:55.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:55.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:55.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:55.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:55.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:55.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:40:55.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:40:55.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:55.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:40:55.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:40:55.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:55.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:40:55.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:40:55.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:40:55.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:40:55.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:40:55.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:40:55.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:55.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:40:55.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:40:55.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:55.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:40:55.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:40:55.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:55.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:40:55.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:40:55.525 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.525 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.525 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.525 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:55.525 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:55.526 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.796849225999999, 2024-04-25T22:40:55.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:40:55.526 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:55.526 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:55.526 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:55.526 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:55.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:55.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:55.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:55.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:55.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:55.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:40:55.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:40:55.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:55.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:40:55.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:40:55.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:55.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:40:55.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:40:55.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:40:55.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:40:55.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:40:55.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:40:55.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:55.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:40:55.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:40:55.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:55.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:40:55.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:40:55.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:55.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:40:55.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:40:55.529 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.530 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.530 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.530 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.530 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:40:55.530 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:55.530 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 38.844410781999997, 2024-04-25T22:40:55.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:40:55.530 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:55.530 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:55.530 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:55.530 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:55.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:55.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:55.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:55.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:55.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:55.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:40:55.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:40:55.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:55.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:40:55.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:40:55.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:55.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:40:55.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:40:55.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:40:55.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:40:55.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:40:55.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:40:55.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:55.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:40:55.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:40:55.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:55.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:40:55.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:40:55.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:55.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:40:55.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:40:55.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:55.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:40:55.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:40:55.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:55.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:40:55.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:40:55.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:55.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:40:55.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:40:55.535 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.535 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.535 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.535 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:40:55.535 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:55.535 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 16.841751458000001, 2024-04-25T22:40:55.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:40:55.535 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:55.535 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:55.536 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:55.536 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:55.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:55.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:55.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:55.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:55.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:55.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:40:55.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:40:55.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:55.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:40:55.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:40:55.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:55.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:40:55.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:40:55.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:40:55.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:40:55.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:40:55.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:40:55.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:55.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:40:55.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:40:55.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:55.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:40:55.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:40:55.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:55.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:40:55.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:40:55.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:55.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:40:55.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:40:55.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:55.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:40:55.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:40:55.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:55.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:40:55.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:40:55.540 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.540 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.540 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.540 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:40:55.541 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:55.541 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 11.841459207, 2024-04-25T22:40:55.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:40:55.541 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:55.541 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:55.541 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:55.541 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:55.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:55.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:55.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:55.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:55.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:55.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:55.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:40:55.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:40:55.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:55.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:40:55.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:40:55.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:55.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:40:55.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:40:55.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:40:55.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:40:55.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:55.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:40:55.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:40:55.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:55.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:40:55.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:40:55.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:55.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:40:55.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:40:55.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:55.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:40:55.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:40:55.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:55.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:40:55.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:40:55.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:55.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:40:55.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:40:55.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:55.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:55.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:55.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:40:55.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:40:55.545 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.545 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.545 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.546 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:55.546 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:55.546 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:55.547 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:55.545+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:55.548 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:40:55.584 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:40:55.648 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:55.647+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:55.682 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:40:55.682 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:40:55.683 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:40:55.683 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:40:55.697 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:40:55.749 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:55.745+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:55.820 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:40:55.820 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:40:55.820 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:40:55.821 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:40:55.821 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:40:55.835 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:40:55.850 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:55.847+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:55.950 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:55.949+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:55.961 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:40:55.962 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:40:55.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:40:55.962 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:40:55.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.962 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:55.962 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:40:55.962 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.365956371000003, 2024-04-25T22:40:55.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:40:55.962 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:55.962 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:55.962 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:55.962 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:55.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:55.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:40:55.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:55.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:55.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:40:55.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:55.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:55.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:40:55.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:40:55.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:55.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:40:55.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:40:55.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:55.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:40:55.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:40:55.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:40:55.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:40:55.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:55.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:40:55.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:40:55.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:55.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:40:55.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:40:55.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:55.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:40:55.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:40:55.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:55.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:40:55.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:40:55.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:55.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:40:55.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:40:55.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:55.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:40:55.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:40:55.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:55.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:40:55.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:40:55.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:55.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:40:55.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:40:55.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:55.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:40:55.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:40:55.968 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:55.968 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:55.968 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:55.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.968 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:55.968 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:40:55.968 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.365868358, 2024-04-25T22:40:55.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:40:55.968 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:55.968 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:55.968 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:55.968 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:55.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:55.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:40:55.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:55.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:55.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:40:55.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:55.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:55.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:40:55.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:40:55.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:55.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:40:55.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:40:55.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:55.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:40:55.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:40:55.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:40:55.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:40:55.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:55.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:40:55.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:40:55.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:55.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:55.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:40:55.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:55.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:40:55.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:40:55.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:55.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:40:55.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:40:55.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:55.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:40:55.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:40:55.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:55.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:40:55.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:40:55.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:55.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:40:55.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:40:55.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:55.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:40:55.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:40:55.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:55.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:40:55.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:40:55.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:55.974 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:55.974 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:55.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.974 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:55.974 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:40:55.974 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.365796236000001, 2024-04-25T22:40:55.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:40:55.974 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:55.974 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:55.974 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:55.974 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:55.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:55.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:40:55.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:55.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:55.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:40:55.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:55.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:55.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:40:55.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:40:55.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:55.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:40:55.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:40:55.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:55.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:40:55.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:40:55.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:40:55.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:40:55.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:55.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:40:55.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:40:55.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:55.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:40:55.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:40:55.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:55.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:40:55.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:40:55.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:55.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:40:55.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:40:55.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:55.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:40:55.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:40:55.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:55.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:40:55.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:40:55.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:55.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:40:55.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:40:55.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:55.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:40:55.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:40:55.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:55.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:40:55.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:40:55.980 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:55.980 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:55.980 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:55.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.980 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:55.980 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:40:55.980 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.365687923000003, 2024-04-25T22:40:55.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:40:55.980 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:55.981 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:55.981 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:55.981 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:55.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:55.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:40:55.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:55.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:55.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:40:55.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:55.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:55.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:40:55.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:40:55.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:55.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:40:55.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:40:55.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:55.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:40:55.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:40:55.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:40:55.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:40:55.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:55.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:40:55.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:40:55.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:55.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:40:55.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:40:55.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:55.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:40:55.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:40:55.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:55.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:40:55.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:40:55.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:55.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:40:55.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:40:55.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:55.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:40:55.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:40:55.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:55.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:40:55.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:40:55.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:55.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:40:55.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:40:55.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:55.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:40:55.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:40:55.986 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:55.986 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:55.986 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:55.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.986 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:55.986 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:40:55.986 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.365621267000002, 2024-04-25T22:40:55.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:40:55.986 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:55.987 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:55.987 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:55.987 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:55.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:55.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:40:55.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:55.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:55.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:40:55.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:55.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:55.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:40:55.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:40:55.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:55.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:40:55.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:40:55.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:55.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:40:55.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:40:55.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:40:55.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:40:55.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:55.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:40:55.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:40:55.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:55.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:40:55.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:40:55.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:55.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:40:55.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:40:55.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:55.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:40:55.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:40:55.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:55.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:40:55.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:40:55.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:55.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:40:55.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:40:55.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:55.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:40:55.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:40:55.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:55.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:40:55.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:40:55.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:55.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:40:55.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:40:55.992 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:55.992 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:55.992 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:55.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.992 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:55.992 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:40:55.992 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.365530671000002, 2024-04-25T22:40:55.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:40:55.992 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:55.992 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:55.992 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:55.993 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:55.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:55.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:40:55.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:55.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:55.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:40:55.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:55.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:55.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:40:55.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:40:55.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:55.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:40:55.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:40:55.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:55.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:40:55.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:40:55.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:55.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:40:55.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:40:55.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:55.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:40:55.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:40:55.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:55.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:40:55.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:40:55.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:55.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:40:55.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:40:55.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:55.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:40:55.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:40:55.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:55.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:40:55.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:40:55.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:55.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:40:55.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:40:55.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:55.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:40:55.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:40:55.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:55.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:40:55.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:40:55.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:55.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:40:55.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:40:55.998 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:55.998 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:55.998 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:55.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.998 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:55.998 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:40:55.998 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.365466097999999, 2024-04-25T22:40:55.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:40:55.998 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:55.998 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:55.998 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:55.999 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:55.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:55.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:40:55.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:55.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:55.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:40:55.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:55.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:55.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:55.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:55.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:40:55.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:40:56.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:56.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:40:56.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:40:56.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:56.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:40:56.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:40:56.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:40:56.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:40:56.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:40:56.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:40:56.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:56.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:40:56.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:40:56.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:40:56.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:40:56.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:56.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:40:56.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:40:56.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:56.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:40:56.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:40:56.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:56.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:40:56.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:40:56.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:56.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:40:56.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:40:56.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:56.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:40:56.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:40:56.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:56.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:40:56.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:40:56.004 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.004 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:56.004 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.004 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.004 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:40:56.004 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.365400674999997, 2024-04-25T22:40:56.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:40:56.004 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:56.004 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:56.004 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.004 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:56.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:56.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:40:56.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:56.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:40:56.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:56.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:40:56.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:40:56.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:56.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:40:56.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:40:56.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:56.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:40:56.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:40:56.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:40:56.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:40:56.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:40:56.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:40:56.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:56.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:40:56.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:40:56.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:40:56.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:40:56.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:56.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:40:56.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:40:56.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:56.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:40:56.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:40:56.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:56.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:40:56.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:40:56.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:56.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:40:56.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:40:56.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:56.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:40:56.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:40:56.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:56.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:40:56.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:40:56.010 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.010 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:56.010 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.010 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.010 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:40:56.010 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.365344608999997, 2024-04-25T22:40:56.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:40:56.010 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:56.010 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:56.010 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.011 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:56.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:56.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:40:56.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:56.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:40:56.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:56.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:40:56.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:40:56.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:56.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:40:56.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:40:56.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:56.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:40:56.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:40:56.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:40:56.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:40:56.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:40:56.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:40:56.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:56.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:40:56.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:40:56.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:40:56.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:40:56.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:56.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:40:56.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:40:56.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:56.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:40:56.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:40:56.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:56.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:40:56.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:40:56.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:56.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:40:56.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:40:56.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:56.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:40:56.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:40:56.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:56.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:40:56.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:40:56.016 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.016 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:56.016 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.016 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.016 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:40:56.016 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.365277503000002, 2024-04-25T22:40:56.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:40:56.016 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:56.016 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:56.016 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.017 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:56.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:56.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:40:56.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:56.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:40:56.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:56.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:40:56.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:40:56.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:56.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:40:56.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:40:56.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:56.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:40:56.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:40:56.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:40:56.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:40:56.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:40:56.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:40:56.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:56.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:40:56.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:40:56.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:40:56.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:40:56.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:56.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:40:56.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:40:56.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:56.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:40:56.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:40:56.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:56.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:40:56.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:40:56.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:56.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:40:56.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:40:56.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:56.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:40:56.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:40:56.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:56.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:40:56.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:40:56.022 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.022 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:56.022 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.022 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.022 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:40:56.022 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.365222379999999, 2024-04-25T22:40:56.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:40:56.022 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:56.022 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:56.022 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.022 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:56.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:56.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:40:56.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:56.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:40:56.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:56.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:40:56.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:40:56.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:56.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:40:56.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:40:56.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:56.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:40:56.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:40:56.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:40:56.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:40:56.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:40:56.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:40:56.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:56.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:40:56.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:40:56.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:40:56.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:40:56.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:56.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:40:56.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:40:56.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:40:56.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:40:56.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:40:56.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:56.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:40:56.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:40:56.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:56.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:40:56.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:40:56.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:56.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:40:56.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:40:56.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:56.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:40:56.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:40:56.028 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.028 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:56.028 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.028 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.028 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:40:56.028 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.365120140999998, 2024-04-25T22:40:56.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:40:56.028 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:56.028 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:56.028 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.029 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:56.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:56.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:40:56.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:56.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:40:56.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:56.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:40:56.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:40:56.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:56.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:40:56.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:40:56.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:56.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:40:56.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:40:56.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:40:56.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:40:56.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:40:56.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:40:56.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:56.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:40:56.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:40:56.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:40:56.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:40:56.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:56.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:40:56.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:40:56.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:40:56.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:40:56.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:40:56.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:56.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:40:56.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:40:56.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:56.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:40:56.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:40:56.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:56.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:40:56.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:40:56.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:56.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:40:56.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:40:56.034 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.034 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:56.034 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.034 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.034 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:40:56.034 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.365061318000002, 2024-04-25T22:40:56.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:40:56.034 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:56.035 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:56.035 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.035 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:56.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:56.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:40:56.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:56.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:40:56.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:56.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:40:56.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:40:56.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:56.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:40:56.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:40:56.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:56.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:40:56.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:40:56.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:40:56.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:40:56.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:40:56.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:40:56.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:56.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:40:56.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:40:56.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:40:56.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:40:56.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:56.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:40:56.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:40:56.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:40:56.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:40:56.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:40:56.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:56.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:40:56.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:40:56.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:56.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:40:56.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:40:56.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:56.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:40:56.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:40:56.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:56.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:40:56.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:40:56.040 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.040 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:56.040 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.040 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.040 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:40:56.040 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.364982585, 2024-04-25T22:40:56.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:40:56.040 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:56.041 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:56.041 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.041 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:56.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:56.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:40:56.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:56.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:40:56.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:56.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:40:56.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:40:56.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:56.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:40:56.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:40:56.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:56.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:40:56.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:40:56.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:40:56.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:40:56.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:40:56.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:40:56.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:56.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:40:56.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:40:56.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:40:56.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:40:56.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:56.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:40:56.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:40:56.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:56.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:40:56.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:40:56.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:56.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:40:56.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:40:56.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:56.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:40:56.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:40:56.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:56.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:40:56.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:40:56.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:56.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:40:56.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:40:56.046 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.046 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:56.046 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.046 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.046 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:40:56.046 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.364943171999997, 2024-04-25T22:40:56.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:40:56.047 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:56.047 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:56.047 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.047 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:56.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:56.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:40:56.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:56.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:40:56.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:56.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:40:56.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:40:56.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:56.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:40:56.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:40:56.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:56.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:40:56.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:40:56.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:40:56.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:40:56.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:40:56.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:40:56.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:56.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:40:56.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:40:56.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:40:56.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:40:56.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:56.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:40:56.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:40:56.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:56.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:40:56.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:40:56.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:56.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:40:56.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:40:56.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:56.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:40:56.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:40:56.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:56.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:40:56.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:40:56.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:56.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:40:56.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:40:56.052 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.052 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:56.052 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.053 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.053 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:40:56.053 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.364873326000001, 2024-04-25T22:40:56.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:40:56.053 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:56.053 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:56.053 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.053 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:56.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:56.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:40:56.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:56.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:40:56.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:56.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:40:56.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:40:56.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:56.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:40:56.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:40:56.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:56.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:40:56.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:40:56.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:40:56.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:40:56.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:40:56.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:40:56.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:56.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:40:56.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:40:56.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:40:56.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:40:56.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:56.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:40:56.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:40:56.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:56.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:40:56.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:40:56.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:56.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:40:56.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:40:56.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:56.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:40:56.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:40:56.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:56.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:40:56.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:40:56.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:56.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:40:56.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:40:56.059 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.059 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:56.059 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.059 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.059 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:40:56.059 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.364823588999997, 2024-04-25T22:40:56.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:40:56.061 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:56.062 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:56.062 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.062 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:56.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:56.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:40:56.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:56.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:40:56.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:56.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:40:56.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:40:56.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:56.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:40:56.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:40:56.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:56.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:40:56.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:40:56.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:40:56.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:40:56.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:40:56.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:40:56.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:56.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:40:56.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:40:56.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:40:56.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:40:56.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:56.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:40:56.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:40:56.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:40:56.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:40:56.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:40:56.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:56.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:40:56.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:40:56.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:56.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:40:56.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:40:56.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:56.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:40:56.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:40:56.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:56.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:40:56.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:40:56.067 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.068 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:56.068 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.068 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.068 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:40:56.068 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.364738973999998, 2024-04-25T22:40:56.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:40:56.068 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:56.068 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:56.068 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.068 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:56.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:56.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:40:56.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:56.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:40:56.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:56.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:40:56.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:40:56.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:56.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:40:56.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:40:56.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:56.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:40:56.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:40:56.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:40:56.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:40:56.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:40:56.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:40:56.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:40:56.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:40:56.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:40:56.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:40:56.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:40:56.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:56.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:40:56.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:40:56.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:56.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:40:56.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:40:56.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:56.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:40:56.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:40:56.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:40:56.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:40:56.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:40:56.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:56.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:40:56.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:40:56.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:56.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:40:56.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:40:56.074 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.074 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:56.074 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.074 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.074 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:40:56.074 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.364675323999997, 2024-04-25T22:40:56.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:40:56.074 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:56.074 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:56.074 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:40:56.074 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:56.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:56.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:40:56.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:56.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:40:56.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:56.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:40:56.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:40:56.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:56.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:40:56.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:40:56.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:56.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:40:56.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:40:56.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:40:56.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:40:56.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:40:56.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:40:56.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:56.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:40:56.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:40:56.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:40:56.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:40:56.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:56.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:40:56.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:40:56.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:56.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:40:56.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:40:56.078 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.078 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:56.078 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.079 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:56.079 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:40:56.079 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 41.357671793999998, 2024-04-25T22:40:56.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:40:56.079 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:40:56.079 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:40:56.079 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.079 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:40:56.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:40:56.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:40:56.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:40:56.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:40:56.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:40:56.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:40:56.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:40:56.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:40:56.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:40:56.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:40:56.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:40:56.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:40:56.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:40:56.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:40:56.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:40:56.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:40:56.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:40:56.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:40:56.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:40:56.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:40:56.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:40:56.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:40:56.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:40:56.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:40:56.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:40:56.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:40:56.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:40:56.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:40:56.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:40:56.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:40:56.082 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.083 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:56.083 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.083 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:40:56.083 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:40:56.083 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:40:56.084 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:40:56.085 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:56.083+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:56.185 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:56.183+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:56.215 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:40:56.216 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:40:56.216 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-04-25T22:40:56.216 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:40:56.229 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:40:56.315 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:56.315+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:56.387 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:56.385+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:56.397 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:40:56.397 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:40:56.398 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-04-25T22:40:56.398 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-04-25T22:40:56.398 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:40:56.413 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:40:56.488 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:56.489+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:56.582 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:40:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-04-25T22:40:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-04-25T22:40:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-04-25T22:40:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:111 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'73, mlcod=11'69)", 2024-04-25T22:40:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:40:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.880666667, 2024-04-25T22:40:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055481899999999997, 2024-04-25T22:40:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:40:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:40:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700271+0000", 2024-04-25T22:40:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:40:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700278+0000", 2024-04-25T22:40:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-04-25T22:40:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700323+0000", 2024-04-25T22:40:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4212999999999998e-05 2024-04-25T22:40:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700333+0000", 2024-04-25T22:40:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0433e-05 2024-04-25T22:40:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700662+0000", 2024-04-25T22:40:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032862800000000003 2024-04-25T22:40:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700692+0000", 2024-04-25T22:40:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0395999999999998e-05 2024-04-25T22:40:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705728+0000", 2024-04-25T22:40:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050361939999999999 2024-04-25T22:40:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705818+0000", 2024-04-25T22:40:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9573000000000005e-05 2024-04-25T22:40:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-25T22:40:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:40:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.880121815000003, 2024-04-25T22:40:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005065501, 2024-04-25T22:40:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:40:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:40:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700816+0000", 2024-04-25T22:40:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.24e-06 2024-04-25T22:40:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700914+0000", 2024-04-25T22:40:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8057e-05 2024-04-25T22:40:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700931+0000", 2024-04-25T22:40:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7745999999999999e-05 2024-04-25T22:40:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700941+0000", 2024-04-25T22:40:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5699999999999999e-06 2024-04-25T22:40:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701162+0000", 2024-04-25T22:40:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000221392 2024-04-25T22:40:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701194+0000", 2024-04-25T22:40:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1745999999999997e-05 2024-04-25T22:40:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705821+0000", 2024-04-25T22:40:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046269869999999999 2024-04-25T22:40:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705880+0000", 2024-04-25T22:40:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8763e-05 2024-04-25T22:40:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:118 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'80, mlcod=11'78)", 2024-04-25T22:40:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:40:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.872766204999998, 2024-04-25T22:40:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047806089999999999, 2024-04-25T22:40:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:40:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:40:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708172+0000", 2024-04-25T22:40:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0600000000000002e-06 2024-04-25T22:40:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708291+0000", 2024-04-25T22:40:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118892 2024-04-25T22:40:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708320+0000", 2024-04-25T22:40:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8822999999999998e-05 2024-04-25T22:40:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708337+0000", 2024-04-25T22:40:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7586999999999999e-05 2024-04-25T22:40:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708512+0000", 2024-04-25T22:40:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017439500000000001 2024-04-25T22:40:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708551+0000", 2024-04-25T22:40:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.909e-05 2024-04-25T22:40:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712865+0000", 2024-04-25T22:40:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043142069999999996 2024-04-25T22:40:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712951+0000", 2024-04-25T22:40:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5555000000000003e-05 2024-04-25T22:40:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:120 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'82, mlcod=11'78)", 2024-04-25T22:40:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:40:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.871760162999998, 2024-04-25T22:40:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047170700000000003, 2024-04-25T22:40:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:40:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:40:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709177+0000", 2024-04-25T22:40:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.19e-06 2024-04-25T22:40:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709315+0000", 2024-04-25T22:40:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000137429 2024-04-25T22:40:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709341+0000", 2024-04-25T22:40:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:40:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709353+0000", 2024-04-25T22:40:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2027e-05 2024-04-25T22:40:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710040+0000", 2024-04-25T22:40:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068710799999999997 2024-04-25T22:40:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710076+0000", 2024-04-25T22:40:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5982999999999998e-05 2024-04-25T22:40:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713802+0000", 2024-04-25T22:40:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037255750000000001 2024-04-25T22:40:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713893+0000", 2024-04-25T22:40:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1201999999999999e-05 2024-04-25T22:40:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:121 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'83, mlcod=11'78)", 2024-04-25T22:40:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:40:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.871213527000002, 2024-04-25T22:40:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0049043919999999996, 2024-04-25T22:40:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:40:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:40:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709724+0000", 2024-04-25T22:40:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.483e-06 2024-04-25T22:40:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709872+0000", 2024-04-25T22:40:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147446 2024-04-25T22:40:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709891+0000", 2024-04-25T22:40:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9245999999999998e-05 2024-04-25T22:40:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709900+0000", 2024-04-25T22:40:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1439999999999992e-06 2024-04-25T22:40:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713091+0000", 2024-04-25T22:40:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031910710000000002 2024-04-25T22:40:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713122+0000", 2024-04-25T22:40:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.048e-05 2024-04-25T22:40:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714538+0000", 2024-04-25T22:40:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014160030000000001 2024-04-25T22:40:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714627+0000", 2024-04-25T22:40:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518999999999995e-05 2024-04-25T22:40:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:40:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.980824147, 2024-04-25T22:40:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022089675999999999, 2024-04-25T22:40:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:40:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:40:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600120+0000", 2024-04-25T22:40:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1259999999999998e-06 2024-04-25T22:40:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600153+0000", 2024-04-25T22:40:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3186999999999999e-05 2024-04-25T22:40:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600181+0000", 2024-04-25T22:40:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7676000000000001e-05 2024-04-25T22:40:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600205+0000", 2024-04-25T22:40:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:40:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600467+0000", 2024-04-25T22:40:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026186800000000001 2024-04-25T22:40:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600809+0000", 2024-04-25T22:40:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034138400000000002 2024-04-25T22:40:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.601892+0000", 2024-04-25T22:40:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010831910000000001 2024-04-25T22:40:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611054+0000", 2024-04-25T22:40:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0091620940000000008 2024-04-25T22:40:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621965+0000", 2024-04-25T22:40:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010911044999999999 2024-04-25T22:40:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622090+0000", 2024-04-25T22:40:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012522 2024-04-25T22:40:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622202+0000", 2024-04-25T22:40:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011164500000000001 2024-04-25T22:40:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:40:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.980681091999998, 2024-04-25T22:40:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035756228000000001, 2024-04-25T22:40:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:40:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:40:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600257+0000", 2024-04-25T22:40:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8300000000000001e-06 2024-04-25T22:40:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600267+0000", 2024-04-25T22:40:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6539999999999994e-06 2024-04-25T22:40:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600293+0000", 2024-04-25T22:40:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5996e-05 2024-04-25T22:40:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600309+0000", 2024-04-25T22:40:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6206e-05 2024-04-25T22:40:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603757+0000", 2024-04-25T22:40:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003448244 2024-04-25T22:40:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604779+0000", 2024-04-25T22:40:56.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010216820000000001 2024-04-25T22:40:56.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:56.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605127+0000", 2024-04-25T22:40:56.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034820100000000002 2024-04-25T22:40:56.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:56.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611082+0000", 2024-04-25T22:40:56.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0059550640000000004 2024-04-25T22:40:56.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:56.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635779+0000", 2024-04-25T22:40:56.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024696665999999999 2024-04-25T22:40:56.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:56.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635915+0000", 2024-04-25T22:40:56.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000135809 2024-04-25T22:40:56.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:56.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636011+0000", 2024-04-25T22:40:56.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6875999999999999e-05 2024-04-25T22:40:56.614 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.614 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.615 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.615 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.615 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:40:56.615 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.980603879, 2024-04-25T22:40:56.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035327031000000002, 2024-04-25T22:40:56.615 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:56.615 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:56.615 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.615 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:56.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:56.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:40:56.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:56.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:40:56.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:56.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600334+0000", 2024-04-25T22:40:56.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:40:56.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:56.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600347+0000", 2024-04-25T22:40:56.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3593e-05 2024-04-25T22:40:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600371+0000", 2024-04-25T22:40:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.313e-05 2024-04-25T22:40:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600390+0000", 2024-04-25T22:40:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.908e-05 2024-04-25T22:40:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602756+0000", 2024-04-25T22:40:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023662560000000002 2024-04-25T22:40:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603021+0000", 2024-04-25T22:40:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026546399999999998 2024-04-25T22:40:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603304+0000", 2024-04-25T22:40:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028308800000000002 2024-04-25T22:40:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611075+0000", 2024-04-25T22:40:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077703900000000003 2024-04-25T22:40:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635414+0000", 2024-04-25T22:40:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024339326000000001 2024-04-25T22:40:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635544+0000", 2024-04-25T22:40:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012948199999999999 2024-04-25T22:40:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635659+0000", 2024-04-25T22:40:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000115809 2024-04-25T22:40:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:40:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.980443954000002, 2024-04-25T22:40:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035594492999999998, 2024-04-25T22:40:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:56.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:56.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:40:56.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:56.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:40:56.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:56.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600494+0000", 2024-04-25T22:40:56.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:40:56.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:56.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600502+0000", 2024-04-25T22:40:56.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3769999999999996e-06 2024-04-25T22:40:56.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:56.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600522+0000", 2024-04-25T22:40:56.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9919999999999999e-05 2024-04-25T22:40:56.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600539+0000", 2024-04-25T22:40:56.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.649e-05 2024-04-25T22:40:56.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:56.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604846+0000", 2024-04-25T22:40:56.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043075199999999996 2024-04-25T22:40:56.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:56.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605057+0000", 2024-04-25T22:40:56.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00021085200000000001 2024-04-25T22:40:56.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:56.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605378+0000", 2024-04-25T22:40:56.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032074799999999999 2024-04-25T22:40:56.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:56.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611089+0000", 2024-04-25T22:40:56.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057110249999999998 2024-04-25T22:40:56.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:56.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635844+0000", 2024-04-25T22:40:56.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024755355999999999 2024-04-25T22:40:56.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:56.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635986+0000", 2024-04-25T22:40:56.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141512 2024-04-25T22:40:56.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:56.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636087+0000", 2024-04-25T22:40:56.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101183 2024-04-25T22:40:56.625 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.625 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.625 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.625 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.625 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:40:56.626 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.980371343999998, 2024-04-25T22:40:56.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021266723000000001, 2024-04-25T22:40:56.626 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:56.626 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:56.626 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.626 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:56.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:56.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:40:56.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:56.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:40:56.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:56.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600566+0000", 2024-04-25T22:40:56.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4959999999999999e-06 2024-04-25T22:40:56.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:56.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600574+0000", 2024-04-25T22:40:56.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-06 2024-04-25T22:40:56.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:56.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600592+0000", 2024-04-25T22:40:56.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8479999999999999e-05 2024-04-25T22:40:56.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600610+0000", 2024-04-25T22:40:56.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7567e-05 2024-04-25T22:40:56.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:56.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602679+0000", 2024-04-25T22:40:56.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020692739999999999 2024-04-25T22:40:56.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:56.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602945+0000", 2024-04-25T22:40:56.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026640399999999998 2024-04-25T22:40:56.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:56.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603115+0000", 2024-04-25T22:40:56.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000169996 2024-04-25T22:40:56.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:56.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608398+0000", 2024-04-25T22:40:56.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052826289999999996 2024-04-25T22:40:56.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:56.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621588+0000", 2024-04-25T22:40:56.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013190489 2024-04-25T22:40:56.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:56.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621733+0000", 2024-04-25T22:40:56.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014462500000000001 2024-04-25T22:40:56.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:56.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621832+0000", 2024-04-25T22:40:56.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8603000000000004e-05 2024-04-25T22:40:56.630 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.631 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.631 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.631 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.631 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:40:56.631 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.980303618000001, 2024-04-25T22:40:56.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034747924999999999, 2024-04-25T22:40:56.631 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:56.631 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:56.631 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.631 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:56.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:56.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:40:56.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:56.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:40:56.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:56.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600634+0000", 2024-04-25T22:40:56.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-04-25T22:40:56.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:56.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600642+0000", 2024-04-25T22:40:56.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8169999999999999e-06 2024-04-25T22:40:56.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:56.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600660+0000", 2024-04-25T22:40:56.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8513e-05 2024-04-25T22:40:56.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600676+0000", 2024-04-25T22:40:56.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6019999999999999e-05 2024-04-25T22:40:56.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:56.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603748+0000", 2024-04-25T22:40:56.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030718329999999999 2024-04-25T22:40:56.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:56.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604752+0000", 2024-04-25T22:40:56.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001003603 2024-04-25T22:40:56.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:56.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605117+0000", 2024-04-25T22:40:56.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00036539 2024-04-25T22:40:56.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:56.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608459+0000", 2024-04-25T22:40:56.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033413879999999998 2024-04-25T22:40:56.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:56.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635106+0000", 2024-04-25T22:40:56.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026647607 2024-04-25T22:40:56.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:56.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635273+0000", 2024-04-25T22:40:56.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000166689 2024-04-25T22:40:56.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:56.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635381+0000", 2024-04-25T22:40:56.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107642 2024-04-25T22:40:56.636 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.636 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.636 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.636 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.636 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:40:56.636 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.980240389000002, 2024-04-25T22:40:56.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040419292000000002, 2024-04-25T22:40:56.636 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:56.636 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:56.637 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.637 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:56.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:56.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:40:56.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:56.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:40:56.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:56.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600697+0000", 2024-04-25T22:40:56.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1999999999999999e-06 2024-04-25T22:40:56.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:56.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600704+0000", 2024-04-25T22:40:56.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5570000000000001e-06 2024-04-25T22:40:56.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:56.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600724+0000", 2024-04-25T22:40:56.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0023000000000001e-05 2024-04-25T22:40:56.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600738+0000", 2024-04-25T22:40:56.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4372999999999999e-05 2024-04-25T22:40:56.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:56.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.612532+0000", 2024-04-25T22:40:56.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011793606 2024-04-25T22:40:56.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:56.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613354+0000", 2024-04-25T22:40:56.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00082244100000000004 2024-04-25T22:40:56.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:56.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613726+0000", 2024-04-25T22:40:56.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00037226000000000002 2024-04-25T22:40:56.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:40:56.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618891+0000", 2024-04-25T22:40:56.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051649199999999999 2024-04-25T22:40:56.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:56.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.640874+0000", 2024-04-25T22:40:56.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021982640000000001 2024-04-25T22:40:56.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:56.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641019+0000", 2024-04-25T22:40:56.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000145339 2024-04-25T22:40:56.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:56.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641115+0000", 2024-04-25T22:40:56.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5933000000000005e-05 2024-04-25T22:40:56.641 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.641 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.641 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.641 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.641 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:40:56.641 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.980154358999997, 2024-04-25T22:40:56.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036502711, 2024-04-25T22:40:56.642 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:56.642 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:56.642 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:40:56.642 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:56.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:56.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:40:56.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:56.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:40:56.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:56.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600783+0000", 2024-04-25T22:40:56.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.533e-06 2024-04-25T22:40:56.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:56.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600790+0000", 2024-04-25T22:40:56.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0439999999999998e-06 2024-04-25T22:40:56.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:56.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600811+0000", 2024-04-25T22:40:56.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0449e-05 2024-04-25T22:40:56.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600825+0000", 2024-04-25T22:40:56.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4293e-05 2024-04-25T22:40:56.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:56.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602304+0000", 2024-04-25T22:40:56.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001478629 2024-04-25T22:40:56.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:56.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602587+0000", 2024-04-25T22:40:56.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028350800000000002 2024-04-25T22:40:56.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:56.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.637285+0000", 2024-04-25T22:40:56.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034697255000000003 2024-04-25T22:40:56.645 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.645 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.645 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.645 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:56.645 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:40:56.645 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.980088793, 2024-04-25T22:40:56.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017311460000000001, 2024-04-25T22:40:56.645 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:56.645 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:56.645 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:40:56.646 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:56.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.646 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:56.646 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:40:56.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.646 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:56.646 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:40:56.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.646 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:56.646 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600849+0000", 2024-04-25T22:40:56.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2899999999999999e-06 2024-04-25T22:40:56.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:56.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600866+0000", 2024-04-25T22:40:56.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6793e-05 2024-04-25T22:40:56.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:56.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600886+0000", 2024-04-25T22:40:56.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0772999999999999e-05 2024-04-25T22:40:56.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600904+0000", 2024-04-25T22:40:56.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7697e-05 2024-04-25T22:40:56.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:56.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602796+0000", 2024-04-25T22:40:56.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018920149999999999 2024-04-25T22:40:56.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:56.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602962+0000", 2024-04-25T22:40:56.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016590600000000001 2024-04-25T22:40:56.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:56.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618159+0000", 2024-04-25T22:40:56.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015196985999999999 2024-04-25T22:40:56.649 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.649 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.649 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.649 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:56.649 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:40:56.649 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.965213052000003, 2024-04-25T22:40:56.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006380269, 2024-04-25T22:40:56.649 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:56.649 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:56.649 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.649 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:56.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:56.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:40:56.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:56.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:40:56.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:56.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615724+0000", 2024-04-25T22:40:56.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.094e-06 2024-04-25T22:40:56.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:56.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615734+0000", 2024-04-25T22:40:56.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.363e-06 2024-04-25T22:40:56.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:56.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615751+0000", 2024-04-25T22:40:56.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:40:56.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615773+0000", 2024-04-25T22:40:56.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.154e-05 2024-04-25T22:40:56.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:56.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616485+0000", 2024-04-25T22:40:56.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00071225100000000001 2024-04-25T22:40:56.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:56.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616528+0000", 2024-04-25T22:40:56.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3606000000000002e-05 2024-04-25T22:40:56.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:56.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622030+0000", 2024-04-25T22:40:56.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055010750000000002 2024-04-25T22:40:56.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:56.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622103+0000", 2024-04-25T22:40:56.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3930000000000005e-05 2024-04-25T22:40:56.653 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.653 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.653 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.653 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:40:56.653 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:40:56.653 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.964300115, 2024-04-25T22:40:56.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046420649999999999, 2024-04-25T22:40:56.653 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:56.654 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:56.654 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-04-25T22:40:56.654 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:56.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:56.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:40:56.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:56.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:40:56.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:56.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616637+0000", 2024-04-25T22:40:56.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0299999999999998e-07 2024-04-25T22:40:56.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:56.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616653+0000", 2024-04-25T22:40:56.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5843000000000001e-05 2024-04-25T22:40:56.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:56.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616690+0000", 2024-04-25T22:40:56.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7466999999999999e-05 2024-04-25T22:40:56.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616729+0000", 2024-04-25T22:40:56.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8810000000000003e-05 2024-04-25T22:40:56.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:56.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617251+0000", 2024-04-25T22:40:56.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00052143899999999995 2024-04-25T22:40:56.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:56.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621278+0000", 2024-04-25T22:40:56.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040277029999999997 2024-04-25T22:40:56.656 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.656 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.657 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.657 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:56.657 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:40:56.657 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.963276763000003, 2024-04-25T22:40:56.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0065101730000000002, 2024-04-25T22:40:56.657 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:56.657 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:56.657 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.657 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:56.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:56.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:40:56.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:56.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:40:56.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:56.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617661+0000", 2024-04-25T22:40:56.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:40:56.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:56.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617688+0000", 2024-04-25T22:40:56.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7589e-05 2024-04-25T22:40:56.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:56.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617710+0000", 2024-04-25T22:40:56.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1467e-05 2024-04-25T22:40:56.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617727+0000", 2024-04-25T22:40:56.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6990000000000002e-05 2024-04-25T22:40:56.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:56.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618559+0000", 2024-04-25T22:40:56.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083207400000000003 2024-04-25T22:40:56.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:56.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618608+0000", 2024-04-25T22:40:56.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8936e-05 2024-04-25T22:40:56.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:56.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624077+0000", 2024-04-25T22:40:56.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054695840000000004 2024-04-25T22:40:56.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:56.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624170+0000", 2024-04-25T22:40:56.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2305999999999993e-05 2024-04-25T22:40:56.661 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.661 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.661 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.661 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:56.661 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:40:56.661 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.958175255, 2024-04-25T22:40:56.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006879446, 2024-04-25T22:40:56.661 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:56.661 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:56.661 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.661 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:56.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:56.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:40:56.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:56.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:40:56.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:56.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622762+0000", 2024-04-25T22:40:56.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:40:56.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:56.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622781+0000", 2024-04-25T22:40:56.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8749999999999998e-05 2024-04-25T22:40:56.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:56.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622802+0000", 2024-04-25T22:40:56.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1650000000000001e-05 2024-04-25T22:40:56.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622816+0000", 2024-04-25T22:40:56.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3556e-05 2024-04-25T22:40:56.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:56.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623700+0000", 2024-04-25T22:40:56.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00088389299999999996 2024-04-25T22:40:56.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:56.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623741+0000", 2024-04-25T22:40:56.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1023999999999999e-05 2024-04-25T22:40:56.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:56.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629543+0000", 2024-04-25T22:40:56.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058023980000000003 2024-04-25T22:40:56.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:56.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629640+0000", 2024-04-25T22:40:56.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7381999999999997e-05 2024-04-25T22:40:56.665 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.665 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.665 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.665 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:56.665 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:40:56.665 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.957914051000003, 2024-04-25T22:40:56.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067054879999999999, 2024-04-25T22:40:56.665 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:56.665 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:56.666 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.666 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:56.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:56.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:40:56.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:56.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:40:56.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:56.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623032+0000", 2024-04-25T22:40:56.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.9930000000000007e-06 2024-04-25T22:40:56.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:56.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623043+0000", 2024-04-25T22:40:56.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0387000000000001e-05 2024-04-25T22:40:56.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:56.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623064+0000", 2024-04-25T22:40:56.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1849999999999999e-05 2024-04-25T22:40:56.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623079+0000", 2024-04-25T22:40:56.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4093e-05 2024-04-25T22:40:56.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:56.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624384+0000", 2024-04-25T22:40:56.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013054539999999999 2024-04-25T22:40:56.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:56.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624421+0000", 2024-04-25T22:40:56.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7088999999999997e-05 2024-04-25T22:40:56.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:56.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629645+0000", 2024-04-25T22:40:56.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052241400000000004 2024-04-25T22:40:56.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:56.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629728+0000", 2024-04-25T22:40:56.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2482000000000001e-05 2024-04-25T22:40:56.669 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.669 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.669 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.669 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2024-04-25T22:40:56.670 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:40:56.670 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.957830938000001, 2024-04-25T22:40:56.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078029559999999998, 2024-04-25T22:40:56.670 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:40:56.670 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:40:56.670 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:56.670 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:40:56.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:40:56.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:40:56.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:40:56.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:40:56.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:40:56.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:40:56.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623106+0000", 2024-04-25T22:40:56.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.64e-07 2024-04-25T22:40:56.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:40:56.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623141+0000", 2024-04-25T22:40:56.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4678999999999998e-05 2024-04-25T22:40:56.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:40:56.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623153+0000", 2024-04-25T22:40:56.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1759999999999999e-05 2024-04-25T22:40:56.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:40:56.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623161+0000", 2024-04-25T22:40:56.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8299999999999996e-06 2024-04-25T22:40:56.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:40:56.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623834+0000", 2024-04-25T22:40:56.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067394500000000001 2024-04-25T22:40:56.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:40:56.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623883+0000", 2024-04-25T22:40:56.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8640000000000002e-05 2024-04-25T22:40:56.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:40:56.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630807+0000", 2024-04-25T22:40:56.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069238859999999998 2024-04-25T22:40:56.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:40:56.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:40:56.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:40:56.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630908+0000", 2024-04-25T22:40:56.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101252 2024-04-25T22:40:56.674 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.674 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.674 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.674 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:40:56.674 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:40:56.674 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:40:56.674 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:40:56.674 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:40:56.677 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-25T22:40:56.677 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-25T22:40:56.679 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is unset 2024-04-25T22:40:56.680 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:40:56.680 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:56.675+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:56.776 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:56.775+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:56.807 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:56.807 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:56.807 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:40:56.807 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:56.821 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:40:56.876 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:56.873+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:56.930 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:56.930 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:56.930 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:40:56.930 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:40:56.930 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:56.942 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:40:56.978 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:56.975+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:57.035 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:40:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 33, 2024-04-25T22:40:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d", 2024-04-25T22:40:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2024-04-25T22:39:52.303074+0000", 2024-04-25T22:40:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2024-04-25T22:40:56.575680+0000", 2024-04-25T22:40:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2024-04-25T22:40:01.251093+0000", 2024-04-25T22:40:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2024-04-25T22:39:53.230242+0000", 2024-04-25T22:40:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-25T22:40:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2024-04-25T22:40:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2024-04-25T22:40:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2024-04-25T22:40:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2024-04-25T22:40:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2024-04-25T22:40:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2024-04-25T22:40:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:40:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 4, 2024-04-25T22:40:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2024-04-25T22:40:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-25T22:40:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-25T22:40:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2024-04-25T22:40:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 4, 2024-04-25T22:40:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 3, 2024-04-25T22:40:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "luminous", 2024-04-25T22:40:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2024-04-25T22:40:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "squid", 2024-04-25T22:40:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "allow_crimson": false, 2024-04-25T22:40:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2024-04-25T22:40:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2024-04-25T22:40:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": ".mgr", 2024-04-25T22:40:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25T22:40:03.197725+0000", 2024-04-25T22:40:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T22:40:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T22:40:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T22:40:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T22:40:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T22:40:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T22:40:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:40:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:40:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:40:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:40:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T22:40:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:40:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2024-04-25T22:40:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2024-04-25T22:40:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2024-04-25T22:40:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2024-04-25T22:40:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2024-04-25T22:40:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T22:40:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T22:40:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T22:40:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T22:40:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T22:40:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T22:40:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T22:40:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "12", 2024-04-25T22:40:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T22:40:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:40:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:40:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T22:40:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:40:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T22:40:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T22:40:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T22:40:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T22:40:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T22:40:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T22:40:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T22:40:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T22:40:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T22:40:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T22:40:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T22:40:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T22:40:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T22:40:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:40:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:40:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:40:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T22:40:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T22:40:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T22:40:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T22:40:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T22:40:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T22:40:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T22:40:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T22:40:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:40:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:40:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:40:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:40:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T22:40:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T22:40:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T22:40:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T22:40:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2024-04-25T22:40:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_max": 32, 2024-04-25T22:40:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2024-04-25T22:40:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T22:40:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": {} 2024-04-25T22:40:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "read_balance": { 2024-04-25T22:40:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "error_message": "pool 1 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-04-25T22:40:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "score_acting": 0, 2024-04-25T22:40:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "score_stable": 0 2024-04-25T22:40:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2024-04-25T22:40:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2024-04-25T22:40:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25T22:40:07.560858+0000", 2024-04-25T22:40:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T22:40:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T22:40:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T22:40:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T22:40:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T22:40:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T22:40:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:40:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:40:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:40:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:40:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T22:40:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:40:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2024-04-25T22:40:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2024-04-25T22:40:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2024-04-25T22:40:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2024-04-25T22:40:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2024-04-25T22:40:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T22:40:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T22:40:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T22:40:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T22:40:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T22:40:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T22:40:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T22:40:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2024-04-25T22:40:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T22:40:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:40:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:40:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T22:40:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:40:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T22:40:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T22:40:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T22:40:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T22:40:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T22:40:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T22:40:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T22:40:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T22:40:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T22:40:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T22:40:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T22:40:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T22:40:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T22:40:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:40:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:40:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:40:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T22:40:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T22:40:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T22:40:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T22:40:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T22:40:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T22:40:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T22:40:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T22:40:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:40:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:40:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:40:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:40:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T22:40:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T22:40:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T22:40:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T22:40:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2024-04-25T22:40:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T22:40:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2024-04-25T22:40:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "read_balance": { 2024-04-25T22:40:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "error_message": "pool 2 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-04-25T22:40:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "score_acting": 0, 2024-04-25T22:40:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "score_stable": 0 2024-04-25T22:40:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 3, 2024-04-25T22:40:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_metadata", 2024-04-25T22:40:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25T22:40:12.431697+0000", 2024-04-25T22:40:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T22:40:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T22:40:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T22:40:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T22:40:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T22:40:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T22:40:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:40:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:40:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:40:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:40:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T22:40:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:40:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 32, 2024-04-25T22:40:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 32, 2024-04-25T22:40:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 32, 2024-04-25T22:40:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 32, 2024-04-25T22:40:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 32, 2024-04-25T22:40:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T22:40:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T22:40:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T22:40:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T22:40:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T22:40:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T22:40:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T22:40:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2024-04-25T22:40:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T22:40:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:40:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:40:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T22:40:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:40:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T22:40:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T22:40:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T22:40:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T22:40:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T22:40:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T22:40:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T22:40:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T22:40:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T22:40:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T22:40:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T22:40:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T22:40:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T22:40:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:40:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:40:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:40:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T22:40:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T22:40:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T22:40:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T22:40:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T22:40:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T22:40:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T22:40:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T22:40:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:40:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:40:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:40:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:40:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T22:40:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T22:40:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T22:40:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T22:40:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2024-04-25T22:40:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_bias": 4, 2024-04-25T22:40:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 16, 2024-04-25T22:40:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_priority": 5 2024-04-25T22:40:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T22:40:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2024-04-25T22:40:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": "cephfs" 2024-04-25T22:40:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "read_balance": { 2024-04-25T22:40:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "error_message": "pool 3 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-04-25T22:40:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "score_acting": 0, 2024-04-25T22:40:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "score_stable": 0 2024-04-25T22:40:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 4, 2024-04-25T22:40:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_data", 2024-04-25T22:40:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25T22:40:12.919828+0000", 2024-04-25T22:40:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T22:40:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T22:40:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T22:40:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T22:40:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T22:40:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T22:40:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:40:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:40:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:40:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:40:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T22:40:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:40:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 64, 2024-04-25T22:40:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 64, 2024-04-25T22:40:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 64, 2024-04-25T22:40:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 64, 2024-04-25T22:40:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 64, 2024-04-25T22:40:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T22:40:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T22:40:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T22:40:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T22:40:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T22:40:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T22:40:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T22:40:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "19", 2024-04-25T22:40:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T22:40:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:40:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:40:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T22:40:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:40:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T22:40:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T22:40:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T22:40:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T22:40:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T22:40:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T22:40:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T22:40:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T22:40:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T22:40:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T22:40:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T22:40:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T22:40:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T22:40:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:40:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:40:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:40:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T22:40:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T22:40:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T22:40:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T22:40:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T22:40:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T22:40:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T22:40:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T22:40:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:40:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:40:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:40:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:40:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T22:40:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T22:40:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T22:40:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T22:40:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2024-04-25T22:40:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 64, 2024-04-25T22:40:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "target_size_ratio": 0.89999997615814209 2024-04-25T22:40:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T22:40:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2024-04-25T22:40:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "data": "cephfs" 2024-04-25T22:40:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "read_balance": { 2024-04-25T22:40:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "error_message": "pool 4 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-04-25T22:40:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "score_acting": 0, 2024-04-25T22:40:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "score_stable": 0 2024-04-25T22:40:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:40:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2024-04-25T22:40:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2024-04-25T22:40:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "73d465b4-5896-4d69-80b1-7e69d31eb455", 2024-04-25T22:40:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T22:40:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T22:40:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T22:40:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2024-04-25T22:40:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T22:40:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T22:40:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 8, 2024-04-25T22:40:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 30, 2024-04-25T22:40:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T22:40:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T22:40:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T22:40:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6800", 2024-04-25T22:40:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:40:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6801", 2024-04-25T22:40:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:40:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T22:40:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6802", 2024-04-25T22:40:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:40:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6803", 2024-04-25T22:40:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:40:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T22:40:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6806", 2024-04-25T22:40:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:40:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6807", 2024-04-25T22:40:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:40:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T22:40:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6804", 2024-04-25T22:40:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:40:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6805", 2024-04-25T22:40:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:40:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.122:6801/765118869", 2024-04-25T22:40:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.122:6803/765118869", 2024-04-25T22:40:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.122:6807/765118869", 2024-04-25T22:40:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.122:6805/765118869", 2024-04-25T22:40:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T22:40:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T22:40:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T22:40:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2024-04-25T22:40:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5", 2024-04-25T22:40:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T22:40:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T22:40:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T22:40:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 0, 2024-04-25T22:40:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T22:40:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T22:40:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 8, 2024-04-25T22:40:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 30, 2024-04-25T22:40:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T22:40:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T22:40:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T22:40:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6800", 2024-04-25T22:40:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:40:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6801", 2024-04-25T22:40:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:40:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T22:40:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6802", 2024-04-25T22:40:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:40:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6803", 2024-04-25T22:40:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:40:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T22:40:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6806", 2024-04-25T22:40:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:40:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6807", 2024-04-25T22:40:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:40:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T22:40:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6804", 2024-04-25T22:40:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:40:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6805", 2024-04-25T22:40:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:40:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.148:6801/2387035286", 2024-04-25T22:40:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.148:6803/2387035286", 2024-04-25T22:40:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.148:6807/2387035286", 2024-04-25T22:40:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.148:6805/2387035286", 2024-04-25T22:40:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T22:40:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T22:40:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T22:40:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2024-04-25T22:40:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "164fc653-2135-4e9b-8826-1716fdba6ea0", 2024-04-25T22:40:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T22:40:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T22:40:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T22:40:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 0, 2024-04-25T22:40:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T22:40:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T22:40:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 8, 2024-04-25T22:40:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 20, 2024-04-25T22:40:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T22:40:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T22:40:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T22:40:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6800", 2024-04-25T22:40:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:40:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6801", 2024-04-25T22:40:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:40:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T22:40:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6802", 2024-04-25T22:40:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:40:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6803", 2024-04-25T22:40:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:40:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T22:40:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6806", 2024-04-25T22:40:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:40:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6807", 2024-04-25T22:40:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:40:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T22:40:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:40:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:40:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6804", 2024-04-25T22:40:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:40:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:40:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6805", 2024-04-25T22:40:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:40:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.188:6801/368834361", 2024-04-25T22:40:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.188:6803/368834361", 2024-04-25T22:40:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.188:6807/368834361", 2024-04-25T22:40:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.188:6805/368834361", 2024-04-25T22:40:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T22:40:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T22:40:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T22:40:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:40:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:40:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2024-04-25T22:40:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2024-04-25T22:40:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T22:40:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T22:40:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T22:40:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540701547738038271, 2024-04-25T22:40:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2024-04-25T22:40:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2024-04-25T22:39:58.559393+0000", 2024-04-25T22:40:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2024-04-25T22:40:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2024-04-25T22:40:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T22:40:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T22:40:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T22:40:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540701547738038271, 2024-04-25T22:40:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2024-04-25T22:40:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2024-04-25T22:39:58.563434+0000", 2024-04-25T22:40:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2024-04-25T22:40:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:40:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2024-04-25T22:40:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T22:40:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T22:40:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T22:40:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540701547738038271, 2024-04-25T22:40:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2024-04-25T22:40:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2024-04-25T22:39:58.557643+0000", 2024-04-25T22:40:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2024-04-25T22:40:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:40:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2024-04-25T22:40:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2024-04-25T22:40:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_primaries": [], 2024-04-25T22:40:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2024-04-25T22:40:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2024-04-25T22:40:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "blocklist": {}, 2024-04-25T22:40:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "range_blocklist": {}, 2024-04-25T22:40:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2024-04-25T22:40:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2024-04-25T22:40:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2024-04-25T22:40:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2024-04-25T22:40:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2024-04-25T22:40:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2024-04-25T22:40:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2024-04-25T22:40:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:40:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2024-04-25T22:40:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2024-04-25T22:40:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2024-04-25T22:40:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2024-04-25T22:40:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {}, 2024-04-25T22:40:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_mode": { 2024-04-25T22:40:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_mode_enabled": false, 2024-04-25T22:40:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_bucket_count": 0, 2024-04-25T22:40:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "degraded_stretch_mode": 0, 2024-04-25T22:40:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "recovering_stretch_mode": 0, 2024-04-25T22:40:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_mode_bucket": 0 2024-04-25T22:40:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:40:57.080 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:40:57.080 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:40:57.082 INFO:tasks.thrashosds.thrasher:j is {'epoch': 33, 'fsid': '5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d', 'created': '2024-04-25T22:39:52.303074+0000', 'modified': '2024-04-25T22:40:56.575680+0000', 'last_up_change': '2024-04-25T22:40:01.251093+0000', 'last_in_change': '2024-04-25T22:39:53.230242+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:40:03.197725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'error_message': 'pool 1 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:40:07.560858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:40:12.431697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'error_message': 'pool 3 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:40:12.919828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 4 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': '73d465b4-5896-4d69-80b1-7e69d31eb455', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6800', 'nonce': 765118869}, {'type': 'v1', 'addr': '172.21.15.122:6801', 'nonce': 765118869}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6802', 'nonce': 765118869}, {'type': 'v1', 'addr': '172.21.15.122:6803', 'nonce': 765118869}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6806', 'nonce': 765118869}, {'type': 'v1', 'addr': '172.21.15.122:6807', 'nonce': 765118869}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6804', 'nonce': 765118869}, {'type': 'v1', 'addr': '172.21.15.122:6805', 'nonce': 765118869}]}, 'public_addr': '172.21.15.122:6801/765118869', 'cluster_addr': '172.21.15.122:6803/765118869', 'heartbeat_back_addr': '172.21.15.122:6807/765118869', 'heartbeat_front_addr': '172.21.15.122:6805/765118869', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6800', 'nonce': 2387035286}, {'type': 'v1', 'addr': '172.21.15.148:6801', 'nonce': 2387035286}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6802', 'nonce': 2387035286}, {'type': 'v1', 'addr': '172.21.15.148:6803', 'nonce': 2387035286}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6806', 'nonce': 2387035286}, {'type': 'v1', 'addr': '172.21.15.148:6807', 'nonce': 2387035286}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6804', 'nonce': 2387035286}, {'type': 'v1', 'addr': '172.21.15.148:6805', 'nonce': 2387035286}]}, 'public_addr': '172.21.15.148:6801/2387035286', 'cluster_addr': '172.21.15.148:6803/2387035286', 'heartbeat_back_addr': '172.21.15.148:6807/2387035286', 'heartbeat_front_addr': '172.21.15.148:6805/2387035286', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '164fc653-2135-4e9b-8826-1716fdba6ea0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 20, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6800', 'nonce': 368834361}, {'type': 'v1', 'addr': '172.21.15.188:6801', 'nonce': 368834361}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6802', 'nonce': 368834361}, {'type': 'v1', 'addr': '172.21.15.188:6803', 'nonce': 368834361}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6806', 'nonce': 368834361}, {'type': 'v1', 'addr': '172.21.15.188:6807', 'nonce': 368834361}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6804', 'nonce': 368834361}, {'type': 'v1', 'addr': '172.21.15.188:6805', 'nonce': 368834361}]}, 'public_addr': '172.21.15.188:6801/368834361', 'cluster_addr': '172.21.15.188:6803/368834361', 'heartbeat_back_addr': '172.21.15.188:6807/368834361', 'heartbeat_front_addr': '172.21.15.188:6805/368834361', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:39:58.559393+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:39:58.563434+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:39:58.557643+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-25T22:40:57.083 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:40:57.083 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:57.081+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:57.105 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:57.105 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:40:57.106 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:40:57.106 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:40:57.106 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.106 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:57.106 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:57.106 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 42.509820787999999, 2024-04-25T22:40:57.106 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:40:57.106 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:57.106 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:57.106 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:57.106 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:57.106 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.106 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:57.107 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:57.107 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.107 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.107 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.107 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:57.107 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:57.107 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.107 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.107 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.107 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:57.107 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:40:57.107 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:40:57.107 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.107 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.108 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:57.108 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:40:57.108 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:40:57.108 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.108 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.108 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:57.108 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:40:57.108 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:40:57.108 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.108 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.108 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:57.108 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:40:57.108 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:40:57.108 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.109 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.109 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.109 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:40:57.109 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:40:57.109 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.109 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.109 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:57.109 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:40:57.109 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:40:57.109 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.109 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.109 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.109 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:40:57.109 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:40:57.110 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.110 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.110 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:57.110 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:40:57.110 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:40:57.110 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.110 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.110 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:57.110 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:40:57.110 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:40:57.110 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.110 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.110 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:57.110 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:40:57.111 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:40:57.111 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.111 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.111 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:57.111 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:40:57.111 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:40:57.111 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.111 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.111 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:57.111 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:40:57.111 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:40:57.111 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.111 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.111 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:57.112 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:40:57.112 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:40:57.112 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.112 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.112 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.112 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.112 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.112 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:57.112 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:57.112 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 42.509683531999997, 2024-04-25T22:40:57.112 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:40:57.112 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:57.112 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:57.112 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:57.112 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:57.113 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.113 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:57.113 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:57.113 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.113 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.113 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.113 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:57.113 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:57.113 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.113 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.113 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.113 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:57.113 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:40:57.113 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:40:57.113 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.113 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.114 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:57.114 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:40:57.114 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:40:57.114 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.114 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.114 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:57.114 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:40:57.114 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:40:57.114 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.114 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.114 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:57.114 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:40:57.114 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:40:57.114 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.115 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:40:57.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:40:57.115 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.115 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:57.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:40:57.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:40:57.115 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.115 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:40:57.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:40:57.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:57.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:40:57.116 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:40:57.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:57.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:40:57.116 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:40:57.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:57.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:40:57.116 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:40:57.117 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:57.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:40:57.117 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:40:57.117 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:57.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:40:57.117 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:40:57.117 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:57.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:40:57.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:40:57.118 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.118 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.118 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.118 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.118 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.118 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:57.118 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:57.118 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 42.50959598, 2024-04-25T22:40:57.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:40:57.118 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:57.118 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:57.118 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:57.118 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:57.119 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.119 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:57.119 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:57.119 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.119 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.119 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.119 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:57.119 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:57.119 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.119 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.119 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.119 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:57.119 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:40:57.119 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:40:57.120 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.120 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.120 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:57.120 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:40:57.120 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:40:57.120 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.120 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.120 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:57.120 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:40:57.120 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:40:57.120 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.120 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.120 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:57.120 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:40:57.120 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:40:57.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:40:57.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:40:57.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:57.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:40:57.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:40:57.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:40:57.122 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:40:57.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:57.122 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:40:57.122 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:40:57.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:57.122 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:40:57.122 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:40:57.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:57.122 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:40:57.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:40:57.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.123 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:57.123 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:40:57.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:40:57.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.123 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:57.123 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:40:57.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:40:57.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.123 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:57.124 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:40:57.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:40:57.124 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.124 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.124 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.124 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.124 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:57.124 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:57.124 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 42.509492154, 2024-04-25T22:40:57.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:40:57.124 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:57.124 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:57.125 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:57.125 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:57.125 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.125 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:57.125 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:57.125 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.125 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.125 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.125 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:57.125 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:57.125 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.125 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.125 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.125 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:57.125 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:40:57.126 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:40:57.126 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.126 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:57.126 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:40:57.126 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:40:57.126 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.126 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:57.126 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:40:57.126 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:40:57.126 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.126 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:57.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:40:57.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:40:57.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:40:57.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:40:57.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:57.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:40:57.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:40:57.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:40:57.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:40:57.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:57.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:40:57.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:40:57.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:57.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:40:57.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:40:57.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.129 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:57.129 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:40:57.129 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:40:57.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.129 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:57.129 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:40:57.129 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:40:57.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.129 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:57.129 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:40:57.129 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:40:57.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:57.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:40:57.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:40:57.130 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.130 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.130 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.130 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:57.130 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:57.130 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 42.509423364, 2024-04-25T22:40:57.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:40:57.131 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:57.131 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:57.131 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:57.131 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:57.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.131 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:57.131 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:57.131 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.131 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.131 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:57.131 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:57.131 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.131 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:57.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:40:57.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:40:57.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:57.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:40:57.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:40:57.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:57.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:40:57.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:40:57.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:57.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:40:57.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:40:57.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:40:57.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:40:57.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:57.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:40:57.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:40:57.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:40:57.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:40:57.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:57.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:40:57.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:40:57.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:57.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:40:57.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:40:57.135 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.135 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.135 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:57.135 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:40:57.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:40:57.135 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.135 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.135 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:57.135 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:40:57.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:40:57.135 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.135 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.135 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:57.135 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:40:57.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:40:57.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.136 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:57.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:40:57.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:40:57.136 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.136 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.136 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.136 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:57.136 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:57.136 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 42.509354278000004, 2024-04-25T22:40:57.137 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:40:57.137 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:57.137 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:57.137 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:57.137 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:57.137 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.137 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:57.137 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:57.137 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.137 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.137 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.137 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:57.137 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:57.137 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.138 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.138 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.138 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:57.138 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:40:57.138 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:40:57.138 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.138 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.138 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:57.138 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:40:57.138 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:40:57.138 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.138 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.138 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:57.138 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:40:57.139 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:40:57.139 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.139 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.139 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:57.139 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:40:57.139 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:40:57.139 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.139 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.139 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.139 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:40:57.139 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:40:57.139 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.139 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.139 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:57.140 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:40:57.140 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:40:57.140 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.140 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.140 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.140 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:40:57.140 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:40:57.140 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.140 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.140 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:57.140 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:40:57.140 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:40:57.140 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.140 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.140 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:57.141 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:40:57.141 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:40:57.141 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.141 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.141 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:57.141 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:40:57.141 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:40:57.141 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.141 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.141 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:57.141 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:40:57.141 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:40:57.141 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.141 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.141 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:57.142 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:40:57.142 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:40:57.142 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.142 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.142 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:57.142 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:40:57.142 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:40:57.142 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.142 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.142 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.142 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.142 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.142 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:57.142 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:57.143 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 42.509258164999999, 2024-04-25T22:40:57.143 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:40:57.143 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:57.143 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:57.143 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:57.143 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:57.143 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.143 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:57.143 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:57.143 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.143 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.143 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.143 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:57.143 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:57.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.144 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.144 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.144 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:57.144 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:40:57.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:40:57.144 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.144 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.144 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:57.144 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:40:57.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:40:57.144 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.144 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.144 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:57.144 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:40:57.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:40:57.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:57.145 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:40:57.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:40:57.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.145 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:40:57.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:40:57.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:57.146 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:40:57.146 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:40:57.146 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.146 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.146 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.146 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:40:57.146 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:40:57.146 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.146 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.146 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:57.146 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:40:57.146 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:40:57.146 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.146 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.147 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:57.147 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:40:57.147 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:40:57.147 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.147 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.147 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.147 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.147 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.147 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:57.147 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:57.147 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 42.509192503000001, 2024-04-25T22:40:57.147 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:40:57.147 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:57.147 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:57.148 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:57.148 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:57.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:57.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:57.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:57.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:57.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:57.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:40:57.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:40:57.149 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.149 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:57.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:40:57.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:40:57.149 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.149 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:57.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:40:57.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:40:57.149 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.149 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:57.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:40:57.150 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:40:57.150 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.150 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.150 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.150 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:40:57.150 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:40:57.150 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.150 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.150 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:57.150 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:40:57.150 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:40:57.150 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.150 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.150 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.151 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:40:57.151 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:40:57.151 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.151 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.151 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:57.151 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:40:57.151 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:40:57.151 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.151 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.151 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:57.151 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:40:57.151 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:40:57.151 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.151 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.152 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.152 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.152 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.152 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:57.152 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:57.152 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 42.509123375999998, 2024-04-25T22:40:57.152 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:40:57.152 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:57.152 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:57.152 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:57.152 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:57.152 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.152 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:57.152 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:57.152 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.153 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.153 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.153 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:57.153 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:57.153 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.153 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.153 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.153 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:57.153 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:40:57.153 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:40:57.153 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.153 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.153 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:57.153 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:40:57.153 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:40:57.154 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:57.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:40:57.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:40:57.154 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:57.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:40:57.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:40:57.154 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:40:57.155 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:40:57.155 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.155 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.155 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:57.155 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:40:57.155 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:40:57.155 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.155 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.155 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.155 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:40:57.155 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:40:57.155 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.155 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.155 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:57.155 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:40:57.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:40:57.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:57.156 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:40:57.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:40:57.156 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.156 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.156 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.156 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:40:57.156 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:57.156 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 42.498306720000002, 2024-04-25T22:40:57.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:40:57.157 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:57.157 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:57.157 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:57.157 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:57.157 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.157 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:57.157 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:57.157 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.157 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.157 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.157 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:57.157 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:57.157 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.157 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.157 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.158 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:57.158 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:40:57.158 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:40:57.158 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.158 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.158 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:57.158 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:40:57.158 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:40:57.158 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.158 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.158 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:57.158 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:40:57.158 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:40:57.158 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:57.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:40:57.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:40:57.159 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:40:57.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:40:57.159 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:57.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:40:57.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:40:57.160 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.160 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.160 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.160 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:57.160 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:57.160 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 42.481408367, 2024-04-25T22:40:57.160 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:40:57.160 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:57.160 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:57.160 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:57.160 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:57.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.160 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:57.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:57.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:57.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:57.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:57.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:57.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:40:57.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:57.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:40:57.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:40:57.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:57.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:40:57.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:40:57.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:57.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:40:57.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:40:57.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.163 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.163 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:40:57.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:40:57.163 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.163 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:57.163 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:40:57.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:40:57.163 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.163 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:57.163 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:40:57.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:40:57.163 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.164 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.164 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.164 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.164 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:57.164 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:57.164 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 42.480587477, 2024-04-25T22:40:57.164 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:40:57.164 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:57.164 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:57.164 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:57.164 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:57.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:57.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:57.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:57.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:57.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:57.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:40:57.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:40:57.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:57.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:40:57.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:40:57.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:57.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:40:57.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:40:57.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:57.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:40:57.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:40:57.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.167 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.167 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:40:57.167 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:40:57.167 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.167 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:57.167 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:40:57.167 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:40:57.167 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.167 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:57.167 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:40:57.168 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:40:57.168 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.168 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.168 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.168 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.168 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.168 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:57.168 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:57.168 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 42.478886748999997, 2024-04-25T22:40:57.168 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:40:57.168 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:57.168 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:57.168 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:57.168 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:57.168 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:57.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:57.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:57.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:57.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:57.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:40:57.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:40:57.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:57.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:40:57.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:40:57.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:57.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:40:57.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:40:57.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:57.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:40:57.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:40:57.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:40:57.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:40:57.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:57.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:40:57.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:40:57.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:57.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:40:57.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:40:57.172 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.172 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.172 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:57.172 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:40:57.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:40:57.172 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.172 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.172 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.172 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.172 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.172 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:57.172 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:57.172 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 42.478290074, 2024-04-25T22:40:57.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:40:57.172 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:57.173 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:57.173 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:57.173 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:57.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:57.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:57.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:57.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:57.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:57.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:40:57.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:40:57.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:57.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:40:57.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:40:57.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:57.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:40:57.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:40:57.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:57.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:40:57.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:40:57.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:40:57.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:40:57.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:57.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:40:57.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:40:57.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:57.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:40:57.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:40:57.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:57.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:40:57.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:40:57.176 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.176 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.176 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.177 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:40:57.177 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:57.177 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 42.468854348000001, 2024-04-25T22:40:57.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:40:57.177 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:57.177 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:57.177 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:57.177 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:57.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:57.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:57.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:57.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:57.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:57.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:57.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:40:57.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:57.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:40:57.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:40:57.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:57.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:40:57.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:40:57.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:57.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:40:57.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:40:57.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:40:57.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:40:57.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.180 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:57.180 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:40:57.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:40:57.180 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.180 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.180 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.180 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.180 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.180 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:57.180 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:57.180 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 42.468206922, 2024-04-25T22:40:57.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:40:57.180 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:57.180 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:57.181 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:57.181 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:57.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:57.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:57.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:57.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:57.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:57.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:40:57.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:40:57.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:57.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:40:57.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:40:57.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:57.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:40:57.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:40:57.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:57.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:40:57.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:40:57.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:40:57.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:40:57.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:57.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:40:57.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:40:57.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.184 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:57.184 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:40:57.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:40:57.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.184 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:57.184 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:40:57.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:40:57.184 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.184 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.184 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.184 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:57.184 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:57.185 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 42.466766102999998, 2024-04-25T22:40:57.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:40:57.185 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:57.185 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:57.185 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:57.185 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:57.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:57.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:57.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:57.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:57.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.186 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:57.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:40:57.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:40:57.186 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:57.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:40:57.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:40:57.186 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:57.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:40:57.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:40:57.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:57.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:40:57.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:40:57.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:40:57.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:40:57.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:57.188 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:40:57.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:40:57.188 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.188 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.188 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:57.188 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:40:57.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:40:57.188 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.188 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.188 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:57.188 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:40:57.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:40:57.188 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.189 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.189 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.189 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:40:57.189 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:57.189 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.514327659000003, 2024-04-25T22:40:57.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:40:57.189 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:57.189 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:57.189 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:57.189 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:57.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:57.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:57.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:57.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:57.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:57.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:40:57.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:40:57.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:57.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:40:57.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:40:57.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:57.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:40:57.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:40:57.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:57.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:40:57.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:40:57.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:40:57.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:40:57.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:57.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:40:57.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:40:57.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:57.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:40:57.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:40:57.193 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.193 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:57.193 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:40:57.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:40:57.193 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.193 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:57.193 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:40:57.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:40:57.193 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:57.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:40:57.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:40:57.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:57.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:40:57.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:40:57.194 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.194 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.194 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.194 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:40:57.195 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:57.195 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 18.511668335, 2024-04-25T22:40:57.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:40:57.195 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:57.195 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:57.195 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:57.195 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:57.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:57.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:57.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:57.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:57.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:57.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:40:57.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:40:57.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:57.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:40:57.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:40:57.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:57.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:40:57.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:40:57.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:57.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:40:57.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:40:57.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:40:57.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:40:57.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:57.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:40:57.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:40:57.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:57.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:40:57.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:40:57.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:57.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:40:57.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:40:57.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:57.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:40:57.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:40:57.199 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:57.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:40:57.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:40:57.199 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:57.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:40:57.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:40:57.199 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.199 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.199 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.200 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:40:57.200 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:57.200 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 13.511376084, 2024-04-25T22:40:57.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:40:57.200 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:57.200 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:57.200 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:57.200 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:57.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:57.200 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:57.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:57.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:57.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:57.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:57.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:40:57.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:40:57.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:57.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:40:57.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:40:57.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:57.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:40:57.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:40:57.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:57.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:40:57.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:40:57.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:57.203 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:40:57.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:40:57.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:57.203 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:40:57.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:40:57.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:57.203 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:40:57.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:40:57.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:40:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:40:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:40:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:40:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:40:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:40:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:57.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:57.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:57.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:40:57.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:40:57.205 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.205 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.205 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.205 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:57.205 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:57.205 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:57.207 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:40:57.208 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:57.207+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:57.275 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:40:57.276 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:40:57.297 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:40:57.297 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:40:57.307 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:57.305+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:57.317 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:40:57.318 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:40:57.342 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:57.342 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:57.356 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:40:57.408 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:57.407+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:57.472 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:57.472 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:57.486 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:40:57.509 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:57.507+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:57.522 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:40:57.524 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:40:57.540 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-04-25T22:40:57.132090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91336,"kb_used_data":1952,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024184,"statfs":{"total":289910292480,"available":289816764416,"internally_reserved":0,"allocated":1998848,"data_stored":1495560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.617270"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:40:45.461332+0000","last_change":"2024-04-25T22:40:36.296993+0000","last_active":"2024-04-25T22:40:45.461332+0000","last_peered":"2024-04-25T22:40:45.461332+0000","last_clean":"2024-04-25T22:40:45.461332+0000","last_became_active":"2024-04-25T22:40:36.296111+0000","last_became_peered":"2024-04-25T22:40:36.296111+0000","last_unstale":"2024-04-25T22:40:45.461332+0000","last_undegraded":"2024-04-25T22:40:45.461332+0000","last_fullsized":"2024-04-25T22:40:45.461332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:03.272640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:40:45.459928+0000","last_change":"2024-04-25T22:40:36.295443+0000","last_active":"2024-04-25T22:40:45.459928+0000","last_peered":"2024-04-25T22:40:45.459928+0000","last_clean":"2024-04-25T22:40:45.459928+0000","last_became_active":"2024-04-25T22:40:36.294248+0000","last_became_peered":"2024-04-25T22:40:36.294248+0000","last_unstale":"2024-04-25T22:40:45.459928+0000","last_undegraded":"2024-04-25T22:40:45.459928+0000","last_fullsized":"2024-04-25T22:40:45.459928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:25.839134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.525411+0000","last_change":"2024-04-25T22:40:14.626211+0000","last_active":"2024-04-25T22:40:51.525411+0000","last_peered":"2024-04-25T22:40:51.525411+0000","last_clean":"2024-04-25T22:40:51.525411+0000","last_became_active":"2024-04-25T22:40:14.622625+0000","last_became_peered":"2024-04-25T22:40:14.622625+0000","last_unstale":"2024-04-25T22:40:51.525411+0000","last_undegraded":"2024-04-25T22:40:51.525411+0000","last_fullsized":"2024-04-25T22:40:51.525411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:35.993000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.524350+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:40:51.524350+0000","last_peered":"2024-04-25T22:40:51.524350+0000","last_clean":"2024-04-25T22:40:51.524350+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:40:51.524350+0000","last_undegraded":"2024-04-25T22:40:51.524350+0000","last_fullsized":"2024-04-25T22:40:51.524350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:40:45.459416+0000","last_change":"2024-04-25T22:40:36.294687+0000","last_active":"2024-04-25T22:40:45.459416+0000","last_peered":"2024-04-25T22:40:45.459416+0000","last_clean":"2024-04-25T22:40:45.459416+0000","last_became_active":"2024-04-25T22:40:36.294114+0000","last_became_peered":"2024-04-25T22:40:36.294114+0000","last_unstale":"2024-04-25T22:40:45.459416+0000","last_undegraded":"2024-04-25T22:40:45.459416+0000","last_fullsized":"2024-04-25T22:40:45.459416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:39:22.907771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.524378+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:40:51.524378+0000","last_peered":"2024-04-25T22:40:51.524378+0000","last_clean":"2024-04-25T22:40:51.524378+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:40:51.524378+0000","last_undegraded":"2024-04-25T22:40:51.524378+0000","last_fullsized":"2024-04-25T22:40:51.524378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.533328+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:40:51.533328+0000","last_peered":"2024-04-25T22:40:51.533328+0000","last_clean":"2024-04-25T22:40:51.533328+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:40:51.533328+0000","last_undegraded":"2024-04-25T22:40:51.533328+0000","last_fullsized":"2024-04-25T22:40:51.533328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.527198+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:40:51.527198+0000","last_peered":"2024-04-25T22:40:51.527198+0000","last_clean":"2024-04-25T22:40:51.527198+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:40:51.527198+0000","last_undegraded":"2024-04-25T22:40:51.527198+0000","last_fullsized":"2024-04-25T22:40:51.527198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.522314+0000","last_change":"2024-04-25T22:40:14.625922+0000","last_active":"2024-04-25T22:40:51.522314+0000","last_peered":"2024-04-25T22:40:51.522314+0000","last_clean":"2024-04-25T22:40:51.522314+0000","last_became_active":"2024-04-25T22:40:14.624594+0000","last_became_peered":"2024-04-25T22:40:14.624594+0000","last_unstale":"2024-04-25T22:40:51.522314+0000","last_undegraded":"2024-04-25T22:40:51.522314+0000","last_fullsized":"2024-04-25T22:40:51.522314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:40:45.459985+0000","last_change":"2024-04-25T22:40:36.298225+0000","last_active":"2024-04-25T22:40:45.459985+0000","last_peered":"2024-04-25T22:40:45.459985+0000","last_clean":"2024-04-25T22:40:45.459985+0000","last_became_active":"2024-04-25T22:40:36.296299+0000","last_became_peered":"2024-04-25T22:40:36.296299+0000","last_unstale":"2024-04-25T22:40:45.459985+0000","last_undegraded":"2024-04-25T22:40:45.459985+0000","last_fullsized":"2024-04-25T22:40:45.459985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:02.464879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.525741+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:40:51.525741+0000","last_peered":"2024-04-25T22:40:51.525741+0000","last_clean":"2024-04-25T22:40:51.525741+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:40:51.525741+0000","last_undegraded":"2024-04-25T22:40:51.525741+0000","last_fullsized":"2024-04-25T22:40:51.525741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.523932+0000","last_change":"2024-04-25T22:40:36.305351+0000","last_active":"2024-04-25T22:40:51.523932+0000","last_peered":"2024-04-25T22:40:51.523932+0000","last_clean":"2024-04-25T22:40:51.523932+0000","last_became_active":"2024-04-25T22:40:36.303042+0000","last_became_peered":"2024-04-25T22:40:36.303042+0000","last_unstale":"2024-04-25T22:40:51.523932+0000","last_undegraded":"2024-04-25T22:40:51.523932+0000","last_fullsized":"2024-04-25T22:40:51.523932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:37.971547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:40:45.459512+0000","last_change":"2024-04-25T22:40:36.296904+0000","last_active":"2024-04-25T22:40:45.459512+0000","last_peered":"2024-04-25T22:40:45.459512+0000","last_clean":"2024-04-25T22:40:45.459512+0000","last_became_active":"2024-04-25T22:40:36.295964+0000","last_became_peered":"2024-04-25T22:40:36.295964+0000","last_unstale":"2024-04-25T22:40:45.459512+0000","last_undegraded":"2024-04-25T22:40:45.459512+0000","last_fullsized":"2024-04-25T22:40:45.459512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:24.977111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.524537+0000","last_change":"2024-04-25T22:40:14.616800+0000","last_active":"2024-04-25T22:40:51.524537+0000","last_peered":"2024-04-25T22:40:51.524537+0000","last_clean":"2024-04-25T22:40:51.524537+0000","last_became_active":"2024-04-25T22:40:14.612887+0000","last_became_peered":"2024-04-25T22:40:14.612887+0000","last_unstale":"2024-04-25T22:40:51.524537+0000","last_undegraded":"2024-04-25T22:40:51.524537+0000","last_fullsized":"2024-04-25T22:40:51.524537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.533536+0000","last_change":"2024-04-25T22:40:14.615520+0000","last_active":"2024-04-25T22:40:51.533536+0000","last_peered":"2024-04-25T22:40:51.533536+0000","last_clean":"2024-04-25T22:40:51.533536+0000","last_became_active":"2024-04-25T22:40:14.613556+0000","last_became_peered":"2024-04-25T22:40:14.613556+0000","last_unstale":"2024-04-25T22:40:51.533536+0000","last_undegraded":"2024-04-25T22:40:51.533536+0000","last_fullsized":"2024-04-25T22:40:51.533536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.528290+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:40:51.528290+0000","last_peered":"2024-04-25T22:40:51.528290+0000","last_clean":"2024-04-25T22:40:51.528290+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:40:51.528290+0000","last_undegraded":"2024-04-25T22:40:51.528290+0000","last_fullsized":"2024-04-25T22:40:51.528290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.527901+0000","last_change":"2024-04-25T22:40:14.628222+0000","last_active":"2024-04-25T22:40:51.527901+0000","last_peered":"2024-04-25T22:40:51.527901+0000","last_clean":"2024-04-25T22:40:51.527901+0000","last_became_active":"2024-04-25T22:40:14.626913+0000","last_became_peered":"2024-04-25T22:40:14.626913+0000","last_unstale":"2024-04-25T22:40:51.527901+0000","last_undegraded":"2024-04-25T22:40:51.527901+0000","last_fullsized":"2024-04-25T22:40:51.527901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:40:45.460706+0000","last_change":"2024-04-25T22:40:36.300373+0000","last_active":"2024-04-25T22:40:45.460706+0000","last_peered":"2024-04-25T22:40:45.460706+0000","last_clean":"2024-04-25T22:40:45.460706+0000","last_became_active":"2024-04-25T22:40:36.299647+0000","last_became_peered":"2024-04-25T22:40:36.299647+0000","last_unstale":"2024-04-25T22:40:45.460706+0000","last_undegraded":"2024-04-25T22:40:45.460706+0000","last_fullsized":"2024-04-25T22:40:45.460706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:19.327397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.519080+0000","last_change":"2024-04-25T22:40:14.623704+0000","last_active":"2024-04-25T22:40:51.519080+0000","last_peered":"2024-04-25T22:40:51.519080+0000","last_clean":"2024-04-25T22:40:51.519080+0000","last_became_active":"2024-04-25T22:40:14.623146+0000","last_became_peered":"2024-04-25T22:40:14.623146+0000","last_unstale":"2024-04-25T22:40:51.519080+0000","last_undegraded":"2024-04-25T22:40:51.519080+0000","last_fullsized":"2024-04-25T22:40:51.519080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.524951+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:40:51.524951+0000","last_peered":"2024-04-25T22:40:51.524951+0000","last_clean":"2024-04-25T22:40:51.524951+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:40:51.524951+0000","last_undegraded":"2024-04-25T22:40:51.524951+0000","last_fullsized":"2024-04-25T22:40:51.524951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.531561+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:40:51.531561+0000","last_peered":"2024-04-25T22:40:51.531561+0000","last_clean":"2024-04-25T22:40:51.531561+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:40:51.531561+0000","last_undegraded":"2024-04-25T22:40:51.531561+0000","last_fullsized":"2024-04-25T22:40:51.531561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.523808+0000","last_change":"2024-04-25T22:40:36.305858+0000","last_active":"2024-04-25T22:40:51.523808+0000","last_peered":"2024-04-25T22:40:51.523808+0000","last_clean":"2024-04-25T22:40:51.523808+0000","last_became_active":"2024-04-25T22:40:36.304730+0000","last_became_peered":"2024-04-25T22:40:36.304730+0000","last_unstale":"2024-04-25T22:40:51.523808+0000","last_undegraded":"2024-04-25T22:40:51.523808+0000","last_fullsized":"2024-04-25T22:40:51.523808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:44.949501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":3,"reported_epoch":30,"state":"peering","last_fresh":"2024-04-25T22:40:51.523764+0000","last_change":"2024-04-25T22:40:51.523764+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:51.523764+0000","last_undegraded":"2024-04-25T22:40:51.523764+0000","last_fullsized":"2024-04-25T22:40:51.523764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:40:45.459049+0000","last_change":"2024-04-25T22:40:36.293289+0000","last_active":"2024-04-25T22:40:45.459049+0000","last_peered":"2024-04-25T22:40:45.459049+0000","last_clean":"2024-04-25T22:40:45.459049+0000","last_became_active":"2024-04-25T22:40:36.292483+0000","last_became_peered":"2024-04-25T22:40:36.292483+0000","last_unstale":"2024-04-25T22:40:45.459049+0000","last_undegraded":"2024-04-25T22:40:45.459049+0000","last_fullsized":"2024-04-25T22:40:45.459049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:51.686908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.524582+0000","last_change":"2024-04-25T22:40:36.304773+0000","last_active":"2024-04-25T22:40:51.524582+0000","last_peered":"2024-04-25T22:40:51.524582+0000","last_clean":"2024-04-25T22:40:51.524582+0000","last_became_active":"2024-04-25T22:40:36.304073+0000","last_became_peered":"2024-04-25T22:40:36.304073+0000","last_unstale":"2024-04-25T22:40:51.524582+0000","last_undegraded":"2024-04-25T22:40:51.524582+0000","last_fullsized":"2024-04-25T22:40:51.524582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:02.464879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":3,"reported_epoch":30,"state":"peering","last_fresh":"2024-04-25T22:40:51.530896+0000","last_change":"2024-04-25T22:40:51.530896+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:51.530896+0000","last_undegraded":"2024-04-25T22:40:51.530896+0000","last_fullsized":"2024-04-25T22:40:51.530896+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.525855+0000","last_change":"2024-04-25T22:40:14.630596+0000","last_active":"2024-04-25T22:40:51.525855+0000","last_peered":"2024-04-25T22:40:51.525855+0000","last_clean":"2024-04-25T22:40:51.525855+0000","last_became_active":"2024-04-25T22:40:14.625407+0000","last_became_peered":"2024-04-25T22:40:14.625407+0000","last_unstale":"2024-04-25T22:40:51.525855+0000","last_undegraded":"2024-04-25T22:40:51.525855+0000","last_fullsized":"2024-04-25T22:40:51.525855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:20:05.398182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.524083+0000","last_change":"2024-04-25T22:40:36.303740+0000","last_active":"2024-04-25T22:40:51.524083+0000","last_peered":"2024-04-25T22:40:51.524083+0000","last_clean":"2024-04-25T22:40:51.524083+0000","last_became_active":"2024-04-25T22:40:36.303305+0000","last_became_peered":"2024-04-25T22:40:36.303305+0000","last_unstale":"2024-04-25T22:40:51.524083+0000","last_undegraded":"2024-04-25T22:40:51.524083+0000","last_fullsized":"2024-04-25T22:40:51.524083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:03.272640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.519115+0000","last_change":"2024-04-25T22:40:14.620608+0000","last_active":"2024-04-25T22:40:51.519115+0000","last_peered":"2024-04-25T22:40:51.519115+0000","last_clean":"2024-04-25T22:40:51.519115+0000","last_became_active":"2024-04-25T22:40:14.618171+0000","last_became_peered":"2024-04-25T22:40:14.618171+0000","last_unstale":"2024-04-25T22:40:51.519115+0000","last_undegraded":"2024-04-25T22:40:51.519115+0000","last_fullsized":"2024-04-25T22:40:51.519115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.524215+0000","last_change":"2024-04-25T22:40:36.305391+0000","last_active":"2024-04-25T22:40:51.524215+0000","last_peered":"2024-04-25T22:40:51.524215+0000","last_clean":"2024-04-25T22:40:51.524215+0000","last_became_active":"2024-04-25T22:40:36.302601+0000","last_became_peered":"2024-04-25T22:40:36.302601+0000","last_unstale":"2024-04-25T22:40:51.524215+0000","last_undegraded":"2024-04-25T22:40:51.524215+0000","last_fullsized":"2024-04-25T22:40:51.524215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:54.909669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.516155+0000","last_change":"2024-04-25T22:40:14.618468+0000","last_active":"2024-04-25T22:40:51.516155+0000","last_peered":"2024-04-25T22:40:51.516155+0000","last_clean":"2024-04-25T22:40:51.516155+0000","last_became_active":"2024-04-25T22:40:14.617312+0000","last_became_peered":"2024-04-25T22:40:14.617312+0000","last_unstale":"2024-04-25T22:40:51.516155+0000","last_undegraded":"2024-04-25T22:40:51.516155+0000","last_fullsized":"2024-04-25T22:40:51.516155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:12.679354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.527736+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:40:51.527736+0000","last_peered":"2024-04-25T22:40:51.527736+0000","last_clean":"2024-04-25T22:40:51.527736+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:40:51.527736+0000","last_undegraded":"2024-04-25T22:40:51.527736+0000","last_fullsized":"2024-04-25T22:40:51.527736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:40:45.459959+0000","last_change":"2024-04-25T22:40:36.296749+0000","last_active":"2024-04-25T22:40:45.459959+0000","last_peered":"2024-04-25T22:40:45.459959+0000","last_clean":"2024-04-25T22:40:45.459959+0000","last_became_active":"2024-04-25T22:40:36.295933+0000","last_became_peered":"2024-04-25T22:40:36.295933+0000","last_unstale":"2024-04-25T22:40:45.459959+0000","last_undegraded":"2024-04-25T22:40:45.459959+0000","last_fullsized":"2024-04-25T22:40:45.459959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:18.491547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.531999+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:40:51.531999+0000","last_peered":"2024-04-25T22:40:51.531999+0000","last_clean":"2024-04-25T22:40:51.531999+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:40:51.531999+0000","last_undegraded":"2024-04-25T22:40:51.531999+0000","last_fullsized":"2024-04-25T22:40:51.531999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:40:45.459879+0000","last_change":"2024-04-25T22:40:36.298200+0000","last_active":"2024-04-25T22:40:45.459879+0000","last_peered":"2024-04-25T22:40:45.459879+0000","last_clean":"2024-04-25T22:40:45.459879+0000","last_became_active":"2024-04-25T22:40:36.296613+0000","last_became_peered":"2024-04-25T22:40:36.296613+0000","last_unstale":"2024-04-25T22:40:45.459879+0000","last_undegraded":"2024-04-25T22:40:45.459879+0000","last_fullsized":"2024-04-25T22:40:45.459879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:12.611590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":3,"reported_epoch":30,"state":"peering","last_fresh":"2024-04-25T22:40:51.530812+0000","last_change":"2024-04-25T22:40:51.530812+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:51.530812+0000","last_undegraded":"2024-04-25T22:40:51.530812+0000","last_fullsized":"2024-04-25T22:40:51.530812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":3,"reported_epoch":30,"state":"peering","last_fresh":"2024-04-25T22:40:51.528053+0000","last_change":"2024-04-25T22:40:51.528053+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:51.528053+0000","last_undegraded":"2024-04-25T22:40:51.528053+0000","last_fullsized":"2024-04-25T22:40:51.528053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.530985+0000","last_change":"2024-04-25T22:40:36.306844+0000","last_active":"2024-04-25T22:40:51.530985+0000","last_peered":"2024-04-25T22:40:51.530985+0000","last_clean":"2024-04-25T22:40:51.530985+0000","last_became_active":"2024-04-25T22:40:36.303223+0000","last_became_peered":"2024-04-25T22:40:36.303223+0000","last_unstale":"2024-04-25T22:40:51.530985+0000","last_undegraded":"2024-04-25T22:40:51.530985+0000","last_fullsized":"2024-04-25T22:40:51.530985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:21.069965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":3,"reported_epoch":30,"state":"peering","last_fresh":"2024-04-25T22:40:51.524741+0000","last_change":"2024-04-25T22:40:51.524741+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:51.524741+0000","last_undegraded":"2024-04-25T22:40:51.524741+0000","last_fullsized":"2024-04-25T22:40:51.524741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.528233+0000","last_change":"2024-04-25T22:40:13.599918+0000","last_active":"2024-04-25T22:40:51.528233+0000","last_peered":"2024-04-25T22:40:51.528233+0000","last_clean":"2024-04-25T22:40:51.528233+0000","last_became_active":"2024-04-25T22:40:13.596461+0000","last_became_peered":"2024-04-25T22:40:13.596461+0000","last_unstale":"2024-04-25T22:40:51.528233+0000","last_undegraded":"2024-04-25T22:40:51.528233+0000","last_fullsized":"2024-04-25T22:40:51.528233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:41:51.887162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.533649+0000","last_change":"2024-04-25T22:40:13.598294+0000","last_active":"2024-04-25T22:40:51.533649+0000","last_peered":"2024-04-25T22:40:51.533649+0000","last_clean":"2024-04-25T22:40:51.533649+0000","last_became_active":"2024-04-25T22:40:13.596687+0000","last_became_peered":"2024-04-25T22:40:13.596687+0000","last_unstale":"2024-04-25T22:40:51.533649+0000","last_undegraded":"2024-04-25T22:40:51.533649+0000","last_fullsized":"2024-04-25T22:40:51.533649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:50:49.280995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.523637+0000","last_change":"2024-04-25T22:40:36.302843+0000","last_active":"2024-04-25T22:40:51.523637+0000","last_peered":"2024-04-25T22:40:51.523637+0000","last_clean":"2024-04-25T22:40:51.523637+0000","last_became_active":"2024-04-25T22:40:36.302275+0000","last_became_peered":"2024-04-25T22:40:36.302275+0000","last_unstale":"2024-04-25T22:40:51.523637+0000","last_undegraded":"2024-04-25T22:40:51.523637+0000","last_fullsized":"2024-04-25T22:40:51.523637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:24.977111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.527520+0000","last_change":"2024-04-25T22:40:36.304995+0000","last_active":"2024-04-25T22:40:51.527520+0000","last_peered":"2024-04-25T22:40:51.527520+0000","last_clean":"2024-04-25T22:40:51.527520+0000","last_became_active":"2024-04-25T22:40:36.304133+0000","last_became_peered":"2024-04-25T22:40:36.304133+0000","last_unstale":"2024-04-25T22:40:51.527520+0000","last_undegraded":"2024-04-25T22:40:51.527520+0000","last_fullsized":"2024-04-25T22:40:51.527520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:06:24.787279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:40:45.459112+0000","last_change":"2024-04-25T22:40:36.295350+0000","last_active":"2024-04-25T22:40:45.459112+0000","last_peered":"2024-04-25T22:40:45.459112+0000","last_clean":"2024-04-25T22:40:45.459112+0000","last_became_active":"2024-04-25T22:40:36.294081+0000","last_became_peered":"2024-04-25T22:40:36.294081+0000","last_unstale":"2024-04-25T22:40:45.459112+0000","last_undegraded":"2024-04-25T22:40:45.459112+0000","last_fullsized":"2024-04-25T22:40:45.459112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:57:06.769650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.527369+0000","last_change":"2024-04-25T22:40:13.601404+0000","last_active":"2024-04-25T22:40:51.527369+0000","last_peered":"2024-04-25T22:40:51.527369+0000","last_clean":"2024-04-25T22:40:51.527369+0000","last_became_active":"2024-04-25T22:40:13.600688+0000","last_became_peered":"2024-04-25T22:40:13.600688+0000","last_unstale":"2024-04-25T22:40:51.527369+0000","last_undegraded":"2024-04-25T22:40:51.527369+0000","last_fullsized":"2024-04-25T22:40:51.527369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:36.157648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.527159+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:40:51.527159+0000","last_peered":"2024-04-25T22:40:51.527159+0000","last_clean":"2024-04-25T22:40:51.527159+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:40:51.527159+0000","last_undegraded":"2024-04-25T22:40:51.527159+0000","last_fullsized":"2024-04-25T22:40:51.527159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.527061+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:40:51.527061+0000","last_peered":"2024-04-25T22:40:51.527061+0000","last_clean":"2024-04-25T22:40:51.527061+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:40:51.527061+0000","last_undegraded":"2024-04-25T22:40:51.527061+0000","last_fullsized":"2024-04-25T22:40:51.527061+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":3,"reported_epoch":30,"state":"peering","last_fresh":"2024-04-25T22:40:51.524982+0000","last_change":"2024-04-25T22:40:51.524982+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:51.524982+0000","last_undegraded":"2024-04-25T22:40:51.524982+0000","last_fullsized":"2024-04-25T22:40:51.524982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":30,"state":"peering","last_fresh":"2024-04-25T22:40:51.534141+0000","last_change":"2024-04-25T22:40:51.534141+0000","last_active":"2024-04-25T22:40:51.534141+0000","last_peered":"2024-04-25T22:40:14.599222+0000","last_clean":"2024-04-25T22:40:14.599222+0000","last_became_active":"2024-04-25T22:40:13.581263+0000","last_became_peered":"2024-04-25T22:40:13.581263+0000","last_unstale":"2024-04-25T22:40:51.534141+0000","last_undegraded":"2024-04-25T22:40:51.534141+0000","last_fullsized":"2024-04-25T22:40:51.534141+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.524885+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:40:51.524885+0000","last_peered":"2024-04-25T22:40:51.524885+0000","last_clean":"2024-04-25T22:40:51.524885+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:40:51.524885+0000","last_undegraded":"2024-04-25T22:40:51.524885+0000","last_fullsized":"2024-04-25T22:40:51.524885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.527559+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:40:51.527559+0000","last_peered":"2024-04-25T22:40:51.527559+0000","last_clean":"2024-04-25T22:40:51.527559+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:40:51.527559+0000","last_undegraded":"2024-04-25T22:40:51.527559+0000","last_fullsized":"2024-04-25T22:40:51.527559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.526168+0000","last_change":"2024-04-25T22:40:14.621941+0000","last_active":"2024-04-25T22:40:51.526168+0000","last_peered":"2024-04-25T22:40:51.526168+0000","last_clean":"2024-04-25T22:40:51.526168+0000","last_became_active":"2024-04-25T22:40:14.614196+0000","last_became_peered":"2024-04-25T22:40:14.614196+0000","last_unstale":"2024-04-25T22:40:51.526168+0000","last_undegraded":"2024-04-25T22:40:51.526168+0000","last_fullsized":"2024-04-25T22:40:51.526168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:24.895025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.531344+0000","last_change":"2024-04-25T22:40:36.305242+0000","last_active":"2024-04-25T22:40:51.531344+0000","last_peered":"2024-04-25T22:40:51.531344+0000","last_clean":"2024-04-25T22:40:51.531344+0000","last_became_active":"2024-04-25T22:40:36.302259+0000","last_became_peered":"2024-04-25T22:40:36.302259+0000","last_unstale":"2024-04-25T22:40:51.531344+0000","last_undegraded":"2024-04-25T22:40:51.531344+0000","last_fullsized":"2024-04-25T22:40:51.531344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:48.252489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.527707+0000","last_change":"2024-04-25T22:40:14.614275+0000","last_active":"2024-04-25T22:40:51.527707+0000","last_peered":"2024-04-25T22:40:51.527707+0000","last_clean":"2024-04-25T22:40:51.527707+0000","last_became_active":"2024-04-25T22:40:14.613038+0000","last_became_peered":"2024-04-25T22:40:14.613038+0000","last_unstale":"2024-04-25T22:40:51.527707+0000","last_undegraded":"2024-04-25T22:40:51.527707+0000","last_fullsized":"2024-04-25T22:40:51.527707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:14:02.343388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:40:45.459059+0000","last_change":"2024-04-25T22:40:36.293392+0000","last_active":"2024-04-25T22:40:45.459059+0000","last_peered":"2024-04-25T22:40:45.459059+0000","last_clean":"2024-04-25T22:40:45.459059+0000","last_became_active":"2024-04-25T22:40:36.292567+0000","last_became_peered":"2024-04-25T22:40:36.292567+0000","last_unstale":"2024-04-25T22:40:45.459059+0000","last_undegraded":"2024-04-25T22:40:45.459059+0000","last_fullsized":"2024-04-25T22:40:45.459059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:21.419443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.522608+0000","last_change":"2024-04-25T22:40:14.627280+0000","last_active":"2024-04-25T22:40:51.522608+0000","last_peered":"2024-04-25T22:40:51.522608+0000","last_clean":"2024-04-25T22:40:51.522608+0000","last_became_active":"2024-04-25T22:40:14.624656+0000","last_became_peered":"2024-04-25T22:40:14.624656+0000","last_unstale":"2024-04-25T22:40:51.522608+0000","last_undegraded":"2024-04-25T22:40:51.522608+0000","last_fullsized":"2024-04-25T22:40:51.522608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":243,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.533567+0000","last_change":"2024-04-25T22:40:04.317146+0000","last_active":"2024-04-25T22:40:51.533567+0000","last_peered":"2024-04-25T22:40:51.533567+0000","last_clean":"2024-04-25T22:40:51.533567+0000","last_became_active":"2024-04-25T22:40:04.316527+0000","last_became_peered":"2024-04-25T22:40:04.316527+0000","last_unstale":"2024-04-25T22:40:51.533567+0000","last_undegraded":"2024-04-25T22:40:51.533567+0000","last_fullsized":"2024-04-25T22:40:51.533567+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:25.669997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.533809+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:40:51.533809+0000","last_peered":"2024-04-25T22:40:51.533809+0000","last_clean":"2024-04-25T22:40:51.533809+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:40:51.533809+0000","last_undegraded":"2024-04-25T22:40:51.533809+0000","last_fullsized":"2024-04-25T22:40:51.533809+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.521089+0000","last_change":"2024-04-25T22:40:13.591980+0000","last_active":"2024-04-25T22:40:51.521089+0000","last_peered":"2024-04-25T22:40:51.521089+0000","last_clean":"2024-04-25T22:40:51.521089+0000","last_became_active":"2024-04-25T22:40:13.591152+0000","last_became_peered":"2024-04-25T22:40:13.591152+0000","last_unstale":"2024-04-25T22:40:51.521089+0000","last_undegraded":"2024-04-25T22:40:51.521089+0000","last_fullsized":"2024-04-25T22:40:51.521089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.527263+0000","last_change":"2024-04-25T22:40:14.621472+0000","last_active":"2024-04-25T22:40:51.527263+0000","last_peered":"2024-04-25T22:40:51.527263+0000","last_clean":"2024-04-25T22:40:51.527263+0000","last_became_active":"2024-04-25T22:40:14.613608+0000","last_became_peered":"2024-04-25T22:40:14.613608+0000","last_unstale":"2024-04-25T22:40:51.527263+0000","last_undegraded":"2024-04-25T22:40:51.527263+0000","last_fullsized":"2024-04-25T22:40:51.527263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:51.686908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.533402+0000","last_change":"2024-04-25T22:40:09.502444+0000","last_active":"2024-04-25T22:40:51.533402+0000","last_peered":"2024-04-25T22:40:51.533402+0000","last_clean":"2024-04-25T22:40:51.533402+0000","last_became_active":"2024-04-25T22:40:09.501576+0000","last_became_peered":"2024-04-25T22:40:09.501576+0000","last_unstale":"2024-04-25T22:40:51.533402+0000","last_undegraded":"2024-04-25T22:40:51.533402+0000","last_fullsized":"2024-04-25T22:40:51.533402+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:35:14.955359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":3,"reported_epoch":30,"state":"peering","last_fresh":"2024-04-25T22:40:51.534852+0000","last_change":"2024-04-25T22:40:51.534852+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:51.534852+0000","last_undegraded":"2024-04-25T22:40:51.534852+0000","last_fullsized":"2024-04-25T22:40:51.534852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:40:45.460194+0000","last_change":"2024-04-25T22:40:36.298928+0000","last_active":"2024-04-25T22:40:45.460194+0000","last_peered":"2024-04-25T22:40:45.460194+0000","last_clean":"2024-04-25T22:40:45.460194+0000","last_became_active":"2024-04-25T22:40:36.298266+0000","last_became_peered":"2024-04-25T22:40:36.298266+0000","last_unstale":"2024-04-25T22:40:45.460194+0000","last_undegraded":"2024-04-25T22:40:45.460194+0000","last_fullsized":"2024-04-25T22:40:45.460194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:49.281475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.527203+0000","last_change":"2024-04-25T22:40:09.501323+0000","last_active":"2024-04-25T22:40:51.527203+0000","last_peered":"2024-04-25T22:40:51.527203+0000","last_clean":"2024-04-25T22:40:51.527203+0000","last_became_active":"2024-04-25T22:40:09.500499+0000","last_became_peered":"2024-04-25T22:40:09.500499+0000","last_unstale":"2024-04-25T22:40:51.527203+0000","last_undegraded":"2024-04-25T22:40:51.527203+0000","last_fullsized":"2024-04-25T22:40:51.527203+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:30.289572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.524071+0000","last_change":"2024-04-25T22:40:36.303534+0000","last_active":"2024-04-25T22:40:51.524071+0000","last_peered":"2024-04-25T22:40:51.524071+0000","last_clean":"2024-04-25T22:40:51.524071+0000","last_became_active":"2024-04-25T22:40:36.302351+0000","last_became_peered":"2024-04-25T22:40:36.302351+0000","last_unstale":"2024-04-25T22:40:51.524071+0000","last_undegraded":"2024-04-25T22:40:51.524071+0000","last_fullsized":"2024-04-25T22:40:51.524071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:31:09.162739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.524776+0000","last_change":"2024-04-25T22:40:14.628007+0000","last_active":"2024-04-25T22:40:51.524776+0000","last_peered":"2024-04-25T22:40:51.524776+0000","last_clean":"2024-04-25T22:40:51.524776+0000","last_became_active":"2024-04-25T22:40:14.625425+0000","last_became_peered":"2024-04-25T22:40:14.625425+0000","last_unstale":"2024-04-25T22:40:51.524776+0000","last_undegraded":"2024-04-25T22:40:51.524776+0000","last_fullsized":"2024-04-25T22:40:51.524776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.528077+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:40:51.528077+0000","last_peered":"2024-04-25T22:40:51.528077+0000","last_clean":"2024-04-25T22:40:51.528077+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:40:51.528077+0000","last_undegraded":"2024-04-25T22:40:51.528077+0000","last_fullsized":"2024-04-25T22:40:51.528077+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.533671+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:40:51.533671+0000","last_peered":"2024-04-25T22:40:51.533671+0000","last_clean":"2024-04-25T22:40:51.533671+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:40:51.533671+0000","last_undegraded":"2024-04-25T22:40:51.533671+0000","last_fullsized":"2024-04-25T22:40:51.533671+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.521054+0000","last_change":"2024-04-25T22:40:14.622442+0000","last_active":"2024-04-25T22:40:51.521054+0000","last_peered":"2024-04-25T22:40:51.521054+0000","last_clean":"2024-04-25T22:40:51.521054+0000","last_became_active":"2024-04-25T22:40:14.621130+0000","last_became_peered":"2024-04-25T22:40:14.621130+0000","last_unstale":"2024-04-25T22:40:51.521054+0000","last_undegraded":"2024-04-25T22:40:51.521054+0000","last_fullsized":"2024-04-25T22:40:51.521054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.527654+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:40:51.527654+0000","last_peered":"2024-04-25T22:40:51.527654+0000","last_clean":"2024-04-25T22:40:51.527654+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:40:51.527654+0000","last_undegraded":"2024-04-25T22:40:51.527654+0000","last_fullsized":"2024-04-25T22:40:51.527654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.521636+0000","last_change":"2024-04-25T22:40:09.501325+0000","last_active":"2024-04-25T22:40:51.521636+0000","last_peered":"2024-04-25T22:40:51.521636+0000","last_clean":"2024-04-25T22:40:51.521636+0000","last_became_active":"2024-04-25T22:40:09.500542+0000","last_became_peered":"2024-04-25T22:40:09.500542+0000","last_unstale":"2024-04-25T22:40:51.521636+0000","last_undegraded":"2024-04-25T22:40:51.521636+0000","last_fullsized":"2024-04-25T22:40:51.521636+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:34:38.234538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.524296+0000","last_change":"2024-04-25T22:40:36.306443+0000","last_active":"2024-04-25T22:40:51.524296+0000","last_peered":"2024-04-25T22:40:51.524296+0000","last_clean":"2024-04-25T22:40:51.524296+0000","last_became_active":"2024-04-25T22:40:36.303568+0000","last_became_peered":"2024-04-25T22:40:36.303568+0000","last_unstale":"2024-04-25T22:40:51.524296+0000","last_undegraded":"2024-04-25T22:40:51.524296+0000","last_fullsized":"2024-04-25T22:40:51.524296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:43:42.692718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.521353+0000","last_change":"2024-04-25T22:40:13.591256+0000","last_active":"2024-04-25T22:40:51.521353+0000","last_peered":"2024-04-25T22:40:51.521353+0000","last_clean":"2024-04-25T22:40:51.521353+0000","last_became_active":"2024-04-25T22:40:13.590744+0000","last_became_peered":"2024-04-25T22:40:13.590744+0000","last_unstale":"2024-04-25T22:40:51.521353+0000","last_undegraded":"2024-04-25T22:40:51.521353+0000","last_fullsized":"2024-04-25T22:40:51.521353+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:50.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:40:45.460176+0000","last_change":"2024-04-25T22:40:36.300605+0000","last_active":"2024-04-25T22:40:45.460176+0000","last_peered":"2024-04-25T22:40:45.460176+0000","last_clean":"2024-04-25T22:40:45.460176+0000","last_became_active":"2024-04-25T22:40:36.299998+0000","last_became_peered":"2024-04-25T22:40:36.299998+0000","last_unstale":"2024-04-25T22:40:45.460176+0000","last_undegraded":"2024-04-25T22:40:45.460176+0000","last_fullsized":"2024-04-25T22:40:45.460176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:49.794261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.524772+0000","last_change":"2024-04-25T22:40:36.305326+0000","last_active":"2024-04-25T22:40:51.524772+0000","last_peered":"2024-04-25T22:40:51.524772+0000","last_clean":"2024-04-25T22:40:51.524772+0000","last_became_active":"2024-04-25T22:40:36.302867+0000","last_became_peered":"2024-04-25T22:40:36.302867+0000","last_unstale":"2024-04-25T22:40:51.524772+0000","last_undegraded":"2024-04-25T22:40:51.524772+0000","last_fullsized":"2024-04-25T22:40:51.524772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:19.327397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.528167+0000","last_change":"2024-04-25T22:40:13.592055+0000","last_active":"2024-04-25T22:40:51.528167+0000","last_peered":"2024-04-25T22:40:51.528167+0000","last_clean":"2024-04-25T22:40:51.528167+0000","last_became_active":"2024-04-25T22:40:13.591169+0000","last_became_peered":"2024-04-25T22:40:13.591169+0000","last_unstale":"2024-04-25T22:40:51.528167+0000","last_undegraded":"2024-04-25T22:40:51.528167+0000","last_fullsized":"2024-04-25T22:40:51.528167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:33.458799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.528000+0000","last_change":"2024-04-25T22:40:09.501358+0000","last_active":"2024-04-25T22:40:51.528000+0000","last_peered":"2024-04-25T22:40:51.528000+0000","last_clean":"2024-04-25T22:40:51.528000+0000","last_became_active":"2024-04-25T22:40:09.500626+0000","last_became_peered":"2024-04-25T22:40:09.500626+0000","last_unstale":"2024-04-25T22:40:51.528000+0000","last_undegraded":"2024-04-25T22:40:51.528000+0000","last_fullsized":"2024-04-25T22:40:51.528000+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:55.182967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":3,"reported_epoch":30,"state":"peering","last_fresh":"2024-04-25T22:40:51.524386+0000","last_change":"2024-04-25T22:40:51.524386+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:51.524386+0000","last_undegraded":"2024-04-25T22:40:51.524386+0000","last_fullsized":"2024-04-25T22:40:51.524386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"25'3","reported_seq":30,"reported_epoch":30,"state":"peering","last_fresh":"2024-04-25T22:40:51.528367+0000","last_change":"2024-04-25T22:40:51.528367+0000","last_active":"2024-04-25T22:40:51.528367+0000","last_peered":"2024-04-25T22:40:43.418925+0000","last_clean":"2024-04-25T22:40:43.418925+0000","last_became_active":"2024-04-25T22:40:13.592338+0000","last_became_peered":"2024-04-25T22:40:13.592338+0000","last_unstale":"2024-04-25T22:40:51.528367+0000","last_undegraded":"2024-04-25T22:40:51.528367+0000","last_fullsized":"2024-04-25T22:40:51.528367+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.533637+0000","last_change":"2024-04-25T22:40:09.500948+0000","last_active":"2024-04-25T22:40:51.533637+0000","last_peered":"2024-04-25T22:40:51.533637+0000","last_clean":"2024-04-25T22:40:51.533637+0000","last_became_active":"2024-04-25T22:40:09.500236+0000","last_became_peered":"2024-04-25T22:40:09.500236+0000","last_unstale":"2024-04-25T22:40:51.533637+0000","last_undegraded":"2024-04-25T22:40:51.533637+0000","last_fullsized":"2024-04-25T22:40:51.533637+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:02.375961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.530834+0000","last_change":"2024-04-25T22:40:36.306177+0000","last_active":"2024-04-25T22:40:51.530834+0000","last_peered":"2024-04-25T22:40:51.530834+0000","last_clean":"2024-04-25T22:40:51.530834+0000","last_became_active":"2024-04-25T22:40:36.304767+0000","last_became_peered":"2024-04-25T22:40:36.304767+0000","last_unstale":"2024-04-25T22:40:51.530834+0000","last_undegraded":"2024-04-25T22:40:51.530834+0000","last_fullsized":"2024-04-25T22:40:51.530834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:31.194700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.528296+0000","last_change":"2024-04-25T22:40:14.619806+0000","last_active":"2024-04-25T22:40:51.528296+0000","last_peered":"2024-04-25T22:40:51.528296+0000","last_clean":"2024-04-25T22:40:51.528296+0000","last_became_active":"2024-04-25T22:40:14.618980+0000","last_became_peered":"2024-04-25T22:40:14.618980+0000","last_unstale":"2024-04-25T22:40:51.528296+0000","last_undegraded":"2024-04-25T22:40:51.528296+0000","last_fullsized":"2024-04-25T22:40:51.528296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"26'10","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.527932+0000","last_change":"2024-04-25T22:40:13.598003+0000","last_active":"2024-04-25T22:40:51.527932+0000","last_peered":"2024-04-25T22:40:51.527932+0000","last_clean":"2024-04-25T22:40:51.527932+0000","last_became_active":"2024-04-25T22:40:13.596631+0000","last_became_peered":"2024-04-25T22:40:13.596631+0000","last_unstale":"2024-04-25T22:40:51.527932+0000","last_undegraded":"2024-04-25T22:40:51.527932+0000","last_fullsized":"2024-04-25T22:40:51.527932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:50.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.519875+0000","last_change":"2024-04-25T22:40:14.620064+0000","last_active":"2024-04-25T22:40:51.519875+0000","last_peered":"2024-04-25T22:40:51.519875+0000","last_clean":"2024-04-25T22:40:51.519875+0000","last_became_active":"2024-04-25T22:40:14.619294+0000","last_became_peered":"2024-04-25T22:40:14.619294+0000","last_unstale":"2024-04-25T22:40:51.519875+0000","last_undegraded":"2024-04-25T22:40:51.519875+0000","last_fullsized":"2024-04-25T22:40:51.519875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.526081+0000","last_change":"2024-04-25T22:40:36.307956+0000","last_active":"2024-04-25T22:40:51.526081+0000","last_peered":"2024-04-25T22:40:51.526081+0000","last_clean":"2024-04-25T22:40:51.526081+0000","last_became_active":"2024-04-25T22:40:36.306587+0000","last_became_peered":"2024-04-25T22:40:36.306587+0000","last_unstale":"2024-04-25T22:40:51.526081+0000","last_undegraded":"2024-04-25T22:40:51.526081+0000","last_fullsized":"2024-04-25T22:40:51.526081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:32.249184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.531344+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:40:51.531344+0000","last_peered":"2024-04-25T22:40:51.531344+0000","last_clean":"2024-04-25T22:40:51.531344+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:40:51.531344+0000","last_undegraded":"2024-04-25T22:40:51.531344+0000","last_fullsized":"2024-04-25T22:40:51.531344+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":3,"reported_epoch":30,"state":"peering","last_fresh":"2024-04-25T22:40:51.524553+0000","last_change":"2024-04-25T22:40:51.524553+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:51.524553+0000","last_undegraded":"2024-04-25T22:40:51.524553+0000","last_fullsized":"2024-04-25T22:40:51.524553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":3,"reported_epoch":30,"state":"peering","last_fresh":"2024-04-25T22:40:51.531591+0000","last_change":"2024-04-25T22:40:51.531591+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:51.531591+0000","last_undegraded":"2024-04-25T22:40:51.531591+0000","last_fullsized":"2024-04-25T22:40:51.531591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.520745+0000","last_change":"2024-04-25T22:40:14.619640+0000","last_active":"2024-04-25T22:40:51.520745+0000","last_peered":"2024-04-25T22:40:51.520745+0000","last_clean":"2024-04-25T22:40:51.520745+0000","last_became_active":"2024-04-25T22:40:14.618088+0000","last_became_peered":"2024-04-25T22:40:14.618088+0000","last_unstale":"2024-04-25T22:40:51.520745+0000","last_undegraded":"2024-04-25T22:40:51.520745+0000","last_fullsized":"2024-04-25T22:40:51.520745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:58.322470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.524978+0000","last_change":"2024-04-25T22:40:36.304451+0000","last_active":"2024-04-25T22:40:51.524978+0000","last_peered":"2024-04-25T22:40:51.524978+0000","last_clean":"2024-04-25T22:40:51.524978+0000","last_became_active":"2024-04-25T22:40:36.303841+0000","last_became_peered":"2024-04-25T22:40:36.303841+0000","last_unstale":"2024-04-25T22:40:51.524978+0000","last_undegraded":"2024-04-25T22:40:51.524978+0000","last_fullsized":"2024-04-25T22:40:51.524978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:12.611590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.519318+0000","last_change":"2024-04-25T22:40:13.588577+0000","last_active":"2024-04-25T22:40:51.519318+0000","last_peered":"2024-04-25T22:40:51.519318+0000","last_clean":"2024-04-25T22:40:51.519318+0000","last_became_active":"2024-04-25T22:40:13.588019+0000","last_became_peered":"2024-04-25T22:40:13.588019+0000","last_unstale":"2024-04-25T22:40:51.519318+0000","last_undegraded":"2024-04-25T22:40:51.519318+0000","last_fullsized":"2024-04-25T22:40:51.519318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:07.743396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":3,"reported_epoch":30,"state":"peering","last_fresh":"2024-04-25T22:40:51.524462+0000","last_change":"2024-04-25T22:40:51.524462+0000","last_active":"2024-04-25T22:40:13.541378+0000","last_peered":"2024-04-25T22:40:13.541378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:51.524462+0000","last_undegraded":"2024-04-25T22:40:51.524462+0000","last_fullsized":"2024-04-25T22:40:51.524462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":3,"reported_epoch":30,"state":"peering","last_fresh":"2024-04-25T22:40:51.534770+0000","last_change":"2024-04-25T22:40:51.534770+0000","last_active":"2024-04-25T22:40:12.512392+0000","last_peered":"2024-04-25T22:40:12.512392+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:40:51.534770+0000","last_undegraded":"2024-04-25T22:40:51.534770+0000","last_fullsized":"2024-04-25T22:40:51.534770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.524611+0000","last_change":"2024-04-25T22:40:36.308091+0000","last_active":"2024-04-25T22:40:51.524611+0000","last_peered":"2024-04-25T22:40:51.524611+0000","last_clean":"2024-04-25T22:40:51.524611+0000","last_became_active":"2024-04-25T22:40:36.307377+0000","last_became_peered":"2024-04-25T22:40:36.307377+0000","last_unstale":"2024-04-25T22:40:51.524611+0000","last_undegraded":"2024-04-25T22:40:51.524611+0000","last_fullsized":"2024-04-25T22:40:51.524611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:49.433865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:40:45.458940+0000","last_change":"2024-04-25T22:40:36.293407+0000","last_active":"2024-04-25T22:40:45.458940+0000","last_peered":"2024-04-25T22:40:45.458940+0000","last_clean":"2024-04-25T22:40:45.458940+0000","last_became_active":"2024-04-25T22:40:36.292707+0000","last_became_peered":"2024-04-25T22:40:36.292707+0000","last_unstale":"2024-04-25T22:40:45.458940+0000","last_undegraded":"2024-04-25T22:40:45.458940+0000","last_fullsized":"2024-04-25T22:40:45.458940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:40:02.440775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:40:45.459690+0000","last_change":"2024-04-25T22:40:36.298814+0000","last_active":"2024-04-25T22:40:45.459690+0000","last_peered":"2024-04-25T22:40:45.459690+0000","last_clean":"2024-04-25T22:40:45.459690+0000","last_became_active":"2024-04-25T22:40:36.298369+0000","last_became_peered":"2024-04-25T22:40:36.298369+0000","last_unstale":"2024-04-25T22:40:45.459690+0000","last_undegraded":"2024-04-25T22:40:45.459690+0000","last_fullsized":"2024-04-25T22:40:45.459690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:06:25.816264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.527849+0000","last_change":"2024-04-25T22:40:36.306430+0000","last_active":"2024-04-25T22:40:51.527849+0000","last_peered":"2024-04-25T22:40:51.527849+0000","last_clean":"2024-04-25T22:40:51.527849+0000","last_became_active":"2024-04-25T22:40:36.305851+0000","last_became_peered":"2024-04-25T22:40:36.305851+0000","last_unstale":"2024-04-25T22:40:51.527849+0000","last_undegraded":"2024-04-25T22:40:51.527849+0000","last_fullsized":"2024-04-25T22:40:51.527849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:19.231988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.528122+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:40:51.528122+0000","last_peered":"2024-04-25T22:40:51.528122+0000","last_clean":"2024-04-25T22:40:51.528122+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:40:51.528122+0000","last_undegraded":"2024-04-25T22:40:51.528122+0000","last_fullsized":"2024-04-25T22:40:51.528122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.525064+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:40:51.525064+0000","last_peered":"2024-04-25T22:40:51.525064+0000","last_clean":"2024-04-25T22:40:51.525064+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:40:51.525064+0000","last_undegraded":"2024-04-25T22:40:51.525064+0000","last_fullsized":"2024-04-25T22:40:51.525064+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.527395+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:40:51.527395+0000","last_peered":"2024-04-25T22:40:51.527395+0000","last_clean":"2024-04-25T22:40:51.527395+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:40:51.527395+0000","last_undegraded":"2024-04-25T22:40:51.527395+0000","last_fullsized":"2024-04-25T22:40:51.527395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.525483+0000","last_change":"2024-04-25T22:40:36.307498+0000","last_active":"2024-04-25T22:40:51.525483+0000","last_peered":"2024-04-25T22:40:51.525483+0000","last_clean":"2024-04-25T22:40:51.525483+0000","last_became_active":"2024-04-25T22:40:36.305913+0000","last_became_peered":"2024-04-25T22:40:36.305913+0000","last_unstale":"2024-04-25T22:40:51.525483+0000","last_undegraded":"2024-04-25T22:40:51.525483+0000","last_fullsized":"2024-04-25T22:40:51.525483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:45:54.627527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T22:40:45.460173+0000","last_change":"2024-04-25T22:40:36.296798+0000","last_active":"2024-04-25T22:40:45.460173+0000","last_peered":"2024-04-25T22:40:45.460173+0000","last_clean":"2024-04-25T22:40:45.460173+0000","last_became_active":"2024-04-25T22:40:36.295967+0000","last_became_peered":"2024-04-25T22:40:36.295967+0000","last_unstale":"2024-04-25T22:40:45.460173+0000","last_undegraded":"2024-04-25T22:40:45.460173+0000","last_fullsized":"2024-04-25T22:40:45.460173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:47:46.321875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.525438+0000","last_change":"2024-04-25T22:40:13.594172+0000","last_active":"2024-04-25T22:40:51.525438+0000","last_peered":"2024-04-25T22:40:51.525438+0000","last_clean":"2024-04-25T22:40:51.525438+0000","last_became_active":"2024-04-25T22:40:13.593428+0000","last_became_peered":"2024-04-25T22:40:13.593428+0000","last_unstale":"2024-04-25T22:40:51.525438+0000","last_undegraded":"2024-04-25T22:40:51.525438+0000","last_fullsized":"2024-04-25T22:40:51.525438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:41:51.887162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T22:40:51.532042+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:40:51.532042+0000","last_peered":"2024-04-25T22:40:51.532042+0000","last_clean":"2024-04-25T22:40:51.532042+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:40:51.532042+0000","last_undegraded":"2024-04-25T22:40:51.532042+0000","last_fullsized":"2024-04-25T22:40:51.532042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":13,"reported_epoch":30,"state":"peering","last_fresh":"2024-04-25T22:40:51.530673+0000","last_change":"2024-04-25T22:40:51.530673+0000","last_active":"2024-04-25T22:40:51.530673+0000","last_peered":"2024-04-25T22:40:14.605878+0000","last_clean":"2024-04-25T22:40:14.605878+0000","last_became_active":"2024-04-25T22:40:13.592874+0000","last_became_peered":"2024-04-25T22:40:13.592874+0000","last_unstale":"2024-04-25T22:40:51.530673+0000","last_undegraded":"2024-04-25T22:40:51.530673+0000","last_fullsized":"2024-04-25T22:40:51.530673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738383,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":100654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738382,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":701373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738383,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":868352,"data_stored":693533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:40:57.544 INFO:tasks.thrashosds.thrasher:Setting 4.2 to [2, 0, 1] 2024-04-25T22:40:57.544 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.2', '2', '0', '1'] 2024-04-25T22:40:57.545 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.2 2 0 1 2024-04-25T22:40:57.607 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:57.607 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:57.610 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:57.609+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:57.621 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:40:57.711 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:57.709+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:57.751 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:57.752 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:57.766 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:40:57.812 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:57.811+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:57.880 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:57.880 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:57.884 INFO:teuthology.orchestra.run.smithi057.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-25T22:40:57.890 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T22:40:57.891 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-25T22:40:57.895 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:40:57.940 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:57.939+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:58.013 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:58.015+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:58.063 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:58.063 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:58.077 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:40:58.122 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:58.121+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:58.208 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:58.208 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:58.215 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:58.213+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:58.222 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:40:58.316 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:58.313+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:58.388 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:58.389 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:58.402 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:40:58.416 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:58.419+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:58.517 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:58.519+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:58.568 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:58.568 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:58.582 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:40:58.618 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:58.619+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:58.682 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:40:58.710 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:58.710 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:58.719 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:58.719+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:58.723 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:40:58.820 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:58.823+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:58.843 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:58.843 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:58.857 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:40:58.921 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:58.921+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:59.022 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:59.022 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:59.023 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:59.023+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:59.036 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:40:59.124 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:59.121+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:59.166 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:59.166 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:59.180 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:40:59.227 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:59.227+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:59.299 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:59.299 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:59.313 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:40:59.335 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:40:59.355 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:59.355+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:59.426 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:59.427+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:59.475 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:40:59.476 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:40:59.490 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:40:59.498 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:40:59.499 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:40:59.519 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:40:59.519 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:40:59.530 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:59.527+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:59.538 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:40:59.538 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:40:59.623 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:59.623 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:59.623 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:40:59.623 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:59.628 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is set 2024-04-25T22:40:59.629 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:40:59.631+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:40:59.639 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:40:59.730 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:40:59.727+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:40:59.760 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:59.760 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:40:59.760 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:40:59.760 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:40:59.760 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:40:59.774 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:40:59.831 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:40:59.829+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:40:59.901 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:40:59.901 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:40:59.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:40:59.901 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:40:59.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.901 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:59.902 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:59.902 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 45.303440377000001, 2024-04-25T22:40:59.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:40:59.902 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:59.902 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:59.902 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:59.902 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:59.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:59.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:59.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:59.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:40:59.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:59.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:40:59.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:40:59.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:59.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:40:59.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:40:59.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:59.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:40:59.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:40:59.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:59.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:40:59.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:40:59.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:40:59.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:40:59.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:59.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:40:59.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:40:59.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:40:59.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:40:59.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:59.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:40:59.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:40:59.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:59.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:40:59.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:40:59.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:59.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:40:59.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:40:59.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:59.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:40:59.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:40:59.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:59.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:40:59.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:40:59.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:59.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:40:59.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:40:59.907 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.908 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:59.908 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.908 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:59.908 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:59.908 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 45.303303120999999, 2024-04-25T22:40:59.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:40:59.908 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:59.908 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:59.908 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:59.908 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:59.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:59.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:40:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:40:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:40:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:40:59.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:40:59.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:59.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:40:59.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:40:59.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:59.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:40:59.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:40:59.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:40:59.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:40:59.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:59.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:40:59.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:40:59.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:40:59.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:40:59.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:59.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:40:59.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:40:59.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:59.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:40:59.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:40:59.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:59.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:40:59.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:40:59.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:59.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:40:59.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:40:59.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:59.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:40:59.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:40:59.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:59.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:40:59.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:40:59.913 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.913 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:59.913 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.914 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:59.914 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:59.914 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 45.303215569000002, 2024-04-25T22:40:59.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:40:59.914 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:59.914 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:59.914 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:59.914 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:59.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:59.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:59.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:59.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:40:59.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:59.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:40:59.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:40:59.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:59.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:40:59.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:40:59.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:59.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:40:59.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:40:59.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:59.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:40:59.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:40:59.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:40:59.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:40:59.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:59.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:40:59.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:40:59.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:40:59.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:40:59.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:59.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:40:59.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:40:59.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:59.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:40:59.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:40:59.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:59.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:40:59.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:40:59.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:59.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:40:59.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:40:59.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:59.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:40:59.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:40:59.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:59.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:40:59.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:40:59.919 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.919 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:59.919 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.920 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:59.920 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:59.920 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 45.303111743000002, 2024-04-25T22:40:59.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:40:59.920 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:59.920 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:59.920 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:59.920 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:59.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:59.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:59.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:59.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:40:59.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:59.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:40:59.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:40:59.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:59.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:40:59.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:40:59.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:59.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:40:59.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:40:59.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:59.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:40:59.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:40:59.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:40:59.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:40:59.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:59.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:40:59.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:40:59.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:40:59.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:40:59.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:59.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:40:59.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:40:59.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:40:59.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:40:59.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:40:59.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:59.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:40:59.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:40:59.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:59.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:40:59.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:40:59.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:59.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:40:59.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:40:59.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:59.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:40:59.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:40:59.925 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.925 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:59.925 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.926 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:59.926 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:59.926 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 45.303042953000002, 2024-04-25T22:40:59.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:40:59.926 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:59.926 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:59.926 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:59.926 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:59.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:59.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:59.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:59.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:40:59.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:59.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:40:59.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:40:59.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:59.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:40:59.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:40:59.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:59.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:40:59.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:40:59.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:59.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:40:59.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:40:59.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:40:59.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:40:59.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:59.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:40:59.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:40:59.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:40:59.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:40:59.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:59.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:40:59.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:40:59.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:59.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:40:59.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:40:59.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:59.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:40:59.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:40:59.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:59.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:40:59.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:40:59.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:59.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:40:59.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:40:59.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:59.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:40:59.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:40:59.931 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.931 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:59.931 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.932 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:59.932 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:59.932 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 45.302973866999999, 2024-04-25T22:40:59.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:40:59.932 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:59.932 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:59.932 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:59.932 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:59.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:59.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:59.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:59.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:40:59.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:59.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:40:59.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:40:59.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:59.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:40:59.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:40:59.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:59.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:40:59.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:40:59.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:59.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:40:59.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:40:59.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:40:59.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:40:59.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:59.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:40:59.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:40:59.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:40:59.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:40:59.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:59.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:40:59.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:40:59.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:59.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:40:59.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:40:59.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:59.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:40:59.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:40:59.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:59.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:40:59.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:40:59.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:59.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:40:59.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:40:59.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:59.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:40:59.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:40:59.937 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.937 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:59.937 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.937 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:59.938 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:59.938 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 45.302877754000001, 2024-04-25T22:40:59.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:40:59.938 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:59.938 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:59.938 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:59.938 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:59.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:59.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:59.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:59.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:40:59.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:59.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:40:59.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:40:59.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:59.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:40:59.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:40:59.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:59.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:40:59.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:40:59.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:59.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:40:59.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:40:59.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:40:59.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:40:59.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:59.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:40:59.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:40:59.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:40:59.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:40:59.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:59.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:40:59.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:40:59.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:59.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:40:59.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:40:59.942 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.942 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:59.942 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.942 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:59.942 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:59.942 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 45.302812092000003, 2024-04-25T22:40:59.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:40:59.947 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:59.947 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:59.947 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:59.947 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:59.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:59.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:59.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:59.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:40:59.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:59.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:40:59.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:40:59.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:59.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:40:59.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:40:59.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:59.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:40:59.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:40:59.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:59.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:40:59.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:40:59.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:40:59.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:40:59.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:40:59.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:40:59.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:40:59.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:40:59.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:40:59.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:59.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:40:59.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:40:59.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:59.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:40:59.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:40:59.951 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.951 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:59.951 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.951 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:40:59.951 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:59.951 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 45.302742965, 2024-04-25T22:40:59.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:40:59.951 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:59.951 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:59.951 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:59.951 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:59.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:59.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:59.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:59.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:40:59.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:59.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:40:59.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:40:59.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:59.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:40:59.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:40:59.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:59.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:40:59.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:40:59.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:59.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:40:59.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:40:59.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:40:59.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:40:59.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:40:59.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:40:59.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:40:59.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:40:59.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:40:59.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:59.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:40:59.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:40:59.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:59.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:40:59.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:40:59.955 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.955 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:59.955 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.955 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:40:59.955 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:59.956 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 45.291926308999997, 2024-04-25T22:40:59.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:40:59.956 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:59.956 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:59.956 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:59.956 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:59.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:59.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:59.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:59.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:40:59.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:59.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:40:59.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:40:59.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:59.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:40:59.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:40:59.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:59.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:40:59.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:40:59.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:59.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:40:59.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:40:59.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:40:59.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:40:59.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:59.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:40:59.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:40:59.959 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.959 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:59.959 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.959 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:59.959 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:59.959 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 45.275027956000002, 2024-04-25T22:40:59.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:40:59.959 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:59.959 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:59.960 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:59.960 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:59.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:59.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:59.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:59.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:59.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:59.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:40:59.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:40:59.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:59.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:40:59.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:40:59.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:59.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:40:59.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:40:59.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:59.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:40:59.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:40:59.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:40:59.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:40:59.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:59.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:40:59.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:40:59.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:59.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:40:59.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:40:59.963 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.963 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:59.963 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.963 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:40:59.963 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:59.963 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 45.274207066000002, 2024-04-25T22:40:59.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:40:59.963 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:59.963 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:59.963 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:40:59.964 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:59.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:59.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:59.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:59.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:40:59.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:59.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:40:59.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:40:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:40:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:40:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:40:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:40:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:40:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:40:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:40:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:40:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:40:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:40:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:40:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:40:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 45.272506337999999, 2024-04-25T22:40:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:40:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:40:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:40:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:40:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:40:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:40:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:40:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:40:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:40:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:40:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:40:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:40:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:40:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:40:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:40:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:40:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:40:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:40:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 45.271909663000002, 2024-04-25T22:40:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:40:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:40:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:40:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:40:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:40:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:40:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:40:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:40:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:40:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:40:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:40:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:40:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:40:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:40:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:40:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:40:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:40:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:40:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:40:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 45.262473937000003, 2024-04-25T22:40:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:40:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:40:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:59.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:40:59.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:40:59.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:59.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:40:59.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:40:59.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:59.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:40:59.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:40:59.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:59.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:40:59.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:40:59.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:40:59.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:40:59.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:59.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:40:59.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:40:59.978 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.978 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:59.978 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.979 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:40:59.979 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:59.979 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 45.261826511000002, 2024-04-25T22:40:59.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:40:59.979 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:59.979 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:59.979 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:59.979 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:59.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.979 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:59.979 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:59.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:59.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:40:59.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:59.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:40:59.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:40:59.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:59.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:40:59.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:40:59.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:59.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:40:59.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:40:59.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:59.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:40:59.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:40:59.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:40:59.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:40:59.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:59.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:40:59.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:40:59.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:59.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:40:59.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:40:59.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:59.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:40:59.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:40:59.983 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.983 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:59.983 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.983 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:40:59.983 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:59.983 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 45.260385692, 2024-04-25T22:40:59.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:40:59.983 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:59.983 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:59.983 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:59.983 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:59.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:59.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:59.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.984 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:59.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:40:59.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.984 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:59.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:40:59.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:40:59.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.984 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:59.985 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:40:59.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:40:59.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.985 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:59.985 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:40:59.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:40:59.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.985 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:59.985 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:40:59.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:40:59.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:40:59.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:40:59.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:59.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:40:59.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:40:59.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:59.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:40:59.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:40:59.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:59.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:40:59.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:40:59.987 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.987 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:59.987 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.987 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:40:59.987 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:59.987 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 43.307947247999998, 2024-04-25T22:40:59.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:40:59.987 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:59.987 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:59.987 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:59.988 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:59.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.988 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:59.988 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:59.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.988 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.988 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:59.988 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:40:59.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.988 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.988 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:59.988 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:40:59.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:40:59.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:59.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:40:59.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:40:59.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:59.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:40:59.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:40:59.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:59.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:40:59.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:40:59.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:40:59.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:40:59.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:59.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:40:59.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:40:59.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:59.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:40:59.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:40:59.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:59.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:40:59.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:40:59.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:59.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:40:59.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:40:59.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:59.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:40:59.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:40:59.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:59.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:40:59.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:40:59.992 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.992 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:59.992 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.992 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:40:59.992 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:59.993 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 21.305287924000002, 2024-04-25T22:40:59.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:40:59.993 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:59.993 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:59.993 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:59.993 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:59.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:59.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:59.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.994 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.994 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:59.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:40:59.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.994 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.994 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:59.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:40:59.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:40:59.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.994 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.994 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:40:59.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:40:59.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:40:59.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:40:59.995 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:40:59.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:40:59.995 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:40:59.995 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:40:59.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:40:59.995 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:40:59.995 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:40:59.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:40:59.995 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:40:59.996 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:40:59.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:40:59.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:40:59.996 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:40:59.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:40:59.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:40:59.996 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:40:59.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:40:59.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:40:59.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:40:59.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:40:59.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:40:59.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:40:59.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:40:59.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:40:59.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:40:59.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:40:59.998 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.998 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:40:59.998 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:40:59.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.998 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:40:59.998 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:59.998 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 16.304995673000001, 2024-04-25T22:40:59.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:40:59.998 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:40:59.998 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:40:59.998 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:40:59.999 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:40:59.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:40:59.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:59.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:40:59.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:40:59.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:40:59.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:40:59.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:40:59.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:40:59.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:40:59.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:00.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:00.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:00.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:00.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:00.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:00.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:00.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:00.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:00.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:00.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:00.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:00.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:00.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:00.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:00.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:00.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:00.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:00.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:00.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:00.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:00.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:00.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:00.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:00.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:00.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:00.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:00.003 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:00.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:00.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:00.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:00.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:00.003 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:00.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:00.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:00.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:00.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:00.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:00.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:00.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:00.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:00.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:00.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:00.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:00.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:00.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:00.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:00.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:00.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:00.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:00.005 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:00.005 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:00.005 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:00.005 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:00.005 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:00.006 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:00.008 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:00.008 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:00.007+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:00.108 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:00.111+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:00.141 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:00.141 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:00.141 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:41:00.141 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:00.155 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:00.209 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:00.209+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:00.310 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:00.310+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:00.313 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:00.313 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:00.313 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:00.313 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:00.313 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:00.327 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:00.411 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:00.411+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:00.495 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:00.495 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:41:00.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:41:00.495 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:41:00.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.495 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:00.495 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:00.495 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.896935339999999, 2024-04-25T22:41:00.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:41:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:00.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:41:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:41:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:41:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:41:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:00.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:41:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:41:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:41:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:41:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:41:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:41:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:41:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:41:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:41:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:41:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:41:00.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:41:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:41:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:41:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:41:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:41:00.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:00.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:41:00.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:41:00.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:00.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:41:00.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:41:00.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:00.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:41:00.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:41:00.502 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.502 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.502 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.502 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:00.502 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:00.503 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.896847327000003, 2024-04-25T22:41:00.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:41:00.503 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:00.503 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:00.503 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:00.503 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:00.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:00.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:00.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:00.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:00.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:00.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:41:00.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:41:00.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:00.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:00.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:41:00.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:00.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:41:00.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:41:00.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:41:00.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:41:00.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:41:00.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:41:00.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:00.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:00.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:41:00.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:41:00.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:41:00.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:00.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:41:00.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:41:00.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:00.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:41:00.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:41:00.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:00.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:41:00.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:41:00.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:00.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:41:00.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:41:00.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:00.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:41:00.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:41:00.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:00.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:41:00.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:41:00.511 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.512 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.512 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.512 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:00.512 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:00.512 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.896775204999997, 2024-04-25T22:41:00.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:41:00.513 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:00.513 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:00.513 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:00.513 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:00.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:00.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:00.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:00.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:00.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:00.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:41:00.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:41:00.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:00.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:41:00.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:41:00.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:00.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:41:00.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:41:00.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:41:00.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:41:00.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:41:00.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:41:00.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:41:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:41:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:41:00.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:41:00.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:00.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:41:00.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:41:00.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:00.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:41:00.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:41:00.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:00.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:41:00.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:41:00.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:00.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:41:00.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:41:00.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:00.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:41:00.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:41:00.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:00.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:41:00.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:41:00.521 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.521 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.521 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.522 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:00.522 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:00.522 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.896666891999999, 2024-04-25T22:41:00.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:41:00.522 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:00.522 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:00.522 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:00.523 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:00.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:00.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:00.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:00.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:00.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:00.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:41:00.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:41:00.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:00.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:41:00.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:41:00.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:00.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:41:00.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:41:00.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:41:00.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:41:00.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:41:00.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:41:00.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:00.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:41:00.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:41:00.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:41:00.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:41:00.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:00.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:41:00.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:41:00.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:00.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:41:00.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:41:00.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:00.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:41:00.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:41:00.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:00.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:41:00.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:41:00.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:00.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:41:00.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:41:00.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:00.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:41:00.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:41:00.531 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.531 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.531 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.531 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:00.531 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:00.531 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.896600235999998, 2024-04-25T22:41:00.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:41:00.532 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:00.532 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:00.532 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:00.532 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:00.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:00.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:00.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:00.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:00.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:00.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:41:00.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:41:00.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:00.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:41:00.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:41:00.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:00.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:41:00.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:41:00.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:41:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:41:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:41:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:41:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:41:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:41:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:41:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:41:00.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:00.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:41:00.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:41:00.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:00.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:41:00.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:41:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:41:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:41:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:41:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:41:00.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:41:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:41:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:41:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:41:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.540 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:00.540 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:00.540 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.896509639999998, 2024-04-25T22:41:00.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:41:00.540 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:00.540 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:00.540 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:00.540 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:00.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:00.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:00.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:00.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:00.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:00.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:41:00.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:41:00.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:00.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:41:00.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:41:00.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:00.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:41:00.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:41:00.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:41:00.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:41:00.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:41:00.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:41:00.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:00.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:41:00.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:41:00.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:41:00.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:41:00.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:00.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:41:00.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:41:00.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:00.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:41:00.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:41:00.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:00.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:41:00.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:41:00.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:00.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:41:00.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:41:00.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:00.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:41:00.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:41:00.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:00.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:41:00.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:41:00.548 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.548 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.548 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.549 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:00.549 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:00.549 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.896445067000002, 2024-04-25T22:41:00.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:41:00.549 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:00.549 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:00.549 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:00.550 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:00.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:00.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:00.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:00.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:00.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:41:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:41:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:41:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:41:00.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:41:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:41:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:41:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:41:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:41:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:41:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:41:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:41:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:41:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:41:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:41:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:41:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:41:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:41:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:41:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:41:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:41:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:41:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:41:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:41:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:41:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.896379644, 2024-04-25T22:41:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:41:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:00.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:41:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:41:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:41:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:41:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:41:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:41:00.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:41:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:41:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:41:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:41:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:41:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:41:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:41:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:41:00.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:41:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:41:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:41:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:41:00.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:41:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:41:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:41:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:41:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:41:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:41:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:41:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.896323578000001, 2024-04-25T22:41:00.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:41:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:00.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:41:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:41:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:41:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:41:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:41:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:41:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:41:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:41:00.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:41:00.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:00.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:41:00.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:41:00.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:41:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:41:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:41:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:41:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:41:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:41:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:41:00.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:41:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:41:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:41:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:41:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:41:00.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:41:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:41:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.575 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.896256471999997, 2024-04-25T22:41:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:41:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:00.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:41:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:41:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:41:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:41:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:41:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:41:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:41:00.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:41:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:41:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:41:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:41:00.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:41:00.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:41:00.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:41:00.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:00.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:41:00.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:41:00.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:00.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:41:00.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:41:00.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:41:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:41:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:41:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:41:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:41:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:41:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:41:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:41:00.584 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.896201349000002, 2024-04-25T22:41:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:41:00.585 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:41:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:41:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:41:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:41:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:41:00.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:41:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:41:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:41:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:41:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:41:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:41:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:41:00.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:41:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:41:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:41:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:41:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:41:00.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:41:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:41:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:41:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:41:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:41:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:41:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:41:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:41:00.593 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.896099110000002, 2024-04-25T22:41:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:41:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:00.594 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:00.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:00.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:00.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:41:00.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:41:00.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:00.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:41:00.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:41:00.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:00.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:41:00.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:41:00.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:41:00.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:41:00.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:41:00.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:41:00.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:00.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:41:00.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:41:00.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:41:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:41:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:41:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:41:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:41:00.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:41:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:41:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:41:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:41:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:41:00.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:41:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:41:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:41:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:41:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.601 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.896040286999998, 2024-04-25T22:41:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:41:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:00.602 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:41:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:41:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:41:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:41:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:41:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:41:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:41:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:41:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:41:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:41:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:41:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:41:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:41:00.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:41:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:41:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:41:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:41:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:41:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:41:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:41:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:41:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:41:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:41:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:41:00.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:41:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:41:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:00.609 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.895961554000003, 2024-04-25T22:41:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:41:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:41:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:00.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:41:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:41:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:41:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:41:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:41:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:41:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:41:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:41:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:41:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:41:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:41:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:41:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:41:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:41:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:41:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:41:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:41:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:41:00.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:41:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:41:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:41:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:41:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:41:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:41:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.895922141, 2024-04-25T22:41:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:41:00.616 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:00.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:41:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:41:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:00.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:41:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:41:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:41:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:41:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:41:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:41:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:41:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:41:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:41:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:41:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:41:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:41:00.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:41:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:41:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:41:00.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:41:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:41:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:41:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:41:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:41:00.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:41:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:41:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:41:00.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:41:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.895852294999997, 2024-04-25T22:41:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:41:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:00.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:41:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:41:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:41:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:41:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:41:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:41:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:41:00.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:41:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:41:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:41:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:41:00.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:41:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:41:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:41:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:41:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:41:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:00.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:41:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:41:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:41:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:41:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:41:00.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:41:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:41:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:41:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:41:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:41:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.895802558, 2024-04-25T22:41:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:41:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:00.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:41:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:41:00.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:41:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:41:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:41:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:41:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:41:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:41:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:41:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:41:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:41:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:41:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:41:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:41:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:41:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:41:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:41:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:41:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:41:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:41:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:41:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:41:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:41:00.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:41:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.895717943000001, 2024-04-25T22:41:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:41:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:00.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:41:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:00.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:41:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:41:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:41:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:41:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:41:00.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:41:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:41:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:41:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:41:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:41:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:41:00.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:41:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:41:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:41:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:41:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:41:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:41:00.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:41:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:41:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:41:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:41:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:41:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:41:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:41:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.895654293, 2024-04-25T22:41:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:41:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:00.643 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:41:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:41:00.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:41:00.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:00.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:41:00.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:41:00.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:00.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:41:00.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:41:00.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:41:00.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:41:00.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:41:00.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:41:00.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:00.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:41:00.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:41:00.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:41:00.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:41:00.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:00.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:41:00.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:41:00.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:00.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:41:00.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:41:00.647 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.647 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.647 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.648 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:00.648 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:00.648 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.888650763000001, 2024-04-25T22:41:00.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:41:00.648 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:00.648 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:00.648 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:00.648 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:00.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:00.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:00.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:00.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:00.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:00.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:00.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:41:00.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:41:00.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:00.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:41:00.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:41:00.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:00.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:41:00.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:41:00.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:00.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:41:00.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:41:00.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:00.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:41:00.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:41:00.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:00.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:41:00.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:41:00.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:00.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:41:00.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:41:00.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:00.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:00.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:00.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:41:00.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:41:00.652 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.652 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.652 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.652 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:00.652 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:00.652 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:00.654 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:41:00.654 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:00.654+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:00.754 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:00.751+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:00.785 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:00.785 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:41:00.785 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-04-25T22:41:00.785 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:00.799 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:41:00.887 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:00.887+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:00.956 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:00.955+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:00.961 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:00.961 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:41:00.961 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-04-25T22:41:00.961 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-04-25T22:41:00.961 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:00.976 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:41:01.058 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:01.057+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:01.141 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-04-25T22:41:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-04-25T22:41:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-04-25T22:41:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:111 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'73, mlcod=11'69)", 2024-04-25T22:41:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.441733761999998, 2024-04-25T22:41:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055481899999999997, 2024-04-25T22:41:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700271+0000", 2024-04-25T22:41:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:41:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700278+0000", 2024-04-25T22:41:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-04-25T22:41:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700323+0000", 2024-04-25T22:41:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4212999999999998e-05 2024-04-25T22:41:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700333+0000", 2024-04-25T22:41:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0433e-05 2024-04-25T22:41:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700662+0000", 2024-04-25T22:41:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032862800000000003 2024-04-25T22:41:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700692+0000", 2024-04-25T22:41:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0395999999999998e-05 2024-04-25T22:41:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705728+0000", 2024-04-25T22:41:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050361939999999999 2024-04-25T22:41:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705818+0000", 2024-04-25T22:41:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9573000000000005e-05 2024-04-25T22:41:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-25T22:41:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.441188910000001, 2024-04-25T22:41:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005065501, 2024-04-25T22:41:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700816+0000", 2024-04-25T22:41:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.24e-06 2024-04-25T22:41:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700914+0000", 2024-04-25T22:41:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8057e-05 2024-04-25T22:41:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700931+0000", 2024-04-25T22:41:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7745999999999999e-05 2024-04-25T22:41:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700941+0000", 2024-04-25T22:41:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5699999999999999e-06 2024-04-25T22:41:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701162+0000", 2024-04-25T22:41:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000221392 2024-04-25T22:41:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701194+0000", 2024-04-25T22:41:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1745999999999997e-05 2024-04-25T22:41:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705821+0000", 2024-04-25T22:41:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046269869999999999 2024-04-25T22:41:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705880+0000", 2024-04-25T22:41:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8763e-05 2024-04-25T22:41:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:118 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'80, mlcod=11'78)", 2024-04-25T22:41:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.433833300000003, 2024-04-25T22:41:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047806089999999999, 2024-04-25T22:41:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708172+0000", 2024-04-25T22:41:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0600000000000002e-06 2024-04-25T22:41:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708291+0000", 2024-04-25T22:41:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118892 2024-04-25T22:41:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708320+0000", 2024-04-25T22:41:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8822999999999998e-05 2024-04-25T22:41:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708337+0000", 2024-04-25T22:41:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7586999999999999e-05 2024-04-25T22:41:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708512+0000", 2024-04-25T22:41:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017439500000000001 2024-04-25T22:41:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708551+0000", 2024-04-25T22:41:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.909e-05 2024-04-25T22:41:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712865+0000", 2024-04-25T22:41:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043142069999999996 2024-04-25T22:41:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712951+0000", 2024-04-25T22:41:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5555000000000003e-05 2024-04-25T22:41:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:120 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'82, mlcod=11'78)", 2024-04-25T22:41:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.432827258000003, 2024-04-25T22:41:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047170700000000003, 2024-04-25T22:41:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709177+0000", 2024-04-25T22:41:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.19e-06 2024-04-25T22:41:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709315+0000", 2024-04-25T22:41:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000137429 2024-04-25T22:41:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709341+0000", 2024-04-25T22:41:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:41:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709353+0000", 2024-04-25T22:41:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2027e-05 2024-04-25T22:41:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710040+0000", 2024-04-25T22:41:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068710799999999997 2024-04-25T22:41:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710076+0000", 2024-04-25T22:41:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5982999999999998e-05 2024-04-25T22:41:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713802+0000", 2024-04-25T22:41:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037255750000000001 2024-04-25T22:41:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713893+0000", 2024-04-25T22:41:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1201999999999999e-05 2024-04-25T22:41:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:121 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'83, mlcod=11'78)", 2024-04-25T22:41:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.432280622, 2024-04-25T22:41:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0049043919999999996, 2024-04-25T22:41:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709724+0000", 2024-04-25T22:41:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.483e-06 2024-04-25T22:41:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709872+0000", 2024-04-25T22:41:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147446 2024-04-25T22:41:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709891+0000", 2024-04-25T22:41:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9245999999999998e-05 2024-04-25T22:41:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709900+0000", 2024-04-25T22:41:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1439999999999992e-06 2024-04-25T22:41:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713091+0000", 2024-04-25T22:41:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031910710000000002 2024-04-25T22:41:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713122+0000", 2024-04-25T22:41:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.048e-05 2024-04-25T22:41:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714538+0000", 2024-04-25T22:41:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014160030000000001 2024-04-25T22:41:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714627+0000", 2024-04-25T22:41:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518999999999995e-05 2024-04-25T22:41:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.541891241999998, 2024-04-25T22:41:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022089675999999999, 2024-04-25T22:41:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600120+0000", 2024-04-25T22:41:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1259999999999998e-06 2024-04-25T22:41:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600153+0000", 2024-04-25T22:41:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3186999999999999e-05 2024-04-25T22:41:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600181+0000", 2024-04-25T22:41:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7676000000000001e-05 2024-04-25T22:41:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600205+0000", 2024-04-25T22:41:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:41:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600467+0000", 2024-04-25T22:41:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026186800000000001 2024-04-25T22:41:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600809+0000", 2024-04-25T22:41:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034138400000000002 2024-04-25T22:41:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.601892+0000", 2024-04-25T22:41:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010831910000000001 2024-04-25T22:41:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611054+0000", 2024-04-25T22:41:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0091620940000000008 2024-04-25T22:41:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621965+0000", 2024-04-25T22:41:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010911044999999999 2024-04-25T22:41:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622090+0000", 2024-04-25T22:41:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012522 2024-04-25T22:41:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622202+0000", 2024-04-25T22:41:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011164500000000001 2024-04-25T22:41:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.541748187000003, 2024-04-25T22:41:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035756228000000001, 2024-04-25T22:41:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600257+0000", 2024-04-25T22:41:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8300000000000001e-06 2024-04-25T22:41:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600267+0000", 2024-04-25T22:41:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6539999999999994e-06 2024-04-25T22:41:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600293+0000", 2024-04-25T22:41:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5996e-05 2024-04-25T22:41:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600309+0000", 2024-04-25T22:41:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6206e-05 2024-04-25T22:41:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603757+0000", 2024-04-25T22:41:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003448244 2024-04-25T22:41:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604779+0000", 2024-04-25T22:41:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010216820000000001 2024-04-25T22:41:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605127+0000", 2024-04-25T22:41:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034820100000000002 2024-04-25T22:41:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611082+0000", 2024-04-25T22:41:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0059550640000000004 2024-04-25T22:41:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635779+0000", 2024-04-25T22:41:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024696665999999999 2024-04-25T22:41:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635915+0000", 2024-04-25T22:41:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000135809 2024-04-25T22:41:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636011+0000", 2024-04-25T22:41:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6875999999999999e-05 2024-04-25T22:41:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.541670973999999, 2024-04-25T22:41:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035327031000000002, 2024-04-25T22:41:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:01.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600334+0000", 2024-04-25T22:41:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:41:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600347+0000", 2024-04-25T22:41:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3593e-05 2024-04-25T22:41:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600371+0000", 2024-04-25T22:41:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.313e-05 2024-04-25T22:41:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600390+0000", 2024-04-25T22:41:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.908e-05 2024-04-25T22:41:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602756+0000", 2024-04-25T22:41:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023662560000000002 2024-04-25T22:41:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603021+0000", 2024-04-25T22:41:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026546399999999998 2024-04-25T22:41:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:01.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603304+0000", 2024-04-25T22:41:01.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028308800000000002 2024-04-25T22:41:01.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:01.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611075+0000", 2024-04-25T22:41:01.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077703900000000003 2024-04-25T22:41:01.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:01.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635414+0000", 2024-04-25T22:41:01.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024339326000000001 2024-04-25T22:41:01.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:01.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635544+0000", 2024-04-25T22:41:01.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012948199999999999 2024-04-25T22:41:01.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:01.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635659+0000", 2024-04-25T22:41:01.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000115809 2024-04-25T22:41:01.183 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.183 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.183 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.183 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:01.184 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:01.184 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.541511049, 2024-04-25T22:41:01.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035594492999999998, 2024-04-25T22:41:01.184 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:01.184 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:01.184 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.184 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:01.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:01.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:01.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:01.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:01.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:01.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600494+0000", 2024-04-25T22:41:01.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:41:01.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:01.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600502+0000", 2024-04-25T22:41:01.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3769999999999996e-06 2024-04-25T22:41:01.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:01.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600522+0000", 2024-04-25T22:41:01.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9919999999999999e-05 2024-04-25T22:41:01.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600539+0000", 2024-04-25T22:41:01.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.649e-05 2024-04-25T22:41:01.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:01.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604846+0000", 2024-04-25T22:41:01.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043075199999999996 2024-04-25T22:41:01.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:01.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605057+0000", 2024-04-25T22:41:01.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00021085200000000001 2024-04-25T22:41:01.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:01.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605378+0000", 2024-04-25T22:41:01.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032074799999999999 2024-04-25T22:41:01.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:01.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611089+0000", 2024-04-25T22:41:01.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057110249999999998 2024-04-25T22:41:01.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:01.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635844+0000", 2024-04-25T22:41:01.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024755355999999999 2024-04-25T22:41:01.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:01.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635986+0000", 2024-04-25T22:41:01.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141512 2024-04-25T22:41:01.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:01.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636087+0000", 2024-04-25T22:41:01.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101183 2024-04-25T22:41:01.190 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.190 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.190 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.190 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:01.190 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:01.190 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.541438438999997, 2024-04-25T22:41:01.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021266723000000001, 2024-04-25T22:41:01.190 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:01.191 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:01.191 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.191 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:01.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:01.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:01.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:01.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:01.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:01.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600566+0000", 2024-04-25T22:41:01.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4959999999999999e-06 2024-04-25T22:41:01.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:01.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600574+0000", 2024-04-25T22:41:01.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-06 2024-04-25T22:41:01.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:01.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600592+0000", 2024-04-25T22:41:01.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8479999999999999e-05 2024-04-25T22:41:01.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600610+0000", 2024-04-25T22:41:01.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7567e-05 2024-04-25T22:41:01.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:01.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602679+0000", 2024-04-25T22:41:01.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020692739999999999 2024-04-25T22:41:01.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:01.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602945+0000", 2024-04-25T22:41:01.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026640399999999998 2024-04-25T22:41:01.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:01.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603115+0000", 2024-04-25T22:41:01.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000169996 2024-04-25T22:41:01.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:01.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608398+0000", 2024-04-25T22:41:01.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052826289999999996 2024-04-25T22:41:01.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:01.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621588+0000", 2024-04-25T22:41:01.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013190489 2024-04-25T22:41:01.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.195 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:01.195 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621733+0000", 2024-04-25T22:41:01.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014462500000000001 2024-04-25T22:41:01.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.195 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:01.195 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621832+0000", 2024-04-25T22:41:01.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8603000000000004e-05 2024-04-25T22:41:01.195 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.195 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.196 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.196 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:01.196 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:01.196 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.541370712999999, 2024-04-25T22:41:01.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034747924999999999, 2024-04-25T22:41:01.196 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:01.196 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:01.196 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.196 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:01.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:01.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:01.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:01.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:01.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:01.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600634+0000", 2024-04-25T22:41:01.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-04-25T22:41:01.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.198 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:01.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600642+0000", 2024-04-25T22:41:01.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8169999999999999e-06 2024-04-25T22:41:01.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.198 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:01.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600660+0000", 2024-04-25T22:41:01.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8513e-05 2024-04-25T22:41:01.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.198 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600676+0000", 2024-04-25T22:41:01.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6019999999999999e-05 2024-04-25T22:41:01.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:01.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603748+0000", 2024-04-25T22:41:01.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030718329999999999 2024-04-25T22:41:01.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:01.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604752+0000", 2024-04-25T22:41:01.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001003603 2024-04-25T22:41:01.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:01.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605117+0000", 2024-04-25T22:41:01.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00036539 2024-04-25T22:41:01.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:01.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608459+0000", 2024-04-25T22:41:01.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033413879999999998 2024-04-25T22:41:01.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:01.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635106+0000", 2024-04-25T22:41:01.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026647607 2024-04-25T22:41:01.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:01.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635273+0000", 2024-04-25T22:41:01.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000166689 2024-04-25T22:41:01.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:01.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635381+0000", 2024-04-25T22:41:01.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107642 2024-04-25T22:41:01.201 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.201 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.201 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.201 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:01.202 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:01.202 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.541307484000001, 2024-04-25T22:41:01.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040419292000000002, 2024-04-25T22:41:01.202 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:01.202 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:01.202 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.202 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:01.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:01.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:01.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:01.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:01.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:01.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600697+0000", 2024-04-25T22:41:01.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1999999999999999e-06 2024-04-25T22:41:01.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:01.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600704+0000", 2024-04-25T22:41:01.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5570000000000001e-06 2024-04-25T22:41:01.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:01.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600724+0000", 2024-04-25T22:41:01.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0023000000000001e-05 2024-04-25T22:41:01.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600738+0000", 2024-04-25T22:41:01.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4372999999999999e-05 2024-04-25T22:41:01.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:01.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.612532+0000", 2024-04-25T22:41:01.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011793606 2024-04-25T22:41:01.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:01.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613354+0000", 2024-04-25T22:41:01.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00082244100000000004 2024-04-25T22:41:01.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:01.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613726+0000", 2024-04-25T22:41:01.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00037226000000000002 2024-04-25T22:41:01.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:01.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618891+0000", 2024-04-25T22:41:01.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051649199999999999 2024-04-25T22:41:01.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:01.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.640874+0000", 2024-04-25T22:41:01.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021982640000000001 2024-04-25T22:41:01.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:01.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641019+0000", 2024-04-25T22:41:01.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000145339 2024-04-25T22:41:01.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:01.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641115+0000", 2024-04-25T22:41:01.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5933000000000005e-05 2024-04-25T22:41:01.207 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.207 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.207 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.207 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:01.208 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:01.208 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.541221454000002, 2024-04-25T22:41:01.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036502711, 2024-04-25T22:41:01.208 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:01.208 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:01.208 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:01.208 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:01.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:01.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:01.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:01.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:01.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:01.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600783+0000", 2024-04-25T22:41:01.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.533e-06 2024-04-25T22:41:01.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:01.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600790+0000", 2024-04-25T22:41:01.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0439999999999998e-06 2024-04-25T22:41:01.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:01.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600811+0000", 2024-04-25T22:41:01.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0449e-05 2024-04-25T22:41:01.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600825+0000", 2024-04-25T22:41:01.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4293e-05 2024-04-25T22:41:01.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:01.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602304+0000", 2024-04-25T22:41:01.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001478629 2024-04-25T22:41:01.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:01.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602587+0000", 2024-04-25T22:41:01.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028350800000000002 2024-04-25T22:41:01.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:01.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.637285+0000", 2024-04-25T22:41:01.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034697255000000003 2024-04-25T22:41:01.211 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.211 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.211 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.211 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:01.211 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:01.212 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.541155887999999, 2024-04-25T22:41:01.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017311460000000001, 2024-04-25T22:41:01.212 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:01.212 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:01.212 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:01.212 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:01.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.212 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:01.212 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:01.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.212 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:01.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:01.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.213 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:01.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600849+0000", 2024-04-25T22:41:01.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2899999999999999e-06 2024-04-25T22:41:01.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.213 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:01.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600866+0000", 2024-04-25T22:41:01.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6793e-05 2024-04-25T22:41:01.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.213 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:01.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600886+0000", 2024-04-25T22:41:01.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0772999999999999e-05 2024-04-25T22:41:01.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600904+0000", 2024-04-25T22:41:01.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7697e-05 2024-04-25T22:41:01.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:01.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602796+0000", 2024-04-25T22:41:01.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018920149999999999 2024-04-25T22:41:01.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:01.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602962+0000", 2024-04-25T22:41:01.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016590600000000001 2024-04-25T22:41:01.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:01.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618159+0000", 2024-04-25T22:41:01.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015196985999999999 2024-04-25T22:41:01.215 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.215 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.215 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.215 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:01.215 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:01.215 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.526280147000001, 2024-04-25T22:41:01.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006380269, 2024-04-25T22:41:01.216 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:01.216 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:01.216 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.216 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:01.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.216 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:01.216 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:01.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.216 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:01.216 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:01.217 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.217 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.217 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.217 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:01.217 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615724+0000", 2024-04-25T22:41:01.217 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.094e-06 2024-04-25T22:41:01.217 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.217 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.217 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:01.217 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615734+0000", 2024-04-25T22:41:01.217 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.363e-06 2024-04-25T22:41:01.217 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.217 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.217 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:01.217 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615751+0000", 2024-04-25T22:41:01.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:41:01.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.218 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.218 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615773+0000", 2024-04-25T22:41:01.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.154e-05 2024-04-25T22:41:01.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.218 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:01.218 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616485+0000", 2024-04-25T22:41:01.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00071225100000000001 2024-04-25T22:41:01.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.218 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:01.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616528+0000", 2024-04-25T22:41:01.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3606000000000002e-05 2024-04-25T22:41:01.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:01.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622030+0000", 2024-04-25T22:41:01.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055010750000000002 2024-04-25T22:41:01.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:01.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622103+0000", 2024-04-25T22:41:01.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3930000000000005e-05 2024-04-25T22:41:01.220 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.220 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.220 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.220 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:01.220 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:01.220 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.525367209999999, 2024-04-25T22:41:01.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046420649999999999, 2024-04-25T22:41:01.220 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:01.220 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:01.220 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-04-25T22:41:01.221 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:01.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:01.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:01.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:01.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:01.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:01.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616637+0000", 2024-04-25T22:41:01.222 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0299999999999998e-07 2024-04-25T22:41:01.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.222 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:01.222 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616653+0000", 2024-04-25T22:41:01.222 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5843000000000001e-05 2024-04-25T22:41:01.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.222 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:01.222 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616690+0000", 2024-04-25T22:41:01.223 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7466999999999999e-05 2024-04-25T22:41:01.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.223 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.223 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616729+0000", 2024-04-25T22:41:01.223 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8810000000000003e-05 2024-04-25T22:41:01.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.223 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:01.223 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617251+0000", 2024-04-25T22:41:01.223 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00052143899999999995 2024-04-25T22:41:01.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.223 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:01.224 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621278+0000", 2024-04-25T22:41:01.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040277029999999997 2024-04-25T22:41:01.224 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.224 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.224 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.224 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:01.224 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:01.224 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.524343858000002, 2024-04-25T22:41:01.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0065101730000000002, 2024-04-25T22:41:01.224 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:01.225 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:01.225 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.225 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:01.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:01.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:01.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:01.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:01.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:01.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617661+0000", 2024-04-25T22:41:01.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:41:01.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:01.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617688+0000", 2024-04-25T22:41:01.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7589e-05 2024-04-25T22:41:01.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.227 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:01.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617710+0000", 2024-04-25T22:41:01.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1467e-05 2024-04-25T22:41:01.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.227 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617727+0000", 2024-04-25T22:41:01.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6990000000000002e-05 2024-04-25T22:41:01.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.227 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:01.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618559+0000", 2024-04-25T22:41:01.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083207400000000003 2024-04-25T22:41:01.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:01.228 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618608+0000", 2024-04-25T22:41:01.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8936e-05 2024-04-25T22:41:01.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:01.228 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624077+0000", 2024-04-25T22:41:01.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054695840000000004 2024-04-25T22:41:01.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.229 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:01.229 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624170+0000", 2024-04-25T22:41:01.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2305999999999993e-05 2024-04-25T22:41:01.229 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.229 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.229 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.229 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.229 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.229 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:01.229 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:01.229 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.519242349999999, 2024-04-25T22:41:01.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006879446, 2024-04-25T22:41:01.229 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:01.229 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:01.230 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.230 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:01.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:01.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:01.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:01.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:01.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:01.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622762+0000", 2024-04-25T22:41:01.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:41:01.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:01.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622781+0000", 2024-04-25T22:41:01.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8749999999999998e-05 2024-04-25T22:41:01.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:01.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622802+0000", 2024-04-25T22:41:01.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1650000000000001e-05 2024-04-25T22:41:01.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622816+0000", 2024-04-25T22:41:01.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3556e-05 2024-04-25T22:41:01.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:01.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623700+0000", 2024-04-25T22:41:01.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00088389299999999996 2024-04-25T22:41:01.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:01.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623741+0000", 2024-04-25T22:41:01.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1023999999999999e-05 2024-04-25T22:41:01.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:01.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629543+0000", 2024-04-25T22:41:01.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058023980000000003 2024-04-25T22:41:01.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:01.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629640+0000", 2024-04-25T22:41:01.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7381999999999997e-05 2024-04-25T22:41:01.233 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.233 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.233 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.234 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:01.234 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:01.234 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.518981146000002, 2024-04-25T22:41:01.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067054879999999999, 2024-04-25T22:41:01.234 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:01.234 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:01.234 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.234 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:01.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:01.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:01.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:01.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:01.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:01.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623032+0000", 2024-04-25T22:41:01.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.9930000000000007e-06 2024-04-25T22:41:01.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:01.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623043+0000", 2024-04-25T22:41:01.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0387000000000001e-05 2024-04-25T22:41:01.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:01.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623064+0000", 2024-04-25T22:41:01.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1849999999999999e-05 2024-04-25T22:41:01.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623079+0000", 2024-04-25T22:41:01.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4093e-05 2024-04-25T22:41:01.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.237 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:01.237 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624384+0000", 2024-04-25T22:41:01.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013054539999999999 2024-04-25T22:41:01.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.237 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:01.237 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624421+0000", 2024-04-25T22:41:01.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7088999999999997e-05 2024-04-25T22:41:01.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.237 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:01.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629645+0000", 2024-04-25T22:41:01.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052241400000000004 2024-04-25T22:41:01.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:01.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629728+0000", 2024-04-25T22:41:01.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2482000000000001e-05 2024-04-25T22:41:01.238 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.238 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.238 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.238 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2024-04-25T22:41:01.238 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:01.239 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.518898032999999, 2024-04-25T22:41:01.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078029559999999998, 2024-04-25T22:41:01.239 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:01.239 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:01.239 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.239 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:01.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:01.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:01.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:01.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:01.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:01.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:01.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623106+0000", 2024-04-25T22:41:01.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.64e-07 2024-04-25T22:41:01.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:01.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623141+0000", 2024-04-25T22:41:01.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4678999999999998e-05 2024-04-25T22:41:01.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:01.241 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623153+0000", 2024-04-25T22:41:01.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1759999999999999e-05 2024-04-25T22:41:01.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.241 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623161+0000", 2024-04-25T22:41:01.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8299999999999996e-06 2024-04-25T22:41:01.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:01.241 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623834+0000", 2024-04-25T22:41:01.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067394500000000001 2024-04-25T22:41:01.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:01.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623883+0000", 2024-04-25T22:41:01.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8640000000000002e-05 2024-04-25T22:41:01.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:01.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630807+0000", 2024-04-25T22:41:01.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069238859999999998 2024-04-25T22:41:01.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:01.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:01.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:01.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630908+0000", 2024-04-25T22:41:01.243 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101252 2024-04-25T22:41:01.243 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.243 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.243 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.243 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:01.243 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:01.243 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:01.244 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:01.245 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:01.245+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:01.345 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:01.345+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:01.378 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:01.378 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:01.378 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:01.378 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:01.389 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:01.478 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:01.477+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:01.548 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:01.545+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:01.557 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:41:01.558 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:01.558 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:01.558 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:01.558 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:01.558 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:01.572 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:01.652 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:41:01.662 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:01.661+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:01.719 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:01.720 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:01.740 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:41:01.741 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:41:01.747 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:01.747 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:01.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:01.747 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:01.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.747 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:01.747 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:01.747 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 47.149649085999997, 2024-04-25T22:41:01.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:01.748 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:01.748 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:01.748 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.748 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:01.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:01.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:01.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:01.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:01.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:01.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:01.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:01.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:01.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:01.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:01.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:01.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:01.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:01.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.750 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.750 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:01.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:01.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.750 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.750 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:01.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:01.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.750 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:01.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:01.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:01.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:01.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:01.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:01.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:01.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:01.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:01.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:01.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:01.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:01.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:01.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:01.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:01.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:01.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:01.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:01.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:01.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:01.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:01.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:01.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:01.753 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.753 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.753 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.753 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:01.754 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:01.754 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 47.149511830000002, 2024-04-25T22:41:01.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:01.754 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:01.754 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:01.754 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.754 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:01.754 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:01.754 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:01.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.754 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.754 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:01.755 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:01.755 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.755 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.755 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.755 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:01.755 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:01.755 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:01.755 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.755 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.755 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:01.755 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:01.755 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:01.755 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.755 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.755 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:01.756 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:01.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:01.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.756 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.756 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:01.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:01.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.756 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.756 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:01.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:01.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.756 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:01.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:01.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:01.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:01.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:01.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:01.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:01.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:01.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:01.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:01.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:01.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:01.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:01.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:01.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:01.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:01.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:01.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.759 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:01.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:01.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:01.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.759 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:01.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:01.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:01.759 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.759 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.759 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.760 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:01.760 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:01.760 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 47.149424277999998, 2024-04-25T22:41:01.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:01.760 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:01.760 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:01.760 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.760 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:01.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.760 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:01.760 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:01.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.761 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.761 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.761 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:01.761 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:01.761 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.761 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.761 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.761 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:01.761 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:01.761 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:01.761 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.761 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.761 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:01.762 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:01.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:01.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.762 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:01.762 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:01.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:01.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.762 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.762 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:01.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:01.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:01.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:01.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:01.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:01.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:01.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:01.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:01.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:01.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:01.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:01.764 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:01.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:01.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:01.764 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:01.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:01.765 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:01.765 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.765 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.765 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:01.765 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:01.765 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:01.765 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.765 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.765 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:01.765 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:01.765 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:01.765 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.765 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.765 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:01.766 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:01.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:01.766 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.766 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.766 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.766 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.766 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:01.766 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:01.766 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 47.149320451999998, 2024-04-25T22:41:01.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:01.766 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:01.766 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:01.767 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.767 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:01.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.767 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:01.767 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:01.767 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.767 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.767 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:01.767 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:01.767 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.767 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.767 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:01.767 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:01.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:01.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:01.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:01.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:01.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:01.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:01.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:01.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:01.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:01.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:01.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:01.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:01.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:01.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:01.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:01.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:01.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.770 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:01.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:01.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:01.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.770 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:01.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:01.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:01.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:01.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:01.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:01.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:01.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:01.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:01.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:01.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:01.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:01.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:01.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:01.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:01.772 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.772 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.772 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.772 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:01.772 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:01.772 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 47.149251661999998, 2024-04-25T22:41:01.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:01.772 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:01.772 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:01.772 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.773 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:01.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:01.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:01.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:01.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:01.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:01.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:01.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:01.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:01.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:01.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:01.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:01.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:01.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:01.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.775 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.775 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:01.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:01.775 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.775 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.775 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.775 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:01.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:01.775 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.775 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.775 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:01.775 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:01.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:01.775 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.775 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:01.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:01.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:01.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:01.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:01.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:01.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:01.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:01.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:01.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:01.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:01.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:01.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:01.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:01.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:01.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:01.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:01.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:01.778 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:01.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:01.778 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.778 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.778 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.778 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:01.778 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:01.779 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 47.149182576000001, 2024-04-25T22:41:01.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:01.779 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:01.779 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:01.779 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.779 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:01.779 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.779 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:01.779 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:01.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.779 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.779 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.779 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:01.779 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:01.780 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.780 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:01.780 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:01.780 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:01.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.780 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:01.780 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:01.780 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:01.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.780 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:01.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:01.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:01.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:01.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:01.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:01.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:01.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:01.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:01.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:01.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:01.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:01.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:01.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:01.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:01.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:01.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:01.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:01.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:01.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:01.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:01.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:01.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:01.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:01.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:01.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:01.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:01.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.784 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:01.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:01.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:01.784 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.784 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.784 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.784 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:01.784 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:01.784 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 47.149086463000003, 2024-04-25T22:41:01.785 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:01.785 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:01.785 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:01.785 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:01.785 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:01.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.785 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:01.785 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:01.785 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.785 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.785 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:01.785 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:01.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:01.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:01.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:01.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:01.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:01.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:01.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:01.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:01.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:01.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:01.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:01.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:01.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:01.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:01.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:01.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:01.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:01.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:01.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:01.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:01.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:01.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:01.789 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:01.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:01.789 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.789 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.789 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.789 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:01.789 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:01.789 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 47.149020800999999, 2024-04-25T22:41:01.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:01.789 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:01.789 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:01.789 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:01.790 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:01.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.790 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:01.790 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:01.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.790 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.790 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:01.790 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:01.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.790 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.790 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:01.791 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:01.791 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:01.791 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.791 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.791 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:01.791 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:01.791 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:01.791 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.791 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.791 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:01.791 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:01.791 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:01.791 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.791 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.791 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:01.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:01.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:01.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:01.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:01.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:01.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:01.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.793 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:01.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:01.793 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.793 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.793 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:01.793 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:01.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:01.793 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.793 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.793 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:01.793 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:01.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:01.793 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.793 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.794 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.794 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.794 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.794 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:01.794 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:01.794 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 47.148951674000003, 2024-04-25T22:41:01.794 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:01.794 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:01.794 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:01.794 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:01.794 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:01.794 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.794 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:01.795 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:01.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.795 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:01.795 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:01.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.795 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:01.795 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:01.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:01.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.796 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.796 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:01.796 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:01.796 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:01.796 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.796 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.796 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:01.796 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:01.796 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:01.796 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.796 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.796 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.796 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:01.796 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:01.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.797 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:01.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:01.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.797 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:01.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:01.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:01.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.797 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:01.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:01.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:01.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:01.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:01.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:01.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:01.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:01.798 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.798 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.798 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.799 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.799 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.799 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:01.799 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:01.799 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 47.138135018, 2024-04-25T22:41:01.799 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:01.799 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:01.799 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:01.799 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:01.799 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:01.799 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.799 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:01.799 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:01.799 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:01.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:01.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:01.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:01.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:01.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:01.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:01.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:01.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.801 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:01.801 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:01.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:01.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.801 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.801 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:01.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:01.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.801 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.802 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:01.802 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:01.802 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.802 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.802 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:01.802 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:01.802 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:01.802 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.802 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.802 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.802 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.802 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.802 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:01.803 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:01.803 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 47.121236664999998, 2024-04-25T22:41:01.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:01.803 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:01.803 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:01.803 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:01.803 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:01.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:01.803 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:01.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.803 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:01.804 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:01.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.804 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:01.804 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:01.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:01.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.804 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:01.804 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:01.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:01.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.805 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:01.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:01.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:01.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.805 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:01.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:01.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.805 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:01.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:01.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.806 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:01.806 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:01.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:01.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.806 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:01.806 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:01.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:01.806 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.806 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.806 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.807 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.807 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:01.807 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:01.807 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 47.120415774999998, 2024-04-25T22:41:01.807 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:01.807 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:01.807 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:01.807 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:01.807 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:01.807 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.807 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:01.807 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:01.807 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.807 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.808 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:01.808 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:01.808 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.808 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.808 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.808 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:01.808 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:01.808 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:01.808 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.808 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.808 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:01.808 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:01.808 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:01.808 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.809 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:01.809 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:01.809 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:01.809 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.809 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.809 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:01.809 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:01.809 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.809 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.809 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:01.809 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:01.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.810 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:01.810 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:01.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:01.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.810 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:01.810 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:01.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:01.810 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.810 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.810 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.811 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:01.811 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:01.811 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 47.118715047000002, 2024-04-25T22:41:01.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:01.811 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:01.811 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:01.811 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.811 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:01.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.811 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:01.811 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:01.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.811 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:01.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:01.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:01.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:01.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:01.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:01.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:01.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:01.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.813 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.813 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:01.813 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:01.813 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:01.813 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.813 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.813 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.813 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:01.813 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:01.813 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.813 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.813 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.813 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:01.813 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:01.813 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.814 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.814 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:01.814 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:01.814 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:01.814 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.814 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.814 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:01.814 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:01.814 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:01.814 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.814 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.814 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:01.814 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:01.814 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:01.815 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.815 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.815 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.815 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.815 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.815 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:01.815 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:01.815 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 47.118118371999998, 2024-04-25T22:41:01.815 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:01.815 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:01.815 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:01.815 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.815 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:01.815 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.815 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:01.816 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:01.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.816 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:01.816 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:01.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.816 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:01.816 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:01.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:01.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.817 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:01.817 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:01.817 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:01.817 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.817 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.817 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:01.817 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:01.817 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:01.817 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.817 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.817 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.817 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:01.817 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:01.817 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.818 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.818 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.818 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:01.818 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:01.818 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.818 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.818 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:01.818 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:01.818 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:01.818 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.818 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.818 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:01.818 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:01.818 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:01.819 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.819 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.819 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:01.819 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:01.819 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:01.819 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.819 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.819 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.819 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.819 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.819 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:01.819 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:01.819 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 47.108682645999998, 2024-04-25T22:41:01.819 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:01.820 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:01.820 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:01.820 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:01.820 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:01.820 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.820 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:01.820 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:01.820 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.820 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.820 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.820 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:01.820 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:01.820 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:01.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:01.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:01.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:01.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:01.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:01.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:01.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:01.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:01.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.822 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.822 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.822 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:01.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:01.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.822 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.822 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.822 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:01.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:01.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.822 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:01.823 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:01.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:01.823 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.823 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.823 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.823 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.823 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:01.823 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:01.823 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 47.108035219999998, 2024-04-25T22:41:01.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:01.823 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:01.823 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:01.823 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.824 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:01.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.824 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:01.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:01.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.824 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.824 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:01.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:01.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.824 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.824 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:01.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:01.825 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:01.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.825 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.825 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:01.825 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:01.825 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:01.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.825 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.825 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:01.825 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:01.825 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:01.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.825 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.825 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.825 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:01.826 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:01.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.826 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.826 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:01.826 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:01.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.826 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:01.826 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:01.826 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:01.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:01.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:01.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:01.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:01.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:01.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:01.827 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.827 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.827 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.827 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:01.828 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:01.828 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 47.106594401000002, 2024-04-25T22:41:01.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:01.828 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:01.828 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:01.828 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.828 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:01.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:01.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:01.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:01.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:01.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:01.829 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:01.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:01.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:01.829 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:01.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:01.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:01.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:01.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:01.830 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.830 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:01.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:01.830 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.830 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:01.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:01.831 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.831 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.831 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:01.831 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:01.831 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:01.831 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.831 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.831 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:01.831 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:01.831 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:01.831 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.831 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.831 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:01.831 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:01.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:01.832 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.832 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.832 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.832 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.832 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:01.832 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:01.832 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 45.154155957, 2024-04-25T22:41:01.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:01.832 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:01.832 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:01.832 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.832 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:01.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:01.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:01.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:01.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:01.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:01.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:01.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:01.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:01.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:01.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:01.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:01.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:01.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:01.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:01.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:01.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:01.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:01.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:01.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:01.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:01.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:01.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:01.836 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:01.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.836 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:01.836 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:01.836 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:01.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.836 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:01.836 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:01.836 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:01.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.837 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:01.837 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:01.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:01.837 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.837 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.837 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:01.837 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:01.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:01.837 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.837 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.837 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.837 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.837 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.838 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:01.838 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:01.838 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 23.151496633000001, 2024-04-25T22:41:01.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:01.838 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:01.838 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:01.838 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.838 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:01.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:01.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:01.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.838 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:01.839 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:01.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:01.839 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:01.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:01.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:01.839 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:01.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:01.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:01.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:01.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:01.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:01.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:01.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:01.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:01.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:01.841 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:01.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:01.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:01.841 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:01.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:01.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:01.841 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:01.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:01.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.842 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.842 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:01.842 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:01.842 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:01.842 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.842 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.842 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:01.842 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:01.842 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:01.842 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.842 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.842 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:01.842 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:01.842 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:01.843 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.843 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.843 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.843 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.843 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.843 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:01.843 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:01.843 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 18.151204382, 2024-04-25T22:41:01.843 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:01.843 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:01.843 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:01.843 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:01.843 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:01.843 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:01.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:01.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:01.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:01.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:01.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:01.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:01.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:01.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:01.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:01.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:01.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:01.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:01.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:01.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:01.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:01.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:01.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:01.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:01.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:01.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:01.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:01.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:01.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:01.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:01.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:01.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.847 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:01.847 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:01.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:01.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.847 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:01.847 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:01.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:01.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.847 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:01.847 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:01.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:01.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:01.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:01.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:01.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:01.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:01.848 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.848 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.848 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.848 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:01.848 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:01.848 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:01.849 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:01.851 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:01.851 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:01.852 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:01.850+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:01.951 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:01.950+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:01.982 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:01.982 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:01.998 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:02.084 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:02.086+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:02.153 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:02.151+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:02.162 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:02.162 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:02.178 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:02.254 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:02.253+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:02.345 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:02.345 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:02.355 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:02.353+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:02.359 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:41:02.456 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:02.454+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:02.490 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:02.490 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:02.504 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:41:02.557 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:02.553+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:02.627 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:02.627 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:02.642 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:41:02.658 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:02.658+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:02.665 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is set 2024-04-25T22:41:02.759 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:02.758+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:02.765 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:02.765 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:02.779 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:02.860 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:02.857+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:02.892 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:41:02.892 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:41:02.892 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-25T22:41:02.892 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-25T22:41:02.892 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-25T22:41:02.893 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-25T22:41:02.912 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:02.912 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:02.927 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:02.974 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:02.973+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:03.011 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:03.011 INFO:teuthology.orchestra.run.smithi188.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-25T22:41:03.011 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:03.061 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:03.062+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:03.099 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:03.099 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:03.113 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:03.162 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:03.162+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:03.234 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:03.234 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:03.247 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:03.263 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:03.263+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:03.364 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:03.365+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:03.378 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:03.378 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:03.394 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:03.465 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:03.465+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:03.516 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:03.517 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:03.530 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:03.565 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:03.563+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:03.654 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:03.654 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:03.666 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:03.667+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:03.668 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:41:03.766 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:03.765+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:03.798 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:03.799 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:03.814 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:41:03.852 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:41:03.867 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:03.866+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:03.937 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:03.937 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:03.951 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:41:03.999 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:03.999+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:04.015 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:04.015 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:04.033 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:41:04.033 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:41:04.054 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:04.054 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:04.070 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:04.069+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:04.075 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:04.075 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-04-25T22:41:04.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-04-25T22:41:04.075 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-04-25T22:41:04.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.075 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:111 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'73, mlcod=11'69)", 2024-04-25T22:41:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.373952211999999, 2024-04-25T22:41:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055481899999999997, 2024-04-25T22:41:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700271+0000", 2024-04-25T22:41:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:41:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700278+0000", 2024-04-25T22:41:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-04-25T22:41:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700323+0000", 2024-04-25T22:41:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4212999999999998e-05 2024-04-25T22:41:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700333+0000", 2024-04-25T22:41:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0433e-05 2024-04-25T22:41:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700662+0000", 2024-04-25T22:41:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032862800000000003 2024-04-25T22:41:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700692+0000", 2024-04-25T22:41:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0395999999999998e-05 2024-04-25T22:41:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705728+0000", 2024-04-25T22:41:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050361939999999999 2024-04-25T22:41:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705818+0000", 2024-04-25T22:41:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9573000000000005e-05 2024-04-25T22:41:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-25T22:41:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.373407360000002, 2024-04-25T22:41:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005065501, 2024-04-25T22:41:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700816+0000", 2024-04-25T22:41:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.24e-06 2024-04-25T22:41:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700914+0000", 2024-04-25T22:41:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8057e-05 2024-04-25T22:41:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700931+0000", 2024-04-25T22:41:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7745999999999999e-05 2024-04-25T22:41:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700941+0000", 2024-04-25T22:41:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5699999999999999e-06 2024-04-25T22:41:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701162+0000", 2024-04-25T22:41:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000221392 2024-04-25T22:41:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701194+0000", 2024-04-25T22:41:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1745999999999997e-05 2024-04-25T22:41:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705821+0000", 2024-04-25T22:41:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046269869999999999 2024-04-25T22:41:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705880+0000", 2024-04-25T22:41:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8763e-05 2024-04-25T22:41:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:118 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'80, mlcod=11'78)", 2024-04-25T22:41:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.366051749999997, 2024-04-25T22:41:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047806089999999999, 2024-04-25T22:41:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708172+0000", 2024-04-25T22:41:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0600000000000002e-06 2024-04-25T22:41:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708291+0000", 2024-04-25T22:41:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118892 2024-04-25T22:41:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708320+0000", 2024-04-25T22:41:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8822999999999998e-05 2024-04-25T22:41:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708337+0000", 2024-04-25T22:41:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7586999999999999e-05 2024-04-25T22:41:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708512+0000", 2024-04-25T22:41:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017439500000000001 2024-04-25T22:41:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708551+0000", 2024-04-25T22:41:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.909e-05 2024-04-25T22:41:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712865+0000", 2024-04-25T22:41:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043142069999999996 2024-04-25T22:41:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712951+0000", 2024-04-25T22:41:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5555000000000003e-05 2024-04-25T22:41:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:120 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'82, mlcod=11'78)", 2024-04-25T22:41:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.365045707999997, 2024-04-25T22:41:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047170700000000003, 2024-04-25T22:41:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709177+0000", 2024-04-25T22:41:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.19e-06 2024-04-25T22:41:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709315+0000", 2024-04-25T22:41:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000137429 2024-04-25T22:41:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709341+0000", 2024-04-25T22:41:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:41:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709353+0000", 2024-04-25T22:41:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2027e-05 2024-04-25T22:41:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710040+0000", 2024-04-25T22:41:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068710799999999997 2024-04-25T22:41:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710076+0000", 2024-04-25T22:41:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5982999999999998e-05 2024-04-25T22:41:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713802+0000", 2024-04-25T22:41:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037255750000000001 2024-04-25T22:41:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713893+0000", 2024-04-25T22:41:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1201999999999999e-05 2024-04-25T22:41:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:121 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'83, mlcod=11'78)", 2024-04-25T22:41:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.364499072000001, 2024-04-25T22:41:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0049043919999999996, 2024-04-25T22:41:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709724+0000", 2024-04-25T22:41:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.483e-06 2024-04-25T22:41:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709872+0000", 2024-04-25T22:41:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147446 2024-04-25T22:41:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709891+0000", 2024-04-25T22:41:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9245999999999998e-05 2024-04-25T22:41:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709900+0000", 2024-04-25T22:41:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1439999999999992e-06 2024-04-25T22:41:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713091+0000", 2024-04-25T22:41:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031910710000000002 2024-04-25T22:41:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713122+0000", 2024-04-25T22:41:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.048e-05 2024-04-25T22:41:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714538+0000", 2024-04-25T22:41:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014160030000000001 2024-04-25T22:41:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714627+0000", 2024-04-25T22:41:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518999999999995e-05 2024-04-25T22:41:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.474109691999999, 2024-04-25T22:41:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022089675999999999, 2024-04-25T22:41:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600120+0000", 2024-04-25T22:41:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1259999999999998e-06 2024-04-25T22:41:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600153+0000", 2024-04-25T22:41:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3186999999999999e-05 2024-04-25T22:41:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600181+0000", 2024-04-25T22:41:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7676000000000001e-05 2024-04-25T22:41:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600205+0000", 2024-04-25T22:41:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:41:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600467+0000", 2024-04-25T22:41:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026186800000000001 2024-04-25T22:41:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600809+0000", 2024-04-25T22:41:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034138400000000002 2024-04-25T22:41:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.601892+0000", 2024-04-25T22:41:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010831910000000001 2024-04-25T22:41:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611054+0000", 2024-04-25T22:41:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0091620940000000008 2024-04-25T22:41:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621965+0000", 2024-04-25T22:41:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010911044999999999 2024-04-25T22:41:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622090+0000", 2024-04-25T22:41:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012522 2024-04-25T22:41:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622202+0000", 2024-04-25T22:41:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011164500000000001 2024-04-25T22:41:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.473966636999997, 2024-04-25T22:41:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035756228000000001, 2024-04-25T22:41:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600257+0000", 2024-04-25T22:41:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8300000000000001e-06 2024-04-25T22:41:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600267+0000", 2024-04-25T22:41:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6539999999999994e-06 2024-04-25T22:41:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600293+0000", 2024-04-25T22:41:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5996e-05 2024-04-25T22:41:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600309+0000", 2024-04-25T22:41:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6206e-05 2024-04-25T22:41:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603757+0000", 2024-04-25T22:41:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003448244 2024-04-25T22:41:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604779+0000", 2024-04-25T22:41:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010216820000000001 2024-04-25T22:41:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605127+0000", 2024-04-25T22:41:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034820100000000002 2024-04-25T22:41:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611082+0000", 2024-04-25T22:41:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0059550640000000004 2024-04-25T22:41:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635779+0000", 2024-04-25T22:41:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024696665999999999 2024-04-25T22:41:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635915+0000", 2024-04-25T22:41:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000135809 2024-04-25T22:41:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636011+0000", 2024-04-25T22:41:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6875999999999999e-05 2024-04-25T22:41:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.473889423999999, 2024-04-25T22:41:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035327031000000002, 2024-04-25T22:41:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600334+0000", 2024-04-25T22:41:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:41:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600347+0000", 2024-04-25T22:41:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3593e-05 2024-04-25T22:41:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600371+0000", 2024-04-25T22:41:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.313e-05 2024-04-25T22:41:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600390+0000", 2024-04-25T22:41:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.908e-05 2024-04-25T22:41:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602756+0000", 2024-04-25T22:41:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023662560000000002 2024-04-25T22:41:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603021+0000", 2024-04-25T22:41:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026546399999999998 2024-04-25T22:41:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603304+0000", 2024-04-25T22:41:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028308800000000002 2024-04-25T22:41:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611075+0000", 2024-04-25T22:41:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077703900000000003 2024-04-25T22:41:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635414+0000", 2024-04-25T22:41:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024339326000000001 2024-04-25T22:41:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635544+0000", 2024-04-25T22:41:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012948199999999999 2024-04-25T22:41:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635659+0000", 2024-04-25T22:41:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000115809 2024-04-25T22:41:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.473729499000001, 2024-04-25T22:41:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035594492999999998, 2024-04-25T22:41:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600494+0000", 2024-04-25T22:41:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:41:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600502+0000", 2024-04-25T22:41:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3769999999999996e-06 2024-04-25T22:41:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600522+0000", 2024-04-25T22:41:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9919999999999999e-05 2024-04-25T22:41:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600539+0000", 2024-04-25T22:41:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.649e-05 2024-04-25T22:41:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604846+0000", 2024-04-25T22:41:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043075199999999996 2024-04-25T22:41:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605057+0000", 2024-04-25T22:41:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00021085200000000001 2024-04-25T22:41:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605378+0000", 2024-04-25T22:41:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032074799999999999 2024-04-25T22:41:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611089+0000", 2024-04-25T22:41:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057110249999999998 2024-04-25T22:41:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635844+0000", 2024-04-25T22:41:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024755355999999999 2024-04-25T22:41:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635986+0000", 2024-04-25T22:41:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141512 2024-04-25T22:41:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636087+0000", 2024-04-25T22:41:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101183 2024-04-25T22:41:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.473656888999997, 2024-04-25T22:41:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021266723000000001, 2024-04-25T22:41:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600566+0000", 2024-04-25T22:41:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4959999999999999e-06 2024-04-25T22:41:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600574+0000", 2024-04-25T22:41:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-06 2024-04-25T22:41:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600592+0000", 2024-04-25T22:41:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8479999999999999e-05 2024-04-25T22:41:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600610+0000", 2024-04-25T22:41:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7567e-05 2024-04-25T22:41:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602679+0000", 2024-04-25T22:41:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020692739999999999 2024-04-25T22:41:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602945+0000", 2024-04-25T22:41:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026640399999999998 2024-04-25T22:41:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603115+0000", 2024-04-25T22:41:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000169996 2024-04-25T22:41:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608398+0000", 2024-04-25T22:41:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052826289999999996 2024-04-25T22:41:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621588+0000", 2024-04-25T22:41:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013190489 2024-04-25T22:41:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621733+0000", 2024-04-25T22:41:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014462500000000001 2024-04-25T22:41:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621832+0000", 2024-04-25T22:41:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8603000000000004e-05 2024-04-25T22:41:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.473589163, 2024-04-25T22:41:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034747924999999999, 2024-04-25T22:41:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600634+0000", 2024-04-25T22:41:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-04-25T22:41:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600642+0000", 2024-04-25T22:41:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8169999999999999e-06 2024-04-25T22:41:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600660+0000", 2024-04-25T22:41:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8513e-05 2024-04-25T22:41:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600676+0000", 2024-04-25T22:41:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6019999999999999e-05 2024-04-25T22:41:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603748+0000", 2024-04-25T22:41:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030718329999999999 2024-04-25T22:41:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604752+0000", 2024-04-25T22:41:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001003603 2024-04-25T22:41:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605117+0000", 2024-04-25T22:41:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00036539 2024-04-25T22:41:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608459+0000", 2024-04-25T22:41:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033413879999999998 2024-04-25T22:41:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635106+0000", 2024-04-25T22:41:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026647607 2024-04-25T22:41:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635273+0000", 2024-04-25T22:41:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000166689 2024-04-25T22:41:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635381+0000", 2024-04-25T22:41:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107642 2024-04-25T22:41:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.130 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.130 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.130 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:04.130 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:04.130 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.473525934000001, 2024-04-25T22:41:04.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040419292000000002, 2024-04-25T22:41:04.130 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:04.130 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:04.130 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.130 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:04.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600697+0000", 2024-04-25T22:41:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1999999999999999e-06 2024-04-25T22:41:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600704+0000", 2024-04-25T22:41:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5570000000000001e-06 2024-04-25T22:41:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600724+0000", 2024-04-25T22:41:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0023000000000001e-05 2024-04-25T22:41:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600738+0000", 2024-04-25T22:41:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4372999999999999e-05 2024-04-25T22:41:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.612532+0000", 2024-04-25T22:41:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011793606 2024-04-25T22:41:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613354+0000", 2024-04-25T22:41:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00082244100000000004 2024-04-25T22:41:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613726+0000", 2024-04-25T22:41:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00037226000000000002 2024-04-25T22:41:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618891+0000", 2024-04-25T22:41:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051649199999999999 2024-04-25T22:41:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.640874+0000", 2024-04-25T22:41:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021982640000000001 2024-04-25T22:41:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641019+0000", 2024-04-25T22:41:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000145339 2024-04-25T22:41:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641115+0000", 2024-04-25T22:41:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5933000000000005e-05 2024-04-25T22:41:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.473439904000003, 2024-04-25T22:41:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036502711, 2024-04-25T22:41:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600783+0000", 2024-04-25T22:41:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.533e-06 2024-04-25T22:41:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600790+0000", 2024-04-25T22:41:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0439999999999998e-06 2024-04-25T22:41:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600811+0000", 2024-04-25T22:41:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0449e-05 2024-04-25T22:41:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600825+0000", 2024-04-25T22:41:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4293e-05 2024-04-25T22:41:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602304+0000", 2024-04-25T22:41:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001478629 2024-04-25T22:41:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602587+0000", 2024-04-25T22:41:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028350800000000002 2024-04-25T22:41:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.637285+0000", 2024-04-25T22:41:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034697255000000003 2024-04-25T22:41:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.473374337999999, 2024-04-25T22:41:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017311460000000001, 2024-04-25T22:41:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600849+0000", 2024-04-25T22:41:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2899999999999999e-06 2024-04-25T22:41:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600866+0000", 2024-04-25T22:41:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6793e-05 2024-04-25T22:41:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600886+0000", 2024-04-25T22:41:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0772999999999999e-05 2024-04-25T22:41:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600904+0000", 2024-04-25T22:41:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7697e-05 2024-04-25T22:41:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602796+0000", 2024-04-25T22:41:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018920149999999999 2024-04-25T22:41:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602962+0000", 2024-04-25T22:41:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016590600000000001 2024-04-25T22:41:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618159+0000", 2024-04-25T22:41:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015196985999999999 2024-04-25T22:41:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.458498597000002, 2024-04-25T22:41:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006380269, 2024-04-25T22:41:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615724+0000", 2024-04-25T22:41:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.094e-06 2024-04-25T22:41:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615734+0000", 2024-04-25T22:41:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.363e-06 2024-04-25T22:41:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615751+0000", 2024-04-25T22:41:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:41:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615773+0000", 2024-04-25T22:41:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.154e-05 2024-04-25T22:41:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616485+0000", 2024-04-25T22:41:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00071225100000000001 2024-04-25T22:41:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616528+0000", 2024-04-25T22:41:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3606000000000002e-05 2024-04-25T22:41:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622030+0000", 2024-04-25T22:41:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055010750000000002 2024-04-25T22:41:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622103+0000", 2024-04-25T22:41:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3930000000000005e-05 2024-04-25T22:41:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.457585659999999, 2024-04-25T22:41:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046420649999999999, 2024-04-25T22:41:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-04-25T22:41:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616637+0000", 2024-04-25T22:41:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0299999999999998e-07 2024-04-25T22:41:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616653+0000", 2024-04-25T22:41:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5843000000000001e-05 2024-04-25T22:41:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616690+0000", 2024-04-25T22:41:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7466999999999999e-05 2024-04-25T22:41:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616729+0000", 2024-04-25T22:41:04.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8810000000000003e-05 2024-04-25T22:41:04.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:04.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617251+0000", 2024-04-25T22:41:04.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00052143899999999995 2024-04-25T22:41:04.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:04.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621278+0000", 2024-04-25T22:41:04.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040277029999999997 2024-04-25T22:41:04.153 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.153 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.153 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.153 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:04.153 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.456562308000002, 2024-04-25T22:41:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0065101730000000002, 2024-04-25T22:41:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:04.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:04.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:04.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:04.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:04.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617661+0000", 2024-04-25T22:41:04.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:41:04.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:04.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617688+0000", 2024-04-25T22:41:04.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7589e-05 2024-04-25T22:41:04.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:04.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617710+0000", 2024-04-25T22:41:04.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1467e-05 2024-04-25T22:41:04.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617727+0000", 2024-04-25T22:41:04.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6990000000000002e-05 2024-04-25T22:41:04.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:04.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618559+0000", 2024-04-25T22:41:04.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083207400000000003 2024-04-25T22:41:04.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:04.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618608+0000", 2024-04-25T22:41:04.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8936e-05 2024-04-25T22:41:04.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:04.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624077+0000", 2024-04-25T22:41:04.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054695840000000004 2024-04-25T22:41:04.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:04.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624170+0000", 2024-04-25T22:41:04.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2305999999999993e-05 2024-04-25T22:41:04.161 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.161 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.161 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.161 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:04.162 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:04.162 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.4514608, 2024-04-25T22:41:04.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006879446, 2024-04-25T22:41:04.162 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:04.162 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:04.162 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.162 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:04.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:04.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:04.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:04.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:04.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:04.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622762+0000", 2024-04-25T22:41:04.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:41:04.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:04.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622781+0000", 2024-04-25T22:41:04.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8749999999999998e-05 2024-04-25T22:41:04.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:04.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622802+0000", 2024-04-25T22:41:04.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1650000000000001e-05 2024-04-25T22:41:04.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622816+0000", 2024-04-25T22:41:04.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3556e-05 2024-04-25T22:41:04.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:04.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623700+0000", 2024-04-25T22:41:04.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00088389299999999996 2024-04-25T22:41:04.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:04.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623741+0000", 2024-04-25T22:41:04.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1023999999999999e-05 2024-04-25T22:41:04.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:04.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629543+0000", 2024-04-25T22:41:04.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058023980000000003 2024-04-25T22:41:04.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:04.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629640+0000", 2024-04-25T22:41:04.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7381999999999997e-05 2024-04-25T22:41:04.167 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.167 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.167 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.167 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:04.168 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:04.168 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.451199596000002, 2024-04-25T22:41:04.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067054879999999999, 2024-04-25T22:41:04.168 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:04.168 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:04.168 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.168 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:04.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:04.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:04.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:04.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:04.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:04.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623032+0000", 2024-04-25T22:41:04.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.9930000000000007e-06 2024-04-25T22:41:04.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:04.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623043+0000", 2024-04-25T22:41:04.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0387000000000001e-05 2024-04-25T22:41:04.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:04.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623064+0000", 2024-04-25T22:41:04.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1849999999999999e-05 2024-04-25T22:41:04.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623079+0000", 2024-04-25T22:41:04.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4093e-05 2024-04-25T22:41:04.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:04.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624384+0000", 2024-04-25T22:41:04.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013054539999999999 2024-04-25T22:41:04.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:04.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624421+0000", 2024-04-25T22:41:04.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7088999999999997e-05 2024-04-25T22:41:04.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:04.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629645+0000", 2024-04-25T22:41:04.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052241400000000004 2024-04-25T22:41:04.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:04.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629728+0000", 2024-04-25T22:41:04.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2482000000000001e-05 2024-04-25T22:41:04.172 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.172 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.172 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.172 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2024-04-25T22:41:04.172 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:04.172 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.451116483, 2024-04-25T22:41:04.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078029559999999998, 2024-04-25T22:41:04.172 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:04.172 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:04.172 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.172 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:04.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:04.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:04.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:04.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:04.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:04.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:04.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623106+0000", 2024-04-25T22:41:04.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.64e-07 2024-04-25T22:41:04.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:04.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623141+0000", 2024-04-25T22:41:04.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4678999999999998e-05 2024-04-25T22:41:04.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:04.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623153+0000", 2024-04-25T22:41:04.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1759999999999999e-05 2024-04-25T22:41:04.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623161+0000", 2024-04-25T22:41:04.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8299999999999996e-06 2024-04-25T22:41:04.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:04.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623834+0000", 2024-04-25T22:41:04.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067394500000000001 2024-04-25T22:41:04.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:04.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623883+0000", 2024-04-25T22:41:04.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8640000000000002e-05 2024-04-25T22:41:04.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:04.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630807+0000", 2024-04-25T22:41:04.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069238859999999998 2024-04-25T22:41:04.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:04.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:04.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:04.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630908+0000", 2024-04-25T22:41:04.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101252 2024-04-25T22:41:04.176 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.176 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.176 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.176 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:04.176 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:04.176 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:04.178 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:04.178 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:04.175+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:04.278 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:04.275+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:04.308 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:04.309 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:04.309 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:04.309 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:04.322 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:04.379 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:04.378+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:04.439 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:04.440 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:04.440 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:04.440 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:04.440 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:04.455 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:04.502 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:04.501+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:04.579 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:04.579 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:04.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:04.579 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:04.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.579 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:04.579 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:04.579 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 49.981418509999997, 2024-04-25T22:41:04.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:04.580 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:04.580 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:04.580 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.580 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:04.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:04.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:04.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:04.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:04.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:04.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:04.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:04.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:04.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:04.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:04.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:04.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:04.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:04.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:04.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:04.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:04.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:04.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:04.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:04.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:04.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:04.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:04.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:04.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:04.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:04.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:04.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:04.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:04.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:04.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:04.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:04.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:04.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:04.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:04.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:04.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:04.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:04.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:04.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:04.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:04.585 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.585 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.585 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.585 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:04.585 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:04.585 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 49.981281254000002, 2024-04-25T22:41:04.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:04.586 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:04.586 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:04.586 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.586 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:04.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.586 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:04.586 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:04.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.586 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.586 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:04.586 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:04.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:04.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:04.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:04.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:04.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:04.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:04.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:04.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:04.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:04.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:04.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:04.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:04.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:04.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:04.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:04.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:04.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:04.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:04.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:04.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:04.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:04.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:04.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:04.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:04.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:04.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:04.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:04.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:04.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:04.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:04.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:04.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:04.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:04.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.591 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:04.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:04.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:04.591 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.591 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.591 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.591 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:04.592 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:04.592 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 49.981193701999999, 2024-04-25T22:41:04.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:04.592 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:04.592 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:04.592 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.592 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:04.592 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.592 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:04.592 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:04.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:04.593 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:04.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:04.593 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:04.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:04.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:04.593 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:04.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:04.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:04.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:04.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:04.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:04.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:04.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:04.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:04.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:04.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:04.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:04.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:04.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:04.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:04.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:04.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:04.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:04.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:04.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:04.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:04.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:04.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:04.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:04.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:04.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:04.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:04.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:04.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:04.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:04.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:04.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:04.597 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.598 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.598 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.598 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:04.598 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:04.598 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 49.981089875999999, 2024-04-25T22:41:04.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:04.598 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:04.598 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:04.598 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.598 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:04.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:04.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:04.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:04.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:04.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:04.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:04.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:04.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:04.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:04.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:04.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:04.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:04.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:04.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:04.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:04.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:04.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:04.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:04.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:04.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:04.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:04.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:04.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:04.602 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:04.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:04.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:04.602 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:04.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:04.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:04.602 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:04.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:04.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.603 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 49.981021085999998, 2024-04-25T22:41:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:04.606 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:04.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:04.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:04.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 49.980952000000002, 2024-04-25T22:41:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:04.610 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.612 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:04.612 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:04.612 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:04.612 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.612 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.612 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:04.612 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:04.612 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:04.612 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.612 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.612 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.612 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:04.612 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:04.612 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.612 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.613 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.613 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:04.613 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:04.613 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.613 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.613 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:04.613 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:04.613 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:04.613 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.613 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.613 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.613 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:04.613 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:04.613 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.613 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:04.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:04.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:04.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.614 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:04.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:04.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:04.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.614 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:04.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:04.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:04.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.615 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:04.615 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:04.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:04.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.615 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:04.615 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:04.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:04.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.615 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:04.615 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:04.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:04.615 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.616 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.616 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.616 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.616 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.616 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:04.616 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:04.616 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 49.980855886999997, 2024-04-25T22:41:04.616 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:04.616 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:04.616 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:04.616 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:04.616 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:04.616 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.616 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:04.617 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:04.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.617 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.617 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:04.617 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:04.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.617 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.617 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:04.617 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:04.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:04.617 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.617 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:04.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:04.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:04.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:04.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:04.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:04.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:04.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:04.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:04.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:04.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:04.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:04.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:04.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:04.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:04.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:04.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:04.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:04.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:04.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:04.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:04.620 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.620 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.620 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.621 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:04.621 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:04.621 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 49.980790225, 2024-04-25T22:41:04.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:04.621 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:04.621 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:04.621 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:04.621 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:04.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:04.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:04.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:04.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:04.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:04.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:04.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:04.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:04.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:04.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:04.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.623 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:04.623 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:04.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:04.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.623 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.623 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:04.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:04.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.623 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.623 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:04.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:04.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:04.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:04.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:04.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:04.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:04.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:04.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:04.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:04.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:04.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:04.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:04.625 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.625 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.625 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.625 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:04.625 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:04.625 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 49.980721097999997, 2024-04-25T22:41:04.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:04.625 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:04.626 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:04.626 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:04.626 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:04.626 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.626 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:04.626 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:04.626 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.626 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.626 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.626 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:04.626 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:04.626 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.626 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.626 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.626 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:04.627 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:04.627 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:04.627 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.627 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.627 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:04.627 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:04.627 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:04.627 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.627 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.627 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:04.627 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:04.627 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:04.627 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.627 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.627 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.628 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:04.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:04.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.628 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.628 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:04.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:04.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.628 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:04.628 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:04.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:04.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.629 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.629 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:04.629 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:04.629 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.629 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.629 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:04.629 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:04.629 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:04.629 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.629 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.629 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:04.629 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:04.629 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:04.629 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.630 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.630 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.630 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.630 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.630 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:04.630 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:04.630 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 49.969904442000001, 2024-04-25T22:41:04.630 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:04.630 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:04.630 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:04.630 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:04.630 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:04.630 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:04.631 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:04.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:04.631 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:04.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:04.631 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:04.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:04.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.632 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:04.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:04.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:04.632 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.632 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:04.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:04.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:04.632 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.632 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:04.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:04.632 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.633 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.633 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:04.633 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:04.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.633 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.633 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:04.633 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:04.633 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:04.633 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.633 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.633 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.633 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.633 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:04.634 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:04.634 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 49.953006088999999, 2024-04-25T22:41:04.634 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:04.634 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:04.634 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:04.634 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:04.634 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:04.634 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.634 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:04.634 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:04.634 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.634 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.634 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.634 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:04.635 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:04.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.635 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.635 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:04.635 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:04.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:04.635 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.635 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:04.635 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:04.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:04.635 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.636 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:04.636 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:04.636 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:04.636 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.636 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.636 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.636 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:04.636 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:04.636 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.636 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.636 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.636 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:04.636 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:04.636 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.636 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:04.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:04.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:04.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:04.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:04.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:04.637 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.637 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.637 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.637 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:04.638 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:04.638 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 49.952185198999999, 2024-04-25T22:41:04.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:04.638 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:04.638 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:04.638 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:04.638 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:04.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:04.638 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:04.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:04.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:04.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:04.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:04.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:04.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:04.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:04.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:04.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.640 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:04.640 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:04.640 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:04.640 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.640 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.640 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:04.640 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:04.640 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.640 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.640 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:04.640 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:04.640 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:04.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:04.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:04.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:04.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:04.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:04.641 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.641 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.641 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.641 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:04.642 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:04.642 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 49.950484471000003, 2024-04-25T22:41:04.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:04.642 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:04.642 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:04.642 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.642 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:04.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:04.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:04.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:04.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:04.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:04.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:04.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:04.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:04.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:04.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:04.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.644 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:04.644 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:04.644 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:04.644 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.644 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.644 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:04.644 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:04.644 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.644 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.644 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:04.644 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:04.644 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.644 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:04.645 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:04.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:04.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.645 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:04.645 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:04.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:04.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.645 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:04.645 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:04.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:04.645 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.645 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.646 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.646 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:04.646 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:04.646 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 49.949887795999999, 2024-04-25T22:41:04.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:04.646 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:04.646 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:04.646 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.646 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:04.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.646 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:04.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:04.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:04.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:04.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:04.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:04.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:04.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:04.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:04.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:04.648 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.648 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:04.648 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:04.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:04.648 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.648 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.648 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:04.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:04.648 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.648 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.649 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:04.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:04.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:04.649 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:04.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:04.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:04.649 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:04.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:04.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.650 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:04.650 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:04.650 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:04.650 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.650 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.650 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.650 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.650 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.650 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:04.650 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:04.650 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 49.940452069999999, 2024-04-25T22:41:04.650 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:04.650 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:04.650 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:04.651 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:04.651 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:04.651 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.651 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:04.651 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:04.651 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.651 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.651 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.651 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:04.651 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:04.651 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.651 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.651 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:04.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:04.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:04.652 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:04.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:04.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:04.652 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:04.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:04.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:04.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:04.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:04.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:04.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:04.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:04.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:04.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:04.654 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.654 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.654 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.654 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:04.654 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:04.654 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 49.939804643999999, 2024-04-25T22:41:04.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:04.654 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:04.654 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:04.654 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.654 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:04.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:04.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:04.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:04.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:04.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:04.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:04.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:04.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:04.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:04.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:04.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:04.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:04.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:04.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:04.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:04.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.657 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.657 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:04.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:04.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.657 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:04.657 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:04.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:04.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.657 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:04.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:04.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:04.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:04.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:04.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:04.658 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.658 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.658 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.658 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:04.658 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:04.659 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 49.938363825000003, 2024-04-25T22:41:04.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:04.659 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:04.659 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:04.659 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.659 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:04.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:04.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:04.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:04.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:04.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:04.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:04.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:04.660 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:04.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:04.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:04.660 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:04.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:04.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:04.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:04.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:04.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:04.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:04.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:04.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:04.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:04.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.662 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:04.662 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:04.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:04.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.662 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:04.662 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:04.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:04.662 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.662 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.662 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.663 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:04.663 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:04.663 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 47.985925381000001, 2024-04-25T22:41:04.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:04.663 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:04.663 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:04.663 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.663 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:04.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.663 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:04.663 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:04.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.663 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:04.664 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:04.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.664 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:04.664 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:04.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:04.664 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:04.664 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:04.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:04.664 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:04.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:04.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:04.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:04.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:04.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:04.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:04.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:04.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:04.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:04.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:04.670 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:04.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:04.670 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.670 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.670 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:04.670 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:04.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:04.670 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.670 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.670 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:04.670 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:04.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:04.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:04.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:04.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:04.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:04.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:04.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:04.671 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.671 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.671 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.672 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:04.672 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:04.672 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 25.983266057000002, 2024-04-25T22:41:04.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:04.672 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:04.672 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:04.672 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.672 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:04.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:04.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:04.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:04.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:04.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:04.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:04.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:04.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:04.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:04.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:04.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:04.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:04.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:04.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:04.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:04.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:04.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:04.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.675 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:04.675 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:04.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:04.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.675 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:04.675 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:04.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:04.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.675 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:04.675 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:04.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:04.676 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.676 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.676 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:04.676 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:04.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:04.676 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.676 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.676 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:04.676 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:04.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:04.676 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.676 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.676 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:04.676 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:04.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:04.677 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.677 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.677 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.677 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:04.677 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:04.677 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.982973806, 2024-04-25T22:41:04.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:04.677 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:04.677 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:04.677 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:04.677 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:04.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:04.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:04.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:04.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:04.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:04.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:04.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:04.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:04.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:04.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:04.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:04.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:04.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:04.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:04.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:04.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:04.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:04.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:04.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:04.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:04.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:04.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:04.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:04.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:04.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:04.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:04.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.681 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:04.681 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:04.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:04.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.681 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:04.681 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:04.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:04.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.681 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:04.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:04.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:04.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:04.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:04.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:04.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:04.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:04.682 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.682 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.682 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.682 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:04.682 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:04.682 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:04.684 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:04.684 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:04.682+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:04.690 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:41:04.785 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:04.786+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:04.816 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:04.816 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:04.816 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:41:04.816 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:04.831 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:04.886 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:04.887+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:04.987 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:04.986+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:04.996 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:04.996 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:04.996 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:04.996 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:04.997 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:05.010 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:05.096 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:05.098+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:05.180 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:41:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:41:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:41:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.582948440999999, 2024-04-25T22:41:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:41:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:41:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:41:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:41:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:41:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:41:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:41:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:41:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:41:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:41:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:41:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:41:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:41:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:41:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:41:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:41:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:41:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:41:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:41:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:41:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:41:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:41:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:41:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:41:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:41:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:41:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:41:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.582860428000004, 2024-04-25T22:41:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:41:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:41:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:41:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:41:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:41:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:41:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:41:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:41:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:41:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:41:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:41:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:41:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:41:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:41:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:41:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:41:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:41:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:41:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:41:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:41:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:41:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:41:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:41:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:41:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:41:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.582788305999998, 2024-04-25T22:41:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:41:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:41:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:41:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:41:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:41:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:41:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:41:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:41:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:41:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:41:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:41:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:41:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:41:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:41:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:41:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:41:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:41:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:41:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:41:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:41:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:41:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:41:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:41:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:41:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:41:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:41:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:41:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.582679992999999, 2024-04-25T22:41:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:41:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:41:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:41:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:41:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:41:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:41:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:41:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:41:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:41:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:41:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:41:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:41:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:41:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:41:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:41:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:41:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:41:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:41:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:41:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:41:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:41:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:41:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:41:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:41:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:41:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:41:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:41:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.582613336999998, 2024-04-25T22:41:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:41:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:41:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:41:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:41:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:41:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:41:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:41:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:41:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:41:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:41:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:41:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:41:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:41:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:41:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:41:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:41:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:41:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:41:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:41:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:41:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:41:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:41:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:41:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:41:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:41:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:41:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:41:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.582522740999998, 2024-04-25T22:41:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:41:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:41:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:41:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:41:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:41:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:41:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:41:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:41:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:41:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:41:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:41:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:41:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:41:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:41:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:41:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:41:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:41:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:41:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:41:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:41:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:41:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:41:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:41:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:41:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:41:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:41:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:41:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.582458168000002, 2024-04-25T22:41:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:41:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:41:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:41:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:41:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:41:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:41:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:41:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:41:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:41:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:41:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:41:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:41:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:41:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:41:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:41:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:41:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:41:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:41:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:41:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:41:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:41:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:41:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:41:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:41:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:41:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:41:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.582392745, 2024-04-25T22:41:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:41:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:41:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:41:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:41:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:41:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:41:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:41:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:41:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:41:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:41:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:41:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:41:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:41:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:41:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:41:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:41:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:41:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:41:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:41:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:41:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:41:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:41:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:41:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:41:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:41:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:41:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.582336679000001, 2024-04-25T22:41:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:41:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:41:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:41:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:41:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:41:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:41:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:41:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:41:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:41:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:41:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:41:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:41:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:41:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:41:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:41:05.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:41:05.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:05.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:41:05.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:41:05.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:41:05.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:41:05.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:05.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:41:05.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:41:05.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:05.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:41:05.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:41:05.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:05.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:41:05.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:41:05.245 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.245 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.245 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.245 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.245 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:05.245 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.582269572999998, 2024-04-25T22:41:05.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:41:05.246 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:05.246 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:05.246 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.246 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:05.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:05.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:05.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:05.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:05.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:05.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:41:05.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:41:05.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:05.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:41:05.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:41:05.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:05.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:41:05.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:41:05.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:41:05.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:41:05.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:41:05.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:41:05.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:05.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:41:05.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:41:05.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:41:05.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:41:05.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:05.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:41:05.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:41:05.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:05.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:41:05.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:41:05.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:41:05.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:41:05.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:05.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:41:05.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:41:05.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:05.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:41:05.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:41:05.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:05.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:41:05.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:41:05.252 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.252 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.252 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.252 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.252 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:05.253 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.582214450000002, 2024-04-25T22:41:05.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:41:05.253 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:05.253 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:05.253 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.253 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:05.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:05.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:05.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:05.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:05.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:05.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:41:05.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:05.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:05.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:41:05.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:41:05.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:05.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:41:05.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:41:05.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:41:05.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:41:05.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:41:05.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:41:05.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:05.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:41:05.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:41:05.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:41:05.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:41:05.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:05.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:41:05.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:41:05.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:05.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:41:05.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:41:05.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:41:05.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:41:05.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:05.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:41:05.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:41:05.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:05.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:41:05.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:41:05.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:05.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:41:05.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:41:05.259 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.259 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.259 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.259 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.259 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:05.259 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.582112211000002, 2024-04-25T22:41:05.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:41:05.260 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:05.260 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:05.260 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.260 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:05.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:05.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:05.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:05.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:05.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:05.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:41:05.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:41:05.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:05.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:41:05.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:41:05.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:05.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:41:05.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:41:05.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:41:05.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:41:05.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:41:05.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:41:05.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:05.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:41:05.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:41:05.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:41:05.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:41:05.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:05.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:41:05.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:41:05.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:05.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:41:05.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:41:05.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:41:05.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:41:05.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:05.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:41:05.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:41:05.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:05.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:41:05.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:41:05.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:05.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:41:05.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:41:05.266 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.266 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.266 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.267 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.267 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:05.267 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.582053387999999, 2024-04-25T22:41:05.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:41:05.267 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:05.267 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:05.267 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.267 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:05.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:05.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:05.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:05.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:05.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:05.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:41:05.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:41:05.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:05.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:41:05.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:41:05.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:05.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:41:05.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:41:05.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:41:05.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:41:05.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:41:05.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:41:05.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:05.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:41:05.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:41:05.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:41:05.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:41:05.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:05.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:41:05.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:41:05.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:05.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:41:05.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:41:05.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:05.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:41:05.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:41:05.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:41:05.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:41:05.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:05.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:41:05.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:41:05.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:05.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:41:05.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:41:05.273 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.273 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.274 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.274 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.274 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:05.274 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.581974655000003, 2024-04-25T22:41:05.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:41:05.274 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:05.274 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:05.274 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.274 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:05.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:05.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:05.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:05.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:05.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:05.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:41:05.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:05.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:05.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:41:05.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:41:05.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:05.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:41:05.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:41:05.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:41:05.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:41:05.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:41:05.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:41:05.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:05.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:41:05.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:41:05.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:41:05.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:41:05.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:05.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:41:05.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:41:05.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:05.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:41:05.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:41:05.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:05.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:41:05.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:41:05.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:41:05.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:41:05.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:05.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:41:05.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:41:05.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:05.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:41:05.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:41:05.282 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.282 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.282 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.282 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.282 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:05.282 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.581935242, 2024-04-25T22:41:05.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:41:05.282 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:05.282 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:05.283 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.283 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:05.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:05.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:05.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:05.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:05.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:05.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:41:05.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:41:05.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:05.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:41:05.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:41:05.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:05.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:41:05.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:41:05.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:41:05.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:41:05.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:41:05.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:41:05.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:05.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:41:05.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:41:05.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:41:05.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:41:05.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:05.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:41:05.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:41:05.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:05.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:41:05.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:41:05.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:41:05.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:41:05.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:05.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:41:05.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:41:05.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:05.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:41:05.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:41:05.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:05.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:41:05.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:41:05.289 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.289 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.289 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.289 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.289 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:05.289 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.581865395999998, 2024-04-25T22:41:05.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:41:05.290 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:05.290 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:05.290 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.290 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:05.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:05.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:05.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:05.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:05.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:05.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:41:05.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:41:05.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:05.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:41:05.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:41:05.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:05.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:41:05.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:41:05.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:41:05.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:41:05.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:41:05.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:41:05.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:05.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:41:05.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:41:05.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:41:05.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:41:05.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:05.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:41:05.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:41:05.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:05.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:41:05.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:41:05.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:41:05.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:41:05.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:05.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:41:05.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:41:05.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:05.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:41:05.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:41:05.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:05.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:41:05.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:41:05.296 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.296 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.296 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.297 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.297 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:05.297 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.581815659, 2024-04-25T22:41:05.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:41:05.297 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:05.297 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:05.297 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.297 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:05.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:05.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:05.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:05.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:05.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:05.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:41:05.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:05.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:05.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:41:05.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:41:05.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:05.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:41:05.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:41:05.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:41:05.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:41:05.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:41:05.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:41:05.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:05.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:41:05.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:41:05.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:41:05.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:41:05.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:05.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:41:05.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:41:05.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:05.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:41:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:41:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:41:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:41:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:41:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:41:05.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:05.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:05.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:41:05.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:05.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:41:05.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:41:05.303 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.303 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.303 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.304 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.304 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:05.304 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.581731044000001, 2024-04-25T22:41:05.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:41:05.304 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:05.304 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:05.304 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.304 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:05.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:05.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:05.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:05.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:05.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:05.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:41:05.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:05.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:05.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:41:05.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:41:05.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:05.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:41:05.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:41:05.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:41:05.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:41:05.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:41:05.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:41:05.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:05.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:41:05.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:41:05.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:41:05.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:41:05.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:05.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:41:05.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:41:05.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:05.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:41:05.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:41:05.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:41:05.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:41:05.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:05.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:41:05.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:41:05.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:05.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:41:05.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:41:05.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:05.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:41:05.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:41:05.310 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.311 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.311 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.311 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.311 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:05.311 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.581667394, 2024-04-25T22:41:05.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:41:05.311 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:05.311 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:05.311 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:41:05.311 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:05.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:05.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:05.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:05.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:05.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:05.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:41:05.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:41:05.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:05.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:41:05.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:41:05.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:05.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:41:05.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:41:05.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:41:05.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:41:05.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:41:05.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:41:05.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:05.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:41:05.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:41:05.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:41:05.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:41:05.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:05.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:41:05.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:41:05.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:05.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:41:05.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:41:05.316 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.316 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.316 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.316 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:05.316 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:05.317 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 50.574663864000001, 2024-04-25T22:41:05.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:41:05.317 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:05.317 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:05.317 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.317 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:05.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:05.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:05.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:05.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:05.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:05.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:05.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:41:05.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:41:05.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:05.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:41:05.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:41:05.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:05.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:41:05.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:41:05.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:41:05.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:41:05.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:05.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:41:05.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:41:05.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:05.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:41:05.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:41:05.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:05.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:41:05.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:41:05.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:05.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:05.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:05.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:41:05.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:41:05.321 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.321 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.321 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.321 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:05.321 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:05.321 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:05.323 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:41:05.324 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:05.322+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:05.424 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:05.421+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:05.453 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:05.454 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:41:05.454 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-04-25T22:41:05.454 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:05.467 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:41:05.525 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:05.525+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:05.591 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:05.591 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:41:05.591 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-04-25T22:41:05.591 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-04-25T22:41:05.591 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:05.605 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:41:05.626 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:05.626+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:05.705 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is unset 2024-04-25T22:41:05.727 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:05.725+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:05.729 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:05.729 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-04-25T22:41:05.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-04-25T22:41:05.729 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-04-25T22:41:05.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.729 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:111 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'73, mlcod=11'69)", 2024-04-25T22:41:05.730 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:05.730 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.029018266000001, 2024-04-25T22:41:05.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055481899999999997, 2024-04-25T22:41:05.730 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:05.730 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:05.730 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.730 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:05.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:05.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:05.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:05.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:05.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:05.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700271+0000", 2024-04-25T22:41:05.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:41:05.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:05.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700278+0000", 2024-04-25T22:41:05.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-04-25T22:41:05.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:05.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700323+0000", 2024-04-25T22:41:05.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4212999999999998e-05 2024-04-25T22:41:05.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700333+0000", 2024-04-25T22:41:05.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0433e-05 2024-04-25T22:41:05.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:05.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700662+0000", 2024-04-25T22:41:05.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032862800000000003 2024-04-25T22:41:05.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:05.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700692+0000", 2024-04-25T22:41:05.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0395999999999998e-05 2024-04-25T22:41:05.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:05.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705728+0000", 2024-04-25T22:41:05.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050361939999999999 2024-04-25T22:41:05.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:05.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705818+0000", 2024-04-25T22:41:05.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9573000000000005e-05 2024-04-25T22:41:05.735 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.735 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.735 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.735 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-25T22:41:05.735 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:05.735 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.028473413999997, 2024-04-25T22:41:05.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005065501, 2024-04-25T22:41:05.736 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:05.736 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:05.736 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.736 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:05.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:05.736 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:05.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:05.737 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:05.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:05.737 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700816+0000", 2024-04-25T22:41:05.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.24e-06 2024-04-25T22:41:05.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:05.737 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700914+0000", 2024-04-25T22:41:05.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8057e-05 2024-04-25T22:41:05.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:05.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700931+0000", 2024-04-25T22:41:05.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7745999999999999e-05 2024-04-25T22:41:05.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700941+0000", 2024-04-25T22:41:05.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5699999999999999e-06 2024-04-25T22:41:05.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:05.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701162+0000", 2024-04-25T22:41:05.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000221392 2024-04-25T22:41:05.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:05.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701194+0000", 2024-04-25T22:41:05.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1745999999999997e-05 2024-04-25T22:41:05.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:05.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705821+0000", 2024-04-25T22:41:05.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046269869999999999 2024-04-25T22:41:05.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:05.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705880+0000", 2024-04-25T22:41:05.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8763e-05 2024-04-25T22:41:05.740 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.740 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.740 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.741 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:118 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'80, mlcod=11'78)", 2024-04-25T22:41:05.741 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:05.741 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.021117803999999, 2024-04-25T22:41:05.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047806089999999999, 2024-04-25T22:41:05.741 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:05.741 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:05.741 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.741 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:05.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:05.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:05.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:05.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:05.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:05.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708172+0000", 2024-04-25T22:41:05.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0600000000000002e-06 2024-04-25T22:41:05.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:05.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708291+0000", 2024-04-25T22:41:05.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118892 2024-04-25T22:41:05.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:05.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708320+0000", 2024-04-25T22:41:05.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8822999999999998e-05 2024-04-25T22:41:05.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708337+0000", 2024-04-25T22:41:05.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7586999999999999e-05 2024-04-25T22:41:05.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:05.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708512+0000", 2024-04-25T22:41:05.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017439500000000001 2024-04-25T22:41:05.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:05.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708551+0000", 2024-04-25T22:41:05.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.909e-05 2024-04-25T22:41:05.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:05.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712865+0000", 2024-04-25T22:41:05.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043142069999999996 2024-04-25T22:41:05.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:05.746 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712951+0000", 2024-04-25T22:41:05.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5555000000000003e-05 2024-04-25T22:41:05.746 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.746 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.746 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.746 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:120 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'82, mlcod=11'78)", 2024-04-25T22:41:05.746 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:05.747 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.020111761999999, 2024-04-25T22:41:05.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047170700000000003, 2024-04-25T22:41:05.747 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:05.747 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:05.747 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.747 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:05.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:05.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:05.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:05.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:05.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:05.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709177+0000", 2024-04-25T22:41:05.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.19e-06 2024-04-25T22:41:05.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:05.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709315+0000", 2024-04-25T22:41:05.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000137429 2024-04-25T22:41:05.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:05.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709341+0000", 2024-04-25T22:41:05.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:41:05.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709353+0000", 2024-04-25T22:41:05.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2027e-05 2024-04-25T22:41:05.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:05.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710040+0000", 2024-04-25T22:41:05.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068710799999999997 2024-04-25T22:41:05.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:05.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710076+0000", 2024-04-25T22:41:05.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5982999999999998e-05 2024-04-25T22:41:05.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:05.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713802+0000", 2024-04-25T22:41:05.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037255750000000001 2024-04-25T22:41:05.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:05.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713893+0000", 2024-04-25T22:41:05.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1201999999999999e-05 2024-04-25T22:41:05.751 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.751 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.751 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.752 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:121 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'83, mlcod=11'78)", 2024-04-25T22:41:05.753 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:05.753 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.019565126000003, 2024-04-25T22:41:05.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0049043919999999996, 2024-04-25T22:41:05.753 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:05.753 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:05.753 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.753 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:05.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:05.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:05.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:05.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:05.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:05.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709724+0000", 2024-04-25T22:41:05.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.483e-06 2024-04-25T22:41:05.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:05.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709872+0000", 2024-04-25T22:41:05.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147446 2024-04-25T22:41:05.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:05.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709891+0000", 2024-04-25T22:41:05.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9245999999999998e-05 2024-04-25T22:41:05.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709900+0000", 2024-04-25T22:41:05.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1439999999999992e-06 2024-04-25T22:41:05.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:05.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713091+0000", 2024-04-25T22:41:05.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031910710000000002 2024-04-25T22:41:05.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:05.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713122+0000", 2024-04-25T22:41:05.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.048e-05 2024-04-25T22:41:05.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:05.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714538+0000", 2024-04-25T22:41:05.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014160030000000001 2024-04-25T22:41:05.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:05.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714627+0000", 2024-04-25T22:41:05.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518999999999995e-05 2024-04-25T22:41:05.761 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.761 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.761 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.761 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.761 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:05.761 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.129175746000001, 2024-04-25T22:41:05.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022089675999999999, 2024-04-25T22:41:05.761 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:05.762 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:05.762 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.762 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:05.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:05.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:05.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:05.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:05.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:05.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600120+0000", 2024-04-25T22:41:05.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1259999999999998e-06 2024-04-25T22:41:05.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:05.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600153+0000", 2024-04-25T22:41:05.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3186999999999999e-05 2024-04-25T22:41:05.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:05.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600181+0000", 2024-04-25T22:41:05.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7676000000000001e-05 2024-04-25T22:41:05.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600205+0000", 2024-04-25T22:41:05.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:41:05.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:05.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600467+0000", 2024-04-25T22:41:05.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026186800000000001 2024-04-25T22:41:05.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:05.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600809+0000", 2024-04-25T22:41:05.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034138400000000002 2024-04-25T22:41:05.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:05.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.601892+0000", 2024-04-25T22:41:05.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010831910000000001 2024-04-25T22:41:05.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:05.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611054+0000", 2024-04-25T22:41:05.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0091620940000000008 2024-04-25T22:41:05.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621965+0000", 2024-04-25T22:41:05.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010911044999999999 2024-04-25T22:41:05.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:05.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622090+0000", 2024-04-25T22:41:05.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012522 2024-04-25T22:41:05.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:05.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622202+0000", 2024-04-25T22:41:05.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011164500000000001 2024-04-25T22:41:05.767 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.767 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.767 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.768 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.768 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:05.768 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.129032690999999, 2024-04-25T22:41:05.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035756228000000001, 2024-04-25T22:41:05.768 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:05.768 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:05.768 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.768 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:05.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:05.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:05.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:05.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:05.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:05.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600257+0000", 2024-04-25T22:41:05.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8300000000000001e-06 2024-04-25T22:41:05.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:05.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600267+0000", 2024-04-25T22:41:05.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6539999999999994e-06 2024-04-25T22:41:05.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:05.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600293+0000", 2024-04-25T22:41:05.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5996e-05 2024-04-25T22:41:05.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600309+0000", 2024-04-25T22:41:05.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6206e-05 2024-04-25T22:41:05.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:05.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603757+0000", 2024-04-25T22:41:05.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003448244 2024-04-25T22:41:05.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:05.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604779+0000", 2024-04-25T22:41:05.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010216820000000001 2024-04-25T22:41:05.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:05.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605127+0000", 2024-04-25T22:41:05.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034820100000000002 2024-04-25T22:41:05.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:05.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611082+0000", 2024-04-25T22:41:05.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0059550640000000004 2024-04-25T22:41:05.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635779+0000", 2024-04-25T22:41:05.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024696665999999999 2024-04-25T22:41:05.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:05.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635915+0000", 2024-04-25T22:41:05.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000135809 2024-04-25T22:41:05.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:05.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636011+0000", 2024-04-25T22:41:05.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6875999999999999e-05 2024-04-25T22:41:05.773 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.773 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.774 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.774 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.774 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:05.774 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.128955478000002, 2024-04-25T22:41:05.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035327031000000002, 2024-04-25T22:41:05.774 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:05.774 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:05.774 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.774 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:05.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:05.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:05.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:05.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:05.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:05.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600334+0000", 2024-04-25T22:41:05.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:41:05.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:05.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600347+0000", 2024-04-25T22:41:05.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3593e-05 2024-04-25T22:41:05.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:05.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600371+0000", 2024-04-25T22:41:05.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.313e-05 2024-04-25T22:41:05.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600390+0000", 2024-04-25T22:41:05.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.908e-05 2024-04-25T22:41:05.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:05.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602756+0000", 2024-04-25T22:41:05.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023662560000000002 2024-04-25T22:41:05.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:05.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603021+0000", 2024-04-25T22:41:05.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026546399999999998 2024-04-25T22:41:05.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:05.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603304+0000", 2024-04-25T22:41:05.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028308800000000002 2024-04-25T22:41:05.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:05.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611075+0000", 2024-04-25T22:41:05.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077703900000000003 2024-04-25T22:41:05.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635414+0000", 2024-04-25T22:41:05.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024339326000000001 2024-04-25T22:41:05.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:05.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635544+0000", 2024-04-25T22:41:05.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012948199999999999 2024-04-25T22:41:05.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:05.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635659+0000", 2024-04-25T22:41:05.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000115809 2024-04-25T22:41:05.780 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.780 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.780 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.780 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.780 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:05.780 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.128795553000003, 2024-04-25T22:41:05.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035594492999999998, 2024-04-25T22:41:05.780 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:05.780 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:05.780 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.780 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:05.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:05.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:05.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:05.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:05.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:05.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600494+0000", 2024-04-25T22:41:05.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:41:05.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:05.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600502+0000", 2024-04-25T22:41:05.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3769999999999996e-06 2024-04-25T22:41:05.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:05.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600522+0000", 2024-04-25T22:41:05.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9919999999999999e-05 2024-04-25T22:41:05.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600539+0000", 2024-04-25T22:41:05.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.649e-05 2024-04-25T22:41:05.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:05.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604846+0000", 2024-04-25T22:41:05.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043075199999999996 2024-04-25T22:41:05.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:05.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605057+0000", 2024-04-25T22:41:05.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00021085200000000001 2024-04-25T22:41:05.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:05.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605378+0000", 2024-04-25T22:41:05.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032074799999999999 2024-04-25T22:41:05.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:05.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611089+0000", 2024-04-25T22:41:05.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057110249999999998 2024-04-25T22:41:05.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635844+0000", 2024-04-25T22:41:05.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024755355999999999 2024-04-25T22:41:05.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:05.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635986+0000", 2024-04-25T22:41:05.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141512 2024-04-25T22:41:05.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:05.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636087+0000", 2024-04-25T22:41:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101183 2024-04-25T22:41:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.128722943, 2024-04-25T22:41:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021266723000000001, 2024-04-25T22:41:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600566+0000", 2024-04-25T22:41:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4959999999999999e-06 2024-04-25T22:41:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600574+0000", 2024-04-25T22:41:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-06 2024-04-25T22:41:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600592+0000", 2024-04-25T22:41:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8479999999999999e-05 2024-04-25T22:41:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600610+0000", 2024-04-25T22:41:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7567e-05 2024-04-25T22:41:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602679+0000", 2024-04-25T22:41:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020692739999999999 2024-04-25T22:41:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602945+0000", 2024-04-25T22:41:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026640399999999998 2024-04-25T22:41:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603115+0000", 2024-04-25T22:41:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000169996 2024-04-25T22:41:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608398+0000", 2024-04-25T22:41:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052826289999999996 2024-04-25T22:41:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621588+0000", 2024-04-25T22:41:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013190489 2024-04-25T22:41:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621733+0000", 2024-04-25T22:41:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014462500000000001 2024-04-25T22:41:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621832+0000", 2024-04-25T22:41:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8603000000000004e-05 2024-04-25T22:41:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.128655217000002, 2024-04-25T22:41:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034747924999999999, 2024-04-25T22:41:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600634+0000", 2024-04-25T22:41:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-04-25T22:41:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600642+0000", 2024-04-25T22:41:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8169999999999999e-06 2024-04-25T22:41:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600660+0000", 2024-04-25T22:41:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8513e-05 2024-04-25T22:41:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600676+0000", 2024-04-25T22:41:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6019999999999999e-05 2024-04-25T22:41:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603748+0000", 2024-04-25T22:41:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030718329999999999 2024-04-25T22:41:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604752+0000", 2024-04-25T22:41:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001003603 2024-04-25T22:41:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605117+0000", 2024-04-25T22:41:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00036539 2024-04-25T22:41:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608459+0000", 2024-04-25T22:41:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033413879999999998 2024-04-25T22:41:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635106+0000", 2024-04-25T22:41:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026647607 2024-04-25T22:41:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635273+0000", 2024-04-25T22:41:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000166689 2024-04-25T22:41:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635381+0000", 2024-04-25T22:41:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107642 2024-04-25T22:41:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.128591987999997, 2024-04-25T22:41:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040419292000000002, 2024-04-25T22:41:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:05.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:05.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:05.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:05.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:05.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600697+0000", 2024-04-25T22:41:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1999999999999999e-06 2024-04-25T22:41:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600704+0000", 2024-04-25T22:41:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5570000000000001e-06 2024-04-25T22:41:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600724+0000", 2024-04-25T22:41:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0023000000000001e-05 2024-04-25T22:41:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600738+0000", 2024-04-25T22:41:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4372999999999999e-05 2024-04-25T22:41:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.612532+0000", 2024-04-25T22:41:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011793606 2024-04-25T22:41:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613354+0000", 2024-04-25T22:41:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00082244100000000004 2024-04-25T22:41:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613726+0000", 2024-04-25T22:41:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00037226000000000002 2024-04-25T22:41:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618891+0000", 2024-04-25T22:41:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051649199999999999 2024-04-25T22:41:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.640874+0000", 2024-04-25T22:41:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021982640000000001 2024-04-25T22:41:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641019+0000", 2024-04-25T22:41:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000145339 2024-04-25T22:41:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641115+0000", 2024-04-25T22:41:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5933000000000005e-05 2024-04-25T22:41:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.128505957999998, 2024-04-25T22:41:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036502711, 2024-04-25T22:41:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600783+0000", 2024-04-25T22:41:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.533e-06 2024-04-25T22:41:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600790+0000", 2024-04-25T22:41:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0439999999999998e-06 2024-04-25T22:41:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600811+0000", 2024-04-25T22:41:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0449e-05 2024-04-25T22:41:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600825+0000", 2024-04-25T22:41:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4293e-05 2024-04-25T22:41:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602304+0000", 2024-04-25T22:41:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001478629 2024-04-25T22:41:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602587+0000", 2024-04-25T22:41:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028350800000000002 2024-04-25T22:41:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.637285+0000", 2024-04-25T22:41:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034697255000000003 2024-04-25T22:41:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.128440392000002, 2024-04-25T22:41:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017311460000000001, 2024-04-25T22:41:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600849+0000", 2024-04-25T22:41:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2899999999999999e-06 2024-04-25T22:41:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600866+0000", 2024-04-25T22:41:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6793e-05 2024-04-25T22:41:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600886+0000", 2024-04-25T22:41:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0772999999999999e-05 2024-04-25T22:41:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600904+0000", 2024-04-25T22:41:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7697e-05 2024-04-25T22:41:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602796+0000", 2024-04-25T22:41:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018920149999999999 2024-04-25T22:41:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602962+0000", 2024-04-25T22:41:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016590600000000001 2024-04-25T22:41:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618159+0000", 2024-04-25T22:41:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015196985999999999 2024-04-25T22:41:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.113564650999997, 2024-04-25T22:41:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006380269, 2024-04-25T22:41:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615724+0000", 2024-04-25T22:41:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.094e-06 2024-04-25T22:41:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615734+0000", 2024-04-25T22:41:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.363e-06 2024-04-25T22:41:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615751+0000", 2024-04-25T22:41:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:41:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615773+0000", 2024-04-25T22:41:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.154e-05 2024-04-25T22:41:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616485+0000", 2024-04-25T22:41:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00071225100000000001 2024-04-25T22:41:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616528+0000", 2024-04-25T22:41:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3606000000000002e-05 2024-04-25T22:41:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622030+0000", 2024-04-25T22:41:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055010750000000002 2024-04-25T22:41:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622103+0000", 2024-04-25T22:41:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3930000000000005e-05 2024-04-25T22:41:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.112651714000002, 2024-04-25T22:41:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046420649999999999, 2024-04-25T22:41:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-04-25T22:41:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616637+0000", 2024-04-25T22:41:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0299999999999998e-07 2024-04-25T22:41:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616653+0000", 2024-04-25T22:41:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5843000000000001e-05 2024-04-25T22:41:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616690+0000", 2024-04-25T22:41:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7466999999999999e-05 2024-04-25T22:41:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616729+0000", 2024-04-25T22:41:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8810000000000003e-05 2024-04-25T22:41:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617251+0000", 2024-04-25T22:41:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00052143899999999995 2024-04-25T22:41:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621278+0000", 2024-04-25T22:41:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040277029999999997 2024-04-25T22:41:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.111628361999998, 2024-04-25T22:41:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0065101730000000002, 2024-04-25T22:41:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617661+0000", 2024-04-25T22:41:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:41:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617688+0000", 2024-04-25T22:41:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7589e-05 2024-04-25T22:41:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617710+0000", 2024-04-25T22:41:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1467e-05 2024-04-25T22:41:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617727+0000", 2024-04-25T22:41:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6990000000000002e-05 2024-04-25T22:41:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618559+0000", 2024-04-25T22:41:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083207400000000003 2024-04-25T22:41:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618608+0000", 2024-04-25T22:41:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8936e-05 2024-04-25T22:41:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624077+0000", 2024-04-25T22:41:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054695840000000004 2024-04-25T22:41:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624170+0000", 2024-04-25T22:41:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2305999999999993e-05 2024-04-25T22:41:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.106526854000002, 2024-04-25T22:41:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006879446, 2024-04-25T22:41:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622762+0000", 2024-04-25T22:41:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:41:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622781+0000", 2024-04-25T22:41:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8749999999999998e-05 2024-04-25T22:41:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622802+0000", 2024-04-25T22:41:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1650000000000001e-05 2024-04-25T22:41:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622816+0000", 2024-04-25T22:41:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3556e-05 2024-04-25T22:41:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623700+0000", 2024-04-25T22:41:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00088389299999999996 2024-04-25T22:41:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623741+0000", 2024-04-25T22:41:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1023999999999999e-05 2024-04-25T22:41:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629543+0000", 2024-04-25T22:41:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058023980000000003 2024-04-25T22:41:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629640+0000", 2024-04-25T22:41:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7381999999999997e-05 2024-04-25T22:41:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.106265649999997, 2024-04-25T22:41:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067054879999999999, 2024-04-25T22:41:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623032+0000", 2024-04-25T22:41:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.9930000000000007e-06 2024-04-25T22:41:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623043+0000", 2024-04-25T22:41:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0387000000000001e-05 2024-04-25T22:41:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623064+0000", 2024-04-25T22:41:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1849999999999999e-05 2024-04-25T22:41:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623079+0000", 2024-04-25T22:41:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4093e-05 2024-04-25T22:41:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624384+0000", 2024-04-25T22:41:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013054539999999999 2024-04-25T22:41:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624421+0000", 2024-04-25T22:41:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7088999999999997e-05 2024-04-25T22:41:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629645+0000", 2024-04-25T22:41:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052241400000000004 2024-04-25T22:41:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629728+0000", 2024-04-25T22:41:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2482000000000001e-05 2024-04-25T22:41:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2024-04-25T22:41:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.106182537000002, 2024-04-25T22:41:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078029559999999998, 2024-04-25T22:41:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623106+0000", 2024-04-25T22:41:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.64e-07 2024-04-25T22:41:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623141+0000", 2024-04-25T22:41:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4678999999999998e-05 2024-04-25T22:41:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623153+0000", 2024-04-25T22:41:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1759999999999999e-05 2024-04-25T22:41:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623161+0000", 2024-04-25T22:41:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8299999999999996e-06 2024-04-25T22:41:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623834+0000", 2024-04-25T22:41:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067394500000000001 2024-04-25T22:41:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623883+0000", 2024-04-25T22:41:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8640000000000002e-05 2024-04-25T22:41:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630807+0000", 2024-04-25T22:41:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069238859999999998 2024-04-25T22:41:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630908+0000", 2024-04-25T22:41:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101252 2024-04-25T22:41:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:05.843 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:05.845 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:05.845 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:05.845+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:05.945 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:05.946+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:05.978 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:05.978 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:05.978 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:05.978 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:05.993 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:06.045 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:06.041+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:06.072 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:41:06.115 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:06.115 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:06.115 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:06.115 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:06.115 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:06.129 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:06.146 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:06.146+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:06.235 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:06.235 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:06.247 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:06.246+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:06.256 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:41:06.256 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:41:06.276 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:06.277 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:06.292 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:06.292 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:06.306 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:06.348 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:06.345+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:06.441 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:06.441 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:06.449 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:06.449+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:06.455 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:06.550 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:06.547+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:06.572 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:06.572 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:06.587 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:06.650 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:06.650+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:06.708 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:06.708 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:06.722 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:41:06.768 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:06.770+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:06.852 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:06.854+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:06.854 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:06.854 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:06.870 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:41:06.953 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:06.951+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:06.986 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:06.986 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:07.000 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:41:07.053 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:07.054+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:07.154 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:07.154+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:07.160 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:07.160 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:07.174 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:07.255 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:07.253+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:07.305 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:07.305 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:07.319 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:07.357 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:07.358+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:07.458 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:07.458+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:07.483 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:07.483 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:07.497 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:07.558 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:07.557+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:07.613 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:07.613 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:07.627 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:07.659 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:07.659+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:07.728 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:41:07.757 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:07.757 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:07.760 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:07.762+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:07.771 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:07.861 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:07.861+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:07.934 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:07.935 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:07.949 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:07.996 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:07.998+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:08.026 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:41:08.026 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:41:08.026 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-25T22:41:08.026 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-25T22:41:08.026 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-25T22:41:08.026 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-25T22:41:08.067 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:08.068 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:08.074 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:08.073+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:08.081 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:41:08.155 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:08.156 INFO:teuthology.orchestra.run.smithi188.stdout: "success": "" 2024-04-25T22:41:08.156 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:08.163 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:08.163+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:08.214 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:08.214 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:08.228 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:41:08.263 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:08.261+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:08.297 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:41:08.365 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:08.366+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:08.392 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:08.393 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:08.407 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:41:08.453 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:08.454 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:08.465 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:08.461+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:08.473 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:41:08.473 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:41:08.496 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:08.497 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:08.531 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-04-25T22:41:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-04-25T22:41:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-04-25T22:41:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:111 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'73, mlcod=11'69)", 2024-04-25T22:41:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.830733772000002, 2024-04-25T22:41:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055481899999999997, 2024-04-25T22:41:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700271+0000", 2024-04-25T22:41:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:41:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700278+0000", 2024-04-25T22:41:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-04-25T22:41:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700323+0000", 2024-04-25T22:41:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4212999999999998e-05 2024-04-25T22:41:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700333+0000", 2024-04-25T22:41:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0433e-05 2024-04-25T22:41:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700662+0000", 2024-04-25T22:41:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032862800000000003 2024-04-25T22:41:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700692+0000", 2024-04-25T22:41:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0395999999999998e-05 2024-04-25T22:41:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705728+0000", 2024-04-25T22:41:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050361939999999999 2024-04-25T22:41:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705818+0000", 2024-04-25T22:41:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9573000000000005e-05 2024-04-25T22:41:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-25T22:41:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.830188919999998, 2024-04-25T22:41:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005065501, 2024-04-25T22:41:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700816+0000", 2024-04-25T22:41:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.24e-06 2024-04-25T22:41:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700914+0000", 2024-04-25T22:41:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8057e-05 2024-04-25T22:41:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700931+0000", 2024-04-25T22:41:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7745999999999999e-05 2024-04-25T22:41:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700941+0000", 2024-04-25T22:41:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5699999999999999e-06 2024-04-25T22:41:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701162+0000", 2024-04-25T22:41:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000221392 2024-04-25T22:41:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701194+0000", 2024-04-25T22:41:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1745999999999997e-05 2024-04-25T22:41:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705821+0000", 2024-04-25T22:41:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046269869999999999 2024-04-25T22:41:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705880+0000", 2024-04-25T22:41:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8763e-05 2024-04-25T22:41:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:118 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'80, mlcod=11'78)", 2024-04-25T22:41:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.82283331, 2024-04-25T22:41:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047806089999999999, 2024-04-25T22:41:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708172+0000", 2024-04-25T22:41:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0600000000000002e-06 2024-04-25T22:41:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708291+0000", 2024-04-25T22:41:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118892 2024-04-25T22:41:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708320+0000", 2024-04-25T22:41:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8822999999999998e-05 2024-04-25T22:41:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708337+0000", 2024-04-25T22:41:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7586999999999999e-05 2024-04-25T22:41:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708512+0000", 2024-04-25T22:41:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017439500000000001 2024-04-25T22:41:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708551+0000", 2024-04-25T22:41:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.909e-05 2024-04-25T22:41:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712865+0000", 2024-04-25T22:41:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043142069999999996 2024-04-25T22:41:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712951+0000", 2024-04-25T22:41:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5555000000000003e-05 2024-04-25T22:41:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:120 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'82, mlcod=11'78)", 2024-04-25T22:41:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.821827268, 2024-04-25T22:41:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047170700000000003, 2024-04-25T22:41:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709177+0000", 2024-04-25T22:41:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.19e-06 2024-04-25T22:41:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709315+0000", 2024-04-25T22:41:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000137429 2024-04-25T22:41:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709341+0000", 2024-04-25T22:41:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:41:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709353+0000", 2024-04-25T22:41:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2027e-05 2024-04-25T22:41:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710040+0000", 2024-04-25T22:41:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068710799999999997 2024-04-25T22:41:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710076+0000", 2024-04-25T22:41:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5982999999999998e-05 2024-04-25T22:41:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713802+0000", 2024-04-25T22:41:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037255750000000001 2024-04-25T22:41:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713893+0000", 2024-04-25T22:41:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1201999999999999e-05 2024-04-25T22:41:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:121 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'83, mlcod=11'78)", 2024-04-25T22:41:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.821280631999997, 2024-04-25T22:41:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0049043919999999996, 2024-04-25T22:41:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709724+0000", 2024-04-25T22:41:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.483e-06 2024-04-25T22:41:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709872+0000", 2024-04-25T22:41:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147446 2024-04-25T22:41:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709891+0000", 2024-04-25T22:41:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9245999999999998e-05 2024-04-25T22:41:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709900+0000", 2024-04-25T22:41:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1439999999999992e-06 2024-04-25T22:41:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713091+0000", 2024-04-25T22:41:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031910710000000002 2024-04-25T22:41:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713122+0000", 2024-04-25T22:41:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.048e-05 2024-04-25T22:41:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714538+0000", 2024-04-25T22:41:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014160030000000001 2024-04-25T22:41:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714627+0000", 2024-04-25T22:41:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518999999999995e-05 2024-04-25T22:41:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 53.930891252000002, 2024-04-25T22:41:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022089675999999999, 2024-04-25T22:41:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600120+0000", 2024-04-25T22:41:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1259999999999998e-06 2024-04-25T22:41:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600153+0000", 2024-04-25T22:41:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3186999999999999e-05 2024-04-25T22:41:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600181+0000", 2024-04-25T22:41:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7676000000000001e-05 2024-04-25T22:41:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600205+0000", 2024-04-25T22:41:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:41:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600467+0000", 2024-04-25T22:41:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026186800000000001 2024-04-25T22:41:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600809+0000", 2024-04-25T22:41:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034138400000000002 2024-04-25T22:41:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.601892+0000", 2024-04-25T22:41:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010831910000000001 2024-04-25T22:41:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611054+0000", 2024-04-25T22:41:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0091620940000000008 2024-04-25T22:41:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621965+0000", 2024-04-25T22:41:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010911044999999999 2024-04-25T22:41:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622090+0000", 2024-04-25T22:41:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012522 2024-04-25T22:41:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622202+0000", 2024-04-25T22:41:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011164500000000001 2024-04-25T22:41:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 53.930748197, 2024-04-25T22:41:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035756228000000001, 2024-04-25T22:41:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600257+0000", 2024-04-25T22:41:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8300000000000001e-06 2024-04-25T22:41:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600267+0000", 2024-04-25T22:41:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6539999999999994e-06 2024-04-25T22:41:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600293+0000", 2024-04-25T22:41:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5996e-05 2024-04-25T22:41:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600309+0000", 2024-04-25T22:41:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6206e-05 2024-04-25T22:41:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603757+0000", 2024-04-25T22:41:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003448244 2024-04-25T22:41:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604779+0000", 2024-04-25T22:41:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010216820000000001 2024-04-25T22:41:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605127+0000", 2024-04-25T22:41:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034820100000000002 2024-04-25T22:41:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611082+0000", 2024-04-25T22:41:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0059550640000000004 2024-04-25T22:41:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635779+0000", 2024-04-25T22:41:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024696665999999999 2024-04-25T22:41:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635915+0000", 2024-04-25T22:41:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000135809 2024-04-25T22:41:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636011+0000", 2024-04-25T22:41:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6875999999999999e-05 2024-04-25T22:41:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 53.930670984000002, 2024-04-25T22:41:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035327031000000002, 2024-04-25T22:41:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600334+0000", 2024-04-25T22:41:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:41:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600347+0000", 2024-04-25T22:41:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3593e-05 2024-04-25T22:41:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600371+0000", 2024-04-25T22:41:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.313e-05 2024-04-25T22:41:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600390+0000", 2024-04-25T22:41:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.908e-05 2024-04-25T22:41:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602756+0000", 2024-04-25T22:41:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023662560000000002 2024-04-25T22:41:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603021+0000", 2024-04-25T22:41:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026546399999999998 2024-04-25T22:41:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603304+0000", 2024-04-25T22:41:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028308800000000002 2024-04-25T22:41:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611075+0000", 2024-04-25T22:41:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077703900000000003 2024-04-25T22:41:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635414+0000", 2024-04-25T22:41:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024339326000000001 2024-04-25T22:41:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635544+0000", 2024-04-25T22:41:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012948199999999999 2024-04-25T22:41:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635659+0000", 2024-04-25T22:41:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000115809 2024-04-25T22:41:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 53.930511058999997, 2024-04-25T22:41:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035594492999999998, 2024-04-25T22:41:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600494+0000", 2024-04-25T22:41:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:41:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600502+0000", 2024-04-25T22:41:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3769999999999996e-06 2024-04-25T22:41:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600522+0000", 2024-04-25T22:41:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9919999999999999e-05 2024-04-25T22:41:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600539+0000", 2024-04-25T22:41:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.649e-05 2024-04-25T22:41:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604846+0000", 2024-04-25T22:41:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043075199999999996 2024-04-25T22:41:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605057+0000", 2024-04-25T22:41:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00021085200000000001 2024-04-25T22:41:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605378+0000", 2024-04-25T22:41:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032074799999999999 2024-04-25T22:41:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611089+0000", 2024-04-25T22:41:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057110249999999998 2024-04-25T22:41:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635844+0000", 2024-04-25T22:41:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024755355999999999 2024-04-25T22:41:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635986+0000", 2024-04-25T22:41:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141512 2024-04-25T22:41:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636087+0000", 2024-04-25T22:41:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101183 2024-04-25T22:41:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 53.930438449, 2024-04-25T22:41:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021266723000000001, 2024-04-25T22:41:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600566+0000", 2024-04-25T22:41:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4959999999999999e-06 2024-04-25T22:41:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600574+0000", 2024-04-25T22:41:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-06 2024-04-25T22:41:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600592+0000", 2024-04-25T22:41:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8479999999999999e-05 2024-04-25T22:41:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600610+0000", 2024-04-25T22:41:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7567e-05 2024-04-25T22:41:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602679+0000", 2024-04-25T22:41:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020692739999999999 2024-04-25T22:41:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602945+0000", 2024-04-25T22:41:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026640399999999998 2024-04-25T22:41:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603115+0000", 2024-04-25T22:41:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000169996 2024-04-25T22:41:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608398+0000", 2024-04-25T22:41:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052826289999999996 2024-04-25T22:41:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621588+0000", 2024-04-25T22:41:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013190489 2024-04-25T22:41:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621733+0000", 2024-04-25T22:41:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014462500000000001 2024-04-25T22:41:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621832+0000", 2024-04-25T22:41:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8603000000000004e-05 2024-04-25T22:41:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 53.930370723000003, 2024-04-25T22:41:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034747924999999999, 2024-04-25T22:41:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600634+0000", 2024-04-25T22:41:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-04-25T22:41:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600642+0000", 2024-04-25T22:41:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8169999999999999e-06 2024-04-25T22:41:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600660+0000", 2024-04-25T22:41:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8513e-05 2024-04-25T22:41:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600676+0000", 2024-04-25T22:41:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6019999999999999e-05 2024-04-25T22:41:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603748+0000", 2024-04-25T22:41:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030718329999999999 2024-04-25T22:41:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604752+0000", 2024-04-25T22:41:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001003603 2024-04-25T22:41:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605117+0000", 2024-04-25T22:41:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00036539 2024-04-25T22:41:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608459+0000", 2024-04-25T22:41:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033413879999999998 2024-04-25T22:41:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635106+0000", 2024-04-25T22:41:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026647607 2024-04-25T22:41:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635273+0000", 2024-04-25T22:41:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000166689 2024-04-25T22:41:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635381+0000", 2024-04-25T22:41:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107642 2024-04-25T22:41:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 53.930307493999997, 2024-04-25T22:41:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040419292000000002, 2024-04-25T22:41:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600697+0000", 2024-04-25T22:41:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1999999999999999e-06 2024-04-25T22:41:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600704+0000", 2024-04-25T22:41:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5570000000000001e-06 2024-04-25T22:41:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600724+0000", 2024-04-25T22:41:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0023000000000001e-05 2024-04-25T22:41:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600738+0000", 2024-04-25T22:41:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4372999999999999e-05 2024-04-25T22:41:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.612532+0000", 2024-04-25T22:41:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011793606 2024-04-25T22:41:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613354+0000", 2024-04-25T22:41:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00082244100000000004 2024-04-25T22:41:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613726+0000", 2024-04-25T22:41:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00037226000000000002 2024-04-25T22:41:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618891+0000", 2024-04-25T22:41:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051649199999999999 2024-04-25T22:41:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.640874+0000", 2024-04-25T22:41:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021982640000000001 2024-04-25T22:41:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641019+0000", 2024-04-25T22:41:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000145339 2024-04-25T22:41:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641115+0000", 2024-04-25T22:41:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5933000000000005e-05 2024-04-25T22:41:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 53.930221463999999, 2024-04-25T22:41:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036502711, 2024-04-25T22:41:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600783+0000", 2024-04-25T22:41:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.533e-06 2024-04-25T22:41:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600790+0000", 2024-04-25T22:41:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0439999999999998e-06 2024-04-25T22:41:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600811+0000", 2024-04-25T22:41:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0449e-05 2024-04-25T22:41:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600825+0000", 2024-04-25T22:41:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4293e-05 2024-04-25T22:41:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602304+0000", 2024-04-25T22:41:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001478629 2024-04-25T22:41:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602587+0000", 2024-04-25T22:41:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028350800000000002 2024-04-25T22:41:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.637285+0000", 2024-04-25T22:41:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034697255000000003 2024-04-25T22:41:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 53.930155898000002, 2024-04-25T22:41:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017311460000000001, 2024-04-25T22:41:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600849+0000", 2024-04-25T22:41:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2899999999999999e-06 2024-04-25T22:41:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600866+0000", 2024-04-25T22:41:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6793e-05 2024-04-25T22:41:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600886+0000", 2024-04-25T22:41:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0772999999999999e-05 2024-04-25T22:41:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600904+0000", 2024-04-25T22:41:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7697e-05 2024-04-25T22:41:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602796+0000", 2024-04-25T22:41:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018920149999999999 2024-04-25T22:41:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602962+0000", 2024-04-25T22:41:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016590600000000001 2024-04-25T22:41:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618159+0000", 2024-04-25T22:41:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015196985999999999 2024-04-25T22:41:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 53.915280156999998, 2024-04-25T22:41:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006380269, 2024-04-25T22:41:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615724+0000", 2024-04-25T22:41:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.094e-06 2024-04-25T22:41:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615734+0000", 2024-04-25T22:41:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.363e-06 2024-04-25T22:41:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615751+0000", 2024-04-25T22:41:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:41:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615773+0000", 2024-04-25T22:41:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.154e-05 2024-04-25T22:41:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616485+0000", 2024-04-25T22:41:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00071225100000000001 2024-04-25T22:41:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616528+0000", 2024-04-25T22:41:08.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3606000000000002e-05 2024-04-25T22:41:08.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:08.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622030+0000", 2024-04-25T22:41:08.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055010750000000002 2024-04-25T22:41:08.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:08.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622103+0000", 2024-04-25T22:41:08.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3930000000000005e-05 2024-04-25T22:41:08.600 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.600 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.600 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.601 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:08.601 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:08.601 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 53.914367220000003, 2024-04-25T22:41:08.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046420649999999999, 2024-04-25T22:41:08.601 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:08.601 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:08.601 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-04-25T22:41:08.601 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:08.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:08.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:08.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:08.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:08.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:08.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616637+0000", 2024-04-25T22:41:08.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0299999999999998e-07 2024-04-25T22:41:08.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:08.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616653+0000", 2024-04-25T22:41:08.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5843000000000001e-05 2024-04-25T22:41:08.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:08.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616690+0000", 2024-04-25T22:41:08.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7466999999999999e-05 2024-04-25T22:41:08.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:08.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616729+0000", 2024-04-25T22:41:08.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8810000000000003e-05 2024-04-25T22:41:08.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:08.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617251+0000", 2024-04-25T22:41:08.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00052143899999999995 2024-04-25T22:41:08.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:08.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621278+0000", 2024-04-25T22:41:08.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040277029999999997 2024-04-25T22:41:08.604 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.604 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.604 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.604 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:08.604 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:08.604 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 53.913343867999998, 2024-04-25T22:41:08.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0065101730000000002, 2024-04-25T22:41:08.604 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:08.605 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:08.605 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:08.605 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:08.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:08.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:08.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:08.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:08.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:08.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617661+0000", 2024-04-25T22:41:08.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:41:08.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:08.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617688+0000", 2024-04-25T22:41:08.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7589e-05 2024-04-25T22:41:08.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:08.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617710+0000", 2024-04-25T22:41:08.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1467e-05 2024-04-25T22:41:08.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:08.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617727+0000", 2024-04-25T22:41:08.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6990000000000002e-05 2024-04-25T22:41:08.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:08.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618559+0000", 2024-04-25T22:41:08.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083207400000000003 2024-04-25T22:41:08.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:08.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618608+0000", 2024-04-25T22:41:08.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8936e-05 2024-04-25T22:41:08.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:08.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624077+0000", 2024-04-25T22:41:08.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054695840000000004 2024-04-25T22:41:08.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:08.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624170+0000", 2024-04-25T22:41:08.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2305999999999993e-05 2024-04-25T22:41:08.608 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.608 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.608 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.608 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:08.608 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:08.609 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 53.908242360000003, 2024-04-25T22:41:08.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006879446, 2024-04-25T22:41:08.609 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:08.609 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:08.609 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:08.609 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:08.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:08.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:08.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:08.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:08.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:08.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622762+0000", 2024-04-25T22:41:08.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:41:08.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:08.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622781+0000", 2024-04-25T22:41:08.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8749999999999998e-05 2024-04-25T22:41:08.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:08.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622802+0000", 2024-04-25T22:41:08.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1650000000000001e-05 2024-04-25T22:41:08.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:08.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622816+0000", 2024-04-25T22:41:08.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3556e-05 2024-04-25T22:41:08.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:08.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623700+0000", 2024-04-25T22:41:08.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00088389299999999996 2024-04-25T22:41:08.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:08.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623741+0000", 2024-04-25T22:41:08.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1023999999999999e-05 2024-04-25T22:41:08.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:08.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629543+0000", 2024-04-25T22:41:08.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058023980000000003 2024-04-25T22:41:08.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:08.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629640+0000", 2024-04-25T22:41:08.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7381999999999997e-05 2024-04-25T22:41:08.612 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.612 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.613 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.613 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:08.613 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:08.613 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 53.907981155999998, 2024-04-25T22:41:08.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067054879999999999, 2024-04-25T22:41:08.613 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:08.613 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:08.613 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:08.613 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:08.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:08.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:08.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:08.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:08.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:08.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623032+0000", 2024-04-25T22:41:08.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.9930000000000007e-06 2024-04-25T22:41:08.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:08.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623043+0000", 2024-04-25T22:41:08.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0387000000000001e-05 2024-04-25T22:41:08.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:08.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623064+0000", 2024-04-25T22:41:08.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1849999999999999e-05 2024-04-25T22:41:08.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:08.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623079+0000", 2024-04-25T22:41:08.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4093e-05 2024-04-25T22:41:08.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:08.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624384+0000", 2024-04-25T22:41:08.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013054539999999999 2024-04-25T22:41:08.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:08.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624421+0000", 2024-04-25T22:41:08.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7088999999999997e-05 2024-04-25T22:41:08.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:08.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629645+0000", 2024-04-25T22:41:08.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052241400000000004 2024-04-25T22:41:08.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:08.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629728+0000", 2024-04-25T22:41:08.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2482000000000001e-05 2024-04-25T22:41:08.617 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.617 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.617 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.617 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2024-04-25T22:41:08.617 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:08.617 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 53.907898043000003, 2024-04-25T22:41:08.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078029559999999998, 2024-04-25T22:41:08.618 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:08.618 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:08.618 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:08.618 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:08.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:08.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:08.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:08.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:08.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:08.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:08.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623106+0000", 2024-04-25T22:41:08.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.64e-07 2024-04-25T22:41:08.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:08.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623141+0000", 2024-04-25T22:41:08.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4678999999999998e-05 2024-04-25T22:41:08.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:08.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623153+0000", 2024-04-25T22:41:08.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1759999999999999e-05 2024-04-25T22:41:08.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:08.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623161+0000", 2024-04-25T22:41:08.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8299999999999996e-06 2024-04-25T22:41:08.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:08.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623834+0000", 2024-04-25T22:41:08.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067394500000000001 2024-04-25T22:41:08.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:08.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623883+0000", 2024-04-25T22:41:08.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8640000000000002e-05 2024-04-25T22:41:08.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:08.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630807+0000", 2024-04-25T22:41:08.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069238859999999998 2024-04-25T22:41:08.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:08.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:08.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:08.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630908+0000", 2024-04-25T22:41:08.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101252 2024-04-25T22:41:08.621 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.621 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.621 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.621 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:08.621 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:08.621 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:08.623 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:08.623 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:08.621+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:08.724 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:08.723+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:08.741 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is unset 2024-04-25T22:41:08.755 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:08.755 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:08.755 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:08.755 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:08.770 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:08.825 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:08.823+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:08.888 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:08.888 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:08.888 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:08.888 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:08.888 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:08.902 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:08.925 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:08.923+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:09.026 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:09.026 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:09.026 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:09.026 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:09.027 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.027 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.027 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:09.027 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.428525012000001, 2024-04-25T22:41:09.027 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:09.027 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:09.027 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:09.027 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.027 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:09.027 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.027 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:09.027 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:09.027 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:09.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:09.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:09.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:09.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:09.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:09.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:09.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:09.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:09.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:09.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:09.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:09.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:09.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:09.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:09.030 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.030 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.030 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:09.030 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:09.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:09.030 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.030 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.030 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.030 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:09.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:09.030 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.030 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.030 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:09.031 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:09.031 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:09.031 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.031 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.031 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:09.031 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:09.031 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:09.031 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.031 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.031 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:09.031 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:09.031 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:09.031 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.031 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.031 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.032 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:09.032 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:09.032 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.032 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.032 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:09.032 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:09.032 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:09.032 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.032 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.032 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:09.032 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:09.032 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:09.032 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.032 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.032 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.032 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.033 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.033 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:09.033 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.428387755999999, 2024-04-25T22:41:09.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:09.033 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:09.033 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:09.033 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.033 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:09.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:09.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:09.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:09.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:09.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:09.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:09.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:09.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:09.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:09.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:09.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:09.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:09.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:09.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.035 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:09.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:09.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.035 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:09.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:09.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.036 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.036 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:09.036 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:09.036 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:09.036 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.036 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.036 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.036 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:09.036 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:09.036 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.036 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.036 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:09.036 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:09.036 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:09.036 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.036 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:09.037 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:09.037 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:09.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:09.037 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:09.037 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:09.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.037 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:09.037 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:09.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.038 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:09.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:09.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:09.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.038 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:09.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:09.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:09.038 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.038 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.038 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.038 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.038 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:09.039 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.428300204000003, 2024-04-25T22:41:09.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:09.039 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:09.039 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:09.039 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.039 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:09.039 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.039 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:09.039 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:09.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.039 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.039 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:09.039 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:09.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.040 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:09.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:09.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:09.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.040 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:09.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:09.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:09.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.040 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:09.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:09.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:09.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.041 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.041 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.041 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:09.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:09.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.041 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.041 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.041 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:09.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:09.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.041 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.042 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:09.042 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:09.042 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:09.042 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.042 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.042 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.042 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:09.042 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:09.042 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.042 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.042 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:09.042 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:09.042 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:09.042 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.043 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.043 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:09.043 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:09.043 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:09.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.043 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.043 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:09.043 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:09.043 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:09.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.043 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.043 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.043 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:09.043 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:09.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.044 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.044 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:09.044 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:09.044 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:09.044 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.044 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.044 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:09.044 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:09.044 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:09.044 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.044 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.044 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.044 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.044 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.045 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.045 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:09.045 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.428196378000003, 2024-04-25T22:41:09.045 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:09.045 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:09.045 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:09.045 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.045 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:09.045 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.045 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:09.045 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:09.046 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.046 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.046 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:09.046 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:09.046 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.046 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.046 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:09.046 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:09.046 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:09.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.046 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.047 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:09.047 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:09.047 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:09.047 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.047 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.047 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:09.047 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:09.047 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:09.047 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.047 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.047 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.047 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:09.047 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:09.047 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.047 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.047 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.048 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:09.048 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:09.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.048 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.048 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:09.048 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:09.048 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:09.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.048 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.048 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.048 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:09.048 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:09.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.048 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.048 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:09.049 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:09.049 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:09.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.049 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:09.049 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:09.049 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:09.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.049 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:09.049 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:09.049 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:09.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:09.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:09.050 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.050 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:09.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:09.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:09.050 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.050 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:09.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:09.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:09.050 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.050 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.051 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.051 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.051 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.051 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.051 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:09.051 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.428127588000002, 2024-04-25T22:41:09.051 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:09.051 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:09.051 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:09.051 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.051 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:09.051 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.051 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:09.051 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:09.052 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.052 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.052 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:09.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:09.052 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.052 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.052 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:09.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:09.052 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:09.052 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.052 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:09.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:09.052 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:09.053 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.053 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.053 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:09.053 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:09.053 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:09.053 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.053 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.053 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.053 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:09.053 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:09.053 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.053 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.053 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.053 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:09.053 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:09.054 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.054 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.054 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:09.054 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:09.054 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:09.054 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.054 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.054 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.054 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:09.054 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:09.054 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.054 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.054 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:09.054 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:09.055 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:09.055 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.055 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.055 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:09.055 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:09.055 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:09.055 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.055 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.055 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:09.055 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:09.055 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:09.055 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.055 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.055 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.055 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:09.056 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:09.056 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.056 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.056 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:09.056 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:09.056 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:09.056 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.056 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.056 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:09.056 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:09.056 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:09.056 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.056 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.056 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.057 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.057 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.057 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.057 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:09.057 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.428058501999999, 2024-04-25T22:41:09.057 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:09.057 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:09.057 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:09.057 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.057 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:09.057 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.057 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:09.057 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:09.057 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.057 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.058 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.058 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:09.058 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:09.058 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.058 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.058 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.058 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:09.058 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:09.058 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:09.058 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.058 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.058 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:09.058 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:09.058 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:09.059 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.059 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.059 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:09.059 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:09.059 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:09.059 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.059 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.059 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.059 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:09.059 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:09.059 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.059 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.059 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.059 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:09.059 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:09.060 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.060 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.060 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:09.060 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:09.060 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:09.060 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.060 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.060 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.060 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:09.060 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:09.060 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.060 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.060 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:09.060 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:09.061 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:09.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.061 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.061 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:09.061 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:09.061 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:09.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.061 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.061 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:09.061 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:09.061 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:09.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.061 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.061 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.061 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:09.062 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:09.062 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.062 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.062 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:09.062 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:09.062 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:09.062 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.062 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.062 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:09.062 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:09.062 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:09.062 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.062 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.062 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.063 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.063 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.063 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.063 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:09.063 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.427962389000001, 2024-04-25T22:41:09.063 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:09.063 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:09.063 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:09.063 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:09.063 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:09.063 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.063 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:09.063 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:09.063 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.064 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.064 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.064 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:09.064 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:09.064 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.064 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.064 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.064 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:09.064 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:09.064 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:09.064 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.064 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.064 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:09.064 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:09.065 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:09.065 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.065 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.065 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:09.065 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:09.065 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:09.065 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.065 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.065 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.065 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:09.065 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:09.065 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.065 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.065 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.065 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:09.065 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:09.066 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.066 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.066 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:09.066 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:09.066 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:09.066 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.066 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.066 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.066 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:09.066 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:09.066 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.066 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.066 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:09.067 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:09.067 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:09.067 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.067 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.067 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:09.067 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:09.067 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:09.067 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.067 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.067 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.067 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.067 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.067 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.067 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:09.067 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.427896726999997, 2024-04-25T22:41:09.068 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:09.068 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:09.068 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:09.068 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:09.068 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:09.068 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.068 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:09.068 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:09.068 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.068 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.068 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.068 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:09.068 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:09.068 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.068 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.069 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.069 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:09.069 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:09.069 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:09.069 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.069 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.069 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:09.069 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:09.069 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:09.069 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.069 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.069 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:09.069 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:09.069 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:09.069 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.070 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.070 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.070 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:09.070 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:09.070 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.070 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.070 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.070 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:09.070 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:09.070 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.070 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.070 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:09.070 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:09.070 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:09.071 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.071 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.071 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.071 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:09.071 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:09.071 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.071 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.071 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:09.071 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:09.071 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:09.071 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.071 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.071 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:09.071 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:09.072 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:09.072 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.072 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.072 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.072 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.072 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.072 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.072 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:09.072 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.427827600000001, 2024-04-25T22:41:09.072 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:09.072 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:09.072 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:09.072 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:09.072 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:09.073 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.073 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:09.073 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:09.073 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.073 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.073 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.073 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:09.073 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:09.073 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.073 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.073 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.073 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:09.073 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:09.073 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:09.073 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.074 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.074 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:09.074 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:09.074 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:09.074 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.074 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.074 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:09.074 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:09.074 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:09.074 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.074 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.074 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.074 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:09.074 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:09.074 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.075 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.075 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.075 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:09.075 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:09.075 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.075 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.075 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:09.075 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:09.075 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:09.075 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.075 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.075 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.075 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:09.075 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:09.075 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.076 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.076 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:09.076 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:09.076 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:09.076 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.076 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.076 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:09.076 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:09.076 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:09.076 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.076 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.076 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.076 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.076 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.077 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:09.077 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:09.077 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.417010943999998, 2024-04-25T22:41:09.077 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:09.077 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:09.077 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:09.077 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:09.077 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:09.077 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.077 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:09.077 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:09.077 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.077 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.077 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.077 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:09.077 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:09.078 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.078 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.078 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.078 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:09.078 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:09.078 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:09.078 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.078 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.078 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:09.078 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:09.078 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:09.078 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.078 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.078 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:09.079 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:09.079 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:09.079 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.079 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.079 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.079 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:09.079 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:09.079 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.079 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.079 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.079 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:09.079 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:09.079 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.080 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.080 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:09.080 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:09.080 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:09.080 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.080 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.080 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.080 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.080 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.080 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:09.080 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:09.080 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.400112591000003, 2024-04-25T22:41:09.080 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:09.080 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:09.081 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:09.081 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:09.081 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:09.081 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.081 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:09.081 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:09.081 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.081 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.081 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.081 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:09.081 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:09.081 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.081 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.081 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.081 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:09.081 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:09.082 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:09.082 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.082 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.082 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:09.082 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:09.082 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:09.082 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.082 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.082 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:09.082 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:09.082 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:09.082 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.082 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.083 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.083 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:09.083 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:09.083 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.083 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.083 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.083 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:09.083 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:09.083 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.083 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.083 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:09.083 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:09.083 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:09.083 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.083 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.084 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:09.084 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:09.084 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:09.084 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.084 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.084 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.084 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.084 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.084 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:09.084 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:09.084 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.399291701000003, 2024-04-25T22:41:09.084 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:09.084 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:09.084 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:09.084 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:09.085 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:09.085 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.085 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:09.085 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:09.085 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.085 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.085 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.085 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:09.085 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:09.085 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.085 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.085 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.085 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:09.085 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:09.085 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:09.086 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.086 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.086 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:09.086 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:09.086 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:09.086 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.086 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.086 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:09.086 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:09.086 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:09.086 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.086 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.086 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.086 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:09.087 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:09.087 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.087 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.087 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.087 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:09.087 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:09.087 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.087 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.087 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:09.087 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:09.087 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:09.087 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.087 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.087 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:09.087 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:09.088 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:09.088 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.088 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.088 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.088 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.088 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.088 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:09.088 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:09.088 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.397590973, 2024-04-25T22:41:09.088 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:09.088 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:09.088 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:09.088 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.089 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:09.089 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.089 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:09.089 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:09.089 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.089 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.089 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.089 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:09.089 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:09.089 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.089 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.089 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.089 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:09.089 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:09.089 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:09.090 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.090 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.090 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:09.090 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:09.090 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:09.090 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.090 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.090 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:09.090 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:09.090 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:09.090 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.090 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.090 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.090 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:09.091 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:09.091 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.091 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.091 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.091 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:09.091 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:09.091 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.091 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.091 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:09.091 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:09.091 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:09.091 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.091 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.091 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:09.091 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:09.092 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:09.092 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.092 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.092 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:09.092 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:09.092 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:09.092 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.092 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.092 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.092 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.092 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.092 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:09.092 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:09.092 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.396994298000003, 2024-04-25T22:41:09.093 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:09.093 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:09.093 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:09.093 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.093 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:09.093 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.093 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:09.093 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:09.093 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.093 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.093 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.093 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:09.093 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:09.093 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.093 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.094 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.094 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:09.094 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:09.094 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:09.094 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.094 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.094 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:09.094 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:09.094 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:09.094 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.094 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.094 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:09.094 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:09.094 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:09.095 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.095 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.095 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.095 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:09.095 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:09.095 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.095 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.095 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.095 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:09.095 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:09.095 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.095 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.095 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:09.095 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:09.095 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:09.096 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.096 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.096 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:09.096 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:09.096 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:09.096 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.096 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.096 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:09.096 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:09.096 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:09.096 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.096 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.096 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.096 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.097 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.097 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:09.097 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:09.097 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.387558572000003, 2024-04-25T22:41:09.097 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:09.097 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:09.097 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:09.097 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:09.097 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:09.097 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.097 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:09.097 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:09.097 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.097 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.098 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.098 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:09.098 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:09.098 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.098 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.098 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.098 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:09.098 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:09.098 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:09.098 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.098 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.098 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:09.098 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:09.098 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:09.099 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.099 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.099 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:09.099 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:09.099 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:09.099 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.099 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.099 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.099 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:09.099 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:09.099 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.099 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.099 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.099 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:09.100 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:09.100 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.100 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.100 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:09.100 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:09.100 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:09.100 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.100 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.100 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.100 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.100 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.100 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:09.100 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:09.100 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.386911146000003, 2024-04-25T22:41:09.101 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:09.101 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:09.101 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:09.101 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.101 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:09.101 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.101 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:09.101 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:09.101 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.101 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.101 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.101 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:09.101 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:09.101 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.102 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.102 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.102 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:09.102 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:09.102 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:09.102 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.102 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.102 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:09.102 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:09.102 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:09.102 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.102 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.102 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:09.102 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:09.103 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:09.103 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.103 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.103 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.103 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:09.103 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:09.103 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.103 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.103 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.103 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:09.103 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:09.103 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.103 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.103 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:09.104 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:09.104 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:09.104 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.104 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.104 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:09.104 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:09.104 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:09.104 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.104 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.104 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:09.104 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:09.104 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:09.104 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.104 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.105 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.105 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.105 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.105 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:09.105 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:09.105 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.385470327, 2024-04-25T22:41:09.105 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:09.105 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:09.105 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:09.105 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.105 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:09.105 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.105 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:09.105 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:09.105 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.105 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.106 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.106 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:09.106 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:09.106 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.106 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.106 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.106 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:09.106 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:09.106 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:09.106 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.106 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.106 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:09.106 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:09.106 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:09.106 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.107 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.107 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:09.107 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:09.107 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:09.107 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.107 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.107 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.107 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:09.107 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:09.107 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.107 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.107 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.107 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:09.107 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:09.107 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.108 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.108 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:09.108 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:09.108 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:09.108 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.108 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.108 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:09.108 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:09.108 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:09.108 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.108 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.108 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:09.108 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:09.108 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:09.108 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.109 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.109 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.109 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.109 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.109 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:09.109 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:09.109 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 52.433031882999998, 2024-04-25T22:41:09.109 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:09.109 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:09.109 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:09.109 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.109 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:09.109 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.109 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:09.109 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:09.110 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.110 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.110 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.110 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:09.110 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:09.110 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.110 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.110 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.110 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:09.110 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:09.110 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:09.110 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.110 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.111 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:09.111 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:09.111 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:09.111 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.111 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.111 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:09.111 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:09.111 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:09.111 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.111 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.111 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.111 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:09.111 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:09.111 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.112 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.112 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.112 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:09.112 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:09.112 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.112 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.112 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:09.112 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:09.112 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:09.112 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.112 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.112 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:09.112 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:09.112 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:09.113 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.113 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.113 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:09.113 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:09.113 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:09.113 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.113 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.113 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.113 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:09.113 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:09.113 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.113 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.113 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:09.113 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:09.114 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:09.114 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.114 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.114 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:09.114 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:09.114 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:09.114 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.114 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.114 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.114 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.114 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.114 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:09.114 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:09.114 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.430372558999998, 2024-04-25T22:41:09.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:09.115 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:09.115 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:09.115 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.115 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:09.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.115 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:09.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:09.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.115 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.115 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:09.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:09.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:09.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:09.116 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:09.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:09.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:09.116 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:09.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:09.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:09.116 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:09.117 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:09.117 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:09.117 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:09.117 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:09.117 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:09.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:09.117 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:09.118 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.118 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.118 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:09.118 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:09.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:09.118 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.118 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.118 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:09.118 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:09.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:09.118 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.118 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.118 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.118 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:09.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:09.119 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.119 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.119 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:09.119 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:09.119 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:09.119 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.119 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.119 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:09.119 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:09.119 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:09.119 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.119 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.119 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.119 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.119 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.120 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:09.120 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:09.120 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 25.430080308000001, 2024-04-25T22:41:09.120 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:09.120 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:09.120 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:09.120 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.120 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:09.120 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.120 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:09.120 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:09.120 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.120 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.120 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:09.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:09.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:09.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:09.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:09.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:09.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:09.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:09.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:09.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:09.122 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:09.122 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:09.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.122 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:09.122 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:09.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:09.122 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:09.122 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:09.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.123 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:09.123 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:09.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:09.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.123 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:09.123 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:09.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:09.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.123 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:09.123 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:09.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:09.124 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.124 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:09.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:09.124 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:09.124 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:09.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:09.124 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:09.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:09.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:09.124 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:09.125 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:09.125 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.125 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.125 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.125 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:09.125 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:09.125 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:09.126 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:09.026+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:09.127 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:09.125+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:09.127 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:09.227 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:09.226+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:09.264 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:09.264 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:09.264 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:41:09.264 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:09.278 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:09.327 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:09.327+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:09.428 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:09.427+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:09.443 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:09.443 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:09.443 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:09.444 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:09.444 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:09.457 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:09.529 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:09.527+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:09.583 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:09.583 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:41:09.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:41:09.583 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:41:09.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.583 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.583 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:09.583 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.986123196999998, 2024-04-25T22:41:09.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:41:09.584 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:09.584 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:09.584 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.584 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:09.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:09.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:09.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:09.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:09.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:09.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:41:09.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:41:09.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:09.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:41:09.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:41:09.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:09.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:41:09.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:41:09.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:41:09.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:41:09.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:41:09.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:41:09.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:09.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:41:09.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:41:09.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:41:09.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:41:09.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:09.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:41:09.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:41:09.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:09.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:41:09.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:41:09.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:41:09.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:41:09.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:09.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:41:09.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:41:09.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:09.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:41:09.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:41:09.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:09.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:41:09.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:41:09.589 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.589 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.589 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.589 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.590 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:09.590 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.986035184000002, 2024-04-25T22:41:09.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:41:09.590 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:09.590 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:09.590 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.590 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:09.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:09.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:09.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:09.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:09.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:09.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:41:09.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:41:09.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:09.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:09.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:41:09.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:09.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:41:09.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:41:09.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:41:09.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:41:09.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:41:09.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:41:09.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:09.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:09.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:41:09.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:41:09.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:41:09.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:09.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:41:09.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:41:09.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:09.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:41:09.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:41:09.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:09.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:41:09.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:41:09.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:41:09.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:41:09.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:09.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:41:09.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:41:09.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:09.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:41:09.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:41:09.595 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.595 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.595 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.596 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.596 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:09.596 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.985963062000003, 2024-04-25T22:41:09.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:41:09.596 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:09.596 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:09.596 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.596 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:09.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:09.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:09.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:09.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:09.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:09.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:41:09.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:41:09.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:09.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:41:09.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:41:09.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:09.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:41:09.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:41:09.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:41:09.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:41:09.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:41:09.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:41:09.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:09.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:41:09.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:41:09.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:41:09.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:41:09.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:09.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:41:09.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:41:09.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:09.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:41:09.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:41:09.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:41:09.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:41:09.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:09.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:41:09.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:41:09.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:09.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:41:09.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:41:09.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:09.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:41:09.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:41:09.601 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.601 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.602 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.602 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.602 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:09.602 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.985854748999998, 2024-04-25T22:41:09.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:41:09.602 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:09.602 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:09.602 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.602 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:09.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:09.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:09.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:09.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:09.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:09.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:41:09.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:41:09.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:09.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:41:09.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:41:09.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:09.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:41:09.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:41:09.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:41:09.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:41:09.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:41:09.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:41:09.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:09.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:41:09.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:41:09.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:41:09.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:41:09.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:09.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:41:09.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:41:09.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:09.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:41:09.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:41:09.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:41:09.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:41:09.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:09.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:41:09.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:41:09.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:09.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:41:09.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:41:09.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:09.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:41:09.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:41:09.608 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.608 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.608 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.608 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.608 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:09.608 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.985788092999996, 2024-04-25T22:41:09.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:41:09.608 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:09.608 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:09.608 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.608 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:09.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:09.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:09.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:09.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:09.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:09.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:41:09.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:41:09.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:09.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:41:09.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:41:09.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:09.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:41:09.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:41:09.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:41:09.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:41:09.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:41:09.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:41:09.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:09.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:41:09.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:41:09.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:41:09.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:41:09.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:09.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:41:09.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:41:09.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:09.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:41:09.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:41:09.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:41:09.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:41:09.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:09.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:41:09.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:41:09.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:09.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:41:09.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:41:09.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:09.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:41:09.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:41:09.614 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.614 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.614 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.614 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.614 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:09.614 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.985697496999997, 2024-04-25T22:41:09.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:41:09.614 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:09.614 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:09.614 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.615 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:09.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:09.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:09.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:09.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:09.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:09.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:41:09.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:41:09.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:09.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:41:09.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:41:09.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:09.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:41:09.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:41:09.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:41:09.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:41:09.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:41:09.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:41:09.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:09.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:41:09.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:41:09.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:41:09.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:41:09.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:09.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:41:09.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:41:09.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:09.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:41:09.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:41:09.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:09.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:41:09.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:41:09.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:41:09.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:41:09.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:09.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:41:09.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:41:09.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:09.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:41:09.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:41:09.620 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.620 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.620 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.620 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.620 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:09.620 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.985632924000001, 2024-04-25T22:41:09.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:41:09.620 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:09.621 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:09.621 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.621 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:09.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:09.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:09.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:09.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:09.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:09.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:41:09.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:41:09.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:09.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:41:09.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:41:09.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:09.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:41:09.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:41:09.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:41:09.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:41:09.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:09.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:41:09.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:09.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:41:09.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:41:09.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:41:09.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:41:09.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:09.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:41:09.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:41:09.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:09.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:41:09.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:41:09.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:41:09.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:41:09.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:09.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:41:09.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:41:09.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:09.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:41:09.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:41:09.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:09.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:41:09.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:41:09.626 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.626 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.626 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.626 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.626 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:09.626 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.985567500999998, 2024-04-25T22:41:09.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:41:09.627 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:09.627 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:09.627 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.627 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:09.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:09.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:09.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:09.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:09.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:09.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:41:09.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:09.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:09.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:41:09.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:41:09.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:09.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:41:09.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:41:09.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:41:09.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:41:09.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:41:09.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:41:09.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:09.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:41:09.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:41:09.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:41:09.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:41:09.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:09.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:41:09.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:41:09.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:09.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:41:09.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:41:09.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:09.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:41:09.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:41:09.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:41:09.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:41:09.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:09.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:41:09.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:41:09.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:09.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:41:09.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:41:09.632 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.632 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.632 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.632 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.632 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:09.633 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.985511434999999, 2024-04-25T22:41:09.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:41:09.633 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:09.633 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:09.633 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.633 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:09.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:09.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:09.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:09.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:09.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:09.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:09.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:41:09.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:09.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:41:09.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:41:09.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:09.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:41:09.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:41:09.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:41:09.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:41:09.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:41:09.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:41:09.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:09.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:41:09.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:41:09.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:41:09.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:41:09.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:09.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:41:09.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:41:09.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:09.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:41:09.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:41:09.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:41:09.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:41:09.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:09.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:41:09.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:41:09.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:09.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:41:09.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:41:09.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:09.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:41:09.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:41:09.638 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.638 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.638 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.639 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.639 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:09.639 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.985444329000003, 2024-04-25T22:41:09.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:41:09.639 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:09.639 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:09.639 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.639 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:09.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:09.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:09.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:09.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:09.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:09.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:41:09.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:41:09.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:09.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:41:09.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:41:09.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:09.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:41:09.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:41:09.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:41:09.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:41:09.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:41:09.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:41:09.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:09.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:41:09.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:41:09.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:41:09.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:41:09.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:09.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:41:09.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:41:09.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:09.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:41:09.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:41:09.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:41:09.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:41:09.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:09.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:41:09.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:41:09.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:09.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:41:09.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:41:09.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:09.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:41:09.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:41:09.644 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.644 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.645 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.645 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.645 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:09.645 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.985389206000001, 2024-04-25T22:41:09.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:41:09.645 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:09.645 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:09.645 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.645 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:09.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:09.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:09.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:09.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:09.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:09.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:41:09.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:09.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:09.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:41:09.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:41:09.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:09.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:41:09.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:41:09.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:41:09.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:41:09.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:41:09.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:41:09.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:09.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:41:09.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:41:09.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:41:09.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:41:09.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:09.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:41:09.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:41:09.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:09.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:41:09.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:41:09.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:41:09.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:41:09.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:09.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:41:09.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:41:09.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:09.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:41:09.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:41:09.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:09.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:41:09.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:41:09.650 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.651 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.651 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.651 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.651 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:09.651 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.985286967, 2024-04-25T22:41:09.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:41:09.651 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:09.651 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:09.651 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.651 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:09.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:09.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:09.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:09.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:09.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:09.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:41:09.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:41:09.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:09.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:41:09.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:41:09.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:09.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:41:09.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:41:09.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:41:09.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:41:09.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:41:09.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:41:09.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:09.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:41:09.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:41:09.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:41:09.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:41:09.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:09.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:41:09.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:41:09.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:09.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:41:09.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:41:09.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:41:09.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:41:09.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:09.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:41:09.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:41:09.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:09.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:41:09.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:41:09.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:09.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:41:09.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:41:09.657 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.657 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.657 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.657 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.657 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:09.657 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.985228143999997, 2024-04-25T22:41:09.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:41:09.657 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:09.657 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:09.657 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.657 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:09.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:09.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:09.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:09.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:09.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:09.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:41:09.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:41:09.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:09.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:41:09.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:41:09.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:09.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:41:09.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:41:09.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:41:09.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:41:09.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:41:09.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:41:09.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:09.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:41:09.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:41:09.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:41:09.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:41:09.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:09.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:41:09.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:41:09.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:09.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:41:09.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:41:09.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:09.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:41:09.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:41:09.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:41:09.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:41:09.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:09.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:41:09.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:41:09.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:09.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:41:09.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:41:09.663 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.663 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.663 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.663 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.663 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:09.663 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.985149411000002, 2024-04-25T22:41:09.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:41:09.663 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:09.663 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:09.663 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.663 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:09.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:09.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:09.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:09.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:09.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:09.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:41:09.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:09.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:09.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:41:09.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:41:09.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:09.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:41:09.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:41:09.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:41:09.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:41:09.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:41:09.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:41:09.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:09.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:41:09.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:41:09.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:41:09.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:41:09.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:09.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:41:09.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:41:09.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:09.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:41:09.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:41:09.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:09.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:41:09.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:41:09.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:41:09.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:41:09.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:09.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:41:09.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:41:09.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:09.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:41:09.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:41:09.668 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.669 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.669 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.669 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.669 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:09.669 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.985109997999999, 2024-04-25T22:41:09.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:41:09.669 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:09.669 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:09.669 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.669 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:09.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:09.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:09.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:09.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:09.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:09.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:41:09.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:41:09.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:09.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:41:09.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:41:09.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:09.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:41:09.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:41:09.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:41:09.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:41:09.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:41:09.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:41:09.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:09.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:41:09.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:41:09.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:41:09.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:41:09.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:09.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:41:09.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:41:09.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:09.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:41:09.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:41:09.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:41:09.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:41:09.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:09.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:41:09.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:41:09.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:09.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:41:09.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:41:09.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:09.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:41:09.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:41:09.674 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.675 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.675 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.675 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.675 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:09.675 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.985040152000003, 2024-04-25T22:41:09.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:41:09.675 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:09.675 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:09.675 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.675 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:09.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:09.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:09.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:09.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:09.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:09.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:41:09.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:41:09.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:09.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:41:09.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:41:09.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:09.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:41:09.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:41:09.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:41:09.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:41:09.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:41:09.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:41:09.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:09.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:41:09.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:41:09.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:41:09.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:41:09.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:09.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:41:09.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:41:09.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:09.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:41:09.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:41:09.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:41:09.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:41:09.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:09.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:41:09.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:41:09.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:09.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:41:09.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:41:09.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:09.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:41:09.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:41:09.681 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.681 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.681 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.681 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.681 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:09.681 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.984990414999999, 2024-04-25T22:41:09.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:41:09.681 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:09.681 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:09.681 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.681 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:09.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:09.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:09.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:09.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:09.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:09.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:41:09.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:09.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:09.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:41:09.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:41:09.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:09.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:41:09.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:41:09.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:41:09.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:41:09.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:41:09.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:41:09.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:09.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:41:09.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:41:09.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:41:09.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:41:09.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:09.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:41:09.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:41:09.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:09.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:41:09.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:41:09.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:09.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:41:09.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:41:09.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:41:09.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:41:09.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:09.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:09.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:41:09.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:09.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:41:09.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:41:09.687 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.687 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.687 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.687 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.687 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:09.687 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.9849058, 2024-04-25T22:41:09.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:41:09.687 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:09.687 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:09.687 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.687 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:09.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:09.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:09.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:09.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:09.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:09.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:41:09.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:09.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:09.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:41:09.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:41:09.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:09.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:41:09.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:41:09.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:41:09.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:41:09.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:41:09.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:41:09.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:09.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:41:09.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:41:09.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:41:09.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:41:09.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:09.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:41:09.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:41:09.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:09.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:41:09.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:41:09.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:09.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:41:09.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:41:09.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:09.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:41:09.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:41:09.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:09.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:41:09.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:41:09.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:09.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:41:09.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:41:09.693 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.693 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.693 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.693 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:09.693 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:09.693 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.984842149999999, 2024-04-25T22:41:09.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:41:09.693 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:09.693 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:09.693 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:41:09.693 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:09.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:09.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:09.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:09.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:09.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:09.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:41:09.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:41:09.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:09.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:41:09.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:41:09.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:09.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:41:09.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:41:09.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:41:09.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:41:09.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:41:09.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:41:09.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:09.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:41:09.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:41:09.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:41:09.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:41:09.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:09.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:41:09.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:41:09.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:09.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:41:09.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:41:09.697 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.697 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.697 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.698 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:09.698 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:09.698 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 54.97783862, 2024-04-25T22:41:09.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:41:09.698 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:09.698 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:09.698 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:09.698 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:09.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:09.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:09.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:09.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:09.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:09.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:09.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:41:09.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:41:09.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:09.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:41:09.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:41:09.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:09.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:41:09.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:41:09.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:09.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:41:09.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:41:09.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:09.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:41:09.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:41:09.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:09.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:41:09.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:41:09.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:09.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:41:09.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:41:09.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:09.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:09.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:09.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:41:09.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:41:09.702 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.702 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.702 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.702 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:09.702 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:09.702 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:09.703 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:41:09.704 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:09.701+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:09.805 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:09.806+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:09.836 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:09.836 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:41:09.836 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-04-25T22:41:09.836 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:09.850 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:41:09.906 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:09.906+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:09.974 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:41:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-04-25T22:41:09.974 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-04-25T22:41:09.974 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:09.987 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:41:10.031 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:10.031+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:10.103 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-04-25T22:41:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-04-25T22:41:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-04-25T22:41:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:111 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'73, mlcod=11'69)", 2024-04-25T22:41:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.403743847000001, 2024-04-25T22:41:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055481899999999997, 2024-04-25T22:41:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700271+0000", 2024-04-25T22:41:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:41:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700278+0000", 2024-04-25T22:41:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-04-25T22:41:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700323+0000", 2024-04-25T22:41:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4212999999999998e-05 2024-04-25T22:41:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700333+0000", 2024-04-25T22:41:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0433e-05 2024-04-25T22:41:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700662+0000", 2024-04-25T22:41:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032862800000000003 2024-04-25T22:41:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700692+0000", 2024-04-25T22:41:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0395999999999998e-05 2024-04-25T22:41:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705728+0000", 2024-04-25T22:41:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050361939999999999 2024-04-25T22:41:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705818+0000", 2024-04-25T22:41:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9573000000000005e-05 2024-04-25T22:41:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-25T22:41:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.403198994999997, 2024-04-25T22:41:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005065501, 2024-04-25T22:41:10.108 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700816+0000", 2024-04-25T22:41:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.24e-06 2024-04-25T22:41:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700914+0000", 2024-04-25T22:41:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8057e-05 2024-04-25T22:41:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700931+0000", 2024-04-25T22:41:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7745999999999999e-05 2024-04-25T22:41:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700941+0000", 2024-04-25T22:41:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5699999999999999e-06 2024-04-25T22:41:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701162+0000", 2024-04-25T22:41:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000221392 2024-04-25T22:41:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701194+0000", 2024-04-25T22:41:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1745999999999997e-05 2024-04-25T22:41:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705821+0000", 2024-04-25T22:41:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046269869999999999 2024-04-25T22:41:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705880+0000", 2024-04-25T22:41:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8763e-05 2024-04-25T22:41:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:118 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'80, mlcod=11'78)", 2024-04-25T22:41:10.112 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.395843385000006, 2024-04-25T22:41:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047806089999999999, 2024-04-25T22:41:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708172+0000", 2024-04-25T22:41:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0600000000000002e-06 2024-04-25T22:41:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708291+0000", 2024-04-25T22:41:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118892 2024-04-25T22:41:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708320+0000", 2024-04-25T22:41:10.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8822999999999998e-05 2024-04-25T22:41:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708337+0000", 2024-04-25T22:41:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7586999999999999e-05 2024-04-25T22:41:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708512+0000", 2024-04-25T22:41:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017439500000000001 2024-04-25T22:41:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708551+0000", 2024-04-25T22:41:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.909e-05 2024-04-25T22:41:10.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712865+0000", 2024-04-25T22:41:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043142069999999996 2024-04-25T22:41:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712951+0000", 2024-04-25T22:41:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5555000000000003e-05 2024-04-25T22:41:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:120 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'82, mlcod=11'78)", 2024-04-25T22:41:10.116 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.394837343000006, 2024-04-25T22:41:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047170700000000003, 2024-04-25T22:41:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709177+0000", 2024-04-25T22:41:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.19e-06 2024-04-25T22:41:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709315+0000", 2024-04-25T22:41:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000137429 2024-04-25T22:41:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709341+0000", 2024-04-25T22:41:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:41:10.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709353+0000", 2024-04-25T22:41:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2027e-05 2024-04-25T22:41:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710040+0000", 2024-04-25T22:41:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068710799999999997 2024-04-25T22:41:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710076+0000", 2024-04-25T22:41:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5982999999999998e-05 2024-04-25T22:41:10.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713802+0000", 2024-04-25T22:41:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037255750000000001 2024-04-25T22:41:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713893+0000", 2024-04-25T22:41:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1201999999999999e-05 2024-04-25T22:41:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:121 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'83, mlcod=11'78)", 2024-04-25T22:41:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.394290706999996, 2024-04-25T22:41:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0049043919999999996, 2024-04-25T22:41:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709724+0000", 2024-04-25T22:41:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.483e-06 2024-04-25T22:41:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709872+0000", 2024-04-25T22:41:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147446 2024-04-25T22:41:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:10.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709891+0000", 2024-04-25T22:41:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9245999999999998e-05 2024-04-25T22:41:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709900+0000", 2024-04-25T22:41:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1439999999999992e-06 2024-04-25T22:41:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713091+0000", 2024-04-25T22:41:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031910710000000002 2024-04-25T22:41:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713122+0000", 2024-04-25T22:41:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.048e-05 2024-04-25T22:41:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714538+0000", 2024-04-25T22:41:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014160030000000001 2024-04-25T22:41:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714627+0000", 2024-04-25T22:41:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518999999999995e-05 2024-04-25T22:41:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.503901327000001, 2024-04-25T22:41:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022089675999999999, 2024-04-25T22:41:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600120+0000", 2024-04-25T22:41:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1259999999999998e-06 2024-04-25T22:41:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600153+0000", 2024-04-25T22:41:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3186999999999999e-05 2024-04-25T22:41:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600181+0000", 2024-04-25T22:41:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7676000000000001e-05 2024-04-25T22:41:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600205+0000", 2024-04-25T22:41:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:41:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600467+0000", 2024-04-25T22:41:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026186800000000001 2024-04-25T22:41:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:10.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600809+0000", 2024-04-25T22:41:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034138400000000002 2024-04-25T22:41:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.601892+0000", 2024-04-25T22:41:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010831910000000001 2024-04-25T22:41:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611054+0000", 2024-04-25T22:41:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0091620940000000008 2024-04-25T22:41:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:10.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621965+0000", 2024-04-25T22:41:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010911044999999999 2024-04-25T22:41:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622090+0000", 2024-04-25T22:41:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012522 2024-04-25T22:41:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622202+0000", 2024-04-25T22:41:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011164500000000001 2024-04-25T22:41:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.503758271999999, 2024-04-25T22:41:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035756228000000001, 2024-04-25T22:41:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600257+0000", 2024-04-25T22:41:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8300000000000001e-06 2024-04-25T22:41:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600267+0000", 2024-04-25T22:41:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6539999999999994e-06 2024-04-25T22:41:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600293+0000", 2024-04-25T22:41:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5996e-05 2024-04-25T22:41:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600309+0000", 2024-04-25T22:41:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6206e-05 2024-04-25T22:41:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603757+0000", 2024-04-25T22:41:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003448244 2024-04-25T22:41:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604779+0000", 2024-04-25T22:41:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010216820000000001 2024-04-25T22:41:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605127+0000", 2024-04-25T22:41:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034820100000000002 2024-04-25T22:41:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611082+0000", 2024-04-25T22:41:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0059550640000000004 2024-04-25T22:41:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:10.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635779+0000", 2024-04-25T22:41:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024696665999999999 2024-04-25T22:41:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635915+0000", 2024-04-25T22:41:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000135809 2024-04-25T22:41:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636011+0000", 2024-04-25T22:41:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6875999999999999e-05 2024-04-25T22:41:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.503681059000002, 2024-04-25T22:41:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035327031000000002, 2024-04-25T22:41:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600334+0000", 2024-04-25T22:41:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:41:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600347+0000", 2024-04-25T22:41:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3593e-05 2024-04-25T22:41:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:10.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600371+0000", 2024-04-25T22:41:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.313e-05 2024-04-25T22:41:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600390+0000", 2024-04-25T22:41:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.908e-05 2024-04-25T22:41:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602756+0000", 2024-04-25T22:41:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023662560000000002 2024-04-25T22:41:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:10.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603021+0000", 2024-04-25T22:41:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026546399999999998 2024-04-25T22:41:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603304+0000", 2024-04-25T22:41:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028308800000000002 2024-04-25T22:41:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611075+0000", 2024-04-25T22:41:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077703900000000003 2024-04-25T22:41:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:10.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635414+0000", 2024-04-25T22:41:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024339326000000001 2024-04-25T22:41:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635544+0000", 2024-04-25T22:41:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012948199999999999 2024-04-25T22:41:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635659+0000", 2024-04-25T22:41:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000115809 2024-04-25T22:41:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.503521134000003, 2024-04-25T22:41:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035594492999999998, 2024-04-25T22:41:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600494+0000", 2024-04-25T22:41:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:41:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600502+0000", 2024-04-25T22:41:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3769999999999996e-06 2024-04-25T22:41:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600522+0000", 2024-04-25T22:41:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9919999999999999e-05 2024-04-25T22:41:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600539+0000", 2024-04-25T22:41:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.649e-05 2024-04-25T22:41:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604846+0000", 2024-04-25T22:41:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043075199999999996 2024-04-25T22:41:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605057+0000", 2024-04-25T22:41:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00021085200000000001 2024-04-25T22:41:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605378+0000", 2024-04-25T22:41:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032074799999999999 2024-04-25T22:41:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611089+0000", 2024-04-25T22:41:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057110249999999998 2024-04-25T22:41:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635844+0000", 2024-04-25T22:41:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024755355999999999 2024-04-25T22:41:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635986+0000", 2024-04-25T22:41:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141512 2024-04-25T22:41:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636087+0000", 2024-04-25T22:41:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101183 2024-04-25T22:41:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.144 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.503448524, 2024-04-25T22:41:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021266723000000001, 2024-04-25T22:41:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600566+0000", 2024-04-25T22:41:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4959999999999999e-06 2024-04-25T22:41:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600574+0000", 2024-04-25T22:41:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-06 2024-04-25T22:41:10.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600592+0000", 2024-04-25T22:41:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8479999999999999e-05 2024-04-25T22:41:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600610+0000", 2024-04-25T22:41:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7567e-05 2024-04-25T22:41:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602679+0000", 2024-04-25T22:41:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020692739999999999 2024-04-25T22:41:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602945+0000", 2024-04-25T22:41:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026640399999999998 2024-04-25T22:41:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603115+0000", 2024-04-25T22:41:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000169996 2024-04-25T22:41:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608398+0000", 2024-04-25T22:41:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052826289999999996 2024-04-25T22:41:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621588+0000", 2024-04-25T22:41:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013190489 2024-04-25T22:41:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621733+0000", 2024-04-25T22:41:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014462500000000001 2024-04-25T22:41:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621832+0000", 2024-04-25T22:41:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8603000000000004e-05 2024-04-25T22:41:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.149 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.503380798000002, 2024-04-25T22:41:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034747924999999999, 2024-04-25T22:41:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600634+0000", 2024-04-25T22:41:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-04-25T22:41:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600642+0000", 2024-04-25T22:41:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8169999999999999e-06 2024-04-25T22:41:10.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600660+0000", 2024-04-25T22:41:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8513e-05 2024-04-25T22:41:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600676+0000", 2024-04-25T22:41:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6019999999999999e-05 2024-04-25T22:41:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603748+0000", 2024-04-25T22:41:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030718329999999999 2024-04-25T22:41:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604752+0000", 2024-04-25T22:41:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001003603 2024-04-25T22:41:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605117+0000", 2024-04-25T22:41:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00036539 2024-04-25T22:41:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608459+0000", 2024-04-25T22:41:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033413879999999998 2024-04-25T22:41:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635106+0000", 2024-04-25T22:41:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026647607 2024-04-25T22:41:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635273+0000", 2024-04-25T22:41:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000166689 2024-04-25T22:41:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635381+0000", 2024-04-25T22:41:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107642 2024-04-25T22:41:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.154 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.503317569000004, 2024-04-25T22:41:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040419292000000002, 2024-04-25T22:41:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:10.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600697+0000", 2024-04-25T22:41:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1999999999999999e-06 2024-04-25T22:41:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:10.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600704+0000", 2024-04-25T22:41:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5570000000000001e-06 2024-04-25T22:41:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600724+0000", 2024-04-25T22:41:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0023000000000001e-05 2024-04-25T22:41:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600738+0000", 2024-04-25T22:41:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4372999999999999e-05 2024-04-25T22:41:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.612532+0000", 2024-04-25T22:41:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011793606 2024-04-25T22:41:10.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613354+0000", 2024-04-25T22:41:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00082244100000000004 2024-04-25T22:41:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613726+0000", 2024-04-25T22:41:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00037226000000000002 2024-04-25T22:41:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618891+0000", 2024-04-25T22:41:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051649199999999999 2024-04-25T22:41:10.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.640874+0000", 2024-04-25T22:41:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021982640000000001 2024-04-25T22:41:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641019+0000", 2024-04-25T22:41:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000145339 2024-04-25T22:41:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641115+0000", 2024-04-25T22:41:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5933000000000005e-05 2024-04-25T22:41:10.159 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.503231538999998, 2024-04-25T22:41:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036502711, 2024-04-25T22:41:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600783+0000", 2024-04-25T22:41:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.533e-06 2024-04-25T22:41:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:10.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600790+0000", 2024-04-25T22:41:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0439999999999998e-06 2024-04-25T22:41:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600811+0000", 2024-04-25T22:41:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0449e-05 2024-04-25T22:41:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600825+0000", 2024-04-25T22:41:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4293e-05 2024-04-25T22:41:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602304+0000", 2024-04-25T22:41:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001478629 2024-04-25T22:41:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602587+0000", 2024-04-25T22:41:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028350800000000002 2024-04-25T22:41:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.637285+0000", 2024-04-25T22:41:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034697255000000003 2024-04-25T22:41:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.163 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.503165973000002, 2024-04-25T22:41:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017311460000000001, 2024-04-25T22:41:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600849+0000", 2024-04-25T22:41:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2899999999999999e-06 2024-04-25T22:41:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600866+0000", 2024-04-25T22:41:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6793e-05 2024-04-25T22:41:10.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600886+0000", 2024-04-25T22:41:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0772999999999999e-05 2024-04-25T22:41:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600904+0000", 2024-04-25T22:41:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7697e-05 2024-04-25T22:41:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602796+0000", 2024-04-25T22:41:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018920149999999999 2024-04-25T22:41:10.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602962+0000", 2024-04-25T22:41:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016590600000000001 2024-04-25T22:41:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618159+0000", 2024-04-25T22:41:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015196985999999999 2024-04-25T22:41:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.167 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.488290231999997, 2024-04-25T22:41:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006380269, 2024-04-25T22:41:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615724+0000", 2024-04-25T22:41:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.094e-06 2024-04-25T22:41:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615734+0000", 2024-04-25T22:41:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.363e-06 2024-04-25T22:41:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615751+0000", 2024-04-25T22:41:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:41:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615773+0000", 2024-04-25T22:41:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.154e-05 2024-04-25T22:41:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616485+0000", 2024-04-25T22:41:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00071225100000000001 2024-04-25T22:41:10.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616528+0000", 2024-04-25T22:41:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3606000000000002e-05 2024-04-25T22:41:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622030+0000", 2024-04-25T22:41:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055010750000000002 2024-04-25T22:41:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622103+0000", 2024-04-25T22:41:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3930000000000005e-05 2024-04-25T22:41:10.171 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.487377295000002, 2024-04-25T22:41:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046420649999999999, 2024-04-25T22:41:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-04-25T22:41:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:10.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616637+0000", 2024-04-25T22:41:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0299999999999998e-07 2024-04-25T22:41:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:10.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616653+0000", 2024-04-25T22:41:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5843000000000001e-05 2024-04-25T22:41:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616690+0000", 2024-04-25T22:41:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7466999999999999e-05 2024-04-25T22:41:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616729+0000", 2024-04-25T22:41:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8810000000000003e-05 2024-04-25T22:41:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617251+0000", 2024-04-25T22:41:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00052143899999999995 2024-04-25T22:41:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621278+0000", 2024-04-25T22:41:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040277029999999997 2024-04-25T22:41:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:10.175 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.486353942999997, 2024-04-25T22:41:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0065101730000000002, 2024-04-25T22:41:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617661+0000", 2024-04-25T22:41:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:41:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617688+0000", 2024-04-25T22:41:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7589e-05 2024-04-25T22:41:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617710+0000", 2024-04-25T22:41:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1467e-05 2024-04-25T22:41:10.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617727+0000", 2024-04-25T22:41:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6990000000000002e-05 2024-04-25T22:41:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618559+0000", 2024-04-25T22:41:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083207400000000003 2024-04-25T22:41:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618608+0000", 2024-04-25T22:41:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8936e-05 2024-04-25T22:41:10.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624077+0000", 2024-04-25T22:41:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054695840000000004 2024-04-25T22:41:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624170+0000", 2024-04-25T22:41:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2305999999999993e-05 2024-04-25T22:41:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.179 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.481252435000002, 2024-04-25T22:41:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006879446, 2024-04-25T22:41:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:10.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622762+0000", 2024-04-25T22:41:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:41:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622781+0000", 2024-04-25T22:41:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8749999999999998e-05 2024-04-25T22:41:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622802+0000", 2024-04-25T22:41:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1650000000000001e-05 2024-04-25T22:41:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622816+0000", 2024-04-25T22:41:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3556e-05 2024-04-25T22:41:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623700+0000", 2024-04-25T22:41:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00088389299999999996 2024-04-25T22:41:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623741+0000", 2024-04-25T22:41:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1023999999999999e-05 2024-04-25T22:41:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629543+0000", 2024-04-25T22:41:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058023980000000003 2024-04-25T22:41:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629640+0000", 2024-04-25T22:41:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7381999999999997e-05 2024-04-25T22:41:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.183 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.480991230999997, 2024-04-25T22:41:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067054879999999999, 2024-04-25T22:41:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:10.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623032+0000", 2024-04-25T22:41:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.9930000000000007e-06 2024-04-25T22:41:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623043+0000", 2024-04-25T22:41:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0387000000000001e-05 2024-04-25T22:41:10.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623064+0000", 2024-04-25T22:41:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1849999999999999e-05 2024-04-25T22:41:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623079+0000", 2024-04-25T22:41:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4093e-05 2024-04-25T22:41:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624384+0000", 2024-04-25T22:41:10.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013054539999999999 2024-04-25T22:41:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624421+0000", 2024-04-25T22:41:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7088999999999997e-05 2024-04-25T22:41:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629645+0000", 2024-04-25T22:41:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052241400000000004 2024-04-25T22:41:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629728+0000", 2024-04-25T22:41:10.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2482000000000001e-05 2024-04-25T22:41:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2024-04-25T22:41:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.480908118000002, 2024-04-25T22:41:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078029559999999998, 2024-04-25T22:41:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623106+0000", 2024-04-25T22:41:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.64e-07 2024-04-25T22:41:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623141+0000", 2024-04-25T22:41:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4678999999999998e-05 2024-04-25T22:41:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623153+0000", 2024-04-25T22:41:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1759999999999999e-05 2024-04-25T22:41:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623161+0000", 2024-04-25T22:41:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8299999999999996e-06 2024-04-25T22:41:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623834+0000", 2024-04-25T22:41:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067394500000000001 2024-04-25T22:41:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623883+0000", 2024-04-25T22:41:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8640000000000002e-05 2024-04-25T22:41:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630807+0000", 2024-04-25T22:41:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069238859999999998 2024-04-25T22:41:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:10.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630908+0000", 2024-04-25T22:41:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101252 2024-04-25T22:41:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:10.192 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:10.192 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:10.193 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:10.194 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:10.194+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:10.295 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:10.295+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:10.325 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:10.325 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:10.325 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:10.325 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:10.339 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:10.395 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:10.394+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:10.456 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:10.456 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:10.456 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:10.456 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:10.456 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:10.471 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:10.496 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:10.495+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:10.513 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:41:10.596 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:10.596 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:10.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:10.596 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:10.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.597 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:10.597 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:10.597 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 56.000342148000001, 2024-04-25T22:41:10.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:10.597 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:10.597 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:10.597 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.597 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:10.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:10.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:10.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:10.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:10.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:10.598 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:10.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:10.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:10.598 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:10.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:10.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:10.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:10.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:10.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:10.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:10.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:10.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:10.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:10.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:10.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:10.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:10.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:10.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:10.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:10.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:10.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:10.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:10.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:10.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:10.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:10.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:10.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:10.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:10.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:10.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:10.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:10.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:10.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:10.602 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:10.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:10.602 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.602 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.602 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.602 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:10.602 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:10.602 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 56.000204891999999, 2024-04-25T22:41:10.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:10.603 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:10.603 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:10.603 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.603 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:10.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:10.603 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:10.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:10.603 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:10.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:10.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:10.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:10.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:10.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:10.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:10.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:10.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:10.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:10.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:10.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:10.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.605 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:10.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:10.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.605 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:10.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:10.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:10.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.605 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:10.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:10.606 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.606 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:10.606 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:10.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:10.606 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.606 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:10.606 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:10.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:10.606 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.606 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:10.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:10.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:10.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:10.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:10.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:10.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:10.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:10.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:10.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:10.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:10.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:10.608 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.608 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.608 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.608 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:10.608 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:10.608 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 56.000117340000003, 2024-04-25T22:41:10.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:10.608 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:10.608 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:10.608 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.608 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:10.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.609 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:10.609 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:10.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.609 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.609 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:10.609 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:10.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.609 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.609 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:10.609 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:10.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:10.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.610 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.610 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:10.610 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:10.610 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:10.610 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.610 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.610 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:10.610 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:10.610 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:10.610 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.610 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.610 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.610 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:10.610 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:10.610 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:10.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:10.611 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:10.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:10.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:10.611 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:10.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:10.611 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.612 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:10.612 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:10.612 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:10.612 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.612 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.612 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:10.612 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:10.612 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:10.612 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.612 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.612 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:10.612 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:10.612 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:10.612 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.612 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.613 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:10.613 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:10.613 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:10.613 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.613 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.613 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:10.613 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:10.613 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:10.613 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.613 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.613 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:10.613 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:10.613 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:10.613 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.613 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.613 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.614 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.614 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:10.614 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:10.614 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 56.000013514000003, 2024-04-25T22:41:10.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:10.614 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:10.614 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:10.614 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.614 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:10.614 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:10.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:10.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.615 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:10.615 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:10.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.615 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:10.615 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:10.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:10.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.615 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:10.615 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:10.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:10.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.616 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.616 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:10.616 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:10.616 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:10.616 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.616 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.616 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.616 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:10.616 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:10.616 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.616 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.616 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.616 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:10.616 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:10.616 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.617 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:10.617 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:10.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:10.617 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.617 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.617 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:10.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:10.617 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.617 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:10.617 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:10.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:10.617 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:10.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:10.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:10.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:10.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:10.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:10.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:10.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:10.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:10.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:10.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:10.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:10.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:10.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:10.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:10.619 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.619 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.619 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.620 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:10.620 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:10.620 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 55.999944724000002, 2024-04-25T22:41:10.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:10.620 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:10.620 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:10.620 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.620 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:10.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:10.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:10.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:10.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:10.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:10.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:10.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:10.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:10.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:10.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:10.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:10.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:10.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:10.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:10.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:10.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:10.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:10.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.623 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:10.623 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:10.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:10.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.623 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.623 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:10.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:10.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.623 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:10.623 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:10.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:10.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:10.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:10.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:10.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:10.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:10.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:10.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:10.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:10.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:10.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:10.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:10.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:10.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:10.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:10.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:10.625 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.625 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.625 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.626 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:10.626 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:10.626 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 55.999875637999999, 2024-04-25T22:41:10.626 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:10.626 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:10.626 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:10.626 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.626 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:10.626 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.626 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:10.626 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:10.626 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.626 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.626 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.626 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:10.627 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:10.627 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.627 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.627 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.627 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:10.627 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:10.627 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:10.627 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.627 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.627 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:10.627 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:10.627 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:10.627 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.627 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.627 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:10.627 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:10.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:10.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.628 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.628 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:10.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:10.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.628 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.628 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:10.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:10.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.628 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:10.628 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:10.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:10.629 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.629 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.629 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.629 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:10.629 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:10.629 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.629 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.629 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:10.629 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:10.629 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:10.629 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.629 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.629 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:10.629 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:10.629 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:10.630 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.630 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.630 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:10.630 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:10.630 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:10.630 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.630 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.630 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:10.630 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:10.630 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:10.630 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.630 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.630 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:10.630 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:10.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:10.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:10.631 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:10.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:10.631 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.631 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.631 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.631 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:10.631 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:10.631 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 55.999779525000001, 2024-04-25T22:41:10.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:10.632 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:10.632 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:10.632 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:10.632 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:10.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.632 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:10.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:10.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.632 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.632 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:10.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:10.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.632 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.632 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:10.633 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:10.633 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:10.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.633 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.633 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:10.633 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:10.633 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:10.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.633 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.633 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:10.633 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:10.633 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:10.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.633 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.633 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.633 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:10.634 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:10.634 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.634 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.634 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.634 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:10.634 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:10.634 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.634 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.634 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:10.634 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:10.634 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:10.634 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.634 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.634 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.634 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:10.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:10.635 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.635 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:10.635 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:10.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:10.635 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.635 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:10.635 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:10.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:10.635 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.635 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.635 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.635 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.636 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:10.636 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:10.636 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 55.999713862999997, 2024-04-25T22:41:10.636 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:10.636 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:10.636 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:10.636 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:10.636 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:10.636 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.636 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:10.636 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:10.636 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.636 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.636 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.636 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:10.636 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:10.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:10.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:10.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:10.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:10.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:10.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:10.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:10.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:10.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:10.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.638 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:10.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:10.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.638 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:10.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:10.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:10.638 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:10.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:10.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:10.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:10.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:10.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:10.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:10.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:10.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:10.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:10.640 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.640 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.640 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.640 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.640 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:10.640 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:10.640 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 55.999644736, 2024-04-25T22:41:10.640 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:10.640 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:10.640 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:10.640 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:10.640 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:10.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.640 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:10.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:10.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:10.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:10.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:10.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:10.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:10.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:10.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:10.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:10.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:10.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:10.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:10.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:10.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:10.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:10.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:10.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:10.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:10.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:10.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:10.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:10.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:10.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:10.644 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:10.644 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.644 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:10.644 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:10.644 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:10.644 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.644 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.644 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.644 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.644 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:10.644 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:10.644 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 55.988828079999998, 2024-04-25T22:41:10.644 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:10.644 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:10.644 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:10.645 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:10.645 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:10.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.645 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:10.645 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:10.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.645 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:10.645 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:10.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.645 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:10.645 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:10.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:10.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.646 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:10.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:10.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:10.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.646 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:10.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:10.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:10.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.646 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:10.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:10.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:10.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:10.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:10.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:10.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:10.647 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.647 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.647 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.648 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:10.648 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:10.648 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 55.971929727000003, 2024-04-25T22:41:10.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:10.648 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:10.648 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:10.648 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:10.648 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:10.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.648 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:10.648 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:10.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.648 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.648 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:10.648 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:10.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:10.649 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:10.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:10.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:10.649 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:10.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:10.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:10.649 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:10.650 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:10.650 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.650 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.650 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.650 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:10.650 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:10.650 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.650 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.650 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.650 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:10.650 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:10.650 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.650 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.651 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:10.651 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:10.651 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:10.651 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.651 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.651 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:10.651 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:10.651 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:10.651 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.651 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.651 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.651 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.651 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.651 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:10.651 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:10.651 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 55.971108837000003, 2024-04-25T22:41:10.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:10.652 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:10.652 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:10.652 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:10.652 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:10.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:10.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:10.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.652 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:10.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:10.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.652 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:10.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:10.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:10.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:10.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:10.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:10.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:10.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:10.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:10.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:10.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:10.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:10.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:10.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:10.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:10.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:10.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:10.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:10.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:10.655 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.655 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.655 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.655 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:10.655 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:10.655 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 55.969408109, 2024-04-25T22:41:10.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:10.655 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:10.655 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:10.655 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.655 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:10.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:10.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:10.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:10.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:10.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:10.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:10.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:10.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.657 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:10.657 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:10.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:10.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.657 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:10.657 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:10.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:10.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.657 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.657 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:10.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:10.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.657 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:10.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:10.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:10.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:10.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:10.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:10.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:10.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:10.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:10.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:10.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:10.659 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.659 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.659 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.659 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:10.659 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:10.659 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 55.968811434000003, 2024-04-25T22:41:10.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:10.659 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:10.659 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:10.659 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.660 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:10.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:10.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:10.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.660 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:10.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:10.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.660 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:10.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:10.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:10.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:10.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:10.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:10.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:10.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:10.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:10.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:10.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:10.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.662 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.662 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:10.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:10.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.662 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:10.662 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:10.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:10.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.662 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:10.663 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:10.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:10.663 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.663 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:10.663 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:10.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:10.663 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.663 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.663 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.663 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.663 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:10.663 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:10.664 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 55.959375708000003, 2024-04-25T22:41:10.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:10.664 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:10.664 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:10.664 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:10.664 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:10.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:10.664 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:10.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.664 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:10.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:10.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:10.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:10.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:10.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:10.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:10.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:10.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:10.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:10.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:10.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:10.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:10.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:10.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:10.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:10.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:10.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:10.667 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.667 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.667 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.667 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:10.667 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:10.667 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 55.958728282000003, 2024-04-25T22:41:10.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:10.667 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:10.667 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:10.667 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.667 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:10.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.668 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:10.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:10.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.668 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:10.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:10.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.668 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:10.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:10.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:10.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:10.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:10.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:10.669 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:10.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:10.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:10.669 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:10.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:10.669 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.670 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.670 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.670 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:10.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:10.670 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.670 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.670 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:10.670 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:10.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:10.670 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.670 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.670 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:10.670 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:10.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:10.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:10.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:10.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:10.671 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.671 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.671 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.671 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:10.671 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:10.671 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 55.957287463, 2024-04-25T22:41:10.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:10.672 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:10.672 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:10.672 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.672 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:10.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:10.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:10.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:10.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:10.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:10.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:10.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:10.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:10.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:10.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:10.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:10.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:10.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:10.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:10.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:10.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:10.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:10.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:10.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:10.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:10.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.675 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:10.675 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:10.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:10.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.675 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:10.675 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:10.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:10.675 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.675 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.675 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.675 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:10.676 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:10.676 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 54.004849018999998, 2024-04-25T22:41:10.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:10.676 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:10.676 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:10.676 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.676 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:10.676 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.676 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:10.676 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:10.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.676 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.676 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.676 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:10.676 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:10.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.677 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:10.677 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:10.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:10.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.677 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:10.677 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:10.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:10.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.677 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:10.677 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:10.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:10.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:10.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:10.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:10.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:10.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:10.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:10.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:10.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:10.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:10.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:10.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:10.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:10.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:10.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:10.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:10.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:10.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:10.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:10.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:10.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:10.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:10.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:10.680 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.680 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.680 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.681 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:10.681 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:10.681 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 32.002189694999998, 2024-04-25T22:41:10.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:10.681 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:10.681 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:10.681 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.681 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:10.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.681 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:10.681 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:10.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.681 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:10.681 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:10.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:10.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:10.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:10.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:10.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:10.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:10.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:10.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:10.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:10.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.683 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:10.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:10.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.683 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:10.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:10.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.683 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:10.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:10.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:10.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.684 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.684 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:10.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:10.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:10.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.684 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.684 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:10.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:10.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:10.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.684 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.684 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:10.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:10.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:10.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:10.685 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:10.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:10.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:10.685 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:10.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:10.685 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.685 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.685 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.685 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:10.686 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:10.686 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.001897444000001, 2024-04-25T22:41:10.686 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:10.686 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:10.686 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:10.686 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:10.686 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:10.686 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.686 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:10.686 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:10.686 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.686 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.686 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.686 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:10.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:10.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:10.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:10.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:10.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:10.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:10.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:10.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:10.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:10.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:10.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:10.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:10.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:10.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:10.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:10.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:10.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:10.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:10.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:10.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:10.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:10.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:10.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:10.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:10.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:10.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:10.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:10.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:10.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:10.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.690 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:10.690 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:10.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:10.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:10.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:10.690 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:10.690 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:10.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:10.690 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.690 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.690 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.690 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:10.690 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:10.690 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:10.691 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:10.691 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:10.598+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:10.692 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:10.692 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:10.695 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:41:10.695 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:41:10.696 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:10.693+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:10.973 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:41:10.975 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:10.975 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:10.976 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:10.976 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:10.976 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:10.977 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:10.973+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:11.075 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:11.073+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:11.102 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:11.102 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:11.117 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:11.176 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:11.175+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:11.237 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:11.237 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:11.251 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:41:11.295 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:11.295+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:11.378 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:11.377+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:11.383 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:11.383 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:11.397 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:41:11.483 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:11.483+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:11.557 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:11.557 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:11.571 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:41:11.578 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:11.578+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:11.680 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:11.678+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:11.737 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:11.737 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:11.751 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:11.781 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:11.779+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:11.782 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is set 2024-04-25T22:41:11.881 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:11.883+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:11.883 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:11.884 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:11.898 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:11.982 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:11.981+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:12.016 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:12.016 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:12.031 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:12.083 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:12.082+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:12.184 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:12.181+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:12.199 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:12.199 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:12.213 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:12.285 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:12.281+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:12.343 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:12.343 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:12.357 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:12.400 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:12.402+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:12.472 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:12.473 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:12.486 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:12.487 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:12.482+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:12.587 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:12.586+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:12.647 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:12.647 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:12.661 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:41:12.688 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:12.686+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:12.789 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:12.785+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:12.792 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:12.792 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:12.807 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:41:12.890 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:12.889+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:12.933 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:12.933 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:12.949 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:41:12.977 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:41:12.991 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:12.990+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:13.072 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:13.072 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:13.086 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:13.092 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:13.090+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:13.128 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:13.128 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:13.149 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:41:13.149 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:41:13.168 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:13.168 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:13.172 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:41:13.172 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:41:13.172 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-04-25T22:41:13.172 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-04-25T22:41:13.192 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:13.194+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:13.216 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:13.216 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:13.216 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:13.216 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:13.230 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:13.293 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:13.290+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:13.331 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-04-25T22:41:13.346 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:13.346 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:13.347 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:13.347 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:13.347 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:13.361 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:13.394 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:13.390+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:13.482 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-04-25T22:41:13.488 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:13.488 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:13.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:13.489 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:13.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.489 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:13.489 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:13.489 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.890814497999997, 2024-04-25T22:41:13.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:13.489 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:13.489 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:13.489 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:13.489 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:13.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:13.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:13.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:13.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:13.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:13.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:13.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:13.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:13.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:13.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:13.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:13.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:13.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:13.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:13.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:13.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:13.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:13.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:13.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:13.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:13.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:13.493 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.493 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.493 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:13.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:13.493 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.493 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:13.493 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:13.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:13.493 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.494 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.494 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:13.494 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:13.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:13.494 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.494 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.494 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:13.494 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:13.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:13.494 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.494 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:13.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:13.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:13.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:13.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:13.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:13.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:13.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:13.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:13.496 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.496 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.496 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.496 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:13.496 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:13.496 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.890677242000002, 2024-04-25T22:41:13.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:13.496 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:13.496 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:13.496 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:13.496 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:13.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:13.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:13.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:13.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:13.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:13.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:13.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:13.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:13.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:13.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:13.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:13.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:13.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:13.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:13.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:13.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:13.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:13.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:13.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:13.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:13.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:13.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.500 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.500 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:13.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:13.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.500 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:13.500 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:13.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:13.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.500 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:13.500 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:13.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:13.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:13.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:13.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:13.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:13.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:13.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:13.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:13.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:13.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:13.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:13.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:13.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:13.502 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.502 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.502 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.502 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:13.502 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:13.502 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.890589689999999, 2024-04-25T22:41:13.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:13.503 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:13.503 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:13.503 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:13.503 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:13.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:13.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:13.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:13.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:13.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:13.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:13.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:13.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:13.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:13.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:13.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:13.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:13.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:13.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.505 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:13.505 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:13.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:13.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.505 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.505 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:13.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:13.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:13.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:13.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:13.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:13.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:13.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:13.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:13.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:13.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:13.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:13.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:13.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:13.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:13.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:13.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:13.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:13.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:13.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:13.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:13.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:13.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:13.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:13.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:13.508 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.508 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.509 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.509 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:13.509 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:13.509 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.890485863999999, 2024-04-25T22:41:13.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:13.509 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:13.509 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:13.509 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:13.509 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:13.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:13.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:13.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:13.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:13.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:13.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:13.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:13.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:13.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:13.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:13.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:13.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:13.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:13.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:13.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:13.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:13.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:13.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:13.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:13.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:13.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:13.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:13.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:13.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:13.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:13.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:13.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:13.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:13.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:13.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:13.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:13.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:13.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:13.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:13.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:13.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:13.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:13.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:13.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:13.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:13.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:13.515 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.515 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.515 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.515 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:13.515 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:13.515 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.890417073999998, 2024-04-25T22:41:13.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:13.515 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:13.516 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:13.516 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:13.516 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:13.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:13.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:13.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:13.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:13.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:13.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:13.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:13.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:13.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:13.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:13.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:13.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:13.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:13.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:13.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:13.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:13.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:13.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:13.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:13.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:13.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:13.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:13.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:13.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:13.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:13.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:13.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:13.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:13.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:13.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:13.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:13.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:13.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:13.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:13.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:13.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:13.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:13.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:13.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:13.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:13.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:13.521 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.522 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.522 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.522 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:13.522 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:13.522 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.890347988000002, 2024-04-25T22:41:13.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:13.522 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:13.522 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:13.522 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:13.522 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:13.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:13.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:13.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:13.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:13.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:13.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:13.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:13.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:13.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:13.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:13.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:13.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:13.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:13.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:13.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:13.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:13.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:13.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:13.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:13.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:13.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:13.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:13.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:13.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:13.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:13.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:13.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:13.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:13.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:13.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:13.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:13.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:13.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:13.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:13.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:13.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:13.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:13.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:13.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:13.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:13.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:13.527 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.528 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.528 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.528 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:13.528 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:13.528 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.890251874999997, 2024-04-25T22:41:13.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:13.528 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:13.528 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:13.528 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:13.528 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:13.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:13.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:13.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:13.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:13.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:13.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:13.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:13.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:13.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:13.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:13.530 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:13.530 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:13.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:13.530 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:13.530 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:13.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:13.530 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:13.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:13.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:13.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:13.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:13.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:13.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:13.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:13.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:13.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:13.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:13.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:13.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:13.532 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.532 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.532 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.532 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:13.532 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:13.533 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.890186213, 2024-04-25T22:41:13.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:13.533 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:13.533 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:13.533 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:13.533 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:13.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:13.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:13.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:13.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:13.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:13.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:13.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:13.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:13.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:13.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:13.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:13.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:13.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:13.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:13.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:13.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:13.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:13.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:13.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:13.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:13.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:13.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:13.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:13.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:13.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:13.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:13.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:13.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:13.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:13.537 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.537 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.537 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.537 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:13.538 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:13.538 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.890117085999997, 2024-04-25T22:41:13.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:13.538 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:13.538 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:13.538 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:13.538 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:13.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:13.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:13.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:13.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:13.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:13.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:13.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:13.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:13.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:13.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:13.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:13.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:13.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:13.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:13.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:13.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:13.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:13.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:13.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:13.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:13.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:13.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:13.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:13.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:13.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:13.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:13.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:13.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:13.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:13.542 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.542 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.542 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.542 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:13.542 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:13.542 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.879300430000001, 2024-04-25T22:41:13.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:13.542 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:13.542 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:13.542 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:13.543 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:13.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:13.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:13.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:13.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:13.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:13.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:13.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:13.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:13.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:13.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:13.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:13.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:13.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:13.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:13.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:13.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:13.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:13.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:13.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:13.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:13.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:13.545 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.545 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.545 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.546 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:13.546 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:13.546 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.862402076999999, 2024-04-25T22:41:13.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:13.546 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:13.546 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:13.546 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:13.546 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:13.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:13.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:13.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:13.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:13.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:13.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:13.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:13.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:13.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:13.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:13.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:13.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:13.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:13.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:13.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:13.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:13.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:13.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:13.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:13.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:13.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:13.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:13.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:13.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:13.549 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.549 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.549 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.550 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:13.550 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:13.550 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.861581186999999, 2024-04-25T22:41:13.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:13.550 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:13.550 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:13.550 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:13.550 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:13.550 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.550 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:13.550 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:13.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.550 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.550 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:13.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:13.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:13.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:13.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:13.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:13.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:13.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:13.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:13.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:13.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:13.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:13.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:13.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:13.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:13.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:13.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:13.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:13.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:13.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:13.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:13.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:13.553 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.553 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.553 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.553 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:13.553 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:13.554 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.859880459000003, 2024-04-25T22:41:13.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:13.554 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:13.554 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:13.554 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:13.554 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:13.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:13.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:13.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:13.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:13.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:13.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:13.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:13.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:13.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:13.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:13.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:13.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:13.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:13.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:13.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:13.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:13.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:13.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:13.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:13.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:13.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:13.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:13.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:13.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:13.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:13.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:13.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:13.557 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.557 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.557 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.558 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:13.558 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:13.558 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.859283783999999, 2024-04-25T22:41:13.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:13.558 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:13.558 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:13.558 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:13.558 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:13.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:13.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:13.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:13.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:13.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:13.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:13.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:13.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:13.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:13.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:13.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:13.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:13.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:13.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:13.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:13.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:13.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:13.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:13.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:13.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:13.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:13.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:13.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:13.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:13.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:13.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:13.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:13.562 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.562 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.562 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.562 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:13.562 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:13.562 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.849848057999999, 2024-04-25T22:41:13.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:13.562 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:13.562 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:13.562 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:13.562 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:13.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:13.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:13.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:13.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:13.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:13.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:13.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:13.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:13.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:13.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:13.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:13.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:13.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:13.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:13.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:13.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:13.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:13.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:13.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:13.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:13.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:13.565 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.565 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.565 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.565 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:13.566 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:13.566 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.849200631999999, 2024-04-25T22:41:13.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:13.566 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:13.566 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:13.566 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:13.566 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:13.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:13.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:13.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:13.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:13.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:13.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:13.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:13.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:13.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:13.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:13.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:13.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:13.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:13.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:13.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:13.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:13.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:13.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:13.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:13.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:13.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:13.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:13.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:13.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:13.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:13.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:13.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:13.569 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.569 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.569 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.570 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:13.570 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:13.570 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.847759813000003, 2024-04-25T22:41:13.570 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:13.570 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:13.570 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:13.570 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:13.570 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:13.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.570 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:13.570 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:13.570 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.570 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:13.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:13.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:13.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:13.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:13.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:13.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:13.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:13.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:13.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:13.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:13.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:13.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:13.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:13.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:13.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:13.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:13.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:13.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:13.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:13.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:13.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:13.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:13.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:13.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:13.573 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.574 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.574 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.574 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.574 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:13.574 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:13.574 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 56.895321369000001, 2024-04-25T22:41:13.574 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:13.574 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:13.574 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:13.574 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:13.574 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:13.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.574 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:13.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:13.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:13.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:13.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:13.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:13.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:13.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:13.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:13.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:13.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:13.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:13.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:13.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:13.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:13.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:13.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:13.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:13.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:13.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:13.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:13.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:13.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:13.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:13.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:13.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:13.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:13.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:13.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:13.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:13.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:13.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:13.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:13.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:13.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:13.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:13.579 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.579 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.579 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.579 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:13.579 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:13.579 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 34.892662045000002, 2024-04-25T22:41:13.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:13.579 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:13.579 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:13.579 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:13.579 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:13.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:13.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:13.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:13.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:13.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:13.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:13.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:13.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:13.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:13.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:13.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:13.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:13.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:13.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:13.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:13.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:13.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:13.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:13.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:13.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:13.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:13.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:13.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:13.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:13.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:13.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:13.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:13.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:13.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:13.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:13.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:13.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:13.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:13.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:13.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:13.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:13.584 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.584 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.584 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.584 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:13.584 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:13.584 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.892369794, 2024-04-25T22:41:13.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:13.585 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:13.585 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:13.585 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:13.585 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:13.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:13.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:13.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:13.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:13.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:13.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.586 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:13.586 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:13.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:13.586 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.586 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:13.586 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:13.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:13.586 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.586 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:13.586 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:13.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:13.586 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:13.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:13.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:13.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:13.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:13.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:13.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:13.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:13.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:13.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:13.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:13.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:13.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:13.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:13.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:13.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:13.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:13.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:13.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:13.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:13.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:13.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:13.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:13.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:13.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:13.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:13.589 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.589 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.589 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.589 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:13.589 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:13.589 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:13.591 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:13.589+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:13.591 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:13.691 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:13.690+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:13.724 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:13.724 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:13.724 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:41:13.724 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:13.738 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:13.792 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:13.789+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:13.804 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:41:13.893 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:13.890+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:13.904 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:13.904 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:13.904 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:13.904 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:13.904 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:13.918 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:13.995 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:13.990+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:14.043 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:14.044 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:41:14.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:41:14.044 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:41:14.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.044 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.044 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:14.044 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.446317630999999, 2024-04-25T22:41:14.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:41:14.045 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:14.045 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:14.045 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.045 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:14.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:14.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:14.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:14.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:14.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:14.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:41:14.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:41:14.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:14.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:41:14.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:41:14.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:14.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:41:14.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:41:14.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:41:14.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:41:14.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:41:14.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:41:14.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:14.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:41:14.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:41:14.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:41:14.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:41:14.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:14.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:41:14.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:41:14.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:14.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:41:14.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:41:14.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:41:14.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:41:14.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:14.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:41:14.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:41:14.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:14.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:41:14.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:41:14.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:14.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:41:14.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:41:14.052 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.052 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.052 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.052 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.053 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:14.053 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.446229617999997, 2024-04-25T22:41:14.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:41:14.053 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:14.053 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:14.053 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.053 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:14.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:14.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:14.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:14.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:14.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:14.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:41:14.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:41:14.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:14.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:14.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:41:14.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:14.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:41:14.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:41:14.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:41:14.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:41:14.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:41:14.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:41:14.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:14.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:14.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:41:14.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:41:14.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:41:14.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:14.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:41:14.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:41:14.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:14.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:41:14.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:41:14.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:14.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:41:14.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:41:14.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:41:14.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:41:14.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:14.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:41:14.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:41:14.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:14.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:41:14.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:41:14.061 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.061 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.061 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.061 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.061 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:14.061 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.446157495999998, 2024-04-25T22:41:14.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:41:14.061 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:14.061 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:14.061 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.061 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:14.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:14.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:14.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:14.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:14.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:14.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:41:14.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:41:14.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:14.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:41:14.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:41:14.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:14.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:41:14.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:41:14.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:41:14.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:41:14.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:41:14.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:41:14.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:14.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:41:14.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:41:14.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:41:14.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:41:14.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:14.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:41:14.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:41:14.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:14.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:41:14.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:41:14.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:41:14.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:41:14.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:14.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:41:14.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:41:14.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:14.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:41:14.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:41:14.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:14.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:41:14.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:41:14.071 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.071 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.071 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.071 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.071 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:14.071 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.446049183, 2024-04-25T22:41:14.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:41:14.072 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:14.072 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:14.072 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.072 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:14.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:14.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:14.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:14.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:14.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:14.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:41:14.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:41:14.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:14.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:41:14.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:41:14.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:14.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:41:14.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:41:14.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:41:14.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:41:14.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:41:14.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:41:14.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:14.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:41:14.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:41:14.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:41:14.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:41:14.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:14.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:41:14.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:41:14.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:14.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:41:14.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:41:14.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:41:14.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:41:14.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:14.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:41:14.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:41:14.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:14.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:41:14.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:41:14.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:14.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:41:14.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:41:14.078 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.078 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.078 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.078 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.078 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:14.078 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.445982526999998, 2024-04-25T22:41:14.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:41:14.078 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:14.079 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:14.079 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.079 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:14.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:14.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:14.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:14.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:14.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:14.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:41:14.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:41:14.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:14.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:41:14.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:41:14.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:14.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:41:14.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:41:14.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:41:14.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:41:14.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:41:14.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:41:14.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:14.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:41:14.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:41:14.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:41:14.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:41:14.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:14.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:41:14.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:41:14.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:14.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:41:14.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:41:14.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:41:14.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:41:14.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:14.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:41:14.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:41:14.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:14.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:41:14.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:41:14.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:14.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:41:14.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:41:14.085 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.085 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.085 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.086 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.086 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:14.086 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.445891930999998, 2024-04-25T22:41:14.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:41:14.086 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:14.086 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:14.086 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.086 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:14.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:14.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:14.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:14.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:14.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:14.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:41:14.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:41:14.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:14.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:41:14.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:41:14.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:14.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:41:14.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:41:14.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:41:14.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:41:14.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:41:14.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:41:14.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:14.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:41:14.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:41:14.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:41:14.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:41:14.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:14.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:41:14.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:41:14.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:14.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:41:14.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:41:14.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:14.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:41:14.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:41:14.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:41:14.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:41:14.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:14.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:41:14.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:41:14.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:14.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:41:14.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:41:14.094 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.094 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.094 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.094 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.094 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:14.095 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.445827358000003, 2024-04-25T22:41:14.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:41:14.095 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:14.095 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:14.095 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.095 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:14.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:14.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:14.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:14.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:14.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:14.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:41:14.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:41:14.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:14.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:41:14.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:41:14.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:14.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:41:14.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:41:14.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:41:14.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:41:14.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:14.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:41:14.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:14.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:41:14.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:41:14.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:41:14.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:41:14.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:14.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:41:14.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:41:14.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:14.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:41:14.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:41:14.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:41:14.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:41:14.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:14.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:41:14.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:41:14.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:14.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:41:14.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:41:14.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:14.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:41:14.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:41:14.102 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.102 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.102 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.102 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.102 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:14.102 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.445761935, 2024-04-25T22:41:14.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:41:14.103 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:14.103 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:14.103 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.103 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:14.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:14.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:14.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:14.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:14.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:14.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:41:14.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:14.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:14.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:41:14.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:41:14.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:14.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:41:14.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:41:14.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:41:14.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:41:14.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:41:14.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:41:14.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:14.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:41:14.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:41:14.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:41:14.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:41:14.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:14.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:41:14.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:41:14.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:14.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:41:14.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:41:14.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:14.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:41:14.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:41:14.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:41:14.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:41:14.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:14.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:41:14.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:41:14.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:14.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:41:14.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:41:14.109 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.109 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.109 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.109 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.109 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:14.109 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.445705869000001, 2024-04-25T22:41:14.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:41:14.109 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:14.109 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:14.109 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.110 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:14.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:14.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:14.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:14.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:14.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:14.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:14.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:41:14.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:14.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:41:14.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:41:14.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:14.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:41:14.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:41:14.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:41:14.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:41:14.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:41:14.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:41:14.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:14.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:41:14.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:41:14.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:41:14.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:41:14.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:14.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:41:14.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:41:14.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:14.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:41:14.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:41:14.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:41:14.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:41:14.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:14.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:41:14.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:41:14.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:14.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:41:14.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:41:14.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:14.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:41:14.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:41:14.116 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.116 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.116 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.116 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.116 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:14.117 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.445638762999998, 2024-04-25T22:41:14.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:41:14.117 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:14.117 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:14.117 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.117 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:14.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:14.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:14.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:14.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:14.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:14.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:41:14.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:41:14.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:14.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:41:14.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:41:14.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:14.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:41:14.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:41:14.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:41:14.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:41:14.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:41:14.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:41:14.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:14.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:41:14.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:41:14.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:41:14.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:41:14.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:14.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:41:14.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:41:14.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:14.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:41:14.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:41:14.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:41:14.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:41:14.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:14.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:41:14.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:41:14.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:14.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:41:14.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:41:14.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:14.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:41:14.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:41:14.124 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.124 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.124 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.124 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.124 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:14.125 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.445583640000002, 2024-04-25T22:41:14.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:41:14.125 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:14.125 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:14.125 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.125 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:14.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:14.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:14.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:14.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:14.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:14.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:41:14.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:14.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:14.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:41:14.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:41:14.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:14.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:41:14.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:41:14.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:41:14.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:41:14.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:41:14.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:41:14.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:14.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:41:14.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:41:14.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:41:14.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:41:14.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:14.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:41:14.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:41:14.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:14.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:41:14.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:41:14.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:41:14.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:41:14.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:14.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:41:14.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:41:14.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:14.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:41:14.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:41:14.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:14.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:41:14.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:41:14.132 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.132 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.132 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.132 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.132 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:14.132 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.445481401000002, 2024-04-25T22:41:14.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:41:14.133 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:14.133 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:14.133 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.133 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:14.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:14.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:14.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:14.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:14.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:14.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:41:14.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:41:14.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:14.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:41:14.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:41:14.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:14.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:41:14.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:41:14.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:41:14.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:41:14.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:41:14.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:41:14.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:14.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:41:14.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:41:14.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:41:14.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:41:14.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:14.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:41:14.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:41:14.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:14.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:41:14.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:41:14.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:41:14.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:41:14.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:14.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:41:14.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:41:14.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:14.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:41:14.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:41:14.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:14.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:41:14.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:41:14.140 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.140 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.140 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.140 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.140 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:14.141 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.445422577999999, 2024-04-25T22:41:14.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:41:14.141 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:14.141 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:14.141 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.141 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:14.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:14.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:14.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:14.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:14.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:14.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:41:14.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:41:14.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:14.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:41:14.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:41:14.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:14.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:41:14.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:41:14.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:41:14.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:41:14.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:41:14.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:41:14.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:14.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:41:14.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:41:14.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:41:14.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:41:14.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:14.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:41:14.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:41:14.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:14.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:41:14.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:41:14.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:14.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:41:14.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:41:14.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:41:14.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:41:14.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:14.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:41:14.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:41:14.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:14.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:41:14.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:41:14.147 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.147 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.147 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.148 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.148 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:14.148 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.445343844999996, 2024-04-25T22:41:14.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:41:14.148 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:14.148 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:14.148 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.148 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:14.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:14.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:14.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:14.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:14.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:14.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:41:14.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:14.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:14.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:41:14.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:41:14.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:14.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:41:14.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:41:14.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:41:14.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:41:14.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:41:14.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:41:14.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:14.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:41:14.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:41:14.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:41:14.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:41:14.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:14.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:41:14.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:41:14.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:14.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:41:14.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:41:14.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:14.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:41:14.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:41:14.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:41:14.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:41:14.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:14.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:41:14.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:41:14.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:14.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:41:14.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:41:14.155 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.155 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.155 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.156 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.156 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:14.156 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.445304432, 2024-04-25T22:41:14.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:41:14.156 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:14.156 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:14.156 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.156 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:14.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:14.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:14.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:14.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:14.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:14.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:41:14.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:41:14.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:14.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:41:14.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:41:14.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:14.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:41:14.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:41:14.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:41:14.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:41:14.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:41:14.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:41:14.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:14.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:41:14.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:41:14.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:41:14.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:41:14.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:14.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:41:14.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:41:14.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:14.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:41:14.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:41:14.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:41:14.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:41:14.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:14.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:41:14.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:41:14.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:14.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:41:14.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:41:14.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:14.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:41:14.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:41:14.164 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.164 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.164 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.164 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.164 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:14.164 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.445234585999998, 2024-04-25T22:41:14.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:41:14.164 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:14.164 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:14.164 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.165 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:14.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:14.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:14.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:14.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:14.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:14.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:41:14.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:41:14.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:14.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:41:14.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:41:14.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:14.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:41:14.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:41:14.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:41:14.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:41:14.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:41:14.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:41:14.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:14.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:41:14.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:41:14.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:41:14.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:41:14.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:14.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:41:14.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:41:14.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:14.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:41:14.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:41:14.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:41:14.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:41:14.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:14.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:41:14.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:41:14.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:14.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:41:14.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:41:14.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:14.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:41:14.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:41:14.171 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.171 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.172 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.172 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.172 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:14.172 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.445184849, 2024-04-25T22:41:14.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:41:14.172 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:14.172 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:14.172 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.172 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:14.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:14.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:14.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:14.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:14.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:14.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:41:14.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:14.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:14.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:41:14.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:41:14.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:14.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:41:14.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:41:14.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:41:14.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:41:14.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:41:14.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:41:14.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:14.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:41:14.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:41:14.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:41:14.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:41:14.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:14.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:41:14.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:41:14.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:14.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:41:14.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:41:14.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:14.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:41:14.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:41:14.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:41:14.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:41:14.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:14.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:14.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:41:14.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:14.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:41:14.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:41:14.179 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.179 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.179 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.179 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.179 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:14.179 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.445100234000002, 2024-04-25T22:41:14.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:41:14.179 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:14.179 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:14.179 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.180 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:14.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:14.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:14.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:14.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:14.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:14.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:41:14.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:14.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:14.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:41:14.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:41:14.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:14.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:41:14.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:41:14.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:41:14.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:41:14.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:41:14.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:41:14.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:14.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:41:14.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:41:14.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:41:14.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:41:14.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:14.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:41:14.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:41:14.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:14.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:41:14.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:41:14.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:41:14.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:41:14.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:14.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:41:14.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:41:14.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:14.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:41:14.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:41:14.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:14.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:41:14.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:41:14.186 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.186 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.186 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.186 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.187 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:14.187 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.445036584, 2024-04-25T22:41:14.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:41:14.187 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:14.187 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:14.187 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:41:14.187 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:14.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:14.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:14.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:14.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:14.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:14.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:41:14.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:41:14.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:14.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:41:14.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:41:14.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:14.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:41:14.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:41:14.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:41:14.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:41:14.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:41:14.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:41:14.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:14.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:41:14.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:41:14.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:41:14.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:41:14.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:14.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:41:14.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:41:14.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:14.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:41:14.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:41:14.193 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.193 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.193 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.193 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:14.193 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:14.193 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 59.438033054000002, 2024-04-25T22:41:14.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:41:14.193 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:14.194 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:14.194 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.194 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:14.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:14.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:14.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:14.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:14.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:14.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:14.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:41:14.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:41:14.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:14.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:41:14.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:41:14.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:14.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:41:14.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:41:14.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:41:14.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:41:14.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:14.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:41:14.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:41:14.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:14.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:41:14.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:41:14.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:14.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:41:14.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:41:14.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:14.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:14.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:14.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:41:14.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:41:14.198 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.198 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.199 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.199 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:14.199 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:14.199 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:14.201 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:41:14.201 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:14.198+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:14.301 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:14.301+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:14.332 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:14.332 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:41:14.333 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-04-25T22:41:14.333 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:14.347 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:41:14.402 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:14.398+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:14.464 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:14.464 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:41:14.464 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-04-25T22:41:14.464 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-04-25T22:41:14.464 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:14.478 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:41:14.519 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:14.518+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:14.604 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:14.602+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:14.644 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:14.644 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-04-25T22:41:14.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-04-25T22:41:14.644 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-04-25T22:41:14.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.644 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:111 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'73, mlcod=11'69)", 2024-04-25T22:41:14.644 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:14.644 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.942357060000006, 2024-04-25T22:41:14.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055481899999999997, 2024-04-25T22:41:14.644 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:14.645 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:14.645 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.645 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:14.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:14.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:14.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:14.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:14.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.646 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:14.646 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700271+0000", 2024-04-25T22:41:14.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:41:14.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.646 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:14.646 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700278+0000", 2024-04-25T22:41:14.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-04-25T22:41:14.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:14.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700323+0000", 2024-04-25T22:41:14.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4212999999999998e-05 2024-04-25T22:41:14.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700333+0000", 2024-04-25T22:41:14.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0433e-05 2024-04-25T22:41:14.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:14.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700662+0000", 2024-04-25T22:41:14.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032862800000000003 2024-04-25T22:41:14.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:14.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700692+0000", 2024-04-25T22:41:14.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0395999999999998e-05 2024-04-25T22:41:14.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:14.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705728+0000", 2024-04-25T22:41:14.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050361939999999999 2024-04-25T22:41:14.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:14.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705818+0000", 2024-04-25T22:41:14.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9573000000000005e-05 2024-04-25T22:41:14.649 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.649 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.649 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.649 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-25T22:41:14.649 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:14.649 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.941812208000002, 2024-04-25T22:41:14.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005065501, 2024-04-25T22:41:14.649 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:14.650 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:14.650 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.650 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:14.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:14.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:14.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:14.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:14.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:14.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700816+0000", 2024-04-25T22:41:14.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.24e-06 2024-04-25T22:41:14.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:14.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700914+0000", 2024-04-25T22:41:14.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8057e-05 2024-04-25T22:41:14.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:14.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700931+0000", 2024-04-25T22:41:14.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7745999999999999e-05 2024-04-25T22:41:14.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700941+0000", 2024-04-25T22:41:14.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5699999999999999e-06 2024-04-25T22:41:14.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:14.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701162+0000", 2024-04-25T22:41:14.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000221392 2024-04-25T22:41:14.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:14.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701194+0000", 2024-04-25T22:41:14.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1745999999999997e-05 2024-04-25T22:41:14.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:14.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705821+0000", 2024-04-25T22:41:14.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046269869999999999 2024-04-25T22:41:14.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:14.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705880+0000", 2024-04-25T22:41:14.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8763e-05 2024-04-25T22:41:14.654 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.654 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.654 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.654 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:118 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'80, mlcod=11'78)", 2024-04-25T22:41:14.654 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:14.654 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.934456597999997, 2024-04-25T22:41:14.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047806089999999999, 2024-04-25T22:41:14.654 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:14.655 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:14.655 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.655 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:14.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:14.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:14.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:14.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:14.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:14.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708172+0000", 2024-04-25T22:41:14.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0600000000000002e-06 2024-04-25T22:41:14.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:14.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708291+0000", 2024-04-25T22:41:14.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118892 2024-04-25T22:41:14.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:14.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708320+0000", 2024-04-25T22:41:14.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8822999999999998e-05 2024-04-25T22:41:14.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708337+0000", 2024-04-25T22:41:14.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7586999999999999e-05 2024-04-25T22:41:14.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:14.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708512+0000", 2024-04-25T22:41:14.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017439500000000001 2024-04-25T22:41:14.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:14.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708551+0000", 2024-04-25T22:41:14.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.909e-05 2024-04-25T22:41:14.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:14.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712865+0000", 2024-04-25T22:41:14.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043142069999999996 2024-04-25T22:41:14.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:14.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712951+0000", 2024-04-25T22:41:14.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5555000000000003e-05 2024-04-25T22:41:14.658 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.658 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.658 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.658 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:120 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'82, mlcod=11'78)", 2024-04-25T22:41:14.658 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:14.659 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.933450555999997, 2024-04-25T22:41:14.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047170700000000003, 2024-04-25T22:41:14.659 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:14.659 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:14.659 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.659 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:14.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:14.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:14.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:14.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:14.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:14.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709177+0000", 2024-04-25T22:41:14.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.19e-06 2024-04-25T22:41:14.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:14.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709315+0000", 2024-04-25T22:41:14.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000137429 2024-04-25T22:41:14.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:14.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709341+0000", 2024-04-25T22:41:14.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:41:14.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709353+0000", 2024-04-25T22:41:14.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2027e-05 2024-04-25T22:41:14.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:14.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710040+0000", 2024-04-25T22:41:14.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068710799999999997 2024-04-25T22:41:14.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:14.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710076+0000", 2024-04-25T22:41:14.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5982999999999998e-05 2024-04-25T22:41:14.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:14.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713802+0000", 2024-04-25T22:41:14.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037255750000000001 2024-04-25T22:41:14.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:14.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713893+0000", 2024-04-25T22:41:14.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1201999999999999e-05 2024-04-25T22:41:14.662 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.662 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.662 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.663 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:121 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'83, mlcod=11'78)", 2024-04-25T22:41:14.663 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:14.663 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.932903920000001, 2024-04-25T22:41:14.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0049043919999999996, 2024-04-25T22:41:14.663 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:14.663 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:14.663 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.663 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:14.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:14.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:14.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:14.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:14.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:14.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709724+0000", 2024-04-25T22:41:14.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.483e-06 2024-04-25T22:41:14.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:14.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709872+0000", 2024-04-25T22:41:14.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147446 2024-04-25T22:41:14.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:14.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709891+0000", 2024-04-25T22:41:14.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9245999999999998e-05 2024-04-25T22:41:14.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709900+0000", 2024-04-25T22:41:14.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1439999999999992e-06 2024-04-25T22:41:14.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:14.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713091+0000", 2024-04-25T22:41:14.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031910710000000002 2024-04-25T22:41:14.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:14.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713122+0000", 2024-04-25T22:41:14.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.048e-05 2024-04-25T22:41:14.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:14.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714538+0000", 2024-04-25T22:41:14.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014160030000000001 2024-04-25T22:41:14.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:14.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714627+0000", 2024-04-25T22:41:14.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518999999999995e-05 2024-04-25T22:41:14.667 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.667 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.667 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.667 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.667 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:14.668 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.042514539999999, 2024-04-25T22:41:14.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022089675999999999, 2024-04-25T22:41:14.668 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:14.668 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:14.668 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.668 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:14.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:14.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:14.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:14.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:14.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:14.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600120+0000", 2024-04-25T22:41:14.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1259999999999998e-06 2024-04-25T22:41:14.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:14.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600153+0000", 2024-04-25T22:41:14.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3186999999999999e-05 2024-04-25T22:41:14.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:14.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600181+0000", 2024-04-25T22:41:14.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7676000000000001e-05 2024-04-25T22:41:14.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600205+0000", 2024-04-25T22:41:14.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:41:14.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:14.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600467+0000", 2024-04-25T22:41:14.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026186800000000001 2024-04-25T22:41:14.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:14.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600809+0000", 2024-04-25T22:41:14.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034138400000000002 2024-04-25T22:41:14.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:14.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.601892+0000", 2024-04-25T22:41:14.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010831910000000001 2024-04-25T22:41:14.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:14.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611054+0000", 2024-04-25T22:41:14.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0091620940000000008 2024-04-25T22:41:14.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621965+0000", 2024-04-25T22:41:14.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010911044999999999 2024-04-25T22:41:14.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:14.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622090+0000", 2024-04-25T22:41:14.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012522 2024-04-25T22:41:14.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:14.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622202+0000", 2024-04-25T22:41:14.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011164500000000001 2024-04-25T22:41:14.673 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.674 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.674 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.674 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.674 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:14.674 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.042371484999997, 2024-04-25T22:41:14.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035756228000000001, 2024-04-25T22:41:14.678 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:14.678 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:14.678 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.678 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:14.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.678 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:14.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:14.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:14.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:14.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:14.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600257+0000", 2024-04-25T22:41:14.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8300000000000001e-06 2024-04-25T22:41:14.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:14.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600267+0000", 2024-04-25T22:41:14.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6539999999999994e-06 2024-04-25T22:41:14.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:14.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600293+0000", 2024-04-25T22:41:14.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5996e-05 2024-04-25T22:41:14.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600309+0000", 2024-04-25T22:41:14.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6206e-05 2024-04-25T22:41:14.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:14.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603757+0000", 2024-04-25T22:41:14.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003448244 2024-04-25T22:41:14.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:14.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604779+0000", 2024-04-25T22:41:14.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010216820000000001 2024-04-25T22:41:14.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:14.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605127+0000", 2024-04-25T22:41:14.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034820100000000002 2024-04-25T22:41:14.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:14.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611082+0000", 2024-04-25T22:41:14.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0059550640000000004 2024-04-25T22:41:14.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635779+0000", 2024-04-25T22:41:14.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024696665999999999 2024-04-25T22:41:14.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:14.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635915+0000", 2024-04-25T22:41:14.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000135809 2024-04-25T22:41:14.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:14.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636011+0000", 2024-04-25T22:41:14.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6875999999999999e-05 2024-04-25T22:41:14.683 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.683 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.683 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.683 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.683 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:14.683 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.042294271999999, 2024-04-25T22:41:14.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035327031000000002, 2024-04-25T22:41:14.683 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:14.683 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:14.683 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.684 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:14.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:14.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:14.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:14.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:14.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:14.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600334+0000", 2024-04-25T22:41:14.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:41:14.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:14.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600347+0000", 2024-04-25T22:41:14.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3593e-05 2024-04-25T22:41:14.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:14.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600371+0000", 2024-04-25T22:41:14.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.313e-05 2024-04-25T22:41:14.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600390+0000", 2024-04-25T22:41:14.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.908e-05 2024-04-25T22:41:14.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:14.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602756+0000", 2024-04-25T22:41:14.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023662560000000002 2024-04-25T22:41:14.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:14.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603021+0000", 2024-04-25T22:41:14.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026546399999999998 2024-04-25T22:41:14.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:14.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603304+0000", 2024-04-25T22:41:14.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028308800000000002 2024-04-25T22:41:14.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:14.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611075+0000", 2024-04-25T22:41:14.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077703900000000003 2024-04-25T22:41:14.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635414+0000", 2024-04-25T22:41:14.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024339326000000001 2024-04-25T22:41:14.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:14.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635544+0000", 2024-04-25T22:41:14.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012948199999999999 2024-04-25T22:41:14.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:14.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635659+0000", 2024-04-25T22:41:14.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000115809 2024-04-25T22:41:14.688 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.688 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.688 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.689 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.689 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:14.689 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.042134347000001, 2024-04-25T22:41:14.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035594492999999998, 2024-04-25T22:41:14.689 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:14.689 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:14.689 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.689 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:14.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:14.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:14.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:14.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:14.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:14.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600494+0000", 2024-04-25T22:41:14.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:41:14.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:14.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600502+0000", 2024-04-25T22:41:14.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3769999999999996e-06 2024-04-25T22:41:14.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:14.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600522+0000", 2024-04-25T22:41:14.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9919999999999999e-05 2024-04-25T22:41:14.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600539+0000", 2024-04-25T22:41:14.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.649e-05 2024-04-25T22:41:14.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:14.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604846+0000", 2024-04-25T22:41:14.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043075199999999996 2024-04-25T22:41:14.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:14.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605057+0000", 2024-04-25T22:41:14.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00021085200000000001 2024-04-25T22:41:14.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:14.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605378+0000", 2024-04-25T22:41:14.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032074799999999999 2024-04-25T22:41:14.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:14.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611089+0000", 2024-04-25T22:41:14.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057110249999999998 2024-04-25T22:41:14.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635844+0000", 2024-04-25T22:41:14.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024755355999999999 2024-04-25T22:41:14.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:14.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635986+0000", 2024-04-25T22:41:14.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141512 2024-04-25T22:41:14.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:14.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636087+0000", 2024-04-25T22:41:14.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101183 2024-04-25T22:41:14.694 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.694 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.694 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.694 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.694 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:14.694 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.042061736999997, 2024-04-25T22:41:14.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021266723000000001, 2024-04-25T22:41:14.694 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:14.694 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:14.695 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.695 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:14.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:14.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:14.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:14.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:14.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:14.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600566+0000", 2024-04-25T22:41:14.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4959999999999999e-06 2024-04-25T22:41:14.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:14.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600574+0000", 2024-04-25T22:41:14.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-06 2024-04-25T22:41:14.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:14.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600592+0000", 2024-04-25T22:41:14.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8479999999999999e-05 2024-04-25T22:41:14.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600610+0000", 2024-04-25T22:41:14.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7567e-05 2024-04-25T22:41:14.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:14.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602679+0000", 2024-04-25T22:41:14.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020692739999999999 2024-04-25T22:41:14.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:14.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602945+0000", 2024-04-25T22:41:14.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026640399999999998 2024-04-25T22:41:14.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:14.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603115+0000", 2024-04-25T22:41:14.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000169996 2024-04-25T22:41:14.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:14.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608398+0000", 2024-04-25T22:41:14.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052826289999999996 2024-04-25T22:41:14.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621588+0000", 2024-04-25T22:41:14.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013190489 2024-04-25T22:41:14.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:14.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621733+0000", 2024-04-25T22:41:14.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014462500000000001 2024-04-25T22:41:14.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:14.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621832+0000", 2024-04-25T22:41:14.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8603000000000004e-05 2024-04-25T22:41:14.699 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.699 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.699 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.699 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.699 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:14.700 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.041994011, 2024-04-25T22:41:14.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034747924999999999, 2024-04-25T22:41:14.700 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:14.700 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:14.700 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.700 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:14.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:14.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:14.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:14.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:14.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:14.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600634+0000", 2024-04-25T22:41:14.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-04-25T22:41:14.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:14.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600642+0000", 2024-04-25T22:41:14.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8169999999999999e-06 2024-04-25T22:41:14.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:14.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600660+0000", 2024-04-25T22:41:14.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8513e-05 2024-04-25T22:41:14.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600676+0000", 2024-04-25T22:41:14.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6019999999999999e-05 2024-04-25T22:41:14.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:14.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603748+0000", 2024-04-25T22:41:14.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030718329999999999 2024-04-25T22:41:14.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:14.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604752+0000", 2024-04-25T22:41:14.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001003603 2024-04-25T22:41:14.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:14.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605117+0000", 2024-04-25T22:41:14.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00036539 2024-04-25T22:41:14.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:14.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608459+0000", 2024-04-25T22:41:14.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033413879999999998 2024-04-25T22:41:14.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635106+0000", 2024-04-25T22:41:14.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026647607 2024-04-25T22:41:14.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:14.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635273+0000", 2024-04-25T22:41:14.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000166689 2024-04-25T22:41:14.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:14.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635381+0000", 2024-04-25T22:41:14.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107642 2024-04-25T22:41:14.704 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.704 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.704 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.705 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.705 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:14.705 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.041930782000001, 2024-04-25T22:41:14.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040419292000000002, 2024-04-25T22:41:14.705 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:14.705 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:14.705 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.705 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:14.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:14.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:14.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:14.706 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:14.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:14.706 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600697+0000", 2024-04-25T22:41:14.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1999999999999999e-06 2024-04-25T22:41:14.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:14.706 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600704+0000", 2024-04-25T22:41:14.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5570000000000001e-06 2024-04-25T22:41:14.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:14.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600724+0000", 2024-04-25T22:41:14.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0023000000000001e-05 2024-04-25T22:41:14.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600738+0000", 2024-04-25T22:41:14.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4372999999999999e-05 2024-04-25T22:41:14.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:14.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.612532+0000", 2024-04-25T22:41:14.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011793606 2024-04-25T22:41:14.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:14.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613354+0000", 2024-04-25T22:41:14.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00082244100000000004 2024-04-25T22:41:14.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:14.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613726+0000", 2024-04-25T22:41:14.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00037226000000000002 2024-04-25T22:41:14.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:14.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618891+0000", 2024-04-25T22:41:14.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051649199999999999 2024-04-25T22:41:14.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:14.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.640874+0000", 2024-04-25T22:41:14.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021982640000000001 2024-04-25T22:41:14.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:14.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641019+0000", 2024-04-25T22:41:14.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000145339 2024-04-25T22:41:14.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:14.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641115+0000", 2024-04-25T22:41:14.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5933000000000005e-05 2024-04-25T22:41:14.710 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.710 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.710 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.710 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.710 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:14.710 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.041844752000003, 2024-04-25T22:41:14.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036502711, 2024-04-25T22:41:14.710 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:14.710 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:14.710 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:14.711 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:14.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:14.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:14.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:14.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:14.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:14.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600783+0000", 2024-04-25T22:41:14.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.533e-06 2024-04-25T22:41:14.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:14.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600790+0000", 2024-04-25T22:41:14.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0439999999999998e-06 2024-04-25T22:41:14.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:14.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600811+0000", 2024-04-25T22:41:14.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0449e-05 2024-04-25T22:41:14.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600825+0000", 2024-04-25T22:41:14.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4293e-05 2024-04-25T22:41:14.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:14.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602304+0000", 2024-04-25T22:41:14.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001478629 2024-04-25T22:41:14.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:14.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602587+0000", 2024-04-25T22:41:14.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028350800000000002 2024-04-25T22:41:14.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:14.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.637285+0000", 2024-04-25T22:41:14.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034697255000000003 2024-04-25T22:41:14.714 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.714 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.714 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.714 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:14.714 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:14.714 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.041779185999999, 2024-04-25T22:41:14.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017311460000000001, 2024-04-25T22:41:14.714 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:14.714 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:14.714 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:14.715 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:14.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:14.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:14.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:14.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:14.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:14.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600849+0000", 2024-04-25T22:41:14.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2899999999999999e-06 2024-04-25T22:41:14.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:14.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600866+0000", 2024-04-25T22:41:14.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6793e-05 2024-04-25T22:41:14.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:14.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600886+0000", 2024-04-25T22:41:14.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0772999999999999e-05 2024-04-25T22:41:14.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600904+0000", 2024-04-25T22:41:14.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7697e-05 2024-04-25T22:41:14.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:14.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602796+0000", 2024-04-25T22:41:14.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018920149999999999 2024-04-25T22:41:14.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:14.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602962+0000", 2024-04-25T22:41:14.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016590600000000001 2024-04-25T22:41:14.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:14.718 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618159+0000", 2024-04-25T22:41:14.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015196985999999999 2024-04-25T22:41:14.718 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.718 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.718 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.718 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:14.718 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:14.718 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.026903445000002, 2024-04-25T22:41:14.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006380269, 2024-04-25T22:41:14.718 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:14.718 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:14.718 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.719 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:14.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:14.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:14.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:14.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:14.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:14.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615724+0000", 2024-04-25T22:41:14.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.094e-06 2024-04-25T22:41:14.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:14.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615734+0000", 2024-04-25T22:41:14.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.363e-06 2024-04-25T22:41:14.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:14.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615751+0000", 2024-04-25T22:41:14.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:41:14.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615773+0000", 2024-04-25T22:41:14.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.154e-05 2024-04-25T22:41:14.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:14.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616485+0000", 2024-04-25T22:41:14.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00071225100000000001 2024-04-25T22:41:14.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:14.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616528+0000", 2024-04-25T22:41:14.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3606000000000002e-05 2024-04-25T22:41:14.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:14.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622030+0000", 2024-04-25T22:41:14.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055010750000000002 2024-04-25T22:41:14.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:14.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622103+0000", 2024-04-25T22:41:14.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3930000000000005e-05 2024-04-25T22:41:14.722 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.722 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.722 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.722 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:14.722 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:14.723 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.025990508, 2024-04-25T22:41:14.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046420649999999999, 2024-04-25T22:41:14.723 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:14.723 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:14.723 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-04-25T22:41:14.723 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:14.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:14.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:14.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:14.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:14.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.724 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:14.724 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616637+0000", 2024-04-25T22:41:14.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0299999999999998e-07 2024-04-25T22:41:14.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.724 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:14.724 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616653+0000", 2024-04-25T22:41:14.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5843000000000001e-05 2024-04-25T22:41:14.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.724 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:14.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616690+0000", 2024-04-25T22:41:14.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7466999999999999e-05 2024-04-25T22:41:14.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616729+0000", 2024-04-25T22:41:14.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8810000000000003e-05 2024-04-25T22:41:14.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:14.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617251+0000", 2024-04-25T22:41:14.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00052143899999999995 2024-04-25T22:41:14.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.726 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:14.726 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621278+0000", 2024-04-25T22:41:14.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040277029999999997 2024-04-25T22:41:14.726 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.726 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.726 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.726 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:14.726 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:14.726 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.024967156000002, 2024-04-25T22:41:14.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0065101730000000002, 2024-04-25T22:41:14.726 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:14.727 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:14.727 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.727 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:14.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:14.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:14.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:14.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:14.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617661+0000", 2024-04-25T22:41:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:41:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617688+0000", 2024-04-25T22:41:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7589e-05 2024-04-25T22:41:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617710+0000", 2024-04-25T22:41:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1467e-05 2024-04-25T22:41:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.729 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617727+0000", 2024-04-25T22:41:14.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6990000000000002e-05 2024-04-25T22:41:14.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.729 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:14.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618559+0000", 2024-04-25T22:41:14.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083207400000000003 2024-04-25T22:41:14.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.729 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:14.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618608+0000", 2024-04-25T22:41:14.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8936e-05 2024-04-25T22:41:14.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:14.730 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624077+0000", 2024-04-25T22:41:14.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054695840000000004 2024-04-25T22:41:14.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:14.730 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624170+0000", 2024-04-25T22:41:14.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2305999999999993e-05 2024-04-25T22:41:14.730 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.730 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.730 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.730 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:14.731 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:14.731 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.019865648, 2024-04-25T22:41:14.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006879446, 2024-04-25T22:41:14.731 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:14.731 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:14.731 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.731 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:14.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:14.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:14.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:14.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:14.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:14.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622762+0000", 2024-04-25T22:41:14.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:41:14.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:14.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622781+0000", 2024-04-25T22:41:14.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8749999999999998e-05 2024-04-25T22:41:14.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:14.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622802+0000", 2024-04-25T22:41:14.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1650000000000001e-05 2024-04-25T22:41:14.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622816+0000", 2024-04-25T22:41:14.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3556e-05 2024-04-25T22:41:14.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:14.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623700+0000", 2024-04-25T22:41:14.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00088389299999999996 2024-04-25T22:41:14.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:14.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623741+0000", 2024-04-25T22:41:14.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1023999999999999e-05 2024-04-25T22:41:14.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:14.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629543+0000", 2024-04-25T22:41:14.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058023980000000003 2024-04-25T22:41:14.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:14.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629640+0000", 2024-04-25T22:41:14.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7381999999999997e-05 2024-04-25T22:41:14.734 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.734 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.735 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.735 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:14.735 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:14.735 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.019604444000002, 2024-04-25T22:41:14.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067054879999999999, 2024-04-25T22:41:14.735 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:14.735 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:14.735 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.735 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:14.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:14.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:14.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:14.736 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:14.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:14.736 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623032+0000", 2024-04-25T22:41:14.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.9930000000000007e-06 2024-04-25T22:41:14.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:14.736 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623043+0000", 2024-04-25T22:41:14.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0387000000000001e-05 2024-04-25T22:41:14.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:14.737 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623064+0000", 2024-04-25T22:41:14.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1849999999999999e-05 2024-04-25T22:41:14.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.737 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623079+0000", 2024-04-25T22:41:14.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4093e-05 2024-04-25T22:41:14.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:14.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624384+0000", 2024-04-25T22:41:14.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013054539999999999 2024-04-25T22:41:14.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:14.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624421+0000", 2024-04-25T22:41:14.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7088999999999997e-05 2024-04-25T22:41:14.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:14.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629645+0000", 2024-04-25T22:41:14.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052241400000000004 2024-04-25T22:41:14.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:14.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629728+0000", 2024-04-25T22:41:14.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2482000000000001e-05 2024-04-25T22:41:14.739 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.739 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.739 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.739 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2024-04-25T22:41:14.739 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:14.739 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.019521331, 2024-04-25T22:41:14.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078029559999999998, 2024-04-25T22:41:14.739 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:14.739 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:14.740 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:14.740 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:14.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:14.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:14.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:14.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:14.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:14.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:14.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623106+0000", 2024-04-25T22:41:14.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.64e-07 2024-04-25T22:41:14.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:14.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623141+0000", 2024-04-25T22:41:14.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4678999999999998e-05 2024-04-25T22:41:14.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:14.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623153+0000", 2024-04-25T22:41:14.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1759999999999999e-05 2024-04-25T22:41:14.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:14.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623161+0000", 2024-04-25T22:41:14.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8299999999999996e-06 2024-04-25T22:41:14.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:14.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623834+0000", 2024-04-25T22:41:14.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067394500000000001 2024-04-25T22:41:14.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:14.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623883+0000", 2024-04-25T22:41:14.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8640000000000002e-05 2024-04-25T22:41:14.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:14.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630807+0000", 2024-04-25T22:41:14.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069238859999999998 2024-04-25T22:41:14.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:14.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:14.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:14.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630908+0000", 2024-04-25T22:41:14.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101252 2024-04-25T22:41:14.743 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.743 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.743 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.743 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:14.743 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:14.744 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:14.745 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:14.746 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:14.746+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:14.799 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is set 2024-04-25T22:41:14.846 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:14.845+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:14.882 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:14.882 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:14.882 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:14.882 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:14.894 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:14.947 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:14.946+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:15.048 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:15.046+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:15.061 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:15.061 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:15.061 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:15.061 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:15.061 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:15.076 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:15.149 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:15.145+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:15.188 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:41:15.196 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:15.196 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:15.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:15.196 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:15.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.197 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:15.197 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:15.197 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 60.598640469000003, 2024-04-25T22:41:15.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:15.197 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:15.197 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:15.197 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:15.197 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:15.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:15.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:15.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:15.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:15.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:15.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:15.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:15.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:15.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:15.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:15.199 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:15.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:15.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:15.199 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:15.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:15.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:15.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.200 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:15.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:15.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:15.200 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:15.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:15.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:15.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:15.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:15.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:15.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:15.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:15.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:15.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:15.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:15.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:15.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:15.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:15.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:15.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:15.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:15.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:15.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:15.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:15.203 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:15.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:15.203 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.203 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.203 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.203 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:15.203 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:15.203 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 60.598503213000001, 2024-04-25T22:41:15.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:15.203 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:15.204 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:15.204 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:15.204 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:15.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:15.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:15.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:15.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:15.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:15.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:15.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:15.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:15.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:15.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:15.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:15.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:15.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:15.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:15.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:15.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:15.206 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:15.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:15.206 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:15.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:15.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:15.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.207 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:15.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:15.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.207 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:15.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:15.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:15.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.207 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:15.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:15.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:15.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.208 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:15.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:15.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:15.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.208 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:15.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:15.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:15.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.208 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:15.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:15.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:15.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:15.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:15.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:15.209 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.209 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.209 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.209 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:15.209 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:15.209 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 60.598415660999997, 2024-04-25T22:41:15.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:15.210 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:15.210 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:15.210 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:15.210 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:15.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:15.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:15.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:15.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:15.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:15.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:15.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:15.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:15.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:15.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:15.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:15.212 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:15.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:15.212 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.212 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:15.212 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:15.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:15.212 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.212 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.212 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:15.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:15.212 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:15.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:15.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:15.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:15.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:15.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:15.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:15.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:15.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.214 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:15.214 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:15.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:15.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.214 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:15.214 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:15.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:15.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.214 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:15.214 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:15.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:15.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.215 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:15.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:15.215 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:15.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.215 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:15.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:15.215 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:15.215 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.215 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.215 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.216 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:15.216 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:15.216 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 60.598311834999997, 2024-04-25T22:41:15.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:15.216 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:15.216 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:15.216 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:15.216 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:15.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:15.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:15.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:15.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:15.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.217 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:15.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:15.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:15.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.217 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:15.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:15.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:15.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:15.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:15.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:15.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:15.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:15.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:15.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:15.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:15.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:15.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:15.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:15.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:15.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:15.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:15.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:15.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:15.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:15.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:15.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:15.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:15.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:15.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:15.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:15.221 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:15.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:15.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.221 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:15.221 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:15.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:15.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.221 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:15.221 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:15.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:15.221 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.221 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.222 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.222 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.222 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:15.222 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:15.222 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 60.598243044999997, 2024-04-25T22:41:15.222 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:15.222 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:15.222 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:15.222 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:15.222 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:15.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.222 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:15.222 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:15.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:15.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:15.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:15.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:15.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:15.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:15.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:15.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:15.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:15.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:15.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:15.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:15.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:15.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:15.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:15.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:15.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:15.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:15.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:15.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:15.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:15.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:15.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:15.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:15.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:15.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:15.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:15.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:15.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:15.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:15.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.227 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.227 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:15.227 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:15.227 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:15.227 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.227 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.227 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:15.227 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:15.227 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:15.227 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.227 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.227 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:15.227 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:15.227 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:15.228 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.228 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.228 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.228 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:15.228 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:15.228 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 60.598173959, 2024-04-25T22:41:15.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:15.228 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:15.228 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:15.228 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:15.228 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:15.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:15.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:15.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:15.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:15.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:15.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:15.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:15.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:15.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:15.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:15.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:15.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:15.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:15.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:15.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:15.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:15.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:15.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:15.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:15.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:15.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:15.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:15.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:15.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:15.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:15.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:15.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:15.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:15.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:15.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:15.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:15.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:15.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:15.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:15.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:15.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:15.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:15.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:15.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:15.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:15.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:15.234 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.234 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.234 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.234 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:15.234 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:15.234 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 60.598077846000002, 2024-04-25T22:41:15.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:15.234 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:15.234 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:15.234 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:15.234 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:15.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:15.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:15.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:15.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:15.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:15.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:15.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:15.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:15.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:15.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:15.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:15.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:15.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:15.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:15.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:15.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:15.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:15.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:15.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:15.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:15.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:15.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:15.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:15.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:15.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:15.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:15.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:15.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:15.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:15.238 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.238 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.239 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.239 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.239 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:15.239 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:15.239 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 60.598012183999998, 2024-04-25T22:41:15.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:15.239 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:15.239 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:15.239 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:15.239 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:15.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:15.239 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:15.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:15.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:15.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:15.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:15.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:15.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:15.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:15.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:15.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:15.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:15.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:15.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:15.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:15.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:15.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:15.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:15.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:15.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:15.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:15.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:15.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:15.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:15.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:15.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:15.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:15.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:15.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:15.243 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.243 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.243 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.243 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:15.244 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:15.244 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 60.597943057000002, 2024-04-25T22:41:15.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:15.244 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:15.244 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:15.244 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:15.244 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:15.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:15.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:15.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:15.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:15.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:15.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:15.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:15.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:15.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:15.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:15.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:15.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:15.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:15.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:15.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:15.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:15.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:15.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:15.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:15.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:15.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:15.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:15.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:15.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:15.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:15.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:15.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:15.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:15.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:15.248 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.248 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.248 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.248 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:15.248 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:15.248 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 60.587126400999999, 2024-04-25T22:41:15.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:15.248 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:15.248 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:15.248 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:15.249 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:15.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:15.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:15.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:15.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:15.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:15.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:15.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:15.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.250 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:15.250 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:15.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:15.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.250 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:15.250 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:15.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:15.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.250 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:15.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:15.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:15.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:15.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:15.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:15.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:15.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:15.251 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.251 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.252 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.252 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:15.252 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:15.252 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 60.570228047999997, 2024-04-25T22:41:15.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:15.252 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:15.252 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:15.252 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:15.252 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:15.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:15.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:15.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:15.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:15.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:15.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:15.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:15.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:15.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:15.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:15.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:15.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:15.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:15.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:15.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:15.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:15.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.255 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.255 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:15.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:15.255 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.255 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.255 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:15.255 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:15.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:15.255 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.255 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.255 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:15.255 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:15.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:15.255 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.255 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.256 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.256 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:15.256 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:15.256 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 60.569407157999997, 2024-04-25T22:41:15.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:15.256 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:15.256 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:15.256 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:15.256 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:15.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:15.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:15.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:15.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:15.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:15.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:15.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:15.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:15.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:15.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:15.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:15.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:15.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:15.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:15.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:15.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:15.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:15.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:15.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:15.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:15.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:15.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:15.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:15.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:15.259 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.259 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.260 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.260 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:15.260 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:15.260 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 60.567706430000001, 2024-04-25T22:41:15.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:15.260 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:15.260 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:15.260 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:15.260 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:15.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:15.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:15.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:15.261 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:15.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:15.261 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:15.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:15.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:15.261 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:15.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:15.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:15.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:15.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:15.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:15.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:15.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:15.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:15.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:15.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:15.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:15.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:15.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:15.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:15.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:15.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:15.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:15.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:15.264 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.264 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.264 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.264 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:15.264 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:15.264 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 60.567109754999997, 2024-04-25T22:41:15.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:15.264 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:15.264 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:15.264 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:15.264 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:15.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:15.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:15.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:15.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:15.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:15.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:15.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:15.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:15.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:15.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:15.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:15.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:15.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:15.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:15.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:15.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:15.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.267 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.267 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:15.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:15.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.267 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:15.267 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:15.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:15.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.267 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:15.267 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:15.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:15.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.268 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:15.268 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:15.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:15.268 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.268 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.268 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.268 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:15.268 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:15.268 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 60.557674028999998, 2024-04-25T22:41:15.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:15.269 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:15.269 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:15.269 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:15.269 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:15.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:15.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:15.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:15.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:15.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:15.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:15.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:15.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:15.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:15.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:15.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:15.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:15.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:15.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:15.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:15.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:15.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:15.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:15.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:15.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:15.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:15.272 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.272 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.272 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.272 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:15.272 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:15.272 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 60.557026602999997, 2024-04-25T22:41:15.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:15.272 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:15.272 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:15.272 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:15.272 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:15.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.272 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:15.273 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:15.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:15.273 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:15.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:15.273 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:15.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:15.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:15.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:15.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:15.274 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.274 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:15.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:15.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:15.274 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.274 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:15.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:15.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:15.274 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:15.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:15.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:15.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:15.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:15.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:15.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:15.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:15.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:15.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:15.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:15.276 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.276 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.276 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.276 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:15.276 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:15.276 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 60.555585784000002, 2024-04-25T22:41:15.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:15.276 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:15.277 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:15.277 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:15.277 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:15.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:15.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:15.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:15.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:15.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:15.278 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:15.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:15.278 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.278 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.278 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:15.278 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:15.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:15.278 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.278 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.278 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:15.278 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:15.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:15.278 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.279 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:15.279 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:15.279 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:15.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.279 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.279 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:15.279 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:15.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.279 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:15.279 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:15.279 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:15.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.280 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.280 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:15.280 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:15.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:15.280 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.280 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.280 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:15.280 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:15.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:15.280 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.280 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.280 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.280 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.280 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.281 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:15.281 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:15.281 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.60314734, 2024-04-25T22:41:15.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:15.281 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:15.281 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:15.281 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:15.281 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:15.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.281 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:15.281 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:15.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.281 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.281 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:15.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:15.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:15.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:15.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:15.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:15.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:15.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:15.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:15.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:15.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:15.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:15.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:15.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:15.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:15.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:15.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.284 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.284 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:15.284 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:15.284 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:15.284 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.284 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.284 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:15.284 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:15.284 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:15.284 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.284 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.284 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:15.284 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:15.284 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:15.285 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.285 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.285 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:15.285 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:15.285 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:15.285 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.285 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.285 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:15.285 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:15.285 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:15.285 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.285 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.285 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:15.285 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:15.285 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:15.286 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.286 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.286 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.286 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.286 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:15.286 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:15.286 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 36.600488016, 2024-04-25T22:41:15.286 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:15.286 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:15.286 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:15.286 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:15.286 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:15.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:15.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:15.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.287 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.287 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:15.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:15.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.287 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.290 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.290 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:15.290 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:15.290 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:15.290 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.290 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.290 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:15.290 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:15.290 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:15.290 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.290 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.290 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:15.290 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:15.291 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:15.291 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.291 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.291 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:15.291 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:15.291 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:15.291 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.291 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.291 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.291 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:15.291 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:15.291 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.291 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.291 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:15.292 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:15.292 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:15.292 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.292 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.292 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:15.292 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:15.292 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:15.292 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.292 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.292 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:15.292 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:15.292 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:15.292 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.292 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.292 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:15.293 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:15.293 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:15.293 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.293 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.293 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:15.293 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:15.293 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:15.293 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.293 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.293 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:15.293 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:15.293 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:15.293 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.293 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.294 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.294 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.294 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.294 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:15.294 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:15.294 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.600195764999999, 2024-04-25T22:41:15.294 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:15.294 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:15.294 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:15.294 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:15.294 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:15.294 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.294 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:15.294 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:15.295 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.295 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.295 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.295 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:15.295 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:15.295 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:15.295 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.295 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.295 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:15.295 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:15.295 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:15.295 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.295 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.295 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:15.296 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:15.296 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:15.296 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.296 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.296 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:15.296 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:15.296 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:15.296 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.296 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.296 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:15.296 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:15.296 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:15.296 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.296 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.296 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:15.297 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:15.297 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:15.297 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.297 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.297 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:15.297 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:15.297 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:15.297 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.297 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.297 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:15.297 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:15.297 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:15.297 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.297 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.298 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:15.298 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:15.298 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:15.298 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.298 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.298 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:15.298 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:15.298 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:15.298 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.298 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.298 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:15.298 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:15.298 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:15.298 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:15.298 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:15.299 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:15.299 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:15.299 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:15.299 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.299 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.299 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.299 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:15.299 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:15.299 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:15.301 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:15.301 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:15.298+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:15.344 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:15.344 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:15.365 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:41:15.366 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:41:15.387 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:15.387 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:15.401 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:15.398+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:15.431 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:15.431 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:15.445 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:15.502 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:15.502+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:15.569 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:15.569 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:15.583 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:15.603 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:15.602+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:15.704 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:15.702+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:15.746 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:15.746 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:15.761 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:41:15.805 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:15.806+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:15.893 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:15.893 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:15.905 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:15.902+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:15.908 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:41:16.008 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:16.006+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:16.081 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:16.082 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:16.095 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:41:16.139 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:16.138+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:16.209 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:16.206+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:16.260 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:16.260 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:16.274 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:16.322 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:16.321+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:16.404 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:16.404 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:16.411 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:16.409+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:16.418 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:16.512 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:16.514+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:16.582 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:16.582 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:16.597 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:16.613 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:16.614+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:16.718 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:16.710+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:16.720 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:16.720 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:16.734 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:16.815 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:16.813+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:16.818 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:41:16.866 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:16.866 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:16.880 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:16.917 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:16.917+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:17.001 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:17.002 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:17.015 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:17.019 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:17.018+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:17.118 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:17.114+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:17.137 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:17.137 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:17.151 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:41:17.218 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:17.217+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:17.284 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:17.284 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:17.298 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:41:17.343 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:17.342+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:17.403 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:41:17.414 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:17.414 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:17.420 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:17.417+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:17.428 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:41:17.520 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:17.522+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:17.563 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:17.563 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:17.586 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:41:17.586 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:41:17.600 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:17.600 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-04-25T22:41:17.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-04-25T22:41:17.600 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-04-25T22:41:17.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.600 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:111 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'73, mlcod=11'69)", 2024-04-25T22:41:17.600 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:17.600 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.898055964999998, 2024-04-25T22:41:17.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055481899999999997, 2024-04-25T22:41:17.600 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:17.600 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:17.601 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:17.601 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:17.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:17.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:17.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:17.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:17.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:17.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700271+0000", 2024-04-25T22:41:17.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:41:17.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:17.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700278+0000", 2024-04-25T22:41:17.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-04-25T22:41:17.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:17.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700323+0000", 2024-04-25T22:41:17.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4212999999999998e-05 2024-04-25T22:41:17.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:17.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700333+0000", 2024-04-25T22:41:17.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0433e-05 2024-04-25T22:41:17.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:17.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700662+0000", 2024-04-25T22:41:17.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032862800000000003 2024-04-25T22:41:17.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:17.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700692+0000", 2024-04-25T22:41:17.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0395999999999998e-05 2024-04-25T22:41:17.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:17.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705728+0000", 2024-04-25T22:41:17.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050361939999999999 2024-04-25T22:41:17.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:17.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705818+0000", 2024-04-25T22:41:17.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9573000000000005e-05 2024-04-25T22:41:17.604 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.604 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.604 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.605 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-25T22:41:17.605 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:17.605 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.897511112999993, 2024-04-25T22:41:17.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005065501, 2024-04-25T22:41:17.605 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:17.605 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:17.605 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:17.605 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:17.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:17.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:17.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:17.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:17.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:17.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700816+0000", 2024-04-25T22:41:17.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.24e-06 2024-04-25T22:41:17.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:17.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700914+0000", 2024-04-25T22:41:17.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8057e-05 2024-04-25T22:41:17.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:17.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700931+0000", 2024-04-25T22:41:17.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7745999999999999e-05 2024-04-25T22:41:17.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:17.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700941+0000", 2024-04-25T22:41:17.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5699999999999999e-06 2024-04-25T22:41:17.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:17.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701162+0000", 2024-04-25T22:41:17.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000221392 2024-04-25T22:41:17.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:17.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701194+0000", 2024-04-25T22:41:17.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1745999999999997e-05 2024-04-25T22:41:17.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:17.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705821+0000", 2024-04-25T22:41:17.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046269869999999999 2024-04-25T22:41:17.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:17.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705880+0000", 2024-04-25T22:41:17.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8763e-05 2024-04-25T22:41:17.609 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.609 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.609 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.609 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:118 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'80, mlcod=11'78)", 2024-04-25T22:41:17.609 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:17.609 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.890155503000003, 2024-04-25T22:41:17.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047806089999999999, 2024-04-25T22:41:17.609 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:17.609 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:17.609 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:17.610 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:17.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:17.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:17.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:17.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:17.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:17.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708172+0000", 2024-04-25T22:41:17.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0600000000000002e-06 2024-04-25T22:41:17.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:17.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708291+0000", 2024-04-25T22:41:17.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118892 2024-04-25T22:41:17.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:17.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708320+0000", 2024-04-25T22:41:17.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8822999999999998e-05 2024-04-25T22:41:17.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:17.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708337+0000", 2024-04-25T22:41:17.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7586999999999999e-05 2024-04-25T22:41:17.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:17.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708512+0000", 2024-04-25T22:41:17.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017439500000000001 2024-04-25T22:41:17.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:17.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708551+0000", 2024-04-25T22:41:17.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.909e-05 2024-04-25T22:41:17.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:17.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712865+0000", 2024-04-25T22:41:17.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043142069999999996 2024-04-25T22:41:17.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:17.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712951+0000", 2024-04-25T22:41:17.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5555000000000003e-05 2024-04-25T22:41:17.613 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.613 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.613 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.613 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:120 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'82, mlcod=11'78)", 2024-04-25T22:41:17.613 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:17.613 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.889149461000002, 2024-04-25T22:41:17.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047170700000000003, 2024-04-25T22:41:17.614 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:17.614 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:17.614 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:17.614 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:17.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:17.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:17.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:17.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:17.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:17.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709177+0000", 2024-04-25T22:41:17.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.19e-06 2024-04-25T22:41:17.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:17.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709315+0000", 2024-04-25T22:41:17.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000137429 2024-04-25T22:41:17.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:17.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709341+0000", 2024-04-25T22:41:17.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:41:17.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:17.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709353+0000", 2024-04-25T22:41:17.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2027e-05 2024-04-25T22:41:17.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:17.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710040+0000", 2024-04-25T22:41:17.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068710799999999997 2024-04-25T22:41:17.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:17.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710076+0000", 2024-04-25T22:41:17.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5982999999999998e-05 2024-04-25T22:41:17.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:17.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713802+0000", 2024-04-25T22:41:17.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037255750000000001 2024-04-25T22:41:17.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:17.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713893+0000", 2024-04-25T22:41:17.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1201999999999999e-05 2024-04-25T22:41:17.618 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.618 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.618 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.619 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:121 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'83, mlcod=11'78)", 2024-04-25T22:41:17.619 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:17.619 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.888602825000007, 2024-04-25T22:41:17.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0049043919999999996, 2024-04-25T22:41:17.619 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:17.619 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:17.619 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:17.619 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:17.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:17.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:17.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:17.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:17.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:17.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709724+0000", 2024-04-25T22:41:17.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.483e-06 2024-04-25T22:41:17.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:17.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709872+0000", 2024-04-25T22:41:17.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147446 2024-04-25T22:41:17.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:17.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709891+0000", 2024-04-25T22:41:17.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9245999999999998e-05 2024-04-25T22:41:17.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:17.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709900+0000", 2024-04-25T22:41:17.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1439999999999992e-06 2024-04-25T22:41:17.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:17.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713091+0000", 2024-04-25T22:41:17.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031910710000000002 2024-04-25T22:41:17.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:17.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713122+0000", 2024-04-25T22:41:17.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.048e-05 2024-04-25T22:41:17.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:17.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714538+0000", 2024-04-25T22:41:17.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014160030000000001 2024-04-25T22:41:17.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:17.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714627+0000", 2024-04-25T22:41:17.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518999999999995e-05 2024-04-25T22:41:17.623 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.623 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.623 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.624 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:17.624 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:17.624 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.998213444999998, 2024-04-25T22:41:17.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022089675999999999, 2024-04-25T22:41:17.624 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:17.624 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:17.624 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:17.624 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:17.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:17.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:17.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:17.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:17.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:17.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600120+0000", 2024-04-25T22:41:17.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1259999999999998e-06 2024-04-25T22:41:17.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:17.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600153+0000", 2024-04-25T22:41:17.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3186999999999999e-05 2024-04-25T22:41:17.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:17.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600181+0000", 2024-04-25T22:41:17.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7676000000000001e-05 2024-04-25T22:41:17.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:17.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600205+0000", 2024-04-25T22:41:17.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:41:17.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:17.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600467+0000", 2024-04-25T22:41:17.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026186800000000001 2024-04-25T22:41:17.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:17.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600809+0000", 2024-04-25T22:41:17.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034138400000000002 2024-04-25T22:41:17.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:17.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.601892+0000", 2024-04-25T22:41:17.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010831910000000001 2024-04-25T22:41:17.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:17.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611054+0000", 2024-04-25T22:41:17.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0091620940000000008 2024-04-25T22:41:17.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:17.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621965+0000", 2024-04-25T22:41:17.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010911044999999999 2024-04-25T22:41:17.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:17.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622090+0000", 2024-04-25T22:41:17.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012522 2024-04-25T22:41:17.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:17.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622202+0000", 2024-04-25T22:41:17.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011164500000000001 2024-04-25T22:41:17.629 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.629 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.629 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.629 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:17.630 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:17.630 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.998070390000002, 2024-04-25T22:41:17.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035756228000000001, 2024-04-25T22:41:17.630 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:17.630 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:17.630 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:17.630 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:17.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:17.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:17.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:17.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:17.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:17.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600257+0000", 2024-04-25T22:41:17.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8300000000000001e-06 2024-04-25T22:41:17.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:17.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600267+0000", 2024-04-25T22:41:17.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6539999999999994e-06 2024-04-25T22:41:17.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:17.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600293+0000", 2024-04-25T22:41:17.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5996e-05 2024-04-25T22:41:17.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:17.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600309+0000", 2024-04-25T22:41:17.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6206e-05 2024-04-25T22:41:17.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:17.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603757+0000", 2024-04-25T22:41:17.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003448244 2024-04-25T22:41:17.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:17.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604779+0000", 2024-04-25T22:41:17.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010216820000000001 2024-04-25T22:41:17.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:17.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605127+0000", 2024-04-25T22:41:17.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034820100000000002 2024-04-25T22:41:17.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:17.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611082+0000", 2024-04-25T22:41:17.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0059550640000000004 2024-04-25T22:41:17.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:17.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635779+0000", 2024-04-25T22:41:17.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024696665999999999 2024-04-25T22:41:17.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:17.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635915+0000", 2024-04-25T22:41:17.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000135809 2024-04-25T22:41:17.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:17.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636011+0000", 2024-04-25T22:41:17.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6875999999999999e-05 2024-04-25T22:41:17.635 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.635 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.636 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.636 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:17.636 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:17.636 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.997993176999998, 2024-04-25T22:41:17.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035327031000000002, 2024-04-25T22:41:17.636 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:17.636 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:17.636 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:17.636 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:17.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:17.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:17.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:17.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:17.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:17.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600334+0000", 2024-04-25T22:41:17.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:41:17.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:17.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600347+0000", 2024-04-25T22:41:17.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3593e-05 2024-04-25T22:41:17.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:17.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600371+0000", 2024-04-25T22:41:17.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.313e-05 2024-04-25T22:41:17.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:17.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600390+0000", 2024-04-25T22:41:17.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.908e-05 2024-04-25T22:41:17.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:17.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602756+0000", 2024-04-25T22:41:17.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023662560000000002 2024-04-25T22:41:17.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:17.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603021+0000", 2024-04-25T22:41:17.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026546399999999998 2024-04-25T22:41:17.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:17.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603304+0000", 2024-04-25T22:41:17.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028308800000000002 2024-04-25T22:41:17.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:17.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611075+0000", 2024-04-25T22:41:17.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077703900000000003 2024-04-25T22:41:17.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:17.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635414+0000", 2024-04-25T22:41:17.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024339326000000001 2024-04-25T22:41:17.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:17.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635544+0000", 2024-04-25T22:41:17.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012948199999999999 2024-04-25T22:41:17.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:17.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635659+0000", 2024-04-25T22:41:17.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000115809 2024-04-25T22:41:17.641 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.641 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.641 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.641 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:17.641 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:17.641 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.997833252, 2024-04-25T22:41:17.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035594492999999998, 2024-04-25T22:41:17.641 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:17.641 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:17.641 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:17.641 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:17.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:17.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:17.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:17.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:17.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:17.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600494+0000", 2024-04-25T22:41:17.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:41:17.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:17.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600502+0000", 2024-04-25T22:41:17.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3769999999999996e-06 2024-04-25T22:41:17.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:17.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600522+0000", 2024-04-25T22:41:17.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9919999999999999e-05 2024-04-25T22:41:17.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:17.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600539+0000", 2024-04-25T22:41:17.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.649e-05 2024-04-25T22:41:17.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:17.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604846+0000", 2024-04-25T22:41:17.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043075199999999996 2024-04-25T22:41:17.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:17.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605057+0000", 2024-04-25T22:41:17.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00021085200000000001 2024-04-25T22:41:17.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:17.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605378+0000", 2024-04-25T22:41:17.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032074799999999999 2024-04-25T22:41:17.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:17.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611089+0000", 2024-04-25T22:41:17.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057110249999999998 2024-04-25T22:41:17.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:17.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635844+0000", 2024-04-25T22:41:17.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024755355999999999 2024-04-25T22:41:17.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:17.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635986+0000", 2024-04-25T22:41:17.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141512 2024-04-25T22:41:17.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:17.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636087+0000", 2024-04-25T22:41:17.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101183 2024-04-25T22:41:17.646 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.646 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.646 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.646 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:17.646 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:17.646 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.997760642000003, 2024-04-25T22:41:17.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021266723000000001, 2024-04-25T22:41:17.646 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:17.646 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:17.646 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:17.646 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:17.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:17.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:17.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:17.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:17.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:17.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600566+0000", 2024-04-25T22:41:17.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4959999999999999e-06 2024-04-25T22:41:17.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:17.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600574+0000", 2024-04-25T22:41:17.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-06 2024-04-25T22:41:17.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:17.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600592+0000", 2024-04-25T22:41:17.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8479999999999999e-05 2024-04-25T22:41:17.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:17.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600610+0000", 2024-04-25T22:41:17.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7567e-05 2024-04-25T22:41:17.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:17.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602679+0000", 2024-04-25T22:41:17.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020692739999999999 2024-04-25T22:41:17.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:17.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602945+0000", 2024-04-25T22:41:17.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026640399999999998 2024-04-25T22:41:17.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:17.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603115+0000", 2024-04-25T22:41:17.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000169996 2024-04-25T22:41:17.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:17.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608398+0000", 2024-04-25T22:41:17.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052826289999999996 2024-04-25T22:41:17.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:17.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621588+0000", 2024-04-25T22:41:17.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013190489 2024-04-25T22:41:17.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:17.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621733+0000", 2024-04-25T22:41:17.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014462500000000001 2024-04-25T22:41:17.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:17.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621832+0000", 2024-04-25T22:41:17.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8603000000000004e-05 2024-04-25T22:41:17.651 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.651 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.651 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.652 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:17.652 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:17.652 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.997692915999998, 2024-04-25T22:41:17.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034747924999999999, 2024-04-25T22:41:17.652 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:17.652 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:17.652 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:17.652 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:17.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:17.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:17.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:17.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:17.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:17.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600634+0000", 2024-04-25T22:41:17.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-04-25T22:41:17.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:17.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600642+0000", 2024-04-25T22:41:17.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8169999999999999e-06 2024-04-25T22:41:17.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:17.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600660+0000", 2024-04-25T22:41:17.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8513e-05 2024-04-25T22:41:17.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:17.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600676+0000", 2024-04-25T22:41:17.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6019999999999999e-05 2024-04-25T22:41:17.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:17.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603748+0000", 2024-04-25T22:41:17.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030718329999999999 2024-04-25T22:41:17.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:17.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604752+0000", 2024-04-25T22:41:17.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001003603 2024-04-25T22:41:17.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:17.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605117+0000", 2024-04-25T22:41:17.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00036539 2024-04-25T22:41:17.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:17.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608459+0000", 2024-04-25T22:41:17.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033413879999999998 2024-04-25T22:41:17.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:17.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635106+0000", 2024-04-25T22:41:17.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026647607 2024-04-25T22:41:17.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:17.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635273+0000", 2024-04-25T22:41:17.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000166689 2024-04-25T22:41:17.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:17.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635381+0000", 2024-04-25T22:41:17.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107642 2024-04-25T22:41:17.657 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.658 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.658 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.658 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:17.658 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:17.658 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.997629687, 2024-04-25T22:41:17.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040419292000000002, 2024-04-25T22:41:17.658 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:17.659 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:17.659 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:17.659 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:17.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:17.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:17.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:17.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:17.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:17.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600697+0000", 2024-04-25T22:41:17.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1999999999999999e-06 2024-04-25T22:41:17.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:17.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600704+0000", 2024-04-25T22:41:17.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5570000000000001e-06 2024-04-25T22:41:17.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:17.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600724+0000", 2024-04-25T22:41:17.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0023000000000001e-05 2024-04-25T22:41:17.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:17.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600738+0000", 2024-04-25T22:41:17.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4372999999999999e-05 2024-04-25T22:41:17.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:17.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.612532+0000", 2024-04-25T22:41:17.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011793606 2024-04-25T22:41:17.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:17.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613354+0000", 2024-04-25T22:41:17.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00082244100000000004 2024-04-25T22:41:17.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:17.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613726+0000", 2024-04-25T22:41:17.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00037226000000000002 2024-04-25T22:41:17.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:17.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618891+0000", 2024-04-25T22:41:17.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051649199999999999 2024-04-25T22:41:17.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:17.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.640874+0000", 2024-04-25T22:41:17.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021982640000000001 2024-04-25T22:41:17.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:17.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641019+0000", 2024-04-25T22:41:17.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000145339 2024-04-25T22:41:17.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:17.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641115+0000", 2024-04-25T22:41:17.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5933000000000005e-05 2024-04-25T22:41:17.664 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.664 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.664 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.665 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:17.665 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:17.665 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.997543657000001, 2024-04-25T22:41:17.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036502711, 2024-04-25T22:41:17.665 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:17.665 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:17.665 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:17.665 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:17.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:17.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:17.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:17.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:17.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:17.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600783+0000", 2024-04-25T22:41:17.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.533e-06 2024-04-25T22:41:17.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:17.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600790+0000", 2024-04-25T22:41:17.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0439999999999998e-06 2024-04-25T22:41:17.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:17.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600811+0000", 2024-04-25T22:41:17.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0449e-05 2024-04-25T22:41:17.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:17.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600825+0000", 2024-04-25T22:41:17.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4293e-05 2024-04-25T22:41:17.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:17.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602304+0000", 2024-04-25T22:41:17.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001478629 2024-04-25T22:41:17.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:17.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602587+0000", 2024-04-25T22:41:17.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028350800000000002 2024-04-25T22:41:17.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:17.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.637285+0000", 2024-04-25T22:41:17.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034697255000000003 2024-04-25T22:41:17.669 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.669 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.669 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.669 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:17.669 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:17.669 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.997478090999998, 2024-04-25T22:41:17.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017311460000000001, 2024-04-25T22:41:17.669 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:17.669 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:17.669 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:17.669 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:17.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:17.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:17.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:17.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:17.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:17.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600849+0000", 2024-04-25T22:41:17.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2899999999999999e-06 2024-04-25T22:41:17.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:17.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600866+0000", 2024-04-25T22:41:17.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6793e-05 2024-04-25T22:41:17.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:17.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600886+0000", 2024-04-25T22:41:17.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0772999999999999e-05 2024-04-25T22:41:17.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:17.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600904+0000", 2024-04-25T22:41:17.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7697e-05 2024-04-25T22:41:17.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:17.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602796+0000", 2024-04-25T22:41:17.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018920149999999999 2024-04-25T22:41:17.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:17.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602962+0000", 2024-04-25T22:41:17.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016590600000000001 2024-04-25T22:41:17.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:17.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618159+0000", 2024-04-25T22:41:17.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015196985999999999 2024-04-25T22:41:17.673 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.673 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.673 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.673 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:17.673 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:17.673 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.982602350000001, 2024-04-25T22:41:17.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006380269, 2024-04-25T22:41:17.674 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:17.674 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:17.674 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:17.674 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:17.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:17.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:17.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:17.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:17.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:17.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615724+0000", 2024-04-25T22:41:17.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.094e-06 2024-04-25T22:41:17.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:17.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615734+0000", 2024-04-25T22:41:17.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.363e-06 2024-04-25T22:41:17.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:17.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615751+0000", 2024-04-25T22:41:17.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:41:17.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:17.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615773+0000", 2024-04-25T22:41:17.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.154e-05 2024-04-25T22:41:17.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:17.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616485+0000", 2024-04-25T22:41:17.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00071225100000000001 2024-04-25T22:41:17.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:17.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616528+0000", 2024-04-25T22:41:17.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3606000000000002e-05 2024-04-25T22:41:17.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:17.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622030+0000", 2024-04-25T22:41:17.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055010750000000002 2024-04-25T22:41:17.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:17.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622103+0000", 2024-04-25T22:41:17.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3930000000000005e-05 2024-04-25T22:41:17.677 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.677 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.677 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.678 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:17.678 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:17.678 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.981689412999998, 2024-04-25T22:41:17.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046420649999999999, 2024-04-25T22:41:17.678 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:17.678 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:17.678 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-04-25T22:41:17.678 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:17.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.678 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:17.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:17.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:17.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:17.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:17.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616637+0000", 2024-04-25T22:41:17.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0299999999999998e-07 2024-04-25T22:41:17.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:17.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616653+0000", 2024-04-25T22:41:17.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5843000000000001e-05 2024-04-25T22:41:17.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:17.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616690+0000", 2024-04-25T22:41:17.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7466999999999999e-05 2024-04-25T22:41:17.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:17.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616729+0000", 2024-04-25T22:41:17.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8810000000000003e-05 2024-04-25T22:41:17.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:17.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617251+0000", 2024-04-25T22:41:17.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00052143899999999995 2024-04-25T22:41:17.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:17.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621278+0000", 2024-04-25T22:41:17.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040277029999999997 2024-04-25T22:41:17.681 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.681 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.681 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.681 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:17.681 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:17.681 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.980666061000001, 2024-04-25T22:41:17.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0065101730000000002, 2024-04-25T22:41:17.682 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:17.682 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:17.682 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:17.682 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:17.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:17.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:17.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:17.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:17.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:17.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617661+0000", 2024-04-25T22:41:17.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:41:17.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:17.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617688+0000", 2024-04-25T22:41:17.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7589e-05 2024-04-25T22:41:17.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:17.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617710+0000", 2024-04-25T22:41:17.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1467e-05 2024-04-25T22:41:17.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:17.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617727+0000", 2024-04-25T22:41:17.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6990000000000002e-05 2024-04-25T22:41:17.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:17.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618559+0000", 2024-04-25T22:41:17.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083207400000000003 2024-04-25T22:41:17.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:17.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618608+0000", 2024-04-25T22:41:17.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8936e-05 2024-04-25T22:41:17.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:17.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624077+0000", 2024-04-25T22:41:17.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054695840000000004 2024-04-25T22:41:17.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:17.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624170+0000", 2024-04-25T22:41:17.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2305999999999993e-05 2024-04-25T22:41:17.686 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.686 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.686 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.687 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:17.687 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:17.687 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.975564552999998, 2024-04-25T22:41:17.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006879446, 2024-04-25T22:41:17.687 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:17.687 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:17.687 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:17.687 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:17.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:17.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:17.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:17.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:17.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:17.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622762+0000", 2024-04-25T22:41:17.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:41:17.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:17.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622781+0000", 2024-04-25T22:41:17.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8749999999999998e-05 2024-04-25T22:41:17.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:17.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622802+0000", 2024-04-25T22:41:17.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1650000000000001e-05 2024-04-25T22:41:17.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:17.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622816+0000", 2024-04-25T22:41:17.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3556e-05 2024-04-25T22:41:17.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:17.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623700+0000", 2024-04-25T22:41:17.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00088389299999999996 2024-04-25T22:41:17.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:17.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623741+0000", 2024-04-25T22:41:17.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1023999999999999e-05 2024-04-25T22:41:17.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:17.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629543+0000", 2024-04-25T22:41:17.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058023980000000003 2024-04-25T22:41:17.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:17.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629640+0000", 2024-04-25T22:41:17.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7381999999999997e-05 2024-04-25T22:41:17.691 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.691 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.691 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.692 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:17.692 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:17.692 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.975303349000001, 2024-04-25T22:41:17.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067054879999999999, 2024-04-25T22:41:17.692 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:17.692 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:17.692 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:17.692 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:17.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:17.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:17.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:17.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:17.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:17.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623032+0000", 2024-04-25T22:41:17.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.9930000000000007e-06 2024-04-25T22:41:17.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:17.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623043+0000", 2024-04-25T22:41:17.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0387000000000001e-05 2024-04-25T22:41:17.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:17.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623064+0000", 2024-04-25T22:41:17.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1849999999999999e-05 2024-04-25T22:41:17.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:17.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623079+0000", 2024-04-25T22:41:17.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4093e-05 2024-04-25T22:41:17.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:17.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624384+0000", 2024-04-25T22:41:17.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013054539999999999 2024-04-25T22:41:17.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:17.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624421+0000", 2024-04-25T22:41:17.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7088999999999997e-05 2024-04-25T22:41:17.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:17.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629645+0000", 2024-04-25T22:41:17.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052241400000000004 2024-04-25T22:41:17.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:17.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629728+0000", 2024-04-25T22:41:17.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2482000000000001e-05 2024-04-25T22:41:17.696 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.696 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.696 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.697 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2024-04-25T22:41:17.697 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:17.697 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.975220235999998, 2024-04-25T22:41:17.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078029559999999998, 2024-04-25T22:41:17.697 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:17.697 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:17.697 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:17.697 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:17.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:17.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:17.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:17.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:17.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:17.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:17.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623106+0000", 2024-04-25T22:41:17.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.64e-07 2024-04-25T22:41:17.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:17.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623141+0000", 2024-04-25T22:41:17.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4678999999999998e-05 2024-04-25T22:41:17.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:17.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623153+0000", 2024-04-25T22:41:17.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1759999999999999e-05 2024-04-25T22:41:17.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:17.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623161+0000", 2024-04-25T22:41:17.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8299999999999996e-06 2024-04-25T22:41:17.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:17.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623834+0000", 2024-04-25T22:41:17.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067394500000000001 2024-04-25T22:41:17.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:17.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623883+0000", 2024-04-25T22:41:17.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8640000000000002e-05 2024-04-25T22:41:17.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:17.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630807+0000", 2024-04-25T22:41:17.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069238859999999998 2024-04-25T22:41:17.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:17.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:17.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:17.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630908+0000", 2024-04-25T22:41:17.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101252 2024-04-25T22:41:17.701 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.701 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.701 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.701 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:17.701 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:17.701 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:17.702 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:17.704 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:17.704 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:17.705 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:17.701+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:17.803 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:17.801+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:17.836 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:17.836 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:17.836 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:17.836 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:17.853 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:17.904 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:17.902+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:18.005 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:18.001+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:18.016 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:18.016 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:18.016 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:18.016 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:18.016 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:18.030 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:18.117 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is unset 2024-04-25T22:41:18.118 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:18.117+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:18.202 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:18.202 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:18.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:18.202 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:18.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.202 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.202 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:18.202 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.604380159999998, 2024-04-25T22:41:18.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:18.203 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:18.203 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:18.203 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.203 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:18.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:18.203 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:18.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:18.203 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:18.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:18.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:18.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:18.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:18.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:18.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:18.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:18.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:18.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:18.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:18.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:18.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:18.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:18.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:18.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:18.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:18.206 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:18.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:18.206 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:18.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:18.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:18.206 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:18.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:18.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:18.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.207 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:18.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:18.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:18.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.207 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:18.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:18.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.208 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:18.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:18.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:18.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.208 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:18.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:18.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:18.208 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.209 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.209 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.209 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.209 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:18.209 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.604242904000003, 2024-04-25T22:41:18.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:18.209 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:18.209 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:18.209 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.209 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:18.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:18.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:18.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:18.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:18.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:18.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:18.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:18.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:18.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:18.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:18.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:18.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:18.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:18.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:18.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:18.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.212 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.212 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:18.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:18.212 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.212 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:18.212 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:18.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:18.212 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.212 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.212 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:18.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:18.212 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:18.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:18.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:18.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:18.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:18.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:18.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:18.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:18.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:18.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.214 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.214 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:18.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:18.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.214 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:18.214 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:18.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:18.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.214 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:18.214 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:18.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:18.214 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.214 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.215 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.215 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.215 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:18.215 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.604155351999999, 2024-04-25T22:41:18.215 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:18.215 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:18.215 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:18.215 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.215 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:18.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.215 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:18.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:18.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:18.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:18.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:18.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:18.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:18.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:18.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:18.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:18.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.217 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:18.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:18.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:18.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.217 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:18.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:18.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:18.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:18.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:18.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:18.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:18.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:18.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:18.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:18.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:18.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:18.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:18.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:18.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:18.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:18.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:18.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:18.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:18.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:18.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:18.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:18.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:18.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:18.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:18.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:18.221 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.221 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.221 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.221 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.221 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:18.221 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.604051525999999, 2024-04-25T22:41:18.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:18.221 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:18.221 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:18.221 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.221 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:18.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.222 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:18.222 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:18.222 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.222 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.222 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:18.222 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:18.222 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.222 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.222 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:18.222 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:18.222 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:18.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:18.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:18.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:18.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:18.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:18.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:18.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:18.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:18.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:18.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:18.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:18.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:18.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:18.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:18.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:18.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:18.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:18.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:18.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:18.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:18.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:18.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:18.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:18.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:18.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:18.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:18.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:18.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:18.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:18.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.227 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:18.227 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:18.227 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:18.227 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.227 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.227 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.227 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.227 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.227 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.227 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:18.227 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.603982735999999, 2024-04-25T22:41:18.227 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:18.227 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:18.227 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:18.228 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.228 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:18.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:18.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:18.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:18.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:18.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:18.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:18.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:18.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:18.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:18.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:18.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:18.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:18.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:18.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:18.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:18.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:18.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:18.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:18.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:18.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:18.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:18.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:18.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:18.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:18.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:18.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:18.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:18.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:18.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:18.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:18.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:18.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:18.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:18.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:18.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:18.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:18.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:18.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:18.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:18.233 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.233 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.233 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.233 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.234 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:18.234 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.603913650000003, 2024-04-25T22:41:18.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:18.234 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:18.234 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:18.234 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.234 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:18.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:18.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:18.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:18.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:18.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:18.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:18.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:18.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:18.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:18.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:18.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:18.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:18.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:18.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:18.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:18.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:18.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:18.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:18.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:18.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:18.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:18.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:18.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:18.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:18.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:18.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:18.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:18.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:18.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:18.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:18.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:18.239 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.239 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:18.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:18.239 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:18.239 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:18.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:18.239 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:18.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:18.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:18.240 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.240 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.240 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.240 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.240 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:18.240 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.603817536999998, 2024-04-25T22:41:18.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:18.240 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:18.240 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:18.241 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:18.241 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:18.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:18.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:18.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:18.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:18.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:18.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:18.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:18.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:18.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:18.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:18.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:18.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:18.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:18.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:18.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:18.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:18.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:18.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:18.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:18.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:18.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:18.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:18.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:18.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:18.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:18.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:18.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:18.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:18.245 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.245 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.245 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.245 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.245 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:18.245 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.603751875, 2024-04-25T22:41:18.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:18.245 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:18.245 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:18.245 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:18.245 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:18.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:18.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:18.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:18.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:18.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:18.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:18.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:18.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:18.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:18.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:18.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:18.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:18.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:18.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:18.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:18.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:18.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:18.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:18.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:18.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:18.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:18.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:18.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:18.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:18.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:18.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:18.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:18.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:18.249 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.249 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.249 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.250 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.250 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:18.250 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.603682747999997, 2024-04-25T22:41:18.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:18.250 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:18.250 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:18.250 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:18.250 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:18.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.250 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:18.250 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:18.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:18.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:18.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:18.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:18.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:18.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:18.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:18.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:18.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:18.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:18.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:18.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:18.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:18.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:18.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:18.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:18.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:18.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:18.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:18.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:18.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:18.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:18.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:18.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:18.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:18.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:18.254 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.254 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.254 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.254 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:18.254 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:18.254 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.592866092000001, 2024-04-25T22:41:18.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:18.255 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:18.255 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:18.255 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:18.255 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:18.255 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.255 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:18.255 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:18.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.255 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.255 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.255 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:18.255 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:18.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.255 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:18.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:18.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:18.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:18.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:18.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:18.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:18.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:18.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:18.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:18.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:18.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:18.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:18.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:18.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:18.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:18.258 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.258 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.258 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.258 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:18.258 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:18.258 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.575967738999999, 2024-04-25T22:41:18.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:18.258 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:18.258 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:18.258 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:18.258 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:18.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:18.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:18.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:18.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:18.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:18.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:18.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:18.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:18.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:18.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:18.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:18.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:18.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:18.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:18.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:18.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.261 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:18.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:18.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:18.261 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:18.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:18.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:18.261 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:18.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:18.261 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.262 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.262 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.262 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:18.262 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:18.262 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.575146848999999, 2024-04-25T22:41:18.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:18.262 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:18.262 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:18.262 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:18.262 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:18.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:18.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:18.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:18.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:18.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:18.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:18.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:18.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:18.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:18.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:18.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:18.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:18.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:18.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:18.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:18.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:18.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:18.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:18.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:18.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:18.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:18.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:18.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:18.265 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.265 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.265 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.266 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:18.266 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:18.266 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.573446121000003, 2024-04-25T22:41:18.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:18.266 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:18.266 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:18.266 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.266 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:18.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:18.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:18.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.267 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:18.267 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:18.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.267 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:18.267 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:18.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:18.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.267 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:18.267 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:18.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:18.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.268 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:18.268 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:18.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:18.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.268 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.268 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:18.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:18.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.268 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.268 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:18.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:18.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:18.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:18.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:18.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:18.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:18.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:18.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:18.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:18.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:18.270 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.270 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.270 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.270 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:18.270 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:18.270 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.572849445999999, 2024-04-25T22:41:18.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:18.270 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:18.270 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:18.270 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.270 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:18.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:18.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:18.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:18.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:18.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:18.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:18.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:18.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:18.272 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:18.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:18.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.272 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:18.272 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:18.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:18.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.272 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.272 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:18.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:18.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.273 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:18.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:18.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:18.273 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:18.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:18.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:18.273 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:18.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:18.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:18.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:18.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:18.274 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.274 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.274 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.274 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.274 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:18.274 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:18.274 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.56341372, 2024-04-25T22:41:18.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:18.274 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:18.274 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:18.275 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:18.275 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:18.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:18.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:18.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:18.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:18.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:18.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:18.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:18.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:18.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:18.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:18.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:18.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:18.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:18.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:18.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:18.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:18.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:18.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:18.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:18.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:18.277 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.277 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.278 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.278 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.278 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.278 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:18.278 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:18.278 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.562766293999999, 2024-04-25T22:41:18.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:18.278 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:18.278 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:18.278 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.278 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:18.278 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.278 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:18.278 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:18.279 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.279 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:18.279 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:18.279 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.279 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:18.279 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:18.279 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:18.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.279 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:18.279 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:18.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:18.280 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.280 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.280 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:18.280 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:18.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:18.280 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.280 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.280 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.280 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:18.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:18.280 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.280 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.280 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.280 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:18.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:18.281 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.281 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:18.281 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:18.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:18.281 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.281 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:18.281 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:18.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:18.281 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.281 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:18.281 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:18.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:18.282 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.282 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.282 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.282 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:18.282 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:18.282 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.561325474999997, 2024-04-25T22:41:18.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:18.282 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:18.282 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:18.282 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.282 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:18.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:18.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:18.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:18.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:18.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:18.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:18.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:18.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.284 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:18.284 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:18.284 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:18.284 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.284 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.284 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:18.284 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:18.284 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:18.284 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.284 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.284 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.284 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:18.284 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:18.284 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.285 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.285 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.285 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:18.285 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:18.285 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.285 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.285 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:18.285 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:18.285 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:18.285 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.285 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.285 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:18.285 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:18.285 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:18.285 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.286 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:18.286 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:18.286 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:18.286 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.286 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.286 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.286 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.286 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:18.286 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:18.286 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 61.608887031000002, 2024-04-25T22:41:18.286 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:18.286 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:18.287 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:18.287 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.287 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:18.287 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:18.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:18.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.287 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.287 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:18.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:18.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.287 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.287 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:18.288 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:18.288 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:18.288 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.288 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.288 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:18.288 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:18.288 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:18.288 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.288 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.288 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:18.288 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:18.288 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:18.288 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.288 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.289 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.289 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:18.289 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:18.289 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.289 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.289 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.289 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:18.289 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:18.289 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.289 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.289 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:18.289 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:18.289 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:18.289 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.289 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.290 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:18.290 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:18.290 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:18.290 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.290 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.290 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:18.290 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:18.290 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:18.290 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.290 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.290 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.290 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:18.290 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:18.290 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.291 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.291 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:18.291 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:18.291 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:18.291 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.291 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.291 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:18.291 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:18.291 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:18.291 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.291 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.291 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.291 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.291 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.291 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:18.292 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:18.292 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 39.606227707000002, 2024-04-25T22:41:18.292 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:18.292 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:18.292 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:18.292 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.292 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:18.292 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.292 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:18.292 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:18.292 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.292 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.292 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.292 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:18.293 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:18.293 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.293 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.293 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.293 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:18.293 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:18.293 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:18.293 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.293 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.293 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:18.293 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:18.293 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:18.293 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.293 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.293 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:18.294 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:18.294 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:18.294 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.294 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.294 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.294 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:18.294 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:18.294 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.294 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.294 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.294 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:18.294 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:18.294 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.294 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.295 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:18.295 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:18.295 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:18.295 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.295 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.295 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:18.295 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:18.295 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:18.295 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.295 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.295 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:18.295 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:18.295 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:18.295 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.295 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.296 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.296 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:18.296 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:18.296 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.296 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.296 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:18.296 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:18.296 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:18.296 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.296 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.296 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:18.296 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:18.296 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:18.296 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.296 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.297 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.297 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.297 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.297 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:18.297 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:18.297 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 34.605935455999997, 2024-04-25T22:41:18.297 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:18.297 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:18.297 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:18.297 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.297 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:18.297 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.297 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:18.297 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:18.298 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.298 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.298 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.298 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:18.298 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:18.298 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:18.298 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.298 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.298 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:18.298 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:18.298 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:18.298 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.298 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.298 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:18.298 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:18.299 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:18.299 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.299 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.299 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:18.299 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:18.299 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:18.299 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.299 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.299 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.299 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:18.299 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:18.299 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.299 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.299 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:18.299 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:18.300 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:18.300 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.300 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.300 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:18.300 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:18.300 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:18.300 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.300 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.300 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:18.300 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:18.300 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:18.300 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.300 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.300 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:18.301 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:18.301 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:18.301 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.301 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.301 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.301 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:18.301 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:18.301 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.301 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.301 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:18.301 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:18.301 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:18.301 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:18.301 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:18.301 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:18.301 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:18.302 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:18.302 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.302 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.302 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.302 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:18.302 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:18.302 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:18.304 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:18.304 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:18.302+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:18.405 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:18.402+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:18.436 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:18.436 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:18.436 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:41:18.436 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:18.452 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:18.505 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:18.506+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:18.573 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:18.574 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:18.574 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:18.574 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:18.574 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:18.588 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:18.628 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:18.630+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:18.636 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:41:18.636 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:41:18.636 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-25T22:41:18.637 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-25T22:41:18.707 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:18.706+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:18.753 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:18.753 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:41:18.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:41:18.753 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:41:18.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.753 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.753 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:18.753 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.157012660999996, 2024-04-25T22:41:18.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:41:18.753 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:18.753 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:18.754 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.754 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:18.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:18.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:18.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:18.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:18.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:18.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:41:18.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:41:18.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:18.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:41:18.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:41:18.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:18.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:41:18.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:41:18.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:41:18.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:41:18.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:41:18.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:41:18.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:18.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:41:18.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:41:18.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:41:18.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:41:18.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:18.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:41:18.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:41:18.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:18.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:41:18.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:41:18.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:41:18.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:41:18.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:18.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:41:18.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:41:18.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:18.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:41:18.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:41:18.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:18.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:41:18.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:41:18.759 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.759 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.759 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.759 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.759 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:18.759 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.156924648, 2024-04-25T22:41:18.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:41:18.759 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:18.759 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:18.759 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.759 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:18.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:18.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:18.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:18.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:18.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:18.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:41:18.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:41:18.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:18.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:18.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:41:18.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:18.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:41:18.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:41:18.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:41:18.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:41:18.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:41:18.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:41:18.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:18.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:18.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:41:18.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:41:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:41:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:41:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:41:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:41:18.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:41:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:41:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:41:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:41:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:41:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:18.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:41:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:41:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:41:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:41:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.156852525999994, 2024-04-25T22:41:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:41:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:18.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:41:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:41:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:18.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:41:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:41:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:41:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:41:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:41:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:41:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:41:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:41:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:41:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:41:18.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:41:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:41:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:41:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:41:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:41:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:41:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:41:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:41:18.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:41:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:41:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:41:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:41:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:41:18.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:41:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.156744212999996, 2024-04-25T22:41:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:41:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:41:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:41:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:41:18.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:41:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:41:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:41:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:41:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:41:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:41:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:41:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:41:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:41:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:41:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:41:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:41:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:41:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:41:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:41:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:41:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:41:18.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:41:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:41:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:41:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:41:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:41:18.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:41:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.156677556999995, 2024-04-25T22:41:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:41:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:18.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:41:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:41:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:41:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:41:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:41:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:41:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:41:18.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:41:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:41:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:41:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:41:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:41:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:41:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:41:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:41:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:41:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:41:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:41:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:41:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:41:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:41:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:41:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:41:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:41:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:41:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:41:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.156586961000002, 2024-04-25T22:41:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:41:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:41:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:41:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:41:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:41:18.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:41:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:41:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:41:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:41:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:41:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:41:18.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:41:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:41:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:41:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:41:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:41:18.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:41:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:41:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:41:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:41:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:41:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:41:18.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:41:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:41:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:41:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:41:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:41:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.156522387999999, 2024-04-25T22:41:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:41:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:41:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:41:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:41:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:41:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:41:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:41:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:41:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:41:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:41:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:41:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:41:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:41:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:41:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:41:18.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:41:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:41:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:41:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:41:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:41:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:41:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:41:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:41:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:41:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:41:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:41:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.156456965000004, 2024-04-25T22:41:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:41:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:18.799 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:41:18.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:41:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:41:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:41:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:41:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:41:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:41:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:41:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:41:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:41:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:41:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:41:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:41:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:41:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:41:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:41:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:41:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:41:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:41:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:41:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:41:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:41:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:41:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:41:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:41:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.156400899000005, 2024-04-25T22:41:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:41:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:18.805 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:18.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:41:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:41:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:41:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:41:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:41:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:41:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:41:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:41:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:41:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:41:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:41:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:41:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:41:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:41:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:41:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:41:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:41:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:41:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:41:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:41:18.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:41:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:41:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:41:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:41:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:41:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.812 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.156333793000002, 2024-04-25T22:41:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:41:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:41:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:41:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:41:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:41:18.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:41:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:41:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:41:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:41:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:41:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:41:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:41:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:41:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:41:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:41:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:41:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:41:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:41:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:41:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:41:18.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:41:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:41:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:41:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:18.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:41:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:41:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:41:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:41:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.819 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.156278670000006, 2024-04-25T22:41:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:41:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:18.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:41:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:41:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:41:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:18.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:41:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:41:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:41:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:41:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:41:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:41:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:18.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:41:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:41:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:41:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:41:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:41:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:41:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:41:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:41:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:41:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:41:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:41:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:41:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:41:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:41:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:41:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:41:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.825 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.156176431000006, 2024-04-25T22:41:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:41:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:18.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:41:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:41:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:41:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:41:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:18.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:41:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:41:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:41:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:41:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:41:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:41:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:41:18.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:41:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:41:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:41:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:41:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:41:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:41:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:41:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:41:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:41:18.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:41:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:41:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:41:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:41:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:41:18.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:41:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.156117608000002, 2024-04-25T22:41:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:41:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:18.832 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:41:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:41:18.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:41:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:41:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:41:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:41:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:41:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:41:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:41:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:41:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:41:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:41:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:41:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:41:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:41:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:41:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:41:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:41:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:18.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:41:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:41:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:41:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:41:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:41:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:41:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:41:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:41:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.156038874999993, 2024-04-25T22:41:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:41:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:18.838 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:41:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:41:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:41:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:41:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:41:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:41:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:41:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:41:18.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:41:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:41:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:41:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:41:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:41:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:18.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:41:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:41:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:41:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:41:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:41:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:41:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:41:18.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:41:18.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:18.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:41:18.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:41:18.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:18.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:41:18.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:41:18.844 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.155999461999997, 2024-04-25T22:41:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:41:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:18.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:41:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:41:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:41:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:41:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:41:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:41:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:41:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:41:18.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:41:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:41:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:41:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:41:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:41:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:41:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:41:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:41:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:41:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:41:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:41:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:41:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:41:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:41:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:41:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:41:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:41:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:41:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.155929615999995, 2024-04-25T22:41:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:41:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:18.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:41:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:41:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:41:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:41:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:41:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:41:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:41:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:41:18.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:41:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:41:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:41:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:41:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:41:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:41:18.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:41:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:41:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:41:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:41:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:41:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:41:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:41:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:41:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:41:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:41:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:41:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:41:18.857 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.155879878999997, 2024-04-25T22:41:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:41:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:18.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:41:18.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:41:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:41:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:41:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:41:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:41:18.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:41:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:41:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:41:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:41:18.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:41:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:41:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:41:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:41:18.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:41:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:41:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:41:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:41:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:41:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:41:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:41:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:41:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:41:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:41:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.155795264000005, 2024-04-25T22:41:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:41:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:41:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:41:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:41:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:41:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:41:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:41:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:41:18.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:41:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:41:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:41:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:41:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:41:18.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:41:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:41:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:41:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:41:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:41:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:41:18.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:41:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:41:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:41:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:41:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:41:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:41:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:41:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.155731614000004, 2024-04-25T22:41:18.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:41:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:41:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:18.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:41:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:41:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:18.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:41:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:41:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:41:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:41:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:41:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:41:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:41:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:41:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:41:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:41:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:41:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:41:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:41:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:41:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:41:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:41:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:18.876 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.148728083999998, 2024-04-25T22:41:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:41:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:18.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:41:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:41:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:41:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:41:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:41:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:41:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:41:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:41:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:41:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:41:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:41:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:41:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:41:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:41:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:41:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:41:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:18.881 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:18.881 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:18.883 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:41:18.884 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:18.882+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:18.947 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:41:18.947 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:41:18.947 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 40, 2024-04-25T22:41:18.948 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d", 2024-04-25T22:41:18.948 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2024-04-25T22:39:52.303074+0000", 2024-04-25T22:41:18.948 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2024-04-25T22:41:18.082714+0000", 2024-04-25T22:41:18.948 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2024-04-25T22:40:01.251093+0000", 2024-04-25T22:41:18.948 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2024-04-25T22:39:53.230242+0000", 2024-04-25T22:41:18.948 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-25T22:41:18.948 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5804032, 2024-04-25T22:41:18.948 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2024-04-25T22:41:18.948 INFO:teuthology.orchestra.run.smithi057.stdout: "nodeep-scrub", 2024-04-25T22:41:18.948 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2024-04-25T22:41:18.948 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2024-04-25T22:41:18.948 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2024-04-25T22:41:18.948 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2024-04-25T22:41:18.949 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:41:18.949 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 4, 2024-04-25T22:41:18.949 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2024-04-25T22:41:18.949 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-25T22:41:18.949 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-25T22:41:18.949 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2024-04-25T22:41:18.949 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 4, 2024-04-25T22:41:18.949 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 3, 2024-04-25T22:41:18.949 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "luminous", 2024-04-25T22:41:18.949 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2024-04-25T22:41:18.949 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "squid", 2024-04-25T22:41:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: "allow_crimson": false, 2024-04-25T22:41:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2024-04-25T22:41:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2024-04-25T22:41:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": ".mgr", 2024-04-25T22:41:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25T22:40:03.197725+0000", 2024-04-25T22:41:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T22:41:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T22:41:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T22:41:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T22:41:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T22:41:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T22:41:18.950 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:41:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:41:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:41:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:41:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T22:41:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:41:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2024-04-25T22:41:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2024-04-25T22:41:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2024-04-25T22:41:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2024-04-25T22:41:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2024-04-25T22:41:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T22:41:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T22:41:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T22:41:18.951 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T22:41:18.952 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T22:41:18.952 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T22:41:18.952 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T22:41:18.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.952 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "12", 2024-04-25T22:41:18.952 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T22:41:18.952 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:41:18.952 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:41:18.952 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T22:41:18.952 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:41:18.952 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T22:41:18.952 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T22:41:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T22:41:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T22:41:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T22:41:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T22:41:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T22:41:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T22:41:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T22:41:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T22:41:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T22:41:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T22:41:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T22:41:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:41:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:41:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:41:18.953 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T22:41:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T22:41:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T22:41:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T22:41:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T22:41:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T22:41:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T22:41:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T22:41:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:41:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:41:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:41:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:41:18.954 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T22:41:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T22:41:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T22:41:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T22:41:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2024-04-25T22:41:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_max": 32, 2024-04-25T22:41:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2024-04-25T22:41:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T22:41:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": {} 2024-04-25T22:41:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "read_balance": { 2024-04-25T22:41:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "error_message": "pool 1 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-04-25T22:41:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "score_acting": 0, 2024-04-25T22:41:18.955 INFO:teuthology.orchestra.run.smithi057.stdout: "score_stable": 0 2024-04-25T22:41:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2024-04-25T22:41:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2024-04-25T22:41:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25T22:40:07.560858+0000", 2024-04-25T22:41:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T22:41:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T22:41:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T22:41:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T22:41:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T22:41:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T22:41:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:41:18.956 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:41:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:41:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:41:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T22:41:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:41:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2024-04-25T22:41:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2024-04-25T22:41:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2024-04-25T22:41:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2024-04-25T22:41:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2024-04-25T22:41:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T22:41:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T22:41:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T22:41:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T22:41:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T22:41:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T22:41:18.957 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T22:41:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2024-04-25T22:41:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T22:41:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:41:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:41:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T22:41:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:41:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T22:41:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T22:41:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T22:41:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T22:41:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T22:41:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T22:41:18.959 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T22:41:18.959 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T22:41:18.959 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T22:41:18.959 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T22:41:18.959 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T22:41:18.959 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T22:41:18.959 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T22:41:18.959 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:41:18.959 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:41:18.959 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:41:18.959 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T22:41:18.959 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T22:41:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T22:41:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T22:41:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T22:41:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T22:41:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T22:41:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T22:41:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:41:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:41:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:41:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:41:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T22:41:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T22:41:18.960 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T22:41:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T22:41:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2024-04-25T22:41:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T22:41:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2024-04-25T22:41:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "read_balance": { 2024-04-25T22:41:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "error_message": "pool 2 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-04-25T22:41:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "score_acting": 0, 2024-04-25T22:41:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "score_stable": 0 2024-04-25T22:41:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 3, 2024-04-25T22:41:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_metadata", 2024-04-25T22:41:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25T22:40:12.431697+0000", 2024-04-25T22:41:18.961 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T22:41:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T22:41:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T22:41:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T22:41:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T22:41:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T22:41:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:41:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:41:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:41:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:41:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T22:41:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:41:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 32, 2024-04-25T22:41:18.962 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 32, 2024-04-25T22:41:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 32, 2024-04-25T22:41:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 32, 2024-04-25T22:41:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 32, 2024-04-25T22:41:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T22:41:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T22:41:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T22:41:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T22:41:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T22:41:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T22:41:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T22:41:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.963 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2024-04-25T22:41:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T22:41:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:41:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:41:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T22:41:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:41:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T22:41:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T22:41:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T22:41:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T22:41:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T22:41:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T22:41:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T22:41:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T22:41:18.964 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T22:41:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T22:41:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T22:41:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T22:41:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T22:41:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:41:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:41:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:41:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T22:41:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T22:41:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T22:41:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T22:41:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T22:41:18.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T22:41:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T22:41:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T22:41:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:41:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:41:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:41:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:41:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T22:41:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T22:41:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T22:41:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T22:41:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2024-04-25T22:41:18.966 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_bias": 4, 2024-04-25T22:41:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 16, 2024-04-25T22:41:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_priority": 5 2024-04-25T22:41:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T22:41:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2024-04-25T22:41:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": "cephfs" 2024-04-25T22:41:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: "read_balance": { 2024-04-25T22:41:18.967 INFO:teuthology.orchestra.run.smithi057.stdout: "error_message": "pool 3 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-04-25T22:41:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: "score_acting": 0, 2024-04-25T22:41:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: "score_stable": 0 2024-04-25T22:41:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 4, 2024-04-25T22:41:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_data", 2024-04-25T22:41:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25T22:40:12.919828+0000", 2024-04-25T22:41:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T22:41:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T22:41:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T22:41:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T22:41:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T22:41:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T22:41:18.968 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:41:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:41:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:41:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:41:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T22:41:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:41:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 64, 2024-04-25T22:41:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 64, 2024-04-25T22:41:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 64, 2024-04-25T22:41:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 64, 2024-04-25T22:41:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 64, 2024-04-25T22:41:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T22:41:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T22:41:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T22:41:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T22:41:18.969 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T22:41:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T22:41:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T22:41:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "19", 2024-04-25T22:41:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T22:41:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:41:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:41:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T22:41:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:41:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T22:41:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T22:41:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T22:41:18.970 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T22:41:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T22:41:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T22:41:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T22:41:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T22:41:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T22:41:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T22:41:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T22:41:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T22:41:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T22:41:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:41:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:41:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:41:18.971 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T22:41:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T22:41:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T22:41:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T22:41:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T22:41:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T22:41:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T22:41:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T22:41:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:41:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:41:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:41:18.972 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:41:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T22:41:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T22:41:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T22:41:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T22:41:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2024-04-25T22:41:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 64, 2024-04-25T22:41:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: "target_size_ratio": 0.89999997615814209 2024-04-25T22:41:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T22:41:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2024-04-25T22:41:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: "data": "cephfs" 2024-04-25T22:41:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.973 INFO:teuthology.orchestra.run.smithi057.stdout: "read_balance": { 2024-04-25T22:41:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: "error_message": "pool 4 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-04-25T22:41:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: "score_acting": 0, 2024-04-25T22:41:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: "score_stable": 0 2024-04-25T22:41:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:41:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2024-04-25T22:41:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2024-04-25T22:41:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "73d465b4-5896-4d69-80b1-7e69d31eb455", 2024-04-25T22:41:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T22:41:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T22:41:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T22:41:18.974 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2024-04-25T22:41:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T22:41:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T22:41:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 8, 2024-04-25T22:41:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 30, 2024-04-25T22:41:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T22:41:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T22:41:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T22:41:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.975 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:18.976 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6800", 2024-04-25T22:41:18.976 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:18.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.976 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:18.976 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6801", 2024-04-25T22:41:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T22:41:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:18.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6802", 2024-04-25T22:41:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6803", 2024-04-25T22:41:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T22:41:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6806", 2024-04-25T22:41:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6807", 2024-04-25T22:41:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.979 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T22:41:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6804", 2024-04-25T22:41:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6805", 2024-04-25T22:41:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.980 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.122:6801/765118869", 2024-04-25T22:41:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.122:6803/765118869", 2024-04-25T22:41:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.122:6807/765118869", 2024-04-25T22:41:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.122:6805/765118869", 2024-04-25T22:41:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T22:41:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T22:41:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T22:41:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2024-04-25T22:41:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5", 2024-04-25T22:41:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T22:41:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T22:41:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T22:41:18.981 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 0, 2024-04-25T22:41:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T22:41:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T22:41:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 8, 2024-04-25T22:41:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 30, 2024-04-25T22:41:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T22:41:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T22:41:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T22:41:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6800", 2024-04-25T22:41:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:18.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6801", 2024-04-25T22:41:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T22:41:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6802", 2024-04-25T22:41:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:18.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6803", 2024-04-25T22:41:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T22:41:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6806", 2024-04-25T22:41:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6807", 2024-04-25T22:41:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T22:41:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6804", 2024-04-25T22:41:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.985 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6805", 2024-04-25T22:41:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.148:6801/2387035286", 2024-04-25T22:41:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.148:6803/2387035286", 2024-04-25T22:41:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.148:6807/2387035286", 2024-04-25T22:41:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.148:6805/2387035286", 2024-04-25T22:41:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T22:41:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T22:41:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T22:41:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:18.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2024-04-25T22:41:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "164fc653-2135-4e9b-8826-1716fdba6ea0", 2024-04-25T22:41:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T22:41:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T22:41:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T22:41:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 0, 2024-04-25T22:41:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T22:41:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T22:41:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 8, 2024-04-25T22:41:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 20, 2024-04-25T22:41:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T22:41:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T22:41:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T22:41:18.987 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6800", 2024-04-25T22:41:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:18.988 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6801", 2024-04-25T22:41:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T22:41:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:18.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.990 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:18.990 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6802", 2024-04-25T22:41:18.990 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:18.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.990 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6803", 2024-04-25T22:41:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T22:41:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:18.991 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6806", 2024-04-25T22:41:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6807", 2024-04-25T22:41:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T22:41:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6804", 2024-04-25T22:41:18.992 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6805", 2024-04-25T22:41:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.188:6801/368834361", 2024-04-25T22:41:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.188:6803/368834361", 2024-04-25T22:41:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.188:6807/368834361", 2024-04-25T22:41:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.188:6805/368834361", 2024-04-25T22:41:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T22:41:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T22:41:18.993 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T22:41:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:41:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2024-04-25T22:41:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2024-04-25T22:41:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T22:41:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T22:41:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T22:41:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540701547738038271, 2024-04-25T22:41:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2024-04-25T22:41:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2024-04-25T22:39:58.559393+0000", 2024-04-25T22:41:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2024-04-25T22:41:18.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2024-04-25T22:41:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T22:41:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T22:41:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T22:41:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540701547738038271, 2024-04-25T22:41:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2024-04-25T22:41:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2024-04-25T22:39:58.563434+0000", 2024-04-25T22:41:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2024-04-25T22:41:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2024-04-25T22:41:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T22:41:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T22:41:18.995 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T22:41:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540701547738038271, 2024-04-25T22:41:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2024-04-25T22:41:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2024-04-25T22:39:58.557643+0000", 2024-04-25T22:41:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2024-04-25T22:41:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:41:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2024-04-25T22:41:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2024-04-25T22:41:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_primaries": [], 2024-04-25T22:41:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2024-04-25T22:41:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2024-04-25T22:41:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "blocklist": {}, 2024-04-25T22:41:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "range_blocklist": {}, 2024-04-25T22:41:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2024-04-25T22:41:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2024-04-25T22:41:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2024-04-25T22:41:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2024-04-25T22:41:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2024-04-25T22:41:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2024-04-25T22:41:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2024-04-25T22:41:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2024-04-25T22:41:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2024-04-25T22:41:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2024-04-25T22:41:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2024-04-25T22:41:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {}, 2024-04-25T22:41:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_mode": { 2024-04-25T22:41:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_mode_enabled": false, 2024-04-25T22:41:18.997 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_bucket_count": 0, 2024-04-25T22:41:18.998 INFO:teuthology.orchestra.run.smithi057.stdout: "degraded_stretch_mode": 0, 2024-04-25T22:41:18.998 INFO:teuthology.orchestra.run.smithi057.stdout: "recovering_stretch_mode": 0, 2024-04-25T22:41:18.998 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_mode_bucket": 0 2024-04-25T22:41:18.998 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:18.998 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:41:19.000 INFO:tasks.thrashosds.thrasher:j is {'epoch': 40, 'fsid': '5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d', 'created': '2024-04-25T22:39:52.303074+0000', 'modified': '2024-04-25T22:41:18.082714+0000', 'last_up_change': '2024-04-25T22:40:01.251093+0000', 'last_in_change': '2024-04-25T22:39:53.230242+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:40:03.197725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'error_message': 'pool 1 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:40:07.560858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:40:12.431697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'error_message': 'pool 3 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:40:12.919828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 4 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': '73d465b4-5896-4d69-80b1-7e69d31eb455', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6800', 'nonce': 765118869}, {'type': 'v1', 'addr': '172.21.15.122:6801', 'nonce': 765118869}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6802', 'nonce': 765118869}, {'type': 'v1', 'addr': '172.21.15.122:6803', 'nonce': 765118869}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6806', 'nonce': 765118869}, {'type': 'v1', 'addr': '172.21.15.122:6807', 'nonce': 765118869}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6804', 'nonce': 765118869}, {'type': 'v1', 'addr': '172.21.15.122:6805', 'nonce': 765118869}]}, 'public_addr': '172.21.15.122:6801/765118869', 'cluster_addr': '172.21.15.122:6803/765118869', 'heartbeat_back_addr': '172.21.15.122:6807/765118869', 'heartbeat_front_addr': '172.21.15.122:6805/765118869', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6800', 'nonce': 2387035286}, {'type': 'v1', 'addr': '172.21.15.148:6801', 'nonce': 2387035286}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6802', 'nonce': 2387035286}, {'type': 'v1', 'addr': '172.21.15.148:6803', 'nonce': 2387035286}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6806', 'nonce': 2387035286}, {'type': 'v1', 'addr': '172.21.15.148:6807', 'nonce': 2387035286}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6804', 'nonce': 2387035286}, {'type': 'v1', 'addr': '172.21.15.148:6805', 'nonce': 2387035286}]}, 'public_addr': '172.21.15.148:6801/2387035286', 'cluster_addr': '172.21.15.148:6803/2387035286', 'heartbeat_back_addr': '172.21.15.148:6807/2387035286', 'heartbeat_front_addr': '172.21.15.148:6805/2387035286', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '164fc653-2135-4e9b-8826-1716fdba6ea0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 20, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6800', 'nonce': 368834361}, {'type': 'v1', 'addr': '172.21.15.188:6801', 'nonce': 368834361}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6802', 'nonce': 368834361}, {'type': 'v1', 'addr': '172.21.15.188:6803', 'nonce': 368834361}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6806', 'nonce': 368834361}, {'type': 'v1', 'addr': '172.21.15.188:6807', 'nonce': 368834361}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6804', 'nonce': 368834361}, {'type': 'v1', 'addr': '172.21.15.188:6805', 'nonce': 368834361}]}, 'public_addr': '172.21.15.188:6801/368834361', 'cluster_addr': '172.21.15.188:6803/368834361', 'heartbeat_back_addr': '172.21.15.188:6807/368834361', 'heartbeat_front_addr': '172.21.15.188:6805/368834361', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:39:58.559393+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:39:58.563434+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:39:58.557643+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-25T22:41:19.000 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:41:19.001 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:18.998+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:19.014 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:19.015 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:41:19.015 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-04-25T22:41:19.015 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:19.030 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:41:19.100 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:19.098+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:19.149 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:19.149 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:41:19.150 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-04-25T22:41:19.150 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-04-25T22:41:19.150 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:19.165 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:41:19.201 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:19.202+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:19.303 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:19.302+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:19.316 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:41:19.318 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:41:19.332 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-04-25T22:41:19.138781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91572,"kb_used_data":2192,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283023948,"statfs":{"total":289910292480,"available":289816522752,"internally_reserved":0,"allocated":2244608,"data_stored":1622344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.361492"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:15.162690+0000","last_change":"2024-04-25T22:40:52.548943+0000","last_active":"2024-04-25T22:41:15.162690+0000","last_peered":"2024-04-25T22:41:15.162690+0000","last_clean":"2024-04-25T22:41:15.162690+0000","last_became_active":"2024-04-25T22:40:52.548128+0000","last_became_peered":"2024-04-25T22:40:52.548128+0000","last_unstale":"2024-04-25T22:41:15.162690+0000","last_undegraded":"2024-04-25T22:41:15.162690+0000","last_fullsized":"2024-04-25T22:41:15.162690+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:54.909669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:15.162014+0000","last_change":"2024-04-25T22:40:52.550578+0000","last_active":"2024-04-25T22:41:15.162014+0000","last_peered":"2024-04-25T22:41:15.162014+0000","last_clean":"2024-04-25T22:41:15.162014+0000","last_became_active":"2024-04-25T22:40:52.549692+0000","last_became_peered":"2024-04-25T22:40:52.549692+0000","last_unstale":"2024-04-25T22:41:15.162014+0000","last_undegraded":"2024-04-25T22:41:15.162014+0000","last_fullsized":"2024-04-25T22:41:15.162014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:20.260974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804915+0000","last_change":"2024-04-25T22:40:14.626211+0000","last_active":"2024-04-25T22:41:14.804915+0000","last_peered":"2024-04-25T22:41:14.804915+0000","last_clean":"2024-04-25T22:41:14.804915+0000","last_became_active":"2024-04-25T22:40:14.622625+0000","last_became_peered":"2024-04-25T22:40:14.622625+0000","last_unstale":"2024-04-25T22:41:14.804915+0000","last_undegraded":"2024-04-25T22:41:14.804915+0000","last_fullsized":"2024-04-25T22:41:14.804915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:35.993000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804202+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:41:14.804202+0000","last_peered":"2024-04-25T22:41:14.804202+0000","last_clean":"2024-04-25T22:41:14.804202+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:41:14.804202+0000","last_undegraded":"2024-04-25T22:41:14.804202+0000","last_fullsized":"2024-04-25T22:41:14.804202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:15.161700+0000","last_change":"2024-04-25T22:40:52.541944+0000","last_active":"2024-04-25T22:41:15.161700+0000","last_peered":"2024-04-25T22:41:15.161700+0000","last_clean":"2024-04-25T22:41:15.161700+0000","last_became_active":"2024-04-25T22:40:52.540674+0000","last_became_peered":"2024-04-25T22:40:52.540674+0000","last_unstale":"2024-04-25T22:41:15.161700+0000","last_undegraded":"2024-04-25T22:41:15.161700+0000","last_fullsized":"2024-04-25T22:41:15.161700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:47:46.321875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803301+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:41:14.803301+0000","last_peered":"2024-04-25T22:41:14.803301+0000","last_clean":"2024-04-25T22:41:14.803301+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:41:14.803301+0000","last_undegraded":"2024-04-25T22:41:14.803301+0000","last_fullsized":"2024-04-25T22:41:14.803301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803194+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:41:14.803194+0000","last_peered":"2024-04-25T22:41:14.803194+0000","last_clean":"2024-04-25T22:41:14.803194+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:41:14.803194+0000","last_undegraded":"2024-04-25T22:41:14.803194+0000","last_fullsized":"2024-04-25T22:41:14.803194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.802615+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:41:14.802615+0000","last_peered":"2024-04-25T22:41:14.802615+0000","last_clean":"2024-04-25T22:41:14.802615+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:41:14.802615+0000","last_undegraded":"2024-04-25T22:41:14.802615+0000","last_fullsized":"2024-04-25T22:41:14.802615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.800708+0000","last_change":"2024-04-25T22:40:14.625922+0000","last_active":"2024-04-25T22:41:14.800708+0000","last_peered":"2024-04-25T22:41:14.800708+0000","last_clean":"2024-04-25T22:41:14.800708+0000","last_became_active":"2024-04-25T22:40:14.624594+0000","last_became_peered":"2024-04-25T22:40:14.624594+0000","last_unstale":"2024-04-25T22:41:14.800708+0000","last_undegraded":"2024-04-25T22:41:14.800708+0000","last_fullsized":"2024-04-25T22:41:14.800708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:15.162216+0000","last_change":"2024-04-25T22:40:52.549807+0000","last_active":"2024-04-25T22:41:15.162216+0000","last_peered":"2024-04-25T22:41:15.162216+0000","last_clean":"2024-04-25T22:41:15.162216+0000","last_became_active":"2024-04-25T22:40:52.549077+0000","last_became_peered":"2024-04-25T22:40:52.549077+0000","last_unstale":"2024-04-25T22:41:15.162216+0000","last_undegraded":"2024-04-25T22:41:15.162216+0000","last_fullsized":"2024-04-25T22:41:15.162216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:31.194700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804859+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:41:14.804859+0000","last_peered":"2024-04-25T22:41:14.804859+0000","last_clean":"2024-04-25T22:41:14.804859+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:41:14.804859+0000","last_undegraded":"2024-04-25T22:41:14.804859+0000","last_fullsized":"2024-04-25T22:41:14.804859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803840+0000","last_change":"2024-04-25T22:40:36.305351+0000","last_active":"2024-04-25T22:41:14.803840+0000","last_peered":"2024-04-25T22:41:14.803840+0000","last_clean":"2024-04-25T22:41:14.803840+0000","last_became_active":"2024-04-25T22:40:36.303042+0000","last_became_peered":"2024-04-25T22:40:36.303042+0000","last_unstale":"2024-04-25T22:41:14.803840+0000","last_undegraded":"2024-04-25T22:41:14.803840+0000","last_fullsized":"2024-04-25T22:41:14.803840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:37.971547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:15.161244+0000","last_change":"2024-04-25T22:40:52.543478+0000","last_active":"2024-04-25T22:41:15.161244+0000","last_peered":"2024-04-25T22:41:15.161244+0000","last_clean":"2024-04-25T22:41:15.161244+0000","last_became_active":"2024-04-25T22:40:52.541693+0000","last_became_peered":"2024-04-25T22:40:52.541693+0000","last_unstale":"2024-04-25T22:41:15.161244+0000","last_undegraded":"2024-04-25T22:41:15.161244+0000","last_fullsized":"2024-04-25T22:41:15.161244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:24.977111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803451+0000","last_change":"2024-04-25T22:40:14.616800+0000","last_active":"2024-04-25T22:41:14.803451+0000","last_peered":"2024-04-25T22:41:14.803451+0000","last_clean":"2024-04-25T22:41:14.803451+0000","last_became_active":"2024-04-25T22:40:14.612887+0000","last_became_peered":"2024-04-25T22:40:14.612887+0000","last_unstale":"2024-04-25T22:41:14.803451+0000","last_undegraded":"2024-04-25T22:41:14.803451+0000","last_fullsized":"2024-04-25T22:41:14.803451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803321+0000","last_change":"2024-04-25T22:40:14.615520+0000","last_active":"2024-04-25T22:41:14.803321+0000","last_peered":"2024-04-25T22:41:14.803321+0000","last_clean":"2024-04-25T22:41:14.803321+0000","last_became_active":"2024-04-25T22:40:14.613556+0000","last_became_peered":"2024-04-25T22:40:14.613556+0000","last_unstale":"2024-04-25T22:41:14.803321+0000","last_undegraded":"2024-04-25T22:41:14.803321+0000","last_fullsized":"2024-04-25T22:41:14.803321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:27:30.403915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.802667+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:41:14.802667+0000","last_peered":"2024-04-25T22:41:14.802667+0000","last_clean":"2024-04-25T22:41:14.802667+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:41:14.802667+0000","last_undegraded":"2024-04-25T22:41:14.802667+0000","last_fullsized":"2024-04-25T22:41:14.802667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.801113+0000","last_change":"2024-04-25T22:40:14.628222+0000","last_active":"2024-04-25T22:41:14.801113+0000","last_peered":"2024-04-25T22:41:14.801113+0000","last_clean":"2024-04-25T22:41:14.801113+0000","last_became_active":"2024-04-25T22:40:14.626913+0000","last_became_peered":"2024-04-25T22:40:14.626913+0000","last_unstale":"2024-04-25T22:41:14.801113+0000","last_undegraded":"2024-04-25T22:41:14.801113+0000","last_fullsized":"2024-04-25T22:41:14.801113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:15.162532+0000","last_change":"2024-04-25T22:40:52.545016+0000","last_active":"2024-04-25T22:41:15.162532+0000","last_peered":"2024-04-25T22:41:15.162532+0000","last_clean":"2024-04-25T22:41:15.162532+0000","last_became_active":"2024-04-25T22:40:52.544350+0000","last_became_peered":"2024-04-25T22:40:52.544350+0000","last_unstale":"2024-04-25T22:41:15.162532+0000","last_undegraded":"2024-04-25T22:41:15.162532+0000","last_fullsized":"2024-04-25T22:41:15.162532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:06:25.816264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.800645+0000","last_change":"2024-04-25T22:40:14.623704+0000","last_active":"2024-04-25T22:41:14.800645+0000","last_peered":"2024-04-25T22:41:14.800645+0000","last_clean":"2024-04-25T22:41:14.800645+0000","last_became_active":"2024-04-25T22:40:14.623146+0000","last_became_peered":"2024-04-25T22:40:14.623146+0000","last_unstale":"2024-04-25T22:41:14.800645+0000","last_undegraded":"2024-04-25T22:41:14.800645+0000","last_fullsized":"2024-04-25T22:41:14.800645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804478+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:41:14.804478+0000","last_peered":"2024-04-25T22:41:14.804478+0000","last_clean":"2024-04-25T22:41:14.804478+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:41:14.804478+0000","last_undegraded":"2024-04-25T22:41:14.804478+0000","last_fullsized":"2024-04-25T22:41:14.804478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803813+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:41:14.803813+0000","last_peered":"2024-04-25T22:41:14.803813+0000","last_clean":"2024-04-25T22:41:14.803813+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:41:14.803813+0000","last_undegraded":"2024-04-25T22:41:14.803813+0000","last_fullsized":"2024-04-25T22:41:14.803813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.802720+0000","last_change":"2024-04-25T22:40:36.305858+0000","last_active":"2024-04-25T22:41:14.802720+0000","last_peered":"2024-04-25T22:41:14.802720+0000","last_clean":"2024-04-25T22:41:14.802720+0000","last_became_active":"2024-04-25T22:40:36.304730+0000","last_became_peered":"2024-04-25T22:40:36.304730+0000","last_unstale":"2024-04-25T22:41:14.802720+0000","last_undegraded":"2024-04-25T22:41:14.802720+0000","last_fullsized":"2024-04-25T22:41:14.802720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:44.949501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803567+0000","last_change":"2024-04-25T22:40:52.547012+0000","last_active":"2024-04-25T22:41:14.803567+0000","last_peered":"2024-04-25T22:41:14.803567+0000","last_clean":"2024-04-25T22:41:14.803567+0000","last_became_active":"2024-04-25T22:40:52.544993+0000","last_became_peered":"2024-04-25T22:40:52.544993+0000","last_unstale":"2024-04-25T22:41:14.803567+0000","last_undegraded":"2024-04-25T22:41:14.803567+0000","last_fullsized":"2024-04-25T22:41:14.803567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:35.659946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:15.160553+0000","last_change":"2024-04-25T22:40:52.540423+0000","last_active":"2024-04-25T22:41:15.160553+0000","last_peered":"2024-04-25T22:41:15.160553+0000","last_clean":"2024-04-25T22:41:15.160553+0000","last_became_active":"2024-04-25T22:40:52.539164+0000","last_became_peered":"2024-04-25T22:40:52.539164+0000","last_unstale":"2024-04-25T22:41:15.160553+0000","last_undegraded":"2024-04-25T22:41:15.160553+0000","last_fullsized":"2024-04-25T22:41:15.160553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:25.839134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804389+0000","last_change":"2024-04-25T22:40:36.304773+0000","last_active":"2024-04-25T22:41:14.804389+0000","last_peered":"2024-04-25T22:41:14.804389+0000","last_clean":"2024-04-25T22:41:14.804389+0000","last_became_active":"2024-04-25T22:40:36.304073+0000","last_became_peered":"2024-04-25T22:40:36.304073+0000","last_unstale":"2024-04-25T22:41:14.804389+0000","last_undegraded":"2024-04-25T22:41:14.804389+0000","last_fullsized":"2024-04-25T22:41:14.804389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:02.464879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.805169+0000","last_change":"2024-04-25T22:40:52.546683+0000","last_active":"2024-04-25T22:41:14.805169+0000","last_peered":"2024-04-25T22:41:14.805169+0000","last_clean":"2024-04-25T22:41:14.805169+0000","last_became_active":"2024-04-25T22:40:52.544838+0000","last_became_peered":"2024-04-25T22:40:52.544838+0000","last_unstale":"2024-04-25T22:41:14.805169+0000","last_undegraded":"2024-04-25T22:41:14.805169+0000","last_fullsized":"2024-04-25T22:41:14.805169+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:48.351231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.805268+0000","last_change":"2024-04-25T22:40:14.630596+0000","last_active":"2024-04-25T22:41:14.805268+0000","last_peered":"2024-04-25T22:41:14.805268+0000","last_clean":"2024-04-25T22:41:14.805268+0000","last_became_active":"2024-04-25T22:40:14.625407+0000","last_became_peered":"2024-04-25T22:40:14.625407+0000","last_unstale":"2024-04-25T22:41:14.805268+0000","last_undegraded":"2024-04-25T22:41:14.805268+0000","last_fullsized":"2024-04-25T22:41:14.805268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:20:05.398182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803928+0000","last_change":"2024-04-25T22:40:36.303740+0000","last_active":"2024-04-25T22:41:14.803928+0000","last_peered":"2024-04-25T22:41:14.803928+0000","last_clean":"2024-04-25T22:41:14.803928+0000","last_became_active":"2024-04-25T22:40:36.303305+0000","last_became_peered":"2024-04-25T22:40:36.303305+0000","last_unstale":"2024-04-25T22:41:14.803928+0000","last_undegraded":"2024-04-25T22:41:14.803928+0000","last_fullsized":"2024-04-25T22:41:14.803928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:03.272640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.800294+0000","last_change":"2024-04-25T22:40:14.620608+0000","last_active":"2024-04-25T22:41:14.800294+0000","last_peered":"2024-04-25T22:41:14.800294+0000","last_clean":"2024-04-25T22:41:14.800294+0000","last_became_active":"2024-04-25T22:40:14.618171+0000","last_became_peered":"2024-04-25T22:40:14.618171+0000","last_unstale":"2024-04-25T22:41:14.800294+0000","last_undegraded":"2024-04-25T22:41:14.800294+0000","last_fullsized":"2024-04-25T22:41:14.800294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803032+0000","last_change":"2024-04-25T22:40:36.305391+0000","last_active":"2024-04-25T22:41:14.803032+0000","last_peered":"2024-04-25T22:41:14.803032+0000","last_clean":"2024-04-25T22:41:14.803032+0000","last_became_active":"2024-04-25T22:40:36.302601+0000","last_became_peered":"2024-04-25T22:40:36.302601+0000","last_unstale":"2024-04-25T22:41:14.803032+0000","last_undegraded":"2024-04-25T22:41:14.803032+0000","last_fullsized":"2024-04-25T22:41:14.803032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:48:54.909669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.799721+0000","last_change":"2024-04-25T22:40:14.618468+0000","last_active":"2024-04-25T22:41:14.799721+0000","last_peered":"2024-04-25T22:41:14.799721+0000","last_clean":"2024-04-25T22:41:14.799721+0000","last_became_active":"2024-04-25T22:40:14.617312+0000","last_became_peered":"2024-04-25T22:40:14.617312+0000","last_unstale":"2024-04-25T22:41:14.799721+0000","last_undegraded":"2024-04-25T22:41:14.799721+0000","last_fullsized":"2024-04-25T22:41:14.799721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:12.679354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.802871+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:41:14.802871+0000","last_peered":"2024-04-25T22:41:14.802871+0000","last_clean":"2024-04-25T22:41:14.802871+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:41:14.802871+0000","last_undegraded":"2024-04-25T22:41:14.802871+0000","last_fullsized":"2024-04-25T22:41:14.802871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:15.161910+0000","last_change":"2024-04-25T22:40:52.544838+0000","last_active":"2024-04-25T22:41:15.161910+0000","last_peered":"2024-04-25T22:41:15.161910+0000","last_clean":"2024-04-25T22:41:15.161910+0000","last_became_active":"2024-04-25T22:40:52.544209+0000","last_became_peered":"2024-04-25T22:40:52.544209+0000","last_unstale":"2024-04-25T22:41:15.161910+0000","last_undegraded":"2024-04-25T22:41:15.161910+0000","last_fullsized":"2024-04-25T22:41:15.161910+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:02.464879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804123+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:41:14.804123+0000","last_peered":"2024-04-25T22:41:14.804123+0000","last_clean":"2024-04-25T22:41:14.804123+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:41:14.804123+0000","last_undegraded":"2024-04-25T22:41:14.804123+0000","last_fullsized":"2024-04-25T22:41:14.804123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:15.161968+0000","last_change":"2024-04-25T22:40:52.549824+0000","last_active":"2024-04-25T22:41:15.161968+0000","last_peered":"2024-04-25T22:41:15.161968+0000","last_clean":"2024-04-25T22:41:15.161968+0000","last_became_active":"2024-04-25T22:40:52.549132+0000","last_became_peered":"2024-04-25T22:40:52.549132+0000","last_unstale":"2024-04-25T22:41:15.161968+0000","last_undegraded":"2024-04-25T22:41:15.161968+0000","last_fullsized":"2024-04-25T22:41:15.161968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:37.971547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804087+0000","last_change":"2024-04-25T22:40:52.544421+0000","last_active":"2024-04-25T22:41:14.804087+0000","last_peered":"2024-04-25T22:41:14.804087+0000","last_clean":"2024-04-25T22:41:14.804087+0000","last_became_active":"2024-04-25T22:40:52.543621+0000","last_became_peered":"2024-04-25T22:40:52.543621+0000","last_unstale":"2024-04-25T22:41:14.804087+0000","last_undegraded":"2024-04-25T22:41:14.804087+0000","last_fullsized":"2024-04-25T22:41:14.804087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:10:22.333204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804811+0000","last_change":"2024-04-25T22:40:52.550914+0000","last_active":"2024-04-25T22:41:14.804811+0000","last_peered":"2024-04-25T22:41:14.804811+0000","last_clean":"2024-04-25T22:41:14.804811+0000","last_became_active":"2024-04-25T22:40:52.549546+0000","last_became_peered":"2024-04-25T22:40:52.549546+0000","last_unstale":"2024-04-25T22:41:14.804811+0000","last_undegraded":"2024-04-25T22:41:14.804811+0000","last_fullsized":"2024-04-25T22:41:14.804811+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:36:41.805159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.802872+0000","last_change":"2024-04-25T22:40:36.306844+0000","last_active":"2024-04-25T22:41:14.802872+0000","last_peered":"2024-04-25T22:41:14.802872+0000","last_clean":"2024-04-25T22:41:14.802872+0000","last_became_active":"2024-04-25T22:40:36.303223+0000","last_became_peered":"2024-04-25T22:40:36.303223+0000","last_unstale":"2024-04-25T22:41:14.802872+0000","last_undegraded":"2024-04-25T22:41:14.802872+0000","last_fullsized":"2024-04-25T22:41:14.802872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:21.069965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804086+0000","last_change":"2024-04-25T22:40:52.549474+0000","last_active":"2024-04-25T22:41:14.804086+0000","last_peered":"2024-04-25T22:41:14.804086+0000","last_clean":"2024-04-25T22:41:14.804086+0000","last_became_active":"2024-04-25T22:40:52.547744+0000","last_became_peered":"2024-04-25T22:40:52.547744+0000","last_unstale":"2024-04-25T22:41:14.804086+0000","last_undegraded":"2024-04-25T22:41:14.804086+0000","last_fullsized":"2024-04-25T22:41:14.804086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:50:43.950890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":61,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803164+0000","last_change":"2024-04-25T22:40:13.599918+0000","last_active":"2024-04-25T22:41:14.803164+0000","last_peered":"2024-04-25T22:41:14.803164+0000","last_clean":"2024-04-25T22:41:14.803164+0000","last_became_active":"2024-04-25T22:40:13.596461+0000","last_became_peered":"2024-04-25T22:40:13.596461+0000","last_unstale":"2024-04-25T22:41:14.803164+0000","last_undegraded":"2024-04-25T22:41:14.803164+0000","last_fullsized":"2024-04-25T22:41:14.803164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:41:51.887162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":54,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.805168+0000","last_change":"2024-04-25T22:40:13.598294+0000","last_active":"2024-04-25T22:41:14.805168+0000","last_peered":"2024-04-25T22:41:14.805168+0000","last_clean":"2024-04-25T22:41:14.805168+0000","last_became_active":"2024-04-25T22:40:13.596687+0000","last_became_peered":"2024-04-25T22:40:13.596687+0000","last_unstale":"2024-04-25T22:41:14.805168+0000","last_undegraded":"2024-04-25T22:41:14.805168+0000","last_fullsized":"2024-04-25T22:41:14.805168+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:50:49.280995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.802297+0000","last_change":"2024-04-25T22:40:36.302843+0000","last_active":"2024-04-25T22:41:14.802297+0000","last_peered":"2024-04-25T22:41:14.802297+0000","last_clean":"2024-04-25T22:41:14.802297+0000","last_became_active":"2024-04-25T22:40:36.302275+0000","last_became_peered":"2024-04-25T22:40:36.302275+0000","last_unstale":"2024-04-25T22:41:14.802297+0000","last_undegraded":"2024-04-25T22:41:14.802297+0000","last_fullsized":"2024-04-25T22:41:14.802297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:24.977111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804301+0000","last_change":"2024-04-25T22:40:36.304995+0000","last_active":"2024-04-25T22:41:14.804301+0000","last_peered":"2024-04-25T22:41:14.804301+0000","last_clean":"2024-04-25T22:41:14.804301+0000","last_became_active":"2024-04-25T22:40:36.304133+0000","last_became_peered":"2024-04-25T22:40:36.304133+0000","last_unstale":"2024-04-25T22:41:14.804301+0000","last_undegraded":"2024-04-25T22:41:14.804301+0000","last_fullsized":"2024-04-25T22:41:14.804301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:06:24.787279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:15.160830+0000","last_change":"2024-04-25T22:40:52.548680+0000","last_active":"2024-04-25T22:41:15.160830+0000","last_peered":"2024-04-25T22:41:15.160830+0000","last_clean":"2024-04-25T22:41:15.160830+0000","last_became_active":"2024-04-25T22:40:52.547982+0000","last_became_peered":"2024-04-25T22:40:52.547982+0000","last_unstale":"2024-04-25T22:41:15.160830+0000","last_undegraded":"2024-04-25T22:41:15.160830+0000","last_fullsized":"2024-04-25T22:41:15.160830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:49.281475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":54,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.805780+0000","last_change":"2024-04-25T22:40:13.601404+0000","last_active":"2024-04-25T22:41:14.805780+0000","last_peered":"2024-04-25T22:41:14.805780+0000","last_clean":"2024-04-25T22:41:14.805780+0000","last_became_active":"2024-04-25T22:40:13.600688+0000","last_became_peered":"2024-04-25T22:40:13.600688+0000","last_unstale":"2024-04-25T22:41:14.805780+0000","last_undegraded":"2024-04-25T22:41:14.805780+0000","last_fullsized":"2024-04-25T22:41:14.805780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:36.157648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803572+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:41:14.803572+0000","last_peered":"2024-04-25T22:41:14.803572+0000","last_clean":"2024-04-25T22:41:14.803572+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:41:14.803572+0000","last_undegraded":"2024-04-25T22:41:14.803572+0000","last_fullsized":"2024-04-25T22:41:14.803572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.805293+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:41:14.805293+0000","last_peered":"2024-04-25T22:41:14.805293+0000","last_clean":"2024-04-25T22:41:14.805293+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:41:14.805293+0000","last_undegraded":"2024-04-25T22:41:14.805293+0000","last_fullsized":"2024-04-25T22:41:14.805293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803545+0000","last_change":"2024-04-25T22:40:52.543894+0000","last_active":"2024-04-25T22:41:14.803545+0000","last_peered":"2024-04-25T22:41:14.803545+0000","last_clean":"2024-04-25T22:41:14.803545+0000","last_became_active":"2024-04-25T22:40:52.541677+0000","last_became_peered":"2024-04-25T22:40:52.541677+0000","last_unstale":"2024-04-25T22:41:14.803545+0000","last_undegraded":"2024-04-25T22:41:14.803545+0000","last_fullsized":"2024-04-25T22:41:14.803545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:30:38.984858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804005+0000","last_change":"2024-04-25T22:40:52.547699+0000","last_active":"2024-04-25T22:41:14.804005+0000","last_peered":"2024-04-25T22:41:14.804005+0000","last_clean":"2024-04-25T22:41:14.804005+0000","last_became_active":"2024-04-25T22:40:52.546654+0000","last_became_peered":"2024-04-25T22:40:52.546654+0000","last_unstale":"2024-04-25T22:41:14.804005+0000","last_undegraded":"2024-04-25T22:41:14.804005+0000","last_fullsized":"2024-04-25T22:41:14.804005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:55:52.272415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804646+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:41:14.804646+0000","last_peered":"2024-04-25T22:41:14.804646+0000","last_clean":"2024-04-25T22:41:14.804646+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:41:14.804646+0000","last_undegraded":"2024-04-25T22:41:14.804646+0000","last_fullsized":"2024-04-25T22:41:14.804646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804627+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:41:14.804627+0000","last_peered":"2024-04-25T22:41:14.804627+0000","last_clean":"2024-04-25T22:41:14.804627+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:41:14.804627+0000","last_undegraded":"2024-04-25T22:41:14.804627+0000","last_fullsized":"2024-04-25T22:41:14.804627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.805551+0000","last_change":"2024-04-25T22:40:14.621941+0000","last_active":"2024-04-25T22:41:14.805551+0000","last_peered":"2024-04-25T22:41:14.805551+0000","last_clean":"2024-04-25T22:41:14.805551+0000","last_became_active":"2024-04-25T22:40:14.614196+0000","last_became_peered":"2024-04-25T22:40:14.614196+0000","last_unstale":"2024-04-25T22:41:14.805551+0000","last_undegraded":"2024-04-25T22:41:14.805551+0000","last_fullsized":"2024-04-25T22:41:14.805551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:24.895025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803020+0000","last_change":"2024-04-25T22:40:36.305242+0000","last_active":"2024-04-25T22:41:14.803020+0000","last_peered":"2024-04-25T22:41:14.803020+0000","last_clean":"2024-04-25T22:41:14.803020+0000","last_became_active":"2024-04-25T22:40:36.302259+0000","last_became_peered":"2024-04-25T22:40:36.302259+0000","last_unstale":"2024-04-25T22:41:14.803020+0000","last_undegraded":"2024-04-25T22:41:14.803020+0000","last_fullsized":"2024-04-25T22:41:14.803020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:03:48.252489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804413+0000","last_change":"2024-04-25T22:40:14.614275+0000","last_active":"2024-04-25T22:41:14.804413+0000","last_peered":"2024-04-25T22:41:14.804413+0000","last_clean":"2024-04-25T22:41:14.804413+0000","last_became_active":"2024-04-25T22:40:14.613038+0000","last_became_peered":"2024-04-25T22:40:14.613038+0000","last_unstale":"2024-04-25T22:41:14.804413+0000","last_undegraded":"2024-04-25T22:41:14.804413+0000","last_fullsized":"2024-04-25T22:41:14.804413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:14:02.343388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:15.160796+0000","last_change":"2024-04-25T22:40:52.541453+0000","last_active":"2024-04-25T22:41:15.160796+0000","last_peered":"2024-04-25T22:41:15.160796+0000","last_clean":"2024-04-25T22:41:15.160796+0000","last_became_active":"2024-04-25T22:40:52.540632+0000","last_became_peered":"2024-04-25T22:40:52.540632+0000","last_unstale":"2024-04-25T22:41:15.160796+0000","last_undegraded":"2024-04-25T22:41:15.160796+0000","last_fullsized":"2024-04-25T22:41:15.160796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:17.462562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.800880+0000","last_change":"2024-04-25T22:40:14.627280+0000","last_active":"2024-04-25T22:41:14.800880+0000","last_peered":"2024-04-25T22:41:14.800880+0000","last_clean":"2024-04-25T22:41:14.800880+0000","last_became_active":"2024-04-25T22:40:14.624656+0000","last_became_peered":"2024-04-25T22:40:14.624656+0000","last_unstale":"2024-04-25T22:41:14.800880+0000","last_undegraded":"2024-04-25T22:41:14.800880+0000","last_fullsized":"2024-04-25T22:41:14.800880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":261,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803578+0000","last_change":"2024-04-25T22:40:04.317146+0000","last_active":"2024-04-25T22:41:14.803578+0000","last_peered":"2024-04-25T22:41:14.803578+0000","last_clean":"2024-04-25T22:41:14.803578+0000","last_became_active":"2024-04-25T22:40:04.316527+0000","last_became_peered":"2024-04-25T22:40:04.316527+0000","last_unstale":"2024-04-25T22:41:14.803578+0000","last_undegraded":"2024-04-25T22:41:14.803578+0000","last_fullsized":"2024-04-25T22:41:14.803578+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:00:25.669997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804412+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:41:14.804412+0000","last_peered":"2024-04-25T22:41:14.804412+0000","last_clean":"2024-04-25T22:41:14.804412+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:41:14.804412+0000","last_undegraded":"2024-04-25T22:41:14.804412+0000","last_fullsized":"2024-04-25T22:41:14.804412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":54,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.800376+0000","last_change":"2024-04-25T22:40:13.591980+0000","last_active":"2024-04-25T22:41:14.800376+0000","last_peered":"2024-04-25T22:41:14.800376+0000","last_clean":"2024-04-25T22:41:14.800376+0000","last_became_active":"2024-04-25T22:40:13.591152+0000","last_became_peered":"2024-04-25T22:40:13.591152+0000","last_unstale":"2024-04-25T22:41:14.800376+0000","last_undegraded":"2024-04-25T22:41:14.800376+0000","last_fullsized":"2024-04-25T22:41:14.800376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.805649+0000","last_change":"2024-04-25T22:40:14.621472+0000","last_active":"2024-04-25T22:41:14.805649+0000","last_peered":"2024-04-25T22:41:14.805649+0000","last_clean":"2024-04-25T22:41:14.805649+0000","last_became_active":"2024-04-25T22:40:14.613608+0000","last_became_peered":"2024-04-25T22:40:14.613608+0000","last_unstale":"2024-04-25T22:41:14.805649+0000","last_undegraded":"2024-04-25T22:41:14.805649+0000","last_fullsized":"2024-04-25T22:41:14.805649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:51.686908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803439+0000","last_change":"2024-04-25T22:40:09.502444+0000","last_active":"2024-04-25T22:41:14.803439+0000","last_peered":"2024-04-25T22:41:14.803439+0000","last_clean":"2024-04-25T22:41:14.803439+0000","last_became_active":"2024-04-25T22:40:09.501576+0000","last_became_peered":"2024-04-25T22:40:09.501576+0000","last_unstale":"2024-04-25T22:41:14.803439+0000","last_undegraded":"2024-04-25T22:41:14.803439+0000","last_fullsized":"2024-04-25T22:41:14.803439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:35:14.955359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804131+0000","last_change":"2024-04-25T22:40:52.544244+0000","last_active":"2024-04-25T22:41:14.804131+0000","last_peered":"2024-04-25T22:41:14.804131+0000","last_clean":"2024-04-25T22:41:14.804131+0000","last_became_active":"2024-04-25T22:40:52.543438+0000","last_became_peered":"2024-04-25T22:40:52.543438+0000","last_unstale":"2024-04-25T22:41:14.804131+0000","last_undegraded":"2024-04-25T22:41:14.804131+0000","last_fullsized":"2024-04-25T22:41:14.804131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:17.842964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:15.162343+0000","last_change":"2024-04-25T22:40:52.548816+0000","last_active":"2024-04-25T22:41:15.162343+0000","last_peered":"2024-04-25T22:41:15.162343+0000","last_clean":"2024-04-25T22:41:15.162343+0000","last_became_active":"2024-04-25T22:40:52.547904+0000","last_became_peered":"2024-04-25T22:40:52.547904+0000","last_unstale":"2024-04-25T22:41:15.162343+0000","last_undegraded":"2024-04-25T22:41:15.162343+0000","last_fullsized":"2024-04-25T22:41:15.162343+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:19.327397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.800300+0000","last_change":"2024-04-25T22:40:09.501323+0000","last_active":"2024-04-25T22:41:14.800300+0000","last_peered":"2024-04-25T22:41:14.800300+0000","last_clean":"2024-04-25T22:41:14.800300+0000","last_became_active":"2024-04-25T22:40:09.500499+0000","last_became_peered":"2024-04-25T22:40:09.500499+0000","last_unstale":"2024-04-25T22:41:14.800300+0000","last_undegraded":"2024-04-25T22:41:14.800300+0000","last_fullsized":"2024-04-25T22:41:14.800300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:30.289572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.802314+0000","last_change":"2024-04-25T22:40:36.303534+0000","last_active":"2024-04-25T22:41:14.802314+0000","last_peered":"2024-04-25T22:41:14.802314+0000","last_clean":"2024-04-25T22:41:14.802314+0000","last_became_active":"2024-04-25T22:40:36.302351+0000","last_became_peered":"2024-04-25T22:40:36.302351+0000","last_unstale":"2024-04-25T22:41:14.802314+0000","last_undegraded":"2024-04-25T22:41:14.802314+0000","last_fullsized":"2024-04-25T22:41:14.802314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:31:09.162739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.800915+0000","last_change":"2024-04-25T22:40:14.628007+0000","last_active":"2024-04-25T22:41:14.800915+0000","last_peered":"2024-04-25T22:41:14.800915+0000","last_clean":"2024-04-25T22:41:14.800915+0000","last_became_active":"2024-04-25T22:40:14.625425+0000","last_became_peered":"2024-04-25T22:40:14.625425+0000","last_unstale":"2024-04-25T22:41:14.800915+0000","last_undegraded":"2024-04-25T22:41:14.800915+0000","last_fullsized":"2024-04-25T22:41:14.800915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":59,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804423+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:41:14.804423+0000","last_peered":"2024-04-25T22:41:14.804423+0000","last_clean":"2024-04-25T22:41:14.804423+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:41:14.804423+0000","last_undegraded":"2024-04-25T22:41:14.804423+0000","last_fullsized":"2024-04-25T22:41:14.804423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804473+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:41:14.804473+0000","last_peered":"2024-04-25T22:41:14.804473+0000","last_clean":"2024-04-25T22:41:14.804473+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:41:14.804473+0000","last_undegraded":"2024-04-25T22:41:14.804473+0000","last_fullsized":"2024-04-25T22:41:14.804473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.800505+0000","last_change":"2024-04-25T22:40:14.622442+0000","last_active":"2024-04-25T22:41:14.800505+0000","last_peered":"2024-04-25T22:41:14.800505+0000","last_clean":"2024-04-25T22:41:14.800505+0000","last_became_active":"2024-04-25T22:40:14.621130+0000","last_became_peered":"2024-04-25T22:40:14.621130+0000","last_unstale":"2024-04-25T22:41:14.800505+0000","last_undegraded":"2024-04-25T22:41:14.800505+0000","last_fullsized":"2024-04-25T22:41:14.800505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:34.451647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.805862+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:41:14.805862+0000","last_peered":"2024-04-25T22:41:14.805862+0000","last_clean":"2024-04-25T22:41:14.805862+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:41:14.805862+0000","last_undegraded":"2024-04-25T22:41:14.805862+0000","last_fullsized":"2024-04-25T22:41:14.805862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.800656+0000","last_change":"2024-04-25T22:40:09.501325+0000","last_active":"2024-04-25T22:41:14.800656+0000","last_peered":"2024-04-25T22:41:14.800656+0000","last_clean":"2024-04-25T22:41:14.800656+0000","last_became_active":"2024-04-25T22:40:09.500542+0000","last_became_peered":"2024-04-25T22:40:09.500542+0000","last_unstale":"2024-04-25T22:41:14.800656+0000","last_undegraded":"2024-04-25T22:41:14.800656+0000","last_fullsized":"2024-04-25T22:41:14.800656+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:34:38.234538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.802741+0000","last_change":"2024-04-25T22:40:36.306443+0000","last_active":"2024-04-25T22:41:14.802741+0000","last_peered":"2024-04-25T22:41:14.802741+0000","last_clean":"2024-04-25T22:41:14.802741+0000","last_became_active":"2024-04-25T22:40:36.303568+0000","last_became_peered":"2024-04-25T22:40:36.303568+0000","last_unstale":"2024-04-25T22:41:14.802741+0000","last_undegraded":"2024-04-25T22:41:14.802741+0000","last_fullsized":"2024-04-25T22:41:14.802741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:43:42.692718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":54,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.800537+0000","last_change":"2024-04-25T22:40:13.591256+0000","last_active":"2024-04-25T22:41:14.800537+0000","last_peered":"2024-04-25T22:41:14.800537+0000","last_clean":"2024-04-25T22:41:14.800537+0000","last_became_active":"2024-04-25T22:40:13.590744+0000","last_became_peered":"2024-04-25T22:40:13.590744+0000","last_unstale":"2024-04-25T22:41:14.800537+0000","last_undegraded":"2024-04-25T22:41:14.800537+0000","last_fullsized":"2024-04-25T22:41:14.800537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:50.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:15.162405+0000","last_change":"2024-04-25T22:40:52.544292+0000","last_active":"2024-04-25T22:41:15.162405+0000","last_peered":"2024-04-25T22:41:15.162405+0000","last_clean":"2024-04-25T22:41:15.162405+0000","last_became_active":"2024-04-25T22:40:52.543531+0000","last_became_peered":"2024-04-25T22:40:52.543531+0000","last_unstale":"2024-04-25T22:41:15.162405+0000","last_undegraded":"2024-04-25T22:41:15.162405+0000","last_fullsized":"2024-04-25T22:41:15.162405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:07.496182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.802986+0000","last_change":"2024-04-25T22:40:36.305326+0000","last_active":"2024-04-25T22:41:14.802986+0000","last_peered":"2024-04-25T22:41:14.802986+0000","last_clean":"2024-04-25T22:41:14.802986+0000","last_became_active":"2024-04-25T22:40:36.302867+0000","last_became_peered":"2024-04-25T22:40:36.302867+0000","last_unstale":"2024-04-25T22:41:14.802986+0000","last_undegraded":"2024-04-25T22:41:14.802986+0000","last_fullsized":"2024-04-25T22:41:14.802986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:19.327397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.801186+0000","last_change":"2024-04-25T22:40:13.592055+0000","last_active":"2024-04-25T22:41:14.801186+0000","last_peered":"2024-04-25T22:41:14.801186+0000","last_clean":"2024-04-25T22:41:14.801186+0000","last_became_active":"2024-04-25T22:40:13.591169+0000","last_became_peered":"2024-04-25T22:40:13.591169+0000","last_unstale":"2024-04-25T22:41:14.801186+0000","last_undegraded":"2024-04-25T22:41:14.801186+0000","last_fullsized":"2024-04-25T22:41:14.801186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:33.458799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.801087+0000","last_change":"2024-04-25T22:40:09.501358+0000","last_active":"2024-04-25T22:41:14.801087+0000","last_peered":"2024-04-25T22:41:14.801087+0000","last_clean":"2024-04-25T22:41:14.801087+0000","last_became_active":"2024-04-25T22:40:09.500626+0000","last_became_peered":"2024-04-25T22:40:09.500626+0000","last_unstale":"2024-04-25T22:41:14.801087+0000","last_undegraded":"2024-04-25T22:41:14.801087+0000","last_fullsized":"2024-04-25T22:41:14.801087+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:55.182967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.802965+0000","last_change":"2024-04-25T22:40:52.547806+0000","last_active":"2024-04-25T22:41:14.802965+0000","last_peered":"2024-04-25T22:41:14.802965+0000","last_clean":"2024-04-25T22:41:14.802965+0000","last_became_active":"2024-04-25T22:40:52.544889+0000","last_became_peered":"2024-04-25T22:40:52.544889+0000","last_unstale":"2024-04-25T22:41:14.802965+0000","last_undegraded":"2024-04-25T22:41:14.802965+0000","last_fullsized":"2024-04-25T22:41:14.802965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:44.880698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"25'3","reported_seq":54,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.805067+0000","last_change":"2024-04-25T22:40:52.547041+0000","last_active":"2024-04-25T22:41:14.805067+0000","last_peered":"2024-04-25T22:41:14.805067+0000","last_clean":"2024-04-25T22:41:14.805067+0000","last_became_active":"2024-04-25T22:40:52.545085+0000","last_became_peered":"2024-04-25T22:40:52.545085+0000","last_unstale":"2024-04-25T22:41:14.805067+0000","last_undegraded":"2024-04-25T22:41:14.805067+0000","last_fullsized":"2024-04-25T22:41:14.805067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:46.066674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.805243+0000","last_change":"2024-04-25T22:40:09.500948+0000","last_active":"2024-04-25T22:41:14.805243+0000","last_peered":"2024-04-25T22:41:14.805243+0000","last_clean":"2024-04-25T22:41:14.805243+0000","last_became_active":"2024-04-25T22:40:09.500236+0000","last_became_peered":"2024-04-25T22:40:09.500236+0000","last_unstale":"2024-04-25T22:41:14.805243+0000","last_undegraded":"2024-04-25T22:41:14.805243+0000","last_fullsized":"2024-04-25T22:41:14.805243+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:02.375961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.802542+0000","last_change":"2024-04-25T22:40:36.306177+0000","last_active":"2024-04-25T22:41:14.802542+0000","last_peered":"2024-04-25T22:41:14.802542+0000","last_clean":"2024-04-25T22:41:14.802542+0000","last_became_active":"2024-04-25T22:40:36.304767+0000","last_became_peered":"2024-04-25T22:40:36.304767+0000","last_unstale":"2024-04-25T22:41:14.802542+0000","last_undegraded":"2024-04-25T22:41:14.802542+0000","last_fullsized":"2024-04-25T22:41:14.802542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:31.194700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803732+0000","last_change":"2024-04-25T22:40:14.619806+0000","last_active":"2024-04-25T22:41:14.803732+0000","last_peered":"2024-04-25T22:41:14.803732+0000","last_clean":"2024-04-25T22:41:14.803732+0000","last_became_active":"2024-04-25T22:40:14.618980+0000","last_became_peered":"2024-04-25T22:40:14.618980+0000","last_unstale":"2024-04-25T22:41:14.803732+0000","last_undegraded":"2024-04-25T22:41:14.803732+0000","last_fullsized":"2024-04-25T22:41:14.803732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:48.936896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"26'10","reported_seq":63,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.805320+0000","last_change":"2024-04-25T22:40:13.598003+0000","last_active":"2024-04-25T22:41:14.805320+0000","last_peered":"2024-04-25T22:41:14.805320+0000","last_clean":"2024-04-25T22:41:14.805320+0000","last_became_active":"2024-04-25T22:40:13.596631+0000","last_became_peered":"2024-04-25T22:40:13.596631+0000","last_unstale":"2024-04-25T22:41:14.805320+0000","last_undegraded":"2024-04-25T22:41:14.805320+0000","last_fullsized":"2024-04-25T22:41:14.805320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:50.862204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.799901+0000","last_change":"2024-04-25T22:40:14.620064+0000","last_active":"2024-04-25T22:41:14.799901+0000","last_peered":"2024-04-25T22:41:14.799901+0000","last_clean":"2024-04-25T22:41:14.799901+0000","last_became_active":"2024-04-25T22:40:14.619294+0000","last_became_peered":"2024-04-25T22:40:14.619294+0000","last_unstale":"2024-04-25T22:41:14.799901+0000","last_undegraded":"2024-04-25T22:41:14.799901+0000","last_fullsized":"2024-04-25T22:41:14.799901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.805236+0000","last_change":"2024-04-25T22:40:36.307956+0000","last_active":"2024-04-25T22:41:14.805236+0000","last_peered":"2024-04-25T22:41:14.805236+0000","last_clean":"2024-04-25T22:41:14.805236+0000","last_became_active":"2024-04-25T22:40:36.306587+0000","last_became_peered":"2024-04-25T22:40:36.306587+0000","last_unstale":"2024-04-25T22:41:14.805236+0000","last_undegraded":"2024-04-25T22:41:14.805236+0000","last_fullsized":"2024-04-25T22:41:14.805236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:32.249184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.805430+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:41:14.805430+0000","last_peered":"2024-04-25T22:41:14.805430+0000","last_clean":"2024-04-25T22:41:14.805430+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:41:14.805430+0000","last_undegraded":"2024-04-25T22:41:14.805430+0000","last_fullsized":"2024-04-25T22:41:14.805430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.802535+0000","last_change":"2024-04-25T22:40:52.550242+0000","last_active":"2024-04-25T22:41:14.802535+0000","last_peered":"2024-04-25T22:41:14.802535+0000","last_clean":"2024-04-25T22:41:14.802535+0000","last_became_active":"2024-04-25T22:40:52.549378+0000","last_became_peered":"2024-04-25T22:40:52.549378+0000","last_unstale":"2024-04-25T22:41:14.802535+0000","last_undegraded":"2024-04-25T22:41:14.802535+0000","last_fullsized":"2024-04-25T22:41:14.802535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:28:55.307548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804918+0000","last_change":"2024-04-25T22:40:52.546932+0000","last_active":"2024-04-25T22:41:14.804918+0000","last_peered":"2024-04-25T22:41:14.804918+0000","last_clean":"2024-04-25T22:41:14.804918+0000","last_became_active":"2024-04-25T22:40:52.545043+0000","last_became_peered":"2024-04-25T22:40:52.545043+0000","last_unstale":"2024-04-25T22:41:14.804918+0000","last_undegraded":"2024-04-25T22:41:14.804918+0000","last_fullsized":"2024-04-25T22:41:14.804918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:11.071236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.799906+0000","last_change":"2024-04-25T22:40:14.619640+0000","last_active":"2024-04-25T22:41:14.799906+0000","last_peered":"2024-04-25T22:41:14.799906+0000","last_clean":"2024-04-25T22:41:14.799906+0000","last_became_active":"2024-04-25T22:40:14.618088+0000","last_became_peered":"2024-04-25T22:40:14.618088+0000","last_unstale":"2024-04-25T22:41:14.799906+0000","last_undegraded":"2024-04-25T22:41:14.799906+0000","last_fullsized":"2024-04-25T22:41:14.799906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:20:58.322470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804661+0000","last_change":"2024-04-25T22:40:36.304451+0000","last_active":"2024-04-25T22:41:14.804661+0000","last_peered":"2024-04-25T22:41:14.804661+0000","last_clean":"2024-04-25T22:41:14.804661+0000","last_became_active":"2024-04-25T22:40:36.303841+0000","last_became_peered":"2024-04-25T22:40:36.303841+0000","last_unstale":"2024-04-25T22:41:14.804661+0000","last_undegraded":"2024-04-25T22:41:14.804661+0000","last_fullsized":"2024-04-25T22:41:14.804661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:12.611590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":54,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.800116+0000","last_change":"2024-04-25T22:40:13.588577+0000","last_active":"2024-04-25T22:41:14.800116+0000","last_peered":"2024-04-25T22:41:14.800116+0000","last_clean":"2024-04-25T22:41:14.800116+0000","last_became_active":"2024-04-25T22:40:13.588019+0000","last_became_peered":"2024-04-25T22:40:13.588019+0000","last_unstale":"2024-04-25T22:41:14.800116+0000","last_undegraded":"2024-04-25T22:41:14.800116+0000","last_fullsized":"2024-04-25T22:41:14.800116+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:07.743396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804013+0000","last_change":"2024-04-25T22:40:52.550229+0000","last_active":"2024-04-25T22:41:14.804013+0000","last_peered":"2024-04-25T22:41:14.804013+0000","last_clean":"2024-04-25T22:41:14.804013+0000","last_became_active":"2024-04-25T22:40:52.549446+0000","last_became_peered":"2024-04-25T22:40:52.549446+0000","last_unstale":"2024-04-25T22:41:14.804013+0000","last_undegraded":"2024-04-25T22:41:14.804013+0000","last_fullsized":"2024-04-25T22:41:14.804013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:08:36.019160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803678+0000","last_change":"2024-04-25T22:40:52.549403+0000","last_active":"2024-04-25T22:41:14.803678+0000","last_peered":"2024-04-25T22:41:14.803678+0000","last_clean":"2024-04-25T22:41:14.803678+0000","last_became_active":"2024-04-25T22:40:52.547483+0000","last_became_peered":"2024-04-25T22:40:52.547483+0000","last_unstale":"2024-04-25T22:41:14.803678+0000","last_undegraded":"2024-04-25T22:41:14.803678+0000","last_fullsized":"2024-04-25T22:41:14.803678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:02:42.003697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804338+0000","last_change":"2024-04-25T22:40:36.308091+0000","last_active":"2024-04-25T22:41:14.804338+0000","last_peered":"2024-04-25T22:41:14.804338+0000","last_clean":"2024-04-25T22:41:14.804338+0000","last_became_active":"2024-04-25T22:40:36.307377+0000","last_became_peered":"2024-04-25T22:40:36.307377+0000","last_unstale":"2024-04-25T22:41:14.804338+0000","last_undegraded":"2024-04-25T22:41:14.804338+0000","last_fullsized":"2024-04-25T22:41:14.804338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:49.433865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:15.161347+0000","last_change":"2024-04-25T22:40:52.543822+0000","last_active":"2024-04-25T22:41:15.161347+0000","last_peered":"2024-04-25T22:41:15.161347+0000","last_clean":"2024-04-25T22:41:15.161347+0000","last_became_active":"2024-04-25T22:40:52.541872+0000","last_became_peered":"2024-04-25T22:40:52.541872+0000","last_unstale":"2024-04-25T22:41:15.161347+0000","last_undegraded":"2024-04-25T22:41:15.161347+0000","last_fullsized":"2024-04-25T22:41:15.161347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:02.243654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:15.161651+0000","last_change":"2024-04-25T22:40:52.549452+0000","last_active":"2024-04-25T22:41:15.161651+0000","last_peered":"2024-04-25T22:41:15.161651+0000","last_clean":"2024-04-25T22:41:15.161651+0000","last_became_active":"2024-04-25T22:40:52.548626+0000","last_became_peered":"2024-04-25T22:40:52.548626+0000","last_unstale":"2024-04-25T22:41:15.161651+0000","last_undegraded":"2024-04-25T22:41:15.161651+0000","last_fullsized":"2024-04-25T22:41:15.161651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:31:10.191724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803036+0000","last_change":"2024-04-25T22:40:36.306430+0000","last_active":"2024-04-25T22:41:14.803036+0000","last_peered":"2024-04-25T22:41:14.803036+0000","last_clean":"2024-04-25T22:41:14.803036+0000","last_became_active":"2024-04-25T22:40:36.305851+0000","last_became_peered":"2024-04-25T22:40:36.305851+0000","last_unstale":"2024-04-25T22:41:14.803036+0000","last_undegraded":"2024-04-25T22:41:14.803036+0000","last_fullsized":"2024-04-25T22:41:14.803036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:13:19.231988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803278+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:41:14.803278+0000","last_peered":"2024-04-25T22:41:14.803278+0000","last_clean":"2024-04-25T22:41:14.803278+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:41:14.803278+0000","last_undegraded":"2024-04-25T22:41:14.803278+0000","last_fullsized":"2024-04-25T22:41:14.803278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804803+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:41:14.804803+0000","last_peered":"2024-04-25T22:41:14.804803+0000","last_clean":"2024-04-25T22:41:14.804803+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:41:14.804803+0000","last_undegraded":"2024-04-25T22:41:14.804803+0000","last_fullsized":"2024-04-25T22:41:14.804803+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803821+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:41:14.803821+0000","last_peered":"2024-04-25T22:41:14.803821+0000","last_clean":"2024-04-25T22:41:14.803821+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:41:14.803821+0000","last_undegraded":"2024-04-25T22:41:14.803821+0000","last_fullsized":"2024-04-25T22:41:14.803821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":56,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804546+0000","last_change":"2024-04-25T22:40:36.307498+0000","last_active":"2024-04-25T22:41:14.804546+0000","last_peered":"2024-04-25T22:41:14.804546+0000","last_clean":"2024-04-25T22:41:14.804546+0000","last_became_active":"2024-04-25T22:40:36.305913+0000","last_became_peered":"2024-04-25T22:40:36.305913+0000","last_unstale":"2024-04-25T22:41:14.804546+0000","last_undegraded":"2024-04-25T22:41:14.804546+0000","last_fullsized":"2024-04-25T22:41:14.804546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:45:54.627527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:15.161251+0000","last_change":"2024-04-25T22:40:52.549782+0000","last_active":"2024-04-25T22:41:15.161251+0000","last_peered":"2024-04-25T22:41:15.161251+0000","last_clean":"2024-04-25T22:41:15.161251+0000","last_became_active":"2024-04-25T22:40:52.548871+0000","last_became_peered":"2024-04-25T22:40:52.548871+0000","last_unstale":"2024-04-25T22:41:15.161251+0000","last_undegraded":"2024-04-25T22:41:15.161251+0000","last_fullsized":"2024-04-25T22:41:15.161251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:02:44.949501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.800963+0000","last_change":"2024-04-25T22:40:13.594172+0000","last_active":"2024-04-25T22:41:14.800963+0000","last_peered":"2024-04-25T22:41:14.800963+0000","last_clean":"2024-04-25T22:41:14.800963+0000","last_became_active":"2024-04-25T22:40:13.593428+0000","last_became_peered":"2024-04-25T22:40:13.593428+0000","last_unstale":"2024-04-25T22:41:14.800963+0000","last_undegraded":"2024-04-25T22:41:14.800963+0000","last_fullsized":"2024-04-25T22:41:14.800963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:41:51.887162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.803242+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:41:14.803242+0000","last_peered":"2024-04-25T22:41:14.803242+0000","last_clean":"2024-04-25T22:41:14.803242+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:41:14.803242+0000","last_undegraded":"2024-04-25T22:41:14.803242+0000","last_fullsized":"2024-04-25T22:41:14.803242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T22:41:14.804857+0000","last_change":"2024-04-25T22:40:52.550558+0000","last_active":"2024-04-25T22:41:14.804857+0000","last_peered":"2024-04-25T22:41:14.804857+0000","last_clean":"2024-04-25T22:41:14.804857+0000","last_became_active":"2024-04-25T22:40:52.549850+0000","last_became_peered":"2024-04-25T22:40:52.549850+0000","last_unstale":"2024-04-25T22:41:14.804857+0000","last_undegraded":"2024-04-25T22:41:14.804857+0000","last_fullsized":"2024-04-25T22:41:14.804857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:14:18.662022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738388,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":142918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738387,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":950272,"data_stored":739405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738388,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":958464,"data_stored":740021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:41:19.336 INFO:tasks.thrashosds.thrasher:Setting 4.d to [2, 1, 0] 2024-04-25T22:41:19.336 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.d', '2', '1', '0'] 2024-04-25T22:41:19.336 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.d 2 1 0 2024-04-25T22:41:19.337 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:19.338 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-04-25T22:41:19.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-04-25T22:41:19.338 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-04-25T22:41:19.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.338 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:111 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'73, mlcod=11'69)", 2024-04-25T22:41:19.338 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:19.338 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.632584592000001, 2024-04-25T22:41:19.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055481899999999997, 2024-04-25T22:41:19.338 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:19.338 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:19.338 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.338 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:19.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.339 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:19.339 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:19.339 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.339 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:19.339 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:19.339 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.339 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:19.339 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700271+0000", 2024-04-25T22:41:19.339 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:41:19.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.340 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:19.340 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700278+0000", 2024-04-25T22:41:19.340 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-04-25T22:41:19.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.340 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:19.340 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700323+0000", 2024-04-25T22:41:19.340 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4212999999999998e-05 2024-04-25T22:41:19.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.340 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.340 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700333+0000", 2024-04-25T22:41:19.340 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0433e-05 2024-04-25T22:41:19.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.341 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:19.341 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700662+0000", 2024-04-25T22:41:19.341 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032862800000000003 2024-04-25T22:41:19.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.341 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:19.341 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700692+0000", 2024-04-25T22:41:19.341 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0395999999999998e-05 2024-04-25T22:41:19.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.341 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:19.341 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705728+0000", 2024-04-25T22:41:19.341 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050361939999999999 2024-04-25T22:41:19.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.342 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:19.342 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705818+0000", 2024-04-25T22:41:19.342 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9573000000000005e-05 2024-04-25T22:41:19.342 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.342 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.342 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.342 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-25T22:41:19.342 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:19.342 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.632039739999996, 2024-04-25T22:41:19.342 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005065501, 2024-04-25T22:41:19.342 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:19.343 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:19.343 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.343 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:19.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.343 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:19.343 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:19.343 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.343 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:19.343 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:19.343 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.343 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:19.344 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700816+0000", 2024-04-25T22:41:19.344 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.24e-06 2024-04-25T22:41:19.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.344 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:19.344 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700914+0000", 2024-04-25T22:41:19.344 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8057e-05 2024-04-25T22:41:19.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.344 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:19.344 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700931+0000", 2024-04-25T22:41:19.344 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7745999999999999e-05 2024-04-25T22:41:19.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.345 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.345 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700941+0000", 2024-04-25T22:41:19.345 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5699999999999999e-06 2024-04-25T22:41:19.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.345 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:19.345 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701162+0000", 2024-04-25T22:41:19.345 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000221392 2024-04-25T22:41:19.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.345 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:19.345 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701194+0000", 2024-04-25T22:41:19.345 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1745999999999997e-05 2024-04-25T22:41:19.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.346 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:19.346 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705821+0000", 2024-04-25T22:41:19.346 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046269869999999999 2024-04-25T22:41:19.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.346 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:19.346 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705880+0000", 2024-04-25T22:41:19.346 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8763e-05 2024-04-25T22:41:19.346 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.346 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.346 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.347 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:118 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'80, mlcod=11'78)", 2024-04-25T22:41:19.347 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:19.347 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.624684130000006, 2024-04-25T22:41:19.347 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047806089999999999, 2024-04-25T22:41:19.347 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:19.347 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:19.347 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.347 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:19.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.347 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:19.347 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:19.347 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.347 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:19.348 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:19.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.348 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:19.348 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708172+0000", 2024-04-25T22:41:19.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0600000000000002e-06 2024-04-25T22:41:19.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.348 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:19.348 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708291+0000", 2024-04-25T22:41:19.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118892 2024-04-25T22:41:19.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.349 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:19.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708320+0000", 2024-04-25T22:41:19.349 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8822999999999998e-05 2024-04-25T22:41:19.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.349 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708337+0000", 2024-04-25T22:41:19.349 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7586999999999999e-05 2024-04-25T22:41:19.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.349 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:19.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708512+0000", 2024-04-25T22:41:19.349 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017439500000000001 2024-04-25T22:41:19.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.350 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:19.350 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708551+0000", 2024-04-25T22:41:19.350 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.909e-05 2024-04-25T22:41:19.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.350 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:19.350 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712865+0000", 2024-04-25T22:41:19.350 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043142069999999996 2024-04-25T22:41:19.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.350 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:19.350 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712951+0000", 2024-04-25T22:41:19.350 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5555000000000003e-05 2024-04-25T22:41:19.351 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.351 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.351 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.351 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:120 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'82, mlcod=11'78)", 2024-04-25T22:41:19.351 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:19.351 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.623678088000005, 2024-04-25T22:41:19.351 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047170700000000003, 2024-04-25T22:41:19.351 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:19.351 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:19.351 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.351 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:19.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.352 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:19.352 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:19.352 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.352 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.352 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:19.352 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:19.352 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.352 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.352 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:19.352 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709177+0000", 2024-04-25T22:41:19.352 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.19e-06 2024-04-25T22:41:19.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709315+0000", 2024-04-25T22:41:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000137429 2024-04-25T22:41:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709341+0000", 2024-04-25T22:41:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:41:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709353+0000", 2024-04-25T22:41:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2027e-05 2024-04-25T22:41:19.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.354 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:19.354 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710040+0000", 2024-04-25T22:41:19.354 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068710799999999997 2024-04-25T22:41:19.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.354 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:19.354 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710076+0000", 2024-04-25T22:41:19.354 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5982999999999998e-05 2024-04-25T22:41:19.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.354 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:19.354 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713802+0000", 2024-04-25T22:41:19.355 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037255750000000001 2024-04-25T22:41:19.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.355 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:19.355 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713893+0000", 2024-04-25T22:41:19.355 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1201999999999999e-05 2024-04-25T22:41:19.355 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.355 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.355 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.355 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:121 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'83, mlcod=11'78)", 2024-04-25T22:41:19.355 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:19.355 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.623131451999996, 2024-04-25T22:41:19.355 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0049043919999999996, 2024-04-25T22:41:19.356 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:19.356 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:19.356 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.356 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:19.356 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.356 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:19.356 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:19.356 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.356 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.356 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:19.356 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:19.356 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.356 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.357 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:19.357 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709724+0000", 2024-04-25T22:41:19.357 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.483e-06 2024-04-25T22:41:19.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.357 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.357 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:19.357 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709872+0000", 2024-04-25T22:41:19.357 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147446 2024-04-25T22:41:19.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.357 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.357 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:19.357 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709891+0000", 2024-04-25T22:41:19.357 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9245999999999998e-05 2024-04-25T22:41:19.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.358 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.358 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.358 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709900+0000", 2024-04-25T22:41:19.358 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1439999999999992e-06 2024-04-25T22:41:19.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.358 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.358 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:19.358 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713091+0000", 2024-04-25T22:41:19.358 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031910710000000002 2024-04-25T22:41:19.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.358 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.358 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:19.358 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713122+0000", 2024-04-25T22:41:19.358 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.048e-05 2024-04-25T22:41:19.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.359 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:19.359 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714538+0000", 2024-04-25T22:41:19.359 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014160030000000001 2024-04-25T22:41:19.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.359 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:19.359 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714627+0000", 2024-04-25T22:41:19.359 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518999999999995e-05 2024-04-25T22:41:19.359 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.359 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.359 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.359 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:19.360 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:19.360 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.732742071999994, 2024-04-25T22:41:19.360 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022089675999999999, 2024-04-25T22:41:19.360 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:19.360 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:19.360 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.360 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:19.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.360 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:19.360 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:19.360 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.361 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:19.361 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:19.361 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.361 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:19.361 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600120+0000", 2024-04-25T22:41:19.361 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1259999999999998e-06 2024-04-25T22:41:19.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.361 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:19.361 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600153+0000", 2024-04-25T22:41:19.361 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3186999999999999e-05 2024-04-25T22:41:19.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.362 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:19.362 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600181+0000", 2024-04-25T22:41:19.362 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7676000000000001e-05 2024-04-25T22:41:19.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.362 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.362 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.362 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600205+0000", 2024-04-25T22:41:19.362 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:41:19.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.362 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.362 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:19.362 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600467+0000", 2024-04-25T22:41:19.362 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026186800000000001 2024-04-25T22:41:19.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.363 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.363 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:19.363 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600809+0000", 2024-04-25T22:41:19.363 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034138400000000002 2024-04-25T22:41:19.363 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.363 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.363 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:19.363 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.601892+0000", 2024-04-25T22:41:19.363 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010831910000000001 2024-04-25T22:41:19.363 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.363 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.363 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:19.363 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611054+0000", 2024-04-25T22:41:19.363 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0091620940000000008 2024-04-25T22:41:19.363 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.364 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.364 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:19.364 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621965+0000", 2024-04-25T22:41:19.364 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010911044999999999 2024-04-25T22:41:19.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.364 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.364 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:19.364 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622090+0000", 2024-04-25T22:41:19.364 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012522 2024-04-25T22:41:19.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.364 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.364 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:19.365 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622202+0000", 2024-04-25T22:41:19.365 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011164500000000001 2024-04-25T22:41:19.365 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.365 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.365 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.365 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.365 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.365 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:19.365 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:19.365 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.732599016999998, 2024-04-25T22:41:19.365 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035756228000000001, 2024-04-25T22:41:19.365 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:19.365 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:19.365 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.366 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:19.366 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.366 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:19.366 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:19.366 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.366 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.366 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.366 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:19.366 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:19.366 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.366 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.366 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.366 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:19.366 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600257+0000", 2024-04-25T22:41:19.367 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8300000000000001e-06 2024-04-25T22:41:19.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.367 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.367 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:19.367 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600267+0000", 2024-04-25T22:41:19.367 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6539999999999994e-06 2024-04-25T22:41:19.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.367 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.367 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:19.367 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600293+0000", 2024-04-25T22:41:19.367 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5996e-05 2024-04-25T22:41:19.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.367 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.367 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.368 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600309+0000", 2024-04-25T22:41:19.368 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6206e-05 2024-04-25T22:41:19.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.368 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.368 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:19.368 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603757+0000", 2024-04-25T22:41:19.368 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003448244 2024-04-25T22:41:19.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.368 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.368 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:19.368 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604779+0000", 2024-04-25T22:41:19.368 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010216820000000001 2024-04-25T22:41:19.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.368 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.368 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:19.369 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605127+0000", 2024-04-25T22:41:19.369 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034820100000000002 2024-04-25T22:41:19.369 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.369 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.369 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:19.369 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611082+0000", 2024-04-25T22:41:19.369 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0059550640000000004 2024-04-25T22:41:19.369 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.369 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.369 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:19.369 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635779+0000", 2024-04-25T22:41:19.370 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024696665999999999 2024-04-25T22:41:19.370 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.370 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.370 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:19.370 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635915+0000", 2024-04-25T22:41:19.374 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000135809 2024-04-25T22:41:19.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.374 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.374 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:19.374 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636011+0000", 2024-04-25T22:41:19.374 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6875999999999999e-05 2024-04-25T22:41:19.374 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.374 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.374 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.374 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.375 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:19.375 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:19.375 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.732521804000001, 2024-04-25T22:41:19.375 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035327031000000002, 2024-04-25T22:41:19.375 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:19.375 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:19.375 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.375 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:19.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.375 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:19.375 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:19.375 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.375 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:19.376 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:19.376 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.376 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.376 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:19.376 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600334+0000", 2024-04-25T22:41:19.376 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:41:19.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.376 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.376 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:19.376 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600347+0000", 2024-04-25T22:41:19.376 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3593e-05 2024-04-25T22:41:19.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.376 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.376 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:19.377 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600371+0000", 2024-04-25T22:41:19.377 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.313e-05 2024-04-25T22:41:19.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.377 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.377 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.377 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600390+0000", 2024-04-25T22:41:19.377 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.908e-05 2024-04-25T22:41:19.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.377 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.377 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:19.377 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602756+0000", 2024-04-25T22:41:19.377 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023662560000000002 2024-04-25T22:41:19.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.378 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.378 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:19.378 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603021+0000", 2024-04-25T22:41:19.378 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026546399999999998 2024-04-25T22:41:19.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.379 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:19.379 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603304+0000", 2024-04-25T22:41:19.379 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028308800000000002 2024-04-25T22:41:19.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.380 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:19.380 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611075+0000", 2024-04-25T22:41:19.380 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077703900000000003 2024-04-25T22:41:19.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.380 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.380 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:19.380 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635414+0000", 2024-04-25T22:41:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024339326000000001 2024-04-25T22:41:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635544+0000", 2024-04-25T22:41:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012948199999999999 2024-04-25T22:41:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635659+0000", 2024-04-25T22:41:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000115809 2024-04-25T22:41:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.381 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.382 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.382 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:19.382 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:19.382 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.732361878999995, 2024-04-25T22:41:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035594492999999998, 2024-04-25T22:41:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600494+0000", 2024-04-25T22:41:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:41:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600502+0000", 2024-04-25T22:41:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3769999999999996e-06 2024-04-25T22:41:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600522+0000", 2024-04-25T22:41:19.384 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9919999999999999e-05 2024-04-25T22:41:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600539+0000", 2024-04-25T22:41:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.649e-05 2024-04-25T22:41:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604846+0000", 2024-04-25T22:41:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043075199999999996 2024-04-25T22:41:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:19.385 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605057+0000", 2024-04-25T22:41:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00021085200000000001 2024-04-25T22:41:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605378+0000", 2024-04-25T22:41:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032074799999999999 2024-04-25T22:41:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611089+0000", 2024-04-25T22:41:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057110249999999998 2024-04-25T22:41:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.386 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635844+0000", 2024-04-25T22:41:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024755355999999999 2024-04-25T22:41:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635986+0000", 2024-04-25T22:41:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141512 2024-04-25T22:41:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636087+0000", 2024-04-25T22:41:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101183 2024-04-25T22:41:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.387 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.732289269000006, 2024-04-25T22:41:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021266723000000001, 2024-04-25T22:41:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:19.388 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600566+0000", 2024-04-25T22:41:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4959999999999999e-06 2024-04-25T22:41:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:19.389 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600574+0000", 2024-04-25T22:41:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-06 2024-04-25T22:41:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600592+0000", 2024-04-25T22:41:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8479999999999999e-05 2024-04-25T22:41:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600610+0000", 2024-04-25T22:41:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7567e-05 2024-04-25T22:41:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.390 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602679+0000", 2024-04-25T22:41:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020692739999999999 2024-04-25T22:41:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602945+0000", 2024-04-25T22:41:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026640399999999998 2024-04-25T22:41:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603115+0000", 2024-04-25T22:41:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000169996 2024-04-25T22:41:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.391 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:19.392 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608398+0000", 2024-04-25T22:41:19.392 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052826289999999996 2024-04-25T22:41:19.392 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.392 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.392 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:19.392 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621588+0000", 2024-04-25T22:41:19.392 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013190489 2024-04-25T22:41:19.392 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.392 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.392 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:19.392 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621733+0000", 2024-04-25T22:41:19.392 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014462500000000001 2024-04-25T22:41:19.392 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.392 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.392 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:19.393 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621832+0000", 2024-04-25T22:41:19.393 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8603000000000004e-05 2024-04-25T22:41:19.393 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.393 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.393 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.393 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.393 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.393 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:19.393 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:19.393 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.732221542999994, 2024-04-25T22:41:19.393 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034747924999999999, 2024-04-25T22:41:19.393 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:19.393 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:19.393 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.394 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:19.394 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.394 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:19.394 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:19.394 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.394 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.394 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:19.394 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:19.394 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.394 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.394 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:19.394 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600634+0000", 2024-04-25T22:41:19.394 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-04-25T22:41:19.395 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.395 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.395 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:19.395 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600642+0000", 2024-04-25T22:41:19.395 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8169999999999999e-06 2024-04-25T22:41:19.395 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.395 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.395 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:19.395 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600660+0000", 2024-04-25T22:41:19.395 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8513e-05 2024-04-25T22:41:19.395 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.395 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.395 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.395 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600676+0000", 2024-04-25T22:41:19.396 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6019999999999999e-05 2024-04-25T22:41:19.396 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.396 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.396 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:19.396 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603748+0000", 2024-04-25T22:41:19.396 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030718329999999999 2024-04-25T22:41:19.396 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.396 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.396 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:19.396 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604752+0000", 2024-04-25T22:41:19.396 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001003603 2024-04-25T22:41:19.396 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.396 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.396 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:19.397 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605117+0000", 2024-04-25T22:41:19.397 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00036539 2024-04-25T22:41:19.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.397 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.397 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:19.397 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608459+0000", 2024-04-25T22:41:19.397 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033413879999999998 2024-04-25T22:41:19.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.397 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.397 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:19.397 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635106+0000", 2024-04-25T22:41:19.397 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026647607 2024-04-25T22:41:19.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.397 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.397 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:19.398 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635273+0000", 2024-04-25T22:41:19.398 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000166689 2024-04-25T22:41:19.398 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.398 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.398 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:19.398 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635381+0000", 2024-04-25T22:41:19.398 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107642 2024-04-25T22:41:19.398 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.398 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.399 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.399 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.399 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.399 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:19.399 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:19.399 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.732158314000003, 2024-04-25T22:41:19.399 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040419292000000002, 2024-04-25T22:41:19.400 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:19.400 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:19.400 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.400 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:19.400 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.400 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:19.401 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:19.401 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.401 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.401 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.401 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:19.401 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:19.401 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.402 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.402 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.402 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:19.402 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600697+0000", 2024-04-25T22:41:19.403 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1999999999999999e-06 2024-04-25T22:41:19.403 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.403 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.403 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:19.403 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600704+0000", 2024-04-25T22:41:19.403 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5570000000000001e-06 2024-04-25T22:41:19.404 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.404 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.404 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:19.404 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600724+0000", 2024-04-25T22:41:19.404 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0023000000000001e-05 2024-04-25T22:41:19.404 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.405 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.405 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.405 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600738+0000", 2024-04-25T22:41:19.405 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4372999999999999e-05 2024-04-25T22:41:19.405 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.405 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.405 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:19.405 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.612532+0000", 2024-04-25T22:41:19.406 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011793606 2024-04-25T22:41:19.406 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.406 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.406 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:19.406 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613354+0000", 2024-04-25T22:41:19.406 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00082244100000000004 2024-04-25T22:41:19.406 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.406 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.406 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:19.406 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613726+0000", 2024-04-25T22:41:19.406 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00037226000000000002 2024-04-25T22:41:19.406 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.406 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.406 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:19.407 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618891+0000", 2024-04-25T22:41:19.407 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051649199999999999 2024-04-25T22:41:19.407 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.407 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.407 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:19.407 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.640874+0000", 2024-04-25T22:41:19.407 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021982640000000001 2024-04-25T22:41:19.407 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.407 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.407 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:19.407 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641019+0000", 2024-04-25T22:41:19.407 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000145339 2024-04-25T22:41:19.407 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.407 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.407 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:19.408 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641115+0000", 2024-04-25T22:41:19.408 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5933000000000005e-05 2024-04-25T22:41:19.408 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.408 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.408 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.408 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.408 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.408 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:19.408 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:19.408 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.732072283999997, 2024-04-25T22:41:19.408 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036502711, 2024-04-25T22:41:19.408 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:19.408 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:19.408 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:19.409 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:19.409 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.409 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:19.409 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:19.409 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.409 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.409 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.409 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:19.409 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:19.409 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.409 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.409 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.410 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:19.410 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600783+0000", 2024-04-25T22:41:19.410 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.533e-06 2024-04-25T22:41:19.410 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.410 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.410 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:19.410 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600790+0000", 2024-04-25T22:41:19.410 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0439999999999998e-06 2024-04-25T22:41:19.410 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.410 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.410 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:19.410 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600811+0000", 2024-04-25T22:41:19.410 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0449e-05 2024-04-25T22:41:19.410 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.411 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.411 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.411 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600825+0000", 2024-04-25T22:41:19.411 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4293e-05 2024-04-25T22:41:19.411 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.411 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.411 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:19.411 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602304+0000", 2024-04-25T22:41:19.411 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001478629 2024-04-25T22:41:19.411 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.411 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.411 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:19.411 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602587+0000", 2024-04-25T22:41:19.411 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028350800000000002 2024-04-25T22:41:19.412 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.412 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.412 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:19.412 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.637285+0000", 2024-04-25T22:41:19.412 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034697255000000003 2024-04-25T22:41:19.412 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.412 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.412 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.412 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.412 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.412 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:19.412 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:19.412 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.732006717999994, 2024-04-25T22:41:19.412 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017311460000000001, 2024-04-25T22:41:19.412 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:19.413 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:19.413 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:19.413 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:19.413 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.413 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:19.413 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:19.413 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.413 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.413 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.413 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:19.413 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:19.413 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.413 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.413 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.414 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:19.414 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600849+0000", 2024-04-25T22:41:19.414 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2899999999999999e-06 2024-04-25T22:41:19.414 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.414 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.414 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:19.414 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600866+0000", 2024-04-25T22:41:19.414 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6793e-05 2024-04-25T22:41:19.414 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.414 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.414 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:19.414 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600886+0000", 2024-04-25T22:41:19.414 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0772999999999999e-05 2024-04-25T22:41:19.414 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.415 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.415 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.415 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600904+0000", 2024-04-25T22:41:19.415 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7697e-05 2024-04-25T22:41:19.415 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.415 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.415 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:19.415 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602796+0000", 2024-04-25T22:41:19.415 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018920149999999999 2024-04-25T22:41:19.415 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.415 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.415 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:19.415 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602962+0000", 2024-04-25T22:41:19.415 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016590600000000001 2024-04-25T22:41:19.415 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.416 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.416 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:19.416 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618159+0000", 2024-04-25T22:41:19.416 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015196985999999999 2024-04-25T22:41:19.416 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.416 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.416 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.416 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.416 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.416 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:19.416 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:19.416 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.717130976999997, 2024-04-25T22:41:19.416 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006380269, 2024-04-25T22:41:19.417 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:19.417 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:19.417 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.417 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:19.417 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.417 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:19.417 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:19.418 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.418 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.418 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.418 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:19.418 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:19.418 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.418 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.419 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.419 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:19.419 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615724+0000", 2024-04-25T22:41:19.419 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.094e-06 2024-04-25T22:41:19.419 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.419 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.419 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:19.419 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615734+0000", 2024-04-25T22:41:19.419 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.363e-06 2024-04-25T22:41:19.419 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.419 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.419 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:19.419 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615751+0000", 2024-04-25T22:41:19.419 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:41:19.420 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.420 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.420 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.420 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615773+0000", 2024-04-25T22:41:19.420 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.154e-05 2024-04-25T22:41:19.420 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.420 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.420 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:19.420 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616485+0000", 2024-04-25T22:41:19.420 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00071225100000000001 2024-04-25T22:41:19.420 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.420 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.420 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:19.420 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616528+0000", 2024-04-25T22:41:19.421 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3606000000000002e-05 2024-04-25T22:41:19.421 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.421 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.421 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:19.421 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622030+0000", 2024-04-25T22:41:19.421 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055010750000000002 2024-04-25T22:41:19.421 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.421 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.421 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:19.421 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622103+0000", 2024-04-25T22:41:19.421 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3930000000000005e-05 2024-04-25T22:41:19.421 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.421 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.421 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.421 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.422 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.422 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:19.422 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:19.422 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.716218040000001, 2024-04-25T22:41:19.422 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046420649999999999, 2024-04-25T22:41:19.422 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:19.422 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:19.422 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-04-25T22:41:19.422 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:19.422 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.422 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:19.422 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:19.422 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.423 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.423 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.423 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:19.423 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:19.423 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.423 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.423 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.423 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:19.423 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616637+0000", 2024-04-25T22:41:19.423 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0299999999999998e-07 2024-04-25T22:41:19.423 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.423 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.423 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:19.423 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616653+0000", 2024-04-25T22:41:19.423 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5843000000000001e-05 2024-04-25T22:41:19.424 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.424 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.424 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:19.424 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616690+0000", 2024-04-25T22:41:19.424 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7466999999999999e-05 2024-04-25T22:41:19.424 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.424 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.424 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.424 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616729+0000", 2024-04-25T22:41:19.424 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8810000000000003e-05 2024-04-25T22:41:19.424 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.424 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.424 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:19.424 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617251+0000", 2024-04-25T22:41:19.424 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00052143899999999995 2024-04-25T22:41:19.425 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.425 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.425 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:19.425 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621278+0000", 2024-04-25T22:41:19.425 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040277029999999997 2024-04-25T22:41:19.425 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.425 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.425 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.425 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.425 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.425 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:19.425 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:19.425 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.715194687999997, 2024-04-25T22:41:19.425 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0065101730000000002, 2024-04-25T22:41:19.426 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:19.426 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:19.426 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.426 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:19.426 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.426 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:19.426 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:19.426 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.426 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.426 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.426 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:19.426 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:19.426 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.426 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.427 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.427 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:19.427 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617661+0000", 2024-04-25T22:41:19.427 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:41:19.427 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.427 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.427 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:19.427 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617688+0000", 2024-04-25T22:41:19.427 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7589e-05 2024-04-25T22:41:19.427 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.427 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.427 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:19.427 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617710+0000", 2024-04-25T22:41:19.427 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1467e-05 2024-04-25T22:41:19.428 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.428 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.428 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.428 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617727+0000", 2024-04-25T22:41:19.428 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6990000000000002e-05 2024-04-25T22:41:19.428 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.428 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.428 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:19.428 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618559+0000", 2024-04-25T22:41:19.428 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083207400000000003 2024-04-25T22:41:19.428 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.428 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.428 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:19.428 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618608+0000", 2024-04-25T22:41:19.429 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8936e-05 2024-04-25T22:41:19.429 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.429 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.429 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:19.429 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624077+0000", 2024-04-25T22:41:19.429 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054695840000000004 2024-04-25T22:41:19.429 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.429 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.429 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:19.429 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624170+0000", 2024-04-25T22:41:19.429 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2305999999999993e-05 2024-04-25T22:41:19.429 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.429 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.429 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.429 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.430 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.430 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:19.430 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:19.430 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.710093180000001, 2024-04-25T22:41:19.430 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006879446, 2024-04-25T22:41:19.430 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:19.430 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:19.430 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.430 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:19.430 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.430 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:19.430 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:19.430 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.430 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.431 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.431 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:19.431 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:19.431 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.431 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.431 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.431 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:19.431 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622762+0000", 2024-04-25T22:41:19.431 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:41:19.431 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.431 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.431 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:19.431 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622781+0000", 2024-04-25T22:41:19.431 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8749999999999998e-05 2024-04-25T22:41:19.431 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.432 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.432 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:19.432 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622802+0000", 2024-04-25T22:41:19.432 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1650000000000001e-05 2024-04-25T22:41:19.432 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.432 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.432 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.432 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622816+0000", 2024-04-25T22:41:19.432 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3556e-05 2024-04-25T22:41:19.432 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.432 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.432 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:19.432 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623700+0000", 2024-04-25T22:41:19.432 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00088389299999999996 2024-04-25T22:41:19.433 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.433 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.433 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:19.433 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623741+0000", 2024-04-25T22:41:19.433 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1023999999999999e-05 2024-04-25T22:41:19.433 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.433 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.433 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:19.433 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629543+0000", 2024-04-25T22:41:19.433 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058023980000000003 2024-04-25T22:41:19.433 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.433 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.433 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:19.433 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629640+0000", 2024-04-25T22:41:19.434 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7381999999999997e-05 2024-04-25T22:41:19.434 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.434 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.434 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.434 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.434 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.434 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:19.434 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:19.434 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.709831976000004, 2024-04-25T22:41:19.434 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067054879999999999, 2024-04-25T22:41:19.434 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:19.435 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:19.435 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.435 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:19.435 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.435 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:19.435 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:19.435 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.435 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.435 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.435 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:19.435 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:19.435 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.435 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.435 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.436 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:19.436 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623032+0000", 2024-04-25T22:41:19.436 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.9930000000000007e-06 2024-04-25T22:41:19.436 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.436 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.436 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:19.436 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623043+0000", 2024-04-25T22:41:19.436 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0387000000000001e-05 2024-04-25T22:41:19.436 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.436 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.436 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:19.436 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623064+0000", 2024-04-25T22:41:19.436 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1849999999999999e-05 2024-04-25T22:41:19.436 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.436 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.437 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.437 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623079+0000", 2024-04-25T22:41:19.437 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4093e-05 2024-04-25T22:41:19.437 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.437 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.437 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:19.437 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624384+0000", 2024-04-25T22:41:19.437 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013054539999999999 2024-04-25T22:41:19.437 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.437 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.437 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:19.437 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624421+0000", 2024-04-25T22:41:19.437 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7088999999999997e-05 2024-04-25T22:41:19.437 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.437 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.438 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:19.438 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629645+0000", 2024-04-25T22:41:19.438 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052241400000000004 2024-04-25T22:41:19.438 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.438 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.438 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:19.438 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629728+0000", 2024-04-25T22:41:19.438 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2482000000000001e-05 2024-04-25T22:41:19.438 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.438 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.438 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.438 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.438 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.439 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2024-04-25T22:41:19.439 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:19.439 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 64.709748863000002, 2024-04-25T22:41:19.439 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078029559999999998, 2024-04-25T22:41:19.439 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:19.439 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:19.439 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.439 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:19.439 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.439 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:19.439 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:19.439 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.439 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.439 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.440 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:19.440 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:19.440 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:19.440 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.440 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.440 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:19.440 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623106+0000", 2024-04-25T22:41:19.440 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.64e-07 2024-04-25T22:41:19.440 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.440 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.440 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:19.440 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623141+0000", 2024-04-25T22:41:19.440 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4678999999999998e-05 2024-04-25T22:41:19.440 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.441 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.441 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:19.441 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623153+0000", 2024-04-25T22:41:19.441 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1759999999999999e-05 2024-04-25T22:41:19.441 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.441 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.441 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.441 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623161+0000", 2024-04-25T22:41:19.441 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8299999999999996e-06 2024-04-25T22:41:19.441 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.441 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.441 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:19.441 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623834+0000", 2024-04-25T22:41:19.441 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067394500000000001 2024-04-25T22:41:19.441 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.442 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.442 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:19.442 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623883+0000", 2024-04-25T22:41:19.442 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8640000000000002e-05 2024-04-25T22:41:19.442 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.442 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.442 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:19.442 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630807+0000", 2024-04-25T22:41:19.442 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069238859999999998 2024-04-25T22:41:19.442 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:19.442 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:19.442 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:19.442 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630908+0000", 2024-04-25T22:41:19.442 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101252 2024-04-25T22:41:19.443 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.443 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.443 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.443 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:19.443 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:19.443 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:19.445 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:19.445 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:19.442+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:19.546 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:19.546+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:19.579 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:19.579 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:19.579 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:19.579 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:19.594 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:19.647 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:19.646+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:19.705 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:41:19.713 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:19.713 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:19.713 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:19.713 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:19.713 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:19.727 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:19.748 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:19.746+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:19.781 INFO:teuthology.orchestra.run.smithi057.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-25T22:41:19.787 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T22:41:19.787 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-25T22:41:19.847 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:19.847 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:19.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:19.847 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:19.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.847 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:19.847 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:19.848 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 65.249364151999998, 2024-04-25T22:41:19.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:19.848 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:19.848 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:19.848 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.848 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:19.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:19.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:19.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:19.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:19.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:19.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:19.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:19.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:19.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:19.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:19.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:19.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:19.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:19.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:19.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:19.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:19.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:19.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:19.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:19.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:19.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:19.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:19.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:19.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:19.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:19.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:19.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:19.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:19.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:19.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:19.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:19.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:19.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:19.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:19.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:19.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:19.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:19.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:19.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:19.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:19.853 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.853 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.853 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.853 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:19.854 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:19.854 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 65.249226895999996, 2024-04-25T22:41:19.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:19.854 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:19.854 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:19.854 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.854 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:19.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.854 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:19.854 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:19.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:19.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:19.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:19.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:19.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:19.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:19.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:19.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:19.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:19.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:19.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:19.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:19.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:19.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:19.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:19.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:19.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:19.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:19.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:19.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:19.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:19.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:19.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:19.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:19.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:19.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:19.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:19.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:19.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:19.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:19.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:19.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:19.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:19.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:19.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:19.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:19.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:19.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:19.859 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.859 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.859 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.859 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:19.859 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:19.860 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 65.249139344, 2024-04-25T22:41:19.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:19.860 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:19.860 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:19.860 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.860 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:19.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:19.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:19.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:19.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:19.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:19.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:19.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:19.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:19.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:19.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:19.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:19.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:19.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:19.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:19.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:19.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:19.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:19.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:19.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:19.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:19.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:19.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:19.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:19.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:19.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:19.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:19.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:19.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:19.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:19.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:19.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:19.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:19.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:19.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:19.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:19.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:19.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:19.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:19.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:19.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:19.866 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.866 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.866 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.866 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:19.866 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:19.866 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 65.249035517999999, 2024-04-25T22:41:19.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:19.867 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:19.867 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:19.867 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.867 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:19.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:19.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:19.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:19.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:19.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:19.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:19.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:19.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:19.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:19.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:19.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:19.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:19.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:19.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:19.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:19.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:19.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:19.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:19.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:19.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:19.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:19.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:19.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:19.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:19.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:19.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:19.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:19.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:19.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:19.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:19.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:19.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:19.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:19.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:19.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:19.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:19.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:19.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:19.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:19.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:19.872 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.872 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.872 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.872 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:19.872 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:19.872 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 65.248966727999999, 2024-04-25T22:41:19.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:19.872 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:19.872 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:19.872 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.873 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:19.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:19.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:19.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:19.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:19.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:19.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:19.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:19.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:19.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:19.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:19.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:19.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:19.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:19.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:19.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:19.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:19.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:19.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:19.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:19.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:19.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:19.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:19.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 65.248897642000003, 2024-04-25T22:41:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:19.878 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:19.879 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.879 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:19.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:19.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:19.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:19.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:19.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:19.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:19.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:19.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:19.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:19.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:19.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:19.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:19.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:19.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.882 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:19.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:19.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.882 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:19.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:19.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:19.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:19.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:19.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:19.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:19.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:19.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:19.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:19.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:19.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:19.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:19.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:19.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:19.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:19.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:19.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:19.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:19.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:19.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:19.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:19.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:19.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:19.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:19.886 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.887 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.887 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.887 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:19.887 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:19.887 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 65.248801529000005, 2024-04-25T22:41:19.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:19.887 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:19.887 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:19.887 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:19.887 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:19.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:19.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:19.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:19.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:19.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:19.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:19.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:19.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:19.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:19.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:19.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:19.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:19.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:19.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:19.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:19.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:19.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:19.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:19.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:19.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:19.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:19.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:19.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:19.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:19.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:19.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:19.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:19.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:19.892 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.892 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.892 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.892 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:19.892 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:19.892 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 65.248735866999994, 2024-04-25T22:41:19.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:19.892 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:19.893 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:19.893 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:19.893 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:19.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:19.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:19.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:19.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:19.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:19.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:19.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:19.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:19.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:19.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:19.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:19.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:19.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:19.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:19.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:19.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:19.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:19.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:19.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:19.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:19.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:19.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:19.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:19.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:19.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:19.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:19.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:19.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:19.896 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.897 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.897 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.897 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:19.897 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:19.897 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 65.248666740000004, 2024-04-25T22:41:19.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:19.897 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:19.897 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:19.897 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:19.897 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:19.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:19.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:19.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:19.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:19.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:19.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:19.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:19.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:19.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:19.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:19.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:19.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:19.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:19.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:19.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:19.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:19.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:19.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:19.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:19.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:19.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:19.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:19.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:19.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:19.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:19.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:19.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:19.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:19.901 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.902 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.902 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.902 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:19.902 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:19.902 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 65.237850084000002, 2024-04-25T22:41:19.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:19.902 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:19.902 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:19.902 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:19.902 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:19.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:19.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:19.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:19.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:19.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:19.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:19.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:19.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:19.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:19.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:19.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:19.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:19.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:19.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:19.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:19.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:19.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:19.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:19.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:19.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:19.905 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.905 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.905 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.906 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:19.906 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:19.906 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 65.220951731, 2024-04-25T22:41:19.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:19.906 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:19.906 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:19.906 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:19.906 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:19.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:19.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:19.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:19.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:19.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:19.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:19.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:19.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:19.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:19.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:19.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:19.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:19.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:19.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:19.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:19.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:19.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:19.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:19.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:19.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:19.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:19.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:19.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:19.909 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.909 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.909 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.910 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:19.910 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:19.910 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 65.220130841, 2024-04-25T22:41:19.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:19.910 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:19.910 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:19.910 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:19.910 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:19.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:19.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:19.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:19.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:19.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:19.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:19.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:19.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:19.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:19.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:19.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:19.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:19.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:19.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:19.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:19.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:19.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:19.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:19.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:19.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:19.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:19.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:19.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:19.913 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.913 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.913 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.913 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:19.913 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:19.913 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 65.218430112999997, 2024-04-25T22:41:19.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:19.914 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:19.914 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:19.914 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.914 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:19.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:19.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:19.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:19.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:19.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:19.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:19.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:19.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:19.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:19.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:19.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:19.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:19.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:19.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:19.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:19.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:19.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:19.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:19.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:19.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:19.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:19.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:19.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:19.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:19.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:19.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:19.917 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.917 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.917 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.918 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:19.918 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:19.918 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 65.217833438, 2024-04-25T22:41:19.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:19.918 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:19.918 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:19.918 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.918 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:19.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:19.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:19.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:19.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:19.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:19.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:19.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:19.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:19.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:19.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:19.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:19.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:19.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:19.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:19.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:19.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:19.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:19.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:19.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:19.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:19.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:19.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:19.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:19.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:19.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:19.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:19.922 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.922 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.922 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.922 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:19.922 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:19.922 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 65.208397711999993, 2024-04-25T22:41:19.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:19.922 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:19.922 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:19.922 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:19.923 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:19.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:19.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:19.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:19.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:19.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:19.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:19.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:19.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:19.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:19.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:19.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:19.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:19.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:19.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:19.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:19.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:19.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:19.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:19.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:19.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:19.925 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.925 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.925 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.926 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:19.926 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:19.926 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 65.207750286000007, 2024-04-25T22:41:19.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:19.926 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:19.926 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:19.926 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.926 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:19.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:19.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:19.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:19.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:19.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:19.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:19.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:19.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:19.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:19.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:19.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:19.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:19.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:19.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:19.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:19.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:19.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:19.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:19.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:19.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:19.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:19.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:19.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:19.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:19.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:19.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:19.929 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.929 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.930 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.930 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:19.930 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:19.930 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 65.206309466999997, 2024-04-25T22:41:19.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:19.930 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:19.930 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:19.930 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.930 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:19.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:19.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:19.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:19.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:19.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:19.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:19.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:19.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:19.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:19.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:19.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:19.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:19.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:19.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:19.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:19.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:19.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:19.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:19.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:19.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:19.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:19.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:19.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:19.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:19.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:19.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:19.934 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.934 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.934 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.934 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:19.934 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:19.934 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.253871023000002, 2024-04-25T22:41:19.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:19.935 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:19.935 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:19.935 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.935 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:19.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:19.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:19.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:19.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:19.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:19.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:19.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:19.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:19.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:19.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:19.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:19.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:19.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:19.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:19.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:19.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:19.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:19.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:19.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:19.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:19.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:19.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:19.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:19.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:19.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:19.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:19.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:19.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:19.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:19.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:19.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:19.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:19.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:19.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:19.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:19.939 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.940 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.940 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.940 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:19.940 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:19.940 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 41.251211699000002, 2024-04-25T22:41:19.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:19.940 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:19.940 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:19.940 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.940 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:19.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:19.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:19.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:19.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:19.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:19.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:19.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:19.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:19.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:19.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:19.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:19.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:19.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:19.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:19.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:19.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:19.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:19.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:19.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:19.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:19.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:19.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:19.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:19.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:19.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:19.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:19.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:19.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:19.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:19.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:19.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:19.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:19.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:19.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:19.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:19.945 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.945 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.945 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.945 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:19.945 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:19.945 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 36.250919447999998, 2024-04-25T22:41:19.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:19.945 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:19.945 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:19.946 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:19.946 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:19.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:19.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:19.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:19.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:19.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:19.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:19.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:19.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:19.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:19.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:19.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:19.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:19.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:19.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:19.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:19.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:19.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:19.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:19.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:19.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:19.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:19.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:19.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:19.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:19.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:19.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:19.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:19.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:19.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:19.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:19.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:19.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:19.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:19.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:19.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:19.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:19.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:19.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:19.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:19.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:19.950 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.950 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.950 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.950 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:19.951 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:19.951 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:19.952 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:19.952 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:19.953 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:41:19.953 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:41:19.953 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:19.954 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:19.955 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:19.955 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:19.954+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:20.053 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:20.050+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:20.086 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:20.087 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:20.100 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:20.137 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:41:20.154 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:20.153+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:20.218 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:20.218 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:20.232 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:20.254 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:20.253+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:20.350 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:20.350 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:20.355 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:20.353+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:20.364 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:41:20.456 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:20.454+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:20.493 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:20.493 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:20.507 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:41:20.556 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:20.554+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:20.624 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:20.624 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:20.638 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:41:20.679 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:20.678+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:20.758 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:20.758+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:20.802 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:20.802 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:20.816 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:20.859 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:20.858+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:20.947 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:20.948 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:20.961 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:20.957+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:20.962 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:21.064 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:21.062+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:21.130 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:21.131 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:21.140 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is unset 2024-04-25T22:41:21.144 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:21.190 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:21.189+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:21.264 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:21.261+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:21.265 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:21.265 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:21.279 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:21.365 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:21.361+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:21.412 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:21.412 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:21.427 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:21.472 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:21.474+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:21.545 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:21.546 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:21.561 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:21.567 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:21.565+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:21.667 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:21.665+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:21.727 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:21.727 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:21.741 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:41:21.768 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:21.770+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:21.869 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:21.870+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:21.874 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:21.875 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:21.890 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:41:21.955 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:41:21.970 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:21.969+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:22.010 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:22.010 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:22.024 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:41:22.071 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:22.070+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:22.114 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:22.114 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:22.134 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:41:22.135 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:41:22.145 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:22.145 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-04-25T22:41:22.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-04-25T22:41:22.145 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-04-25T22:41:22.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.145 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:111 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'73, mlcod=11'69)", 2024-04-25T22:41:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.443636017000003, 2024-04-25T22:41:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055481899999999997, 2024-04-25T22:41:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700271+0000", 2024-04-25T22:41:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:41:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700278+0000", 2024-04-25T22:41:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-04-25T22:41:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700323+0000", 2024-04-25T22:41:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4212999999999998e-05 2024-04-25T22:41:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700333+0000", 2024-04-25T22:41:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0433e-05 2024-04-25T22:41:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700662+0000", 2024-04-25T22:41:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032862800000000003 2024-04-25T22:41:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700692+0000", 2024-04-25T22:41:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0395999999999998e-05 2024-04-25T22:41:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705728+0000", 2024-04-25T22:41:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050361939999999999 2024-04-25T22:41:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705818+0000", 2024-04-25T22:41:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9573000000000005e-05 2024-04-25T22:41:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-25T22:41:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.443091164999998, 2024-04-25T22:41:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005065501, 2024-04-25T22:41:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700816+0000", 2024-04-25T22:41:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.24e-06 2024-04-25T22:41:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700914+0000", 2024-04-25T22:41:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8057e-05 2024-04-25T22:41:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700931+0000", 2024-04-25T22:41:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7745999999999999e-05 2024-04-25T22:41:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700941+0000", 2024-04-25T22:41:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5699999999999999e-06 2024-04-25T22:41:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701162+0000", 2024-04-25T22:41:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000221392 2024-04-25T22:41:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701194+0000", 2024-04-25T22:41:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1745999999999997e-05 2024-04-25T22:41:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705821+0000", 2024-04-25T22:41:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046269869999999999 2024-04-25T22:41:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705880+0000", 2024-04-25T22:41:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8763e-05 2024-04-25T22:41:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:118 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'80, mlcod=11'78)", 2024-04-25T22:41:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.435735554999994, 2024-04-25T22:41:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047806089999999999, 2024-04-25T22:41:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708172+0000", 2024-04-25T22:41:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0600000000000002e-06 2024-04-25T22:41:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708291+0000", 2024-04-25T22:41:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118892 2024-04-25T22:41:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708320+0000", 2024-04-25T22:41:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8822999999999998e-05 2024-04-25T22:41:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708337+0000", 2024-04-25T22:41:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7586999999999999e-05 2024-04-25T22:41:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708512+0000", 2024-04-25T22:41:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017439500000000001 2024-04-25T22:41:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708551+0000", 2024-04-25T22:41:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.909e-05 2024-04-25T22:41:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712865+0000", 2024-04-25T22:41:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043142069999999996 2024-04-25T22:41:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712951+0000", 2024-04-25T22:41:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5555000000000003e-05 2024-04-25T22:41:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:120 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'82, mlcod=11'78)", 2024-04-25T22:41:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.434729512999994, 2024-04-25T22:41:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047170700000000003, 2024-04-25T22:41:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709177+0000", 2024-04-25T22:41:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.19e-06 2024-04-25T22:41:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709315+0000", 2024-04-25T22:41:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000137429 2024-04-25T22:41:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709341+0000", 2024-04-25T22:41:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:41:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709353+0000", 2024-04-25T22:41:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2027e-05 2024-04-25T22:41:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710040+0000", 2024-04-25T22:41:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068710799999999997 2024-04-25T22:41:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710076+0000", 2024-04-25T22:41:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5982999999999998e-05 2024-04-25T22:41:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713802+0000", 2024-04-25T22:41:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037255750000000001 2024-04-25T22:41:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713893+0000", 2024-04-25T22:41:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1201999999999999e-05 2024-04-25T22:41:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:121 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'83, mlcod=11'78)", 2024-04-25T22:41:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.434182876999998, 2024-04-25T22:41:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0049043919999999996, 2024-04-25T22:41:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709724+0000", 2024-04-25T22:41:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.483e-06 2024-04-25T22:41:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709872+0000", 2024-04-25T22:41:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147446 2024-04-25T22:41:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709891+0000", 2024-04-25T22:41:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9245999999999998e-05 2024-04-25T22:41:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709900+0000", 2024-04-25T22:41:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1439999999999992e-06 2024-04-25T22:41:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713091+0000", 2024-04-25T22:41:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031910710000000002 2024-04-25T22:41:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713122+0000", 2024-04-25T22:41:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.048e-05 2024-04-25T22:41:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714538+0000", 2024-04-25T22:41:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014160030000000001 2024-04-25T22:41:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714627+0000", 2024-04-25T22:41:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518999999999995e-05 2024-04-25T22:41:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 67.543793496999996, 2024-04-25T22:41:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022089675999999999, 2024-04-25T22:41:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600120+0000", 2024-04-25T22:41:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1259999999999998e-06 2024-04-25T22:41:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600153+0000", 2024-04-25T22:41:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3186999999999999e-05 2024-04-25T22:41:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600181+0000", 2024-04-25T22:41:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7676000000000001e-05 2024-04-25T22:41:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600205+0000", 2024-04-25T22:41:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:41:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600467+0000", 2024-04-25T22:41:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026186800000000001 2024-04-25T22:41:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600809+0000", 2024-04-25T22:41:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034138400000000002 2024-04-25T22:41:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.601892+0000", 2024-04-25T22:41:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010831910000000001 2024-04-25T22:41:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611054+0000", 2024-04-25T22:41:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0091620940000000008 2024-04-25T22:41:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621965+0000", 2024-04-25T22:41:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010911044999999999 2024-04-25T22:41:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622090+0000", 2024-04-25T22:41:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012522 2024-04-25T22:41:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622202+0000", 2024-04-25T22:41:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011164500000000001 2024-04-25T22:41:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 67.543650442000001, 2024-04-25T22:41:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035756228000000001, 2024-04-25T22:41:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600257+0000", 2024-04-25T22:41:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8300000000000001e-06 2024-04-25T22:41:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600267+0000", 2024-04-25T22:41:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6539999999999994e-06 2024-04-25T22:41:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600293+0000", 2024-04-25T22:41:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5996e-05 2024-04-25T22:41:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600309+0000", 2024-04-25T22:41:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6206e-05 2024-04-25T22:41:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603757+0000", 2024-04-25T22:41:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003448244 2024-04-25T22:41:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604779+0000", 2024-04-25T22:41:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010216820000000001 2024-04-25T22:41:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605127+0000", 2024-04-25T22:41:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034820100000000002 2024-04-25T22:41:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611082+0000", 2024-04-25T22:41:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0059550640000000004 2024-04-25T22:41:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635779+0000", 2024-04-25T22:41:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024696665999999999 2024-04-25T22:41:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635915+0000", 2024-04-25T22:41:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000135809 2024-04-25T22:41:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636011+0000", 2024-04-25T22:41:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6875999999999999e-05 2024-04-25T22:41:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 67.543573229000003, 2024-04-25T22:41:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035327031000000002, 2024-04-25T22:41:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600334+0000", 2024-04-25T22:41:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:41:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600347+0000", 2024-04-25T22:41:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3593e-05 2024-04-25T22:41:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600371+0000", 2024-04-25T22:41:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.313e-05 2024-04-25T22:41:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600390+0000", 2024-04-25T22:41:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.908e-05 2024-04-25T22:41:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602756+0000", 2024-04-25T22:41:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023662560000000002 2024-04-25T22:41:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603021+0000", 2024-04-25T22:41:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026546399999999998 2024-04-25T22:41:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603304+0000", 2024-04-25T22:41:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028308800000000002 2024-04-25T22:41:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611075+0000", 2024-04-25T22:41:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077703900000000003 2024-04-25T22:41:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635414+0000", 2024-04-25T22:41:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024339326000000001 2024-04-25T22:41:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635544+0000", 2024-04-25T22:41:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012948199999999999 2024-04-25T22:41:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635659+0000", 2024-04-25T22:41:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000115809 2024-04-25T22:41:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 67.543413303999998, 2024-04-25T22:41:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035594492999999998, 2024-04-25T22:41:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600494+0000", 2024-04-25T22:41:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:41:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600502+0000", 2024-04-25T22:41:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3769999999999996e-06 2024-04-25T22:41:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600522+0000", 2024-04-25T22:41:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9919999999999999e-05 2024-04-25T22:41:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600539+0000", 2024-04-25T22:41:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.649e-05 2024-04-25T22:41:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604846+0000", 2024-04-25T22:41:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043075199999999996 2024-04-25T22:41:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605057+0000", 2024-04-25T22:41:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00021085200000000001 2024-04-25T22:41:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605378+0000", 2024-04-25T22:41:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032074799999999999 2024-04-25T22:41:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611089+0000", 2024-04-25T22:41:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057110249999999998 2024-04-25T22:41:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635844+0000", 2024-04-25T22:41:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024755355999999999 2024-04-25T22:41:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635986+0000", 2024-04-25T22:41:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141512 2024-04-25T22:41:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636087+0000", 2024-04-25T22:41:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101183 2024-04-25T22:41:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 67.543340693999994, 2024-04-25T22:41:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021266723000000001, 2024-04-25T22:41:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600566+0000", 2024-04-25T22:41:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4959999999999999e-06 2024-04-25T22:41:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600574+0000", 2024-04-25T22:41:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-06 2024-04-25T22:41:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600592+0000", 2024-04-25T22:41:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8479999999999999e-05 2024-04-25T22:41:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600610+0000", 2024-04-25T22:41:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7567e-05 2024-04-25T22:41:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602679+0000", 2024-04-25T22:41:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020692739999999999 2024-04-25T22:41:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602945+0000", 2024-04-25T22:41:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026640399999999998 2024-04-25T22:41:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603115+0000", 2024-04-25T22:41:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000169996 2024-04-25T22:41:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608398+0000", 2024-04-25T22:41:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052826289999999996 2024-04-25T22:41:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621588+0000", 2024-04-25T22:41:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013190489 2024-04-25T22:41:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621733+0000", 2024-04-25T22:41:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014462500000000001 2024-04-25T22:41:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621832+0000", 2024-04-25T22:41:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8603000000000004e-05 2024-04-25T22:41:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 67.543272967999997, 2024-04-25T22:41:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034747924999999999, 2024-04-25T22:41:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600634+0000", 2024-04-25T22:41:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-04-25T22:41:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600642+0000", 2024-04-25T22:41:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8169999999999999e-06 2024-04-25T22:41:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600660+0000", 2024-04-25T22:41:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8513e-05 2024-04-25T22:41:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600676+0000", 2024-04-25T22:41:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6019999999999999e-05 2024-04-25T22:41:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603748+0000", 2024-04-25T22:41:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030718329999999999 2024-04-25T22:41:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604752+0000", 2024-04-25T22:41:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001003603 2024-04-25T22:41:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605117+0000", 2024-04-25T22:41:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00036539 2024-04-25T22:41:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608459+0000", 2024-04-25T22:41:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033413879999999998 2024-04-25T22:41:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635106+0000", 2024-04-25T22:41:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026647607 2024-04-25T22:41:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635273+0000", 2024-04-25T22:41:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000166689 2024-04-25T22:41:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635381+0000", 2024-04-25T22:41:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107642 2024-04-25T22:41:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 67.543209739000005, 2024-04-25T22:41:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040419292000000002, 2024-04-25T22:41:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600697+0000", 2024-04-25T22:41:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1999999999999999e-06 2024-04-25T22:41:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600704+0000", 2024-04-25T22:41:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5570000000000001e-06 2024-04-25T22:41:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600724+0000", 2024-04-25T22:41:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0023000000000001e-05 2024-04-25T22:41:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600738+0000", 2024-04-25T22:41:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4372999999999999e-05 2024-04-25T22:41:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.612532+0000", 2024-04-25T22:41:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011793606 2024-04-25T22:41:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613354+0000", 2024-04-25T22:41:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00082244100000000004 2024-04-25T22:41:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613726+0000", 2024-04-25T22:41:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00037226000000000002 2024-04-25T22:41:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618891+0000", 2024-04-25T22:41:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051649199999999999 2024-04-25T22:41:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.640874+0000", 2024-04-25T22:41:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021982640000000001 2024-04-25T22:41:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641019+0000", 2024-04-25T22:41:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000145339 2024-04-25T22:41:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641115+0000", 2024-04-25T22:41:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5933000000000005e-05 2024-04-25T22:41:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 67.543123709, 2024-04-25T22:41:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036502711, 2024-04-25T22:41:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600783+0000", 2024-04-25T22:41:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.533e-06 2024-04-25T22:41:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600790+0000", 2024-04-25T22:41:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0439999999999998e-06 2024-04-25T22:41:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600811+0000", 2024-04-25T22:41:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0449e-05 2024-04-25T22:41:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600825+0000", 2024-04-25T22:41:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4293e-05 2024-04-25T22:41:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602304+0000", 2024-04-25T22:41:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001478629 2024-04-25T22:41:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602587+0000", 2024-04-25T22:41:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028350800000000002 2024-04-25T22:41:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.637285+0000", 2024-04-25T22:41:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034697255000000003 2024-04-25T22:41:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 67.543058142999996, 2024-04-25T22:41:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017311460000000001, 2024-04-25T22:41:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:22.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600849+0000", 2024-04-25T22:41:22.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2899999999999999e-06 2024-04-25T22:41:22.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:22.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600866+0000", 2024-04-25T22:41:22.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6793e-05 2024-04-25T22:41:22.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:22.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600886+0000", 2024-04-25T22:41:22.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0772999999999999e-05 2024-04-25T22:41:22.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.212 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.212 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600904+0000", 2024-04-25T22:41:22.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7697e-05 2024-04-25T22:41:22.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.212 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:22.212 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602796+0000", 2024-04-25T22:41:22.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018920149999999999 2024-04-25T22:41:22.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.212 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:22.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602962+0000", 2024-04-25T22:41:22.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016590600000000001 2024-04-25T22:41:22.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.213 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:22.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618159+0000", 2024-04-25T22:41:22.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015196985999999999 2024-04-25T22:41:22.213 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.213 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.213 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.213 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:22.213 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:22.214 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 67.528182401999999, 2024-04-25T22:41:22.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006380269, 2024-04-25T22:41:22.214 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:22.214 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:22.214 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.214 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:22.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:22.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:22.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:22.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:22.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:22.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615724+0000", 2024-04-25T22:41:22.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.094e-06 2024-04-25T22:41:22.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:22.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615734+0000", 2024-04-25T22:41:22.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.363e-06 2024-04-25T22:41:22.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:22.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615751+0000", 2024-04-25T22:41:22.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:41:22.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.216 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.216 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615773+0000", 2024-04-25T22:41:22.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.154e-05 2024-04-25T22:41:22.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.216 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:22.216 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616485+0000", 2024-04-25T22:41:22.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00071225100000000001 2024-04-25T22:41:22.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.217 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:22.217 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616528+0000", 2024-04-25T22:41:22.217 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3606000000000002e-05 2024-04-25T22:41:22.217 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.217 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.217 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:22.217 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622030+0000", 2024-04-25T22:41:22.217 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055010750000000002 2024-04-25T22:41:22.217 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.217 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.217 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:22.217 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622103+0000", 2024-04-25T22:41:22.217 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3930000000000005e-05 2024-04-25T22:41:22.217 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.217 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.218 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.218 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:22.218 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:22.218 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 67.527269465000003, 2024-04-25T22:41:22.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046420649999999999, 2024-04-25T22:41:22.218 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:22.218 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:22.218 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-04-25T22:41:22.218 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:22.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.218 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:22.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:22.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:22.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:22.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:22.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616637+0000", 2024-04-25T22:41:22.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0299999999999998e-07 2024-04-25T22:41:22.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:22.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616653+0000", 2024-04-25T22:41:22.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5843000000000001e-05 2024-04-25T22:41:22.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:22.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616690+0000", 2024-04-25T22:41:22.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7466999999999999e-05 2024-04-25T22:41:22.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616729+0000", 2024-04-25T22:41:22.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8810000000000003e-05 2024-04-25T22:41:22.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:22.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617251+0000", 2024-04-25T22:41:22.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00052143899999999995 2024-04-25T22:41:22.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:22.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621278+0000", 2024-04-25T22:41:22.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040277029999999997 2024-04-25T22:41:22.221 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.221 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.221 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.221 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:22.222 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:22.222 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 67.526246112999999, 2024-04-25T22:41:22.222 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0065101730000000002, 2024-04-25T22:41:22.222 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:22.222 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:22.222 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.222 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:22.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.222 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:22.222 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:22.222 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.222 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:22.223 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:22.223 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.223 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:22.223 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617661+0000", 2024-04-25T22:41:22.223 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:41:22.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.223 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:22.223 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617688+0000", 2024-04-25T22:41:22.223 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7589e-05 2024-04-25T22:41:22.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:22.224 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617710+0000", 2024-04-25T22:41:22.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1467e-05 2024-04-25T22:41:22.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.224 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617727+0000", 2024-04-25T22:41:22.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6990000000000002e-05 2024-04-25T22:41:22.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:22.224 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618559+0000", 2024-04-25T22:41:22.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083207400000000003 2024-04-25T22:41:22.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:22.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618608+0000", 2024-04-25T22:41:22.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8936e-05 2024-04-25T22:41:22.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:22.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624077+0000", 2024-04-25T22:41:22.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054695840000000004 2024-04-25T22:41:22.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:22.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624170+0000", 2024-04-25T22:41:22.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2305999999999993e-05 2024-04-25T22:41:22.225 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.226 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.226 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.226 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:22.226 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:22.226 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 67.521144605000003, 2024-04-25T22:41:22.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006879446, 2024-04-25T22:41:22.226 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:22.226 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:22.226 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.226 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:22.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:22.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:22.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.227 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:22.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:22.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:22.228 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622762+0000", 2024-04-25T22:41:22.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:41:22.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:22.228 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622781+0000", 2024-04-25T22:41:22.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8749999999999998e-05 2024-04-25T22:41:22.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:22.228 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622802+0000", 2024-04-25T22:41:22.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1650000000000001e-05 2024-04-25T22:41:22.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.229 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.229 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622816+0000", 2024-04-25T22:41:22.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3556e-05 2024-04-25T22:41:22.229 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.229 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.229 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:22.229 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623700+0000", 2024-04-25T22:41:22.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00088389299999999996 2024-04-25T22:41:22.229 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.229 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.229 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:22.229 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623741+0000", 2024-04-25T22:41:22.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1023999999999999e-05 2024-04-25T22:41:22.229 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:22.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629543+0000", 2024-04-25T22:41:22.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058023980000000003 2024-04-25T22:41:22.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:22.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629640+0000", 2024-04-25T22:41:22.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7381999999999997e-05 2024-04-25T22:41:22.230 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.230 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.230 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.231 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:22.231 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:22.231 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 67.520883401000006, 2024-04-25T22:41:22.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067054879999999999, 2024-04-25T22:41:22.231 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:22.231 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:22.231 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.231 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:22.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:22.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:22.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:22.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:22.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:22.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623032+0000", 2024-04-25T22:41:22.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.9930000000000007e-06 2024-04-25T22:41:22.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:22.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623043+0000", 2024-04-25T22:41:22.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0387000000000001e-05 2024-04-25T22:41:22.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:22.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623064+0000", 2024-04-25T22:41:22.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1849999999999999e-05 2024-04-25T22:41:22.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623079+0000", 2024-04-25T22:41:22.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4093e-05 2024-04-25T22:41:22.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:22.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624384+0000", 2024-04-25T22:41:22.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013054539999999999 2024-04-25T22:41:22.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:22.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624421+0000", 2024-04-25T22:41:22.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7088999999999997e-05 2024-04-25T22:41:22.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:22.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629645+0000", 2024-04-25T22:41:22.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052241400000000004 2024-04-25T22:41:22.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:22.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629728+0000", 2024-04-25T22:41:22.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2482000000000001e-05 2024-04-25T22:41:22.234 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.235 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.235 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.235 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2024-04-25T22:41:22.235 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:22.235 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 67.520800288000004, 2024-04-25T22:41:22.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078029559999999998, 2024-04-25T22:41:22.235 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:22.235 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:22.235 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.235 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:22.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:22.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:22.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:22.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:22.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:22.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:22.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623106+0000", 2024-04-25T22:41:22.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.64e-07 2024-04-25T22:41:22.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:22.237 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623141+0000", 2024-04-25T22:41:22.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4678999999999998e-05 2024-04-25T22:41:22.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.237 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:22.237 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623153+0000", 2024-04-25T22:41:22.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1759999999999999e-05 2024-04-25T22:41:22.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.237 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.237 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623161+0000", 2024-04-25T22:41:22.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8299999999999996e-06 2024-04-25T22:41:22.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.237 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:22.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623834+0000", 2024-04-25T22:41:22.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067394500000000001 2024-04-25T22:41:22.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:22.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623883+0000", 2024-04-25T22:41:22.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8640000000000002e-05 2024-04-25T22:41:22.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:22.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630807+0000", 2024-04-25T22:41:22.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069238859999999998 2024-04-25T22:41:22.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:22.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:22.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:22.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630908+0000", 2024-04-25T22:41:22.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101252 2024-04-25T22:41:22.239 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.239 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.239 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.239 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:22.239 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:22.239 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:22.240 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:22.241 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:22.242 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:22.243 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:22.242+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:22.342 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:22.342+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:22.374 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:22.374 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:22.374 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:22.374 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:22.388 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:22.443 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:22.438+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:22.511 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:22.512 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:22.512 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:22.512 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:22.512 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:22.526 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:22.544 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:22.542+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:22.645 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:22.642+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:22.648 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:22.648 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:22.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:22.649 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:22.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.649 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:22.649 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:22.649 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 68.049941211999993, 2024-04-25T22:41:22.650 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:22.650 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:22.650 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:22.650 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.650 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:22.650 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.651 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:22.651 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:22.651 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.651 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.651 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:22.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:22.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.652 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:22.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:22.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:22.652 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:22.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:22.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:22.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:22.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:22.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:22.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:22.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:22.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:22.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:22.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:22.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:22.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:22.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:22.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:22.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:22.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:22.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:22.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:22.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:22.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:22.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:22.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:22.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:22.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:22.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:22.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:22.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:22.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:22.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:22.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:22.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:22.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:22.657 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.657 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.657 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.657 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:22.657 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:22.657 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 68.049803956000005, 2024-04-25T22:41:22.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:22.657 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:22.657 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:22.657 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.657 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:22.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.657 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:22.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:22.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:22.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:22.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:22.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:22.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:22.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:22.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:22.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:22.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:22.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:22.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:22.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:22.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:22.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:22.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:22.660 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:22.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:22.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:22.660 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:22.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:22.660 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:22.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:22.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:22.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:22.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:22.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:22.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:22.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:22.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:22.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.662 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:22.662 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:22.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:22.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.662 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:22.662 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:22.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:22.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.662 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:22.662 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:22.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:22.663 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.663 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.663 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.663 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.663 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:22.663 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:22.663 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 68.049716403999994, 2024-04-25T22:41:22.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:22.663 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:22.663 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:22.663 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.663 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:22.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:22.664 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:22.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.664 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:22.664 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:22.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.664 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:22.664 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:22.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:22.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:22.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:22.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:22.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:22.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:22.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:22.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:22.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:22.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:22.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:22.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:22.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:22.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:22.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:22.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:22.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:22.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:22.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:22.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:22.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:22.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:22.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.668 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:22.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:22.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:22.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.668 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:22.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:22.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:22.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.668 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:22.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:22.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:22.669 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:22.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:22.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:22.669 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.669 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.669 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.669 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.669 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:22.669 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:22.669 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 68.049612577999994, 2024-04-25T22:41:22.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:22.670 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:22.670 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:22.670 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.670 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:22.670 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.670 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:22.670 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:22.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.670 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.670 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.670 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:22.670 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:22.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:22.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:22.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:22.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:22.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:22.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:22.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:22.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:22.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:22.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:22.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:22.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:22.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:22.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:22.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:22.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:22.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:22.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:22.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:22.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:22.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:22.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:22.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:22.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:22.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:22.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:22.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:22.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:22.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:22.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:22.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.675 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:22.675 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:22.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:22.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.675 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:22.675 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:22.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:22.675 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.675 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.675 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.676 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:22.676 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:22.676 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 68.049543787999994, 2024-04-25T22:41:22.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:22.676 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:22.676 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:22.676 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.676 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:22.676 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.676 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:22.676 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:22.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.677 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:22.677 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:22.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.677 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:22.677 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:22.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:22.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.677 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:22.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:22.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:22.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:22.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:22.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:22.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:22.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:22.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:22.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:22.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:22.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:22.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:22.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:22.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:22.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:22.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:22.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:22.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:22.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:22.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:22.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:22.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:22.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:22.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.681 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:22.681 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:22.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:22.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.681 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:22.681 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:22.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:22.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:22.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:22.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:22.682 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.682 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.682 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.682 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:22.682 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:22.682 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 68.049474701999998, 2024-04-25T22:41:22.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:22.682 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:22.683 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:22.683 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.683 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:22.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.683 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:22.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:22.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.683 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:22.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:22.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.684 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:22.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:22.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:22.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.684 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.684 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:22.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:22.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:22.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.684 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.684 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:22.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:22.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:22.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.685 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:22.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:22.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.685 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:22.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:22.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:22.685 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:22.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:22.686 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.686 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.686 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.686 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:22.686 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:22.686 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.686 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.686 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:22.686 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:22.686 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:22.686 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.686 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.686 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:22.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:22.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:22.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:22.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:22.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:22.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:22.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:22.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:22.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:22.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:22.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:22.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:22.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:22.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:22.688 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.688 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.688 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.689 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:22.689 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:22.689 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 68.049378589, 2024-04-25T22:41:22.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:22.689 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:22.689 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:22.689 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:22.689 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:22.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:22.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:22.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:22.690 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:22.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.690 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:22.690 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:22.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:22.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.690 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:22.690 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:22.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:22.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.691 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.691 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:22.691 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:22.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:22.691 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.691 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.691 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.691 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:22.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:22.691 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.691 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.691 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.691 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:22.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:22.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:22.692 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:22.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:22.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.692 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:22.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:22.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:22.692 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:22.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:22.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:22.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:22.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:22.693 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.693 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.693 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.693 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:22.693 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:22.693 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 68.049312927000003, 2024-04-25T22:41:22.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:22.694 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:22.694 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:22.694 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:22.694 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:22.694 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.694 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:22.694 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:22.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.694 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.694 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.694 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:22.694 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:22.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.695 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:22.695 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:22.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:22.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.695 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:22.695 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:22.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:22.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.695 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:22.695 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:22.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:22.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:22.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:22.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:22.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:22.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:22.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:22.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:22.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:22.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:22.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:22.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:22.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:22.698 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.698 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:22.698 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:22.698 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:22.698 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.698 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.698 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.698 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.698 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:22.698 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:22.698 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 68.049243799999999, 2024-04-25T22:41:22.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:22.699 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:22.699 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:22.699 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:22.699 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:22.699 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.699 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:22.699 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:22.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.699 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.699 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.699 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:22.699 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:22.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.700 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:22.700 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:22.700 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:22.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.700 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:22.700 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:22.700 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:22.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.700 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:22.700 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:22.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:22.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:22.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:22.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:22.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:22.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:22.702 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:22.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:22.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.702 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.702 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:22.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:22.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.702 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:22.702 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:22.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:22.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:22.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:22.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:22.703 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.703 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.703 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.703 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:22.703 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:22.703 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 68.038427143999996, 2024-04-25T22:41:22.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:22.703 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:22.704 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:22.704 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:22.704 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:22.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.704 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:22.704 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:22.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.704 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:22.704 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:22.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.705 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:22.705 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:22.705 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:22.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.705 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.705 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:22.705 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:22.705 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:22.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.705 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.705 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:22.705 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:22.705 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:22.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.705 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.706 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:22.706 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:22.706 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.706 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:22.706 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:22.706 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:22.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:22.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:22.707 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.707 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.707 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.707 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:22.707 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:22.707 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 68.021528790999994, 2024-04-25T22:41:22.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:22.707 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:22.707 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:22.707 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:22.707 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:22.708 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.708 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:22.708 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:22.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.708 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.708 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.708 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:22.708 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:22.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.708 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.708 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.708 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:22.708 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:22.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:22.708 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:22.709 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:22.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:22.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:22.709 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:22.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:22.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.709 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:22.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:22.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.710 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:22.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:22.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.710 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:22.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:22.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:22.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.710 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:22.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:22.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:22.711 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.711 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.711 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.711 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.711 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:22.711 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:22.711 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 68.020707900999994, 2024-04-25T22:41:22.711 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:22.711 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:22.711 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:22.711 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:22.711 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:22.711 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.711 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:22.711 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:22.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:22.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:22.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:22.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:22.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:22.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.713 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:22.713 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:22.713 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:22.713 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.713 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:22.713 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:22.713 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:22.713 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.713 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.713 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:22.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:22.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.714 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.714 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:22.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:22.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.714 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:22.714 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:22.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:22.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:22.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:22.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:22.715 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.715 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.715 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.715 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.715 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:22.715 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:22.716 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 68.019007173000006, 2024-04-25T22:41:22.716 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:22.716 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:22.716 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:22.716 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.716 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:22.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.716 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:22.716 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:22.716 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.716 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:22.716 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:22.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:22.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:22.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:22.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:22.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:22.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:22.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:22.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:22.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:22.718 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.718 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.718 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.718 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:22.718 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:22.718 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.718 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.718 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.718 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:22.718 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:22.718 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.718 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.718 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:22.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:22.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:22.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:22.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:22.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:22.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:22.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:22.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:22.719 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.719 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.719 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.720 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:22.720 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:22.720 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 68.018410497999994, 2024-04-25T22:41:22.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:22.720 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:22.720 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:22.720 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.720 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:22.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.720 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:22.720 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:22.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:22.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:22.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:22.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:22.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:22.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:22.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:22.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:22.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:22.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:22.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:22.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:22.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:22.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.723 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:22.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:22.723 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.723 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:22.723 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:22.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:22.723 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.723 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:22.723 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:22.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:22.723 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.724 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.724 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:22.724 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:22.724 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:22.724 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.724 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.724 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.724 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.724 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.724 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:22.724 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:22.724 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 68.008974772000002, 2024-04-25T22:41:22.724 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:22.724 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:22.725 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:22.725 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:22.725 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:22.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:22.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:22.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:22.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:22.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:22.726 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:22.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:22.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:22.726 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:22.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:22.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:22.726 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:22.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:22.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:22.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:22.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:22.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:22.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:22.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:22.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:22.727 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.727 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.727 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.728 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:22.728 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:22.728 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 68.008327346000002, 2024-04-25T22:41:22.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:22.728 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:22.728 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:22.728 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.728 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:22.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:22.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:22.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.729 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.729 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:22.729 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:22.729 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.729 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.729 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.729 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:22.729 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:22.729 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:22.729 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.729 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.729 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:22.729 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:22.730 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:22.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:22.730 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:22.730 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:22.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.730 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:22.730 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:22.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.731 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:22.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:22.731 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.731 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.731 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:22.731 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:22.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:22.731 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.731 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.731 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:22.731 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:22.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:22.731 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.731 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.731 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:22.732 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:22.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:22.732 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.732 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.732 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.732 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.732 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:22.732 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:22.732 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 68.006886527000006, 2024-04-25T22:41:22.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:22.732 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:22.732 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:22.732 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.732 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:22.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:22.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:22.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:22.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:22.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:22.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:22.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:22.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:22.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:22.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:22.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:22.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:22.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:22.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:22.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:22.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:22.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:22.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:22.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:22.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:22.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:22.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:22.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:22.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:22.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:22.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:22.736 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.736 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.736 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.736 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:22.736 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:22.736 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 66.054448082999997, 2024-04-25T22:41:22.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:22.737 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:22.737 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:22.737 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.737 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:22.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:22.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:22.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:22.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:22.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:22.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:22.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:22.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:22.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:22.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:22.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:22.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:22.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:22.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:22.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:22.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:22.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:22.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:22.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:22.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:22.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:22.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:22.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:22.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:22.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:22.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:22.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:22.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:22.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:22.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:22.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:22.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:22.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:22.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:22.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:22.741 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.741 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.741 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.742 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:22.742 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:22.742 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 44.051788758999997, 2024-04-25T22:41:22.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:22.742 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:22.742 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:22.742 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.742 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:22.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:22.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:22.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:22.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:22.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:22.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:22.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:22.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:22.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:22.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:22.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:22.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:22.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:22.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:22.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:22.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:22.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:22.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:22.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:22.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:22.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:22.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:22.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:22.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:22.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:22.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:22.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:22.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:22.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:22.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:22.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:22.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:22.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:22.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:22.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:22.747 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.747 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.747 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.747 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:22.747 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:22.747 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 39.051496508, 2024-04-25T22:41:22.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:22.747 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:22.747 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:22.747 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:22.748 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:22.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:22.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:22.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:22.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:22.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:22.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:22.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:22.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:22.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:22.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:22.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:22.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:22.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:22.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:22.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:22.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:22.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:22.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.750 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:22.750 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:22.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:22.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.750 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:22.750 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:22.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:22.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.750 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:22.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:22.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:22.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:22.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:22.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:22.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:22.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:22.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:22.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:22.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:22.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:22.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:22.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:22.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:22.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:22.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:22.752 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.752 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.752 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.752 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:22.752 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:22.752 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:22.754 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:22.752+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:22.754 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:22.855 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:22.854+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:22.886 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:22.886 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:22.886 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:41:22.886 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:22.900 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:22.956 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:22.952+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:23.057 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:23.056+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:23.061 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:23.061 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:23.061 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:23.061 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:23.061 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:23.075 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:23.158 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:23.154+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:23.161 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:41:23.196 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:23.196 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:41:23.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:41:23.197 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:41:23.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.197 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.197 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:23.197 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.598919436000003, 2024-04-25T22:41:23.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:41:23.197 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:23.197 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:23.197 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.197 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:23.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:23.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:23.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:23.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:23.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:23.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:41:23.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:41:23.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:23.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:41:23.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:41:23.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:23.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:41:23.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:41:23.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:41:23.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:41:23.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:41:23.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:41:23.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:23.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:41:23.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:41:23.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:41:23.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:41:23.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:23.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:41:23.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:41:23.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:23.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:41:23.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:41:23.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:41:23.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:41:23.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:23.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:41:23.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:41:23.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:23.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:41:23.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:41:23.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:23.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:41:23.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:41:23.203 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.203 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.203 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.203 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.203 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:23.203 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.598831423000007, 2024-04-25T22:41:23.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:41:23.203 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:23.203 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:23.203 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.204 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:23.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:23.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:23.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:23.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:23.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:23.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:41:23.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:41:23.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:23.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:23.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:41:23.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:23.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:41:23.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:41:23.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:41:23.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:41:23.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:41:23.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:41:23.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:23.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:23.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:41:23.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:41:23.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:41:23.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:23.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:41:23.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:41:23.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:23.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:41:23.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:41:23.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:23.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:41:23.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:41:23.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:41:23.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:41:23.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:23.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:41:23.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:41:23.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:23.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:41:23.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:41:23.209 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.209 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.209 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.209 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.209 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:23.209 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.598759301000001, 2024-04-25T22:41:23.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:41:23.209 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:23.209 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:23.209 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.209 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:23.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:23.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:23.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:23.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:23.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:23.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:41:23.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:41:23.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:23.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:41:23.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:41:23.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:23.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:41:23.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:41:23.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:41:23.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:41:23.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:41:23.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:41:23.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:23.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:41:23.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:41:23.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:41:23.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:41:23.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:23.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:41:23.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:41:23.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:23.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:41:23.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:41:23.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:41:23.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:41:23.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:23.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:41:23.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:41:23.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:23.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:41:23.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:41:23.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:23.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:41:23.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:41:23.215 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.215 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.215 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.215 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.215 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:23.216 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.598650988000003, 2024-04-25T22:41:23.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:41:23.216 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:23.216 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:23.216 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.216 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:23.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:23.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:23.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:23.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:23.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:23.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:41:23.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:41:23.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:23.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:41:23.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:41:23.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:23.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:41:23.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:41:23.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:41:23.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:41:23.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:41:23.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:41:23.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:23.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:41:23.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:41:23.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:41:23.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:41:23.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:23.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:41:23.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:41:23.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:23.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:41:23.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:41:23.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:41:23.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:41:23.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:23.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:41:23.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:41:23.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:23.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:41:23.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:41:23.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:23.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:41:23.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:41:23.221 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.221 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.221 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.221 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.221 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:23.222 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.598584332000001, 2024-04-25T22:41:23.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:41:23.222 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:23.222 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:23.222 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.222 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:23.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:23.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:23.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:23.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:23.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:23.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:41:23.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:41:23.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:23.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:41:23.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:41:23.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:23.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:41:23.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:41:23.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:41:23.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:41:23.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:41:23.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:41:23.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:23.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:41:23.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:41:23.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:41:23.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:41:23.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:23.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:41:23.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:41:23.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:23.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:41:23.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:41:23.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:41:23.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:41:23.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:23.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:41:23.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:41:23.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:23.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:41:23.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:41:23.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:23.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:41:23.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:41:23.227 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.227 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.227 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.228 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.228 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:23.228 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.598493735999995, 2024-04-25T22:41:23.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:41:23.228 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:23.228 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:23.228 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.228 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:23.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:23.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:23.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:23.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:23.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:23.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:41:23.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:41:23.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:23.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:41:23.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:41:23.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:23.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:41:23.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:41:23.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:41:23.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:41:23.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:41:23.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:41:23.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:23.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:41:23.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:41:23.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:41:23.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:41:23.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:23.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:41:23.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:41:23.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:23.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:41:23.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:41:23.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:23.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:41:23.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:41:23.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:41:23.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:41:23.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:23.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:41:23.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:41:23.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:23.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:41:23.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:41:23.234 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.234 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.234 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.234 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.234 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:23.234 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.598429163000006, 2024-04-25T22:41:23.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:41:23.234 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:23.234 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:23.234 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.235 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:23.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:23.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:23.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:23.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:23.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:23.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:41:23.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:41:23.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:23.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:41:23.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:41:23.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:23.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:41:23.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:41:23.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:41:23.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:41:23.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:23.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:41:23.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:23.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:41:23.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:41:23.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:41:23.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:41:23.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:23.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:41:23.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:41:23.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:23.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:41:23.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:41:23.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:41:23.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:41:23.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:23.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:41:23.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:41:23.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:23.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:41:23.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:41:23.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:23.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:41:23.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:41:23.240 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.240 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.240 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.240 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.240 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:23.240 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.598363739999996, 2024-04-25T22:41:23.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:41:23.240 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:23.241 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:23.241 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.241 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:23.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:23.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:23.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:23.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:23.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:23.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:41:23.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:23.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:23.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:41:23.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:41:23.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:23.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:41:23.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:41:23.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:41:23.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:41:23.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:41:23.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:41:23.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:23.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:41:23.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:41:23.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:41:23.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:41:23.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:23.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:41:23.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:41:23.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:23.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:41:23.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:41:23.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:23.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:41:23.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:41:23.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:41:23.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:41:23.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:23.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:41:23.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:41:23.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:23.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:41:23.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:41:23.246 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.246 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.246 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.246 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.246 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:23.247 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.598307673999997, 2024-04-25T22:41:23.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:41:23.247 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:23.249 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:23.249 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.249 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:23.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:23.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:23.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:23.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:23.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:23.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:23.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:41:23.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:23.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:41:23.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:41:23.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:23.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:41:23.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:41:23.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:41:23.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:41:23.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:41:23.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:41:23.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:23.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:41:23.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:41:23.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:41:23.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:41:23.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:23.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:41:23.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:41:23.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:23.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:41:23.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:41:23.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:41:23.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:41:23.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:23.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:41:23.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:41:23.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:23.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:41:23.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:41:23.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:23.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:41:23.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:41:23.255 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.255 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.255 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.255 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.255 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:23.255 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.598240567999994, 2024-04-25T22:41:23.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:41:23.256 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:23.256 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:23.256 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.256 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:23.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:23.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:23.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:23.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:23.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:23.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:41:23.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:41:23.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:23.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:41:23.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:41:23.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:23.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:41:23.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:41:23.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:41:23.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:41:23.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:41:23.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:41:23.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:23.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:41:23.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:41:23.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:41:23.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:41:23.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:23.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:41:23.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:41:23.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:23.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:41:23.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:41:23.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:41:23.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:41:23.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:23.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:41:23.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:41:23.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:23.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:41:23.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:41:23.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:23.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:41:23.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:41:23.261 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.261 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.261 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.261 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.262 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:23.262 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.598185444999999, 2024-04-25T22:41:23.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:41:23.262 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:23.262 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:23.262 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.262 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:23.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:23.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:23.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:23.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:23.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:23.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:41:23.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:23.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:23.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:41:23.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:41:23.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:23.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:41:23.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:41:23.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:41:23.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:41:23.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:41:23.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:41:23.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:23.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:41:23.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:41:23.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:41:23.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:41:23.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:23.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:41:23.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:41:23.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:23.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:41:23.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:41:23.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:41:23.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:41:23.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:23.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:41:23.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:41:23.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:23.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:41:23.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:41:23.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:23.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:41:23.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:41:23.268 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.268 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.268 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.268 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.268 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:23.268 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.598083205999998, 2024-04-25T22:41:23.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:41:23.268 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:23.268 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:23.268 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.269 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:23.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:23.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:23.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:23.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:23.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:23.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:41:23.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:41:23.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:23.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:41:23.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:41:23.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:23.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:41:23.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:41:23.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:41:23.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:41:23.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:41:23.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:41:23.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:23.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:41:23.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:41:23.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:41:23.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:41:23.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:23.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:41:23.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:41:23.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:23.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:41:23.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:41:23.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:41:23.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:41:23.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:23.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:41:23.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:41:23.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:23.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:41:23.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:41:23.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:23.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:41:23.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:41:23.274 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.274 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.274 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.274 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.274 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:23.274 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.598024382999995, 2024-04-25T22:41:23.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:41:23.274 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:23.275 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:23.275 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.275 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:23.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:23.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:23.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:23.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:23.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:23.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:41:23.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:41:23.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:23.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:41:23.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:41:23.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:23.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:41:23.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:41:23.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:41:23.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:41:23.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:41:23.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:41:23.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:23.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:41:23.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:41:23.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:41:23.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:41:23.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:23.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:41:23.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:41:23.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:23.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:41:23.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:41:23.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:23.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:41:23.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:41:23.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:41:23.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:41:23.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:23.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:41:23.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:41:23.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:23.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:41:23.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:41:23.280 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.280 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.280 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.280 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.280 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:23.281 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.59794565, 2024-04-25T22:41:23.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:41:23.281 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:23.281 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:23.281 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.281 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:23.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:23.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:23.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:23.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:23.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:23.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:41:23.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:23.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:23.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:41:23.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:41:23.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:23.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:41:23.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:41:23.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:41:23.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:41:23.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:41:23.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:41:23.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:23.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:41:23.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:41:23.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:41:23.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:41:23.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:23.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:41:23.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:41:23.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:23.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:41:23.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:41:23.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:23.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:41:23.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:41:23.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:41:23.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:41:23.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:23.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:41:23.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:41:23.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:23.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:41:23.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:41:23.287 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.287 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.287 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.287 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.287 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:23.287 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.597906237000004, 2024-04-25T22:41:23.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:41:23.287 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:23.287 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:23.287 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.287 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:23.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:23.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:23.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:23.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:23.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:23.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:41:23.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:41:23.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:23.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:41:23.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:41:23.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:23.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:41:23.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:41:23.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:41:23.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:41:23.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:41:23.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:41:23.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:23.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:41:23.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:41:23.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:41:23.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:41:23.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:41:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:41:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:41:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:41:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:41:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:41:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:41:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:41:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:41:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:41:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:41:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:41:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.597836391000001, 2024-04-25T22:41:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:41:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:41:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:41:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:41:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:41:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:41:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:41:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:41:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:41:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:41:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:41:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:41:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:41:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:41:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:41:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:41:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:41:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:41:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:41:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:41:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:41:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:41:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:41:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:41:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:41:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:41:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:41:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.597786654000004, 2024-04-25T22:41:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:41:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:41:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:41:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:41:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:41:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:41:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:41:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:41:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:41:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:41:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:41:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:41:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:41:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:41:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:41:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:41:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:41:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:41:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:41:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:41:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:41:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:41:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:41:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:41:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:41:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.597702038999998, 2024-04-25T22:41:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:41:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:41:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:41:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:41:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:41:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:41:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:41:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:41:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:41:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:41:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:41:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:41:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:41:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:41:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:41:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:41:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:41:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:41:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:41:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:41:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:41:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:41:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:41:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:41:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:41:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:41:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.597638388999997, 2024-04-25T22:41:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:41:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:41:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:41:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:41:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:41:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:41:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:41:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:41:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:41:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:41:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:41:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:41:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:41:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:41:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:41:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:41:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:41:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:41:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:41:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:41:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 68.590634859000005, 2024-04-25T22:41:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:41:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:41:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:41:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:41:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:41:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:41:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:41:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:41:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:41:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:41:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:41:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:41:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:41:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:41:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:41:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:41:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:41:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:23.321 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:23.323 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:41:23.323 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:23.322+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:23.424 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:23.422+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:23.455 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:23.455 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:41:23.455 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-04-25T22:41:23.455 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:23.469 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:41:23.525 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:23.526+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:23.626 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:23.624+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:23.634 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:23.634 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:41:23.634 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-04-25T22:41:23.634 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-04-25T22:41:23.634 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:23.648 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:41:23.727 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:23.726+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:23.765 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:23.765 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-04-25T22:41:23.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-04-25T22:41:23.765 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-04-25T22:41:23.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.765 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:111 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'73, mlcod=11'69)", 2024-04-25T22:41:23.765 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:23.765 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.065044631000006, 2024-04-25T22:41:23.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055481899999999997, 2024-04-25T22:41:23.766 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:23.766 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:23.766 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.766 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:23.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:23.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:23.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:23.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:23.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:23.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700271+0000", 2024-04-25T22:41:23.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:41:23.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:23.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700278+0000", 2024-04-25T22:41:23.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-04-25T22:41:23.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:23.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700323+0000", 2024-04-25T22:41:23.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4212999999999998e-05 2024-04-25T22:41:23.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700333+0000", 2024-04-25T22:41:23.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0433e-05 2024-04-25T22:41:23.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:23.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700662+0000", 2024-04-25T22:41:23.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032862800000000003 2024-04-25T22:41:23.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:23.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700692+0000", 2024-04-25T22:41:23.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0395999999999998e-05 2024-04-25T22:41:23.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:23.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705728+0000", 2024-04-25T22:41:23.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050361939999999999 2024-04-25T22:41:23.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:23.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705818+0000", 2024-04-25T22:41:23.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9573000000000005e-05 2024-04-25T22:41:23.769 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.769 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.769 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.770 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-25T22:41:23.770 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:23.770 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.064499779000002, 2024-04-25T22:41:23.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005065501, 2024-04-25T22:41:23.770 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:23.770 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:23.770 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.770 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:23.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:23.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:23.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:23.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:23.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:23.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700816+0000", 2024-04-25T22:41:23.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.24e-06 2024-04-25T22:41:23.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:23.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700914+0000", 2024-04-25T22:41:23.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8057e-05 2024-04-25T22:41:23.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:23.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700931+0000", 2024-04-25T22:41:23.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7745999999999999e-05 2024-04-25T22:41:23.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700941+0000", 2024-04-25T22:41:23.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5699999999999999e-06 2024-04-25T22:41:23.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:23.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701162+0000", 2024-04-25T22:41:23.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000221392 2024-04-25T22:41:23.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:23.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701194+0000", 2024-04-25T22:41:23.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1745999999999997e-05 2024-04-25T22:41:23.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:23.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705821+0000", 2024-04-25T22:41:23.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046269869999999999 2024-04-25T22:41:23.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:23.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705880+0000", 2024-04-25T22:41:23.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8763e-05 2024-04-25T22:41:23.773 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.774 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.774 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.774 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:118 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'80, mlcod=11'78)", 2024-04-25T22:41:23.774 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:23.774 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.057144168999997, 2024-04-25T22:41:23.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047806089999999999, 2024-04-25T22:41:23.774 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:23.774 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:23.774 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.774 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:23.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:23.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:23.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:23.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:23.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:23.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708172+0000", 2024-04-25T22:41:23.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0600000000000002e-06 2024-04-25T22:41:23.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:23.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708291+0000", 2024-04-25T22:41:23.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118892 2024-04-25T22:41:23.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:23.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708320+0000", 2024-04-25T22:41:23.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8822999999999998e-05 2024-04-25T22:41:23.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708337+0000", 2024-04-25T22:41:23.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7586999999999999e-05 2024-04-25T22:41:23.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:23.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708512+0000", 2024-04-25T22:41:23.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017439500000000001 2024-04-25T22:41:23.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:23.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708551+0000", 2024-04-25T22:41:23.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.909e-05 2024-04-25T22:41:23.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:23.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712865+0000", 2024-04-25T22:41:23.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043142069999999996 2024-04-25T22:41:23.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:23.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712951+0000", 2024-04-25T22:41:23.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5555000000000003e-05 2024-04-25T22:41:23.778 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.778 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.778 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.778 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:120 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'82, mlcod=11'78)", 2024-04-25T22:41:23.778 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:23.778 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.056138126999997, 2024-04-25T22:41:23.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047170700000000003, 2024-04-25T22:41:23.778 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:23.778 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:23.779 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.779 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:23.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:23.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:23.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:23.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:23.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:23.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709177+0000", 2024-04-25T22:41:23.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.19e-06 2024-04-25T22:41:23.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:23.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709315+0000", 2024-04-25T22:41:23.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000137429 2024-04-25T22:41:23.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:23.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709341+0000", 2024-04-25T22:41:23.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:41:23.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709353+0000", 2024-04-25T22:41:23.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2027e-05 2024-04-25T22:41:23.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:23.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710040+0000", 2024-04-25T22:41:23.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068710799999999997 2024-04-25T22:41:23.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:23.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710076+0000", 2024-04-25T22:41:23.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5982999999999998e-05 2024-04-25T22:41:23.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:23.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713802+0000", 2024-04-25T22:41:23.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037255750000000001 2024-04-25T22:41:23.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:23.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713893+0000", 2024-04-25T22:41:23.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1201999999999999e-05 2024-04-25T22:41:23.782 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.782 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.782 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.782 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:121 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'83, mlcod=11'78)", 2024-04-25T22:41:23.782 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:23.783 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.055591491000001, 2024-04-25T22:41:23.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0049043919999999996, 2024-04-25T22:41:23.783 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:23.783 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:23.783 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.783 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:23.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:23.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:23.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:23.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:23.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:23.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709724+0000", 2024-04-25T22:41:23.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.483e-06 2024-04-25T22:41:23.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:23.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709872+0000", 2024-04-25T22:41:23.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147446 2024-04-25T22:41:23.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:23.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709891+0000", 2024-04-25T22:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9245999999999998e-05 2024-04-25T22:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709900+0000", 2024-04-25T22:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1439999999999992e-06 2024-04-25T22:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713091+0000", 2024-04-25T22:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031910710000000002 2024-04-25T22:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713122+0000", 2024-04-25T22:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.048e-05 2024-04-25T22:41:23.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:23.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714538+0000", 2024-04-25T22:41:23.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014160030000000001 2024-04-25T22:41:23.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:23.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714627+0000", 2024-04-25T22:41:23.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518999999999995e-05 2024-04-25T22:41:23.786 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.786 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.786 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.787 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.787 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:23.787 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.165202110999999, 2024-04-25T22:41:23.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022089675999999999, 2024-04-25T22:41:23.787 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:23.787 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:23.787 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.787 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:23.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:23.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:23.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:23.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:23.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:23.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600120+0000", 2024-04-25T22:41:23.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1259999999999998e-06 2024-04-25T22:41:23.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:23.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600153+0000", 2024-04-25T22:41:23.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3186999999999999e-05 2024-04-25T22:41:23.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:23.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600181+0000", 2024-04-25T22:41:23.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7676000000000001e-05 2024-04-25T22:41:23.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600205+0000", 2024-04-25T22:41:23.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:41:23.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:23.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600467+0000", 2024-04-25T22:41:23.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026186800000000001 2024-04-25T22:41:23.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:23.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600809+0000", 2024-04-25T22:41:23.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034138400000000002 2024-04-25T22:41:23.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:23.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.601892+0000", 2024-04-25T22:41:23.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010831910000000001 2024-04-25T22:41:23.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:23.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611054+0000", 2024-04-25T22:41:23.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0091620940000000008 2024-04-25T22:41:23.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621965+0000", 2024-04-25T22:41:23.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010911044999999999 2024-04-25T22:41:23.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:23.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622090+0000", 2024-04-25T22:41:23.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012522 2024-04-25T22:41:23.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:23.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622202+0000", 2024-04-25T22:41:23.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011164500000000001 2024-04-25T22:41:23.791 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.792 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.792 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.792 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.792 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:23.792 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.165059056000004, 2024-04-25T22:41:23.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035756228000000001, 2024-04-25T22:41:23.792 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:23.792 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:23.792 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.792 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:23.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:23.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:23.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:23.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:23.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:23.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600257+0000", 2024-04-25T22:41:23.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8300000000000001e-06 2024-04-25T22:41:23.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:23.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600267+0000", 2024-04-25T22:41:23.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6539999999999994e-06 2024-04-25T22:41:23.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:23.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600293+0000", 2024-04-25T22:41:23.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5996e-05 2024-04-25T22:41:23.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600309+0000", 2024-04-25T22:41:23.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6206e-05 2024-04-25T22:41:23.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:23.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603757+0000", 2024-04-25T22:41:23.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003448244 2024-04-25T22:41:23.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:23.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604779+0000", 2024-04-25T22:41:23.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010216820000000001 2024-04-25T22:41:23.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:23.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605127+0000", 2024-04-25T22:41:23.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034820100000000002 2024-04-25T22:41:23.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:23.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611082+0000", 2024-04-25T22:41:23.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0059550640000000004 2024-04-25T22:41:23.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635779+0000", 2024-04-25T22:41:23.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024696665999999999 2024-04-25T22:41:23.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:23.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635915+0000", 2024-04-25T22:41:23.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000135809 2024-04-25T22:41:23.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:23.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636011+0000", 2024-04-25T22:41:23.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6875999999999999e-05 2024-04-25T22:41:23.797 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.797 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.797 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.797 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.797 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:23.797 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.164981843000007, 2024-04-25T22:41:23.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035327031000000002, 2024-04-25T22:41:23.797 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:23.797 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:23.797 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.798 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:23.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:23.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:23.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:23.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:23.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:23.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600334+0000", 2024-04-25T22:41:23.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:41:23.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:23.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600347+0000", 2024-04-25T22:41:23.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3593e-05 2024-04-25T22:41:23.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:23.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600371+0000", 2024-04-25T22:41:23.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.313e-05 2024-04-25T22:41:23.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600390+0000", 2024-04-25T22:41:23.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.908e-05 2024-04-25T22:41:23.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:23.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602756+0000", 2024-04-25T22:41:23.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023662560000000002 2024-04-25T22:41:23.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:23.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603021+0000", 2024-04-25T22:41:23.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026546399999999998 2024-04-25T22:41:23.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:23.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603304+0000", 2024-04-25T22:41:23.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028308800000000002 2024-04-25T22:41:23.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:23.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611075+0000", 2024-04-25T22:41:23.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077703900000000003 2024-04-25T22:41:23.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635414+0000", 2024-04-25T22:41:23.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024339326000000001 2024-04-25T22:41:23.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:23.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635544+0000", 2024-04-25T22:41:23.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012948199999999999 2024-04-25T22:41:23.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:23.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635659+0000", 2024-04-25T22:41:23.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000115809 2024-04-25T22:41:23.802 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.802 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.802 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.802 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.802 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:23.802 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.164821918000001, 2024-04-25T22:41:23.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035594492999999998, 2024-04-25T22:41:23.803 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:23.803 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:23.803 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.803 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:23.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:23.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:23.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:23.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:23.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:23.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600494+0000", 2024-04-25T22:41:23.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:41:23.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:23.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600502+0000", 2024-04-25T22:41:23.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3769999999999996e-06 2024-04-25T22:41:23.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:23.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600522+0000", 2024-04-25T22:41:23.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9919999999999999e-05 2024-04-25T22:41:23.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600539+0000", 2024-04-25T22:41:23.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.649e-05 2024-04-25T22:41:23.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:23.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604846+0000", 2024-04-25T22:41:23.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043075199999999996 2024-04-25T22:41:23.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:23.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605057+0000", 2024-04-25T22:41:23.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00021085200000000001 2024-04-25T22:41:23.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:23.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605378+0000", 2024-04-25T22:41:23.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032074799999999999 2024-04-25T22:41:23.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:23.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611089+0000", 2024-04-25T22:41:23.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057110249999999998 2024-04-25T22:41:23.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635844+0000", 2024-04-25T22:41:23.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024755355999999999 2024-04-25T22:41:23.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:23.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635986+0000", 2024-04-25T22:41:23.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141512 2024-04-25T22:41:23.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:23.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636087+0000", 2024-04-25T22:41:23.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101183 2024-04-25T22:41:23.807 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.807 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.807 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.807 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.808 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:23.808 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.164749307999998, 2024-04-25T22:41:23.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021266723000000001, 2024-04-25T22:41:23.808 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:23.808 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:23.808 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.808 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:23.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:23.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:23.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:23.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:23.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:23.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600566+0000", 2024-04-25T22:41:23.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4959999999999999e-06 2024-04-25T22:41:23.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:23.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600574+0000", 2024-04-25T22:41:23.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-06 2024-04-25T22:41:23.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:23.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600592+0000", 2024-04-25T22:41:23.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8479999999999999e-05 2024-04-25T22:41:23.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600610+0000", 2024-04-25T22:41:23.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7567e-05 2024-04-25T22:41:23.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:23.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602679+0000", 2024-04-25T22:41:23.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020692739999999999 2024-04-25T22:41:23.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:23.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602945+0000", 2024-04-25T22:41:23.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026640399999999998 2024-04-25T22:41:23.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:23.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603115+0000", 2024-04-25T22:41:23.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000169996 2024-04-25T22:41:23.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:23.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608398+0000", 2024-04-25T22:41:23.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052826289999999996 2024-04-25T22:41:23.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621588+0000", 2024-04-25T22:41:23.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013190489 2024-04-25T22:41:23.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:23.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621733+0000", 2024-04-25T22:41:23.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014462500000000001 2024-04-25T22:41:23.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:23.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621832+0000", 2024-04-25T22:41:23.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8603000000000004e-05 2024-04-25T22:41:23.812 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.812 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.812 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.813 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.813 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:23.813 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.164681582, 2024-04-25T22:41:23.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034747924999999999, 2024-04-25T22:41:23.813 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:23.813 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:23.813 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.813 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:23.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:23.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:23.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:23.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:23.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:23.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600634+0000", 2024-04-25T22:41:23.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-04-25T22:41:23.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:23.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600642+0000", 2024-04-25T22:41:23.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8169999999999999e-06 2024-04-25T22:41:23.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:23.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600660+0000", 2024-04-25T22:41:23.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8513e-05 2024-04-25T22:41:23.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600676+0000", 2024-04-25T22:41:23.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6019999999999999e-05 2024-04-25T22:41:23.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:23.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603748+0000", 2024-04-25T22:41:23.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030718329999999999 2024-04-25T22:41:23.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:23.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604752+0000", 2024-04-25T22:41:23.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001003603 2024-04-25T22:41:23.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:23.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605117+0000", 2024-04-25T22:41:23.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00036539 2024-04-25T22:41:23.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:23.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608459+0000", 2024-04-25T22:41:23.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033413879999999998 2024-04-25T22:41:23.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635106+0000", 2024-04-25T22:41:23.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026647607 2024-04-25T22:41:23.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:23.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635273+0000", 2024-04-25T22:41:23.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000166689 2024-04-25T22:41:23.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:23.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635381+0000", 2024-04-25T22:41:23.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107642 2024-04-25T22:41:23.817 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.818 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.818 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.818 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.818 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:23.818 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.164618352999994, 2024-04-25T22:41:23.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040419292000000002, 2024-04-25T22:41:23.818 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:23.818 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:23.818 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.818 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:23.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:23.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:23.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:23.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:23.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:23.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600697+0000", 2024-04-25T22:41:23.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1999999999999999e-06 2024-04-25T22:41:23.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:23.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600704+0000", 2024-04-25T22:41:23.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5570000000000001e-06 2024-04-25T22:41:23.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:23.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600724+0000", 2024-04-25T22:41:23.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0023000000000001e-05 2024-04-25T22:41:23.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600738+0000", 2024-04-25T22:41:23.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4372999999999999e-05 2024-04-25T22:41:23.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:23.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.612532+0000", 2024-04-25T22:41:23.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011793606 2024-04-25T22:41:23.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:23.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613354+0000", 2024-04-25T22:41:23.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00082244100000000004 2024-04-25T22:41:23.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:23.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613726+0000", 2024-04-25T22:41:23.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00037226000000000002 2024-04-25T22:41:23.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:23.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618891+0000", 2024-04-25T22:41:23.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051649199999999999 2024-04-25T22:41:23.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:23.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.640874+0000", 2024-04-25T22:41:23.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021982640000000001 2024-04-25T22:41:23.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:23.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641019+0000", 2024-04-25T22:41:23.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000145339 2024-04-25T22:41:23.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:23.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641115+0000", 2024-04-25T22:41:23.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5933000000000005e-05 2024-04-25T22:41:23.823 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.823 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.823 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.823 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.823 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:23.823 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.164532323000003, 2024-04-25T22:41:23.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036502711, 2024-04-25T22:41:23.823 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:23.824 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:23.824 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:23.824 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:23.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:23.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:23.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:23.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:23.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:23.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600783+0000", 2024-04-25T22:41:23.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.533e-06 2024-04-25T22:41:23.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:23.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600790+0000", 2024-04-25T22:41:23.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0439999999999998e-06 2024-04-25T22:41:23.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:23.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600811+0000", 2024-04-25T22:41:23.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0449e-05 2024-04-25T22:41:23.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600825+0000", 2024-04-25T22:41:23.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4293e-05 2024-04-25T22:41:23.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:23.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602304+0000", 2024-04-25T22:41:23.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001478629 2024-04-25T22:41:23.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:23.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602587+0000", 2024-04-25T22:41:23.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028350800000000002 2024-04-25T22:41:23.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:23.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.637285+0000", 2024-04-25T22:41:23.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034697255000000003 2024-04-25T22:41:23.827 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.827 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.827 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.827 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:23.827 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:23.827 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.164466757, 2024-04-25T22:41:23.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017311460000000001, 2024-04-25T22:41:23.827 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:23.827 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:23.828 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:23.828 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:23.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:23.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:23.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:23.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:23.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:23.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600849+0000", 2024-04-25T22:41:23.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2899999999999999e-06 2024-04-25T22:41:23.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:23.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600866+0000", 2024-04-25T22:41:23.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6793e-05 2024-04-25T22:41:23.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:23.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600886+0000", 2024-04-25T22:41:23.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0772999999999999e-05 2024-04-25T22:41:23.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600904+0000", 2024-04-25T22:41:23.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7697e-05 2024-04-25T22:41:23.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:23.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602796+0000", 2024-04-25T22:41:23.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018920149999999999 2024-04-25T22:41:23.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:23.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602962+0000", 2024-04-25T22:41:23.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016590600000000001 2024-04-25T22:41:23.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:23.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618159+0000", 2024-04-25T22:41:23.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015196985999999999 2024-04-25T22:41:23.831 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.831 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.831 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.831 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:23.831 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:23.831 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.149591016000002, 2024-04-25T22:41:23.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006380269, 2024-04-25T22:41:23.831 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:23.831 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:23.831 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.832 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:23.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:23.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:23.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:23.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:23.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:23.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615724+0000", 2024-04-25T22:41:23.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.094e-06 2024-04-25T22:41:23.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:23.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615734+0000", 2024-04-25T22:41:23.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.363e-06 2024-04-25T22:41:23.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:23.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615751+0000", 2024-04-25T22:41:23.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:41:23.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615773+0000", 2024-04-25T22:41:23.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.154e-05 2024-04-25T22:41:23.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:23.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616485+0000", 2024-04-25T22:41:23.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00071225100000000001 2024-04-25T22:41:23.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:23.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616528+0000", 2024-04-25T22:41:23.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3606000000000002e-05 2024-04-25T22:41:23.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:23.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622030+0000", 2024-04-25T22:41:23.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055010750000000002 2024-04-25T22:41:23.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:23.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622103+0000", 2024-04-25T22:41:23.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3930000000000005e-05 2024-04-25T22:41:23.835 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.835 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.835 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.835 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:23.835 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:23.835 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.148678079000007, 2024-04-25T22:41:23.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046420649999999999, 2024-04-25T22:41:23.835 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:23.836 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:23.836 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-04-25T22:41:23.836 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:23.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:23.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:23.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:23.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:23.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:23.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616637+0000", 2024-04-25T22:41:23.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0299999999999998e-07 2024-04-25T22:41:23.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:23.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616653+0000", 2024-04-25T22:41:23.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5843000000000001e-05 2024-04-25T22:41:23.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:23.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616690+0000", 2024-04-25T22:41:23.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7466999999999999e-05 2024-04-25T22:41:23.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616729+0000", 2024-04-25T22:41:23.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8810000000000003e-05 2024-04-25T22:41:23.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:23.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617251+0000", 2024-04-25T22:41:23.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00052143899999999995 2024-04-25T22:41:23.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:23.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621278+0000", 2024-04-25T22:41:23.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040277029999999997 2024-04-25T22:41:23.838 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.838 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.839 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.839 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:23.839 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:23.839 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.147654727000003, 2024-04-25T22:41:23.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0065101730000000002, 2024-04-25T22:41:23.839 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:23.839 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:23.839 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.839 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:23.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:23.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:23.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:23.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:23.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:23.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617661+0000", 2024-04-25T22:41:23.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:41:23.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:23.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617688+0000", 2024-04-25T22:41:23.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7589e-05 2024-04-25T22:41:23.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:23.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617710+0000", 2024-04-25T22:41:23.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1467e-05 2024-04-25T22:41:23.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617727+0000", 2024-04-25T22:41:23.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6990000000000002e-05 2024-04-25T22:41:23.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:23.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618559+0000", 2024-04-25T22:41:23.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083207400000000003 2024-04-25T22:41:23.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:23.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618608+0000", 2024-04-25T22:41:23.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8936e-05 2024-04-25T22:41:23.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:23.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624077+0000", 2024-04-25T22:41:23.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054695840000000004 2024-04-25T22:41:23.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:23.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624170+0000", 2024-04-25T22:41:23.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2305999999999993e-05 2024-04-25T22:41:23.843 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.843 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.843 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.843 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:23.843 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:23.843 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.142553219000007, 2024-04-25T22:41:23.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006879446, 2024-04-25T22:41:23.843 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:23.843 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:23.843 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.843 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:23.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:23.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:23.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:23.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:23.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:23.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622762+0000", 2024-04-25T22:41:23.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:41:23.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:23.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622781+0000", 2024-04-25T22:41:23.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8749999999999998e-05 2024-04-25T22:41:23.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:23.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622802+0000", 2024-04-25T22:41:23.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1650000000000001e-05 2024-04-25T22:41:23.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622816+0000", 2024-04-25T22:41:23.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3556e-05 2024-04-25T22:41:23.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:23.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623700+0000", 2024-04-25T22:41:23.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00088389299999999996 2024-04-25T22:41:23.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:23.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623741+0000", 2024-04-25T22:41:23.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1023999999999999e-05 2024-04-25T22:41:23.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:23.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629543+0000", 2024-04-25T22:41:23.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058023980000000003 2024-04-25T22:41:23.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:23.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629640+0000", 2024-04-25T22:41:23.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7381999999999997e-05 2024-04-25T22:41:23.847 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.847 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.847 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.847 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:23.847 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:23.847 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.142292014999995, 2024-04-25T22:41:23.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067054879999999999, 2024-04-25T22:41:23.847 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:23.847 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:23.848 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.848 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:23.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:23.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:23.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:23.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:23.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:23.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623032+0000", 2024-04-25T22:41:23.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.9930000000000007e-06 2024-04-25T22:41:23.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:23.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623043+0000", 2024-04-25T22:41:23.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0387000000000001e-05 2024-04-25T22:41:23.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:23.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623064+0000", 2024-04-25T22:41:23.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1849999999999999e-05 2024-04-25T22:41:23.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623079+0000", 2024-04-25T22:41:23.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4093e-05 2024-04-25T22:41:23.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:23.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624384+0000", 2024-04-25T22:41:23.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013054539999999999 2024-04-25T22:41:23.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:23.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624421+0000", 2024-04-25T22:41:23.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7088999999999997e-05 2024-04-25T22:41:23.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:23.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629645+0000", 2024-04-25T22:41:23.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052241400000000004 2024-04-25T22:41:23.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:23.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629728+0000", 2024-04-25T22:41:23.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2482000000000001e-05 2024-04-25T22:41:23.851 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.851 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.851 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.851 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2024-04-25T22:41:23.852 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:23.852 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.142208901999993, 2024-04-25T22:41:23.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078029559999999998, 2024-04-25T22:41:23.852 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:23.852 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:23.852 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:23.852 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:23.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:23.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:23.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:23.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:23.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:23.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:23.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623106+0000", 2024-04-25T22:41:23.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.64e-07 2024-04-25T22:41:23.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:23.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623141+0000", 2024-04-25T22:41:23.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4678999999999998e-05 2024-04-25T22:41:23.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:23.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623153+0000", 2024-04-25T22:41:23.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1759999999999999e-05 2024-04-25T22:41:23.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:23.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623161+0000", 2024-04-25T22:41:23.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8299999999999996e-06 2024-04-25T22:41:23.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:23.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623834+0000", 2024-04-25T22:41:23.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067394500000000001 2024-04-25T22:41:23.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:23.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623883+0000", 2024-04-25T22:41:23.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8640000000000002e-05 2024-04-25T22:41:23.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:23.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630807+0000", 2024-04-25T22:41:23.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069238859999999998 2024-04-25T22:41:23.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:23.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:23.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:23.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630908+0000", 2024-04-25T22:41:23.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101252 2024-04-25T22:41:23.855 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.855 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.856 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.856 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:23.856 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:23.856 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:23.857 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:23.858 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:23.854+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:23.958 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:23.958+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:23.990 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:23.990 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:23.990 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:23.990 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:24.005 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:24.058 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:24.056+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:24.126 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:24.127 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:24.127 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:24.127 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:24.127 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:24.140 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:24.159 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:24.158+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:24.200 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is set 2024-04-25T22:41:24.243 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:41:24.260 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:24.262+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:24.305 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:24.305 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:24.306 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:24.306 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:24.306 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.306 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:24.306 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:24.306 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 69.709318369000002, 2024-04-25T22:41:24.306 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:24.306 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:24.306 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:24.306 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:24.306 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:24.306 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.306 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:24.307 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:24.307 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.307 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.307 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.307 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:24.307 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:24.307 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.307 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.307 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.307 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:24.307 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:24.307 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:24.307 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.307 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.307 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:24.308 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:24.308 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:24.308 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.308 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.308 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:24.308 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:24.308 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:24.308 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.308 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.308 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:24.308 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:24.308 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:24.308 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.308 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.309 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.309 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:24.309 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:24.309 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.309 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.309 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:24.309 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:24.309 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:24.309 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.309 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.309 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.309 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:24.309 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:24.310 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.310 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.310 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:24.310 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:24.310 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:24.310 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.310 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.310 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:24.310 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:24.310 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:24.310 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.310 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.310 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:24.310 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:24.311 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:24.311 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.311 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.311 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:24.311 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:24.311 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:24.311 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.311 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.311 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:24.311 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:24.311 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:24.311 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.311 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.312 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:24.312 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:24.312 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:24.312 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.312 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.312 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.312 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.312 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.312 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:24.312 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:24.312 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 69.709181113, 2024-04-25T22:41:24.312 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:24.312 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:24.312 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:24.312 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:24.313 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:24.313 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.313 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:24.313 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:24.313 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.313 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.313 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.313 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:24.313 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:24.313 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.313 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.313 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.313 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:24.313 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:24.314 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:24.314 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.314 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.314 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:24.314 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:24.314 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:24.314 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.314 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.314 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:24.314 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:24.314 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:24.314 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.314 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.314 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:24.314 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:24.315 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:24.315 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.315 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.315 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.315 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:24.315 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:24.315 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.315 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.315 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:24.315 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:24.315 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:24.315 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.315 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.315 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.316 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:24.316 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:24.316 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.316 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.316 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:24.316 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:24.316 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:24.316 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.316 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.316 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:24.316 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:24.316 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:24.316 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.316 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.317 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:24.317 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:24.317 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:24.317 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.317 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.317 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:24.317 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:24.317 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:24.317 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.317 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.317 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:24.317 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:24.317 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:24.317 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.318 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.318 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:24.318 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:24.318 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:24.318 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.318 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.318 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.318 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.318 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.318 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:24.318 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:24.318 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 69.709093561000003, 2024-04-25T22:41:24.318 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:24.318 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:24.319 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:24.319 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:24.319 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:24.319 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.319 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:24.319 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:24.319 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.319 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.319 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.319 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:24.319 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:24.319 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.319 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.319 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.320 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:24.320 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:24.320 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:24.320 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.320 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.320 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:24.320 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:24.320 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:24.320 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.320 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.320 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:24.320 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:24.320 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:24.320 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.321 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.321 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:24.321 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:24.321 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:24.321 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.321 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.321 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.321 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:24.321 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:24.321 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.321 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.321 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:24.321 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:24.321 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:24.322 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.322 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.322 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.322 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:24.322 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:24.322 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.322 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.322 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:24.322 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:24.322 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:24.322 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.322 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.322 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:24.322 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:24.323 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:24.323 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.323 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.323 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:24.323 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:24.323 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:24.323 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.323 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.323 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:24.323 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:24.323 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:24.323 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.323 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.323 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:24.324 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:24.324 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:24.324 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.324 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.324 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:24.324 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:24.324 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:24.324 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.324 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.324 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.324 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.324 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.324 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:24.324 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:24.325 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 69.708989735000003, 2024-04-25T22:41:24.325 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:24.325 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:24.325 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:24.325 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:24.325 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:24.325 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.325 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:24.325 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:24.325 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.325 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.325 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.325 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:24.325 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:24.325 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.326 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.326 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.326 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:24.326 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:24.326 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:24.326 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.326 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.326 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:24.326 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:24.326 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:24.326 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.326 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.326 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:24.327 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:24.327 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:24.327 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.327 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.327 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:24.327 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:24.327 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:24.327 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.327 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.327 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.327 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:24.327 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:24.327 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.327 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.327 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:24.328 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:24.328 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:24.328 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.328 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.328 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.328 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:24.328 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:24.328 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.328 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.328 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:24.328 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:24.328 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:24.328 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.328 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.328 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:24.329 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:24.329 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:24.329 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.329 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.329 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:24.329 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:24.329 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:24.329 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.329 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.329 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:24.329 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:24.329 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:24.329 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.329 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.329 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:24.330 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:24.330 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:24.330 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.330 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.330 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:24.330 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:24.330 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:24.330 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.330 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.330 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.330 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.330 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.330 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:24.330 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:24.331 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 69.708920945000003, 2024-04-25T22:41:24.331 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:24.331 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:24.331 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:24.331 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:24.331 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:24.331 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.331 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:24.331 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:24.331 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.331 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.331 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.331 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:24.331 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:24.332 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.332 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.332 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.332 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:24.332 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:24.332 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:24.332 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.332 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.332 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:24.332 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:24.332 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:24.332 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.332 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.332 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:24.333 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:24.333 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:24.333 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.333 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.333 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:24.333 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:24.333 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:24.333 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.333 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.333 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.333 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:24.333 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:24.333 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.333 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.333 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:24.334 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:24.334 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:24.334 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.334 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.334 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.334 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:24.334 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:24.334 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.334 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.334 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:24.334 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:24.334 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:24.334 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.334 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.335 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:24.335 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:24.335 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:24.335 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.335 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.335 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:24.335 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:24.335 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:24.335 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.335 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.335 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:24.335 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:24.335 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:24.335 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.336 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.336 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:24.336 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:24.336 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:24.336 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.336 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.336 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:24.336 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:24.336 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:24.336 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.336 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.336 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.336 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.336 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.337 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:24.337 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:24.337 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 69.708851859000006, 2024-04-25T22:41:24.337 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:24.337 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:24.337 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:24.337 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:24.337 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:24.337 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.337 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:24.337 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:24.337 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.337 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.337 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.337 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:24.338 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:24.338 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.338 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.338 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.338 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:24.338 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:24.338 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:24.338 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.338 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.338 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:24.338 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:24.338 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:24.338 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.338 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.339 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:24.339 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:24.339 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:24.339 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.339 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.339 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:24.339 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:24.339 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:24.339 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.339 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.339 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.339 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:24.339 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:24.339 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.340 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.340 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:24.340 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:24.340 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:24.340 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.340 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.340 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.340 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:24.340 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:24.340 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.340 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.340 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:24.340 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:24.340 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:24.341 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.341 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.341 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:24.341 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:24.341 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:24.341 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.341 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.341 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:24.341 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:24.341 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:24.341 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.341 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.341 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:24.341 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:24.341 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:24.342 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.342 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.342 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:24.342 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:24.342 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:24.342 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.342 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.342 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:24.342 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:24.342 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:24.342 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.342 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.342 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.342 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.342 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.343 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:24.343 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:24.343 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 69.708755745999994, 2024-04-25T22:41:24.343 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:24.343 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:24.343 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:24.343 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:24.343 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:24.343 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.343 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:24.343 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:24.343 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.343 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.343 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.343 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:24.344 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:24.344 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.344 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.344 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.344 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:24.344 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:24.344 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:24.344 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.344 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.344 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:24.344 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:24.344 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:24.344 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.344 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.344 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:24.345 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:24.345 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:24.345 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.345 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.345 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:24.345 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:24.345 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:24.345 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.345 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.345 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.345 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:24.345 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:24.345 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.345 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.345 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:24.346 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:24.346 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:24.346 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.346 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.346 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.346 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:24.346 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:24.346 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.346 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.346 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:24.346 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:24.346 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:24.346 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.347 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.347 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:24.347 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:24.347 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:24.347 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.347 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.347 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.347 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.347 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.347 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:24.347 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:24.347 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 69.708690083999997, 2024-04-25T22:41:24.347 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:24.348 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:24.348 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:24.348 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:24.348 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:24.348 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.348 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:24.348 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:24.348 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.348 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.348 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.348 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:24.348 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:24.348 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.348 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.348 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.349 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:24.349 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:24.349 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:24.349 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.349 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.349 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:24.349 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:24.349 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:24.349 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.349 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.349 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:24.349 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:24.349 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:24.349 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.350 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.350 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:24.350 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:24.350 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:24.350 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.350 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.350 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.350 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:24.350 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:24.350 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.350 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.350 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:24.350 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:24.350 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:24.351 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.351 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.351 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.351 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:24.351 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:24.351 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.351 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.351 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:24.351 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:24.351 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:24.351 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.351 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.351 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:24.351 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:24.351 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:24.352 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.352 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.352 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.352 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.352 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.352 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:24.352 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:24.352 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 69.708620956999994, 2024-04-25T22:41:24.352 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:24.352 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:24.352 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:24.352 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:24.352 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:24.352 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.352 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:24.353 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:24.353 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.353 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.353 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.353 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:24.353 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:24.353 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.353 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.353 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.353 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:24.353 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:24.353 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:24.353 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.353 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.353 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:24.354 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:24.354 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:24.354 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.354 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.354 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:24.354 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:24.354 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:24.354 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.354 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.354 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:24.354 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:24.354 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:24.354 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.354 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.355 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.355 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:24.355 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:24.355 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.355 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.355 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:24.355 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:24.355 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:24.355 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.355 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.355 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.355 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:24.355 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:24.355 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.356 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.356 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:24.356 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:24.356 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:24.356 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.356 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.356 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:24.356 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:24.356 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:24.356 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.356 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.356 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.356 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.356 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.356 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:24.357 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:24.357 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 69.697804301000005, 2024-04-25T22:41:24.357 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:24.357 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:24.357 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:24.357 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:24.357 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:24.357 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.357 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:24.357 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:24.357 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.357 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.357 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.357 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:24.357 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:24.358 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.358 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.358 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.358 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:24.358 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:24.358 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:24.358 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.358 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.358 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:24.358 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:24.358 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:24.358 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.358 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.358 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:24.358 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:24.359 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:24.359 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.359 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.359 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:24.359 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:24.359 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:24.359 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.359 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.359 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.359 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:24.359 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:24.359 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.360 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.360 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:24.360 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:24.360 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:24.360 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.360 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.360 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.360 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.360 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.360 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:24.360 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:24.360 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 69.680905948000003, 2024-04-25T22:41:24.360 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:24.361 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:24.361 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:24.361 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:24.361 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:24.361 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.361 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:24.361 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:24.361 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.361 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.361 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.361 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:24.361 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:24.361 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.361 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.362 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.362 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:24.362 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:24.362 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:24.362 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.362 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.362 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:24.362 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:24.362 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:24.362 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.362 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.362 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:24.362 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:24.363 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:24.363 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.363 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.363 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:24.363 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:24.363 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:24.363 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.363 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.363 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.363 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:24.363 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:24.363 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.363 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.364 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:24.364 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:24.364 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:24.364 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.364 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.364 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:24.364 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:24.364 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:24.364 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.364 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.364 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.364 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.364 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.364 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:24.365 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:24.365 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 69.680085058000003, 2024-04-25T22:41:24.365 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:24.365 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:24.365 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:24.365 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:24.365 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:24.365 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.365 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:24.365 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:24.365 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.365 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.365 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.365 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:24.366 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:24.366 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.366 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.366 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.366 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:24.366 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:24.366 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:24.366 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.366 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.366 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:24.366 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:24.366 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:24.366 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.366 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.367 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:24.367 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:24.367 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:24.367 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.367 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.367 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:24.367 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:24.367 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:24.367 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.367 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.367 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.367 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:24.367 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:24.367 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.367 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.368 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:24.368 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:24.368 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:24.368 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.368 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.368 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:24.368 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:24.368 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:24.368 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.368 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.368 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.368 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.368 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.368 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:24.368 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:24.369 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 69.67838433, 2024-04-25T22:41:24.369 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:24.369 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:24.369 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:24.369 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:24.369 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:24.369 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.369 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:24.369 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:24.369 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.369 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.369 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.369 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:24.369 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.370 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:24.371 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:24.371 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:24.371 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.371 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.371 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:24.371 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:24.371 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:24.371 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.371 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.371 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.371 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:24.371 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:24.371 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.371 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.372 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:24.372 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:24.372 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:24.372 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.372 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.372 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:24.372 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:24.372 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:24.372 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.372 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.372 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:24.372 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:24.373 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:24.373 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.373 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.373 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.373 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.373 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.373 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:24.373 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:24.373 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 69.677787655000003, 2024-04-25T22:41:24.373 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:24.373 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:24.373 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:24.373 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:24.373 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:24.374 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.374 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:24.374 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:24.374 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.374 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.374 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.374 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:24.374 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:24.374 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.374 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.374 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.374 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:24.374 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:24.375 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:24.375 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.375 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.375 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:24.375 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:24.375 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:24.375 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.375 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.375 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:24.375 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:24.375 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:24.375 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.375 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.375 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:24.376 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:24.376 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:24.376 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.376 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.376 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.376 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:24.376 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:24.376 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.376 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.376 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:24.376 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:24.376 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:24.376 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.377 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.377 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:24.377 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:24.377 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:24.377 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.377 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.377 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:24.377 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:24.377 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:24.377 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.377 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.377 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.377 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.377 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.378 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:24.378 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:24.378 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 69.668351928999996, 2024-04-25T22:41:24.378 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:24.378 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:24.378 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:24.378 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:24.378 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:24.378 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.378 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:24.378 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:24.378 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.378 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.378 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.379 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:24.379 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:24.379 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.379 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.379 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.379 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:24.379 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:24.379 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:24.379 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.379 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.379 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:24.379 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:24.379 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:24.379 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.379 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.380 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:24.380 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:24.380 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:24.380 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.380 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.380 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:24.380 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:24.380 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:24.380 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.380 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.380 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.380 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:24.380 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:24.380 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.380 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.381 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:24.381 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:24.381 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:24.381 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.381 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.381 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.381 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.381 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.381 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:24.381 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:24.381 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 69.667704502999996, 2024-04-25T22:41:24.381 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:24.381 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:24.381 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:24.381 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:24.382 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:24.382 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.382 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:24.382 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:24.382 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.382 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.382 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.382 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:24.382 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:24.382 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.382 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.382 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.382 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:24.382 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:24.383 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:24.383 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.383 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.383 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:24.383 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:24.383 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:24.383 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.383 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.383 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:24.383 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:24.383 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:24.383 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.383 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.384 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:24.384 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:24.384 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:24.384 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.384 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.384 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.384 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:24.384 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:24.384 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.384 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.384 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:24.384 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:24.384 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:24.384 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.385 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.385 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:24.385 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:24.385 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:24.385 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.385 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.385 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:24.385 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:24.385 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:24.385 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.385 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.385 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.385 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.385 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.386 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:24.386 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:24.386 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 69.666263684, 2024-04-25T22:41:24.386 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:24.386 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:24.386 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:24.386 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:24.386 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:24.386 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.386 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:24.386 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:24.386 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.386 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.387 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.387 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:24.387 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:24.387 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.387 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.387 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.387 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:24.387 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:24.387 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:24.387 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.387 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.387 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:24.387 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:24.387 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:24.387 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.388 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.388 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:24.388 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:24.388 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:24.388 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.388 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.388 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:24.388 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:24.388 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:24.388 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.388 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.388 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.388 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:24.389 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:24.389 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.389 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:24.389 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:24.389 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:24.389 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.389 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:24.389 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:24.389 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:24.389 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.389 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:24.389 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 67.713825240000006, 2024-04-25T22:41:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:24.390 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:24.391 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.392 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.392 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:24.392 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:24.392 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:24.392 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.392 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.392 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:24.392 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:24.392 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:24.392 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.392 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.392 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:24.392 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:24.392 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:24.392 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.393 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.393 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.393 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:24.393 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:24.393 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.393 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.393 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:24.393 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:24.393 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:24.393 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.393 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.393 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:24.393 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:24.393 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:24.394 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.394 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.394 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:24.394 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:24.394 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:24.394 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.394 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.394 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:24.394 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:24.394 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:24.394 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.394 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.394 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:24.394 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:24.395 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:24.395 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.395 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.395 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:24.395 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:24.395 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:24.395 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.395 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.395 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.395 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.395 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.395 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:24.395 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:24.395 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 45.711165915999999, 2024-04-25T22:41:24.396 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:24.396 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:24.396 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:24.396 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:24.396 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:24.396 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.396 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:24.396 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:24.396 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.396 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.396 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.396 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:24.396 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:24.396 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.396 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.397 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.397 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:24.397 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:24.397 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:24.397 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.397 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.397 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:24.397 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:24.397 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:24.397 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.397 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.397 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:24.397 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:24.397 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:24.398 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.398 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.398 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:24.398 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:24.398 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:24.398 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.398 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.398 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.398 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:24.398 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:24.398 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.398 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.398 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:24.399 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:24.399 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:24.399 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.399 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.399 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:24.399 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:24.399 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:24.399 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.399 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.399 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:24.399 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:24.399 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:24.399 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.399 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.400 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:24.400 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:24.400 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:24.400 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.400 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.400 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:24.400 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:24.400 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:24.400 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.400 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.400 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:24.400 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:24.400 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:24.400 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.401 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.401 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.401 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.401 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:24.401 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:24.401 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 40.710873665000001, 2024-04-25T22:41:24.401 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:24.401 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:24.401 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:24.401 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:24.401 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:24.401 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:24.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:24.402 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.402 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.402 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:24.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:24.402 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:24.402 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.402 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:24.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:24.402 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:24.402 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.402 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.403 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:24.403 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:24.403 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:24.403 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.403 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.403 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:24.403 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:24.403 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:24.403 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.403 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.403 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:24.403 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:24.403 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:24.404 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.404 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.404 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:24.404 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:24.404 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:24.404 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.404 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.404 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:24.404 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:24.404 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:24.404 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.404 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.404 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:24.404 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:24.405 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:24.405 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.405 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.405 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:24.405 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:24.405 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:24.405 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.405 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.405 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:24.405 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:24.405 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:24.405 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.405 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.405 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:24.406 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:24.406 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:24.406 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:24.406 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:24.406 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:24.406 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:24.406 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:24.406 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.406 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.406 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.406 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:24.406 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:24.406 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:24.407 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:24.408 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:24.409 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:41:24.409 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:41:24.409 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:24.410 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:24.410+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:24.429 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:24.429 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:24.509 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:24.510+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:24.539 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:24.540 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:24.554 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:24.644 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:24.646+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:24.710 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:24.708+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:24.719 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:24.720 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:24.733 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:24.788 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:41:24.788 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:41:24.788 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-25T22:41:24.788 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-25T22:41:24.811 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:24.810+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:24.899 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:24.899 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:24.912 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:24.914+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:24.914 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:41:25.013 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:25.010+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:25.047 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:25.047 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:25.061 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:41:25.097 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:41:25.097 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:41:25.097 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 42, 2024-04-25T22:41:25.097 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d", 2024-04-25T22:41:25.097 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2024-04-25T22:39:52.303074+0000", 2024-04-25T22:41:25.097 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2024-04-25T22:41:24.170548+0000", 2024-04-25T22:41:25.097 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2024-04-25T22:40:01.251093+0000", 2024-04-25T22:41:25.097 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2024-04-25T22:39:53.230242+0000", 2024-04-25T22:41:25.097 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-25T22:41:25.097 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5801984, 2024-04-25T22:41:25.097 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2024-04-25T22:41:25.097 INFO:teuthology.orchestra.run.smithi057.stdout: "noscrub", 2024-04-25T22:41:25.097 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2024-04-25T22:41:25.098 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2024-04-25T22:41:25.098 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2024-04-25T22:41:25.098 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2024-04-25T22:41:25.098 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:41:25.098 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 4, 2024-04-25T22:41:25.098 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2024-04-25T22:41:25.098 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-25T22:41:25.098 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-25T22:41:25.098 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2024-04-25T22:41:25.098 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 4, 2024-04-25T22:41:25.098 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 3, 2024-04-25T22:41:25.098 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "luminous", 2024-04-25T22:41:25.098 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2024-04-25T22:41:25.098 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "squid", 2024-04-25T22:41:25.099 INFO:teuthology.orchestra.run.smithi057.stdout: "allow_crimson": false, 2024-04-25T22:41:25.099 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2024-04-25T22:41:25.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.099 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2024-04-25T22:41:25.099 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": ".mgr", 2024-04-25T22:41:25.099 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25T22:40:03.197725+0000", 2024-04-25T22:41:25.099 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T22:41:25.099 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T22:41:25.099 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T22:41:25.099 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T22:41:25.099 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T22:41:25.099 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T22:41:25.099 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:41:25.099 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:41:25.100 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:41:25.100 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:41:25.100 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T22:41:25.100 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:41:25.100 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2024-04-25T22:41:25.100 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2024-04-25T22:41:25.100 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2024-04-25T22:41:25.100 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2024-04-25T22:41:25.100 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2024-04-25T22:41:25.100 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T22:41:25.100 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T22:41:25.100 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T22:41:25.100 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T22:41:25.100 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T22:41:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T22:41:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T22:41:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "12", 2024-04-25T22:41:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T22:41:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:41:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:41:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T22:41:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:41:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T22:41:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T22:41:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T22:41:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T22:41:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T22:41:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T22:41:25.102 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T22:41:25.102 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T22:41:25.102 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T22:41:25.102 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T22:41:25.102 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T22:41:25.102 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T22:41:25.102 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T22:41:25.102 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:41:25.102 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:41:25.102 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:41:25.102 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T22:41:25.102 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T22:41:25.102 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T22:41:25.103 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T22:41:25.103 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T22:41:25.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.103 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T22:41:25.103 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T22:41:25.103 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T22:41:25.103 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:41:25.103 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:41:25.103 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:41:25.103 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:41:25.103 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T22:41:25.103 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T22:41:25.103 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T22:41:25.103 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T22:41:25.104 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2024-04-25T22:41:25.104 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_max": 32, 2024-04-25T22:41:25.104 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2024-04-25T22:41:25.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.104 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T22:41:25.104 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": {} 2024-04-25T22:41:25.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.104 INFO:teuthology.orchestra.run.smithi057.stdout: "read_balance": { 2024-04-25T22:41:25.104 INFO:teuthology.orchestra.run.smithi057.stdout: "error_message": "pool 1 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-04-25T22:41:25.104 INFO:teuthology.orchestra.run.smithi057.stdout: "score_acting": 0, 2024-04-25T22:41:25.104 INFO:teuthology.orchestra.run.smithi057.stdout: "score_stable": 0 2024-04-25T22:41:25.104 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.105 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2024-04-25T22:41:25.105 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2024-04-25T22:41:25.105 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25T22:40:07.560858+0000", 2024-04-25T22:41:25.105 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T22:41:25.105 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T22:41:25.105 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T22:41:25.105 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T22:41:25.105 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T22:41:25.105 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T22:41:25.105 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:41:25.105 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:41:25.105 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:41:25.105 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:41:25.106 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T22:41:25.106 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:41:25.106 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2024-04-25T22:41:25.106 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2024-04-25T22:41:25.106 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2024-04-25T22:41:25.106 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2024-04-25T22:41:25.106 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2024-04-25T22:41:25.106 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T22:41:25.106 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T22:41:25.106 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T22:41:25.106 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T22:41:25.106 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T22:41:25.106 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T22:41:25.107 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T22:41:25.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.107 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2024-04-25T22:41:25.107 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T22:41:25.107 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:41:25.107 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:41:25.107 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T22:41:25.107 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:41:25.107 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T22:41:25.107 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T22:41:25.107 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T22:41:25.107 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T22:41:25.107 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T22:41:25.107 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T22:41:25.107 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T22:41:25.108 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T22:41:25.108 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T22:41:25.108 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T22:41:25.108 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T22:41:25.108 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T22:41:25.108 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T22:41:25.108 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:41:25.108 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:41:25.108 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:41:25.108 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T22:41:25.108 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T22:41:25.108 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T22:41:25.108 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T22:41:25.108 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T22:41:25.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.109 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T22:41:25.109 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T22:41:25.109 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T22:41:25.109 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:41:25.109 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:41:25.109 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:41:25.109 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:41:25.109 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T22:41:25.109 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T22:41:25.109 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T22:41:25.109 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T22:41:25.109 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2024-04-25T22:41:25.109 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T22:41:25.110 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2024-04-25T22:41:25.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.110 INFO:teuthology.orchestra.run.smithi057.stdout: "read_balance": { 2024-04-25T22:41:25.110 INFO:teuthology.orchestra.run.smithi057.stdout: "error_message": "pool 2 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-04-25T22:41:25.110 INFO:teuthology.orchestra.run.smithi057.stdout: "score_acting": 0, 2024-04-25T22:41:25.110 INFO:teuthology.orchestra.run.smithi057.stdout: "score_stable": 0 2024-04-25T22:41:25.110 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.110 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 3, 2024-04-25T22:41:25.110 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_metadata", 2024-04-25T22:41:25.110 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25T22:40:12.431697+0000", 2024-04-25T22:41:25.110 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T22:41:25.110 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T22:41:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T22:41:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T22:41:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T22:41:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T22:41:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:41:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:41:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:41:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:41:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T22:41:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:41:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 32, 2024-04-25T22:41:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 32, 2024-04-25T22:41:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 32, 2024-04-25T22:41:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 32, 2024-04-25T22:41:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 32, 2024-04-25T22:41:25.112 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T22:41:25.112 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T22:41:25.112 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T22:41:25.112 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T22:41:25.112 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T22:41:25.112 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T22:41:25.112 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T22:41:25.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.112 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2024-04-25T22:41:25.112 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T22:41:25.112 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:41:25.112 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:41:25.112 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T22:41:25.112 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:41:25.112 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T22:41:25.113 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T22:41:25.113 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T22:41:25.113 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T22:41:25.113 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T22:41:25.113 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T22:41:25.113 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T22:41:25.113 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T22:41:25.113 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T22:41:25.113 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T22:41:25.113 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T22:41:25.113 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T22:41:25.113 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T22:41:25.113 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:41:25.114 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:41:25.114 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:41:25.114 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T22:41:25.114 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T22:41:25.114 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T22:41:25.114 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T22:41:25.114 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T22:41:25.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.114 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T22:41:25.114 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T22:41:25.114 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T22:41:25.114 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:41:25.114 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:41:25.114 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:41:25.115 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:41:25.115 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T22:41:25.115 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T22:41:25.115 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T22:41:25.115 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T22:41:25.115 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2024-04-25T22:41:25.115 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_bias": 4, 2024-04-25T22:41:25.115 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 16, 2024-04-25T22:41:25.115 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_priority": 5 2024-04-25T22:41:25.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.115 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T22:41:25.115 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2024-04-25T22:41:25.115 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": "cephfs" 2024-04-25T22:41:25.115 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: "read_balance": { 2024-04-25T22:41:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: "error_message": "pool 3 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-04-25T22:41:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: "score_acting": 0, 2024-04-25T22:41:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: "score_stable": 0 2024-04-25T22:41:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 4, 2024-04-25T22:41:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_data", 2024-04-25T22:41:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25T22:40:12.919828+0000", 2024-04-25T22:41:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T22:41:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T22:41:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T22:41:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T22:41:25.117 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T22:41:25.117 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T22:41:25.117 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:41:25.117 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:41:25.117 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:41:25.117 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:41:25.117 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T22:41:25.117 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:41:25.117 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 64, 2024-04-25T22:41:25.117 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 64, 2024-04-25T22:41:25.117 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 64, 2024-04-25T22:41:25.117 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 64, 2024-04-25T22:41:25.117 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 64, 2024-04-25T22:41:25.118 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T22:41:25.118 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T22:41:25.118 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T22:41:25.118 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T22:41:25.118 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T22:41:25.118 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T22:41:25.118 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T22:41:25.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.118 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "19", 2024-04-25T22:41:25.118 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T22:41:25.118 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:41:25.118 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:41:25.118 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T22:41:25.118 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:41:25.119 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T22:41:25.119 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T22:41:25.119 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T22:41:25.119 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T22:41:25.119 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T22:41:25.119 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T22:41:25.119 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T22:41:25.119 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T22:41:25.119 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T22:41:25.119 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T22:41:25.119 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T22:41:25.119 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T22:41:25.119 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T22:41:25.119 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:41:25.119 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:41:25.120 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:41:25.120 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T22:41:25.120 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T22:41:25.120 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T22:41:25.120 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T22:41:25.120 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T22:41:25.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.120 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T22:41:25.120 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T22:41:25.120 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T22:41:25.120 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:41:25.120 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:41:25.120 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:41:25.120 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:41:25.121 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T22:41:25.121 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T22:41:25.121 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T22:41:25.121 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T22:41:25.121 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2024-04-25T22:41:25.121 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 64, 2024-04-25T22:41:25.121 INFO:teuthology.orchestra.run.smithi057.stdout: "target_size_ratio": 0.89999997615814209 2024-04-25T22:41:25.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.121 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T22:41:25.121 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2024-04-25T22:41:25.121 INFO:teuthology.orchestra.run.smithi057.stdout: "data": "cephfs" 2024-04-25T22:41:25.121 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.121 INFO:teuthology.orchestra.run.smithi057.stdout: "read_balance": { 2024-04-25T22:41:25.122 INFO:teuthology.orchestra.run.smithi057.stdout: "error_message": "pool 4 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-04-25T22:41:25.122 INFO:teuthology.orchestra.run.smithi057.stdout: "score_acting": 0, 2024-04-25T22:41:25.122 INFO:teuthology.orchestra.run.smithi057.stdout: "score_stable": 0 2024-04-25T22:41:25.122 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.122 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.122 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:41:25.122 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2024-04-25T22:41:25.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.122 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2024-04-25T22:41:25.122 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "73d465b4-5896-4d69-80b1-7e69d31eb455", 2024-04-25T22:41:25.122 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T22:41:25.122 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T22:41:25.122 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T22:41:25.122 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2024-04-25T22:41:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T22:41:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T22:41:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 8, 2024-04-25T22:41:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 30, 2024-04-25T22:41:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T22:41:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T22:41:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T22:41:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6800", 2024-04-25T22:41:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6801", 2024-04-25T22:41:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T22:41:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6802", 2024-04-25T22:41:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:25.125 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6803", 2024-04-25T22:41:25.125 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:25.125 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.125 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:25.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.125 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T22:41:25.125 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:25.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.125 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:25.125 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6806", 2024-04-25T22:41:25.125 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:25.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.125 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:25.126 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6807", 2024-04-25T22:41:25.126 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:25.126 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.126 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:25.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.126 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T22:41:25.126 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:25.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.126 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:25.126 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6804", 2024-04-25T22:41:25.126 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:25.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.127 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:25.127 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6805", 2024-04-25T22:41:25.127 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:25.127 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.127 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:25.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.127 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.122:6801/765118869", 2024-04-25T22:41:25.127 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.122:6803/765118869", 2024-04-25T22:41:25.127 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.122:6807/765118869", 2024-04-25T22:41:25.127 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.122:6805/765118869", 2024-04-25T22:41:25.127 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T22:41:25.127 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T22:41:25.127 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T22:41:25.127 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:25.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.128 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2024-04-25T22:41:25.128 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5", 2024-04-25T22:41:25.128 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T22:41:25.128 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T22:41:25.128 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T22:41:25.128 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 0, 2024-04-25T22:41:25.128 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T22:41:25.128 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T22:41:25.128 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 8, 2024-04-25T22:41:25.128 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 30, 2024-04-25T22:41:25.128 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T22:41:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T22:41:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T22:41:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6800", 2024-04-25T22:41:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6801", 2024-04-25T22:41:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T22:41:25.130 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:25.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.130 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:25.130 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6802", 2024-04-25T22:41:25.130 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:25.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.130 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:25.130 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6803", 2024-04-25T22:41:25.130 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:25.130 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.130 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:25.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.130 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T22:41:25.131 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:25.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.131 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:25.131 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6806", 2024-04-25T22:41:25.131 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:25.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.131 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:25.131 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6807", 2024-04-25T22:41:25.131 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:25.131 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.131 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:25.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.131 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T22:41:25.131 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:25.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.132 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:25.132 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6804", 2024-04-25T22:41:25.132 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:25.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.132 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:25.132 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6805", 2024-04-25T22:41:25.132 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:25.132 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.132 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:25.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.132 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.148:6801/2387035286", 2024-04-25T22:41:25.132 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.148:6803/2387035286", 2024-04-25T22:41:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.148:6807/2387035286", 2024-04-25T22:41:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.148:6805/2387035286", 2024-04-25T22:41:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T22:41:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T22:41:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T22:41:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2024-04-25T22:41:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "164fc653-2135-4e9b-8826-1716fdba6ea0", 2024-04-25T22:41:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T22:41:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T22:41:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T22:41:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 0, 2024-04-25T22:41:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T22:41:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T22:41:25.134 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 8, 2024-04-25T22:41:25.134 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 20, 2024-04-25T22:41:25.134 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T22:41:25.134 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T22:41:25.134 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T22:41:25.134 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:25.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.134 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:25.134 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6800", 2024-04-25T22:41:25.134 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:25.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.134 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:25.134 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6801", 2024-04-25T22:41:25.134 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:25.135 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.135 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:25.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.135 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T22:41:25.135 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:25.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.135 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:25.135 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6802", 2024-04-25T22:41:25.135 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:25.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.135 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:25.135 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6803", 2024-04-25T22:41:25.135 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:25.136 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.136 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:25.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.136 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T22:41:25.136 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:25.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.136 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:25.136 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6806", 2024-04-25T22:41:25.136 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:25.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.136 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:25.136 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6807", 2024-04-25T22:41:25.136 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T22:41:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6804", 2024-04-25T22:41:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6805", 2024-04-25T22:41:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.138 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:25.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.138 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.188:6801/368834361", 2024-04-25T22:41:25.138 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.188:6803/368834361", 2024-04-25T22:41:25.138 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.188:6807/368834361", 2024-04-25T22:41:25.138 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.188:6805/368834361", 2024-04-25T22:41:25.138 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T22:41:25.138 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T22:41:25.138 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T22:41:25.138 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:25.138 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.138 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:41:25.138 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2024-04-25T22:41:25.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.138 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2024-04-25T22:41:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T22:41:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T22:41:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T22:41:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540701547738038271, 2024-04-25T22:41:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2024-04-25T22:41:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2024-04-25T22:39:58.559393+0000", 2024-04-25T22:41:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2024-04-25T22:41:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2024-04-25T22:41:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T22:41:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T22:41:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T22:41:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540701547738038271, 2024-04-25T22:41:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2024-04-25T22:41:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2024-04-25T22:39:58.563434+0000", 2024-04-25T22:41:25.140 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2024-04-25T22:41:25.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:25.140 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2024-04-25T22:41:25.140 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T22:41:25.140 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T22:41:25.140 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T22:41:25.140 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540701547738038271, 2024-04-25T22:41:25.140 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2024-04-25T22:41:25.140 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2024-04-25T22:39:58.557643+0000", 2024-04-25T22:41:25.140 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2024-04-25T22:41:25.140 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.140 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:41:25.140 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2024-04-25T22:41:25.141 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2024-04-25T22:41:25.141 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_primaries": [], 2024-04-25T22:41:25.141 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2024-04-25T22:41:25.141 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2024-04-25T22:41:25.141 INFO:teuthology.orchestra.run.smithi057.stdout: "blocklist": {}, 2024-04-25T22:41:25.141 INFO:teuthology.orchestra.run.smithi057.stdout: "range_blocklist": {}, 2024-04-25T22:41:25.141 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2024-04-25T22:41:25.141 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2024-04-25T22:41:25.141 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2024-04-25T22:41:25.141 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2024-04-25T22:41:25.141 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2024-04-25T22:41:25.141 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2024-04-25T22:41:25.141 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2024-04-25T22:41:25.141 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:25.142 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2024-04-25T22:41:25.142 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2024-04-25T22:41:25.142 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2024-04-25T22:41:25.142 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2024-04-25T22:41:25.142 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {}, 2024-04-25T22:41:25.142 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_mode": { 2024-04-25T22:41:25.142 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_mode_enabled": false, 2024-04-25T22:41:25.142 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_bucket_count": 0, 2024-04-25T22:41:25.142 INFO:teuthology.orchestra.run.smithi057.stdout: "degraded_stretch_mode": 0, 2024-04-25T22:41:25.142 INFO:teuthology.orchestra.run.smithi057.stdout: "recovering_stretch_mode": 0, 2024-04-25T22:41:25.142 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_mode_bucket": 0 2024-04-25T22:41:25.142 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:25.142 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:41:25.145 INFO:tasks.thrashosds.thrasher:j is {'epoch': 42, 'fsid': '5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d', 'created': '2024-04-25T22:39:52.303074+0000', 'modified': '2024-04-25T22:41:24.170548+0000', 'last_up_change': '2024-04-25T22:40:01.251093+0000', 'last_in_change': '2024-04-25T22:39:53.230242+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:40:03.197725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'error_message': 'pool 1 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:40:07.560858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:40:12.431697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'error_message': 'pool 3 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:40:12.919828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 4 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': '73d465b4-5896-4d69-80b1-7e69d31eb455', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6800', 'nonce': 765118869}, {'type': 'v1', 'addr': '172.21.15.122:6801', 'nonce': 765118869}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6802', 'nonce': 765118869}, {'type': 'v1', 'addr': '172.21.15.122:6803', 'nonce': 765118869}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6806', 'nonce': 765118869}, {'type': 'v1', 'addr': '172.21.15.122:6807', 'nonce': 765118869}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6804', 'nonce': 765118869}, {'type': 'v1', 'addr': '172.21.15.122:6805', 'nonce': 765118869}]}, 'public_addr': '172.21.15.122:6801/765118869', 'cluster_addr': '172.21.15.122:6803/765118869', 'heartbeat_back_addr': '172.21.15.122:6807/765118869', 'heartbeat_front_addr': '172.21.15.122:6805/765118869', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6800', 'nonce': 2387035286}, {'type': 'v1', 'addr': '172.21.15.148:6801', 'nonce': 2387035286}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6802', 'nonce': 2387035286}, {'type': 'v1', 'addr': '172.21.15.148:6803', 'nonce': 2387035286}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6806', 'nonce': 2387035286}, {'type': 'v1', 'addr': '172.21.15.148:6807', 'nonce': 2387035286}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6804', 'nonce': 2387035286}, {'type': 'v1', 'addr': '172.21.15.148:6805', 'nonce': 2387035286}]}, 'public_addr': '172.21.15.148:6801/2387035286', 'cluster_addr': '172.21.15.148:6803/2387035286', 'heartbeat_back_addr': '172.21.15.148:6807/2387035286', 'heartbeat_front_addr': '172.21.15.148:6805/2387035286', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '164fc653-2135-4e9b-8826-1716fdba6ea0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 20, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6800', 'nonce': 368834361}, {'type': 'v1', 'addr': '172.21.15.188:6801', 'nonce': 368834361}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6802', 'nonce': 368834361}, {'type': 'v1', 'addr': '172.21.15.188:6803', 'nonce': 368834361}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6806', 'nonce': 368834361}, {'type': 'v1', 'addr': '172.21.15.188:6807', 'nonce': 368834361}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6804', 'nonce': 368834361}, {'type': 'v1', 'addr': '172.21.15.188:6805', 'nonce': 368834361}]}, 'public_addr': '172.21.15.188:6801/368834361', 'cluster_addr': '172.21.15.188:6803/368834361', 'heartbeat_back_addr': '172.21.15.188:6807/368834361', 'heartbeat_front_addr': '172.21.15.188:6805/368834361', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:39:58.559393+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:39:58.563434+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:39:58.557643+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-25T22:41:25.145 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-25T22:41:25.145 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:25.144+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:25.245 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:25.240+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:25.267 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:25.267 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:25.281 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:41:25.346 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:25.346+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:25.397 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:25.397 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:25.411 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:25.447 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:25.446+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:25.542 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:25.543 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:25.548 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:25.546+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:25.557 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:25.649 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:25.644+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:25.675 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:25.675 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:25.689 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:25.750 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:25.746+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:25.851 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:25.850+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:25.854 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:25.854 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:25.868 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:25.951 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:25.950+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:25.998 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:25.998 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:26.012 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:26.060 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:26.062+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:26.153 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:26.148+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:26.184 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:26.184 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:26.199 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:26.221 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:41:26.253 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:26.254+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:26.326 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:26.326 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:26.342 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:41:26.354 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:26.352+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:26.447 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:41:26.455 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:26.454+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:26.475 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:26.475 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:26.491 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:41:26.555 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:26.552+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:26.609 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:26.609 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:26.624 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:41:26.633 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:26.633 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:26.657 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:26.656+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:26.663 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:41:26.664 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:41:26.697 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:26.698 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:26.751 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:26.751 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-04-25T22:41:26.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-04-25T22:41:26.752 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-04-25T22:41:26.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.752 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:111 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'73, mlcod=11'69)", 2024-04-25T22:41:26.752 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:26.752 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.048806322000004, 2024-04-25T22:41:26.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055481899999999997, 2024-04-25T22:41:26.752 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:26.752 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:26.752 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:26.752 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:26.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:26.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:26.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:26.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:26.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:26.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700271+0000", 2024-04-25T22:41:26.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:41:26.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:26.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700278+0000", 2024-04-25T22:41:26.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-04-25T22:41:26.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:26.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700323+0000", 2024-04-25T22:41:26.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4212999999999998e-05 2024-04-25T22:41:26.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:26.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700333+0000", 2024-04-25T22:41:26.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0433e-05 2024-04-25T22:41:26.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:26.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700662+0000", 2024-04-25T22:41:26.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032862800000000003 2024-04-25T22:41:26.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:26.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700692+0000", 2024-04-25T22:41:26.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0395999999999998e-05 2024-04-25T22:41:26.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:26.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705728+0000", 2024-04-25T22:41:26.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050361939999999999 2024-04-25T22:41:26.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:26.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705818+0000", 2024-04-25T22:41:26.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9573000000000005e-05 2024-04-25T22:41:26.756 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.756 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.757 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.757 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-25T22:41:26.757 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:26.757 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.04826147, 2024-04-25T22:41:26.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005065501, 2024-04-25T22:41:26.757 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:26.757 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:26.757 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:26.757 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:26.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:26.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:26.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:26.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:26.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:26.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700816+0000", 2024-04-25T22:41:26.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.24e-06 2024-04-25T22:41:26.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:26.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700914+0000", 2024-04-25T22:41:26.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8057e-05 2024-04-25T22:41:26.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:26.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700931+0000", 2024-04-25T22:41:26.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7745999999999999e-05 2024-04-25T22:41:26.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:26.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700941+0000", 2024-04-25T22:41:26.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5699999999999999e-06 2024-04-25T22:41:26.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:26.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701162+0000", 2024-04-25T22:41:26.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000221392 2024-04-25T22:41:26.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:26.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701194+0000", 2024-04-25T22:41:26.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1745999999999997e-05 2024-04-25T22:41:26.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:26.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705821+0000", 2024-04-25T22:41:26.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046269869999999999 2024-04-25T22:41:26.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:26.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705880+0000", 2024-04-25T22:41:26.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8763e-05 2024-04-25T22:41:26.761 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.761 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.761 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.761 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:118 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'80, mlcod=11'78)", 2024-04-25T22:41:26.761 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:26.762 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.040905859999995, 2024-04-25T22:41:26.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047806089999999999, 2024-04-25T22:41:26.762 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:26.762 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:26.762 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:26.762 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:26.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:26.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:26.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:26.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:26.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:26.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708172+0000", 2024-04-25T22:41:26.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0600000000000002e-06 2024-04-25T22:41:26.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:26.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708291+0000", 2024-04-25T22:41:26.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118892 2024-04-25T22:41:26.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:26.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708320+0000", 2024-04-25T22:41:26.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8822999999999998e-05 2024-04-25T22:41:26.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:26.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708337+0000", 2024-04-25T22:41:26.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7586999999999999e-05 2024-04-25T22:41:26.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:26.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708512+0000", 2024-04-25T22:41:26.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017439500000000001 2024-04-25T22:41:26.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:26.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708551+0000", 2024-04-25T22:41:26.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.909e-05 2024-04-25T22:41:26.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:26.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712865+0000", 2024-04-25T22:41:26.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043142069999999996 2024-04-25T22:41:26.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:26.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712951+0000", 2024-04-25T22:41:26.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5555000000000003e-05 2024-04-25T22:41:26.766 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.766 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.766 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.767 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:120 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'82, mlcod=11'78)", 2024-04-25T22:41:26.767 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:26.767 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.039899817999995, 2024-04-25T22:41:26.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047170700000000003, 2024-04-25T22:41:26.767 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:26.767 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:26.767 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:26.767 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:26.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:26.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:26.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:26.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:26.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:26.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709177+0000", 2024-04-25T22:41:26.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.19e-06 2024-04-25T22:41:26.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:26.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709315+0000", 2024-04-25T22:41:26.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000137429 2024-04-25T22:41:26.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:26.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709341+0000", 2024-04-25T22:41:26.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:41:26.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:26.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709353+0000", 2024-04-25T22:41:26.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2027e-05 2024-04-25T22:41:26.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:26.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710040+0000", 2024-04-25T22:41:26.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068710799999999997 2024-04-25T22:41:26.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:26.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710076+0000", 2024-04-25T22:41:26.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5982999999999998e-05 2024-04-25T22:41:26.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:26.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713802+0000", 2024-04-25T22:41:26.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037255750000000001 2024-04-25T22:41:26.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:26.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713893+0000", 2024-04-25T22:41:26.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1201999999999999e-05 2024-04-25T22:41:26.771 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.771 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.771 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.771 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:121 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'83, mlcod=11'78)", 2024-04-25T22:41:26.771 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:26.771 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.039353181999999, 2024-04-25T22:41:26.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0049043919999999996, 2024-04-25T22:41:26.771 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:26.771 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:26.771 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:26.772 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:26.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:26.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:26.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:26.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:26.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:26.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709724+0000", 2024-04-25T22:41:26.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.483e-06 2024-04-25T22:41:26.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:26.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709872+0000", 2024-04-25T22:41:26.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147446 2024-04-25T22:41:26.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:26.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709891+0000", 2024-04-25T22:41:26.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9245999999999998e-05 2024-04-25T22:41:26.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:26.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709900+0000", 2024-04-25T22:41:26.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1439999999999992e-06 2024-04-25T22:41:26.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:26.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713091+0000", 2024-04-25T22:41:26.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031910710000000002 2024-04-25T22:41:26.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:26.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713122+0000", 2024-04-25T22:41:26.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.048e-05 2024-04-25T22:41:26.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:26.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714538+0000", 2024-04-25T22:41:26.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014160030000000001 2024-04-25T22:41:26.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:26.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714627+0000", 2024-04-25T22:41:26.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518999999999995e-05 2024-04-25T22:41:26.775 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.775 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.775 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.775 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:26.775 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:26.776 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.148963801999997, 2024-04-25T22:41:26.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022089675999999999, 2024-04-25T22:41:26.776 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:26.776 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:26.776 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:26.776 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:26.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:26.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:26.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:26.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:26.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:26.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600120+0000", 2024-04-25T22:41:26.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1259999999999998e-06 2024-04-25T22:41:26.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:26.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600153+0000", 2024-04-25T22:41:26.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3186999999999999e-05 2024-04-25T22:41:26.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:26.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600181+0000", 2024-04-25T22:41:26.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7676000000000001e-05 2024-04-25T22:41:26.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:26.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600205+0000", 2024-04-25T22:41:26.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:41:26.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:26.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600467+0000", 2024-04-25T22:41:26.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026186800000000001 2024-04-25T22:41:26.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:26.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600809+0000", 2024-04-25T22:41:26.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034138400000000002 2024-04-25T22:41:26.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:26.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.601892+0000", 2024-04-25T22:41:26.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010831910000000001 2024-04-25T22:41:26.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:26.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611054+0000", 2024-04-25T22:41:26.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0091620940000000008 2024-04-25T22:41:26.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:26.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621965+0000", 2024-04-25T22:41:26.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010911044999999999 2024-04-25T22:41:26.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:26.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622090+0000", 2024-04-25T22:41:26.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012522 2024-04-25T22:41:26.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:26.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622202+0000", 2024-04-25T22:41:26.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011164500000000001 2024-04-25T22:41:26.780 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.780 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.780 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.781 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:26.781 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:26.781 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.148820747000002, 2024-04-25T22:41:26.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035756228000000001, 2024-04-25T22:41:26.781 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:26.781 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:26.781 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:26.781 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:26.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:26.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:26.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:26.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:26.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:26.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600257+0000", 2024-04-25T22:41:26.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8300000000000001e-06 2024-04-25T22:41:26.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:26.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600267+0000", 2024-04-25T22:41:26.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6539999999999994e-06 2024-04-25T22:41:26.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:26.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600293+0000", 2024-04-25T22:41:26.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5996e-05 2024-04-25T22:41:26.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:26.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600309+0000", 2024-04-25T22:41:26.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6206e-05 2024-04-25T22:41:26.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:26.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603757+0000", 2024-04-25T22:41:26.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003448244 2024-04-25T22:41:26.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:26.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604779+0000", 2024-04-25T22:41:26.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010216820000000001 2024-04-25T22:41:26.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:26.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605127+0000", 2024-04-25T22:41:26.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034820100000000002 2024-04-25T22:41:26.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:26.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611082+0000", 2024-04-25T22:41:26.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0059550640000000004 2024-04-25T22:41:26.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:26.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635779+0000", 2024-04-25T22:41:26.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024696665999999999 2024-04-25T22:41:26.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:26.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635915+0000", 2024-04-25T22:41:26.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000135809 2024-04-25T22:41:26.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:26.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636011+0000", 2024-04-25T22:41:26.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6875999999999999e-05 2024-04-25T22:41:26.786 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.786 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.786 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.786 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:26.786 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:26.786 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.148743534000005, 2024-04-25T22:41:26.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035327031000000002, 2024-04-25T22:41:26.786 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:26.786 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:26.786 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:26.787 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:26.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:26.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:26.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:26.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:26.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:26.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600334+0000", 2024-04-25T22:41:26.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:41:26.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:26.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600347+0000", 2024-04-25T22:41:26.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3593e-05 2024-04-25T22:41:26.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:26.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600371+0000", 2024-04-25T22:41:26.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.313e-05 2024-04-25T22:41:26.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:26.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600390+0000", 2024-04-25T22:41:26.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.908e-05 2024-04-25T22:41:26.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:26.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602756+0000", 2024-04-25T22:41:26.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023662560000000002 2024-04-25T22:41:26.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:26.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603021+0000", 2024-04-25T22:41:26.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026546399999999998 2024-04-25T22:41:26.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:26.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603304+0000", 2024-04-25T22:41:26.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028308800000000002 2024-04-25T22:41:26.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:26.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611075+0000", 2024-04-25T22:41:26.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077703900000000003 2024-04-25T22:41:26.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:26.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635414+0000", 2024-04-25T22:41:26.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024339326000000001 2024-04-25T22:41:26.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:26.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635544+0000", 2024-04-25T22:41:26.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012948199999999999 2024-04-25T22:41:26.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:26.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635659+0000", 2024-04-25T22:41:26.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000115809 2024-04-25T22:41:26.791 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.791 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.791 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.791 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:26.791 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:26.791 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.148583608999999, 2024-04-25T22:41:26.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035594492999999998, 2024-04-25T22:41:26.792 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:26.792 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:26.792 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:26.792 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:26.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:26.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:26.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:26.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:26.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:26.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600494+0000", 2024-04-25T22:41:26.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:41:26.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:26.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600502+0000", 2024-04-25T22:41:26.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3769999999999996e-06 2024-04-25T22:41:26.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:26.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600522+0000", 2024-04-25T22:41:26.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9919999999999999e-05 2024-04-25T22:41:26.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:26.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600539+0000", 2024-04-25T22:41:26.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.649e-05 2024-04-25T22:41:26.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:26.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604846+0000", 2024-04-25T22:41:26.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043075199999999996 2024-04-25T22:41:26.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:26.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605057+0000", 2024-04-25T22:41:26.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00021085200000000001 2024-04-25T22:41:26.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:26.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605378+0000", 2024-04-25T22:41:26.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032074799999999999 2024-04-25T22:41:26.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:26.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611089+0000", 2024-04-25T22:41:26.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057110249999999998 2024-04-25T22:41:26.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:26.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635844+0000", 2024-04-25T22:41:26.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024755355999999999 2024-04-25T22:41:26.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:26.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635986+0000", 2024-04-25T22:41:26.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141512 2024-04-25T22:41:26.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:26.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636087+0000", 2024-04-25T22:41:26.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101183 2024-04-25T22:41:26.796 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.796 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.796 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.797 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:26.797 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:26.797 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.148510998999996, 2024-04-25T22:41:26.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021266723000000001, 2024-04-25T22:41:26.797 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:26.797 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:26.797 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:26.797 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:26.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:26.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:26.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:26.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:26.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:26.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600566+0000", 2024-04-25T22:41:26.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4959999999999999e-06 2024-04-25T22:41:26.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:26.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600574+0000", 2024-04-25T22:41:26.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-06 2024-04-25T22:41:26.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:26.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600592+0000", 2024-04-25T22:41:26.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8479999999999999e-05 2024-04-25T22:41:26.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:26.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600610+0000", 2024-04-25T22:41:26.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7567e-05 2024-04-25T22:41:26.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:26.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602679+0000", 2024-04-25T22:41:26.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020692739999999999 2024-04-25T22:41:26.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:26.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602945+0000", 2024-04-25T22:41:26.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026640399999999998 2024-04-25T22:41:26.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:26.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603115+0000", 2024-04-25T22:41:26.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000169996 2024-04-25T22:41:26.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:26.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608398+0000", 2024-04-25T22:41:26.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052826289999999996 2024-04-25T22:41:26.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:26.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621588+0000", 2024-04-25T22:41:26.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013190489 2024-04-25T22:41:26.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:26.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621733+0000", 2024-04-25T22:41:26.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014462500000000001 2024-04-25T22:41:26.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:26.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621832+0000", 2024-04-25T22:41:26.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8603000000000004e-05 2024-04-25T22:41:26.801 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.802 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.802 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.802 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:26.802 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:26.802 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.148443272999998, 2024-04-25T22:41:26.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034747924999999999, 2024-04-25T22:41:26.802 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:26.802 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:26.802 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:26.802 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:26.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:26.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:26.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:26.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:26.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:26.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600634+0000", 2024-04-25T22:41:26.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-04-25T22:41:26.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:26.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600642+0000", 2024-04-25T22:41:26.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8169999999999999e-06 2024-04-25T22:41:26.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:26.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600660+0000", 2024-04-25T22:41:26.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8513e-05 2024-04-25T22:41:26.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:26.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600676+0000", 2024-04-25T22:41:26.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6019999999999999e-05 2024-04-25T22:41:26.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:26.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603748+0000", 2024-04-25T22:41:26.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030718329999999999 2024-04-25T22:41:26.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:26.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604752+0000", 2024-04-25T22:41:26.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001003603 2024-04-25T22:41:26.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:26.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605117+0000", 2024-04-25T22:41:26.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00036539 2024-04-25T22:41:26.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:26.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608459+0000", 2024-04-25T22:41:26.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033413879999999998 2024-04-25T22:41:26.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:26.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635106+0000", 2024-04-25T22:41:26.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026647607 2024-04-25T22:41:26.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:26.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635273+0000", 2024-04-25T22:41:26.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000166689 2024-04-25T22:41:26.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:26.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635381+0000", 2024-04-25T22:41:26.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107642 2024-04-25T22:41:26.807 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.807 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.807 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.807 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:26.807 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:26.807 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.148380044000007, 2024-04-25T22:41:26.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040419292000000002, 2024-04-25T22:41:26.807 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:26.807 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:26.807 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:26.808 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:26.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:26.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:26.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:26.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:26.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:26.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600697+0000", 2024-04-25T22:41:26.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1999999999999999e-06 2024-04-25T22:41:26.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:26.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600704+0000", 2024-04-25T22:41:26.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5570000000000001e-06 2024-04-25T22:41:26.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:26.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600724+0000", 2024-04-25T22:41:26.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0023000000000001e-05 2024-04-25T22:41:26.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:26.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600738+0000", 2024-04-25T22:41:26.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4372999999999999e-05 2024-04-25T22:41:26.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:26.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.612532+0000", 2024-04-25T22:41:26.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011793606 2024-04-25T22:41:26.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:26.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613354+0000", 2024-04-25T22:41:26.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00082244100000000004 2024-04-25T22:41:26.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:26.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613726+0000", 2024-04-25T22:41:26.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00037226000000000002 2024-04-25T22:41:26.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:26.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618891+0000", 2024-04-25T22:41:26.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051649199999999999 2024-04-25T22:41:26.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:26.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.640874+0000", 2024-04-25T22:41:26.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021982640000000001 2024-04-25T22:41:26.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:26.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641019+0000", 2024-04-25T22:41:26.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000145339 2024-04-25T22:41:26.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:26.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641115+0000", 2024-04-25T22:41:26.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5933000000000005e-05 2024-04-25T22:41:26.812 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.812 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.812 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.812 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:26.813 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:26.813 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.148294014000001, 2024-04-25T22:41:26.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036502711, 2024-04-25T22:41:26.813 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:26.813 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:26.813 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:26.813 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:26.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:26.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:26.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:26.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:26.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:26.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600783+0000", 2024-04-25T22:41:26.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.533e-06 2024-04-25T22:41:26.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:26.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600790+0000", 2024-04-25T22:41:26.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0439999999999998e-06 2024-04-25T22:41:26.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:26.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600811+0000", 2024-04-25T22:41:26.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0449e-05 2024-04-25T22:41:26.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:26.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600825+0000", 2024-04-25T22:41:26.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4293e-05 2024-04-25T22:41:26.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:26.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602304+0000", 2024-04-25T22:41:26.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001478629 2024-04-25T22:41:26.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:26.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602587+0000", 2024-04-25T22:41:26.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028350800000000002 2024-04-25T22:41:26.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:26.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.637285+0000", 2024-04-25T22:41:26.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034697255000000003 2024-04-25T22:41:26.816 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.816 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.816 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.816 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:26.816 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:26.816 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.148228447999998, 2024-04-25T22:41:26.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017311460000000001, 2024-04-25T22:41:26.817 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:26.817 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:26.817 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:26.817 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:26.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:26.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:26.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:26.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:26.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:26.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600849+0000", 2024-04-25T22:41:26.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2899999999999999e-06 2024-04-25T22:41:26.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:26.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600866+0000", 2024-04-25T22:41:26.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6793e-05 2024-04-25T22:41:26.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:26.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600886+0000", 2024-04-25T22:41:26.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0772999999999999e-05 2024-04-25T22:41:26.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:26.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600904+0000", 2024-04-25T22:41:26.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7697e-05 2024-04-25T22:41:26.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:26.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602796+0000", 2024-04-25T22:41:26.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018920149999999999 2024-04-25T22:41:26.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:26.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602962+0000", 2024-04-25T22:41:26.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016590600000000001 2024-04-25T22:41:26.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:26.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618159+0000", 2024-04-25T22:41:26.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015196985999999999 2024-04-25T22:41:26.820 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.820 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.820 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.820 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:26.820 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:26.820 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.133352707, 2024-04-25T22:41:26.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006380269, 2024-04-25T22:41:26.820 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:26.821 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:26.821 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:26.821 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:26.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:26.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:26.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:26.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:26.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:26.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615724+0000", 2024-04-25T22:41:26.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.094e-06 2024-04-25T22:41:26.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:26.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615734+0000", 2024-04-25T22:41:26.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.363e-06 2024-04-25T22:41:26.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:26.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615751+0000", 2024-04-25T22:41:26.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:41:26.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:26.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615773+0000", 2024-04-25T22:41:26.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.154e-05 2024-04-25T22:41:26.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:26.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616485+0000", 2024-04-25T22:41:26.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00071225100000000001 2024-04-25T22:41:26.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:26.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616528+0000", 2024-04-25T22:41:26.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3606000000000002e-05 2024-04-25T22:41:26.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:26.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622030+0000", 2024-04-25T22:41:26.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055010750000000002 2024-04-25T22:41:26.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:26.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622103+0000", 2024-04-25T22:41:26.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3930000000000005e-05 2024-04-25T22:41:26.824 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.824 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.824 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.824 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:26.825 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:26.825 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.132439770000005, 2024-04-25T22:41:26.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046420649999999999, 2024-04-25T22:41:26.825 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:26.825 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:26.825 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-04-25T22:41:26.825 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:26.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:26.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:26.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:26.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:26.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:26.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616637+0000", 2024-04-25T22:41:26.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0299999999999998e-07 2024-04-25T22:41:26.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:26.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616653+0000", 2024-04-25T22:41:26.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5843000000000001e-05 2024-04-25T22:41:26.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:26.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616690+0000", 2024-04-25T22:41:26.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7466999999999999e-05 2024-04-25T22:41:26.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:26.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616729+0000", 2024-04-25T22:41:26.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8810000000000003e-05 2024-04-25T22:41:26.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:26.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617251+0000", 2024-04-25T22:41:26.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00052143899999999995 2024-04-25T22:41:26.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:26.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621278+0000", 2024-04-25T22:41:26.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040277029999999997 2024-04-25T22:41:26.828 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.828 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.828 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.828 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:26.828 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:26.828 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.131416418000001, 2024-04-25T22:41:26.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0065101730000000002, 2024-04-25T22:41:26.828 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:26.828 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:26.828 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:26.828 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:26.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:26.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:26.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:26.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:26.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:26.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617661+0000", 2024-04-25T22:41:26.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:41:26.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:26.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617688+0000", 2024-04-25T22:41:26.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7589e-05 2024-04-25T22:41:26.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:26.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617710+0000", 2024-04-25T22:41:26.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1467e-05 2024-04-25T22:41:26.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:26.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617727+0000", 2024-04-25T22:41:26.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6990000000000002e-05 2024-04-25T22:41:26.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:26.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618559+0000", 2024-04-25T22:41:26.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083207400000000003 2024-04-25T22:41:26.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:26.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618608+0000", 2024-04-25T22:41:26.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8936e-05 2024-04-25T22:41:26.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:26.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624077+0000", 2024-04-25T22:41:26.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054695840000000004 2024-04-25T22:41:26.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:26.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624170+0000", 2024-04-25T22:41:26.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2305999999999993e-05 2024-04-25T22:41:26.832 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.832 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.832 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.832 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:26.832 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:26.832 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.126314910000005, 2024-04-25T22:41:26.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006879446, 2024-04-25T22:41:26.832 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:26.833 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:26.833 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:26.833 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:26.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:26.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:26.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:26.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:26.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:26.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622762+0000", 2024-04-25T22:41:26.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:41:26.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:26.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622781+0000", 2024-04-25T22:41:26.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8749999999999998e-05 2024-04-25T22:41:26.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:26.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622802+0000", 2024-04-25T22:41:26.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1650000000000001e-05 2024-04-25T22:41:26.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:26.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622816+0000", 2024-04-25T22:41:26.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3556e-05 2024-04-25T22:41:26.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:26.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623700+0000", 2024-04-25T22:41:26.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00088389299999999996 2024-04-25T22:41:26.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:26.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623741+0000", 2024-04-25T22:41:26.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1023999999999999e-05 2024-04-25T22:41:26.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:26.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629543+0000", 2024-04-25T22:41:26.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058023980000000003 2024-04-25T22:41:26.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:26.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629640+0000", 2024-04-25T22:41:26.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7381999999999997e-05 2024-04-25T22:41:26.836 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.836 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.836 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.836 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:26.837 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:26.837 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.126053705999993, 2024-04-25T22:41:26.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067054879999999999, 2024-04-25T22:41:26.837 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:26.837 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:26.837 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:26.837 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:26.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:26.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:26.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:26.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:26.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:26.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623032+0000", 2024-04-25T22:41:26.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.9930000000000007e-06 2024-04-25T22:41:26.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:26.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623043+0000", 2024-04-25T22:41:26.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0387000000000001e-05 2024-04-25T22:41:26.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:26.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623064+0000", 2024-04-25T22:41:26.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1849999999999999e-05 2024-04-25T22:41:26.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:26.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623079+0000", 2024-04-25T22:41:26.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4093e-05 2024-04-25T22:41:26.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:26.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624384+0000", 2024-04-25T22:41:26.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013054539999999999 2024-04-25T22:41:26.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:26.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624421+0000", 2024-04-25T22:41:26.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7088999999999997e-05 2024-04-25T22:41:26.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:26.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629645+0000", 2024-04-25T22:41:26.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052241400000000004 2024-04-25T22:41:26.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:26.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629728+0000", 2024-04-25T22:41:26.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2482000000000001e-05 2024-04-25T22:41:26.840 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.840 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.840 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.841 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2024-04-25T22:41:26.841 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:26.841 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.125970593000005, 2024-04-25T22:41:26.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078029559999999998, 2024-04-25T22:41:26.841 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:26.841 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:26.841 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:26.841 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:26.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:26.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:26.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:26.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:26.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:26.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:26.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623106+0000", 2024-04-25T22:41:26.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.64e-07 2024-04-25T22:41:26.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:26.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623141+0000", 2024-04-25T22:41:26.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4678999999999998e-05 2024-04-25T22:41:26.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623153+0000", 2024-04-25T22:41:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1759999999999999e-05 2024-04-25T22:41:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623161+0000", 2024-04-25T22:41:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8299999999999996e-06 2024-04-25T22:41:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623834+0000", 2024-04-25T22:41:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067394500000000001 2024-04-25T22:41:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:26.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623883+0000", 2024-04-25T22:41:26.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8640000000000002e-05 2024-04-25T22:41:26.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:26.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630807+0000", 2024-04-25T22:41:26.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069238859999999998 2024-04-25T22:41:26.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:26.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:26.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:26.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630908+0000", 2024-04-25T22:41:26.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101252 2024-04-25T22:41:26.844 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.844 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.845 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.845 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:26.845 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:26.845 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:26.846 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:26.847 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:26.846+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:26.948 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:26.946+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:26.976 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:26.976 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:26.977 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:26.977 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:26.991 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:27.049 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:27.050+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:27.103 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:27.103 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:27.103 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:27.103 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:27.104 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:27.116 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:27.162 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:27.160+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:27.227 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:27.227 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:27.227 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:27.227 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:27.227 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.227 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.227 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:27.227 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.629222514999995, 2024-04-25T22:41:27.227 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:27.227 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:27.228 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:27.228 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.228 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:27.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:27.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:27.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:27.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:27.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:27.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:27.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:27.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:27.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:27.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:27.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:27.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:27.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:27.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:27.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:27.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:27.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:27.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:27.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:27.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:27.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:27.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:27.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:27.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:27.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:27.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:27.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:27.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:27.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:27.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:27.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:27.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:27.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:27.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:27.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:27.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:27.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:27.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:27.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:27.233 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.233 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.233 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.233 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.233 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:27.233 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.629085258999993, 2024-04-25T22:41:27.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:27.234 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:27.234 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:27.234 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.234 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:27.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:27.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:27.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:27.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:27.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:27.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:27.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:27.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:27.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:27.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:27.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:27.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:27.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:27.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:27.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:27.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:27.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:27.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:27.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:27.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:27.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:27.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:27.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:27.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:27.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:27.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:27.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:27.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:27.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:27.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:27.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:27.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:27.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:27.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:27.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:27.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:27.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:27.239 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:27.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:27.239 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.239 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.239 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.239 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.239 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.239 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:27.239 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.628997706999996, 2024-04-25T22:41:27.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:27.239 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:27.239 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:27.240 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.240 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:27.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:27.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:27.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:27.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:27.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:27.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:27.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:27.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:27.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:27.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:27.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:27.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:27.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:27.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:27.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:27.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:27.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:27.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:27.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:27.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:27.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:27.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:27.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:27.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:27.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:27.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:27.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:27.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:27.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:27.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:27.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:27.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:27.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:27.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:27.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:27.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:27.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:27.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:27.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:27.245 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.245 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.245 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.245 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.245 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:27.245 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.628893880999996, 2024-04-25T22:41:27.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:27.246 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:27.246 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:27.246 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.246 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:27.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:27.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:27.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:27.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:27.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:27.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:27.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:27.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:27.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:27.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:27.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:27.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:27.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:27.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:27.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:27.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:27.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:27.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:27.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:27.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:27.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:27.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:27.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:27.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:27.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:27.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:27.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:27.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:27.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.250 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:27.250 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:27.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:27.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.250 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.250 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:27.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:27.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.250 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:27.250 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:27.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:27.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:27.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:27.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:27.251 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.251 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.251 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.251 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.251 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:27.251 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.628825090999996, 2024-04-25T22:41:27.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:27.251 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:27.251 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:27.252 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.252 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:27.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:27.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:27.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:27.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:27.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:27.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:27.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:27.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:27.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:27.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:27.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:27.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:27.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:27.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:27.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:27.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:27.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:27.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:27.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:27.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:27.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.255 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.255 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:27.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:27.255 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.255 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.255 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:27.255 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:27.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:27.255 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.255 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.255 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:27.255 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:27.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:27.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:27.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:27.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:27.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:27.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:27.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:27.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:27.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:27.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:27.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:27.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:27.257 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.257 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.257 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.257 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.257 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:27.257 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.628756005, 2024-04-25T22:41:27.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:27.258 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:27.258 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:27.258 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.258 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:27.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:27.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:27.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:27.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:27.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:27.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:27.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:27.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:27.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:27.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:27.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:27.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:27.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:27.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:27.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:27.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:27.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:27.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:27.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:27.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:27.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.261 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:27.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:27.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:27.261 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:27.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:27.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:27.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:27.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:27.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:27.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:27.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:27.263 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.263 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.263 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.263 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.264 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:27.264 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.628659892000002, 2024-04-25T22:41:27.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:27.264 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:27.264 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:27.264 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:27.264 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:27.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:27.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:27.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:27.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:27.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:27.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:27.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:27.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:27.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:27.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:27.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:27.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:27.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:27.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:27.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:27.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:27.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:27.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.267 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:27.267 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:27.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:27.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.267 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.267 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:27.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:27.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.267 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:27.267 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:27.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:27.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.268 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:27.268 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:27.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:27.268 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.268 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.268 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.268 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.268 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:27.268 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.628594230000004, 2024-04-25T22:41:27.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:27.269 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:27.269 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:27.269 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:27.269 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:27.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:27.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:27.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:27.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:27.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:27.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:27.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:27.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:27.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:27.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:27.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:27.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:27.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:27.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:27.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:27.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:27.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:27.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:27.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:27.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:27.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.272 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.272 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:27.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:27.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.272 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:27.272 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:27.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:27.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.272 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:27.272 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:27.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:27.273 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.273 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.273 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.273 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.273 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:27.273 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.628525103000001, 2024-04-25T22:41:27.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:27.273 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:27.273 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:27.273 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:27.273 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:27.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:27.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:27.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.274 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.274 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:27.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:27.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.274 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.274 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:27.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:27.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:27.274 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:27.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:27.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:27.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:27.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:27.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:27.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:27.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:27.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:27.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:27.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:27.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:27.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:27.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:27.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:27.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:27.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:27.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:27.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:27.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:27.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:27.277 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.277 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.277 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.277 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:27.278 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:27.278 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.617708446999998, 2024-04-25T22:41:27.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:27.278 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:27.278 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:27.278 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:27.278 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:27.278 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.278 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:27.278 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:27.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.278 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.278 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.279 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:27.279 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:27.279 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.279 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:27.279 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:27.279 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:27.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.279 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:27.279 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:27.279 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:27.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.280 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:27.280 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:27.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:27.280 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.280 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.280 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.280 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:27.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:27.280 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.280 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.280 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.280 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:27.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:27.280 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.281 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:27.281 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:27.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:27.281 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.281 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.281 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.281 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.281 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:27.281 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:27.281 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.600810093999996, 2024-04-25T22:41:27.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:27.281 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:27.282 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:27.282 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:27.282 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:27.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:27.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:27.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:27.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:27.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:27.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:27.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:27.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:27.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:27.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:27.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:27.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:27.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:27.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.284 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.284 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:27.284 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:27.284 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.284 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.284 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.284 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:27.284 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:27.284 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.284 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.284 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:27.284 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:27.284 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:27.284 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.285 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.285 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:27.285 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:27.285 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:27.285 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.285 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.285 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.285 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.285 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.285 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:27.285 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:27.285 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.599989203999996, 2024-04-25T22:41:27.285 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:27.285 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:27.285 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:27.286 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:27.286 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:27.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.286 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:27.286 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:27.286 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.286 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.286 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:27.286 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:27.286 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.286 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.286 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:27.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:27.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:27.287 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.287 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:27.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:27.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:27.287 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.287 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:27.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:27.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:27.287 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.287 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.288 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:27.288 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:27.288 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.288 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.288 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.288 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:27.288 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:27.288 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.288 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.288 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:27.288 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:27.288 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:27.288 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.288 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.288 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:27.289 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:27.289 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:27.289 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.289 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.289 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.289 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.289 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.289 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:27.289 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:27.289 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.598288475999993, 2024-04-25T22:41:27.289 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:27.289 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:27.289 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:27.289 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.290 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:27.290 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.290 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:27.290 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:27.290 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.290 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.290 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.290 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:27.290 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:27.290 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.290 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.290 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.290 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:27.290 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:27.290 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:27.291 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.291 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.291 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:27.291 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:27.291 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:27.291 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.291 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.291 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:27.291 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:27.291 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:27.291 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.291 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.291 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.291 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:27.292 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:27.292 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.292 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.292 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.292 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:27.292 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:27.292 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.292 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.292 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:27.292 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:27.292 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:27.292 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.292 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.292 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:27.292 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:27.293 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:27.293 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.293 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.293 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:27.293 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:27.293 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:27.293 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.293 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.293 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.293 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.293 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.293 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:27.293 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:27.293 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.597691800999996, 2024-04-25T22:41:27.293 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:27.294 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:27.294 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:27.294 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.294 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:27.294 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.294 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:27.294 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:27.294 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.294 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.294 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.294 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:27.294 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:27.294 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.295 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.295 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.295 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:27.295 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:27.295 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:27.295 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.295 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.295 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:27.295 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:27.295 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:27.295 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.295 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.295 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:27.295 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:27.295 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:27.296 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.296 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.296 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.296 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:27.296 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:27.296 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.296 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.296 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.296 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:27.296 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:27.296 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.296 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.296 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:27.296 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:27.296 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:27.297 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.297 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.297 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:27.297 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:27.297 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:27.297 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.297 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.297 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:27.297 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:27.297 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:27.297 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.297 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.297 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.297 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.298 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.298 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:27.298 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:27.298 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.588256075000004, 2024-04-25T22:41:27.298 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:27.298 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:27.298 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:27.298 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:27.298 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:27.298 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.298 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:27.298 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:27.298 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.298 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.298 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.299 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:27.299 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:27.299 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.299 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.299 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.299 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:27.299 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:27.299 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:27.299 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.299 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.299 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:27.299 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:27.299 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:27.299 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.300 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.300 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:27.300 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:27.300 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:27.300 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.300 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.300 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.300 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:27.300 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:27.300 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.300 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.300 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.300 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:27.300 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:27.300 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.301 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.301 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:27.301 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:27.301 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:27.301 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.301 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.301 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.301 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.301 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.301 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:27.301 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:27.301 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.587608649000003, 2024-04-25T22:41:27.301 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:27.301 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:27.301 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:27.302 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.302 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:27.302 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.302 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:27.302 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:27.302 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.302 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.302 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.302 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:27.302 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:27.302 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.302 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.302 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.302 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:27.302 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:27.303 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:27.303 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.303 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.303 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:27.303 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:27.303 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:27.303 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.303 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.303 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:27.303 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:27.303 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:27.303 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.303 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.303 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.304 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:27.304 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:27.304 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.304 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.304 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.304 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:27.304 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:27.304 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.304 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.304 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:27.304 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:27.304 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:27.304 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.304 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.304 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:27.305 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:27.305 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:27.305 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.305 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.305 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:27.305 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:27.305 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:27.305 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.305 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.305 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.305 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.305 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.305 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:27.305 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:27.305 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.586167829999994, 2024-04-25T22:41:27.305 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:27.306 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:27.306 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:27.306 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.306 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:27.306 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.306 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:27.306 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:27.306 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.306 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.306 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.306 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:27.306 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:27.306 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.306 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.307 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.307 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:27.307 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:27.307 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:27.307 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.307 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.307 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:27.307 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:27.307 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:27.307 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.307 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.307 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:27.307 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:27.307 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:27.307 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.308 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.308 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.308 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:27.308 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:27.308 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.308 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.308 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.308 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:27.308 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:27.308 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.308 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.308 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:27.308 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:27.308 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:27.309 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.309 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.309 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:27.309 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:27.309 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:27.309 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.309 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.309 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:27.309 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:27.309 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:27.309 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.309 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.309 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.309 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.309 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.310 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:27.310 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:27.310 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 70.633729385999999, 2024-04-25T22:41:27.310 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:27.310 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:27.310 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:27.310 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.310 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:27.310 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.310 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:27.310 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:27.310 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.310 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.310 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.311 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:27.311 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:27.311 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.311 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.311 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.311 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:27.311 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:27.311 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:27.311 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.311 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.311 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:27.311 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:27.311 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:27.311 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.311 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.312 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:27.312 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:27.312 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:27.312 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.312 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.312 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.312 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:27.312 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:27.312 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.312 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.312 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.312 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:27.312 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:27.312 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.312 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.313 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:27.313 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:27.313 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:27.313 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.313 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.313 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:27.313 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:27.313 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:27.313 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.313 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.313 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:27.313 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:27.313 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:27.313 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.313 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.314 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.314 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:27.314 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:27.314 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.314 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.314 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:27.314 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:27.314 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:27.314 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.314 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.314 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:27.314 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:27.314 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:27.314 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.315 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.315 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.315 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.315 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.315 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:27.315 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:27.315 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 48.631070061999999, 2024-04-25T22:41:27.315 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:27.315 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:27.315 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:27.315 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.315 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:27.315 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.315 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:27.315 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:27.316 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.316 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.316 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.316 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:27.316 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:27.316 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.316 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.316 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.316 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:27.316 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:27.316 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:27.316 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.316 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.316 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:27.317 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:27.317 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:27.317 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.317 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.317 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:27.317 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:27.317 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:27.317 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.317 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.317 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.317 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:27.317 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:27.317 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.317 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.317 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.318 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:27.318 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:27.318 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.318 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.318 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:27.318 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:27.318 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:27.318 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.318 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.318 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:27.318 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:27.318 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:27.318 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.318 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.319 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:27.319 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:27.319 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:27.319 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.319 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.319 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.319 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:27.319 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:27.319 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.319 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.319 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:27.319 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:27.319 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:27.319 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.319 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.320 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:27.320 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:27.320 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:27.320 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.320 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.320 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.320 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.320 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.320 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:27.320 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:27.320 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 43.630777811000002, 2024-04-25T22:41:27.320 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:27.320 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:27.320 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:27.320 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.321 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:27.321 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.321 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:27.321 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:27.321 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.321 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.321 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.321 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:27.321 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:27.321 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:27.321 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.321 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.321 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:27.321 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:27.321 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:27.322 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.322 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.322 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:27.322 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:27.322 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:27.322 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.322 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.322 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:27.322 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:27.322 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:27.322 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.322 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.322 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.322 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:27.323 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:27.323 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.323 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.323 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:27.323 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:27.323 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:27.323 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.323 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.323 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:27.323 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:27.323 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:27.323 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.323 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.323 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:27.323 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:27.324 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:27.324 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.324 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.324 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:27.324 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:27.324 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:27.324 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.324 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.324 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.324 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:27.324 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:27.324 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.324 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.324 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:27.324 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:27.325 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:27.325 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:27.325 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:27.325 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:27.325 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:27.325 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:27.325 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.325 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.325 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.325 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:27.325 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:27.325 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:27.327 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is set 2024-04-25T22:41:27.328 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:27.324+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:27.328 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:27.428 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:27.426+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:27.460 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:27.460 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:27.460 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:41:27.460 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:27.476 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:27.529 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:27.524+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:27.594 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:27.594 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:27.594 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:27.594 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:27.594 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:27.609 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:27.630 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:27.626+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:27.731 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:27.730+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:27.734 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:27.734 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:41:27.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:41:27.734 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:41:27.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.734 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.735 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:27.735 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.137891748000001, 2024-04-25T22:41:27.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:41:27.735 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:27.735 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:27.735 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.735 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:27.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:27.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:27.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:27.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:27.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:27.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:41:27.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:41:27.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:27.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:41:27.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:41:27.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:27.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:41:27.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:41:27.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:41:27.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:41:27.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:41:27.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:41:27.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:27.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:41:27.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:41:27.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:41:27.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:41:27.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:27.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:41:27.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:41:27.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:27.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:41:27.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:41:27.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:41:27.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:41:27.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:27.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:41:27.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:41:27.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:27.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:41:27.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:41:27.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:27.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:41:27.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:41:27.740 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.740 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.740 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.740 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.740 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:27.741 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.137803735000006, 2024-04-25T22:41:27.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:41:27.741 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:27.741 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:27.741 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.741 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:27.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:27.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:27.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:27.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:27.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:27.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:41:27.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:41:27.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:27.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:27.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:41:27.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:27.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:41:27.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:41:27.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:41:27.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:41:27.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:41:27.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:41:27.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:27.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:27.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:41:27.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:41:27.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:41:27.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:27.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:41:27.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:41:27.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:27.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:41:27.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:41:27.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:27.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:41:27.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:41:27.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:41:27.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:41:27.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:27.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:41:27.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:41:27.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:27.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:41:27.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:41:27.746 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.746 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.746 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.746 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.746 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:27.746 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.137731613, 2024-04-25T22:41:27.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:41:27.746 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:27.746 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:27.747 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.747 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:27.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:27.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:27.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:27.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:27.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:27.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:41:27.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:41:27.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:27.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:41:27.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:41:27.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:27.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:41:27.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:41:27.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:41:27.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:41:27.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:41:27.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:41:27.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:27.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:41:27.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:41:27.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:41:27.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:41:27.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:27.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:41:27.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:41:27.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:27.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:41:27.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:41:27.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:41:27.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:41:27.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:27.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:41:27.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:41:27.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:27.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:41:27.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:41:27.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:27.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:41:27.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:41:27.752 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.752 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.752 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.752 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.752 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:27.752 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.137623300000001, 2024-04-25T22:41:27.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:41:27.752 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:27.752 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:27.752 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.752 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:27.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:27.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:27.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:27.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:27.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:27.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:41:27.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:41:27.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:27.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:41:27.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:41:27.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:27.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:41:27.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:41:27.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:41:27.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:41:27.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:41:27.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:41:27.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:27.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:41:27.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:41:27.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:41:27.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:41:27.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:27.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:41:27.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:41:27.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:27.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:41:27.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:41:27.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:41:27.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:41:27.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:27.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:41:27.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:41:27.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:27.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:41:27.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:41:27.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:27.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:41:27.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:41:27.757 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.757 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.758 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.758 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.758 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:27.758 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.137556644, 2024-04-25T22:41:27.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:41:27.758 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:27.758 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:27.758 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.758 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:27.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:27.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:27.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:27.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:27.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:27.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:41:27.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:41:27.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:27.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:41:27.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:41:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:41:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:41:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:41:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:41:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:41:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:41:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:41:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:41:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:41:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:41:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:41:27.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:41:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:41:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:41:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:41:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:41:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:27.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:41:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:41:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:41:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:41:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:41:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:41:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.137466047999993, 2024-04-25T22:41:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:41:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:41:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:41:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:41:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:41:27.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:41:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:41:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:41:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:41:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:41:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:41:27.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:27.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:41:27.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:41:27.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:41:27.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:41:27.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:27.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:41:27.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:41:27.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:27.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:41:27.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:41:27.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:27.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:41:27.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:41:27.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:41:27.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:41:27.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:27.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:41:27.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:41:27.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:27.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:41:27.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:41:27.769 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.769 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.769 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.769 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.769 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:27.770 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.137401475000004, 2024-04-25T22:41:27.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:41:27.770 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:27.770 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:27.770 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.770 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:27.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:27.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:27.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:27.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:27.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:27.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:41:27.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:41:27.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:27.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:41:27.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:41:27.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:27.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:41:27.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:41:27.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:41:27.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:41:27.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:27.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:41:27.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:27.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:41:27.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:41:27.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:41:27.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:41:27.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:27.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:41:27.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:41:27.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:27.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:41:27.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:41:27.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:41:27.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:41:27.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:27.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:41:27.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:41:27.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:27.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:41:27.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:41:27.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:27.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:41:27.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:41:27.775 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.775 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.775 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.775 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.775 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:27.775 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.137336051999995, 2024-04-25T22:41:27.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:41:27.775 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:27.776 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:27.776 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.776 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:27.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:27.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:27.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:27.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:27.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:27.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:41:27.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:27.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:27.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:41:27.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:41:27.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:27.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:41:27.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:41:27.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:41:27.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:41:27.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:41:27.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:41:27.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:27.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:41:27.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:41:27.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:41:27.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:41:27.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:27.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:41:27.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:41:27.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:27.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:41:27.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:41:27.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:27.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:41:27.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:41:27.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:41:27.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:41:27.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:27.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:41:27.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:41:27.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:27.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:41:27.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:41:27.781 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.781 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.781 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.781 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.781 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:27.781 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.137279985999996, 2024-04-25T22:41:27.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:41:27.781 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:27.781 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:27.782 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.782 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:27.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:27.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:27.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:27.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:27.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:27.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:27.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:41:27.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:27.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:41:27.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:41:27.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:27.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:41:27.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:41:27.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:41:27.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:41:27.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:41:27.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:41:27.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:27.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:41:27.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:41:27.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:41:27.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:41:27.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:27.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:41:27.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:41:27.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:27.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:41:27.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:41:27.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:41:27.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:41:27.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:27.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:41:27.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:41:27.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:27.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:41:27.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:41:27.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:27.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:41:27.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:41:27.787 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.787 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.787 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.787 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.787 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:27.787 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.137212880000007, 2024-04-25T22:41:27.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:41:27.787 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:27.787 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:27.787 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.788 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:27.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:27.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:27.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:27.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:27.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:27.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:41:27.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:41:27.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:27.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:41:27.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:41:27.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:27.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:41:27.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:41:27.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:41:27.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:41:27.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:41:27.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:41:27.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:27.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:41:27.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:41:27.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:41:27.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:41:27.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:27.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:41:27.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:41:27.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:27.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:41:27.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:41:27.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:41:27.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:41:27.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:27.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:41:27.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:41:27.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:27.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:41:27.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:41:27.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:27.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:41:27.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:41:27.793 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.793 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.793 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.793 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.793 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:27.793 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.137157756999997, 2024-04-25T22:41:27.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:41:27.793 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:27.793 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:27.793 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.793 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:27.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:27.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:27.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:27.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:27.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:27.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:41:27.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:27.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:27.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:41:27.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:41:27.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:27.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:41:27.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:41:27.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:41:27.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:41:27.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:41:27.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:41:27.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:27.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:41:27.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:41:27.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:41:27.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:41:27.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:27.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:41:27.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:41:27.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:27.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:41:27.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:41:27.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:41:27.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:41:27.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:27.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:41:27.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:41:27.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:27.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:41:27.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:41:27.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:27.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:41:27.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:41:27.798 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.798 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.799 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.799 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.799 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:27.799 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.137055517999997, 2024-04-25T22:41:27.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:41:27.799 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:27.799 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:27.799 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.799 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:27.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:27.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:27.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:27.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:27.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:27.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:41:27.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:41:27.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:27.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:41:27.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:41:27.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:27.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:41:27.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:41:27.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:41:27.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:41:27.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:41:27.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:41:27.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:27.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:41:27.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:41:27.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:41:27.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:41:27.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:27.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:41:27.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:41:27.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:27.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:41:27.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:41:27.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:41:27.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:41:27.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:27.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:41:27.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:41:27.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:27.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:41:27.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:41:27.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:27.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:41:27.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:41:27.804 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.804 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.804 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.805 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.805 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:27.805 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.136996694999993, 2024-04-25T22:41:27.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:41:27.805 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:27.805 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:27.805 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.805 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:27.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:27.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:27.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:27.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:27.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:27.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:41:27.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:41:27.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:27.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:41:27.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:41:27.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:27.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:41:27.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:41:27.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:41:27.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:41:27.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:41:27.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:41:27.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:27.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:41:27.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:41:27.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:41:27.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:41:27.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:27.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:41:27.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:41:27.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:27.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:41:27.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:41:27.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:27.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:41:27.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:41:27.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:41:27.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:41:27.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:27.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:41:27.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:41:27.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:27.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:41:27.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:41:27.810 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.810 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.810 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.810 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.810 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:27.811 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.136917961999998, 2024-04-25T22:41:27.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:41:27.811 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:27.811 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:27.811 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.811 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:27.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:27.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:27.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:27.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:27.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:27.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:41:27.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:27.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:27.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:41:27.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:41:27.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:27.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:41:27.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:41:27.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:41:27.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:41:27.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:41:27.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:41:27.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:27.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:41:27.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:41:27.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:41:27.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:41:27.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:27.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:41:27.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:41:27.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:27.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:41:27.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:41:27.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:27.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:41:27.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:41:27.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:41:27.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:41:27.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:27.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:41:27.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:41:27.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:27.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:41:27.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:41:27.816 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.816 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.816 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.816 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.816 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:27.816 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.136878549000002, 2024-04-25T22:41:27.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:41:27.817 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:27.817 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:27.817 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.817 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:27.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:27.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:27.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:27.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:27.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:27.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:41:27.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:41:27.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:27.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:41:27.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:41:27.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:27.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:41:27.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:41:27.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:41:27.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:41:27.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:41:27.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:41:27.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:27.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:41:27.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:41:27.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:41:27.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:41:27.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:27.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:41:27.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:41:27.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:27.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:41:27.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:41:27.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:41:27.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:41:27.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:27.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:41:27.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:41:27.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:27.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:41:27.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:41:27.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:27.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:41:27.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:41:27.822 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.822 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.822 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.822 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.822 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:27.822 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.136808703, 2024-04-25T22:41:27.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:41:27.822 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:27.822 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:27.822 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.823 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:27.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:27.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:27.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:27.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:27.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:27.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:41:27.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:41:27.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:27.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:41:27.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:41:27.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:27.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:41:27.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:41:27.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:41:27.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:41:27.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:41:27.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:41:27.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:27.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:41:27.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:41:27.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:41:27.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:41:27.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:27.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:41:27.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:41:27.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:27.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:41:27.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:41:27.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:41:27.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:41:27.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:27.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:41:27.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:41:27.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:27.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:41:27.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:41:27.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:27.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:41:27.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:41:27.828 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.828 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.828 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.828 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.828 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:27.828 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.136758966000002, 2024-04-25T22:41:27.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:41:27.828 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:27.828 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:27.828 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.828 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:27.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:27.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:27.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:27.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:27.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:27.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:41:27.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:27.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:27.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:41:27.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:41:27.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:27.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:41:27.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:41:27.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:41:27.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:41:27.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:41:27.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:41:27.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:27.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:41:27.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:41:27.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:41:27.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:41:27.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:27.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:41:27.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:41:27.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:27.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:41:27.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:41:27.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:27.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:41:27.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:41:27.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:41:27.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:41:27.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:27.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:27.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:41:27.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:27.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:41:27.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:41:27.833 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.834 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.834 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.834 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.834 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:27.834 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.136674350999996, 2024-04-25T22:41:27.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:41:27.834 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:27.834 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:27.834 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.834 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:27.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:27.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:27.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:27.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:27.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:27.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:41:27.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:27.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:27.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:41:27.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:41:27.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:27.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:41:27.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:41:27.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:41:27.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:41:27.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:41:27.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:41:27.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:27.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:41:27.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:41:27.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:41:27.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:41:27.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:27.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:41:27.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:41:27.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:27.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:41:27.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:41:27.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:27.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:41:27.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:41:27.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:27.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:41:27.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:41:27.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:27.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:41:27.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:41:27.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:27.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:41:27.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:41:27.839 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.839 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.839 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.840 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:27.840 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:27.840 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.136610700999995, 2024-04-25T22:41:27.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:41:27.840 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:27.840 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:27.840 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:41:27.840 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:27.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:27.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:27.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:27.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:27.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:27.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:41:27.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:41:27.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:27.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:41:27.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:41:27.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:27.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:41:27.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:41:27.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:41:27.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:41:27.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:41:27.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:41:27.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:27.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:41:27.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:41:27.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:41:27.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:41:27.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:27.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:41:27.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:41:27.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:27.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:41:27.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:41:27.844 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.844 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.844 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.844 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:27.844 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:27.844 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.129607171000004, 2024-04-25T22:41:27.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:41:27.844 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:27.844 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:27.845 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:27.845 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:27.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:27.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:27.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:27.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:27.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:27.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:27.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:41:27.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:41:27.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:27.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:41:27.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:41:27.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:27.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:41:27.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:41:27.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:27.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:41:27.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:41:27.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:27.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:41:27.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:41:27.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:27.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:41:27.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:41:27.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:27.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:41:27.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:41:27.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:27.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:27.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:27.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:41:27.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:41:27.848 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.848 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.848 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.848 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:27.848 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:27.848 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:27.850 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:41:27.850 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:27.850+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:27.951 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:27.950+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:27.982 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:27.982 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:41:27.982 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-04-25T22:41:27.982 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:27.996 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:41:28.052 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:28.050+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:28.119 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:41:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-04-25T22:41:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-04-25T22:41:28.119 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:28.133 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:41:28.155 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:28.152+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:28.256 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:28.254+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:28.300 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:41:28.300 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-04-25T22:41:28.300 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-04-25T22:41:28.300 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-04-25T22:41:28.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.300 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:111 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'73, mlcod=11'69)", 2024-04-25T22:41:28.301 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:28.301 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 83.598403130999998, 2024-04-25T22:41:28.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055481899999999997, 2024-04-25T22:41:28.301 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:28.301 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:28.301 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.301 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:28.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:28.301 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:28.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:28.301 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700270+0000", 2024-04-25T22:41:28.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:28.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700271+0000", 2024-04-25T22:41:28.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:41:28.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:28.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700278+0000", 2024-04-25T22:41:28.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-04-25T22:41:28.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:28.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700323+0000", 2024-04-25T22:41:28.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4212999999999998e-05 2024-04-25T22:41:28.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.303 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700333+0000", 2024-04-25T22:41:28.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0433e-05 2024-04-25T22:41:28.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.303 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:28.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700662+0000", 2024-04-25T22:41:28.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032862800000000003 2024-04-25T22:41:28.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.303 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:28.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700692+0000", 2024-04-25T22:41:28.304 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0395999999999998e-05 2024-04-25T22:41:28.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.304 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:28.304 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705728+0000", 2024-04-25T22:41:28.304 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050361939999999999 2024-04-25T22:41:28.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.304 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:28.304 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705818+0000", 2024-04-25T22:41:28.304 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9573000000000005e-05 2024-04-25T22:41:28.304 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.304 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.304 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.305 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:112 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'74, mlcod=11'69)", 2024-04-25T22:41:28.305 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:28.305 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 83.597858278999993, 2024-04-25T22:41:28.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.005065501, 2024-04-25T22:41:28.305 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:28.305 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:28.305 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.305 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:28.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:28.305 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:28.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:28.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700814+0000", 2024-04-25T22:41:28.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:28.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700816+0000", 2024-04-25T22:41:28.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.24e-06 2024-04-25T22:41:28.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:28.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700914+0000", 2024-04-25T22:41:28.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8057e-05 2024-04-25T22:41:28.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.307 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:28.307 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700931+0000", 2024-04-25T22:41:28.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7745999999999999e-05 2024-04-25T22:41:28.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.307 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.307 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.700941+0000", 2024-04-25T22:41:28.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5699999999999999e-06 2024-04-25T22:41:28.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.307 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:28.307 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701162+0000", 2024-04-25T22:41:28.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000221392 2024-04-25T22:41:28.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:28.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.701194+0000", 2024-04-25T22:41:28.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1745999999999997e-05 2024-04-25T22:41:28.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:28.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705821+0000", 2024-04-25T22:41:28.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046269869999999999 2024-04-25T22:41:28.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:28.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.705880+0000", 2024-04-25T22:41:28.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8763e-05 2024-04-25T22:41:28.308 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.308 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.309 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.309 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:118 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'80, mlcod=11'78)", 2024-04-25T22:41:28.309 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:28.309 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 83.590502669000003, 2024-04-25T22:41:28.309 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047806089999999999, 2024-04-25T22:41:28.309 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:28.309 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:28.309 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.309 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:28.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:28.309 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:28.309 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.310 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:28.310 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708170+0000", 2024-04-25T22:41:28.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.310 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:28.310 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708172+0000", 2024-04-25T22:41:28.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0600000000000002e-06 2024-04-25T22:41:28.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.310 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:28.310 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708291+0000", 2024-04-25T22:41:28.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118892 2024-04-25T22:41:28.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:28.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708320+0000", 2024-04-25T22:41:28.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8822999999999998e-05 2024-04-25T22:41:28.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708337+0000", 2024-04-25T22:41:28.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7586999999999999e-05 2024-04-25T22:41:28.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:28.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708512+0000", 2024-04-25T22:41:28.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017439500000000001 2024-04-25T22:41:28.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.312 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:28.312 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.708551+0000", 2024-04-25T22:41:28.312 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.909e-05 2024-04-25T22:41:28.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.312 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:28.312 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712865+0000", 2024-04-25T22:41:28.312 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043142069999999996 2024-04-25T22:41:28.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.312 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:28.312 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.712951+0000", 2024-04-25T22:41:28.312 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5555000000000003e-05 2024-04-25T22:41:28.312 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.313 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.313 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.313 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.313 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.313 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:120 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'82, mlcod=11'78)", 2024-04-25T22:41:28.313 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:28.313 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 83.589496627000003, 2024-04-25T22:41:28.313 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0047170700000000003, 2024-04-25T22:41:28.313 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:28.313 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:28.313 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.313 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:28.313 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.313 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:28.313 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:28.314 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.314 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:28.314 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709176+0000", 2024-04-25T22:41:28.314 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.314 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:28.314 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709177+0000", 2024-04-25T22:41:28.314 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.19e-06 2024-04-25T22:41:28.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.314 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:28.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709315+0000", 2024-04-25T22:41:28.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000137429 2024-04-25T22:41:28.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.315 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:28.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709341+0000", 2024-04-25T22:41:28.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6556000000000001e-05 2024-04-25T22:41:28.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.315 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709353+0000", 2024-04-25T22:41:28.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2027e-05 2024-04-25T22:41:28.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.315 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:28.316 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710040+0000", 2024-04-25T22:41:28.316 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00068710799999999997 2024-04-25T22:41:28.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.316 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:28.316 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.710076+0000", 2024-04-25T22:41:28.316 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5982999999999998e-05 2024-04-25T22:41:28.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.316 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:28.316 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713802+0000", 2024-04-25T22:41:28.316 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037255750000000001 2024-04-25T22:41:28.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.317 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:28.317 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713893+0000", 2024-04-25T22:41:28.317 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1201999999999999e-05 2024-04-25T22:41:28.317 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.317 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.317 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.317 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4170.0:121 1.0 e11/10 1:30306672:devicehealth::main.db.0000000000000000:head v 11'83, mlcod=11'78)", 2024-04-25T22:41:28.317 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:28.317 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 83.588949991000007, 2024-04-25T22:41:28.317 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0049043919999999996, 2024-04-25T22:41:28.317 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:28.317 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:28.317 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.318 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:28.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:28.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:28.318 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:28.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709723+0000", 2024-04-25T22:41:28.318 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:28.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709724+0000", 2024-04-25T22:41:28.319 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.483e-06 2024-04-25T22:41:28.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.319 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:28.319 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709872+0000", 2024-04-25T22:41:28.319 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000147446 2024-04-25T22:41:28.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.319 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:28.319 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709891+0000", 2024-04-25T22:41:28.319 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9245999999999998e-05 2024-04-25T22:41:28.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.319 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.319 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.709900+0000", 2024-04-25T22:41:28.320 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1439999999999992e-06 2024-04-25T22:41:28.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.320 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:28.320 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713091+0000", 2024-04-25T22:41:28.320 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031910710000000002 2024-04-25T22:41:28.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.320 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:28.320 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.713122+0000", 2024-04-25T22:41:28.320 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.048e-05 2024-04-25T22:41:28.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.320 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:28.320 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714538+0000", 2024-04-25T22:41:28.321 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014160030000000001 2024-04-25T22:41:28.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.321 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:28.321 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:04.714627+0000", 2024-04-25T22:41:28.321 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9518999999999995e-05 2024-04-25T22:41:28.321 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.321 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.321 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.321 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:28.321 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:28.321 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.698560611000005, 2024-04-25T22:41:28.321 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022089675999999999, 2024-04-25T22:41:28.322 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:28.322 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:28.322 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.322 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:28.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.322 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:28.322 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:28.322 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.322 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:28.322 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600112+0000", 2024-04-25T22:41:28.322 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.322 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.323 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:28.323 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600120+0000", 2024-04-25T22:41:28.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1259999999999998e-06 2024-04-25T22:41:28.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.323 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:28.323 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600153+0000", 2024-04-25T22:41:28.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3186999999999999e-05 2024-04-25T22:41:28.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.323 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:28.323 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600181+0000", 2024-04-25T22:41:28.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7676000000000001e-05 2024-04-25T22:41:28.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.323 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600205+0000", 2024-04-25T22:41:28.324 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4239999999999998e-05 2024-04-25T22:41:28.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.324 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:28.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600467+0000", 2024-04-25T22:41:28.324 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026186800000000001 2024-04-25T22:41:28.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.324 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:28.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600809+0000", 2024-04-25T22:41:28.324 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034138400000000002 2024-04-25T22:41:28.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:28.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.601892+0000", 2024-04-25T22:41:28.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010831910000000001 2024-04-25T22:41:28.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:28.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611054+0000", 2024-04-25T22:41:28.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0091620940000000008 2024-04-25T22:41:28.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:28.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621965+0000", 2024-04-25T22:41:28.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010911044999999999 2024-04-25T22:41:28.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:28.326 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622090+0000", 2024-04-25T22:41:28.326 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012522 2024-04-25T22:41:28.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.326 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:28.326 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622202+0000", 2024-04-25T22:41:28.326 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011164500000000001 2024-04-25T22:41:28.326 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.326 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.326 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.326 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:28.326 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:28.327 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.698417555999995, 2024-04-25T22:41:28.327 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035756228000000001, 2024-04-25T22:41:28.327 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:28.327 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:28.327 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.327 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:28.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.327 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:28.327 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:28.327 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.327 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:28.327 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600255+0000", 2024-04-25T22:41:28.327 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.328 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:28.328 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600257+0000", 2024-04-25T22:41:28.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8300000000000001e-06 2024-04-25T22:41:28.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.328 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:28.328 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600267+0000", 2024-04-25T22:41:28.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6539999999999994e-06 2024-04-25T22:41:28.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.328 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:28.328 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600293+0000", 2024-04-25T22:41:28.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5996e-05 2024-04-25T22:41:28.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.329 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.329 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600309+0000", 2024-04-25T22:41:28.329 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6206e-05 2024-04-25T22:41:28.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.329 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:28.329 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603757+0000", 2024-04-25T22:41:28.329 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003448244 2024-04-25T22:41:28.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.329 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:28.329 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604779+0000", 2024-04-25T22:41:28.329 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0010216820000000001 2024-04-25T22:41:28.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.330 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:28.330 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605127+0000", 2024-04-25T22:41:28.330 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00034820100000000002 2024-04-25T22:41:28.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.330 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.330 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:28.330 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611082+0000", 2024-04-25T22:41:28.330 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0059550640000000004 2024-04-25T22:41:28.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.330 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.330 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:28.330 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635779+0000", 2024-04-25T22:41:28.330 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024696665999999999 2024-04-25T22:41:28.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.331 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:28.331 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635915+0000", 2024-04-25T22:41:28.331 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000135809 2024-04-25T22:41:28.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.331 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:28.331 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636011+0000", 2024-04-25T22:41:28.331 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6875999999999999e-05 2024-04-25T22:41:28.331 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.331 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.331 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.331 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:28.332 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:28.332 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.698340342999998, 2024-04-25T22:41:28.332 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035327031000000002, 2024-04-25T22:41:28.332 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:28.332 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:28.332 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.332 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:28.332 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.332 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:28.332 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:28.332 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.332 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.332 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:28.332 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600332+0000", 2024-04-25T22:41:28.333 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.333 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.333 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.333 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:28.333 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600334+0000", 2024-04-25T22:41:28.333 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4130000000000001e-06 2024-04-25T22:41:28.333 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.333 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.333 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:28.333 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600347+0000", 2024-04-25T22:41:28.333 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3593e-05 2024-04-25T22:41:28.333 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.333 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.333 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:28.333 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600371+0000", 2024-04-25T22:41:28.333 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.313e-05 2024-04-25T22:41:28.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.334 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.334 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600390+0000", 2024-04-25T22:41:28.334 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.908e-05 2024-04-25T22:41:28.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.334 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:28.334 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602756+0000", 2024-04-25T22:41:28.334 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023662560000000002 2024-04-25T22:41:28.334 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.334 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.334 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:28.334 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603021+0000", 2024-04-25T22:41:28.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026546399999999998 2024-04-25T22:41:28.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.335 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:28.335 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603304+0000", 2024-04-25T22:41:28.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028308800000000002 2024-04-25T22:41:28.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.335 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:28.335 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611075+0000", 2024-04-25T22:41:28.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0077703900000000003 2024-04-25T22:41:28.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.335 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:28.335 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635414+0000", 2024-04-25T22:41:28.335 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024339326000000001 2024-04-25T22:41:28.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.336 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.336 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:28.336 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635544+0000", 2024-04-25T22:41:28.336 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012948199999999999 2024-04-25T22:41:28.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.336 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.336 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:28.336 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635659+0000", 2024-04-25T22:41:28.336 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000115809 2024-04-25T22:41:28.336 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.336 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.336 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.336 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.336 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.337 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:28.337 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:28.337 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.698180418000007, 2024-04-25T22:41:28.337 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035594492999999998, 2024-04-25T22:41:28.337 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:28.337 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:28.337 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.337 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:28.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.337 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:28.337 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:28.337 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.337 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:28.337 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600492+0000", 2024-04-25T22:41:28.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.338 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:28.338 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600494+0000", 2024-04-25T22:41:28.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5099999999999999e-06 2024-04-25T22:41:28.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.338 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:28.338 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600502+0000", 2024-04-25T22:41:28.338 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3769999999999996e-06 2024-04-25T22:41:28.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.338 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.338 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:28.339 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600522+0000", 2024-04-25T22:41:28.339 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9919999999999999e-05 2024-04-25T22:41:28.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.339 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.339 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600539+0000", 2024-04-25T22:41:28.339 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.649e-05 2024-04-25T22:41:28.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.339 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:28.339 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604846+0000", 2024-04-25T22:41:28.339 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0043075199999999996 2024-04-25T22:41:28.339 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.340 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:28.340 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605057+0000", 2024-04-25T22:41:28.340 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00021085200000000001 2024-04-25T22:41:28.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.340 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:28.340 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605378+0000", 2024-04-25T22:41:28.340 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00032074799999999999 2024-04-25T22:41:28.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.340 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:28.340 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.611089+0000", 2024-04-25T22:41:28.340 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0057110249999999998 2024-04-25T22:41:28.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.341 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:28.341 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635844+0000", 2024-04-25T22:41:28.341 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024755355999999999 2024-04-25T22:41:28.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.341 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:28.341 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635986+0000", 2024-04-25T22:41:28.341 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000141512 2024-04-25T22:41:28.341 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.341 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.341 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:28.341 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.636087+0000", 2024-04-25T22:41:28.341 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101183 2024-04-25T22:41:28.341 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.341 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.342 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.342 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:28.342 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:28.342 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.698107808000003, 2024-04-25T22:41:28.342 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021266723000000001, 2024-04-25T22:41:28.342 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:28.342 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:28.342 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.342 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:28.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.342 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:28.342 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:28.343 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.343 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:28.343 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600565+0000", 2024-04-25T22:41:28.343 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.343 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:28.343 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600566+0000", 2024-04-25T22:41:28.343 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4959999999999999e-06 2024-04-25T22:41:28.343 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.343 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.343 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:28.343 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600574+0000", 2024-04-25T22:41:28.344 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-06 2024-04-25T22:41:28.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.344 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:28.344 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600592+0000", 2024-04-25T22:41:28.344 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8479999999999999e-05 2024-04-25T22:41:28.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.344 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.344 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600610+0000", 2024-04-25T22:41:28.344 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7567e-05 2024-04-25T22:41:28.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.344 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.344 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:28.344 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602679+0000", 2024-04-25T22:41:28.345 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020692739999999999 2024-04-25T22:41:28.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.345 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:28.345 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602945+0000", 2024-04-25T22:41:28.345 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026640399999999998 2024-04-25T22:41:28.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.345 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:28.345 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603115+0000", 2024-04-25T22:41:28.345 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000169996 2024-04-25T22:41:28.345 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.345 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:28.345 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608398+0000", 2024-04-25T22:41:28.346 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052826289999999996 2024-04-25T22:41:28.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.346 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:28.346 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621588+0000", 2024-04-25T22:41:28.346 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013190489 2024-04-25T22:41:28.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.346 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:28.346 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621733+0000", 2024-04-25T22:41:28.346 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014462500000000001 2024-04-25T22:41:28.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.346 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:28.346 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621832+0000", 2024-04-25T22:41:28.347 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8603000000000004e-05 2024-04-25T22:41:28.347 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.347 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.347 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.347 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.347 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:28.347 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:28.347 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.698040082000006, 2024-04-25T22:41:28.347 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034747924999999999, 2024-04-25T22:41:28.347 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:28.347 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:28.347 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.347 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:28.347 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.347 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:28.348 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:28.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.348 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:28.348 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600633+0000", 2024-04-25T22:41:28.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.348 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:28.348 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600634+0000", 2024-04-25T22:41:28.348 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.423e-06 2024-04-25T22:41:28.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.348 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:28.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600642+0000", 2024-04-25T22:41:28.349 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8169999999999999e-06 2024-04-25T22:41:28.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.349 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:28.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600660+0000", 2024-04-25T22:41:28.349 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8513e-05 2024-04-25T22:41:28.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.349 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600676+0000", 2024-04-25T22:41:28.349 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6019999999999999e-05 2024-04-25T22:41:28.349 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.349 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.349 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:28.349 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.603748+0000", 2024-04-25T22:41:28.350 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030718329999999999 2024-04-25T22:41:28.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.350 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:28.350 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.604752+0000", 2024-04-25T22:41:28.350 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001003603 2024-04-25T22:41:28.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.350 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:28.350 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.605117+0000", 2024-04-25T22:41:28.350 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00036539 2024-04-25T22:41:28.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.350 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:28.351 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.608459+0000", 2024-04-25T22:41:28.351 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033413879999999998 2024-04-25T22:41:28.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.351 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:28.351 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635106+0000", 2024-04-25T22:41:28.351 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026647607 2024-04-25T22:41:28.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.351 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:28.351 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635273+0000", 2024-04-25T22:41:28.351 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000166689 2024-04-25T22:41:28.351 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.351 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.351 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:28.351 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.635381+0000", 2024-04-25T22:41:28.352 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107642 2024-04-25T22:41:28.352 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.352 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.352 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.352 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.352 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:28.352 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:28.352 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.697976853, 2024-04-25T22:41:28.352 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040419292000000002, 2024-04-25T22:41:28.352 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:28.352 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:28.352 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.352 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:28.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.353 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:28.353 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:28.353 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.353 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:28.353 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600696+0000", 2024-04-25T22:41:28.353 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.353 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.353 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:28.353 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600697+0000", 2024-04-25T22:41:28.353 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1999999999999999e-06 2024-04-25T22:41:28.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.354 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:28.354 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600704+0000", 2024-04-25T22:41:28.354 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5570000000000001e-06 2024-04-25T22:41:28.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.354 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:28.354 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600724+0000", 2024-04-25T22:41:28.354 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0023000000000001e-05 2024-04-25T22:41:28.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.354 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.354 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.354 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600738+0000", 2024-04-25T22:41:28.354 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4372999999999999e-05 2024-04-25T22:41:28.354 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.355 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:28.355 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.612532+0000", 2024-04-25T22:41:28.355 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011793606 2024-04-25T22:41:28.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.355 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:28.355 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613354+0000", 2024-04-25T22:41:28.355 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00082244100000000004 2024-04-25T22:41:28.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.355 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:28.355 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.613726+0000", 2024-04-25T22:41:28.355 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00037226000000000002 2024-04-25T22:41:28.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.356 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-04-25T22:41:28.356 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618891+0000", 2024-04-25T22:41:28.356 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051649199999999999 2024-04-25T22:41:28.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.356 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.356 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:28.356 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.640874+0000", 2024-04-25T22:41:28.356 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021982640000000001 2024-04-25T22:41:28.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.356 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.356 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:28.356 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641019+0000", 2024-04-25T22:41:28.356 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000145339 2024-04-25T22:41:28.356 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.356 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.357 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:28.357 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.641115+0000", 2024-04-25T22:41:28.357 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5933000000000005e-05 2024-04-25T22:41:28.357 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.357 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.357 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.357 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.357 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:28.357 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:28.357 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.697890822999994, 2024-04-25T22:41:28.357 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036502711, 2024-04-25T22:41:28.357 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:28.357 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:28.357 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:28.358 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:28.358 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.358 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:28.358 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:28.358 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.358 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.358 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:28.358 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600782+0000", 2024-04-25T22:41:28.358 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.358 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.358 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.358 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:28.358 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600783+0000", 2024-04-25T22:41:28.358 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.533e-06 2024-04-25T22:41:28.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.359 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:28.359 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600790+0000", 2024-04-25T22:41:28.359 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0439999999999998e-06 2024-04-25T22:41:28.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.359 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:28.359 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600811+0000", 2024-04-25T22:41:28.359 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0449e-05 2024-04-25T22:41:28.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.359 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.359 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600825+0000", 2024-04-25T22:41:28.359 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4293e-05 2024-04-25T22:41:28.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.360 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:28.360 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602304+0000", 2024-04-25T22:41:28.360 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001478629 2024-04-25T22:41:28.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.360 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:28.360 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602587+0000", 2024-04-25T22:41:28.360 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00028350800000000002 2024-04-25T22:41:28.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.360 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.360 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:28.360 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.637285+0000", 2024-04-25T22:41:28.360 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034697255000000003 2024-04-25T22:41:28.360 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.360 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.361 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.361 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:28.361 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:28.361 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.697825257000005, 2024-04-25T22:41:28.361 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017311460000000001, 2024-04-25T22:41:28.361 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:28.361 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:28.361 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-04-25T22:41:28.361 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:28.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.361 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:28.361 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:28.361 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.362 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.362 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:28.362 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600847+0000", 2024-04-25T22:41:28.362 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.362 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.362 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:28.362 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600849+0000", 2024-04-25T22:41:28.362 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2899999999999999e-06 2024-04-25T22:41:28.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.362 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.362 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:28.362 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600866+0000", 2024-04-25T22:41:28.362 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6793e-05 2024-04-25T22:41:28.363 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.363 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.363 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:28.363 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600886+0000", 2024-04-25T22:41:28.363 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0772999999999999e-05 2024-04-25T22:41:28.363 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.363 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.363 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.363 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.600904+0000", 2024-04-25T22:41:28.363 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7697e-05 2024-04-25T22:41:28.363 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.363 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.363 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:28.363 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602796+0000", 2024-04-25T22:41:28.363 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018920149999999999 2024-04-25T22:41:28.363 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.364 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.364 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:28.364 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.602962+0000", 2024-04-25T22:41:28.364 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016590600000000001 2024-04-25T22:41:28.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.364 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.364 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:28.364 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618159+0000", 2024-04-25T22:41:28.364 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015196985999999999 2024-04-25T22:41:28.364 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.364 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.364 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.364 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.364 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:28.365 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:28.365 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.682949515999994, 2024-04-25T22:41:28.365 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006380269, 2024-04-25T22:41:28.365 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:28.365 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:28.365 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.365 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:28.365 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.365 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:28.365 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:28.365 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.365 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.365 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.365 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:28.365 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615723+0000", 2024-04-25T22:41:28.366 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.366 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.366 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.366 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:28.366 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615724+0000", 2024-04-25T22:41:28.366 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.094e-06 2024-04-25T22:41:28.366 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.366 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.366 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:28.366 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615734+0000", 2024-04-25T22:41:28.366 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.363e-06 2024-04-25T22:41:28.366 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.366 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.366 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:28.366 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615751+0000", 2024-04-25T22:41:28.367 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7410000000000001e-05 2024-04-25T22:41:28.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.367 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.367 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.367 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.615773+0000", 2024-04-25T22:41:28.367 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.154e-05 2024-04-25T22:41:28.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.367 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.367 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:28.367 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616485+0000", 2024-04-25T22:41:28.367 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00071225100000000001 2024-04-25T22:41:28.367 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.367 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.367 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:28.367 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616528+0000", 2024-04-25T22:41:28.367 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3606000000000002e-05 2024-04-25T22:41:28.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.368 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.368 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:28.368 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622030+0000", 2024-04-25T22:41:28.368 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055010750000000002 2024-04-25T22:41:28.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.368 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.368 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:28.368 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622103+0000", 2024-04-25T22:41:28.368 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3930000000000005e-05 2024-04-25T22:41:28.368 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.368 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.368 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.368 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.368 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.369 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:28.369 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:28.369 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.682036578999998, 2024-04-25T22:41:28.369 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046420649999999999, 2024-04-25T22:41:28.369 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:28.369 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:28.369 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-04-25T22:41:28.369 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:28.369 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.369 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:28.369 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:28.369 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.369 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.369 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.369 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:28.370 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616636+0000", 2024-04-25T22:41:28.370 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.370 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.370 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.370 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:28.370 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616637+0000", 2024-04-25T22:41:28.370 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0299999999999998e-07 2024-04-25T22:41:28.370 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.370 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.370 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:28.370 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616653+0000", 2024-04-25T22:41:28.370 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5843000000000001e-05 2024-04-25T22:41:28.370 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.370 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.370 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:28.371 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616690+0000", 2024-04-25T22:41:28.371 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7466999999999999e-05 2024-04-25T22:41:28.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.371 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.371 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.371 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.616729+0000", 2024-04-25T22:41:28.371 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8810000000000003e-05 2024-04-25T22:41:28.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.371 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.371 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:28.371 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617251+0000", 2024-04-25T22:41:28.371 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00052143899999999995 2024-04-25T22:41:28.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.371 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.371 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.621278+0000", 2024-04-25T22:41:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0040277029999999997 2024-04-25T22:41:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:25 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.681013226999994, 2024-04-25T22:41:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0065101730000000002, 2024-04-25T22:41:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:28.372 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617659+0000", 2024-04-25T22:41:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617661+0000", 2024-04-25T22:41:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2270000000000001e-06 2024-04-25T22:41:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.373 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617688+0000", 2024-04-25T22:41:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7589e-05 2024-04-25T22:41:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617710+0000", 2024-04-25T22:41:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1467e-05 2024-04-25T22:41:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.617727+0000", 2024-04-25T22:41:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6990000000000002e-05 2024-04-25T22:41:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.374 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.375 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:28.375 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618559+0000", 2024-04-25T22:41:28.375 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00083207400000000003 2024-04-25T22:41:28.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.375 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:28.375 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.618608+0000", 2024-04-25T22:41:28.375 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8936e-05 2024-04-25T22:41:28.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.375 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:28.375 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624077+0000", 2024-04-25T22:41:28.375 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054695840000000004 2024-04-25T22:41:28.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.375 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:28.376 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624170+0000", 2024-04-25T22:41:28.376 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2305999999999993e-05 2024-04-25T22:41:28.376 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.376 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.376 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.376 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.376 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:6 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:28.376 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:28.376 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.675911718999998, 2024-04-25T22:41:28.376 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006879446, 2024-04-25T22:41:28.376 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:28.376 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:28.376 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.376 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:28.376 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.377 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:28.377 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:28.377 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.377 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.377 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:28.377 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622761+0000", 2024-04-25T22:41:28.377 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.377 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.377 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:28.377 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622762+0000", 2024-04-25T22:41:28.377 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-04-25T22:41:28.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.377 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.378 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:28.378 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622781+0000", 2024-04-25T22:41:28.378 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8749999999999998e-05 2024-04-25T22:41:28.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.378 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.378 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:28.378 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622802+0000", 2024-04-25T22:41:28.378 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1650000000000001e-05 2024-04-25T22:41:28.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.378 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.378 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.378 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.622816+0000", 2024-04-25T22:41:28.378 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3556e-05 2024-04-25T22:41:28.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.379 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:28.379 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623700+0000", 2024-04-25T22:41:28.379 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00088389299999999996 2024-04-25T22:41:28.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.379 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:28.379 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623741+0000", 2024-04-25T22:41:28.379 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1023999999999999e-05 2024-04-25T22:41:28.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.379 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:28.379 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629543+0000", 2024-04-25T22:41:28.379 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0058023980000000003 2024-04-25T22:41:28.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.380 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:28.380 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629640+0000", 2024-04-25T22:41:28.380 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7381999999999997e-05 2024-04-25T22:41:28.380 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.380 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.380 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.380 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.380 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:7 3.10 e18/16 3:0d82a743:::600.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:28.380 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:28.380 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.675650515000001, 2024-04-25T22:41:28.380 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067054879999999999, 2024-04-25T22:41:28.380 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:28.380 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:28.380 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.381 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:28.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.381 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:28.381 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:28.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.381 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:28.381 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623022+0000", 2024-04-25T22:41:28.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.381 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:28.381 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623032+0000", 2024-04-25T22:41:28.381 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.9930000000000007e-06 2024-04-25T22:41:28.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.382 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:28.382 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623043+0000", 2024-04-25T22:41:28.382 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0387000000000001e-05 2024-04-25T22:41:28.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.382 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:28.382 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623064+0000", 2024-04-25T22:41:28.382 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1849999999999999e-05 2024-04-25T22:41:28.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.382 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.382 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623079+0000", 2024-04-25T22:41:28.382 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4093e-05 2024-04-25T22:41:28.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.383 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:28.383 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624384+0000", 2024-04-25T22:41:28.383 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013054539999999999 2024-04-25T22:41:28.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.383 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:28.383 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.624421+0000", 2024-04-25T22:41:28.383 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7088999999999997e-05 2024-04-25T22:41:28.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.383 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:28.383 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629645+0000", 2024-04-25T22:41:28.383 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052241400000000004 2024-04-25T22:41:28.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.384 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:28.384 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.629728+0000", 2024-04-25T22:41:28.384 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2482000000000001e-05 2024-04-25T22:41:28.384 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.384 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.384 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.384 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.384 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2024-04-25T22:41:28.384 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:28.384 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.675567401999999, 2024-04-25T22:41:28.384 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078029559999999998, 2024-04-25T22:41:28.384 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-04-25T22:41:28.384 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-04-25T22:41:28.385 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.385 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-04-25T22:41:28.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.385 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-04-25T22:41:28.385 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:28.385 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.385 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-04-25T22:41:28.385 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623105+0000", 2024-04-25T22:41:28.385 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-04-25T22:41:28.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.385 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-04-25T22:41:28.385 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623106+0000", 2024-04-25T22:41:28.385 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.64e-07 2024-04-25T22:41:28.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.386 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.386 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-04-25T22:41:28.386 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623141+0000", 2024-04-25T22:41:28.386 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4678999999999998e-05 2024-04-25T22:41:28.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.386 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.386 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-04-25T22:41:28.386 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623153+0000", 2024-04-25T22:41:28.386 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1759999999999999e-05 2024-04-25T22:41:28.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.386 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.386 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.386 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623161+0000", 2024-04-25T22:41:28.386 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8299999999999996e-06 2024-04-25T22:41:28.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.387 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-04-25T22:41:28.387 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623834+0000", 2024-04-25T22:41:28.387 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067394500000000001 2024-04-25T22:41:28.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.387 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-04-25T22:41:28.387 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.623883+0000", 2024-04-25T22:41:28.387 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8640000000000002e-05 2024-04-25T22:41:28.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.387 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-04-25T22:41:28.387 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630807+0000", 2024-04-25T22:41:28.388 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069238859999999998 2024-04-25T22:41:28.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-04-25T22:41:28.388 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-04-25T22:41:28.388 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-04-25T22:41:28.388 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-04-25T22:40:14.630908+0000", 2024-04-25T22:41:28.388 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000101252 2024-04-25T22:41:28.388 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.388 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.388 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.388 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-04-25T22:41:28.388 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-04-25T22:41:28.388 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:41:28.390 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:28.390 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:28.390+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:28.490 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:28.488+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:28.518 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:28.518 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:28.518 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:28.518 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:28.533 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:28.591 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:28.590+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:28.692 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:28.690+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:28.693 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:28.693 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:28.693 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:28.693 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:28.693 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:28.708 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:28.718 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:41:28.792 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:28.788+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:28.833 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:28.833 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:28.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:28.833 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:28.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.833 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:28.833 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:28.833 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 74.235601717999998, 2024-04-25T22:41:28.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:28.834 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:28.834 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:28.834 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.834 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:28.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:28.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:28.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:28.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:28.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:28.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:28.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:28.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:28.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:28.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:28.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:28.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:28.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:28.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.836 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.836 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:28.836 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:28.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.836 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.836 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:28.836 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:28.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.836 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:28.836 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:28.836 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:28.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.837 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.837 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.837 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:28.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:28.837 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.837 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.837 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:28.837 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:28.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:28.837 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.837 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.837 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:28.837 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:28.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:28.837 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:28.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:28.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:28.838 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:28.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:28.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:28.838 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:28.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:28.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:28.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:28.839 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:28.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:28.839 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.839 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.839 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.839 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:28.839 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:28.839 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 74.235464461999996, 2024-04-25T22:41:28.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:28.839 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:28.840 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:28.840 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.840 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:28.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:28.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:28.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:28.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:28.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:28.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:28.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:28.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:28.841 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:28.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:28.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:28.841 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:28.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:28.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.842 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:28.842 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:28.842 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.842 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.842 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.842 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:28.842 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:28.842 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.842 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.842 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:28.842 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:28.842 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:28.842 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.842 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.842 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.843 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:28.843 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:28.843 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.843 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.843 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:28.843 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:28.843 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:28.843 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.843 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.843 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:28.843 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:28.843 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:28.843 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.843 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.843 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:28.843 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:28.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:28.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:28.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:28.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:28.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:28.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:28.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:28.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:28.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:28.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:28.845 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.845 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.845 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.845 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:28.845 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:28.845 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 74.235376909999999, 2024-04-25T22:41:28.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:28.845 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:28.845 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:28.845 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.845 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:28.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:28.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:28.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:28.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:28.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:28.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:28.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:28.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.847 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:28.847 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:28.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:28.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.847 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:28.847 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:28.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:28.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.847 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.847 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:28.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:28.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:28.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:28.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:28.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:28.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:28.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:28.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:28.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:28.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:28.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:28.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:28.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:28.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:28.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:28.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:28.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:28.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:28.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:28.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:28.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:28.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:28.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:28.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:28.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:28.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:28.850 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.850 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.851 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.851 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:28.851 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:28.851 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 74.235273083999999, 2024-04-25T22:41:28.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:28.851 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:28.851 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:28.851 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.851 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:28.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:28.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:28.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:28.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:28.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:28.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:28.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:28.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:28.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:28.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:28.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:28.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:28.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:28.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:28.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:28.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:28.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:28.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.854 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:28.854 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:28.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:28.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.854 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.854 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:28.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:28.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.854 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:28.854 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:28.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:28.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:28.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:28.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:28.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:28.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:28.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:28.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:28.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:28.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:28.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:28.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:28.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:28.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:28.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:28.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:28.856 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.856 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.856 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.857 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:28.857 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:28.857 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 74.235204293999999, 2024-04-25T22:41:28.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:28.857 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:28.857 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:28.857 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.857 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:28.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:28.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:28.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:28.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:28.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:28.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:28.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:28.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:28.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:28.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:28.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:28.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:28.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:28.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:28.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:28.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:28.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:28.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 74.235135208000003, 2024-04-25T22:41:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 74.235039095000005, 2024-04-25T22:41:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 74.234973432999993, 2024-04-25T22:41:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 74.234904306000004, 2024-04-25T22:41:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 74.224087650000001, 2024-04-25T22:41:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 74.207189296999999, 2024-04-25T22:41:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 74.206368406999999, 2024-04-25T22:41:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 74.204667678999996, 2024-04-25T22:41:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 74.204071003999999, 2024-04-25T22:41:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 74.194635278000007, 2024-04-25T22:41:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 74.193987852000006, 2024-04-25T22:41:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 74.192547032999997, 2024-04-25T22:41:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.240108589000002, 2024-04-25T22:41:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 50.237449265000002, 2024-04-25T22:41:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 45.237157013999997, 2024-04-25T22:41:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:28.928 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:28.929 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:28.929 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:28.930 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:41:28.930 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:41:28.930 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:28.931 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:28.931 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:28.932 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:28.930+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:29.030 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:29.028+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:29.062 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:29.062 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:29.076 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:29.130 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:29.130+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:29.200 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:29.200 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:29.214 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:29.261 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:29.262+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:29.328 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:41:29.331 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:29.332+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:29.384 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:29.384 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:29.398 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:41:29.432 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:29.430+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:29.529 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:29.529 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:29.533 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:29.530+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:29.543 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:41:29.634 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:29.634+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:29.709 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:29.710 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:29.723 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:41:29.734 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:29.734+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:29.835 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:29.832+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:29.841 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:29.841 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:29.856 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:29.936 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:29.938+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:29.987 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:29.988 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:30.003 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:30.037 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:30.038+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:30.126 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:30.126 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:30.138 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:41:30.134+0000 7f00baa0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21650) UID: 0 2024-04-25T22:41:30.141 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:30.145 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:41:30.145 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:41:30.146 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 1, 2] 2024-04-25T22:41:30.146 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi148.front.sepia.ceph.com 2024-04-25T22:41:30.146 INFO:teuthology.orchestra.console.smithi148:Power off 2024-04-25T22:41:30.146 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T22:41:30.170 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2024-04-25T22:41:30.170 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:41:30.192 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-04-25T22:41:30.239 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:30.236+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:30.264 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:30.265 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:30.279 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:30.318 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is unset 2024-04-25T22:41:30.340 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:30.336+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:30.410 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:30.411 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:30.425 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:30.472 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:30.474+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:30.542 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:30.542 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:30.542 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:30.542+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:30.557 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:30.643 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:30.640+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:30.721 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:30.721 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:30.735 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:30.744 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:30.746+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:30.845 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:30.840+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:30.867 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:30.867 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:30.881 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:30.946 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:30.946+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:30.950 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:41:31.047 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:31.044+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:31.049 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:31.049 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:31.064 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:31.098 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:31.098 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:31.118 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:41:31.118 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:41:31.135 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:31.136 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:31.148 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:31.146+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:31.231 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:31.231 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:31.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:31.231 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:31.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.231 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.231 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:31.231 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 76.632781750999996, 2024-04-25T22:41:31.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:31.231 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:31.231 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:31.232 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.232 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:31.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:31.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:31.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:31.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:31.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:31.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:31.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:31.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:31.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:31.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:31.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:31.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:31.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:31.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:31.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:31.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:31.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:31.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:31.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:31.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:31.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:31.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:31.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:31.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:31.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:31.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:31.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:31.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:31.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:31.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:31.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:31.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:31.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:31.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:31.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:31.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:31.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:31.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:31.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:31.237 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.237 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.237 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.237 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.237 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:31.237 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 76.632644494999994, 2024-04-25T22:41:31.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:31.238 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:31.238 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:31.238 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.238 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:31.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:31.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:31.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:31.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:31.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.239 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:31.239 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:31.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:31.239 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:31.239 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:31.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:31.239 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:31.239 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:31.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:31.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:31.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:31.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:31.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:31.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:31.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:31.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:31.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:31.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:31.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:31.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:31.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:31.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:31.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:31.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:31.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:31.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:31.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:31.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:31.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:31.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:31.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:31.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:31.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:31.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:31.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:31.243 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.243 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.243 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.243 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.243 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:31.243 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 76.632556942999997, 2024-04-25T22:41:31.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:31.244 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:31.244 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:31.244 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.244 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:31.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:31.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:31.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:31.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:31.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:31.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:31.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:31.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:31.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:31.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:31.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:31.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:31.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:31.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:31.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:31.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:31.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:31.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:31.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:31.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:31.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:31.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:31.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:31.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:31.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:31.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:31.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:31.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:31.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:31.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:31.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:31.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:31.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:31.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:31.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:31.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:31.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:31.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:31.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:31.249 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.249 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.249 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.249 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.249 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:31.249 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 76.632453116999997, 2024-04-25T22:41:31.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:31.249 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:31.249 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:31.249 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.249 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:31.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.250 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:31.250 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:31.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.250 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:31.250 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:31.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.250 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:31.250 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:31.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:31.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:31.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:31.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:31.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:31.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:31.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:31.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:31.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:31.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:31.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:31.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:31.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:31.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:31.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:31.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:31.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:31.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:31.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:31.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:31.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:31.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:31.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:31.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:31.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:31.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:31.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:31.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:31.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:31.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:31.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:31.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:31.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:31.254 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.254 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.254 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.255 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.255 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.255 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.255 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:31.255 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 76.632384326999997, 2024-04-25T22:41:31.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:31.255 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:31.255 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:31.255 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.255 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:31.255 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.255 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:31.255 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:31.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.255 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:31.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:31.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:31.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:31.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:31.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:31.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:31.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:31.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:31.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:31.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:31.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:31.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:31.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:31.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:31.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:31.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:31.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:31.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:31.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:31.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:31.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:31.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:31.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:31.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:31.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:31.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:31.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:31.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:31.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.259 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:31.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:31.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:31.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:31.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:31.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:31.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:31.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:31.260 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.261 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.261 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.261 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.261 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:31.261 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 76.632315241000001, 2024-04-25T22:41:31.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:31.261 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:31.261 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:31.261 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.261 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:31.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:31.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:31.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:31.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:31.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:31.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:31.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:31.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:31.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:31.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:31.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:31.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:31.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:31.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:31.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:31.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:31.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:31.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:31.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:31.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:31.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:31.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:31.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:31.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:31.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:31.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:31.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:31.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:31.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:31.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:31.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:31.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:31.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:31.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:31.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:31.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:31.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:31.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:31.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:31.266 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.266 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.267 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.267 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.267 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:31.267 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 76.632219128000003, 2024-04-25T22:41:31.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:31.267 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:31.267 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:31.267 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:31.267 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:31.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.267 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:31.267 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:31.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.268 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:31.268 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:31.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.268 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:31.268 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:31.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:31.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.268 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:31.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:31.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:31.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:31.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:31.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:31.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:31.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:31.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:31.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:31.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:31.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:31.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:31.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:31.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:31.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:31.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:31.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:31.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:31.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:31.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:31.271 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.271 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.271 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.272 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.272 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:31.272 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 76.632153466000005, 2024-04-25T22:41:31.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:31.272 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:31.272 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:31.272 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:31.272 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:31.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.272 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:31.272 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:31.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:31.273 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:31.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:31.273 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:31.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:31.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:31.273 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:31.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:31.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.274 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:31.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:31.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:31.274 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.274 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:31.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:31.274 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.274 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.274 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:31.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:31.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:31.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:31.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:31.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:31.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:31.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:31.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:31.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:31.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:31.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:31.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:31.276 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.276 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.276 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.276 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.276 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:31.276 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 76.632084339000002, 2024-04-25T22:41:31.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:31.276 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:31.277 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:31.277 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:31.277 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:31.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:31.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:31.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:31.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:31.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.278 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.278 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:31.278 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:31.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:31.278 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.278 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.278 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:31.278 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:31.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:31.278 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.278 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.278 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:31.278 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:31.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:31.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.279 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.279 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:31.279 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:31.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.279 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.279 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:31.279 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:31.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.279 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:31.279 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:31.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:31.280 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.280 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.280 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.280 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:31.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:31.280 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.280 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.280 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:31.280 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:31.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:31.280 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.280 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.280 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:31.280 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:31.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:31.281 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.281 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.281 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.281 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.281 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:31.281 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:31.281 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 76.621267682999999, 2024-04-25T22:41:31.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:31.281 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:31.281 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:31.281 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:31.281 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:31.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.281 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:31.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:31.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:31.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:31.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:31.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:31.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:31.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:31.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:31.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:31.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:31.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:31.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:31.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.283 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.283 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.283 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:31.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:31.283 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.284 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.284 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.284 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:31.284 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:31.284 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.284 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.284 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:31.284 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:31.284 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:31.284 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.284 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.284 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.284 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.284 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.285 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:31.285 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:31.285 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 76.604369329999997, 2024-04-25T22:41:31.285 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:31.285 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:31.285 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:31.285 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:31.285 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:31.285 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.285 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:31.285 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:31.285 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.285 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.285 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.285 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:31.285 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:31.286 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.286 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.286 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:31.286 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:31.286 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:31.286 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.286 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:31.286 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:31.286 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:31.286 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.286 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:31.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:31.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:31.287 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.287 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:31.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:31.287 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.287 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.287 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:31.287 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:31.287 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.287 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.287 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:31.288 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:31.288 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:31.288 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.288 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.288 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:31.288 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:31.288 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:31.288 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.288 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.288 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.288 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.288 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.288 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:31.288 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:31.288 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 76.603548439999997, 2024-04-25T22:41:31.289 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:31.289 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:31.289 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:31.289 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:31.289 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:31.289 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.289 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:31.289 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:31.289 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.289 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.289 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.289 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:31.289 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:31.289 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.290 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.290 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.290 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:31.290 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:31.290 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:31.290 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.290 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.290 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:31.290 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:31.290 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:31.290 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.290 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.290 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:31.290 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:31.291 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:31.291 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.291 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.291 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.291 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:31.291 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:31.291 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.291 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.291 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.291 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:31.291 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:31.291 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.291 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.291 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:31.291 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:31.291 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:31.292 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.292 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.292 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:31.292 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:31.292 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:31.292 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.292 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.292 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.292 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.292 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.292 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:31.292 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:31.292 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 76.601847711999994, 2024-04-25T22:41:31.292 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:31.292 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:31.293 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:31.293 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.293 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:31.293 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.293 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:31.293 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:31.293 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.293 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.293 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.293 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:31.293 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:31.293 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.293 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.293 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.293 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:31.293 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:31.294 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:31.294 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.294 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.294 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:31.294 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:31.294 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:31.294 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.294 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.294 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:31.294 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:31.294 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:31.294 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.294 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.294 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.295 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:31.295 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:31.295 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.295 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.295 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.295 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:31.295 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:31.295 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.295 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.295 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:31.295 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:31.295 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:31.295 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.295 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.296 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:31.296 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:31.296 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:31.296 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.296 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.296 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:31.296 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:31.296 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:31.296 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.296 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.296 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.296 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.296 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.296 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:31.296 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:31.296 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 76.601251036999997, 2024-04-25T22:41:31.297 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:31.297 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:31.297 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:31.297 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.297 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:31.297 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.297 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:31.297 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:31.297 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.297 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.297 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.297 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:31.297 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:31.297 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.298 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.298 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.298 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:31.298 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:31.298 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:31.298 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.298 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.298 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:31.298 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:31.298 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:31.298 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.298 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.298 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:31.298 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:31.299 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:31.299 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.299 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.299 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.299 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:31.299 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:31.299 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.299 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.299 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.299 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:31.299 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:31.299 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.299 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.299 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:31.299 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:31.300 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:31.300 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.300 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.300 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:31.300 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:31.300 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:31.300 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.300 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.300 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:31.300 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:31.300 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:31.300 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.300 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.300 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.300 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.301 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.301 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:31.301 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:31.301 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 76.591815311000005, 2024-04-25T22:41:31.301 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:31.301 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:31.301 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:31.301 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:31.301 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:31.301 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.301 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:31.301 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:31.301 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.301 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.302 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.302 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:31.302 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:31.302 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.302 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.302 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.302 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:31.302 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:31.302 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:31.302 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.302 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.302 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:31.302 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:31.302 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:31.302 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.303 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.303 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:31.303 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:31.303 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:31.303 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.303 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.303 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.303 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:31.303 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:31.303 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.303 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.303 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.303 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:31.303 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:31.303 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.303 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.304 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:31.304 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:31.304 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:31.304 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.304 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.304 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.304 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.304 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.304 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:31.304 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:31.304 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 76.591167885000004, 2024-04-25T22:41:31.304 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:31.304 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:31.304 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:31.304 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.304 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:31.304 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.305 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:31.305 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:31.305 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.305 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.305 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.305 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:31.305 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:31.305 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.305 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.305 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.305 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:31.305 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:31.305 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:31.305 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.305 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.305 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:31.306 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:31.306 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:31.306 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.306 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.306 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:31.306 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:31.306 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:31.306 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.306 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.306 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.306 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:31.306 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:31.306 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.306 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.307 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.307 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:31.307 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:31.307 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.307 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.307 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:31.307 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:31.307 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:31.307 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.307 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.307 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:31.307 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:31.307 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:31.307 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.308 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.308 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:31.308 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:31.308 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:31.308 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.308 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.308 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.308 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.308 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.308 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:31.308 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:31.308 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 76.589727065999995, 2024-04-25T22:41:31.308 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:31.308 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:31.309 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:31.309 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.309 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:31.309 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.309 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:31.309 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:31.309 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.309 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.309 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.309 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:31.309 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:31.309 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.309 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.310 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.310 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:31.310 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:31.310 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:31.310 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.310 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.310 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:31.310 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:31.310 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:31.310 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.310 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.310 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:31.310 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:31.310 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:31.311 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.311 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.311 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.311 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:31.311 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:31.311 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.311 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.311 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.311 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:31.311 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:31.311 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.311 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.311 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:31.311 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:31.311 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:31.312 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.312 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.312 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:31.312 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:31.312 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:31.312 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.312 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.312 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:31.312 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:31.312 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:31.312 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.312 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.312 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.312 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.312 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.312 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:31.313 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:31.313 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 74.637288622, 2024-04-25T22:41:31.313 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:31.313 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:31.313 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:31.313 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.313 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:31.313 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.313 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:31.313 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:31.313 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.313 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.313 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.313 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:31.313 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:31.314 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.314 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.314 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.314 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:31.314 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:31.314 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:31.314 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.314 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.314 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:31.314 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:31.314 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:31.314 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.314 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.314 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:31.314 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:31.315 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:31.315 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.315 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.315 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.315 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:31.315 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:31.315 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.315 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.315 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.315 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:31.315 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:31.315 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.315 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.315 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:31.315 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:31.316 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:31.316 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.316 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.316 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:31.316 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:31.316 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:31.316 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.316 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.316 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:31.316 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:31.316 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:31.316 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.316 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.316 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.316 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:31.316 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:31.317 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.317 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.317 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:31.317 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:31.317 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:31.317 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.317 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.317 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:31.317 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:31.317 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:31.317 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.317 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.317 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.317 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.318 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.318 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:31.318 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:31.318 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 52.634629298, 2024-04-25T22:41:31.318 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:31.318 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:31.318 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:31.318 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.318 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:31.318 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.318 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:31.318 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:31.318 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.318 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.318 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.318 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:31.318 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:31.319 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.319 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.319 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.319 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:31.319 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:31.319 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:31.319 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.319 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.319 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:31.319 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:31.319 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:31.319 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.319 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.319 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:31.319 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:31.320 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:31.320 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.320 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.320 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.320 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:31.320 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:31.320 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.320 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.320 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.320 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:31.320 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:31.320 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.320 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.320 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:31.320 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:31.321 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:31.321 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.321 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.321 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:31.321 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:31.321 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:31.321 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.321 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.321 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:31.321 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:31.321 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:31.321 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.321 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.321 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.322 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:31.322 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:31.322 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.322 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.322 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:31.322 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:31.322 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:31.322 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.322 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.322 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:31.322 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:31.322 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:31.322 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.322 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.322 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.322 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.323 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.323 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:31.323 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:31.323 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 47.634337047000002, 2024-04-25T22:41:31.323 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:31.323 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:31.323 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:31.323 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.323 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:31.323 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.323 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:31.323 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:31.323 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.323 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.323 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.324 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:31.324 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:31.324 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:31.324 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.324 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.324 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:31.324 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:31.324 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:31.324 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.324 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.324 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:31.324 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:31.324 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:31.324 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.324 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.325 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:31.325 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:31.325 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:31.325 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.325 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.325 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.325 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:31.325 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:31.325 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.325 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.325 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:31.325 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:31.325 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:31.325 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.325 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.326 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:31.326 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:31.326 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:31.326 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.326 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.326 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:31.326 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:31.326 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:31.326 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.326 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.326 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:31.326 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:31.326 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:31.326 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.327 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.327 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.327 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:31.327 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:31.327 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.327 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.327 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:31.327 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:31.327 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:31.327 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:31.327 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:31.327 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:31.327 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:31.328 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:31.328 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.328 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.328 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.328 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:31.328 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:31.328 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:31.329 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:31.328+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:31.330 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:31.430 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:31.428+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:31.465 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:31.465 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:31.465 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:41:31.465 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:31.480 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:31.531 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:31.528+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:31.606 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:31.607 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:31.607 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:31.607 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:31.607 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:31.623 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:31.633 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:31.628+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:31.733 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:31.732+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:31.747 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:31.747 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:41:31.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:41:31.747 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:41:31.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.747 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.748 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:31.748 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.149192649, 2024-04-25T22:41:31.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:41:31.748 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:31.748 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:31.748 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.748 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:31.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:31.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:31.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:31.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:31.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:31.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:41:31.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:41:31.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:31.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:41:31.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:41:31.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:31.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:41:31.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:41:31.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:41:31.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:41:31.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:41:31.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:41:31.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:31.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:41:31.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:41:31.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:41:31.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:41:31.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:31.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:41:31.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:41:31.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:31.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:41:31.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:41:31.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:41:31.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:41:31.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:31.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:41:31.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:41:31.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:31.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:41:31.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:41:31.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:31.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:41:31.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:41:31.753 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.753 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.753 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.754 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.754 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:31.754 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.149104636000004, 2024-04-25T22:41:31.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:41:31.754 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:31.754 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:31.754 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.754 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:31.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:31.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:31.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:31.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:31.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:31.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:41:31.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:41:31.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:31.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:31.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:41:31.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:31.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:41:31.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:41:31.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:41:31.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:41:31.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:41:31.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:41:31.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:31.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:31.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:41:31.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:41:31.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:41:31.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:31.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:41:31.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:41:31.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:31.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:41:31.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:41:31.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:31.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:41:31.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:41:31.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:41:31.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:41:31.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:31.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:41:31.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:41:31.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:31.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:41:31.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:41:31.759 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.759 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.759 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.760 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.760 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:31.760 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.149032513999998, 2024-04-25T22:41:31.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:41:31.760 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:31.760 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:31.760 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.760 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:31.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:31.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:31.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:31.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:31.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:31.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:41:31.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:41:31.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:31.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:41:31.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:41:31.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:31.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:41:31.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:41:31.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:41:31.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:41:31.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:41:31.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:41:31.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:31.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:41:31.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:41:31.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:41:31.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:41:31.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:31.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:41:31.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:41:31.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:31.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:41:31.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:41:31.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:41:31.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:41:31.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:31.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:41:31.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:41:31.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:31.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:41:31.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:41:31.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:31.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:41:31.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:41:31.765 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.765 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.765 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.766 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.766 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:31.766 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.148924201, 2024-04-25T22:41:31.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:41:31.766 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:31.766 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:31.766 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.766 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:31.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:31.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:31.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:31.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:31.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:31.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:41:31.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:41:31.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:31.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:41:31.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:41:31.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:31.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:41:31.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:41:31.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:41:31.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:41:31.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:41:31.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:41:31.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:31.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:41:31.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:41:31.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:41:31.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:41:31.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:31.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:41:31.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:41:31.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:31.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:41:31.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:41:31.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:41:31.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:41:31.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:31.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:41:31.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:41:31.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:31.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:41:31.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:41:31.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:31.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:41:31.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:41:31.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.771 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.772 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.772 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:31.772 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.148857544999998, 2024-04-25T22:41:31.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:41:31.772 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:31.772 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:31.772 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.772 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:31.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:31.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:31.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:31.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:31.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:31.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:41:31.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:41:31.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:31.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:41:31.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:41:31.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:31.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:41:31.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:41:31.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:41:31.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:41:31.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:41:31.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:41:31.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:31.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:41:31.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:41:31.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:41:31.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:41:31.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:31.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:41:31.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:41:31.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:31.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:41:31.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:41:31.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:41:31.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:41:31.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:31.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:41:31.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:41:31.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:31.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:41:31.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:41:31.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:31.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:41:31.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:41:31.777 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.777 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.777 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.777 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.777 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:31.778 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.148766949000006, 2024-04-25T22:41:31.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:41:31.778 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:31.778 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:31.778 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.778 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:31.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:31.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:31.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:31.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:31.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:31.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:41:31.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:41:31.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:31.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:41:31.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:41:31.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:31.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:41:31.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:41:31.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:41:31.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:41:31.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:41:31.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:41:31.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:31.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:41:31.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:41:31.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:41:31.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:41:31.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:31.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:41:31.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:41:31.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:31.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:41:31.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:41:31.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:31.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:41:31.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:41:31.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:41:31.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:41:31.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:31.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:41:31.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:41:31.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:31.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:41:31.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:41:31.783 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.783 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.783 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.783 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.783 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:31.783 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.148702376000003, 2024-04-25T22:41:31.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:41:31.783 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:31.784 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:31.784 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.784 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:31.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:31.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:31.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:31.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:31.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:31.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:41:31.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:41:31.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:31.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:41:31.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:41:31.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:31.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:41:31.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:41:31.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:41:31.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:41:31.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:31.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:41:31.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:31.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:41:31.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:41:31.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:41:31.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:41:31.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:31.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:41:31.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:41:31.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:31.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:41:31.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:41:31.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:41:31.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:41:31.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:31.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:41:31.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:41:31.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:31.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:41:31.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:41:31.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:31.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:41:31.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:41:31.789 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.789 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.789 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.789 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.789 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:31.789 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.148636952999993, 2024-04-25T22:41:31.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:41:31.789 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:31.789 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:31.789 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.790 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:31.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:31.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:31.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:31.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:31.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:31.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:41:31.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:31.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:31.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:41:31.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:41:31.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:31.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:41:31.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:41:31.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:41:31.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:41:31.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:41:31.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:41:31.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:31.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:41:31.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:41:31.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:41:31.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:41:31.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:31.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:41:31.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:41:31.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:31.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:41:31.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:41:31.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:31.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:41:31.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:41:31.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:41:31.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:41:31.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:31.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:41:31.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:41:31.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:31.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:41:31.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:41:31.794 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.795 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.795 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.795 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.795 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:31.795 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.148580886999994, 2024-04-25T22:41:31.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:41:31.795 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:31.795 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:31.795 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.795 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:31.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:31.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:31.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:31.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:31.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:31.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:31.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:41:31.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:31.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:41:31.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:41:31.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:31.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:41:31.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:41:31.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:41:31.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:41:31.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:41:31.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:41:31.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:31.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:41:31.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:41:31.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:41:31.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:41:31.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:31.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:41:31.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:41:31.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:31.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:41:31.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:41:31.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:41:31.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:41:31.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:31.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:41:31.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:41:31.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:31.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:41:31.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:41:31.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:31.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:41:31.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:41:31.800 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.800 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.800 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.801 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.801 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:31.801 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.148513781000005, 2024-04-25T22:41:31.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:41:31.801 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:31.801 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:31.801 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.801 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:31.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:31.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:31.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:31.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:31.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:31.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:41:31.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:41:31.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:31.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:41:31.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:41:31.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:31.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:41:31.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:41:31.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:41:31.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:41:31.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:41:31.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:41:31.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:31.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:41:31.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:41:31.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:41:31.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:41:31.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:31.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:41:31.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:41:31.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:31.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:41:31.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:41:31.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:41:31.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:41:31.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:31.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:41:31.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:41:31.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:31.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:41:31.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:41:31.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:31.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:41:31.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:41:31.806 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.806 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.806 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.806 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.806 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:31.806 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.148458657999996, 2024-04-25T22:41:31.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:41:31.806 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:31.807 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:31.807 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.807 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:31.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:31.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:31.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:31.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:31.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:31.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:41:31.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:31.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:31.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:41:31.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:41:31.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:31.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:41:31.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:41:31.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:41:31.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:41:31.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:41:31.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:41:31.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:31.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:41:31.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:41:31.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:41:31.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:41:31.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:31.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:41:31.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:41:31.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:31.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:41:31.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:41:31.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:41:31.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:41:31.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:31.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:41:31.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:41:31.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:31.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:41:31.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:41:31.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:31.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:41:31.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:41:31.812 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.812 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.812 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.812 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.812 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:31.812 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.148356418999995, 2024-04-25T22:41:31.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:41:31.812 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:31.812 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:31.812 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.812 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:31.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:31.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:31.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:31.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:31.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:31.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:41:31.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:41:31.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:31.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:41:31.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:41:31.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:31.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:41:31.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:41:31.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:41:31.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:41:31.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:41:31.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:41:31.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:31.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:41:31.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:41:31.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:41:31.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:41:31.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:31.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:41:31.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:41:31.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:31.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:41:31.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:41:31.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:41:31.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:41:31.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:31.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:41:31.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:41:31.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:31.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:41:31.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:41:31.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:31.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:41:31.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:41:31.817 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.818 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.818 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.818 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.818 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:31.818 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.148297596000006, 2024-04-25T22:41:31.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:41:31.818 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:31.818 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:31.818 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.818 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:31.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:31.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:31.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:31.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:31.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:31.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:41:31.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:41:31.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:31.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:41:31.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:41:31.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:31.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:41:31.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:41:31.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:41:31.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:41:31.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:41:31.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:41:31.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:31.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:41:31.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:41:31.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:41:31.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:41:31.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:31.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:41:31.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:41:31.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:31.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:41:31.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:41:31.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:31.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:41:31.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:41:31.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:41:31.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:41:31.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:31.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:41:31.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:41:31.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:31.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:41:31.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:41:31.823 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.823 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.823 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.823 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.823 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:31.824 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.148218862999997, 2024-04-25T22:41:31.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:41:31.824 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:31.824 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:31.824 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.824 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:31.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:31.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:31.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:31.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:31.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:31.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:41:31.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:31.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:31.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:41:31.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:41:31.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:31.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:41:31.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:41:31.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:41:31.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:41:31.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:41:31.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:41:31.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:31.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:41:31.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:41:31.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:41:31.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:41:31.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:31.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:41:31.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:41:31.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:31.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:41:31.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:41:31.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:31.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:41:31.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:41:31.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:41:31.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:41:31.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:31.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:41:31.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:41:31.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:31.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:41:31.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:41:31.830 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.830 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.831 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.831 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.831 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:31.831 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.148179450000001, 2024-04-25T22:41:31.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:41:31.831 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:31.831 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:31.831 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.831 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:31.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:31.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:31.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:31.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:31.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:31.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:41:31.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:41:31.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:31.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:41:31.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:41:31.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:31.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:41:31.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:41:31.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:41:31.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:41:31.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:41:31.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:41:31.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:31.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:41:31.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:41:31.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:41:31.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:41:31.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:31.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:41:31.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:41:31.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:31.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:41:31.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:41:31.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:41:31.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:41:31.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:31.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:41:31.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:41:31.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:31.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:41:31.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:41:31.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:31.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:41:31.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:41:31.836 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.836 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.836 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.836 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.836 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:31.837 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.148109603999998, 2024-04-25T22:41:31.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:41:31.837 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:31.837 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:31.837 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.837 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:31.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:31.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:31.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:31.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:31.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:31.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:41:31.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:41:31.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:31.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:41:31.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:41:31.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:31.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:41:31.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:41:31.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:41:31.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:41:31.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:41:31.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:41:31.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:31.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:41:31.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:41:31.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:41:31.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:41:31.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:31.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:41:31.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:41:31.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:31.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:41:31.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:41:31.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:41:31.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:41:31.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:31.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:41:31.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:41:31.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:31.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:41:31.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:41:31.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:31.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:41:31.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:41:31.842 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.842 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.842 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.842 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.843 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:31.843 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.148059867000001, 2024-04-25T22:41:31.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:41:31.843 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:31.843 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:31.843 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.843 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:31.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:31.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:31.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:31.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:31.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:31.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:41:31.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:31.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:31.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:41:31.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:41:31.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:31.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:41:31.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:41:31.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:41:31.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:41:31.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:41:31.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:41:31.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:31.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:41:31.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:41:31.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:41:31.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:41:31.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:31.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:41:31.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:41:31.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:31.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:41:31.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:41:31.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:31.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:41:31.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:41:31.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:41:31.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:41:31.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:31.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:31.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:41:31.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:31.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:41:31.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:41:31.848 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.848 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.848 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.848 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.848 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:31.849 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.147975251999995, 2024-04-25T22:41:31.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:41:31.849 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:31.849 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:31.849 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.849 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:31.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:31.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:31.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:31.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:31.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:31.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:41:31.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:31.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:31.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:41:31.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:41:31.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:31.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:41:31.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:41:31.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:41:31.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:41:31.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:41:31.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:41:31.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:31.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:41:31.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:41:31.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:41:31.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:41:31.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:31.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:41:31.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:41:31.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:31.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:41:31.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:41:31.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:31.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:41:31.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:41:31.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:31.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:41:31.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:41:31.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:31.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:41:31.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:41:31.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:31.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:41:31.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:41:31.854 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.854 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.854 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.854 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:31.855 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:31.855 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.147911601999994, 2024-04-25T22:41:31.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:41:31.855 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:31.855 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:31.855 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:41:31.855 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:31.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:31.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:31.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:31.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:31.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:31.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:41:31.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:41:31.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:31.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:41:31.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:41:31.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:31.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:41:31.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:41:31.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:41:31.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:41:31.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:41:31.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:41:31.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:31.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:41:31.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:41:31.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:41:31.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:41:31.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:31.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:41:31.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:41:31.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:31.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:41:31.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:41:31.859 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.859 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.859 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.859 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:31.859 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:31.859 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.140908072000002, 2024-04-25T22:41:31.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:41:31.859 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:31.859 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:31.859 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:31.860 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:31.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:31.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:31.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:31.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:31.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:31.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:31.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:41:31.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:41:31.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:31.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:41:31.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:41:31.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:31.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:41:31.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:41:31.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:31.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:41:31.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:41:31.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:31.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:41:31.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:41:31.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:31.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:41:31.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:41:31.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:31.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:41:31.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:41:31.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:31.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:31.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:31.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:41:31.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:41:31.863 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.863 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.863 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.863 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:31.863 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:31.863 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:31.865 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:31.865 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:31.864+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:31.966 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:31.964+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:31.996 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:31.997 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:31.997 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:31.997 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:32.011 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:32.102 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:32.100+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:32.167 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:32.170+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:32.179 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:32.179 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:32.179 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:32.179 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:32.179 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:32.193 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:32.278 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:32.276+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:32.337 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:41:32.357 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:32.358 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:32.358 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:32.358 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:32.358 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.358 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:32.358 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:32.358 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.760756560000004, 2024-04-25T22:41:32.358 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:32.358 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:32.358 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:32.358 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.358 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:32.358 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.359 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:32.359 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:32.359 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.359 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.359 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.359 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:32.359 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:32.359 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.359 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.359 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.359 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:32.359 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:32.359 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:32.359 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.360 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.360 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:32.360 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:32.360 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:32.360 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.360 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.360 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:32.360 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:32.360 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:32.360 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.360 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.360 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.360 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:32.360 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:32.360 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.361 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.361 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.361 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:32.361 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:32.361 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.361 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.361 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:32.361 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:32.361 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:32.361 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.361 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.361 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.361 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:32.361 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:32.362 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.362 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.362 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:32.362 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:32.362 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:32.362 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.362 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.362 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:32.362 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:32.362 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:32.362 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.362 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.362 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:32.362 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:32.363 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:32.363 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.363 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.363 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:32.363 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:32.363 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:32.363 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.363 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.363 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:32.363 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:32.363 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:32.363 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.363 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.363 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:32.363 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:32.364 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:32.364 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.364 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.364 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.364 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.364 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.364 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:32.364 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:32.364 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.760619304000002, 2024-04-25T22:41:32.364 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:32.364 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:32.364 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:32.364 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.364 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:32.365 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.365 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:32.365 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:32.365 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.365 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.365 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.365 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:32.365 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:32.365 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.365 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.365 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.365 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:32.365 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:32.365 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:32.365 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.366 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.366 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:32.366 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:32.366 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:32.366 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.366 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.366 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:32.366 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:32.366 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:32.366 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.366 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.366 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.366 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:32.366 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:32.367 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.367 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.367 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.367 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:32.367 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:32.367 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.367 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.367 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:32.367 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:32.367 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:32.367 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.367 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.367 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.367 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:32.367 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:32.368 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.368 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.368 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:32.368 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:32.368 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:32.368 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.368 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.368 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:32.368 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:32.368 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:32.368 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.368 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.368 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:32.368 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:32.368 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:32.369 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.369 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.369 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:32.369 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:32.369 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:32.369 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.369 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.369 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:32.369 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:32.369 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:32.369 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.369 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.369 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:32.369 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:32.370 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:32.370 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.370 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.370 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.370 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.370 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.370 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:32.370 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:32.370 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.760531752000006, 2024-04-25T22:41:32.370 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:32.370 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:32.370 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:32.370 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.370 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:32.371 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.371 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:32.371 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:32.371 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.371 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.371 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.371 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:32.371 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:32.371 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.371 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.371 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.371 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:32.371 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:32.371 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:32.372 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.372 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.372 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:32.372 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:32.372 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:32.372 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.372 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.372 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:32.372 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:32.372 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:32.372 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.372 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.372 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.372 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:32.372 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:32.373 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.373 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.373 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.373 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:32.373 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:32.373 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.373 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.373 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:32.373 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:32.373 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:32.373 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.373 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.373 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.373 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:32.374 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:32.374 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.374 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.374 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:32.374 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:32.374 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:32.374 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.374 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.374 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:32.374 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:32.374 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:32.374 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.374 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.374 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:32.374 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:32.375 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:32.375 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.375 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.375 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:32.375 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:32.375 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:32.375 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.375 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.375 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:32.375 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:32.375 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:32.375 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.375 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.375 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:32.376 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:32.376 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:32.376 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.376 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.376 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.376 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.376 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.376 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:32.376 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:32.376 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.760427926000006, 2024-04-25T22:41:32.376 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:32.376 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:32.376 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:32.376 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.376 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:32.377 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.377 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:32.377 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:32.377 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.377 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.377 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.377 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:32.377 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:32.377 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.377 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.377 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.377 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:32.377 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:32.377 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:32.377 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.378 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.378 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:32.378 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:32.378 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:32.378 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.378 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.378 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:32.378 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:32.378 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:32.378 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.378 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.378 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.378 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:32.378 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:32.379 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.379 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.379 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.379 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:32.379 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:32.379 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.379 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.379 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:32.379 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:32.379 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:32.379 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.379 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.379 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.379 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:32.380 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:32.380 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.380 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.380 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:32.380 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:32.380 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:32.380 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.380 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.380 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:32.380 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:32.380 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:32.380 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.380 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.380 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:32.380 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:32.381 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:32.381 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.381 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.381 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:32.381 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:32.381 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:32.381 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.381 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.381 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:32.381 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:32.381 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:32.381 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.381 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.381 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:32.381 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:32.382 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:32.382 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.382 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.382 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.382 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.382 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.382 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:32.382 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:32.382 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.760359136000005, 2024-04-25T22:41:32.382 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:32.382 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:32.382 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:32.382 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.382 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:32.383 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.383 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:32.383 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:32.383 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.383 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.383 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.383 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:32.383 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:32.383 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.383 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.383 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.383 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:32.383 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:32.383 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:32.383 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.384 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.384 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:32.384 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:32.384 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:32.384 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.384 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.384 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:32.384 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:32.384 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:32.384 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.384 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.384 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.384 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:32.384 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:32.385 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.385 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.385 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.385 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:32.385 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:32.385 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.385 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.385 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:32.385 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:32.385 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:32.385 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.385 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.385 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.385 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:32.386 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:32.386 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.386 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.386 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:32.386 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:32.386 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:32.386 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.386 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.386 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:32.386 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:32.386 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:32.386 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.386 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.386 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:32.387 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:32.387 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:32.387 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.387 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.387 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:32.387 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:32.387 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:32.387 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.387 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.387 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:32.387 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:32.387 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:32.387 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.387 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.387 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:32.388 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:32.388 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:32.388 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.388 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.388 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.388 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.388 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.388 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:32.388 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:32.388 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.760290049999995, 2024-04-25T22:41:32.388 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:32.388 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:32.388 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:32.388 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.388 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:32.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.389 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:32.389 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:32.389 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.389 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.389 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:32.389 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:32.389 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.389 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.389 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:32.389 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:32.389 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:32.390 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.390 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.390 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:32.390 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:32.390 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:32.390 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.390 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.390 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:32.390 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:32.390 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:32.390 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.390 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.390 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.390 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:32.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:32.391 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.391 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.391 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.391 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:32.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:32.391 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.391 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.391 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:32.391 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:32.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:32.391 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.391 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.391 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.392 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:32.392 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:32.392 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.392 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.392 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:32.392 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:32.392 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:32.392 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.392 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.392 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:32.392 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:32.392 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:32.392 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.392 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.392 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:32.393 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:32.393 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:32.393 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.393 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.393 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:32.393 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:32.393 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:32.393 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.393 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.393 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:32.393 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:32.393 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:32.393 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.393 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.393 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:32.394 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:32.394 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:32.394 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.394 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.394 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.394 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.394 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.394 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:32.394 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:32.394 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.760193936999997, 2024-04-25T22:41:32.394 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:32.394 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:32.394 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:32.394 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:32.395 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:32.395 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.395 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:32.395 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:32.395 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.395 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.395 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.395 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:32.395 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:32.395 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.395 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.395 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.395 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:32.395 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:32.396 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:32.396 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.396 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.396 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:32.396 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:32.396 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:32.396 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.396 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.396 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:32.396 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:32.396 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:32.396 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.396 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.396 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.396 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:32.397 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:32.397 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.397 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.397 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.397 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:32.397 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:32.397 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.397 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.397 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:32.397 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:32.397 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:32.397 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.397 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.397 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.398 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:32.398 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:32.398 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.398 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.398 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:32.398 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:32.398 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:32.398 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.398 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.398 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:32.398 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:32.398 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:32.398 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.398 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.399 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.399 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.399 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.399 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:32.399 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:32.399 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.760128275, 2024-04-25T22:41:32.399 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:32.399 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:32.399 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:32.399 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:32.399 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:32.399 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.399 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:32.399 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:32.400 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.400 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.400 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.400 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:32.400 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:32.400 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.400 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.400 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.400 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:32.400 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:32.400 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:32.400 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.400 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.400 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:32.401 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:32.401 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:32.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.401 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.401 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:32.401 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:32.401 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:32.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.401 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.401 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.401 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:32.401 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:32.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.401 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:32.402 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:32.402 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.402 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:32.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:32.402 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:32.402 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.402 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:32.402 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:32.402 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.402 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.403 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:32.403 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:32.403 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:32.403 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.403 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.403 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:32.403 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:32.403 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:32.403 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.403 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.403 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.403 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.403 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.403 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:32.404 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:32.404 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.760059147999996, 2024-04-25T22:41:32.404 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:32.404 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:32.404 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:32.404 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:32.404 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:32.404 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.404 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:32.404 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:32.404 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.404 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.404 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.404 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:32.404 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:32.405 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.405 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.405 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.405 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:32.405 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:32.405 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:32.405 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.405 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.405 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:32.405 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:32.405 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:32.405 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.405 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.405 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:32.405 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:32.406 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:32.406 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.406 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.406 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.406 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:32.406 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:32.406 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.406 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.406 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.406 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:32.406 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:32.406 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.406 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.406 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:32.406 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:32.407 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:32.407 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.407 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.407 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.407 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:32.407 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:32.407 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.407 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.407 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:32.407 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:32.407 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:32.407 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.407 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.407 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:32.407 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:32.408 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:32.408 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.408 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.408 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.408 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.408 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.408 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:32.408 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:32.408 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.749242491999993, 2024-04-25T22:41:32.408 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:32.408 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:32.408 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:32.408 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:32.408 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:32.409 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.409 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:32.409 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:32.409 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.409 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.409 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.409 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:32.409 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:32.409 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.409 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.409 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.409 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:32.409 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:32.409 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:32.409 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.410 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.410 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:32.410 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:32.410 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:32.410 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.410 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.410 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:32.410 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:32.410 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:32.410 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.410 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.410 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.410 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:32.410 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:32.411 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.411 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.411 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.411 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:32.411 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:32.411 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.411 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.411 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:32.411 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:32.411 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:32.411 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.411 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.411 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.411 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.412 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:32.412 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:32.412 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.732344139000006, 2024-04-25T22:41:32.412 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:32.412 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:32.412 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:32.412 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:32.412 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:32.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.412 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:32.412 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:32.412 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.412 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.413 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:32.413 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:32.413 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.413 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.413 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.413 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:32.413 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:32.413 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:32.413 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.413 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.413 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:32.413 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:32.413 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:32.413 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.414 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.414 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:32.414 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:32.414 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:32.414 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.414 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.414 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.414 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:32.414 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:32.414 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.414 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.414 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.414 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:32.414 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:32.415 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.415 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.415 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:32.415 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:32.415 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:32.415 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.415 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.415 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:32.415 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:32.415 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:32.415 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.415 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.415 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.415 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.416 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.416 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:32.416 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:32.416 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.731523249000006, 2024-04-25T22:41:32.416 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:32.416 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:32.416 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:32.416 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:32.416 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:32.416 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.416 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:32.416 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:32.416 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.416 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.417 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.417 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:32.417 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:32.417 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.417 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.417 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.417 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:32.417 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:32.417 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:32.417 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.417 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.417 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:32.417 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:32.417 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:32.417 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.418 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.418 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:32.418 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:32.418 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:32.418 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.418 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.418 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.418 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:32.418 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:32.418 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.418 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.418 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.418 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:32.418 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:32.419 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.419 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.419 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:32.419 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:32.419 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:32.419 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.419 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.419 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:32.419 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:32.419 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:32.419 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.419 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.419 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.419 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.419 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.420 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:32.420 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:32.420 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.729822521000003, 2024-04-25T22:41:32.420 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:32.420 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:32.420 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:32.420 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.420 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:32.420 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.420 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:32.420 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:32.420 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.420 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.420 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.420 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:32.421 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:32.421 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.421 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.421 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.421 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:32.421 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:32.421 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:32.421 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.421 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.421 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:32.421 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:32.421 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:32.421 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.421 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.421 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:32.422 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:32.422 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:32.422 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.422 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.422 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.422 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:32.422 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:32.422 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.422 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.422 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.422 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:32.422 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:32.422 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.422 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.422 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:32.423 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:32.423 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:32.423 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.423 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.423 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:32.423 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:32.423 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:32.423 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.423 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.423 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:32.423 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:32.423 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:32.423 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.423 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.424 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.424 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.424 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.424 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:32.424 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:32.424 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.729225846000006, 2024-04-25T22:41:32.424 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:32.424 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:32.424 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:32.424 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.424 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:32.424 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.424 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:32.424 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:32.424 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.425 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.425 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.425 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:32.425 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:32.425 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.425 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.425 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.425 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:32.425 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:32.425 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:32.425 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.425 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.425 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:32.425 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:32.426 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:32.426 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.426 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.426 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:32.426 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:32.426 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:32.426 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.426 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.426 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.426 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:32.426 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:32.426 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.426 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.427 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.427 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:32.427 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:32.427 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.427 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.427 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:32.427 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:32.427 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:32.427 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.427 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.427 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:32.427 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:32.427 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:32.427 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.428 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.428 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:32.428 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:32.428 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:32.428 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.428 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.428 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.428 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.428 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.428 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:32.428 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:32.428 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.719790119999999, 2024-04-25T22:41:32.428 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:32.428 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:32.428 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:32.429 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:32.429 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:32.429 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.429 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:32.429 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:32.429 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.429 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.429 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.429 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:32.429 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:32.429 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.429 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.429 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.429 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:32.429 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:32.430 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:32.430 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.430 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.430 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:32.430 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:32.430 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:32.430 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.430 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.430 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:32.430 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:32.430 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:32.430 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.430 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.431 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.431 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:32.431 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:32.431 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.431 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.431 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.431 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:32.431 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:32.431 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.431 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.431 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:32.431 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:32.431 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:32.431 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.431 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.432 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.432 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.432 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.432 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:32.432 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:32.432 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.719142693999999, 2024-04-25T22:41:32.432 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:32.432 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:32.432 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:32.432 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.432 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:32.432 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.432 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:32.432 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:32.433 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.433 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.433 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.433 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:32.433 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:32.433 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.433 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.433 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.433 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:32.433 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:32.433 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:32.433 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.433 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.433 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:32.434 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:32.434 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:32.434 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.434 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.434 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:32.434 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:32.434 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:32.434 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.434 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.434 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.434 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:32.434 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:32.434 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.434 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.435 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.435 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:32.435 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:32.435 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.435 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.435 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:32.435 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:32.435 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:32.435 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.435 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.435 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:32.435 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:32.435 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:32.435 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.435 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.436 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:32.436 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:32.436 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:32.436 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.436 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.436 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.436 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.436 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.436 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:32.436 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:32.436 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 77.717701875000003, 2024-04-25T22:41:32.436 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:32.436 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:32.436 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:32.437 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.437 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:32.437 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.437 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:32.437 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:32.437 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.437 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.437 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.437 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:32.437 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:32.437 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.437 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.437 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.437 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:32.438 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:32.438 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:32.438 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.438 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.438 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:32.438 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:32.438 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:32.438 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.438 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.438 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:32.438 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:32.438 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:32.438 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.438 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.439 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.439 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:32.439 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:32.439 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.439 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.439 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.439 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:32.439 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:32.439 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.439 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.439 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:32.439 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:32.439 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:32.439 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.440 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.440 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:32.440 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:32.440 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:32.440 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.440 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.440 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:32.440 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:32.440 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:32.440 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.440 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.440 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.440 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.440 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.440 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:32.441 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:32.441 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 75.765263430999994, 2024-04-25T22:41:32.441 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:32.441 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:32.441 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:32.441 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.441 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:32.441 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.441 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:32.441 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:32.441 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.441 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.441 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.441 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:32.441 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:32.442 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.442 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.442 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.442 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:32.442 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:32.442 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:32.442 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.442 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.442 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:32.442 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:32.442 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:32.442 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.442 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.442 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:32.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:32.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:32.443 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.443 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:32.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:32.443 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.443 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:32.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:32.443 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:32.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:32.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:32.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:32.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:32.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:32.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:32.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:32.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:32.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:32.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:32.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:32.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:32.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:32.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:32.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:32.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:32.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:32.446 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.446 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.446 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.446 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.446 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:32.446 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:32.446 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 53.762604107000001, 2024-04-25T22:41:32.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:32.446 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:32.446 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:32.446 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.446 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:32.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.446 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:32.447 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:32.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.447 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.447 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:32.447 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:32.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.447 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.447 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:32.447 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:32.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:32.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.447 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.447 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:32.448 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:32.448 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:32.448 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.448 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.448 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:32.448 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:32.448 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:32.448 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.448 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.448 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.448 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:32.448 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:32.448 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.448 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.448 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.449 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:32.449 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:32.449 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.449 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:32.449 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:32.449 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:32.449 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.449 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:32.449 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:32.449 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:32.449 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.449 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:32.450 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:32.450 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:32.450 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.450 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.450 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:32.450 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:32.450 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:32.450 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.450 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.450 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:32.450 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:32.450 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:32.450 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.450 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.451 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:32.451 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:32.451 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:32.451 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.451 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.451 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.451 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.451 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.451 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:32.451 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:32.451 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 48.762311855999997, 2024-04-25T22:41:32.451 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:32.451 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:32.451 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:32.451 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.452 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:32.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:32.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:32.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.452 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:32.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:32.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:32.452 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:32.453 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:32.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:32.453 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.453 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.453 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:32.453 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:32.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:32.453 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.453 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.453 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:32.453 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:32.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:32.453 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.453 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.454 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.454 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:32.454 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:32.454 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.454 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.454 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:32.454 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:32.454 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:32.454 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.454 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.454 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:32.454 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:32.454 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:32.454 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.455 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:32.455 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:32.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:32.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.455 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:32.455 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:32.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:32.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.455 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:32.455 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:32.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:32.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.456 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.456 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:32.456 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:32.456 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:32.456 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:32.456 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:32.456 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:32.456 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:32.456 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:32.456 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.456 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.456 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.456 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:32.456 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:32.456 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:32.458 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:32.456+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:32.458 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:32.559 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:32.558+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:32.592 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:32.593 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:32.593 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:41:32.593 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:32.607 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:32.692 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:32.694+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:32.761 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:32.762+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:32.766 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:32.766 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:32.766 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:32.766 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:32.766 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:32.780 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:32.862 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:32.860+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:32.955 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:32.955 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:41:32.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:41:32.955 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:41:32.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.955 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:32.955 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:32.955 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.357347497999996, 2024-04-25T22:41:32.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:41:32.955 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:32.955 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:32.956 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.956 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:32.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:32.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:32.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:32.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:32.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:32.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:32.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:32.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:41:32.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:41:32.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:32.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:41:32.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:41:32.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:32.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:41:32.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:41:32.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:41:32.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:41:32.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:32.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:41:32.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:41:32.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:32.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:41:32.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:41:32.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:32.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:41:32.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:41:32.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:32.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:41:32.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:41:32.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:32.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:41:32.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:41:32.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:32.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:41:32.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:41:32.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:32.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:41:32.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:41:32.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:32.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:41:32.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:41:32.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:32.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:41:32.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:41:32.961 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:32.961 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:32.961 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:32.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.961 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:32.962 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:32.962 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.357259485, 2024-04-25T22:41:32.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:41:32.962 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:32.962 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:32.962 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.962 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:32.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:32.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:32.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:32.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:32.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:32.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:32.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:32.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:41:32.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:41:32.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:32.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:32.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:41:32.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:32.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:41:32.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:41:32.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:41:32.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:41:32.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:32.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:41:32.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:41:32.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:32.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:32.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:41:32.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:32.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:41:32.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:41:32.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:32.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:41:32.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:41:32.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:32.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:41:32.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:41:32.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:32.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:41:32.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:41:32.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:32.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:41:32.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:41:32.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:32.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:41:32.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:41:32.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:32.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:41:32.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:41:32.967 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:32.968 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:32.968 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:32.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.968 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:32.968 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:32.968 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.357187362999994, 2024-04-25T22:41:32.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:41:32.968 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:32.968 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:32.968 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.968 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:32.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:32.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:32.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:32.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:32.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:32.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:32.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:32.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:41:32.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:41:32.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:32.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:41:32.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:41:32.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:32.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:41:32.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:41:32.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:41:32.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:41:32.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:32.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:41:32.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:41:32.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:32.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:41:32.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:41:32.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:32.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:41:32.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:41:32.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:32.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:41:32.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:41:32.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:32.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:41:32.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:41:32.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:32.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:41:32.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:41:32.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:32.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:41:32.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:41:32.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:32.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:41:32.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:41:32.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:32.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:41:32.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:41:32.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:32.974 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:32.974 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:32.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.974 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:32.974 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:32.974 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.357079049999996, 2024-04-25T22:41:32.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:41:32.974 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:32.974 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:32.974 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.974 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:32.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:32.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:32.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:32.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:32.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:32.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:32.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:32.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:41:32.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:41:32.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:32.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:41:32.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:41:32.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:32.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:41:32.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:41:32.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:41:32.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:41:32.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:32.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:41:32.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:41:32.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:32.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:41:32.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:41:32.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:32.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:41:32.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:41:32.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:32.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:41:32.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:41:32.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:32.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:41:32.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:41:32.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:32.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:41:32.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:41:32.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:32.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:41:32.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:41:32.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:32.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:41:32.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:41:32.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:32.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:41:32.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:41:32.979 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:32.979 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:32.979 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:32.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.979 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:32.980 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:32.980 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.357012393999995, 2024-04-25T22:41:32.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:41:32.980 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:32.980 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:32.980 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.980 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:32.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:32.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:32.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:32.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:32.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:32.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:32.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:32.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:41:32.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:41:32.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:32.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:41:32.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:41:32.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:32.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:41:32.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:41:32.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:41:32.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:41:32.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:32.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:41:32.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:41:32.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:32.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:41:32.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:41:32.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:32.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:41:32.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:41:32.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:32.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:41:32.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:41:32.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:32.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:41:32.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:41:32.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:32.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:41:32.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:41:32.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:32.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:41:32.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:41:32.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:32.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:41:32.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:41:32.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:32.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:41:32.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:41:32.985 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:32.985 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:32.985 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:32.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.985 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:32.985 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:32.986 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.356921798000002, 2024-04-25T22:41:32.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:41:32.986 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:32.986 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:32.986 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.986 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:32.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:32.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:32.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:32.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:32.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:32.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:32.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:32.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:41:32.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:41:32.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:32.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:41:32.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:41:32.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:32.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:41:32.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:41:32.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:41:32.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:41:32.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:32.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:41:32.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:41:32.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:32.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:41:32.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:41:32.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:32.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:41:32.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:41:32.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:32.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:41:32.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:41:32.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:32.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:41:32.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:41:32.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:32.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:41:32.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:41:32.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:32.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:41:32.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:41:32.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:32.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:41:32.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:41:32.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:32.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:41:32.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:41:32.991 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:32.991 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:32.991 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:32.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.991 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:32.991 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:32.991 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.356857224999999, 2024-04-25T22:41:32.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:41:32.992 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:32.992 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:32.992 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.992 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:32.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:32.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:32.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:32.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:32.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:32.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:32.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:32.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:41:32.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:41:32.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:32.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:41:32.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:41:32.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:32.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:41:32.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:41:32.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:41:32.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:41:32.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:32.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:32.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:41:32.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:32.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:41:32.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:41:32.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:32.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:41:32.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:41:32.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:32.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:41:32.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:41:32.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:32.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:41:32.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:41:32.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:32.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:41:32.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:41:32.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:32.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:41:32.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:41:32.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:32.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:41:32.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:41:32.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:32.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:41:32.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:41:32.997 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:32.997 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:32.997 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:32.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.997 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:32.997 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:32.997 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.356791802000004, 2024-04-25T22:41:32.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:41:32.997 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:32.997 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:32.997 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:32.997 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:32.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:32.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:32.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:32.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:32.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:32.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:32.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:32.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:41:32.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:32.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:32.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:41:32.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:41:32.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:32.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:41:32.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:41:32.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:32.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:32.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:41:32.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:41:32.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:32.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:41:33.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:41:33.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:33.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:41:33.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:41:33.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:41:33.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:41:33.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:33.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:41:33.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:41:33.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:33.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:41:33.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:41:33.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:33.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:41:33.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:41:33.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:33.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:41:33.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:41:33.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:33.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:41:33.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:41:33.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:33.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:41:33.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:41:33.002 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.002 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:33.002 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.003 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:33.003 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:33.003 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.356735736000005, 2024-04-25T22:41:33.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:41:33.003 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:33.003 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:33.003 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:33.003 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:33.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:33.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:33.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:33.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:33.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:33.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:33.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:41:33.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:33.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:41:33.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:41:33.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:33.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:41:33.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:41:33.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:33.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:41:33.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:41:33.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:41:33.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:41:33.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:33.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:41:33.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:41:33.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:41:33.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:41:33.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:33.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:41:33.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:41:33.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:33.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:41:33.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:41:33.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:33.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:41:33.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:41:33.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:33.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:41:33.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:41:33.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:33.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:41:33.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:41:33.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:33.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:41:33.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:41:33.008 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.008 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:33.008 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.009 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:33.009 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:33.009 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.356668630000001, 2024-04-25T22:41:33.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:41:33.009 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:33.009 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:33.009 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:33.009 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:33.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:33.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:33.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:33.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:33.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:33.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:41:33.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:41:33.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:33.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:41:33.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:41:33.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:33.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:41:33.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:41:33.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:33.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:41:33.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:41:33.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:41:33.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:41:33.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:33.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:41:33.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:41:33.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:41:33.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:41:33.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:33.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:41:33.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:41:33.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:33.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:41:33.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:41:33.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:33.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:41:33.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:41:33.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:33.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:41:33.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:41:33.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:33.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:41:33.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:41:33.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:33.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:41:33.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:41:33.014 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.014 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:33.014 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.015 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:33.015 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:33.015 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.356613507000006, 2024-04-25T22:41:33.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:41:33.015 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:33.015 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:33.015 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:33.015 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:33.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:33.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:33.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:33.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:33.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:33.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:41:33.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:33.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:33.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:41:33.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:41:33.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:33.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:41:33.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:41:33.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:33.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:41:33.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:41:33.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:41:33.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:41:33.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:33.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:41:33.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:41:33.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:41:33.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:41:33.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:33.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:41:33.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:41:33.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:33.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:41:33.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:41:33.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:33.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:41:33.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:41:33.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:33.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:41:33.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:41:33.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:33.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:41:33.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:41:33.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:33.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:41:33.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:41:33.020 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.020 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:33.021 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.021 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:33.021 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:33.021 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.356511268000006, 2024-04-25T22:41:33.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:41:33.021 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:33.021 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:33.021 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:33.021 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:33.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:33.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:33.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:33.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:33.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:33.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:41:33.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:41:33.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:33.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:41:33.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:41:33.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:33.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:41:33.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:41:33.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:33.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:41:33.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:41:33.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:41:33.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:41:33.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:33.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:41:33.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:41:33.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:41:33.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:41:33.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:33.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:41:33.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:41:33.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:33.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:41:33.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:41:33.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:33.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:41:33.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:41:33.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:33.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:41:33.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:41:33.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:33.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:41:33.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:41:33.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:33.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:41:33.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:41:33.027 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.027 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:33.027 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.027 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:33.027 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:33.027 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.356452445000002, 2024-04-25T22:41:33.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:41:33.027 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:33.027 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:33.027 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:33.027 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:33.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:33.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:33.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:33.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:33.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:33.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:41:33.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:41:33.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:33.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:41:33.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:41:33.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:33.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:41:33.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:41:33.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:33.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:41:33.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:41:33.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:41:33.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:41:33.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:33.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:41:33.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:41:33.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:41:33.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:41:33.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:33.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:41:33.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:41:33.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:33.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:41:33.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:41:33.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:33.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:41:33.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:41:33.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:33.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:41:33.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:41:33.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:33.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:41:33.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:41:33.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:33.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:41:33.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:41:33.033 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.033 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:33.033 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.033 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:33.033 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:33.033 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.356373712000007, 2024-04-25T22:41:33.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:41:33.034 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:33.034 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:33.034 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:33.034 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:33.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:33.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:33.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:33.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:33.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:33.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:41:33.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:33.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:33.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:41:33.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:41:33.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:33.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:41:33.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:41:33.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:33.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:41:33.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:41:33.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:41:33.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:41:33.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:33.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:41:33.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:41:33.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:41:33.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:41:33.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:33.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:41:33.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:41:33.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:33.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:41:33.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:41:33.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:33.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:41:33.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:41:33.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:33.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:41:33.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:41:33.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:33.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:41:33.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:41:33.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:33.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:41:33.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:41:33.039 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.039 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:33.039 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.040 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:33.040 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:33.040 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.356334298999997, 2024-04-25T22:41:33.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:41:33.040 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:33.040 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:33.040 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:33.040 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:33.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:33.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:33.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:33.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:33.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:33.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:41:33.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:41:33.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:33.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:41:33.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:41:33.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:33.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:41:33.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:41:33.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:33.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:41:33.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:41:33.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:41:33.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:41:33.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:33.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:41:33.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:41:33.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:41:33.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:41:33.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:33.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:41:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:41:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:41:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:41:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:41:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:41:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:41:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:41:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:41:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:41:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:41:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:41:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.045 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.356264452999994, 2024-04-25T22:41:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:41:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:33.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:41:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:41:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:41:33.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:41:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:41:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:41:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:41:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:41:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:41:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:41:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:41:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:41:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:41:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:41:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:41:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:41:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:41:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:41:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:41:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:41:33.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:41:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:41:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:41:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:41:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:33.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:41:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:41:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.356214715999997, 2024-04-25T22:41:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:41:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:33.052 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:33.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:41:33.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:33.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:33.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:41:33.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:41:33.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:33.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:41:33.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:41:33.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:33.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:41:33.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:41:33.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:41:33.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:41:33.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:33.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:41:33.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:41:33.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:41:33.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:41:33.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:33.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:41:33.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:41:33.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:33.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:41:33.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:41:33.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:33.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:41:33.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:41:33.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:33.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:41:33.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:41:33.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:33.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:33.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:41:33.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:33.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:41:33.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:41:33.057 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.057 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:33.058 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.058 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:33.058 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:33.058 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.356130101000005, 2024-04-25T22:41:33.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:41:33.058 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:33.058 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:33.058 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:33.058 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:33.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:33.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:33.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:33.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:33.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:33.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:41:33.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:33.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:33.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:41:33.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:41:33.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:33.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:41:33.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:41:33.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:33.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:41:33.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:41:33.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:41:33.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:41:33.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:33.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:41:33.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:41:33.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:41:33.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:41:33.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:33.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:41:33.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:41:33.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:33.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:41:33.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:41:33.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:33.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:41:33.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:41:33.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:33.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:41:33.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:41:33.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:33.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:41:33.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:41:33.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:33.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:41:33.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:41:33.064 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.064 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:33.064 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.064 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:33.064 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:33.064 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.356066451000004, 2024-04-25T22:41:33.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:41:33.064 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:33.064 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:33.064 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:41:33.064 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:33.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:33.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:33.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:33.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:33.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:33.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:41:33.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:41:33.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:33.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:41:33.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:41:33.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:33.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:41:33.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:41:33.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:33.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:41:33.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:41:33.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:41:33.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:41:33.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:33.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:41:33.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:41:33.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:41:33.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:41:33.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:33.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:41:33.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:41:33.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:33.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:41:33.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:41:33.068 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.068 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:33.068 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.069 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:33.069 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:33.069 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 78.349062920999998, 2024-04-25T22:41:33.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:41:33.069 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:33.069 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:33.069 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:33.069 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:33.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:33.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:33.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:33.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:33.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:33.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:33.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:41:33.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:41:33.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:33.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:41:33.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:41:33.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:33.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:41:33.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:41:33.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:33.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:41:33.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:41:33.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:33.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:41:33.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:41:33.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:33.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:41:33.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:41:33.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:33.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:41:33.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:41:33.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:33.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:33.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:33.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:41:33.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:41:33.073 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.073 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:33.073 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.073 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:33.073 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:33.073 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:33.074 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:33.075 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:33.074+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:33.154 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:41:33.175 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:33.174+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:33.207 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:33.207 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:33.207 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:33.207 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:33.221 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:33.276 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:33.278+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:33.342 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is unset 2024-04-25T22:41:33.345 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:33.345 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:33.345 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:33.345 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:33.345 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:33.359 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:33.369 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:33.369 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:33.377 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:33.378+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:33.403 INFO:teuthology.orchestra.run.smithi057.stdout:osd.1: {} 2024-04-25T22:41:33.403 INFO:teuthology.orchestra.run.smithi057.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:41:33.434 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:33.435 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:33.476 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:33.476 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:33.477 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:33.478+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:33.491 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:33.578 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:33.576+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:33.621 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:33.622 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:33.636 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:33.680 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:33.682+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:33.752 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:33.752 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:33.766 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:33.781 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:33.776+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:33.882 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:33.880+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:33.922 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:33.923 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:33.936 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:33.983 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:33.980+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:34.068 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:34.068 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:34.082 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:34.083 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:34.082+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:34.184 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:34.180+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:34.193 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:41:34.248 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:34.249 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:34.262 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:34.285 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:34.286+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:34.303 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-04-25T22:41:34.386 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:34.386+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:34.434 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:34.434 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:34.448 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:34.487 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:34.484+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:34.579 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:34.579 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:34.588 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:34.590+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:34.594 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:34.689 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:34.690+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:34.757 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:34.757 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:34.772 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:34.791 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:34.788+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:34.891 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:34.888+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:34.935 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:34.935 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:34.950 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:34.994 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:34.992+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:35.081 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:35.081 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:35.093 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:35.094+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:35.095 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:35.137 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-25T22:41:35.194 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:35.194+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:35.258 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:35.259 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:35.274 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:35.295 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:35.294+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:35.364 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:41:35.397 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:35.394+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:35.404 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:35.405 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:35.419 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:35.455 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:41:35.496 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:35.492+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:35.549 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:35.550 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:35.563 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:35.597 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:35.596+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:35.656 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:35.657 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:35.657 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:41:35.687 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:35.687 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:35.687 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:35.687 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:35.687 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:35.691 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:35.691 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:35.695 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:41:35.695 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:41:35.698 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:35.698+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:35.702 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:35.799 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:35.800+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:35.871 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:41:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:41:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:41:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.274166875000006, 2024-04-25T22:41:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:41:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:41:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:41:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:41:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:41:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:41:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:41:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:41:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:41:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:41:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:41:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:41:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:41:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:41:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:41:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:41:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:41:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:41:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:41:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:41:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:41:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:41:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:41:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:41:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:41:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:41:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:41:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.274078861999996, 2024-04-25T22:41:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:41:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:41:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:41:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:41:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:41:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:41:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:41:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:41:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:41:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:41:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:41:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:41:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:41:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:41:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:41:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:41:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:41:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:41:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:41:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:41:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:41:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:41:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:41:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:41:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:41:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.274006740000004, 2024-04-25T22:41:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:41:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:41:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:41:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:41:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:41:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:41:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:41:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:41:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:41:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:41:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:41:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:41:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:41:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:41:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:41:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:41:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:41:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:41:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:41:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:41:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:41:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:35.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:41:35.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:41:35.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:35.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:41:35.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:41:35.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:35.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:41:35.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:41:35.891 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.891 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.891 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.891 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:35.891 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:35.891 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.273898427000006, 2024-04-25T22:41:35.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:41:35.892 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:35.892 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:35.892 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:35.892 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:35.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:35.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:35.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:35.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:35.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:35.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:41:35.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:41:35.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:35.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:41:35.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:41:35.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:35.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:41:35.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:41:35.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:35.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:41:35.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:41:35.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:41:35.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:41:35.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:35.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:41:35.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:41:35.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:41:35.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:41:35.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:35.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:41:35.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:41:35.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:35.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:41:35.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:41:35.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:35.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:41:35.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:41:35.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:35.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:41:35.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:41:35.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:35.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:41:35.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:41:35.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:35.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:41:35.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:41:35.897 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.897 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.898 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.898 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:35.898 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:35.898 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.273831771000005, 2024-04-25T22:41:35.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:41:35.898 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:35.898 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:35.898 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:35.898 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:35.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:35.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:35.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:35.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:35.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:35.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:41:35.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:41:35.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:35.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:41:35.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:41:35.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:35.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:41:35.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:41:35.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:35.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:41:35.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:41:35.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:41:35.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:41:35.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:35.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:41:35.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:41:35.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:41:35.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:41:35.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:35.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:41:35.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:41:35.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:35.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:41:35.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:41:35.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:35.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:41:35.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:41:35.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:35.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:41:35.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:41:35.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:35.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:41:35.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:41:35.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:35.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:41:35.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:41:35.904 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.904 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.904 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.904 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:35.904 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:35.904 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.273741174999998, 2024-04-25T22:41:35.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:41:35.904 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:35.904 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:35.904 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:35.904 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:35.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:35.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:35.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:35.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:35.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:35.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:41:35.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:41:35.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:35.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:41:35.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:41:35.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:35.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:41:35.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:41:35.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:35.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:41:35.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:41:35.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:41:35.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:41:35.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:35.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:41:35.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:41:35.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:41:35.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:41:35.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:35.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:41:35.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:41:35.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:35.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:41:35.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:41:35.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:35.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:41:35.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:41:35.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:35.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:41:35.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:41:35.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:35.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:41:35.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:41:35.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:35.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:41:35.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:41:35.910 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.910 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.910 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.910 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:35.910 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:35.910 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.273676601999995, 2024-04-25T22:41:35.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:41:35.910 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:35.910 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:35.910 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:35.910 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:35.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:35.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:35.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:35.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:35.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:35.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:41:35.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:41:35.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:35.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:41:35.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:41:35.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:35.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:41:35.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:41:35.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:35.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:41:35.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:41:35.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:35.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:41:35.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:35.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:41:35.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:41:35.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:41:35.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:41:35.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:35.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:41:35.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:41:35.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:35.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:41:35.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:41:35.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:35.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:41:35.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:41:35.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:35.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:41:35.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:41:35.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:35.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:41:35.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:41:35.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:35.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:41:35.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:41:35.916 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.916 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.916 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.916 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:35.916 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:35.916 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.273611179, 2024-04-25T22:41:35.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:41:35.916 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:35.916 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:35.916 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:35.916 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:35.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:41:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:41:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:41:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:41:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:41:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:41:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:41:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:41:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:41:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:41:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:41:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:41:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:41:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:41:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:41:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:41:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:41:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:41:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:41:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:41:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:41:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:41:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:41:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:41:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:41:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.273555113, 2024-04-25T22:41:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:41:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:41:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:41:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:41:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:41:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:41:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:41:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:41:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:41:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:41:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:41:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:41:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:41:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:41:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:41:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:41:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:41:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:41:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:41:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:41:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:41:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:41:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:41:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:41:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:41:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:41:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.273488006999997, 2024-04-25T22:41:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:41:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:41:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:41:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:41:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:41:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:41:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:41:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:41:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:41:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:41:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:41:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:41:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:41:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:41:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:41:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:41:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:41:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:41:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:41:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:41:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:41:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:41:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:41:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:41:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:41:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:41:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:41:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.273432884000002, 2024-04-25T22:41:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:41:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:41:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:41:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:41:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:41:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:41:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:41:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:41:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:41:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:41:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:41:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:41:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:41:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:41:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:41:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:41:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:41:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:41:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:41:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:41:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:41:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:41:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:41:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:41:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:41:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:41:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.273330645000001, 2024-04-25T22:41:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:41:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:41:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:41:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:41:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:41:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:41:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:41:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:41:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:41:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:41:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:41:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:41:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:41:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:41:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:41:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:41:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:41:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:41:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:41:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:41:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:41:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:41:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:41:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:41:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:41:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:41:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:41:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.273271821999998, 2024-04-25T22:41:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:41:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:41:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:41:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:41:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:41:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:41:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:41:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:41:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:41:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:41:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:41:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:41:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:41:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:41:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:41:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:41:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:41:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:41:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:41:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:41:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:41:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:41:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:41:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:41:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:41:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:41:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:41:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.273193089000003, 2024-04-25T22:41:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:41:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:41:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:41:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:41:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:41:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:41:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:41:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:41:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:41:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:41:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:41:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:41:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:41:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:41:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:41:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:41:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:41:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:41:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:41:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:41:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:41:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:41:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:41:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:41:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:41:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:41:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.273153676000007, 2024-04-25T22:41:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:41:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:41:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:41:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:41:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:41:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:41:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:41:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:41:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:41:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:41:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:41:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:41:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:41:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:41:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:41:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:41:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:41:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:41:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:41:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:41:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:41:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:41:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:41:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:41:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:41:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:41:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:41:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.273083830000004, 2024-04-25T22:41:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:41:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:41:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:41:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:41:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:41:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:41:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:41:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:41:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:41:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:41:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:41:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:41:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:41:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:41:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:41:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:41:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:41:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:41:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:41:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:41:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:41:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:41:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:41:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:41:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:41:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:41:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:41:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.273034093000007, 2024-04-25T22:41:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:41:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:41:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:41:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:41:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:41:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:41:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:41:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:41:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:41:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:41:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:41:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:41:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:41:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:41:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:41:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:41:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:41:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:41:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:41:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:41:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:41:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:41:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:41:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:41:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:41:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.272949478000001, 2024-04-25T22:41:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:41:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:41:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:41:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:41:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:41:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:41:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:41:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:41:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:41:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:41:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:41:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:41:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:41:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:41:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:41:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:41:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:41:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:41:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:41:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:41:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:41:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:41:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:41:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:41:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:41:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:41:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.272885828, 2024-04-25T22:41:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:41:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:41:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:41:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:41:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:41:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:41:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:41:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:41:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:41:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:41:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:41:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:41:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:41:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:41:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:41:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:41:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:41:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:41:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:41:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:41:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 81.265882297999994, 2024-04-25T22:41:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:41:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:41:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:41:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:41:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:41:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:41:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:41:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:41:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:41:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:41:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:41:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:41:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:41:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:41:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:41:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:41:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:41:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:35.989 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:35.991 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:35.991 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:35.990+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:36.092 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:36.094+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:36.123 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:36.123 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:36.123 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:36.123 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:36.138 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:36.193 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:36.188+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:36.261 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:36.261 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:36.261 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:36.262 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:36.262 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:36.275 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:36.294 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:36.294+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:36.389 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is set 2024-04-25T22:41:36.394 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:36.392+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:36.444 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:36.444 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:36.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:36.444 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:36.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.444 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:36.444 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:36.444 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 81.847533671999997, 2024-04-25T22:41:36.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:36.444 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:36.445 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:36.445 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.445 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:36.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:36.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:36.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:36.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:36.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:36.446 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:36.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:36.446 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.446 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:36.446 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:36.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:36.446 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.446 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:36.446 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:36.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:36.446 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.447 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.447 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:36.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:36.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.447 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.447 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.447 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:36.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:36.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.447 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.447 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:36.447 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:36.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:36.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.448 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.448 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.448 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:36.448 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:36.448 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.448 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.448 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:36.448 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:36.448 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:36.448 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.448 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.448 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:36.448 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:36.448 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:36.449 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.449 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:36.449 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:36.449 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:36.449 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.449 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:36.449 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:36.449 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:36.449 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.449 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:36.449 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:36.449 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:36.450 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.450 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.450 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:36.450 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:36.450 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:36.450 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.450 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.450 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.450 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.450 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.450 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:36.450 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:36.450 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 81.847396415999995, 2024-04-25T22:41:36.451 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:36.451 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:36.451 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:36.451 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.451 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:36.451 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.451 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:36.451 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:36.451 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.451 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.451 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.451 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:36.451 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:36.451 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.451 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:36.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:36.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:36.452 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:36.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:36.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:36.452 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:36.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:36.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:36.453 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.453 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.453 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.453 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:36.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:36.453 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.453 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.453 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.453 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:36.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:36.453 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.453 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.453 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:36.453 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:36.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:36.454 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.454 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.454 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.454 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:36.454 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:36.454 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.454 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.454 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:36.454 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:36.454 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:36.454 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.454 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.454 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:36.454 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:36.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:36.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.455 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:36.455 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:36.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:36.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.455 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:36.455 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:36.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:36.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.455 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:36.456 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:36.456 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:36.456 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.456 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.456 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:36.456 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:36.456 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:36.456 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.456 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.456 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.456 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.456 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.456 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:36.456 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:36.456 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 81.847308863999999, 2024-04-25T22:41:36.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:36.457 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:36.457 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:36.457 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.457 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:36.457 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.457 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:36.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:36.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.457 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.457 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.457 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:36.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:36.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.458 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.458 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:36.458 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:36.458 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:36.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.458 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.458 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:36.458 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:36.458 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:36.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.458 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.458 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:36.458 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:36.458 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:36.459 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.459 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.459 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.459 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:36.459 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:36.459 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.459 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.459 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.459 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:36.459 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:36.459 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.459 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.459 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:36.459 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:36.459 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:36.460 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.460 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.460 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.460 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:36.460 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:36.460 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.460 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.460 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:36.460 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:36.460 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:36.460 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.460 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.460 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:36.460 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:36.461 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:36.461 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.461 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.461 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:36.461 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:36.461 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:36.461 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.461 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.461 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:36.461 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:36.461 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:36.461 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.461 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.461 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:36.461 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:36.462 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:36.462 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.462 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.462 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:36.462 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:36.462 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:36.462 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.462 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.462 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.462 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.462 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.462 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:36.462 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:36.462 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 81.847205037999998, 2024-04-25T22:41:36.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:36.463 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:36.463 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:36.463 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.463 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:36.463 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:36.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:36.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.463 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.463 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:36.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:36.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.463 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.464 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.464 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:36.464 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:36.464 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:36.464 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.464 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.464 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:36.464 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:36.464 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:36.464 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.464 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.464 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:36.464 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:36.464 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:36.464 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.465 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.465 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.465 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:36.465 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:36.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.465 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.465 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.465 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:36.465 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:36.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.465 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.465 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:36.465 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:36.465 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:36.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.466 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.466 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.466 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:36.466 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:36.466 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.466 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.466 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:36.466 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:36.466 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:36.466 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.466 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.466 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:36.466 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:36.466 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:36.467 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.467 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.467 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:36.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:36.467 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:36.467 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.467 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.467 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:36.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:36.467 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:36.467 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.467 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.467 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:36.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:36.467 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:36.468 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.468 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.468 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:36.468 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:36.468 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:36.468 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.468 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.468 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.468 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.468 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.468 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:36.468 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:36.468 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 81.847136247999998, 2024-04-25T22:41:36.468 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:36.469 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:36.469 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:36.469 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.469 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:36.469 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.469 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:36.469 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:36.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.469 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.469 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.469 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:36.469 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:36.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.469 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.469 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.470 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:36.470 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:36.470 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:36.470 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.470 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.470 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:36.470 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:36.470 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:36.470 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.470 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.470 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:36.470 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:36.470 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:36.470 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:36.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:36.471 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:36.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:36.471 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:36.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:36.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:36.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.472 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:36.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:36.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:36.472 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:36.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:36.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:36.472 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:36.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:36.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.473 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:36.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:36.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:36.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.473 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:36.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:36.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:36.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.473 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:36.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:36.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:36.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.474 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:36.474 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:36.474 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:36.474 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.474 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.474 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.474 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.474 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:36.474 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:36.474 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 81.847067162000002, 2024-04-25T22:41:36.474 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:36.474 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:36.475 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:36.475 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.475 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:36.475 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.475 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:36.475 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:36.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.475 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.475 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.475 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:36.475 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:36.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.475 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.475 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.475 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:36.476 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:36.476 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:36.476 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.476 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:36.476 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:36.476 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:36.476 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.476 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:36.476 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:36.476 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:36.476 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.476 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:36.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:36.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:36.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:36.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:36.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:36.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:36.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.478 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:36.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:36.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.478 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:36.478 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:36.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:36.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.478 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:36.478 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:36.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:36.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.478 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:36.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:36.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:36.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:36.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:36.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:36.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:36.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:36.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:36.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:36.480 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:36.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:36.480 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.480 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.480 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.480 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.480 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:36.480 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:36.480 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 81.846971049000004, 2024-04-25T22:41:36.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:36.480 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:36.480 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:36.480 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:36.480 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:36.481 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.481 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:36.481 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:36.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.481 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.481 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:36.481 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:36.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.481 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.481 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:36.481 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:36.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:36.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.482 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.482 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:36.482 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:36.482 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:36.482 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.482 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.482 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:36.482 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:36.482 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:36.482 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.482 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.482 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.482 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:36.482 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:36.482 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:36.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:36.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:36.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:36.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:36.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:36.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:36.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.484 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:36.484 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:36.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:36.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.484 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:36.484 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:36.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:36.484 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.484 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.484 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.485 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.485 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:36.485 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:36.485 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 81.846905387000007, 2024-04-25T22:41:36.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:36.485 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:36.485 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:36.485 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:36.485 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:36.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.485 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:36.485 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:36.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.485 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.486 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.486 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:36.486 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:36.486 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.486 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.486 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.486 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:36.486 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:36.486 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:36.486 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.486 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.486 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:36.486 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:36.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:36.487 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:36.487 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:36.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:36.487 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.487 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:36.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:36.487 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.488 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:36.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:36.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.488 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:36.488 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:36.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:36.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.488 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.488 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:36.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:36.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.488 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:36.489 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:36.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:36.489 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:36.489 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:36.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:36.489 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.489 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.489 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.489 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.489 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:36.489 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:36.489 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 81.846836260000003, 2024-04-25T22:41:36.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:36.490 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:36.490 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:36.490 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:36.490 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:36.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:36.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:36.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:36.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:36.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:36.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:36.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:36.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:36.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:36.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:36.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:36.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:36.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:36.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:36.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:36.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:36.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:36.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:36.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:36.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:36.493 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.493 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.493 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:36.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:36.493 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.493 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:36.493 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:36.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:36.493 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.493 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:36.493 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:36.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:36.494 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.494 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.494 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.494 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.494 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.494 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:36.494 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:36.494 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 81.836019604000001, 2024-04-25T22:41:36.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:36.494 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:36.494 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:36.494 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:36.494 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:36.494 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:36.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:36.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:36.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:36.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:36.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:36.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:36.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:36.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:36.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:36.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:36.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:36.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:36.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:36.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:36.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:36.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:36.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:36.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:36.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:36.497 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.497 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.497 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.498 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:36.498 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:36.498 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 81.819121250999999, 2024-04-25T22:41:36.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:36.498 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:36.498 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:36.498 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:36.498 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:36.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:36.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:36.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:36.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:36.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:36.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:36.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:36.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:36.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:36.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:36.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.500 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:36.500 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:36.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:36.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.500 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.500 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:36.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:36.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.500 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.500 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:36.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:36.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:36.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:36.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:36.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:36.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:36.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:36.501 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.501 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.501 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.501 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:36.502 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:36.502 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 81.818300360999999, 2024-04-25T22:41:36.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:36.502 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:36.502 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:36.502 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:36.502 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:36.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:36.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:36.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:36.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:36.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:36.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:36.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:36.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:36.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:36.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:36.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:36.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:36.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:36.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:36.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:36.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:36.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:36.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:36.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:36.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:36.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.505 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:36.505 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:36.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:36.505 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.505 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.505 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.505 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:36.505 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:36.505 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 81.816599632999996, 2024-04-25T22:41:36.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:36.506 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:36.506 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:36.506 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.506 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:36.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:36.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:36.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:36.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:36.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:36.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:36.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:36.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:36.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:36.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:36.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:36.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:36.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:36.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:36.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:36.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:36.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:36.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:36.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:36.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:36.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:36.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:36.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:36.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:36.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:36.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:36.509 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.509 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.509 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.510 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:36.510 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:36.510 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 81.816002957999999, 2024-04-25T22:41:36.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:36.510 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:36.510 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:36.510 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.510 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:36.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:36.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:36.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:36.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:36.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:36.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:36.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:36.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:36.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:36.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:36.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:36.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:36.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:36.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:36.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:36.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:36.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:36.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:36.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:36.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:36.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:36.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:36.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:36.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:36.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:36.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:36.513 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.514 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.514 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.514 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:36.514 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:36.514 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 81.806567232000006, 2024-04-25T22:41:36.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:36.514 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:36.514 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:36.514 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:36.514 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:36.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:36.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:36.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:36.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:36.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:36.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:36.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:36.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:36.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:36.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:36.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:36.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:36.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:36.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:36.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:36.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:36.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:36.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:36.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:36.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:36.517 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.517 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.517 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.517 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:36.517 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:36.517 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 81.805919806000006, 2024-04-25T22:41:36.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:36.518 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:36.518 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:36.518 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.518 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:36.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:36.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:36.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:36.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:36.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:36.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:36.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:36.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:36.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:36.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:36.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:36.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:36.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:36.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:36.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:36.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:36.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:36.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:36.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:36.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:36.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:36.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:36.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:36.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:36.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:36.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:36.521 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.521 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.521 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.521 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:36.521 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:36.522 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 81.804478986999996, 2024-04-25T22:41:36.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:36.522 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:36.522 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:36.522 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.522 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:36.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:36.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:36.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:36.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:36.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:36.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:36.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:36.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:36.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:36.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:36.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:36.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:36.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:36.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:36.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:36.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:36.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:36.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:36.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:36.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:36.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:36.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:36.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:36.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:36.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:36.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:36.525 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.525 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.525 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.526 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:36.526 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:36.526 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 79.852040543000001, 2024-04-25T22:41:36.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:36.526 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:36.526 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:36.526 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.526 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:36.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:36.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:36.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:36.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:36.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:36.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:36.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:36.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:36.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:36.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:36.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:36.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:36.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:36.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:36.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:36.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:36.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:36.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:36.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:36.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:36.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:36.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:36.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:36.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:36.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:36.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:36.530 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:36.530 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:36.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:36.530 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:36.530 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:36.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:36.530 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:36.530 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:36.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:36.531 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.531 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.531 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.531 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:36.531 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:36.531 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 57.849381219000001, 2024-04-25T22:41:36.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:36.531 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:36.531 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:36.531 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.531 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:36.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:36.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:36.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:36.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:36.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:36.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:36.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:36.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:36.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:36.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:36.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:36.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:36.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:36.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:36.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:36.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:36.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:36.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:36.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:36.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:36.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:36.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:36.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:36.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:36.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:36.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:36.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:36.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:36.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:36.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:36.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:36.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:36.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:36.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:36.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:36.536 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.536 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.536 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.536 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:36.536 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:36.536 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 52.849088967999997, 2024-04-25T22:41:36.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:36.536 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:36.536 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:36.536 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.537 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:36.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:36.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:36.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:36.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:36.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:36.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:36.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:36.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:36.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:36.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:36.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:36.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:36.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:36.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:36.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:36.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:36.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:36.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:36.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:36.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:36.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:36.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:36.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:36.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:36.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:36.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:36.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:36.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:36.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:36.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:36.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:36.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:36.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:36.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:36.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:36.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:36.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:36.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:36.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:36.541 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.541 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.541 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.541 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:36.541 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:36.541 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:36.543 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:36.540+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:36.543 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:36.644 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:36.644+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:36.673 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:36.673 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:36.673 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:41:36.673 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:36.687 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:36.744 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:36.744+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:36.809 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:36.809 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:36.809 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:36.810 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:36.810 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:36.823 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:36.868 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:36.870+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:36.946 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:36.944+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:36.949 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:41:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:41:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:41:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.351488947000007, 2024-04-25T22:41:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:41:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.949 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:41:36.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:41:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:41:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:41:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:41:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:41:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:41:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:41:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:41:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:41:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:41:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:41:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:41:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:41:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:41:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:41:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:41:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:41:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:41:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:41:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:41:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:41:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:41:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:41:36.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:41:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:41:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.351400933999997, 2024-04-25T22:41:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:41:36.955 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:36.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:41:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:41:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:41:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:41:36.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:41:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:41:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:41:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:41:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:41:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:41:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:41:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:41:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:41:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:41:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:41:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:41:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:41:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:41:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:41:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:41:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:41:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:41:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:41:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:41:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.351328812000006, 2024-04-25T22:41:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:41:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:36.962 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:41:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:41:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:41:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:41:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:41:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:41:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:41:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:41:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:41:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:41:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:41:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:41:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:41:36.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:41:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:41:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:41:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:41:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:41:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:36.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:41:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:41:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:41:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:41:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:41:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:41:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:36.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:41:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:41:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.351220498999993, 2024-04-25T22:41:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:41:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:41:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:41:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:41:36.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:41:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:41:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:41:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:41:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:41:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:41:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:41:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:41:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:41:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:41:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:41:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:41:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:41:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:41:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:41:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:41:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:41:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:41:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:41:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:41:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:41:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:41:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:41:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.351153843000006, 2024-04-25T22:41:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:41:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:41:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:41:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:41:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:41:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:41:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:41:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:41:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:41:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:41:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:41:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:41:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:41:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:41:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:41:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:41:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:41:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:41:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:41:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:41:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:41:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:41:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:41:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:41:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:41:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:41:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:41:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.351063246999999, 2024-04-25T22:41:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:41:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:41:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:41:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:41:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:41:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:41:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:41:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:41:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:41:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:41:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:41:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:41:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:41:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:41:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:41:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:41:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:41:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:41:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:41:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:41:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:41:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:41:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:41:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:41:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:41:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:41:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:41:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.350998673999996, 2024-04-25T22:41:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:41:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:41:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:41:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:41:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:41:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:41:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:41:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:41:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:41:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:41:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:41:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:41:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:41:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:41:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:41:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:41:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:41:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:41:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:41:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:41:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:41:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:41:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:41:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:41:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:41:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:41:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.350933251000001, 2024-04-25T22:41:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:41:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:41:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:41:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:41:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:41:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:41:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:41:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:41:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:41:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:41:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:41:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:41:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:41:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:41:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:41:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:41:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:41:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:41:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:41:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:41:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:41:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:41:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:41:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:41:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:41:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:41:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.350877185000002, 2024-04-25T22:41:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:41:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:41:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:41:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:41:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:41:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:41:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:41:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:41:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:41:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:41:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:41:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:41:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:41:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:41:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:41:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:41:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:41:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:41:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:41:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:41:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:41:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:41:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:41:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:41:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:41:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:41:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.350810078999999, 2024-04-25T22:41:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:41:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:41:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:41:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:41:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:41:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:41:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:41:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:41:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:41:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:41:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:41:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:41:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:41:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:41:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:41:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:41:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:41:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:41:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:41:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:41:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:41:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:41:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:41:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:41:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:41:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:41:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:41:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.350754956000003, 2024-04-25T22:41:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:41:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:41:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:41:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:41:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:41:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:41:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:41:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:41:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:41:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:41:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:41:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:41:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:41:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:41:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:41:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:41:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:41:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:41:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:41:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:41:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:41:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:41:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:41:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:41:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:41:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:41:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.350652717000003, 2024-04-25T22:41:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:41:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:41:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:41:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:41:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:41:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:41:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:41:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:41:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:41:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:41:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:41:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:41:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:41:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:41:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:41:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:41:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:41:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:41:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:41:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:41:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:41:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:41:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:41:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:41:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:41:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:41:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:41:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.350593893999999, 2024-04-25T22:41:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:41:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:41:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:41:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:41:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:41:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:41:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:41:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:41:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:41:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:41:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:41:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:41:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:41:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:41:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:41:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:41:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:41:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:41:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:41:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:41:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:41:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:41:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:41:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:41:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:41:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:41:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:41:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.350515161000004, 2024-04-25T22:41:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:41:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:41:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:41:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:41:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:41:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:41:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:41:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:41:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:41:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:41:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:41:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:41:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:41:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:41:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:41:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:41:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:41:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:41:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:41:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:41:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:41:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:41:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:41:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:41:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:41:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:41:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.350475747999994, 2024-04-25T22:41:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:41:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:41:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:41:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:41:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:41:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:41:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:41:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:41:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:41:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:41:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:41:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:41:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:41:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:41:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:41:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:41:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:41:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:41:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:41:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:41:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:41:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:41:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:41:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:41:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:41:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:41:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:41:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.350405902000006, 2024-04-25T22:41:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:41:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:41:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:41:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:41:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:41:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:41:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:41:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:41:37.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:41:37.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:41:37.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:41:37.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:37.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:41:37.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:41:37.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:41:37.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:41:37.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:37.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:41:37.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:41:37.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:37.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:41:37.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:41:37.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:37.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:41:37.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:41:37.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:37.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:41:37.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:41:37.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:37.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:41:37.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:41:37.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:37.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:41:37.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:41:37.041 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.041 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:37.041 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.041 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:37.041 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:37.041 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.350356164999994, 2024-04-25T22:41:37.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:41:37.041 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:37.041 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:37.042 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.042 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:37.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:37.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:37.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:37.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:37.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:37.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:41:37.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:37.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:37.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:41:37.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:41:37.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:37.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:41:37.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:41:37.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:41:37.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:41:37.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:41:37.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:41:37.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:37.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:41:37.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:41:37.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:41:37.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:41:37.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:37.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:41:37.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:41:37.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:37.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:41:37.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:41:37.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:37.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:41:37.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:41:37.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:37.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:41:37.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:41:37.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:37.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:37.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:41:37.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:37.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:41:37.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:41:37.047 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.047 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:37.047 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.047 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:37.047 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:37.047 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.350271550000002, 2024-04-25T22:41:37.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:41:37.047 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:37.047 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:37.047 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.048 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:37.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:37.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:37.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:37.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:37.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:37.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:41:37.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:37.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:37.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:41:37.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:41:37.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:37.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:41:37.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:41:37.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:41:37.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:41:37.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:41:37.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:41:37.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:37.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:41:37.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:41:37.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:41:37.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:41:37.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:37.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:41:37.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:41:37.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:37.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:41:37.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:41:37.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:37.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:41:37.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:41:37.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:37.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:41:37.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:41:37.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:37.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:41:37.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:41:37.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:37.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:41:37.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:41:37.053 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.053 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:37.053 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.053 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:37.053 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:37.053 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.350207900000001, 2024-04-25T22:41:37.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:41:37.053 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:37.054 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:37.054 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:41:37.054 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:37.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:37.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:37.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:37.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:37.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:37.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:41:37.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:41:37.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:37.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:41:37.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:41:37.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:37.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:41:37.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:41:37.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:41:37.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:41:37.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:41:37.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:41:37.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:37.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:41:37.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:41:37.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:41:37.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:41:37.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:37.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:41:37.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:41:37.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:37.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:41:37.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:41:37.057 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.057 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:37.057 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.058 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:37.058 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:37.058 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 82.343204369999995, 2024-04-25T22:41:37.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:41:37.058 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:37.058 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:37.058 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.058 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:37.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:37.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:37.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:37.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:37.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:37.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:37.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:41:37.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:41:37.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:37.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:41:37.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:41:37.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:37.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:41:37.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:41:37.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:41:37.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:41:37.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:37.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:41:37.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:41:37.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:37.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:41:37.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:41:37.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:37.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:41:37.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:41:37.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:37.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:37.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:37.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:41:37.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:41:37.061 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.061 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:37.061 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.062 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:37.062 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:37.062 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:37.063 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:37.064 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:37.060+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:37.164 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:37.166+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:37.195 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:37.195 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:37.195 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:37.195 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:37.209 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:37.265 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:37.266+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:37.330 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:37.331 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:37.331 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:37.331 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:37.331 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:37.345 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:37.367 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:37.366+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:37.468 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:37.470+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:37.469 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:37.469 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:37.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 82.871926701999996, 2024-04-25T22:41:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 82.871789445999994, 2024-04-25T22:41:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 82.871701893999997, 2024-04-25T22:41:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 82.871598067999997, 2024-04-25T22:41:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 82.871529277999997, 2024-04-25T22:41:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 82.871460192000001, 2024-04-25T22:41:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 82.871364079000003, 2024-04-25T22:41:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 82.871298417000006, 2024-04-25T22:41:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 82.871229290000002, 2024-04-25T22:41:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 82.860412633999999, 2024-04-25T22:41:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 82.843514280999997, 2024-04-25T22:41:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 82.842693390999997, 2024-04-25T22:41:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 82.840992662999994, 2024-04-25T22:41:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 82.840395987999997, 2024-04-25T22:41:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 82.830960262000005, 2024-04-25T22:41:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 82.830312836000004, 2024-04-25T22:41:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 82.828872016999995, 2024-04-25T22:41:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:37.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:37.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:37.550 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 80.876433573, 2024-04-25T22:41:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:37.551 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:37.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:37.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.557 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.873774249, 2024-04-25T22:41:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:37.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:37.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:37.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 53.873481998000003, 2024-04-25T22:41:37.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:37.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:37.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:37.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:37.569 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:37.569 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:37.571 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:37.572 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:37.570+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:37.672 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:37.674+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:37.696 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:41:37.702 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:37.702 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:37.702 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:41:37.702 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:37.716 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:37.809 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:37.810+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:37.874 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:37.872+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:37.885 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:37.885 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:37.885 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:37.885 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:37.885 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:37.893 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:37.893 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:37.893 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:41:37.899 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:37.928 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:37.931 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:41:37.932 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:41:37.975 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:37.976+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:38.062 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:38.062 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:38.076 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:38.077 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:38.073+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:38.176 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:38.177+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:38.211 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:38.211 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:38.225 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:38.278 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:38.276+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:38.304 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:41:38.342 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:38.342 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:38.356 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:38.379 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:38.377+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:38.413 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-04-25T22:41:38.416 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:41:38.479 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:38.476+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:38.519 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:38.519 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:38.533 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:38.580 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:38.581+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:38.665 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:38.665 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:38.681 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:38.681 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:38.681+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:38.781 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:38.780+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:38.844 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:38.844 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:38.858 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:38.883 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:38.880+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:38.974 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:38.975 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:38.983 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:38.981+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:38.989 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:39.084 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:39.085+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:39.121 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:39.121 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:39.136 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:39.184 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:39.180+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:39.258 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:39.258 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:39.272 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:39.286 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:39.285+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:39.387 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:39.385+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:39.412 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is set 2024-04-25T22:41:39.440 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:39.440 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:39.454 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:39.500 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:39.501+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:39.585 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:39.585 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:39.589 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:39.589+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:39.600 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:39.689 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:39.689+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:39.760 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:39.761 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:39.774 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:39.790 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:39.788+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:39.891 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:39.888+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:39.933 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:41:39.942 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:39.943 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:39.958 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:40.006 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:40.004+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:40.089 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:40.089 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:40.092 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:40.088+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:40.103 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:40.130 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:40.130 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:40.130 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:41:40.161 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:40.162 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:40.165 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:41:40.166 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:41:40.193 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:40.188+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:40.269 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:40.269 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:40.270 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:40.270 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:40.270 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:40.284 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:40.294 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:40.293+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:40.395 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:40.393+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:40.454 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:40.454 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:40.454 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:40.454 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:40.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.455 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:40.455 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:40.455 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.855348589000002, 2024-04-25T22:41:40.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:40.456 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:40.456 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:40.456 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:40.456 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:40.456 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.456 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:40.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:40.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.457 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.457 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.457 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:40.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:40.458 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.458 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.458 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:40.458 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:40.458 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:40.459 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.459 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.459 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:40.459 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:40.459 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:40.460 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.460 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.460 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:40.460 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:40.460 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:40.460 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.461 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.461 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:40.461 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:40.461 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:40.461 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.461 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.462 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.462 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:40.462 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:40.462 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.462 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:40.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:40.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:40.463 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.463 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.464 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.464 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:40.464 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:40.464 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.464 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.464 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:40.465 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:40.465 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:40.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.465 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.465 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:40.466 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:40.466 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:40.466 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.466 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.466 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:40.466 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:40.467 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:40.467 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.467 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.467 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:40.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:40.468 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:40.468 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.468 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.468 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:40.468 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:40.468 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:40.469 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.469 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.469 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:40.469 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:40.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:40.469 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.470 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.470 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.470 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.470 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.470 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:40.471 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:40.471 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.855211333, 2024-04-25T22:41:40.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:40.471 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:40.471 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:40.471 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:40.472 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:40.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:40.472 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:40.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.473 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:40.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:40.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.474 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:40.474 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:40.474 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:40.474 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.475 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:40.475 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:40.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:40.475 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.475 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.475 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:40.476 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:40.476 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:40.476 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.476 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:40.476 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:40.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:40.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:40.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:40.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.478 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:40.478 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:40.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:40.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:40.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:40.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.480 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:40.480 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:40.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:40.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.480 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.480 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:40.481 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:40.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:40.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.481 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.481 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:40.482 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:40.482 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:40.482 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.482 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.482 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:40.482 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:40.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:40.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:40.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:40.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:40.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.484 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:40.484 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:40.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:40.485 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.485 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.485 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.485 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.485 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:40.486 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:40.486 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.855123781000003, 2024-04-25T22:41:40.486 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:40.486 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:40.486 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:40.486 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:40.487 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:40.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:40.487 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:40.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.488 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:40.488 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:40.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:40.489 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:40.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:40.489 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:40.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:40.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:40.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:40.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:40.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:40.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:40.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:40.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:40.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:40.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:40.493 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.493 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:40.493 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:40.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:40.494 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.494 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.494 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.494 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:40.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:40.494 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:40.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:40.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:40.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:40.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:40.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:40.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:40.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:40.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:40.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:40.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:40.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:40.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:40.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:40.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:40.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:40.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:40.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:40.500 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.500 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.500 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.501 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:40.501 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:40.501 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.855019955000003, 2024-04-25T22:41:40.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:40.501 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:40.502 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:40.502 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:40.502 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:40.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:40.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:40.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:40.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:40.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:40.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:40.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:40.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.505 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:40.505 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:40.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:40.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:40.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:40.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:40.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:40.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:40.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:40.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:40.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:40.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:40.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:40.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:40.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:40.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:40.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:40.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:40.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:40.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:40.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:40.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:40.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:40.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:40.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:40.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:40.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:40.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:40.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:40.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:40.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:40.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:40.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:40.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:40.515 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.515 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.515 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.516 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:40.516 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:40.516 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.854951165000003, 2024-04-25T22:41:40.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:40.517 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:40.517 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:40.517 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:40.517 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:40.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:40.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:40.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:40.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:40.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:40.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:40.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:40.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:40.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:40.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:40.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:40.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:40.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:40.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:40.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:40.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:40.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:40.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:40.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:40.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:40.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:40.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:40.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:40.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:40.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:40.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:40.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:40.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:40.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:40.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:40.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:40.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:40.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:40.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:40.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:40.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:40.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:40.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:40.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:40.530 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:40.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:40.530 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.530 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.531 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.531 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:40.531 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:40.531 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.854882079000006, 2024-04-25T22:41:40.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:40.532 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:40.532 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:40.532 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:40.532 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:40.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:40.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:40.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:40.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:40.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:40.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:40.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:40.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:40.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:40.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:40.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:40.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:40.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:40.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:40.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:40.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:40.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:40.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:40.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:40.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:40.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:40.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:40.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:40.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:40.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:40.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:40.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:40.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:40.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:40.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:40.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:40.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:40.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:40.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:40.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:40.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:40.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:40.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:40.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:40.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:40.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:40.541 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.541 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.541 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.541 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:40.541 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:40.541 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.854785965999994, 2024-04-25T22:41:40.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:40.541 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:40.542 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:40.542 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:40.542 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:40.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:40.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:40.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:40.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:40.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:40.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:40.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:40.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:40.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:40.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:40.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:40.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:40.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:40.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:40.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:40.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:40.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:40.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:40.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:40.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:40.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:40.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:40.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:40.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:40.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:40.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:40.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:40.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:40.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:40.545 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.545 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.545 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.545 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:40.545 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:40.546 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.854720303999997, 2024-04-25T22:41:40.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:40.546 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:40.546 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:40.546 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:40.546 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:40.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:40.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:40.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:40.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:40.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:40.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:40.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:40.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:40.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:40.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:40.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:40.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:40.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:40.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:40.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:40.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:40.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:40.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:40.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:40.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:40.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:40.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:40.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:40.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:40.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:40.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:40.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.550 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:40.550 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:40.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:40.550 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.550 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.550 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.550 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.550 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.550 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:40.550 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:40.550 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.854651176999994, 2024-04-25T22:41:40.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:40.550 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:40.550 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:40.551 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:40.551 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:40.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:40.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:40.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:40.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:40.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:40.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:40.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:40.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:40.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:40.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:40.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:40.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:40.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:40.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:40.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:40.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:40.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:40.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:40.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:40.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:40.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:40.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:40.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:40.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:40.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:40.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:40.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:40.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:40.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:40.554 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.554 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.555 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.555 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:40.555 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:40.555 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.843834521000005, 2024-04-25T22:41:40.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:40.555 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:40.555 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:40.555 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:40.555 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:40.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:40.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:40.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:40.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:40.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:40.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:40.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:40.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:40.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:40.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:40.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:40.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:40.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:40.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:40.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:40.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:40.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:40.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:40.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:40.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:40.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:40.558 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.558 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.558 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.558 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:40.558 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:40.558 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.826936168000003, 2024-04-25T22:41:40.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:40.558 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:40.559 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:40.559 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:40.559 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:40.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:40.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:40.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:40.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:40.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:40.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:40.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:40.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:40.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:40.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:40.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:40.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:40.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:40.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:40.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:40.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:40.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:40.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:40.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:40.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:40.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:40.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:40.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:40.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:40.562 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.562 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.562 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.562 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:40.562 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:40.562 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.826115278000003, 2024-04-25T22:41:40.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:40.562 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:40.562 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:40.562 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:40.562 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:40.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:40.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:40.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:40.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:40.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:40.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:40.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:40.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:40.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:40.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:40.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:40.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:40.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:40.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:40.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:40.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:40.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:40.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:40.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:40.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:40.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:40.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:40.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:40.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:40.565 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.565 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.565 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.566 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:40.566 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:40.566 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.82441455, 2024-04-25T22:41:40.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:40.566 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:40.566 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:40.566 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:40.566 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:40.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:40.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:40.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:40.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:40.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:40.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:40.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:40.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:40.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:40.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:40.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:40.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:40.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:40.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:40.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:40.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:40.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:40.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:40.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:40.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:40.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:40.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:40.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:40.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:40.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:40.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:40.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:40.570 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.570 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.570 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.570 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.570 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:40.570 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:40.570 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.823817875000003, 2024-04-25T22:41:40.570 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:40.570 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:40.570 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:40.570 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:40.570 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:40.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.570 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:40.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:40.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:40.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:40.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:40.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:40.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:40.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:40.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:40.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:40.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:40.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:40.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:40.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:40.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:40.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:40.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:40.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:40.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:40.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:40.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:40.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:40.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:40.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:40.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:40.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:40.574 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:40.574 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.574 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.574 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.574 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.574 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:40.574 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:40.574 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.814382148999997, 2024-04-25T22:41:40.574 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:40.574 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:40.574 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:40.574 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:40.574 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:40.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:40.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:40.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:40.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:40.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:40.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:40.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:40.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:40.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:40.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:40.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:40.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:40.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:40.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:40.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:40.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:40.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:40.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:40.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:40.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:40.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:40.577 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.577 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.577 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.577 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:40.577 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:40.577 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.813734722999996, 2024-04-25T22:41:40.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:40.577 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:40.577 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:40.577 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:40.578 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:40.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:40.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:40.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:40.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:40.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:40.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:40.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:40.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:40.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:40.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:40.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:40.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:40.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:40.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:40.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:40.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:40.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:40.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:40.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:40.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:40.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:40.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:40.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:40.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:40.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:40.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:40.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:40.581 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.581 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.581 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.581 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:40.581 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:40.581 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.812293904000001, 2024-04-25T22:41:40.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:40.581 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:40.581 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:40.581 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:40.582 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:40.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:40.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:40.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:40.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:40.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:40.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:40.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:40.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:40.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:40.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:40.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:40.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:40.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:40.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:40.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:40.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:40.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:40.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:40.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:40.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:40.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:40.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:40.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:40.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:40.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:40.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:40.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:40.585 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.585 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.585 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.585 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:40.585 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:40.585 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 83.859855460000006, 2024-04-25T22:41:40.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:40.585 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:40.585 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:40.585 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:40.585 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:40.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.586 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:40.586 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:40.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.586 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.586 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:40.586 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:40.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.586 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.586 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:40.586 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:40.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:40.586 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:40.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:40.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:40.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:40.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:40.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:40.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:40.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:40.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:40.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:40.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:40.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:40.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:40.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:40.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:40.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:40.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:40.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:40.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:40.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:40.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:40.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:40.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:40.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:40.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:40.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:40.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:40.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:40.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:40.590 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.590 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.590 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.590 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:40.590 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:40.590 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 61.857196135999999, 2024-04-25T22:41:40.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:40.590 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:40.591 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:40.591 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:40.591 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:40.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.591 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:40.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:40.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.591 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:40.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:40.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.592 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:40.592 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:40.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:40.592 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.592 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.592 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:40.592 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:40.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:40.592 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.592 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.592 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:40.592 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:40.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:40.592 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.592 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:40.593 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:40.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:40.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.593 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:40.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:40.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:40.593 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:40.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:40.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:40.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:40.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:40.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:40.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:40.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:40.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:40.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:40.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:40.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:40.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:40.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:40.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:40.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:40.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:40.595 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.595 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.595 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.595 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:40.595 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:40.595 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 56.856903885000001, 2024-04-25T22:41:40.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:40.596 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:40.596 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:40.596 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:40.596 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:40.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:40.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:40.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:40.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:40.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:40.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:40.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:40.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:40.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:40.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:40.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:40.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:40.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:40.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:40.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:40.598 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:40.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:40.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:40.598 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:40.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:40.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:40.598 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:40.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:40.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:40.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:40.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:40.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:40.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:40.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:40.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:40.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:40.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:40.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:40.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:40.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:40.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:40.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:40.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:40.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:40.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:40.600 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.600 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.600 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.600 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:40.600 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:40.600 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:40.602 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:40.602 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:40.601+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:40.703 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:40.701+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:40.734 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:41:40.734 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:40.748 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:40.837 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:40.837+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:40.904 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:40.904+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:40.916 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:40.916 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:40.916 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:40.916 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:40.916 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:40.931 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:41.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~6s 2024-04-25T22:41:41.021 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:41.021+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:41.097 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:41.097 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:41:41.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:41:41.097 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:41:41.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.097 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.097 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:41.097 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.500747172999993, 2024-04-25T22:41:41.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:41:41.098 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:41.098 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:41.098 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.098 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:41.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:41.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:41.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:41.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:41.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:41.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:41:41.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:41:41.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:41.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:41:41.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:41:41.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:41.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:41:41.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:41:41.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:41:41.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:41:41.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:41:41.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:41:41.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:41.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:41:41.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:41:41.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:41:41.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:41:41.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:41.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:41:41.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:41:41.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:41.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:41:41.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:41:41.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:41:41.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:41:41.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:41.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:41:41.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:41:41.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:41.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:41:41.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:41:41.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:41.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:41:41.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:41:41.104 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.104 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.104 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.104 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.104 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:41.104 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.500659159999998, 2024-04-25T22:41:41.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:41:41.104 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:41.104 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:41.104 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.104 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:41.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:41.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:41.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:41.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:41.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:41.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:41:41.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:41:41.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:41.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:41.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:41:41.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:41.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:41:41.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:41:41.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:41:41.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:41:41.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:41:41.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:41:41.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:41.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:41.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:41:41.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:41:41.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:41:41.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:41.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:41:41.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:41:41.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:41.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:41:41.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:41:41.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:41.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:41:41.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:41:41.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:41:41.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:41:41.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:41.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:41:41.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:41:41.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:41.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:41:41.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:41:41.110 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.110 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.110 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.110 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.110 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:41.110 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.500587038000006, 2024-04-25T22:41:41.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:41:41.111 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:41.111 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:41.111 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.111 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:41.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:41.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:41.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:41.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:41.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:41.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:41:41.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:41:41.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:41.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:41:41.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:41:41.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:41.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:41:41.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:41:41.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:41:41.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:41:41.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:41:41.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:41:41.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:41.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:41:41.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:41:41.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:41:41.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:41:41.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:41.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:41:41.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:41:41.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:41.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:41:41.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:41:41.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:41:41.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:41:41.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:41.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:41:41.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:41:41.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:41.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:41:41.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:41:41.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:41.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:41:41.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:41:41.116 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.116 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.116 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.116 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.116 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:41.117 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.500478724999994, 2024-04-25T22:41:41.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:41:41.117 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:41.117 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:41.117 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.117 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:41.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:41.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:41.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:41.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:41.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:41.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:41:41.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:41:41.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:41.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:41:41.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:41:41.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:41.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:41:41.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:41:41.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:41:41.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:41:41.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:41:41.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:41:41.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:41.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:41:41.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:41:41.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:41:41.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:41:41.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:41.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:41:41.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:41:41.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:41.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:41:41.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:41:41.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:41:41.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:41:41.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:41.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:41:41.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:41:41.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:41.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:41:41.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:41:41.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:41.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:41:41.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:41:41.122 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.122 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.122 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.123 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.123 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:41.123 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.500412069000006, 2024-04-25T22:41:41.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:41:41.123 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:41.123 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:41.123 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.123 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:41.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:41.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:41.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:41.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:41.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:41.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:41:41.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:41:41.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:41.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:41:41.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:41:41.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:41.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:41:41.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:41:41.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:41:41.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:41:41.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:41:41.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:41:41.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:41.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:41:41.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:41:41.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:41:41.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:41:41.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:41:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:41:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:41:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:41:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:41:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:41:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:41:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:41:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:41:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:41:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:41:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:41:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.500321473, 2024-04-25T22:41:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:41:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:41:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:41:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:41:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:41:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:41:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:41:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:41:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:41:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:41:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:41:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:41:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:41:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:41:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:41:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:41:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:41:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:41:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:41:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:41:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:41:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:41:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:41:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:41:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:41:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:41:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:41:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.500256899999997, 2024-04-25T22:41:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:41:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:41:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:41:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:41:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:41:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:41:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:41:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:41:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:41:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:41:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:41:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:41:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:41:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:41:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:41:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:41:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:41:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:41:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:41:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:41:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:41:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:41:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:41:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:41:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:41:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:41:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.500191477000001, 2024-04-25T22:41:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:41:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:41:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:41:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:41:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:41:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:41:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:41:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:41:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:41:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:41:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:41:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:41:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:41:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:41:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:41:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:41:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:41:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:41:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:41:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:41:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:41:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:41:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:41:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:41:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:41:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:41:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.500135411000002, 2024-04-25T22:41:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:41:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:41:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:41:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:41:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:41:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:41:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:41:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:41:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:41:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:41:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:41:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:41:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:41:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:41:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:41:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:41:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:41:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:41:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:41:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:41:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:41:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:41:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:41:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:41:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:41:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:41:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.500068304999999, 2024-04-25T22:41:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:41:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:41:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:41:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:41:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:41:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:41:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:41:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:41:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:41:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:41:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:41:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:41:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:41:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:41:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:41:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:41:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:41:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:41:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:41:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:41:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:41:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:41:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:41:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:41:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:41:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:41:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:41:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.500013182000004, 2024-04-25T22:41:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:41:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:41:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:41:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:41:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:41:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:41:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:41:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:41:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:41:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:41:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:41:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:41:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:41:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:41:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:41:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:41:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:41:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:41:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:41:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:41:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:41:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:41:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:41:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:41:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:41:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:41:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.499910943000003, 2024-04-25T22:41:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:41:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:41:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:41:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:41:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:41:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:41:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:41:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:41:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:41:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:41:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:41:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:41:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:41:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:41:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:41:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:41:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:41:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:41:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:41:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:41:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:41:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:41:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:41:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:41:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:41:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:41:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:41:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.49985212, 2024-04-25T22:41:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:41:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:41:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:41:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:41:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:41:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:41:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:41:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:41:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:41:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:41:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:41:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:41:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:41:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:41:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:41:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:41:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:41:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:41:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:41:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:41:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:41:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:41:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:41:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:41:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:41:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:41:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:41:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.499773387000005, 2024-04-25T22:41:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:41:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:41:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:41:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:41:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:41:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:41:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:41:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:41:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:41:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:41:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:41:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:41:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:41:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:41:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:41:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:41:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:41:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:41:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:41:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:41:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:41:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:41:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:41:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:41:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:41:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:41:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.499733973999994, 2024-04-25T22:41:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:41:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:41:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:41:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:41:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:41:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:41:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:41:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:41:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:41:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:41:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:41:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:41:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:41:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:41:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:41:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:41:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:41:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:41:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:41:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:41:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:41:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:41:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:41:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:41:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:41:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:41:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:41:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.499664128000006, 2024-04-25T22:41:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:41:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:41:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:41:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:41:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:41:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:41:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:41:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:41:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:41:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:41:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:41:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:41:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:41:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:41:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:41:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:41:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:41:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:41:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:41:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:41:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:41:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:41:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:41:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:41:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:41:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:41:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:41:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.499614390999994, 2024-04-25T22:41:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:41:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:41:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:41:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:41:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:41:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:41:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:41:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:41:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:41:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:41:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:41:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:41:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:41:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:41:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:41:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:41:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:41:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:41:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:41:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:41:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:41:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:41:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:41:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:41:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:41:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.499529776000003, 2024-04-25T22:41:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:41:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:41:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:41:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:41:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:41:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:41:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:41:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:41:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:41:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:41:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:41:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:41:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:41:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:41:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:41:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:41:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:41:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:41:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:41:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:41:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:41:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:41:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:41:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:41:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:41:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:41:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.499466126000002, 2024-04-25T22:41:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:41:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:41:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:41:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:41:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:41:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:41:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:41:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:41:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:41:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:41:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:41:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:41:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:41:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:41:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:41:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:41:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:41:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:41:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:41:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:41:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 86.492462595999996, 2024-04-25T22:41:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:41:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:41:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:41:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:41:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:41:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:41:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:41:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:41:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:41:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:41:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:41:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:41:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:41:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:41:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:41:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:41:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:41:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:41.218 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:41.220 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:41.220 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:41.220+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:41.321 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:41.316+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:41.350 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:41.350 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:41.350 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:41.351 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:41.365 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:41.436 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:41:41.450 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:41.448+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:41.522 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:41.522 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:41.522 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:41.522 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:41.523 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:41.523 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:41.521+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:41.536 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:41.623 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:41.621+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:41.699 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:41.954 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:41.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:41.954 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:41.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 87.100998920999999, 2024-04-25T22:41:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:41.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:41.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:41.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:41.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:41.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 87.100861664999996, 2024-04-25T22:41:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:41.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:41.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:41.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:41.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 87.100774113, 2024-04-25T22:41:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:41.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:41.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:41.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:41.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:41.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:41.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:41.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:41.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:41.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:41.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:41.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:41.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:41.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:41.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:41.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:41.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:41.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:41.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:41.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:41.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:41.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:41.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:41.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:41.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:41.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:41.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:41.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:41.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:41.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:41.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:41.972 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:41.972 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:41.972 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:41.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.972 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.973 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:41.973 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 87.100670287, 2024-04-25T22:41:41.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:41.973 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:41.973 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:41.973 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.973 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:41.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.973 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:41.973 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:41.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:41.973 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.973 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:41.973 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:41.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:41.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:41.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:41.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:41.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:41.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:41.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:41.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:41.975 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:41.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:41.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.975 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.975 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:41.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:41.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.975 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:41.975 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:41.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:41.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.975 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:41.978 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 87.100601497, 2024-04-25T22:41:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:41.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:41.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:41.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 87.100532411000003, 2024-04-25T22:41:41.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.988 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:41.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 87.100436298000005, 2024-04-25T22:41:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:41.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.994 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 87.100370635999994, 2024-04-25T22:41:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:41.995 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 87.100301509000005, 2024-04-25T22:41:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:41.999 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:42.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:42.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:42.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 87.089484853000002, 2024-04-25T22:41:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:42.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 87.0725865, 2024-04-25T22:41:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:42.007 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:42.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:42.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:42.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 87.07176561, 2024-04-25T22:41:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:42.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:42.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 87.070064881999997, 2024-04-25T22:41:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.016 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.018 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 87.069468207, 2024-04-25T22:41:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:42.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:42.021 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:42.022 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 87.060032480999993, 2024-04-25T22:41:42.023 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:42.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:42.026 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 87.059385055000007, 2024-04-25T22:41:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.027 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:42.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:42.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 87.057944235999997, 2024-04-25T22:41:42.031 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.032 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:42.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:42.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 85.105505792000002, 2024-04-25T22:41:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.036 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:42.037 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.038 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.039 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:42.040 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 63.102846468000003, 2024-04-25T22:41:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:42.042 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.043 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.044 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.045 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 58.102554216999998, 2024-04-25T22:41:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:42.047 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:42.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:42.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:42.050 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:42.051 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:42.052 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:42.052+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:42.053 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:42.154 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:42.148+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:42.166 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:41:42.182 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:42.182 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:42.182 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:41:42.182 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:42.196 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:42.255 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:42.253+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:42.315 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:42.315 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:42.315 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:42.315 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:42.315 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:42.328 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:42.368 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:42.369 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:42.369 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:41:42.373 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:42.373+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:42.403 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:42.403 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:42.407 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:41:42.407 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:41:42.414 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:41:42.437 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is unset 2024-04-25T22:41:42.457 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:42.452+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:42.497 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:42.497 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:42.511 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:42.524 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-04-25T22:41:42.558 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:42.557+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:42.625 INFO:teuthology.orchestra.console.smithi148:Power off completed 2024-04-25T22:41:42.646 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:42.646 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:42.658 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:42.657+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:42.661 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:42.760 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:42.757+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:42.782 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:42.782 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:42.796 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:42.861 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:42.856+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:42.912 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:42.912 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:42.928 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:42.973 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:42.973+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:43.057 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:43.057 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:43.062 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:43.061+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:43.071 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:43.164 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:43.164+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:43.237 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:43.237 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:43.251 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:43.265 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:43.260+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:43.365 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:43.360+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:43.372 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:43.372 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:43.386 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:43.466 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:43.465+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:43.517 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:43.517 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:43.531 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:43.578 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:43.576+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:43.648 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:43.648 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:43.662 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:43.706 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:43.704+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:43.769 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:43.764+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:43.828 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:43.828 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:43.842 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:43.886 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:43.884+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:43.970 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:43.969+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:43.976 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:43.976 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:43.990 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:44.077 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:44.077+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:44.154 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:44.154 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:44.168 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:44.213 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:44.213+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:44.272 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:44.269+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:44.336 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:44.336 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:44.350 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:44.393 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:44.393+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:44.408 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:41:44.462 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:41:44.474 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:44.468+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:44.482 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:44.483 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:44.498 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:44.575 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:44.573+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:44.612 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:44.613 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:44.613 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:41:44.646 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:44.646 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:44.650 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:41:44.650 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:41:44.667 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:44.667 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:44.667 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:44.667 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:44.667 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:44.676 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:44.672+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:44.681 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:44.776 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:44.777+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:44.842 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:44.842 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:44.843 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:44.843 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:44.843 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.843 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:44.843 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:44.843 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 90.244184860999994, 2024-04-25T22:41:44.843 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:44.843 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:44.843 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:44.843 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:44.843 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:44.843 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.843 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:44.843 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:44.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:44.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:44.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:44.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:44.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:44.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:44.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:44.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:44.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:44.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:44.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:44.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:44.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:44.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:44.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:44.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:44.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:44.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:44.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:44.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:44.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:44.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:44.847 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:44.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:44.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.847 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:44.847 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:44.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:44.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.847 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:44.847 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:44.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:44.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:44.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:44.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:44.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:44.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:44.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:44.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:44.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:44.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:44.849 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.849 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.849 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.849 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:44.849 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:44.849 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 90.244047605000006, 2024-04-25T22:41:44.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:44.849 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:44.849 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:44.849 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:44.849 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:44.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:44.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:44.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:44.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:44.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:44.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:44.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:44.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:44.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:44.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:44.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:44.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:44.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:44.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:44.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:44.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:44.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:44.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:44.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:44.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:44.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:44.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:44.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:44.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:44.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:44.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:44.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:44.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:44.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:44.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:44.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:44.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:44.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:44.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:44.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:44.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.854 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:44.854 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:44.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:44.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.854 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:44.854 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:44.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:44.854 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.854 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.854 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.855 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:44.855 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:44.855 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 90.243960052999995, 2024-04-25T22:41:44.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:44.855 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:44.855 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:44.855 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:44.855 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:44.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:44.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:44.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:44.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:44.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:44.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:44.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:44.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:44.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:44.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:44.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:44.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:44.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:44.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:44.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:44.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:44.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:44.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:44.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:44.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:44.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:44.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:44.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:44.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:44.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:44.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:44.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:44.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:44.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:44.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:44.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:44.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:44.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:44.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:44.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:44.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:44.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:44.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:44.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:44.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:44.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:44.860 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.860 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.860 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.860 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:44.860 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:44.860 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 90.243856226999995, 2024-04-25T22:41:44.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:44.861 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:44.861 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:44.861 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:44.861 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:44.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:44.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:44.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:44.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:44.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:44.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:44.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:44.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:44.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:44.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:44.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:44.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:44.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:44.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:44.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:44.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:44.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:44.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:44.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:44.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:44.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:44.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:44.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:44.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:44.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:44.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:44.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:44.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:44.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:44.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:44.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:44.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:44.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:44.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:44.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:44.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:44.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:44.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:44.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:44.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:44.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:44.866 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.866 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.866 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.866 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:44.866 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:44.866 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 90.243787436999995, 2024-04-25T22:41:44.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:44.866 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:44.866 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:44.866 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:44.866 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:44.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:44.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:44.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:44.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:44.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:44.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:44.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:44.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:44.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:44.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:44.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:44.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:44.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:44.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:44.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:44.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:44.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:44.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:44.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:44.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:44.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:44.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:44.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:44.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:44.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:44.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:44.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:44.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:44.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:44.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:44.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:44.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:44.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:44.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:44.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:44.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:44.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:44.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:44.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:44.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:44.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:44.871 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.872 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.872 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.872 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:44.872 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:44.872 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 90.243718350999998, 2024-04-25T22:41:44.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:44.872 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:44.872 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:44.872 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:44.872 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:44.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:44.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:44.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:44.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:44.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:44.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:44.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:44.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:44.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:44.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:44.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:44.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:44.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:44.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:44.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:44.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:44.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:44.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:44.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:44.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:44.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:44.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:44.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:44.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:44.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:44.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:44.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:44.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:44.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:44.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:44.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:44.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:44.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:44.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:44.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:44.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:44.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:44.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:44.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:44.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:44.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:44.877 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.877 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.877 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.878 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:44.878 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:44.878 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 90.243622238, 2024-04-25T22:41:44.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:44.878 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:44.878 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:44.878 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:44.878 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:44.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:44.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:44.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:44.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:44.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:44.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:44.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:44.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:44.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:44.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:44.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:44.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:44.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:44.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:44.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:44.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:44.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:44.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:44.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:44.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:44.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:44.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:44.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:44.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:44.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:44.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:44.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:44.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:44.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:44.882 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.882 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.882 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.882 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:44.882 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:44.882 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 90.243556576000003, 2024-04-25T22:41:44.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:44.882 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:44.882 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:44.882 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:44.882 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:44.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.882 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:44.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:44.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:44.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:44.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:44.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:44.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:44.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:44.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:44.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:44.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:44.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:44.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:44.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:44.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:44.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:44.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:44.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:44.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:44.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:44.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:44.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:44.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:44.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:44.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:44.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:44.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:44.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:44.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:44.886 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.886 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.886 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.886 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:44.886 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:44.886 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 90.243487449, 2024-04-25T22:41:44.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:44.886 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:44.886 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:44.887 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:44.887 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:44.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:44.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:44.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:44.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:44.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:44.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:44.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:44.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:44.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:44.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:44.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:44.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:44.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:44.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:44.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:44.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:44.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:44.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:44.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:44.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:44.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:44.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:44.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:44.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:44.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:44.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:44.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:44.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:44.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:44.890 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.890 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.890 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.890 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:44.891 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:44.891 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 90.232670792999997, 2024-04-25T22:41:44.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:44.891 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:44.891 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:44.891 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:44.891 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:44.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:44.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:44.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:44.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:44.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:44.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:44.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:44.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:44.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:44.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:44.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:44.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:44.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:44.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:44.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:44.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:44.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:44.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:44.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:44.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:44.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:44.894 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.894 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.894 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.894 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:44.894 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:44.894 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 90.215772439999995, 2024-04-25T22:41:44.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:44.894 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:44.894 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:44.894 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:44.894 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:44.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:44.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:44.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:44.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:44.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:44.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:44.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:44.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:44.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:44.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:44.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:44.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:44.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:44.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:44.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:44.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:44.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:44.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:44.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:44.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:44.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:44.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:44.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:44.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:44.897 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.897 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.897 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.898 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:44.898 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:44.898 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 90.214951549999995, 2024-04-25T22:41:44.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:44.898 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:44.898 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:44.898 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:44.898 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:44.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:44.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:44.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:44.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:44.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:44.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:44.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:44.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:44.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:44.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:44.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:44.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:44.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:44.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:44.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:44.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:44.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:44.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:44.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:44.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:44.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:44.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:44.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:44.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:44.901 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.901 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.901 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.901 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:44.901 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:44.901 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 90.213250822000006, 2024-04-25T22:41:44.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:44.901 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:44.901 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:44.902 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:44.902 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:44.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:44.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:44.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:44.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:44.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:44.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:44.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:44.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:44.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:44.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:44.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:44.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:44.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:44.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:44.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:44.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:44.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:44.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:44.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:44.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:44.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:44.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:44.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:44.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:44.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:44.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:44.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:44.905 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.905 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.905 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.905 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:44.905 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:44.905 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 90.212654146999995, 2024-04-25T22:41:44.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:44.906 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:44.906 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:44.906 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:44.906 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:44.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:44.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:44.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:44.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:44.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:44.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:44.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:44.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:44.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:44.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:44.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:44.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:44.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:44.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:44.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:44.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:44.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:44.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:44.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:44.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:44.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:44.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:44.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:44.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:44.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:44.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:44.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:44.909 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.909 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.909 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.909 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:44.910 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:44.910 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 90.203218421000003, 2024-04-25T22:41:44.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:44.910 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:44.910 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:44.910 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:44.910 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:44.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:44.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:44.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:44.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:44.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:44.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:44.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:44.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:44.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:44.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:44.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:44.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:44.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:44.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:44.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:44.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:44.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:44.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:44.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:44.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:44.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:44.913 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.913 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.913 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.913 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:44.913 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:44.913 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 90.202570995000002, 2024-04-25T22:41:44.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:44.913 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:44.913 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:44.913 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:44.914 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:44.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:44.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:44.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:44.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:44.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:44.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:44.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:44.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:44.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:44.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:44.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:44.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:44.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:44.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:44.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:44.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:44.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:44.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:44.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:44.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:44.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:44.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:44.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:44.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:44.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:44.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:44.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:44.917 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.917 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.917 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.917 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:44.917 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:44.917 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 90.201130176000007, 2024-04-25T22:41:44.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:44.917 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:44.918 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:44.918 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:44.918 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:44.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:44.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:44.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:44.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:44.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:44.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:44.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:44.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:44.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:44.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:44.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:44.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:44.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:44.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:44.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:44.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:44.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:44.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:44.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:44.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:44.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:44.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:44.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:44.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:44.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:44.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:44.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:44.921 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.921 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.921 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.921 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:44.921 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:44.921 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 88.248691731999998, 2024-04-25T22:41:44.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:44.922 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:44.922 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:44.922 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:44.922 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:44.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:44.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:44.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:44.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:44.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:44.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:44.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:44.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:44.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:44.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:44.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:44.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:44.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:44.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:44.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:44.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:44.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:44.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:44.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:44.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:44.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:44.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:44.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:44.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:44.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:44.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:44.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:44.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:44.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:44.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:44.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:44.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:44.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:44.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:44.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:44.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:44.926 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.926 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.926 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.926 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:44.926 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:44.926 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 66.246032408000005, 2024-04-25T22:41:44.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:44.926 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:44.927 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:44.927 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:44.927 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:44.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:44.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:44.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:44.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:44.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:44.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:44.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:44.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:44.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:44.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:44.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:44.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:44.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:44.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:44.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:44.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:44.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:44.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:44.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:44.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:44.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:44.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:44.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:44.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:44.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:44.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:44.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:44.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:44.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:44.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:44.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:44.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:44.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:44.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:44.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:44.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:44.931 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.931 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.931 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.931 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:44.931 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:44.931 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 61.245740157, 2024-04-25T22:41:44.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:44.933 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:44.933 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:44.933 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:44.933 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:44.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:44.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:44.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:44.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:44.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:44.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:44.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:44.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:44.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:44.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:44.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:44.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:44.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:44.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:44.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:44.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:44.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:44.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:44.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:44.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:44.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:44.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:44.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:44.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:44.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:44.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:44.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:44.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:44.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:44.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:44.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:44.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:44.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:44.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:44.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:44.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:44.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:44.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:44.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:44.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:44.937 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.937 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.937 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.937 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:44.937 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:44.938 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:44.939 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:44.939 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:44.937+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:45.040 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:45.037+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:45.071 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:45.071 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:45.071 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:41:45.071 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:45.085 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:45.177 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:45.177+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:45.241 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:45.241+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:45.251 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:45.251 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:45.251 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:45.251 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:45.251 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:45.264 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:45.349 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:45.349+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:45.429 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:45.429 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:41:45.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:41:45.429 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:41:45.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.429 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.429 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:45.429 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.831220152, 2024-04-25T22:41:45.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:41:45.430 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:45.430 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:45.430 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.430 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:45.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:45.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:45.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:45.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:45.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:45.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:41:45.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:41:45.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:45.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:41:45.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:41:45.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:45.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:41:45.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:41:45.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:41:45.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:41:45.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:41:45.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:41:45.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:45.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:41:45.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:41:45.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:41:45.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:41:45.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:45.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:41:45.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:41:45.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:45.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:41:45.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:41:45.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:45.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:41:45.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:41:45.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:45.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:41:45.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:41:45.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:45.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:41:45.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:41:45.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:45.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:41:45.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:41:45.435 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.435 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.435 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.435 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.435 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:45.435 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.831132139000005, 2024-04-25T22:41:45.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:41:45.435 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:45.435 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:45.435 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.435 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:45.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:45.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:45.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:45.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:45.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:45.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:41:45.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:41:45.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:45.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:45.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:41:45.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:45.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:41:45.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:41:45.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:41:45.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:41:45.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:41:45.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:41:45.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:45.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:45.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:41:45.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:41:45.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:41:45.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:45.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:41:45.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:41:45.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:45.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:41:45.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:41:45.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:45.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:41:45.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:41:45.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:45.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:41:45.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:41:45.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:45.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:41:45.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:41:45.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:45.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:41:45.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:41:45.440 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.440 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.440 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.441 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.441 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:45.441 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.831060016999999, 2024-04-25T22:41:45.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:41:45.441 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:45.441 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:45.441 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.441 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:45.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:45.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:45.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:45.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:45.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:45.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:41:45.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:41:45.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:45.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:41:45.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:41:45.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:45.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:41:45.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:41:45.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:41:45.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:41:45.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:41:45.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:41:45.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:45.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:41:45.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:41:45.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:41:45.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:41:45.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:45.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:41:45.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:41:45.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:45.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:41:45.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:41:45.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:45.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:41:45.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:41:45.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:45.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:41:45.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:41:45.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:45.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:41:45.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:41:45.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:45.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:41:45.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:41:45.446 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.446 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.446 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.447 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.447 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:45.447 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.830951704, 2024-04-25T22:41:45.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:41:45.447 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:45.447 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:45.447 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.447 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:45.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:45.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:45.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:45.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:45.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:45.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:41:45.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:41:45.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:45.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:41:45.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:41:45.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:45.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:41:45.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:41:45.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:41:45.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:41:45.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:41:45.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:41:45.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:45.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:41:45.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:41:45.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:41:45.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:41:45.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:45.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:41:45.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:41:45.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:45.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:41:45.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:41:45.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:45.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:41:45.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:41:45.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:45.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:41:45.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:41:45.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:45.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:41:45.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:41:45.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:45.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:41:45.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:41:45.452 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.452 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.452 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.452 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.452 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:45.452 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.830885047999999, 2024-04-25T22:41:45.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:41:45.452 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:45.452 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:45.452 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.452 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:45.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:45.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:45.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:45.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:45.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:45.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:41:45.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:41:45.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:45.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:41:45.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:41:45.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:45.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:41:45.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:41:45.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:41:45.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:41:45.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:41:45.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:41:45.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:45.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:41:45.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:41:45.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:41:45.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:41:45.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:45.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:41:45.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:41:45.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:45.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:41:45.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:41:45.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:45.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:41:45.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:41:45.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:45.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:41:45.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:41:45.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:45.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:41:45.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:41:45.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:45.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:41:45.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:41:45.457 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.457 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.458 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.458 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.458 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:45.458 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.830794452000006, 2024-04-25T22:41:45.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:41:45.458 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:45.458 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:45.458 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.458 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:45.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:45.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:45.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:45.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:45.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:45.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:41:45.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:41:45.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:45.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:41:45.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:41:45.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:45.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:41:45.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:41:45.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:41:45.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:41:45.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:41:45.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:41:45.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:45.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:41:45.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:41:45.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:41:45.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:41:45.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:45.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:41:45.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:41:45.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:45.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:41:45.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:41:45.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:45.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:41:45.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:41:45.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:45.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:41:45.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:41:45.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:45.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:41:45.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:41:45.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:45.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:41:45.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:41:45.463 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.463 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.463 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.463 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.463 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:45.463 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.830729879000003, 2024-04-25T22:41:45.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:41:45.463 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:45.464 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:45.464 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.464 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:45.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:45.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:45.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:45.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:45.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:45.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:41:45.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:41:45.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:45.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:41:45.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:41:45.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:45.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:41:45.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:41:45.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:41:45.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:41:45.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:45.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:41:45.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:45.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:41:45.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:41:45.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:41:45.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:41:45.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:45.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:41:45.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:41:45.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:45.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:41:45.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:41:45.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:45.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:41:45.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:41:45.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:45.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:41:45.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:41:45.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:45.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:41:45.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:41:45.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:45.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:41:45.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:41:45.468 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.469 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.469 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.469 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.469 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:45.469 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.830664455999994, 2024-04-25T22:41:45.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:41:45.469 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:45.469 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:45.469 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.469 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:45.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:45.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:45.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:45.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:45.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:45.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:41:45.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:45.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:45.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:41:45.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:41:45.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:45.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:41:45.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:41:45.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:41:45.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:41:45.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:41:45.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:41:45.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:45.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:41:45.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:41:45.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:41:45.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:41:45.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:45.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:41:45.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:41:45.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:45.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:41:45.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:41:45.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:45.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:41:45.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:41:45.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:45.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:41:45.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:41:45.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:45.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:41:45.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:41:45.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:45.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:41:45.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:41:45.474 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.474 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.474 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.474 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.475 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:45.475 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.830608389999995, 2024-04-25T22:41:45.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:41:45.475 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:45.475 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:45.475 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.475 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:45.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:45.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:45.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:45.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:45.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:45.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:45.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:41:45.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:45.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:41:45.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:41:45.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:45.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:41:45.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:41:45.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:41:45.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:41:45.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:41:45.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:41:45.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:45.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:41:45.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:41:45.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:41:45.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:41:45.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:45.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:41:45.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:41:45.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:45.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:41:45.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:41:45.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:45.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:41:45.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:41:45.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:45.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:41:45.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:41:45.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:45.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:41:45.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:41:45.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:45.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:41:45.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:41:45.479 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.480 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.480 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.480 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.480 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:45.480 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.830541284000006, 2024-04-25T22:41:45.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:41:45.480 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:45.480 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:45.480 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.480 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:45.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:45.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:45.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:45.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:45.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:45.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:41:45.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:41:45.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:45.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:41:45.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:41:45.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:45.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:41:45.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:41:45.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:41:45.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:41:45.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:41:45.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:41:45.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:45.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:41:45.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:41:45.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:41:45.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:41:45.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:45.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:41:45.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:41:45.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:45.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:41:45.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:41:45.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:45.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:41:45.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:41:45.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:45.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:41:45.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:41:45.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:45.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:41:45.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:41:45.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:45.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:41:45.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:41:45.485 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.485 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.485 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.485 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.485 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:45.485 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.830486160999996, 2024-04-25T22:41:45.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:41:45.485 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:45.485 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:45.486 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.486 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:45.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:45.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:45.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:45.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:45.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:45.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:41:45.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:45.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:45.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:41:45.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:41:45.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:45.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:41:45.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:41:45.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:41:45.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:41:45.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:41:45.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:41:45.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:45.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:41:45.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:41:45.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:41:45.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:41:45.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:45.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:41:45.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:41:45.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:45.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:41:45.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:41:45.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:45.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:41:45.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:41:45.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:45.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:41:45.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:41:45.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:45.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:41:45.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:41:45.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:45.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:41:45.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:41:45.491 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.491 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.491 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.491 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.491 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:45.491 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.830383921999996, 2024-04-25T22:41:45.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:41:45.491 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:45.491 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:45.491 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.491 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:45.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:45.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:45.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:45.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:45.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:45.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:41:45.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:41:45.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:45.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:41:45.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:41:45.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:45.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:41:45.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:41:45.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:41:45.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:41:45.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:41:45.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:41:45.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:45.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:41:45.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:41:45.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:41:45.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:41:45.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:45.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:41:45.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:41:45.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:45.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:41:45.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:41:45.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:45.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:41:45.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:41:45.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:45.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:41:45.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:41:45.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:45.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:41:45.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:41:45.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:45.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:41:45.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:41:45.496 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.496 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.496 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.496 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.496 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:45.496 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.830325099000007, 2024-04-25T22:41:45.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:41:45.497 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:45.497 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:45.497 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.497 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:45.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:45.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:45.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:45.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:45.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:45.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:41:45.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:41:45.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:45.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:41:45.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:41:45.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:45.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:41:45.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:41:45.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:41:45.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:41:45.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:41:45.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:41:45.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:45.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:41:45.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:41:45.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:41:45.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:41:45.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:45.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:41:45.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:41:45.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:45.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:41:45.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:41:45.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:45.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:41:45.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:41:45.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:45.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:41:45.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:41:45.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:45.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:41:45.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:41:45.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:45.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:41:45.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:41:45.502 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.502 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.502 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.502 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.502 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:45.502 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.830246365999997, 2024-04-25T22:41:45.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:41:45.502 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:45.502 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:45.502 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.503 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:45.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:45.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:45.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:45.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:45.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:45.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:41:45.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:45.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:45.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:41:45.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:41:45.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:45.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:41:45.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:41:45.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:41:45.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:41:45.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:41:45.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:41:45.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:45.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:41:45.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:41:45.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:41:45.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:41:45.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:45.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:41:45.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:41:45.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:45.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:41:45.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:41:45.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:45.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:41:45.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:41:45.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:45.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:41:45.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:41:45.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:45.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:41:45.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:41:45.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:45.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:41:45.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:41:45.508 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.508 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.508 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.508 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.508 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:45.508 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.830206953000001, 2024-04-25T22:41:45.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:41:45.508 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:45.508 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:45.508 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.508 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:45.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:45.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:45.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:45.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:45.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:45.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:41:45.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:41:45.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:45.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:41:45.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:41:45.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:45.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:41:45.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:41:45.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:41:45.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:41:45.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:41:45.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:41:45.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:45.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:41:45.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:41:45.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:41:45.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:41:45.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:45.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:41:45.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:41:45.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:45.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:41:45.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:41:45.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:45.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:41:45.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:41:45.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:45.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:41:45.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:41:45.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:45.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:41:45.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:41:45.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:45.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:41:45.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:41:45.513 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.513 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.513 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.514 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.514 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:45.514 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.830137106999999, 2024-04-25T22:41:45.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:41:45.514 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:45.514 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:45.514 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.514 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:45.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:45.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:45.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:45.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:45.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:45.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:41:45.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:41:45.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:45.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:41:45.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:41:45.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:45.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:41:45.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:41:45.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:41:45.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:41:45.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:41:45.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:41:45.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:45.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:41:45.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:41:45.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:41:45.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:41:45.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:45.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:41:45.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:41:45.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:45.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:41:45.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:41:45.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:45.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:41:45.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:41:45.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:45.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:41:45.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:41:45.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:45.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:41:45.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:41:45.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:45.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:41:45.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:41:45.519 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.519 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.519 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.520 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.520 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:45.520 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.830087370000001, 2024-04-25T22:41:45.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:41:45.520 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:45.520 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:45.520 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.520 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:45.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:45.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:45.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:45.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:45.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:45.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:41:45.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:45.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:45.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:41:45.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:41:45.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:45.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:41:45.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:41:45.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:41:45.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:41:45.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:41:45.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:41:45.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:45.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:41:45.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:41:45.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:41:45.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:41:45.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:45.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:41:45.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:41:45.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:45.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:41:45.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:41:45.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:45.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:41:45.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:41:45.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:45.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:41:45.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:41:45.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:45.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:45.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:41:45.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:45.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:41:45.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:41:45.525 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.525 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.525 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.525 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.525 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:45.526 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.830002754999995, 2024-04-25T22:41:45.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:41:45.526 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:45.526 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:45.526 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.526 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:45.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:45.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:45.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:45.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:45.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:45.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:41:45.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:45.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:45.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:41:45.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:41:45.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:45.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:41:45.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:41:45.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:41:45.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:41:45.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:41:45.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:41:45.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:45.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:41:45.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:41:45.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:41:45.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:41:45.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:45.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:41:45.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:41:45.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:45.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:41:45.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:41:45.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:45.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:41:45.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:41:45.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:45.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:41:45.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:41:45.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:45.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:41:45.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:41:45.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:45.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:41:45.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:41:45.531 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.531 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.531 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.531 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.531 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:45.531 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.829939104999994, 2024-04-25T22:41:45.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:41:45.531 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:45.531 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:45.531 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:41:45.531 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:45.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:45.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:45.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:45.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:45.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:45.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:41:45.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:41:45.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:45.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:41:45.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:41:45.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:45.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:41:45.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:41:45.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:41:45.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:41:45.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:41:45.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:41:45.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:45.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:41:45.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:41:45.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:41:45.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:41:45.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:45.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:41:45.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:41:45.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:45.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:41:45.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:41:45.535 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.535 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.535 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.535 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:45.535 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:45.535 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 90.822935575000002, 2024-04-25T22:41:45.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:41:45.536 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:45.536 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:45.536 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.536 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:45.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:45.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:45.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:45.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:45.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:45.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:45.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:41:45.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:41:45.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:45.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:41:45.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:41:45.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:45.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:41:45.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:41:45.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:41:45.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:41:45.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:45.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:41:45.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:41:45.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:45.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:41:45.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:41:45.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:45.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:41:45.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:41:45.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:45.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:45.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:45.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:41:45.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:41:45.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.539 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:45.539 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:45.539 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:45.541 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:45.541 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:45.540+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:45.642 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:45.640+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:45.658 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is unset 2024-04-25T22:41:45.675 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:45.675 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:45.675 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:45.675 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:45.689 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:45.743 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:45.741+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:45.844 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:45.845+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:45.850 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:45.850 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:45.850 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:45.850 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:45.850 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:45.864 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:45.945 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:45.940+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:45.989 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:45.989 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:45.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:45.989 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:45.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.989 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.989 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:45.989 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 91.390828702999997, 2024-04-25T22:41:45.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:45.989 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:45.990 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:45.990 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.990 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:45.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:45.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:45.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:45.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:45.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:45.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:45.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:45.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:45.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:45.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:45.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:45.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:45.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:45.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:45.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:45.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:45.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:45.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:45.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:45.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:45.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:45.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:45.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:45.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:45.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:45.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:45.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:45.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:45.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:45.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:45.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:45.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:45.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:45.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:45.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:45.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.994 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:45.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:45.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:45.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.994 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.994 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:45.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:45.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:45.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.994 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.994 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:45.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:45.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:45.994 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:45.994 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:45.995 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:45.995 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.995 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:45.995 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:45.995 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 91.390691446999995, 2024-04-25T22:41:45.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:45.995 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:45.995 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:45.995 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:45.995 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:45.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:45.995 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:45.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:45.995 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:45.996 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:45.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:45.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:45.996 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:45.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:45.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:45.996 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:45.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:45.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:45.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:45.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:45.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:45.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:45.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:45.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:45.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:45.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:45.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:45.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:45.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:45.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:45.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:45.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:45.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:45.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:45.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:45.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:45.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:45.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:45.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:45.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:45.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:45.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:45.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:45.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:45.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:45.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:45.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:45.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:45.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:45.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:46.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:46.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:46.000 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.000 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:46.000 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.000 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.000 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:46.000 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 91.390603894999998, 2024-04-25T22:41:46.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:46.000 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:46.000 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:46.000 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.000 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:46.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:46.001 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:46.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:46.001 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:46.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:46.001 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:46.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:46.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:46.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:46.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:46.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:46.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:46.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:46.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:46.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:46.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.003 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:46.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:46.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.003 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:46.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:46.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:46.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.003 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:46.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:46.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:46.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:46.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:46.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:46.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:46.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:46.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:46.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:46.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:46.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:46.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:46.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:46.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:46.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:46.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:46.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:46.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:46.006 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.006 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:46.006 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.006 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.006 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:46.006 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 91.390500068999998, 2024-04-25T22:41:46.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:46.006 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:46.006 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:46.006 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.006 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:46.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:46.007 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:46.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:46.007 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:46.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:46.007 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:46.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:46.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:46.007 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:46.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:46.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:46.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:46.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:46.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:46.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:46.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:46.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:46.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:46.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:46.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:46.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:46.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:46.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:46.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:46.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:46.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:46.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:46.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:46.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:46.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:46.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:46.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:46.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:46.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:46.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:46.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:46.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:46.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:46.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:46.011 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.011 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:46.011 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.011 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.012 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:46.012 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 91.390431278999998, 2024-04-25T22:41:46.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:46.012 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:46.012 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:46.012 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.012 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:46.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:46.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:46.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:46.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:46.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:46.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:46.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:46.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:46.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:46.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:46.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:46.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:46.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:46.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:46.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:46.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:46.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:46.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:46.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:46.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:46.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.015 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.015 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:46.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:46.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.015 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:46.015 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:46.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:46.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.015 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:46.015 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:46.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:46.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.016 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:46.016 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:46.016 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:46.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.016 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.016 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:46.016 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:46.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.016 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:46.016 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:46.016 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:46.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.017 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:46.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:46.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:46.017 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.017 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:46.017 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.017 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.017 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:46.017 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 91.390362193000001, 2024-04-25T22:41:46.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:46.017 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:46.018 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:46.018 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.018 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:46.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:46.018 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:46.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:46.018 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:46.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:46.018 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:46.019 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:46.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.019 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.019 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:46.019 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:46.019 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:46.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.019 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.019 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:46.019 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:46.019 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:46.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.019 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.019 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.019 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:46.019 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:46.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:46.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:46.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:46.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:46.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:46.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:46.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:46.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.021 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.021 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:46.021 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:46.021 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:46.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.021 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.021 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:46.021 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:46.021 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:46.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.021 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.021 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:46.021 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:46.021 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:46.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.022 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:46.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:46.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:46.022 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:46.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:46.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:46.022 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:46.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:46.022 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.023 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:46.023 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.023 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.023 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.023 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.023 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:46.023 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 91.390266080000004, 2024-04-25T22:41:46.023 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:46.023 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:46.023 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:46.023 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:46.023 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:46.023 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.023 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:46.023 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:46.024 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.024 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.024 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:46.024 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:46.024 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.024 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.024 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:46.024 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:46.024 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:46.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.024 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.024 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:46.024 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:46.024 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:46.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.025 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.025 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:46.025 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:46.025 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:46.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.025 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.025 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.025 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:46.025 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:46.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.025 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.025 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.025 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:46.025 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:46.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.026 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.026 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:46.026 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:46.026 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:46.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.026 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.026 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.026 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:46.026 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:46.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.026 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.026 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:46.026 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:46.026 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:46.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.027 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.027 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:46.027 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:46.027 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:46.027 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.027 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:46.027 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.027 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.027 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.027 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:46.027 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 91.390200418000006, 2024-04-25T22:41:46.027 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:46.027 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:46.027 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:46.028 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:46.028 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:46.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:46.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:46.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:46.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:46.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:46.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:46.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:46.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:46.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:46.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:46.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:46.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:46.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:46.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:46.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:46.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.030 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.030 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.030 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:46.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:46.030 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.030 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.030 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:46.030 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:46.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:46.030 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.030 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.030 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.030 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:46.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:46.030 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.031 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.031 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:46.031 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:46.031 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:46.031 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.031 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.031 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:46.031 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:46.031 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:46.031 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.031 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:46.031 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.031 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.031 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.031 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.031 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:46.032 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 91.390131291000003, 2024-04-25T22:41:46.032 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:46.032 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:46.032 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:46.032 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:46.032 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:46.032 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.032 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:46.032 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:46.032 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.032 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.032 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.032 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:46.032 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:46.032 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:46.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:46.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:46.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:46.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:46.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:46.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:46.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:46.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:46.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:46.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:46.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:46.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:46.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:46.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:46.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:46.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:46.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:46.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.035 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:46.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:46.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:46.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.035 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:46.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:46.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:46.035 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.035 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:46.035 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.036 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.036 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.036 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:46.036 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:46.036 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 91.379314635, 2024-04-25T22:41:46.036 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:46.036 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:46.036 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:46.036 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:46.036 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:46.036 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.036 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:46.036 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:46.036 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:46.037 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:46.037 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:46.037 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:46.037 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:46.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:46.037 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:46.037 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:46.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.038 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:46.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:46.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:46.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.038 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:46.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:46.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.038 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:46.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:46.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.039 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.039 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:46.039 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:46.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:46.039 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.039 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:46.039 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.039 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.039 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:46.039 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:46.039 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 91.362416281999998, 2024-04-25T22:41:46.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:46.040 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:46.040 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:46.040 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:46.040 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:46.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.040 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:46.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:46.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.040 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:46.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:46.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.041 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.041 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:46.041 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:46.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:46.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.041 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.041 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:46.041 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:46.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:46.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.041 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.041 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:46.041 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:46.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:46.042 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.042 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.042 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.042 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:46.042 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:46.042 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.042 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.042 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.042 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:46.042 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:46.042 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.042 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.042 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:46.042 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:46.043 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:46.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.043 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.043 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:46.043 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:46.043 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:46.043 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.043 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:46.043 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.043 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.043 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:46.043 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:46.043 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 91.361595391999998, 2024-04-25T22:41:46.043 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:46.044 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:46.044 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:46.044 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:46.044 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:46.044 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.044 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:46.044 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:46.044 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.044 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.044 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.044 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:46.044 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:46.044 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.044 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.044 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.044 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:46.044 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:46.045 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:46.045 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.045 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.045 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:46.045 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:46.045 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:46.045 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.045 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.045 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:46.045 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:46.045 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:46.045 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.045 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.045 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.046 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:46.046 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:46.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.046 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.046 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.046 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:46.046 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:46.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.046 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.046 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:46.046 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:46.046 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:46.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.046 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.046 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:46.047 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:46.047 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:46.047 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.047 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:46.047 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.047 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.047 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.047 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:46.047 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:46.047 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 91.359894663999995, 2024-04-25T22:41:46.047 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:46.047 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:46.047 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:46.047 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.047 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:46.047 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.048 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:46.048 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:46.048 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.048 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.048 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:46.048 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:46.048 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.048 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.048 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:46.048 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:46.048 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:46.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.048 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.048 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:46.049 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:46.049 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:46.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.049 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:46.049 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:46.049 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:46.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.049 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.049 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:46.049 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:46.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.049 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.049 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:46.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:46.050 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.050 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:46.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:46.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:46.050 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.050 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:46.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:46.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:46.050 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.050 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:46.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:46.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:46.051 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.051 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:46.051 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.051 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.051 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.051 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:46.051 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:46.051 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 91.359297988999998, 2024-04-25T22:41:46.051 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:46.051 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:46.051 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:46.051 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.051 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:46.051 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.051 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:46.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:46.052 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.052 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.052 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:46.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:46.052 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.052 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.052 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:46.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:46.052 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:46.052 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.052 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:46.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:46.053 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:46.053 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.053 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.053 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:46.053 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:46.053 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:46.053 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.053 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.053 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.053 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:46.053 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:46.053 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.053 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.053 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.053 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:46.053 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:46.054 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.054 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.054 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:46.054 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:46.054 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:46.054 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.054 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.054 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:46.054 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:46.054 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:46.054 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.054 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.054 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:46.054 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:46.055 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:46.055 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.055 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:46.055 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.055 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.055 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.055 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:46.055 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:46.055 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 91.349862263000006, 2024-04-25T22:41:46.055 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:46.055 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:46.055 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:46.055 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:46.055 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:46.055 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.056 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:46.056 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:46.056 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.056 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.056 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.056 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:46.056 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:46.056 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.056 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.056 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.056 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:46.056 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:46.056 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:46.056 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.057 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.057 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:46.057 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:46.057 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:46.057 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.057 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.057 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:46.057 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:46.057 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:46.057 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.057 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.057 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.057 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:46.057 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:46.057 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.058 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.058 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.058 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:46.058 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:46.058 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.058 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.058 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:46.058 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:46.058 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:46.058 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.058 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:46.058 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.058 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.058 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.058 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:46.058 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:46.059 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 91.349214837000005, 2024-04-25T22:41:46.059 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:46.059 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:46.059 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:46.059 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.059 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:46.059 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.059 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:46.059 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:46.059 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.059 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.059 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.059 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:46.059 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:46.059 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.059 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.060 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.060 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:46.060 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:46.060 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:46.060 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.060 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.060 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:46.060 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:46.060 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:46.060 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.060 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.060 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:46.060 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:46.060 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:46.060 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.060 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.060 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.061 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:46.061 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:46.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.061 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.061 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.061 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:46.061 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:46.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.061 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.061 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:46.061 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:46.061 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:46.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.061 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.061 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:46.061 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:46.061 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:46.062 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.062 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.062 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:46.062 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:46.062 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:46.062 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.062 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:46.062 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.062 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.062 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.062 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:46.062 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:46.062 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 91.347774017999996, 2024-04-25T22:41:46.062 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:46.062 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:46.063 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:46.063 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.063 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:46.063 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.063 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:46.063 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:46.063 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.063 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.063 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.063 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:46.063 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:46.063 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.063 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.063 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.063 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:46.063 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:46.063 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:46.064 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.064 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.064 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:46.064 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:46.064 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:46.064 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.064 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.064 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:46.064 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:46.064 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:46.064 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.064 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.064 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.064 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:46.064 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:46.064 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.065 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.065 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.065 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:46.065 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:46.065 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.065 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.065 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:46.065 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:46.065 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:46.065 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.065 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.065 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:46.065 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:46.065 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:46.065 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.065 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.065 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:46.066 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:46.066 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:46.066 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.066 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:46.066 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.066 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.066 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.066 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:46.066 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:46.066 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 89.395335574000001, 2024-04-25T22:41:46.066 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:46.066 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:46.066 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:46.066 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.067 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:46.067 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.067 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:46.067 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:46.067 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.067 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.067 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.067 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:46.067 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:46.067 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.067 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.067 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.067 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:46.067 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:46.067 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:46.067 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.068 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.068 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:46.068 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:46.068 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:46.068 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.068 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.068 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:46.068 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:46.068 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:46.068 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.068 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.068 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.068 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:46.068 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:46.068 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.069 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.069 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.069 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:46.069 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:46.069 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.069 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.069 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:46.069 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:46.069 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:46.069 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.069 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.069 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:46.069 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:46.069 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:46.069 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.070 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.070 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:46.070 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:46.070 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:46.070 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.070 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.070 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.070 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:46.070 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:46.070 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.070 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.070 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:46.070 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:46.070 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:46.070 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.071 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.071 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:46.071 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:46.071 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:46.071 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.071 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:46.071 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.071 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.071 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.071 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:46.071 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:46.071 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 67.392676249999994, 2024-04-25T22:41:46.071 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:46.071 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:46.071 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:46.071 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.072 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:46.072 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.072 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:46.072 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:46.072 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.072 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.072 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.072 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:46.072 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:46.072 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.072 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.072 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.072 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:46.072 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:46.072 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:46.072 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.073 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.073 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:46.073 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:46.073 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:46.073 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.073 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.073 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:46.073 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:46.073 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:46.073 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.073 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.073 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.073 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:46.073 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:46.073 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.073 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.074 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.074 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:46.074 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:46.074 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.074 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.074 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:46.074 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:46.074 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:46.074 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.074 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.074 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:46.074 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:46.074 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:46.074 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.074 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.075 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:46.075 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:46.075 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:46.075 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.075 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.075 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.075 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:46.075 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:46.075 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.075 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.075 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:46.075 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:46.075 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:46.075 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.075 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.076 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:46.076 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:46.076 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:46.076 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.076 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:46.076 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.076 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.076 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.076 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:46.076 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:46.076 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 62.392383999000003, 2024-04-25T22:41:46.076 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:46.076 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:46.076 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:46.076 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.076 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:46.077 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.077 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:46.077 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:46.077 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.077 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.077 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.077 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:46.077 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:46.077 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:46.077 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.077 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.077 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:46.077 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:46.077 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:46.078 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.078 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.078 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:46.078 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:46.078 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:46.078 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.078 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.078 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:46.078 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:46.078 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:46.078 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.078 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.078 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.078 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:46.078 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:46.079 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.079 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.079 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:46.079 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:46.079 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:46.079 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.079 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.079 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:46.079 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:46.079 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:46.079 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.079 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.079 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:46.079 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:46.079 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:46.080 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.080 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.080 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:46.080 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:46.080 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:46.080 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.080 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.080 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.080 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:46.080 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:46.080 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.080 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.080 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:46.080 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:46.080 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:46.080 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:46.080 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:46.081 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:46.081 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:46.081 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:46.081 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.081 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:46.081 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.081 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:46.081 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:46.081 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:46.082 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:46.080+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:46.083 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:46.183 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:46.180+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:46.216 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:46.216 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:46.216 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:41:46.216 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:46.230 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:46.285 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:46.284+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:46.346 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:46.346 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:46.346 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:46.346 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:46.347 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:46.360 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:46.405 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:46.405+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:46.479 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:46.479 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:41:46.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:41:46.480 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:41:46.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.480 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.480 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:46.480 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.883014961000001, 2024-04-25T22:41:46.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:41:46.480 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:46.480 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:46.480 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.480 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:46.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:46.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:46.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:46.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:46.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:46.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:41:46.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:41:46.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:46.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:41:46.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:41:46.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:46.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:41:46.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:41:46.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:41:46.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:41:46.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:41:46.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:41:46.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:46.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:41:46.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:41:46.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:41:46.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:41:46.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:46.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:41:46.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:41:46.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:46.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:41:46.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:41:46.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:41:46.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:41:46.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:46.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:41:46.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:41:46.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:46.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:41:46.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:41:46.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:46.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:41:46.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:41:46.485 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.485 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.485 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.486 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.486 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:46.486 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.882926948000005, 2024-04-25T22:41:46.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:41:46.486 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:46.486 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:46.486 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.486 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:46.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:46.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:46.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:46.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:46.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:46.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:41:46.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:41:46.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:46.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:46.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:41:46.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:46.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:41:46.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:41:46.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:41:46.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:41:46.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:41:46.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:41:46.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:46.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:46.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:41:46.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:41:46.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:41:46.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:46.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:41:46.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:41:46.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:46.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:41:46.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:41:46.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:46.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:41:46.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:41:46.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:41:46.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:41:46.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:46.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:41:46.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:41:46.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:46.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:41:46.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:41:46.491 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.491 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.491 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.492 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.492 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:46.492 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.882854825999999, 2024-04-25T22:41:46.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:41:46.492 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:46.492 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:46.492 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.492 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:46.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:46.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:46.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:46.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:46.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:46.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:41:46.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:41:46.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:46.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:41:46.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:41:46.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:46.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:41:46.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:41:46.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:41:46.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:41:46.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:41:46.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:41:46.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:46.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:41:46.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:41:46.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:41:46.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:41:46.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:46.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:41:46.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:41:46.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:46.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:41:46.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:41:46.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:41:46.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:41:46.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:46.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:41:46.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:41:46.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:46.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:41:46.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:41:46.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:46.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:41:46.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:41:46.497 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.497 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.497 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.498 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.498 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:46.498 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.882746513000001, 2024-04-25T22:41:46.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:41:46.498 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:46.498 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:46.498 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.498 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:46.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:46.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:46.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:46.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:46.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:46.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:41:46.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:41:46.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:46.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:41:46.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:41:46.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:46.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:41:46.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:41:46.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:41:46.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:41:46.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:41:46.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:41:46.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:46.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:41:46.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:41:46.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:41:46.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:41:46.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:46.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:41:46.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:41:46.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:46.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:41:46.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:41:46.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:41:46.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:41:46.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:46.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:41:46.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:41:46.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:46.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:41:46.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:41:46.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:46.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:41:46.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:41:46.504 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.504 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.504 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.504 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.504 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:46.504 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.882679856999999, 2024-04-25T22:41:46.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:41:46.504 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:46.504 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:46.504 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.504 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:46.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:46.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:46.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:46.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:46.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:46.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:41:46.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:41:46.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:46.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:41:46.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:41:46.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:46.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:41:46.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:41:46.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:41:46.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:41:46.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:41:46.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:41:46.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:46.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:41:46.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:41:46.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:41:46.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:41:46.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:46.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:41:46.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:41:46.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:46.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:41:46.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:41:46.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:41:46.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:41:46.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:46.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:41:46.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:41:46.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:46.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:41:46.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:41:46.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:46.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:41:46.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:41:46.510 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.510 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.510 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.510 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.510 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:46.510 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.882589261000007, 2024-04-25T22:41:46.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:41:46.511 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:46.511 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:46.511 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.511 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:46.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:46.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:46.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:46.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:46.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:46.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:41:46.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:41:46.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:46.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:41:46.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:41:46.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:46.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:41:46.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:41:46.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:41:46.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:41:46.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:41:46.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:41:46.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:46.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:41:46.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:41:46.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:41:46.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:41:46.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:46.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:41:46.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:41:46.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:46.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:41:46.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:41:46.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:46.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:41:46.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:41:46.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:41:46.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:41:46.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:46.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:41:46.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:41:46.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:46.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:41:46.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:41:46.516 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.516 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.516 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.516 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.516 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:46.517 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.882524688000004, 2024-04-25T22:41:46.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:41:46.517 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:46.517 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:46.517 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.517 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:46.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:46.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:46.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:46.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:46.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:46.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:41:46.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:41:46.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:46.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:41:46.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:41:46.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:46.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:41:46.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:41:46.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:41:46.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:41:46.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:46.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:41:46.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:46.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:41:46.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:41:46.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:41:46.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:41:46.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:46.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:41:46.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:41:46.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:46.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:41:46.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:41:46.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:41:46.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:41:46.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:46.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:41:46.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:41:46.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:46.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:41:46.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:41:46.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:46.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:41:46.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:41:46.522 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.522 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.522 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.522 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.523 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:46.523 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.882459264999994, 2024-04-25T22:41:46.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:41:46.523 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:46.523 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:46.523 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.523 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:46.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:46.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:46.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:46.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:46.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:46.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:41:46.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:46.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:46.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:41:46.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:41:46.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:46.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:41:46.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:41:46.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:41:46.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:41:46.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:41:46.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:41:46.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:46.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:41:46.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:41:46.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:41:46.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:41:46.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:46.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:41:46.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:41:46.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:46.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:41:46.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:41:46.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:46.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:41:46.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:41:46.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:41:46.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:41:46.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:46.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:41:46.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:41:46.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:46.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:41:46.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:41:46.528 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.528 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.528 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.529 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.529 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:46.529 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.882403198999995, 2024-04-25T22:41:46.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:41:46.529 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:46.529 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:46.529 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.529 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:46.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:46.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:46.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:46.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:46.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:46.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:46.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:41:46.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:46.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:41:46.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:41:46.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:46.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:41:46.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:41:46.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:41:46.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:41:46.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:41:46.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:41:46.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:46.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:41:46.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:41:46.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:41:46.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:41:46.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:46.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:41:46.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:41:46.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:46.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:41:46.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:41:46.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:41:46.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:41:46.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:46.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:41:46.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:41:46.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:46.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:41:46.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:41:46.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:46.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:41:46.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:41:46.534 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.534 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.534 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.534 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.534 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:46.535 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.882336093000006, 2024-04-25T22:41:46.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:41:46.535 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:46.535 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:46.535 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.535 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:46.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:46.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:46.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:46.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:46.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:46.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:41:46.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:41:46.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:46.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:41:46.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:41:46.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:46.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:41:46.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:41:46.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:41:46.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:41:46.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:41:46.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:41:46.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:46.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:41:46.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:41:46.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:41:46.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:41:46.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:46.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:41:46.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:41:46.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:46.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:41:46.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:41:46.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:41:46.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:41:46.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:46.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:41:46.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:41:46.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:41:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:41:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:41:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:41:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:46.540 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.882280969999997, 2024-04-25T22:41:46.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:41:46.541 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:46.541 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:46.541 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.541 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:46.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:46.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:46.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:46.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:46.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:41:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:41:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:41:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:41:46.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:41:46.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:41:46.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:41:46.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:41:46.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:41:46.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:46.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:41:46.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:41:46.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:41:46.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:41:46.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:46.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:41:46.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:41:46.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:46.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:41:46.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:41:46.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:41:46.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:41:46.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:46.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:41:46.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:41:46.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:46.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:41:46.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:41:46.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:46.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:41:46.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:41:46.546 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.546 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.546 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.546 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.546 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:46.546 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.882178730999996, 2024-04-25T22:41:46.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:41:46.547 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:46.547 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:46.547 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.547 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:46.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:46.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:46.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:46.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:46.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:46.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:41:46.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:41:46.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:46.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:41:46.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:41:46.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:46.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:41:46.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:41:46.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:41:46.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:41:46.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:41:46.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:41:46.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:46.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:41:46.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:41:46.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:41:46.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:41:46.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:46.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:41:46.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:41:46.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:46.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:41:46.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:41:46.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:41:46.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:41:46.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:46.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:41:46.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:41:46.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:46.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:41:46.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:41:46.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:46.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:41:46.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:41:46.552 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.552 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.552 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.552 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.552 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:46.552 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.882119907999993, 2024-04-25T22:41:46.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:41:46.552 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:46.553 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:46.553 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.553 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:46.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:46.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:46.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:46.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:46.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:46.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:41:46.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:41:46.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:46.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:41:46.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:41:46.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:46.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:41:46.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:41:46.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:41:46.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:41:46.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:41:46.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:41:46.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:46.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:41:46.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:41:46.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:41:46.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:41:46.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:46.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:41:46.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:41:46.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:46.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:41:46.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:41:46.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:46.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:41:46.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:41:46.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:41:46.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:41:46.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:46.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:41:46.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:41:46.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:46.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:41:46.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:41:46.558 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.558 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.558 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.558 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.558 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:46.558 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.882041174999998, 2024-04-25T22:41:46.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:41:46.558 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:46.558 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:46.558 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.558 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:46.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:46.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:46.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:46.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:46.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:46.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:41:46.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:46.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:46.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:41:46.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:41:46.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:46.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:41:46.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:41:46.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:41:46.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:41:46.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:41:46.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:41:46.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:46.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:41:46.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:41:46.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:41:46.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:41:46.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:46.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:41:46.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:41:46.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:46.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:41:46.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:41:46.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:46.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:41:46.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:41:46.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:41:46.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:41:46.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:46.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:41:46.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:41:46.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:46.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:41:46.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:41:46.564 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.564 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.564 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.564 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.564 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:46.564 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.882001762000002, 2024-04-25T22:41:46.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:41:46.564 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:46.564 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:46.564 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.565 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:46.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:46.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:46.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:46.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:46.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:46.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:41:46.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:41:46.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:46.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:41:46.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:41:46.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:46.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:41:46.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:41:46.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:41:46.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:41:46.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:41:46.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:41:46.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:46.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:41:46.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:41:46.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:41:46.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:41:46.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:46.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:41:46.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:41:46.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:46.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:41:46.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:41:46.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:41:46.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:41:46.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:46.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:41:46.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:41:46.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:46.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:41:46.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:41:46.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:46.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:41:46.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:41:46.570 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.570 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.570 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.570 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.570 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:46.570 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.881931915999999, 2024-04-25T22:41:46.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:41:46.570 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:46.570 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:46.570 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.570 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:46.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:46.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:46.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:46.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:46.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:46.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:41:46.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:41:46.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:46.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:41:46.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:41:46.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:46.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:41:46.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:41:46.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:41:46.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:41:46.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:41:46.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:41:46.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:46.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:41:46.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:41:46.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:41:46.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:41:46.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:46.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:41:46.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:41:46.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:46.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:41:46.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:41:46.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:41:46.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:41:46.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:46.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:41:46.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:41:46.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:46.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:41:46.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:41:46.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:46.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:41:46.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:41:46.576 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.576 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.576 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.576 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.576 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:46.576 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.881882179000002, 2024-04-25T22:41:46.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:41:46.576 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:46.576 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:46.577 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.577 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:46.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:46.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:46.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:46.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:46.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:46.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:41:46.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:46.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:46.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:41:46.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:41:46.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:46.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:41:46.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:41:46.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:41:46.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:41:46.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:41:46.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:41:46.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:46.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:41:46.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:41:46.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:41:46.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:41:46.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:46.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:41:46.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:41:46.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:46.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:41:46.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:41:46.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:46.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:41:46.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:41:46.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:41:46.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:41:46.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:46.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:46.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:41:46.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:46.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:41:46.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:41:46.582 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.582 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.582 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.582 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.582 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:46.582 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.881797563999996, 2024-04-25T22:41:46.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:41:46.582 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:46.582 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:46.582 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.583 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:46.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:46.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:46.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:46.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:46.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:46.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:41:46.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:46.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:46.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:41:46.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:41:46.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:46.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:41:46.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:41:46.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:41:46.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:41:46.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:41:46.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:41:46.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:46.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:41:46.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:41:46.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:41:46.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:41:46.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:46.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:41:46.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:41:46.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:46.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:41:46.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:41:46.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:46.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:41:46.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:41:46.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:46.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:41:46.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:41:46.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:46.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:41:46.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:41:46.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:46.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:41:46.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:41:46.588 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.588 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.588 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.588 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:46.588 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:46.588 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.881733913999994, 2024-04-25T22:41:46.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:41:46.588 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:46.588 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:46.588 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:41:46.589 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:46.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:46.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:46.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:46.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:46.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:46.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:41:46.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:41:46.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:46.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:41:46.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:41:46.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:46.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:41:46.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:41:46.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:41:46.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:41:46.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:41:46.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:41:46.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:46.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:41:46.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:41:46.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:41:46.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:41:46.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:46.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:41:46.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:41:46.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:46.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:41:46.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:41:46.592 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.592 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.592 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.593 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:46.593 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:46.593 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.874730384000003, 2024-04-25T22:41:46.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:41:46.593 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:46.593 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:46.593 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:46.593 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:46.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:46.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:46.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:46.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:46.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:46.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:46.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:41:46.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:41:46.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:46.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:41:46.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:41:46.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:46.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:41:46.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:41:46.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:46.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:41:46.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:41:46.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:46.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:41:46.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:41:46.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:46.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:41:46.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:41:46.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:46.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:41:46.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:41:46.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:46.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:46.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:46.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:41:46.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:41:46.596 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.597 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.597 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.597 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:46.597 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:46.597 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:46.598 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:46.599 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:46.596+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:46.651 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:41:46.699 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:46.697+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:46.727 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:46.727 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:46.727 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:46.727 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:46.741 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:46.799 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:46.801+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:46.850 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:46.851 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:46.851 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:41:46.860 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:46.860 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:46.860 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:46.860 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:46.860 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:46.874 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:46.880 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:46.881 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:46.885 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:41:46.885 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:41:46.926 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:46.924+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:46.997 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:46.998 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:47.000 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~12s 2024-04-25T22:41:47.001 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:47.001+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:47.012 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:47.102 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:47.100+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:47.146 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:47.146 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:47.160 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:47.205 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:47.205+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:47.283 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:47.283 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:47.297 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:47.304 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:47.300+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:47.404 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:47.401+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:47.462 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:47.462 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:47.477 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:47.526 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:47.524+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:47.606 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:47.604+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:47.609 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:47.610 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:47.624 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:47.682 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:41:47.707 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:47.705+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:47.727 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-25T22:41:47.727 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:41:47.728 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-25T22:41:47.728 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-25T22:41:47.786 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:47.787 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:47.802 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:47.846 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:47.844+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:47.909 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:47.904+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:47.917 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:47.917 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:47.932 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:48.010 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:48.008+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:48.065 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:48.065 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:48.081 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:48.110 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:48.108+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:48.200 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:48.200 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:48.212 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:48.209+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:48.215 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:48.223 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:41:48.224 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:41:48.224 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 51, 2024-04-25T22:41:48.224 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d", 2024-04-25T22:41:48.224 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2024-04-25T22:39:52.303074+0000", 2024-04-25T22:41:48.224 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2024-04-25T22:41:45.639476+0000", 2024-04-25T22:41:48.224 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2024-04-25T22:41:34.334402+0000", 2024-04-25T22:41:48.224 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2024-04-25T22:39:53.230242+0000", 2024-04-25T22:41:48.224 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-25T22:41:48.224 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2024-04-25T22:41:48.224 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2024-04-25T22:41:48.224 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2024-04-25T22:41:48.224 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2024-04-25T22:41:48.224 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2024-04-25T22:41:48.224 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2024-04-25T22:41:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:41:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 4, 2024-04-25T22:41:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2024-04-25T22:41:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-25T22:41:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-25T22:41:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2024-04-25T22:41:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 4, 2024-04-25T22:41:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 3, 2024-04-25T22:41:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "luminous", 2024-04-25T22:41:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2024-04-25T22:41:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "squid", 2024-04-25T22:41:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: "allow_crimson": false, 2024-04-25T22:41:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2024-04-25T22:41:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2024-04-25T22:41:48.225 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": ".mgr", 2024-04-25T22:41:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25T22:40:03.197725+0000", 2024-04-25T22:41:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T22:41:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T22:41:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T22:41:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T22:41:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T22:41:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T22:41:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:41:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:41:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:41:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:41:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T22:41:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:41:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2024-04-25T22:41:48.226 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2024-04-25T22:41:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2024-04-25T22:41:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2024-04-25T22:41:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2024-04-25T22:41:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T22:41:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T22:41:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T22:41:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T22:41:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T22:41:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T22:41:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T22:41:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "12", 2024-04-25T22:41:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T22:41:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:41:48.227 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:41:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T22:41:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:41:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T22:41:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T22:41:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T22:41:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T22:41:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T22:41:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T22:41:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T22:41:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T22:41:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T22:41:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T22:41:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T22:41:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T22:41:48.228 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T22:41:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:41:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:41:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:41:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T22:41:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T22:41:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T22:41:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T22:41:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T22:41:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T22:41:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T22:41:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T22:41:48.229 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:41:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:41:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:41:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:41:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T22:41:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T22:41:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T22:41:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T22:41:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2024-04-25T22:41:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_max": 32, 2024-04-25T22:41:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2024-04-25T22:41:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T22:41:48.230 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": {} 2024-04-25T22:41:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: "read_balance": { 2024-04-25T22:41:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: "error_message": "pool 1 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-04-25T22:41:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: "score_acting": 0, 2024-04-25T22:41:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: "score_stable": 0 2024-04-25T22:41:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2024-04-25T22:41:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2024-04-25T22:41:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25T22:40:07.560858+0000", 2024-04-25T22:41:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T22:41:48.231 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T22:41:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T22:41:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T22:41:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T22:41:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T22:41:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:41:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:41:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:41:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:41:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T22:41:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:41:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2024-04-25T22:41:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2024-04-25T22:41:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2024-04-25T22:41:48.232 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2024-04-25T22:41:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2024-04-25T22:41:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T22:41:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T22:41:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T22:41:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T22:41:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T22:41:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T22:41:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T22:41:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "15", 2024-04-25T22:41:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T22:41:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:41:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:41:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T22:41:48.233 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:41:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T22:41:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T22:41:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T22:41:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T22:41:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T22:41:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T22:41:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T22:41:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T22:41:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T22:41:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T22:41:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T22:41:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T22:41:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T22:41:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:41:48.234 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:41:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:41:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T22:41:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T22:41:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T22:41:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T22:41:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T22:41:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T22:41:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T22:41:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T22:41:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:41:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:41:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:41:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:41:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T22:41:48.235 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T22:41:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T22:41:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T22:41:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2024-04-25T22:41:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T22:41:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2024-04-25T22:41:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "read_balance": { 2024-04-25T22:41:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "error_message": "pool 2 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-04-25T22:41:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "score_acting": 0, 2024-04-25T22:41:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "score_stable": 0 2024-04-25T22:41:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 3, 2024-04-25T22:41:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_metadata", 2024-04-25T22:41:48.236 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25T22:40:12.431697+0000", 2024-04-25T22:41:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T22:41:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T22:41:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T22:41:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T22:41:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T22:41:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T22:41:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:41:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:41:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:41:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:41:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T22:41:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:41:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 32, 2024-04-25T22:41:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 32, 2024-04-25T22:41:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 32, 2024-04-25T22:41:48.237 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 32, 2024-04-25T22:41:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 32, 2024-04-25T22:41:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T22:41:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T22:41:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T22:41:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T22:41:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T22:41:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T22:41:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T22:41:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2024-04-25T22:41:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T22:41:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:41:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:41:48.238 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T22:41:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:41:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T22:41:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T22:41:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T22:41:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T22:41:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T22:41:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T22:41:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T22:41:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T22:41:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T22:41:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T22:41:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T22:41:48.239 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T22:41:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T22:41:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:41:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:41:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:41:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T22:41:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T22:41:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T22:41:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T22:41:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T22:41:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T22:41:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T22:41:48.240 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T22:41:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:41:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:41:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:41:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:41:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T22:41:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T22:41:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T22:41:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T22:41:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2024-04-25T22:41:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_bias": 4, 2024-04-25T22:41:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 16, 2024-04-25T22:41:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_priority": 5 2024-04-25T22:41:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T22:41:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2024-04-25T22:41:48.241 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": "cephfs" 2024-04-25T22:41:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: "read_balance": { 2024-04-25T22:41:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: "error_message": "pool 3 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-04-25T22:41:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: "score_acting": 0, 2024-04-25T22:41:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: "score_stable": 0 2024-04-25T22:41:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 4, 2024-04-25T22:41:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_data", 2024-04-25T22:41:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-04-25T22:40:12.919828+0000", 2024-04-25T22:41:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-04-25T22:41:48.242 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-04-25T22:41:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-04-25T22:41:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-04-25T22:41:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-04-25T22:41:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-04-25T22:41:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:41:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:41:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:41:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:41:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-04-25T22:41:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:41:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 64, 2024-04-25T22:41:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 64, 2024-04-25T22:41:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 64, 2024-04-25T22:41:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 64, 2024-04-25T22:41:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 64, 2024-04-25T22:41:48.243 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-04-25T22:41:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-04-25T22:41:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-04-25T22:41:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-04-25T22:41:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-04-25T22:41:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-04-25T22:41:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-04-25T22:41:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "19", 2024-04-25T22:41:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-04-25T22:41:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:41:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:41:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-04-25T22:41:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:41:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-04-25T22:41:48.244 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-04-25T22:41:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-04-25T22:41:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-04-25T22:41:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-04-25T22:41:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-04-25T22:41:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-04-25T22:41:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-04-25T22:41:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-04-25T22:41:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-04-25T22:41:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-04-25T22:41:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-04-25T22:41:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-04-25T22:41:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:41:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:41:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:41:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-04-25T22:41:48.245 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-04-25T22:41:48.246 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-04-25T22:41:48.246 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-04-25T22:41:48.246 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-04-25T22:41:48.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.246 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-04-25T22:41:48.246 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-04-25T22:41:48.246 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-04-25T22:41:48.246 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:41:48.246 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:41:48.246 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:41:48.246 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:41:48.246 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-04-25T22:41:48.246 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-04-25T22:41:48.246 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-04-25T22:41:48.246 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-04-25T22:41:48.247 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2024-04-25T22:41:48.247 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 64, 2024-04-25T22:41:48.247 INFO:teuthology.orchestra.run.smithi057.stdout: "target_size_ratio": 0.89999997615814209 2024-04-25T22:41:48.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.247 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-04-25T22:41:48.247 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2024-04-25T22:41:48.247 INFO:teuthology.orchestra.run.smithi057.stdout: "data": "cephfs" 2024-04-25T22:41:48.247 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.247 INFO:teuthology.orchestra.run.smithi057.stdout: "read_balance": { 2024-04-25T22:41:48.247 INFO:teuthology.orchestra.run.smithi057.stdout: "error_message": "pool 4 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-04-25T22:41:48.247 INFO:teuthology.orchestra.run.smithi057.stdout: "score_acting": 0, 2024-04-25T22:41:48.247 INFO:teuthology.orchestra.run.smithi057.stdout: "score_stable": 0 2024-04-25T22:41:48.247 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.248 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.248 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:41:48.248 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2024-04-25T22:41:48.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.248 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2024-04-25T22:41:48.248 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "73d465b4-5896-4d69-80b1-7e69d31eb455", 2024-04-25T22:41:48.248 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T22:41:48.248 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T22:41:48.248 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T22:41:48.248 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2024-04-25T22:41:48.248 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T22:41:48.248 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T22:41:48.248 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 8, 2024-04-25T22:41:48.248 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 46, 2024-04-25T22:41:48.248 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T22:41:48.248 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T22:41:48.249 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T22:41:48.249 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:48.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.249 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:48.249 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6800", 2024-04-25T22:41:48.249 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:48.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.249 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:48.249 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6801", 2024-04-25T22:41:48.249 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:48.249 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.249 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:48.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.249 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T22:41:48.250 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:48.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.250 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:48.250 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6802", 2024-04-25T22:41:48.250 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:48.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.250 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:48.250 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6803", 2024-04-25T22:41:48.250 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:48.250 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.250 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:48.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.251 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T22:41:48.251 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:48.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.251 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:48.251 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6806", 2024-04-25T22:41:48.251 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:48.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.251 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:48.251 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6807", 2024-04-25T22:41:48.251 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:48.251 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.251 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:48.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.252 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T22:41:48.252 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:48.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.252 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:48.252 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6804", 2024-04-25T22:41:48.252 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:48.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.252 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:48.252 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.122:6805", 2024-04-25T22:41:48.252 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 765118869 2024-04-25T22:41:48.252 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.252 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:48.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.253 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.122:6801/765118869", 2024-04-25T22:41:48.253 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.122:6803/765118869", 2024-04-25T22:41:48.253 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.122:6807/765118869", 2024-04-25T22:41:48.253 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.122:6805/765118869", 2024-04-25T22:41:48.253 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T22:41:48.253 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T22:41:48.253 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T22:41:48.253 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:48.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.253 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2024-04-25T22:41:48.253 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5", 2024-04-25T22:41:48.253 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 0, 2024-04-25T22:41:48.254 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T22:41:48.254 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T22:41:48.254 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 0, 2024-04-25T22:41:48.254 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T22:41:48.254 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T22:41:48.254 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 8, 2024-04-25T22:41:48.254 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 30, 2024-04-25T22:41:48.254 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 46, 2024-04-25T22:41:48.254 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T22:41:48.254 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T22:41:48.254 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:48.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.254 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:48.255 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6800", 2024-04-25T22:41:48.255 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:48.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.255 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:48.255 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6801", 2024-04-25T22:41:48.255 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:48.255 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.255 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:48.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.255 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T22:41:48.255 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:48.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.256 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:48.256 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6802", 2024-04-25T22:41:48.256 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:48.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.256 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:48.256 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6803", 2024-04-25T22:41:48.256 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:48.256 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.256 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:48.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.256 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T22:41:48.256 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:48.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.257 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:48.257 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6806", 2024-04-25T22:41:48.257 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:48.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.257 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:48.257 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6807", 2024-04-25T22:41:48.257 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:48.257 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.257 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:48.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.257 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T22:41:48.258 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:48.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.258 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:48.258 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6804", 2024-04-25T22:41:48.258 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:48.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.258 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:48.258 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.148:6805", 2024-04-25T22:41:48.258 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2387035286 2024-04-25T22:41:48.258 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.258 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:48.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.258 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.148:6801/2387035286", 2024-04-25T22:41:48.259 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.148:6803/2387035286", 2024-04-25T22:41:48.259 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.148:6807/2387035286", 2024-04-25T22:41:48.259 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.148:6805/2387035286", 2024-04-25T22:41:48.259 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T22:41:48.259 INFO:teuthology.orchestra.run.smithi057.stdout: "exists" 2024-04-25T22:41:48.259 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:48.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.259 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2024-04-25T22:41:48.259 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "164fc653-2135-4e9b-8826-1716fdba6ea0", 2024-04-25T22:41:48.259 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-04-25T22:41:48.259 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-04-25T22:41:48.259 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-04-25T22:41:48.259 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 0, 2024-04-25T22:41:48.259 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 0, 2024-04-25T22:41:48.260 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 0, 2024-04-25T22:41:48.260 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 8, 2024-04-25T22:41:48.260 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 46, 2024-04-25T22:41:48.260 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 0, 2024-04-25T22:41:48.260 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-04-25T22:41:48.260 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-04-25T22:41:48.260 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:48.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.260 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:48.260 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6800", 2024-04-25T22:41:48.260 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:48.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.260 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:48.261 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6801", 2024-04-25T22:41:48.261 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:48.261 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.261 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:48.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.261 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-04-25T22:41:48.261 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:48.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.261 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:48.261 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6802", 2024-04-25T22:41:48.261 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:48.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.261 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:48.261 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6803", 2024-04-25T22:41:48.261 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:48.262 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.262 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:48.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.262 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-04-25T22:41:48.262 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:48.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.262 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:48.262 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6806", 2024-04-25T22:41:48.262 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:48.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.262 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:48.262 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6807", 2024-04-25T22:41:48.262 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:48.263 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.263 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:48.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.263 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-04-25T22:41:48.263 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-04-25T22:41:48.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.263 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v2", 2024-04-25T22:41:48.263 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6804", 2024-04-25T22:41:48.263 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:48.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.263 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-04-25T22:41:48.263 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.188:6805", 2024-04-25T22:41:48.263 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 368834361 2024-04-25T22:41:48.264 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.264 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:48.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.264 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.188:6801/368834361", 2024-04-25T22:41:48.264 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.188:6803/368834361", 2024-04-25T22:41:48.264 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.188:6807/368834361", 2024-04-25T22:41:48.264 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.188:6805/368834361", 2024-04-25T22:41:48.264 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-04-25T22:41:48.264 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-04-25T22:41:48.264 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-04-25T22:41:48.264 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-04-25T22:41:48.264 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.264 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:41:48.264 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2024-04-25T22:41:48.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.265 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2024-04-25T22:41:48.265 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T22:41:48.265 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T22:41:48.265 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T22:41:48.265 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540701547738038271, 2024-04-25T22:41:48.265 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2024-04-25T22:41:48.265 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2024-04-25T22:39:58.559393+0000", 2024-04-25T22:41:48.265 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2024-04-25T22:41:48.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.265 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2024-04-25T22:41:48.265 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T22:41:48.265 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T22:41:48.265 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T22:41:48.266 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540701547738038271, 2024-04-25T22:41:48.266 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2024-04-25T22:41:48.266 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2024-04-25T22:39:58.563434+0000", 2024-04-25T22:41:48.266 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 45 2024-04-25T22:41:48.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-04-25T22:41:48.266 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2024-04-25T22:41:48.266 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-04-25T22:41:48.266 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-04-25T22:41:48.266 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-04-25T22:41:48.266 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540701547738038271, 2024-04-25T22:41:48.266 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2024-04-25T22:41:48.266 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2024-04-25T22:39:58.557643+0000", 2024-04-25T22:41:48.266 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2024-04-25T22:41:48.267 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.267 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-04-25T22:41:48.267 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2024-04-25T22:41:48.267 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2024-04-25T22:41:48.267 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_primaries": [], 2024-04-25T22:41:48.267 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2024-04-25T22:41:48.267 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2024-04-25T22:41:48.267 INFO:teuthology.orchestra.run.smithi057.stdout: "blocklist": {}, 2024-04-25T22:41:48.267 INFO:teuthology.orchestra.run.smithi057.stdout: "range_blocklist": {}, 2024-04-25T22:41:48.267 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2024-04-25T22:41:48.267 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2024-04-25T22:41:48.267 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2024-04-25T22:41:48.267 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2024-04-25T22:41:48.267 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2024-04-25T22:41:48.268 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2024-04-25T22:41:48.268 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2024-04-25T22:41:48.268 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-04-25T22:41:48.268 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2024-04-25T22:41:48.268 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2024-04-25T22:41:48.268 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2024-04-25T22:41:48.268 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2024-04-25T22:41:48.268 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {}, 2024-04-25T22:41:48.268 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_mode": { 2024-04-25T22:41:48.268 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_mode_enabled": false, 2024-04-25T22:41:48.268 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_bucket_count": 0, 2024-04-25T22:41:48.268 INFO:teuthology.orchestra.run.smithi057.stdout: "degraded_stretch_mode": 0, 2024-04-25T22:41:48.268 INFO:teuthology.orchestra.run.smithi057.stdout: "recovering_stretch_mode": 0, 2024-04-25T22:41:48.269 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_mode_bucket": 0 2024-04-25T22:41:48.269 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-04-25T22:41:48.269 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:41:48.270 INFO:tasks.thrashosds.thrasher:j is {'epoch': 51, 'fsid': '5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d', 'created': '2024-04-25T22:39:52.303074+0000', 'modified': '2024-04-25T22:41:45.639476+0000', 'last_up_change': '2024-04-25T22:41:34.334402+0000', 'last_in_change': '2024-04-25T22:39:53.230242+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:40:03.197725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'error_message': 'pool 1 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:40:07.560858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:40:12.431697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'error_message': 'pool 3 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:40:12.919828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 4 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': '73d465b4-5896-4d69-80b1-7e69d31eb455', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6800', 'nonce': 765118869}, {'type': 'v1', 'addr': '172.21.15.122:6801', 'nonce': 765118869}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6802', 'nonce': 765118869}, {'type': 'v1', 'addr': '172.21.15.122:6803', 'nonce': 765118869}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6806', 'nonce': 765118869}, {'type': 'v1', 'addr': '172.21.15.122:6807', 'nonce': 765118869}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6804', 'nonce': 765118869}, {'type': 'v1', 'addr': '172.21.15.122:6805', 'nonce': 765118869}]}, 'public_addr': '172.21.15.122:6801/765118869', 'cluster_addr': '172.21.15.122:6803/765118869', 'heartbeat_back_addr': '172.21.15.122:6807/765118869', 'heartbeat_front_addr': '172.21.15.122:6805/765118869', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 30, 'down_at': 46, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6800', 'nonce': 2387035286}, {'type': 'v1', 'addr': '172.21.15.148:6801', 'nonce': 2387035286}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6802', 'nonce': 2387035286}, {'type': 'v1', 'addr': '172.21.15.148:6803', 'nonce': 2387035286}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6806', 'nonce': 2387035286}, {'type': 'v1', 'addr': '172.21.15.148:6807', 'nonce': 2387035286}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6804', 'nonce': 2387035286}, {'type': 'v1', 'addr': '172.21.15.148:6805', 'nonce': 2387035286}]}, 'public_addr': '172.21.15.148:6801/2387035286', 'cluster_addr': '172.21.15.148:6803/2387035286', 'heartbeat_back_addr': '172.21.15.148:6807/2387035286', 'heartbeat_front_addr': '172.21.15.148:6805/2387035286', 'state': ['exists']}, {'osd': 2, 'uuid': '164fc653-2135-4e9b-8826-1716fdba6ea0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6800', 'nonce': 368834361}, {'type': 'v1', 'addr': '172.21.15.188:6801', 'nonce': 368834361}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6802', 'nonce': 368834361}, {'type': 'v1', 'addr': '172.21.15.188:6803', 'nonce': 368834361}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6806', 'nonce': 368834361}, {'type': 'v1', 'addr': '172.21.15.188:6807', 'nonce': 368834361}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6804', 'nonce': 368834361}, {'type': 'v1', 'addr': '172.21.15.188:6805', 'nonce': 368834361}]}, 'public_addr': '172.21.15.188:6801/368834361', 'cluster_addr': '172.21.15.188:6803/368834361', 'heartbeat_back_addr': '172.21.15.188:6807/368834361', 'heartbeat_front_addr': '172.21.15.188:6805/368834361', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:39:58.559393+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:39:58.563434+0000', 'dead_epoch': 45}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:39:58.557643+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-25T22:41:48.271 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:41:48.313 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:48.313+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:48.393 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:48.393 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:48.407 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:48.449 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:48.449+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:48.514 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:48.508+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:48.540 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:48.540 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:48.555 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:41:48.557 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:41:48.558 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:48.576 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-04-25T22:41:47.145326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":17,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":143,"acting":143,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91772,"kb_used_data":2392,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283023748,"statfs":{"total":289910292480,"available":289816317952,"internally_reserved":0,"allocated":2449408,"data_stored":1730906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.734787"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":37,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.416926+0000","last_change":"2024-04-25T22:41:35.383072+0000","last_active":"2024-04-25T22:41:39.416926+0000","last_peered":"2024-04-25T22:41:39.416926+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:41:35.383072+0000","last_became_peered":"2024-04-25T22:41:35.383072+0000","last_unstale":"2024-04-25T22:41:39.416926+0000","last_undegraded":"2024-04-25T22:41:39.416926+0000","last_fullsized":"2024-04-25T22:41:35.375957+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:36:05.996021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":37,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.415068+0000","last_change":"2024-04-25T22:41:35.381887+0000","last_active":"2024-04-25T22:41:39.415068+0000","last_peered":"2024-04-25T22:41:39.415068+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:41:35.381887+0000","last_became_peered":"2024-04-25T22:41:35.381887+0000","last_unstale":"2024-04-25T22:41:39.415068+0000","last_undegraded":"2024-04-25T22:41:39.415068+0000","last_fullsized":"2024-04-25T22:41:35.374821+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:22:05.510857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":73,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.419767+0000","last_change":"2024-04-25T22:41:35.392947+0000","last_active":"2024-04-25T22:41:39.419767+0000","last_peered":"2024-04-25T22:41:39.419767+0000","last_clean":"2024-04-25T22:41:34.255813+0000","last_became_active":"2024-04-25T22:41:35.392947+0000","last_became_peered":"2024-04-25T22:41:35.392947+0000","last_unstale":"2024-04-25T22:41:39.419767+0000","last_undegraded":"2024-04-25T22:41:39.419767+0000","last_fullsized":"2024-04-25T22:41:35.381912+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:10.648131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":71,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.418418+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:41:39.418418+0000","last_peered":"2024-04-25T22:41:39.418418+0000","last_clean":"2024-04-25T22:41:39.418418+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:41:39.418418+0000","last_undegraded":"2024-04-25T22:41:39.418418+0000","last_fullsized":"2024-04-25T22:41:39.418418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":37,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.414552+0000","last_change":"2024-04-25T22:41:35.379723+0000","last_active":"2024-04-25T22:41:39.414552+0000","last_peered":"2024-04-25T22:41:39.414552+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:41:35.379723+0000","last_became_peered":"2024-04-25T22:41:35.379723+0000","last_unstale":"2024-04-25T22:41:39.414552+0000","last_undegraded":"2024-04-25T22:41:39.414552+0000","last_fullsized":"2024-04-25T22:41:35.373576+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:14:06.235329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":71,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.418841+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:41:39.418841+0000","last_peered":"2024-04-25T22:41:39.418841+0000","last_clean":"2024-04-25T22:41:39.418841+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:41:39.418841+0000","last_undegraded":"2024-04-25T22:41:39.418841+0000","last_fullsized":"2024-04-25T22:41:39.418841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":71,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.418511+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:41:39.418511+0000","last_peered":"2024-04-25T22:41:39.418511+0000","last_clean":"2024-04-25T22:41:39.418511+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:41:39.418511+0000","last_undegraded":"2024-04-25T22:41:39.418511+0000","last_fullsized":"2024-04-25T22:41:39.418511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":71,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.417862+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:41:39.417862+0000","last_peered":"2024-04-25T22:41:39.417862+0000","last_clean":"2024-04-25T22:41:39.417862+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:41:39.417862+0000","last_undegraded":"2024-04-25T22:41:39.417862+0000","last_fullsized":"2024-04-25T22:41:39.417862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":74,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.416525+0000","last_change":"2024-04-25T22:41:35.379844+0000","last_active":"2024-04-25T22:41:39.416525+0000","last_peered":"2024-04-25T22:41:39.416525+0000","last_clean":"2024-04-25T22:41:33.341370+0000","last_became_active":"2024-04-25T22:41:35.379844+0000","last_became_peered":"2024-04-25T22:41:35.379844+0000","last_unstale":"2024-04-25T22:41:39.416525+0000","last_undegraded":"2024-04-25T22:41:39.416525+0000","last_fullsized":"2024-04-25T22:41:35.375067+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:19:42.552250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":37,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.415368+0000","last_change":"2024-04-25T22:41:35.380006+0000","last_active":"2024-04-25T22:41:39.415368+0000","last_peered":"2024-04-25T22:41:39.415368+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:41:35.380006+0000","last_became_peered":"2024-04-25T22:41:35.380006+0000","last_unstale":"2024-04-25T22:41:39.415368+0000","last_undegraded":"2024-04-25T22:41:39.415368+0000","last_fullsized":"2024-04-25T22:41:35.375095+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:16.341334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":71,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.420033+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:41:39.420033+0000","last_peered":"2024-04-25T22:41:39.420033+0000","last_clean":"2024-04-25T22:41:39.420033+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:41:39.420033+0000","last_undegraded":"2024-04-25T22:41:39.420033+0000","last_fullsized":"2024-04-25T22:41:39.420033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.417904+0000","last_change":"2024-04-25T22:41:35.384533+0000","last_active":"2024-04-25T22:41:39.417904+0000","last_peered":"2024-04-25T22:41:39.417904+0000","last_clean":"2024-04-25T22:41:34.255048+0000","last_became_active":"2024-04-25T22:41:35.384533+0000","last_became_peered":"2024-04-25T22:41:35.384533+0000","last_unstale":"2024-04-25T22:41:39.417904+0000","last_undegraded":"2024-04-25T22:41:39.417904+0000","last_fullsized":"2024-04-25T22:41:35.379912+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:18.444737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":37,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.414617+0000","last_change":"2024-04-25T22:41:35.380402+0000","last_active":"2024-04-25T22:41:39.414617+0000","last_peered":"2024-04-25T22:41:39.414617+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:41:35.380402+0000","last_became_peered":"2024-04-25T22:41:35.380402+0000","last_unstale":"2024-04-25T22:41:39.414617+0000","last_undegraded":"2024-04-25T22:41:39.414617+0000","last_fullsized":"2024-04-25T22:41:35.373789+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:08.083943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":73,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.419082+0000","last_change":"2024-04-25T22:41:35.391345+0000","last_active":"2024-04-25T22:41:39.419082+0000","last_peered":"2024-04-25T22:41:39.419082+0000","last_clean":"2024-04-25T22:41:34.255218+0000","last_became_active":"2024-04-25T22:41:35.391345+0000","last_became_peered":"2024-04-25T22:41:35.391345+0000","last_unstale":"2024-04-25T22:41:39.419082+0000","last_undegraded":"2024-04-25T22:41:39.419082+0000","last_fullsized":"2024-04-25T22:41:35.381720+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:01.698545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":73,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.418561+0000","last_change":"2024-04-25T22:41:35.390558+0000","last_active":"2024-04-25T22:41:39.418561+0000","last_peered":"2024-04-25T22:41:39.418561+0000","last_clean":"2024-04-25T22:41:34.256312+0000","last_became_active":"2024-04-25T22:41:35.390558+0000","last_became_peered":"2024-04-25T22:41:35.390558+0000","last_unstale":"2024-04-25T22:41:39.418561+0000","last_undegraded":"2024-04-25T22:41:39.418561+0000","last_fullsized":"2024-04-25T22:41:35.380286+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:02:31.289032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":71,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.420439+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:41:39.420439+0000","last_peered":"2024-04-25T22:41:39.420439+0000","last_clean":"2024-04-25T22:41:39.420439+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:41:39.420439+0000","last_undegraded":"2024-04-25T22:41:39.420439+0000","last_fullsized":"2024-04-25T22:41:39.420439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":74,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.417098+0000","last_change":"2024-04-25T22:41:35.383375+0000","last_active":"2024-04-25T22:41:39.417098+0000","last_peered":"2024-04-25T22:41:39.417098+0000","last_clean":"2024-04-25T22:41:33.342064+0000","last_became_active":"2024-04-25T22:41:35.383375+0000","last_became_peered":"2024-04-25T22:41:35.383375+0000","last_unstale":"2024-04-25T22:41:39.417098+0000","last_undegraded":"2024-04-25T22:41:39.417098+0000","last_fullsized":"2024-04-25T22:41:35.376453+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:14:57.342647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":37,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.416433+0000","last_change":"2024-04-25T22:41:35.381947+0000","last_active":"2024-04-25T22:41:39.416433+0000","last_peered":"2024-04-25T22:41:39.416433+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:41:35.381947+0000","last_became_peered":"2024-04-25T22:41:35.381947+0000","last_unstale":"2024-04-25T22:41:39.416433+0000","last_undegraded":"2024-04-25T22:41:39.416433+0000","last_fullsized":"2024-04-25T22:41:35.376222+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:05.742667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":74,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.415540+0000","last_change":"2024-04-25T22:41:35.380574+0000","last_active":"2024-04-25T22:41:39.415540+0000","last_peered":"2024-04-25T22:41:39.415540+0000","last_clean":"2024-04-25T22:41:33.341549+0000","last_became_active":"2024-04-25T22:41:35.380574+0000","last_became_peered":"2024-04-25T22:41:35.380574+0000","last_unstale":"2024-04-25T22:41:39.415540+0000","last_undegraded":"2024-04-25T22:41:39.415540+0000","last_fullsized":"2024-04-25T22:41:35.374693+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:03:37.235283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":71,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.418684+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:41:39.418684+0000","last_peered":"2024-04-25T22:41:39.418684+0000","last_clean":"2024-04-25T22:41:39.418684+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:41:39.418684+0000","last_undegraded":"2024-04-25T22:41:39.418684+0000","last_fullsized":"2024-04-25T22:41:39.418684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":71,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.419585+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:41:39.419585+0000","last_peered":"2024-04-25T22:41:39.419585+0000","last_clean":"2024-04-25T22:41:39.419585+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:41:39.419585+0000","last_undegraded":"2024-04-25T22:41:39.419585+0000","last_fullsized":"2024-04-25T22:41:39.419585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.417441+0000","last_change":"2024-04-25T22:41:35.385207+0000","last_active":"2024-04-25T22:41:39.417441+0000","last_peered":"2024-04-25T22:41:39.417441+0000","last_clean":"2024-04-25T22:41:34.254643+0000","last_became_active":"2024-04-25T22:41:35.385207+0000","last_became_peered":"2024-04-25T22:41:35.385207+0000","last_unstale":"2024-04-25T22:41:39.417441+0000","last_undegraded":"2024-04-25T22:41:39.417441+0000","last_fullsized":"2024-04-25T22:41:35.379042+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:05.742667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.418766+0000","last_change":"2024-04-25T22:40:52.547012+0000","last_active":"2024-04-25T22:41:39.418766+0000","last_peered":"2024-04-25T22:41:39.418766+0000","last_clean":"2024-04-25T22:41:39.418766+0000","last_became_active":"2024-04-25T22:40:52.544993+0000","last_became_peered":"2024-04-25T22:40:52.544993+0000","last_unstale":"2024-04-25T22:41:39.418766+0000","last_undegraded":"2024-04-25T22:41:39.418766+0000","last_fullsized":"2024-04-25T22:41:39.418766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:35.659946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":37,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.413758+0000","last_change":"2024-04-25T22:41:35.373557+0000","last_active":"2024-04-25T22:41:39.413758+0000","last_peered":"2024-04-25T22:41:39.413758+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:41:35.373557+0000","last_became_peered":"2024-04-25T22:41:35.373557+0000","last_unstale":"2024-04-25T22:41:39.413758+0000","last_undegraded":"2024-04-25T22:41:39.413758+0000","last_fullsized":"2024-04-25T22:41:35.371984+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:12.100221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.418731+0000","last_change":"2024-04-25T22:41:35.388513+0000","last_active":"2024-04-25T22:41:39.418731+0000","last_peered":"2024-04-25T22:41:39.418731+0000","last_clean":"2024-04-25T22:41:34.256374+0000","last_became_active":"2024-04-25T22:41:35.388513+0000","last_became_peered":"2024-04-25T22:41:35.388513+0000","last_unstale":"2024-04-25T22:41:39.418731+0000","last_undegraded":"2024-04-25T22:41:39.418731+0000","last_fullsized":"2024-04-25T22:41:35.380960+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:14:57.342647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.421655+0000","last_change":"2024-04-25T22:40:52.546683+0000","last_active":"2024-04-25T22:41:39.421655+0000","last_peered":"2024-04-25T22:41:39.421655+0000","last_clean":"2024-04-25T22:41:39.421655+0000","last_became_active":"2024-04-25T22:40:52.544838+0000","last_became_peered":"2024-04-25T22:40:52.544838+0000","last_unstale":"2024-04-25T22:41:39.421655+0000","last_undegraded":"2024-04-25T22:41:39.421655+0000","last_fullsized":"2024-04-25T22:41:39.421655+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:29:48.351231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":73,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.420289+0000","last_change":"2024-04-25T22:41:35.393638+0000","last_active":"2024-04-25T22:41:39.420289+0000","last_peered":"2024-04-25T22:41:39.420289+0000","last_clean":"2024-04-25T22:41:34.256209+0000","last_became_active":"2024-04-25T22:41:35.393638+0000","last_became_peered":"2024-04-25T22:41:35.393638+0000","last_unstale":"2024-04-25T22:41:39.420289+0000","last_undegraded":"2024-04-25T22:41:39.420289+0000","last_fullsized":"2024-04-25T22:41:35.383995+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:01:14.332384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.418101+0000","last_change":"2024-04-25T22:41:35.388258+0000","last_active":"2024-04-25T22:41:39.418101+0000","last_peered":"2024-04-25T22:41:39.418101+0000","last_clean":"2024-04-25T22:41:34.255376+0000","last_became_active":"2024-04-25T22:41:35.388258+0000","last_became_peered":"2024-04-25T22:41:35.388258+0000","last_unstale":"2024-04-25T22:41:39.418101+0000","last_undegraded":"2024-04-25T22:41:39.418101+0000","last_fullsized":"2024-04-25T22:41:35.380648+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:36:05.996021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":74,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.415577+0000","last_change":"2024-04-25T22:41:35.380944+0000","last_active":"2024-04-25T22:41:39.415577+0000","last_peered":"2024-04-25T22:41:39.415577+0000","last_clean":"2024-04-25T22:41:33.340911+0000","last_became_active":"2024-04-25T22:41:35.380944+0000","last_became_peered":"2024-04-25T22:41:35.380944+0000","last_unstale":"2024-04-25T22:41:39.415577+0000","last_undegraded":"2024-04-25T22:41:39.415577+0000","last_fullsized":"2024-04-25T22:41:35.374642+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:59.636776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.418386+0000","last_change":"2024-04-25T22:41:35.388182+0000","last_active":"2024-04-25T22:41:39.418386+0000","last_peered":"2024-04-25T22:41:39.418386+0000","last_clean":"2024-04-25T22:41:34.255390+0000","last_became_active":"2024-04-25T22:41:35.388182+0000","last_became_peered":"2024-04-25T22:41:35.388182+0000","last_unstale":"2024-04-25T22:41:39.418386+0000","last_undegraded":"2024-04-25T22:41:39.418386+0000","last_fullsized":"2024-04-25T22:41:35.380918+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:15.247328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":74,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.413765+0000","last_change":"2024-04-25T22:41:35.373564+0000","last_active":"2024-04-25T22:41:39.413765+0000","last_peered":"2024-04-25T22:41:39.413765+0000","last_clean":"2024-04-25T22:41:33.339970+0000","last_became_active":"2024-04-25T22:41:35.373564+0000","last_became_peered":"2024-04-25T22:41:35.373564+0000","last_unstale":"2024-04-25T22:41:39.413765+0000","last_undegraded":"2024-04-25T22:41:39.413765+0000","last_fullsized":"2024-04-25T22:41:35.371993+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:02:43.032682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":71,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.418148+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:41:39.418148+0000","last_peered":"2024-04-25T22:41:39.418148+0000","last_clean":"2024-04-25T22:41:39.418148+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:41:39.418148+0000","last_undegraded":"2024-04-25T22:41:39.418148+0000","last_fullsized":"2024-04-25T22:41:39.418148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":37,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.414596+0000","last_change":"2024-04-25T22:41:35.380989+0000","last_active":"2024-04-25T22:41:39.414596+0000","last_peered":"2024-04-25T22:41:39.414596+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:41:35.380989+0000","last_became_peered":"2024-04-25T22:41:35.380989+0000","last_unstale":"2024-04-25T22:41:39.414596+0000","last_undegraded":"2024-04-25T22:41:39.414596+0000","last_fullsized":"2024-04-25T22:41:35.374689+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:12.954925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.420214+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:41:39.420214+0000","last_peered":"2024-04-25T22:41:39.420214+0000","last_clean":"2024-04-25T22:41:39.420214+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:41:39.420214+0000","last_undegraded":"2024-04-25T22:41:39.420214+0000","last_fullsized":"2024-04-25T22:41:39.420214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":37,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.415264+0000","last_change":"2024-04-25T22:41:35.379659+0000","last_active":"2024-04-25T22:41:39.415264+0000","last_peered":"2024-04-25T22:41:39.415264+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:41:35.379659+0000","last_became_peered":"2024-04-25T22:41:35.379659+0000","last_unstale":"2024-04-25T22:41:39.415264+0000","last_undegraded":"2024-04-25T22:41:39.415264+0000","last_fullsized":"2024-04-25T22:41:35.374160+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:36.675840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.419874+0000","last_change":"2024-04-25T22:40:52.544421+0000","last_active":"2024-04-25T22:41:39.419874+0000","last_peered":"2024-04-25T22:41:39.419874+0000","last_clean":"2024-04-25T22:41:39.419874+0000","last_became_active":"2024-04-25T22:40:52.543621+0000","last_became_peered":"2024-04-25T22:40:52.543621+0000","last_unstale":"2024-04-25T22:41:39.419874+0000","last_undegraded":"2024-04-25T22:41:39.419874+0000","last_fullsized":"2024-04-25T22:41:39.419874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:10:22.333204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.421353+0000","last_change":"2024-04-25T22:40:52.550914+0000","last_active":"2024-04-25T22:41:39.421353+0000","last_peered":"2024-04-25T22:41:39.421353+0000","last_clean":"2024-04-25T22:41:39.421353+0000","last_became_active":"2024-04-25T22:40:52.549546+0000","last_became_peered":"2024-04-25T22:40:52.549546+0000","last_unstale":"2024-04-25T22:41:39.421353+0000","last_undegraded":"2024-04-25T22:41:39.421353+0000","last_fullsized":"2024-04-25T22:41:39.421353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:36:41.805159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.417719+0000","last_change":"2024-04-25T22:41:35.384829+0000","last_active":"2024-04-25T22:41:39.417719+0000","last_peered":"2024-04-25T22:41:39.417719+0000","last_clean":"2024-04-25T22:41:34.254755+0000","last_became_active":"2024-04-25T22:41:35.384829+0000","last_became_peered":"2024-04-25T22:41:35.384829+0000","last_unstale":"2024-04-25T22:41:39.417719+0000","last_undegraded":"2024-04-25T22:41:39.417719+0000","last_fullsized":"2024-04-25T22:41:35.379281+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:24.374302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.418547+0000","last_change":"2024-04-25T22:40:52.549474+0000","last_active":"2024-04-25T22:41:39.418547+0000","last_peered":"2024-04-25T22:41:39.418547+0000","last_clean":"2024-04-25T22:41:39.418547+0000","last_became_active":"2024-04-25T22:40:52.547744+0000","last_became_peered":"2024-04-25T22:40:52.547744+0000","last_unstale":"2024-04-25T22:41:39.418547+0000","last_undegraded":"2024-04-25T22:41:39.418547+0000","last_fullsized":"2024-04-25T22:41:39.418547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:50:43.950890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":83,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-04-25T22:41:39.419371+0000","last_change":"2024-04-25T22:41:35.393637+0000","last_active":"2024-04-25T22:41:39.419371+0000","last_peered":"2024-04-25T22:41:39.419371+0000","last_clean":"2024-04-25T22:41:34.253587+0000","last_became_active":"2024-04-25T22:41:35.393637+0000","last_became_peered":"2024-04-25T22:41:35.393637+0000","last_unstale":"2024-04-25T22:41:39.419371+0000","last_undegraded":"2024-04-25T22:41:35.380134+0000","last_fullsized":"2024-04-25T22:41:35.379926+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:30.072425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":76,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-04-25T22:41:39.421171+0000","last_change":"2024-04-25T22:41:35.391705+0000","last_active":"2024-04-25T22:41:39.421171+0000","last_peered":"2024-04-25T22:41:39.421171+0000","last_clean":"2024-04-25T22:41:34.254180+0000","last_became_active":"2024-04-25T22:41:35.391705+0000","last_became_peered":"2024-04-25T22:41:35.391705+0000","last_unstale":"2024-04-25T22:41:39.421171+0000","last_undegraded":"2024-04-25T22:41:35.384549+0000","last_fullsized":"2024-04-25T22:41:35.384312+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:02:55.984514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.417200+0000","last_change":"2024-04-25T22:41:35.387396+0000","last_active":"2024-04-25T22:41:39.417200+0000","last_peered":"2024-04-25T22:41:39.417200+0000","last_clean":"2024-04-25T22:41:34.254259+0000","last_became_active":"2024-04-25T22:41:35.387396+0000","last_became_peered":"2024-04-25T22:41:35.387396+0000","last_unstale":"2024-04-25T22:41:39.417200+0000","last_undegraded":"2024-04-25T22:41:39.417200+0000","last_fullsized":"2024-04-25T22:41:35.378674+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:38:56.060297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":78,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-04-25T22:41:39.420169+0000","last_change":"2024-04-25T22:41:35.388365+0000","last_active":"2024-04-25T22:41:39.420169+0000","last_peered":"2024-04-25T22:41:39.420169+0000","last_clean":"2024-04-25T22:41:34.256081+0000","last_became_active":"2024-04-25T22:41:35.388365+0000","last_became_peered":"2024-04-25T22:41:35.388365+0000","last_unstale":"2024-04-25T22:41:39.420169+0000","last_undegraded":"2024-04-25T22:41:35.381517+0000","last_fullsized":"2024-04-25T22:41:35.381308+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:33:00.361883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":37,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.413948+0000","last_change":"2024-04-25T22:41:35.377184+0000","last_active":"2024-04-25T22:41:39.413948+0000","last_peered":"2024-04-25T22:41:39.413948+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:41:35.377184+0000","last_became_peered":"2024-04-25T22:41:35.377184+0000","last_unstale":"2024-04-25T22:41:39.413948+0000","last_undegraded":"2024-04-25T22:41:39.413948+0000","last_fullsized":"2024-04-25T22:41:35.372481+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:28:55.307548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":76,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-04-25T22:41:39.422612+0000","last_change":"2024-04-25T22:41:35.397510+0000","last_active":"2024-04-25T22:41:39.422612+0000","last_peered":"2024-04-25T22:41:39.422612+0000","last_clean":"2024-04-25T22:41:34.253912+0000","last_became_active":"2024-04-25T22:41:35.397510+0000","last_became_peered":"2024-04-25T22:41:35.397510+0000","last_unstale":"2024-04-25T22:41:39.422612+0000","last_undegraded":"2024-04-25T22:41:35.388175+0000","last_fullsized":"2024-04-25T22:41:35.387922+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:36:40.340986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":71,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.419423+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:41:39.419423+0000","last_peered":"2024-04-25T22:41:39.419423+0000","last_clean":"2024-04-25T22:41:39.419423+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:41:39.419423+0000","last_undegraded":"2024-04-25T22:41:39.419423+0000","last_fullsized":"2024-04-25T22:41:39.419423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":73,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.420090+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:41:39.420090+0000","last_peered":"2024-04-25T22:41:39.420090+0000","last_clean":"2024-04-25T22:41:39.420090+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:41:39.420090+0000","last_undegraded":"2024-04-25T22:41:39.420090+0000","last_fullsized":"2024-04-25T22:41:39.420090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.418743+0000","last_change":"2024-04-25T22:40:52.543894+0000","last_active":"2024-04-25T22:41:39.418743+0000","last_peered":"2024-04-25T22:41:39.418743+0000","last_clean":"2024-04-25T22:41:39.418743+0000","last_became_active":"2024-04-25T22:40:52.541677+0000","last_became_peered":"2024-04-25T22:40:52.541677+0000","last_unstale":"2024-04-25T22:41:39.418743+0000","last_undegraded":"2024-04-25T22:41:39.418743+0000","last_fullsized":"2024-04-25T22:41:39.418743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:30:38.984858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":57,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.419867+0000","last_change":"2024-04-25T22:40:52.547699+0000","last_active":"2024-04-25T22:41:39.419867+0000","last_peered":"2024-04-25T22:41:39.419867+0000","last_clean":"2024-04-25T22:41:39.419867+0000","last_became_active":"2024-04-25T22:40:52.546654+0000","last_became_peered":"2024-04-25T22:40:52.546654+0000","last_unstale":"2024-04-25T22:41:39.419867+0000","last_undegraded":"2024-04-25T22:41:39.419867+0000","last_fullsized":"2024-04-25T22:41:39.419867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:55:52.272415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":71,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.418917+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:41:39.418917+0000","last_peered":"2024-04-25T22:41:39.418917+0000","last_clean":"2024-04-25T22:41:39.418917+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:41:39.418917+0000","last_undegraded":"2024-04-25T22:41:39.418917+0000","last_fullsized":"2024-04-25T22:41:39.418917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":73,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.419993+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:41:39.419993+0000","last_peered":"2024-04-25T22:41:39.419993+0000","last_clean":"2024-04-25T22:41:39.419993+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:41:39.419993+0000","last_undegraded":"2024-04-25T22:41:39.419993+0000","last_fullsized":"2024-04-25T22:41:39.419993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":73,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.422128+0000","last_change":"2024-04-25T22:41:35.397083+0000","last_active":"2024-04-25T22:41:39.422128+0000","last_peered":"2024-04-25T22:41:39.422128+0000","last_clean":"2024-04-25T22:41:34.256785+0000","last_became_active":"2024-04-25T22:41:35.397083+0000","last_became_peered":"2024-04-25T22:41:35.397083+0000","last_unstale":"2024-04-25T22:41:39.422128+0000","last_undegraded":"2024-04-25T22:41:39.422128+0000","last_fullsized":"2024-04-25T22:41:35.387259+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:05.015622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.418087+0000","last_change":"2024-04-25T22:41:35.385097+0000","last_active":"2024-04-25T22:41:39.418087+0000","last_peered":"2024-04-25T22:41:39.418087+0000","last_clean":"2024-04-25T22:41:34.254779+0000","last_became_active":"2024-04-25T22:41:35.385097+0000","last_became_peered":"2024-04-25T22:41:35.385097+0000","last_unstale":"2024-04-25T22:41:39.418087+0000","last_undegraded":"2024-04-25T22:41:39.418087+0000","last_fullsized":"2024-04-25T22:41:35.379754+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:30.157183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":73,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.420861+0000","last_change":"2024-04-25T22:41:35.388881+0000","last_active":"2024-04-25T22:41:39.420861+0000","last_peered":"2024-04-25T22:41:39.420861+0000","last_clean":"2024-04-25T22:41:34.256232+0000","last_became_active":"2024-04-25T22:41:35.388881+0000","last_became_peered":"2024-04-25T22:41:35.388881+0000","last_unstale":"2024-04-25T22:41:39.420861+0000","last_undegraded":"2024-04-25T22:41:39.420861+0000","last_fullsized":"2024-04-25T22:41:35.381441+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:45.756043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.413768+0000","last_change":"2024-04-25T22:41:35.376197+0000","last_active":"2024-04-25T22:41:39.413768+0000","last_peered":"2024-04-25T22:41:39.413768+0000","last_clean":"2024-04-25T22:40:12.512392+0000","last_became_active":"2024-04-25T22:41:35.376197+0000","last_became_peered":"2024-04-25T22:41:35.376197+0000","last_unstale":"2024-04-25T22:41:39.413768+0000","last_undegraded":"2024-04-25T22:41:39.413768+0000","last_fullsized":"2024-04-25T22:41:35.372126+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:32:34.630961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":74,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.416617+0000","last_change":"2024-04-25T22:41:35.382344+0000","last_active":"2024-04-25T22:41:39.416617+0000","last_peered":"2024-04-25T22:41:39.416617+0000","last_clean":"2024-04-25T22:41:33.341615+0000","last_became_active":"2024-04-25T22:41:35.382344+0000","last_became_peered":"2024-04-25T22:41:35.382344+0000","last_unstale":"2024-04-25T22:41:39.416617+0000","last_undegraded":"2024-04-25T22:41:39.416617+0000","last_fullsized":"2024-04-25T22:41:35.375544+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:33:01.390868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":283,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-04-25T22:41:39.421555+0000","last_change":"2024-04-25T22:41:35.394047+0000","last_active":"2024-04-25T22:41:39.421555+0000","last_peered":"2024-04-25T22:41:39.421555+0000","last_clean":"2024-04-25T22:41:34.256969+0000","last_became_active":"2024-04-25T22:41:35.394047+0000","last_became_peered":"2024-04-25T22:41:35.394047+0000","last_unstale":"2024-04-25T22:41:39.421555+0000","last_undegraded":"2024-04-25T22:41:35.382945+0000","last_fullsized":"2024-04-25T22:41:35.382731+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:03.467646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":79,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.421017+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:41:39.421017+0000","last_peered":"2024-04-25T22:41:39.421017+0000","last_clean":"2024-04-25T22:41:39.421017+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:41:39.421017+0000","last_undegraded":"2024-04-25T22:41:39.421017+0000","last_fullsized":"2024-04-25T22:41:39.421017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":76,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.414999+0000","last_change":"2024-04-25T22:41:35.377757+0000","last_active":"2024-04-25T22:41:39.414999+0000","last_peered":"2024-04-25T22:41:39.414999+0000","last_clean":"2024-04-25T22:41:33.340701+0000","last_became_active":"2024-04-25T22:41:35.377757+0000","last_became_peered":"2024-04-25T22:41:35.377757+0000","last_unstale":"2024-04-25T22:41:39.414999+0000","last_undegraded":"2024-04-25T22:41:39.414999+0000","last_fullsized":"2024-04-25T22:41:35.373135+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:50:42.921905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":73,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.422140+0000","last_change":"2024-04-25T22:41:35.396885+0000","last_active":"2024-04-25T22:41:39.422140+0000","last_peered":"2024-04-25T22:41:39.422140+0000","last_clean":"2024-04-25T22:41:34.256933+0000","last_became_active":"2024-04-25T22:41:35.396885+0000","last_became_peered":"2024-04-25T22:41:35.396885+0000","last_unstale":"2024-04-25T22:41:39.422140+0000","last_undegraded":"2024-04-25T22:41:39.422140+0000","last_fullsized":"2024-04-25T22:41:35.385479+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:21.815110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":81,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.421468+0000","last_change":"2024-04-25T22:41:35.391397+0000","last_active":"2024-04-25T22:41:39.421468+0000","last_peered":"2024-04-25T22:41:39.421468+0000","last_clean":"2024-04-25T22:41:34.255182+0000","last_became_active":"2024-04-25T22:41:35.391397+0000","last_became_peered":"2024-04-25T22:41:35.391397+0000","last_unstale":"2024-04-25T22:41:39.421468+0000","last_undegraded":"2024-04-25T22:41:39.421468+0000","last_fullsized":"2024-04-25T22:41:35.380254+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:47:02.732766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.419070+0000","last_change":"2024-04-25T22:40:52.544244+0000","last_active":"2024-04-25T22:41:39.419070+0000","last_peered":"2024-04-25T22:41:39.419070+0000","last_clean":"2024-04-25T22:41:39.419070+0000","last_became_active":"2024-04-25T22:40:52.543438+0000","last_became_peered":"2024-04-25T22:40:52.543438+0000","last_unstale":"2024-04-25T22:41:39.419070+0000","last_undegraded":"2024-04-25T22:41:39.419070+0000","last_fullsized":"2024-04-25T22:41:39.419070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:34:17.842964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":37,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.415370+0000","last_change":"2024-04-25T22:41:35.381177+0000","last_active":"2024-04-25T22:41:39.415370+0000","last_peered":"2024-04-25T22:41:39.415370+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:41:35.381177+0000","last_became_peered":"2024-04-25T22:41:35.381177+0000","last_unstale":"2024-04-25T22:41:39.415370+0000","last_undegraded":"2024-04-25T22:41:39.415370+0000","last_fullsized":"2024-04-25T22:41:35.375464+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:18.444737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":82,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.414962+0000","last_change":"2024-04-25T22:41:35.378753+0000","last_active":"2024-04-25T22:41:39.414962+0000","last_peered":"2024-04-25T22:41:39.414962+0000","last_clean":"2024-04-25T22:41:33.340509+0000","last_became_active":"2024-04-25T22:41:35.378753+0000","last_became_peered":"2024-04-25T22:41:35.378753+0000","last_unstale":"2024-04-25T22:41:39.414962+0000","last_undegraded":"2024-04-25T22:41:39.414962+0000","last_fullsized":"2024-04-25T22:41:35.373216+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:36:36.689751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.417204+0000","last_change":"2024-04-25T22:41:35.384482+0000","last_active":"2024-04-25T22:41:39.417204+0000","last_peered":"2024-04-25T22:41:39.417204+0000","last_clean":"2024-04-25T22:41:34.254329+0000","last_became_active":"2024-04-25T22:41:35.384482+0000","last_became_peered":"2024-04-25T22:41:35.384482+0000","last_unstale":"2024-04-25T22:41:39.417204+0000","last_undegraded":"2024-04-25T22:41:39.417204+0000","last_fullsized":"2024-04-25T22:41:35.378661+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:58.607791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":74,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.416781+0000","last_change":"2024-04-25T22:41:35.382731+0000","last_active":"2024-04-25T22:41:39.416781+0000","last_peered":"2024-04-25T22:41:39.416781+0000","last_clean":"2024-04-25T22:41:33.341668+0000","last_became_active":"2024-04-25T22:41:35.382731+0000","last_became_peered":"2024-04-25T22:41:35.382731+0000","last_unstale":"2024-04-25T22:41:39.416781+0000","last_undegraded":"2024-04-25T22:41:39.416781+0000","last_fullsized":"2024-04-25T22:41:35.375743+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:43:59.949712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":79,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.420140+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:41:39.420140+0000","last_peered":"2024-04-25T22:41:39.420140+0000","last_clean":"2024-04-25T22:41:39.420140+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:41:39.420140+0000","last_undegraded":"2024-04-25T22:41:39.420140+0000","last_fullsized":"2024-04-25T22:41:39.420140+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":73,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.420886+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:41:39.420886+0000","last_peered":"2024-04-25T22:41:39.420886+0000","last_clean":"2024-04-25T22:41:39.420886+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:41:39.420886+0000","last_undegraded":"2024-04-25T22:41:39.420886+0000","last_fullsized":"2024-04-25T22:41:39.420886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":74,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.415229+0000","last_change":"2024-04-25T22:41:35.382658+0000","last_active":"2024-04-25T22:41:39.415229+0000","last_peered":"2024-04-25T22:41:39.415229+0000","last_clean":"2024-04-25T22:41:33.341478+0000","last_became_active":"2024-04-25T22:41:35.382658+0000","last_became_peered":"2024-04-25T22:41:35.382658+0000","last_unstale":"2024-04-25T22:41:39.415229+0000","last_undegraded":"2024-04-25T22:41:39.415229+0000","last_fullsized":"2024-04-25T22:41:35.375175+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:25.403287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":73,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.422612+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:41:39.422612+0000","last_peered":"2024-04-25T22:41:39.422612+0000","last_clean":"2024-04-25T22:41:39.422612+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:41:39.422612+0000","last_undegraded":"2024-04-25T22:41:39.422612+0000","last_fullsized":"2024-04-25T22:41:39.422612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":82,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.415928+0000","last_change":"2024-04-25T22:41:35.382338+0000","last_active":"2024-04-25T22:41:39.415928+0000","last_peered":"2024-04-25T22:41:39.415928+0000","last_clean":"2024-04-25T22:41:33.341776+0000","last_became_active":"2024-04-25T22:41:35.382338+0000","last_became_peered":"2024-04-25T22:41:35.382338+0000","last_unstale":"2024-04-25T22:41:39.415928+0000","last_undegraded":"2024-04-25T22:41:39.415928+0000","last_fullsized":"2024-04-25T22:41:35.376424+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:26.070760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.417511+0000","last_change":"2024-04-25T22:41:35.388436+0000","last_active":"2024-04-25T22:41:39.417511+0000","last_peered":"2024-04-25T22:41:39.417511+0000","last_clean":"2024-04-25T22:41:34.254671+0000","last_became_active":"2024-04-25T22:41:35.388436+0000","last_became_peered":"2024-04-25T22:41:35.388436+0000","last_unstale":"2024-04-25T22:41:39.417511+0000","last_undegraded":"2024-04-25T22:41:39.417511+0000","last_fullsized":"2024-04-25T22:41:35.379058+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:43:59.949712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":76,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.415691+0000","last_change":"2024-04-25T22:41:35.380999+0000","last_active":"2024-04-25T22:41:39.415691+0000","last_peered":"2024-04-25T22:41:39.415691+0000","last_clean":"2024-04-25T22:41:33.341489+0000","last_became_active":"2024-04-25T22:41:35.380999+0000","last_became_peered":"2024-04-25T22:41:35.380999+0000","last_unstale":"2024-04-25T22:41:39.415691+0000","last_undegraded":"2024-04-25T22:41:39.415691+0000","last_fullsized":"2024-04-25T22:41:35.375691+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:55.943090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.415725+0000","last_change":"2024-04-25T22:41:35.381219+0000","last_active":"2024-04-25T22:41:39.415725+0000","last_peered":"2024-04-25T22:41:39.415725+0000","last_clean":"2024-04-25T22:40:08.425969+0000","last_became_active":"2024-04-25T22:41:35.381219+0000","last_became_peered":"2024-04-25T22:41:35.381219+0000","last_unstale":"2024-04-25T22:41:39.415725+0000","last_undegraded":"2024-04-25T22:41:39.415725+0000","last_fullsized":"2024-04-25T22:41:35.375381+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:49.954631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.417674+0000","last_change":"2024-04-25T22:41:35.387822+0000","last_active":"2024-04-25T22:41:39.417674+0000","last_peered":"2024-04-25T22:41:39.417674+0000","last_clean":"2024-04-25T22:41:34.255399+0000","last_became_active":"2024-04-25T22:41:35.387822+0000","last_became_peered":"2024-04-25T22:41:35.387822+0000","last_unstale":"2024-04-25T22:41:39.417674+0000","last_undegraded":"2024-04-25T22:41:39.417674+0000","last_fullsized":"2024-04-25T22:41:35.379351+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:22:35.224099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":78,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-04-25T22:41:39.417150+0000","last_change":"2024-04-25T22:41:35.384055+0000","last_active":"2024-04-25T22:41:39.417150+0000","last_peered":"2024-04-25T22:41:39.417150+0000","last_clean":"2024-04-25T22:41:33.342061+0000","last_became_active":"2024-04-25T22:41:35.384055+0000","last_became_peered":"2024-04-25T22:41:35.384055+0000","last_unstale":"2024-04-25T22:41:39.417150+0000","last_undegraded":"2024-04-25T22:41:35.376874+0000","last_fullsized":"2024-04-25T22:41:35.376768+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:44.727058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":82,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.416787+0000","last_change":"2024-04-25T22:41:35.383803+0000","last_active":"2024-04-25T22:41:39.416787+0000","last_peered":"2024-04-25T22:41:39.416787+0000","last_clean":"2024-04-25T22:41:33.342202+0000","last_became_active":"2024-04-25T22:41:35.383803+0000","last_became_peered":"2024-04-25T22:41:35.383803+0000","last_unstale":"2024-04-25T22:41:39.416787+0000","last_undegraded":"2024-04-25T22:41:39.416787+0000","last_fullsized":"2024-04-25T22:41:35.377202+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:22:30.108691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.419034+0000","last_change":"2024-04-25T22:40:52.547806+0000","last_active":"2024-04-25T22:41:39.419034+0000","last_peered":"2024-04-25T22:41:39.419034+0000","last_clean":"2024-04-25T22:41:39.419034+0000","last_became_active":"2024-04-25T22:40:52.544889+0000","last_became_peered":"2024-04-25T22:40:52.544889+0000","last_unstale":"2024-04-25T22:41:39.419034+0000","last_undegraded":"2024-04-25T22:41:39.419034+0000","last_fullsized":"2024-04-25T22:41:39.419034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:44.880698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"25'3","reported_seq":74,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.421590+0000","last_change":"2024-04-25T22:40:52.547041+0000","last_active":"2024-04-25T22:41:39.421590+0000","last_peered":"2024-04-25T22:41:39.421590+0000","last_clean":"2024-04-25T22:41:39.421590+0000","last_became_active":"2024-04-25T22:40:52.545085+0000","last_became_peered":"2024-04-25T22:40:52.545085+0000","last_unstale":"2024-04-25T22:41:39.421590+0000","last_undegraded":"2024-04-25T22:41:39.421590+0000","last_fullsized":"2024-04-25T22:41:39.421590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:46.066674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":81,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.421211+0000","last_change":"2024-04-25T22:41:35.396203+0000","last_active":"2024-04-25T22:41:39.421211+0000","last_peered":"2024-04-25T22:41:39.421211+0000","last_clean":"2024-04-25T22:41:34.257152+0000","last_became_active":"2024-04-25T22:41:35.396203+0000","last_became_peered":"2024-04-25T22:41:35.396203+0000","last_unstale":"2024-04-25T22:41:39.421211+0000","last_undegraded":"2024-04-25T22:41:39.421211+0000","last_fullsized":"2024-04-25T22:41:35.385135+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:20:50.159164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.417385+0000","last_change":"2024-04-25T22:41:35.384292+0000","last_active":"2024-04-25T22:41:39.417385+0000","last_peered":"2024-04-25T22:41:39.417385+0000","last_clean":"2024-04-25T22:41:34.254462+0000","last_became_active":"2024-04-25T22:41:35.384292+0000","last_became_peered":"2024-04-25T22:41:35.384292+0000","last_unstale":"2024-04-25T22:41:39.417385+0000","last_undegraded":"2024-04-25T22:41:39.417385+0000","last_fullsized":"2024-04-25T22:41:35.378939+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:22:05.510857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":73,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.418996+0000","last_change":"2024-04-25T22:41:35.391757+0000","last_active":"2024-04-25T22:41:39.418996+0000","last_peered":"2024-04-25T22:41:39.418996+0000","last_clean":"2024-04-25T22:41:34.255710+0000","last_became_active":"2024-04-25T22:41:35.391757+0000","last_became_peered":"2024-04-25T22:41:35.391757+0000","last_unstale":"2024-04-25T22:41:39.418996+0000","last_undegraded":"2024-04-25T22:41:39.418996+0000","last_fullsized":"2024-04-25T22:41:35.382585+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:00:20.147961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"26'10","reported_seq":85,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-04-25T22:41:39.419541+0000","last_change":"2024-04-25T22:41:35.391810+0000","last_active":"2024-04-25T22:41:39.419541+0000","last_peered":"2024-04-25T22:41:39.419541+0000","last_clean":"2024-04-25T22:41:34.253852+0000","last_became_active":"2024-04-25T22:41:35.391810+0000","last_became_peered":"2024-04-25T22:41:35.391810+0000","last_unstale":"2024-04-25T22:41:39.419541+0000","last_undegraded":"2024-04-25T22:41:35.382935+0000","last_fullsized":"2024-04-25T22:41:35.382702+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:20.609468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":74,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.414300+0000","last_change":"2024-04-25T22:41:35.375278+0000","last_active":"2024-04-25T22:41:39.414300+0000","last_peered":"2024-04-25T22:41:39.414300+0000","last_clean":"2024-04-25T22:41:33.340293+0000","last_became_active":"2024-04-25T22:41:35.375278+0000","last_became_peered":"2024-04-25T22:41:35.375278+0000","last_unstale":"2024-04-25T22:41:39.414300+0000","last_undegraded":"2024-04-25T22:41:39.414300+0000","last_fullsized":"2024-04-25T22:41:35.372529+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:55:53.301400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":78,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-04-25T22:41:39.421236+0000","last_change":"2024-04-25T22:41:35.396154+0000","last_active":"2024-04-25T22:41:39.421236+0000","last_peered":"2024-04-25T22:41:39.421236+0000","last_clean":"2024-04-25T22:41:34.256334+0000","last_became_active":"2024-04-25T22:41:35.396154+0000","last_became_peered":"2024-04-25T22:41:35.396154+0000","last_unstale":"2024-04-25T22:41:39.421236+0000","last_undegraded":"2024-04-25T22:41:35.384950+0000","last_fullsized":"2024-04-25T22:41:35.384699+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:23:59.083298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":73,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.421947+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:41:39.421947+0000","last_peered":"2024-04-25T22:41:39.421947+0000","last_clean":"2024-04-25T22:41:39.421947+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:41:39.421947+0000","last_undegraded":"2024-04-25T22:41:39.421947+0000","last_fullsized":"2024-04-25T22:41:39.421947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.417377+0000","last_change":"2024-04-25T22:40:52.550242+0000","last_active":"2024-04-25T22:41:39.417377+0000","last_peered":"2024-04-25T22:41:39.417377+0000","last_clean":"2024-04-25T22:41:39.417377+0000","last_became_active":"2024-04-25T22:40:52.549378+0000","last_became_peered":"2024-04-25T22:40:52.549378+0000","last_unstale":"2024-04-25T22:41:39.417377+0000","last_undegraded":"2024-04-25T22:41:39.417377+0000","last_fullsized":"2024-04-25T22:41:39.417377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:28:55.307548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.420414+0000","last_change":"2024-04-25T22:40:52.546932+0000","last_active":"2024-04-25T22:41:39.420414+0000","last_peered":"2024-04-25T22:41:39.420414+0000","last_clean":"2024-04-25T22:41:39.420414+0000","last_became_active":"2024-04-25T22:40:52.545043+0000","last_became_peered":"2024-04-25T22:40:52.545043+0000","last_unstale":"2024-04-25T22:41:39.420414+0000","last_undegraded":"2024-04-25T22:41:39.420414+0000","last_fullsized":"2024-04-25T22:41:39.420414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:51:11.071236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":74,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.413970+0000","last_change":"2024-04-25T22:41:35.376344+0000","last_active":"2024-04-25T22:41:39.413970+0000","last_peered":"2024-04-25T22:41:39.413970+0000","last_clean":"2024-04-25T22:41:33.339970+0000","last_became_active":"2024-04-25T22:41:35.376344+0000","last_became_peered":"2024-04-25T22:41:35.376344+0000","last_unstale":"2024-04-25T22:41:39.413970+0000","last_undegraded":"2024-04-25T22:41:39.413970+0000","last_fullsized":"2024-04-25T22:41:35.372682+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:47.095659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.419060+0000","last_change":"2024-04-25T22:41:35.390886+0000","last_active":"2024-04-25T22:41:39.419060+0000","last_peered":"2024-04-25T22:41:39.419060+0000","last_clean":"2024-04-25T22:41:34.256787+0000","last_became_active":"2024-04-25T22:41:35.390886+0000","last_became_peered":"2024-04-25T22:41:35.390886+0000","last_unstale":"2024-04-25T22:41:39.419060+0000","last_undegraded":"2024-04-25T22:41:39.419060+0000","last_fullsized":"2024-04-25T22:41:35.381663+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:02:30.896908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":76,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.414271+0000","last_change":"2024-04-25T22:41:35.378000+0000","last_active":"2024-04-25T22:41:39.414271+0000","last_peered":"2024-04-25T22:41:39.414271+0000","last_clean":"2024-04-25T22:41:33.340122+0000","last_became_active":"2024-04-25T22:41:35.378000+0000","last_became_peered":"2024-04-25T22:41:35.378000+0000","last_unstale":"2024-04-25T22:41:39.414271+0000","last_undegraded":"2024-04-25T22:41:39.414271+0000","last_fullsized":"2024-04-25T22:41:35.372987+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:08:34.990175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.418453+0000","last_change":"2024-04-25T22:40:52.550229+0000","last_active":"2024-04-25T22:41:39.418453+0000","last_peered":"2024-04-25T22:41:39.418453+0000","last_clean":"2024-04-25T22:41:39.418453+0000","last_became_active":"2024-04-25T22:40:52.549446+0000","last_became_peered":"2024-04-25T22:40:52.549446+0000","last_unstale":"2024-04-25T22:41:39.418453+0000","last_undegraded":"2024-04-25T22:41:39.418453+0000","last_fullsized":"2024-04-25T22:41:39.418453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:08:36.019160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.419239+0000","last_change":"2024-04-25T22:40:52.549403+0000","last_active":"2024-04-25T22:41:39.419239+0000","last_peered":"2024-04-25T22:41:39.419239+0000","last_clean":"2024-04-25T22:41:39.419239+0000","last_became_active":"2024-04-25T22:40:52.547483+0000","last_became_peered":"2024-04-25T22:40:52.547483+0000","last_unstale":"2024-04-25T22:41:39.419239+0000","last_undegraded":"2024-04-25T22:41:39.419239+0000","last_fullsized":"2024-04-25T22:41:39.419239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:02:42.003697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.418453+0000","last_change":"2024-04-25T22:41:35.393657+0000","last_active":"2024-04-25T22:41:39.418453+0000","last_peered":"2024-04-25T22:41:39.418453+0000","last_clean":"2024-04-25T22:41:34.256072+0000","last_became_active":"2024-04-25T22:41:35.393657+0000","last_became_peered":"2024-04-25T22:41:35.393657+0000","last_unstale":"2024-04-25T22:41:39.418453+0000","last_undegraded":"2024-04-25T22:41:39.418453+0000","last_fullsized":"2024-04-25T22:41:35.380318+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:43:38.384433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":37,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.413973+0000","last_change":"2024-04-25T22:41:35.374703+0000","last_active":"2024-04-25T22:41:39.413973+0000","last_peered":"2024-04-25T22:41:39.413973+0000","last_clean":"2024-04-25T22:40:50.512032+0000","last_became_active":"2024-04-25T22:41:35.374703+0000","last_became_peered":"2024-04-25T22:41:35.374703+0000","last_unstale":"2024-04-25T22:41:39.413973+0000","last_undegraded":"2024-04-25T22:41:39.413973+0000","last_fullsized":"2024-04-25T22:41:35.372279+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:43.851713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":37,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.414590+0000","last_change":"2024-04-25T22:41:35.380325+0000","last_active":"2024-04-25T22:41:39.414590+0000","last_peered":"2024-04-25T22:41:39.414590+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:41:35.380325+0000","last_became_peered":"2024-04-25T22:41:35.380325+0000","last_unstale":"2024-04-25T22:41:39.414590+0000","last_undegraded":"2024-04-25T22:41:39.414590+0000","last_fullsized":"2024-04-25T22:41:35.374343+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:12:33.994677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":68,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.417764+0000","last_change":"2024-04-25T22:41:35.393032+0000","last_active":"2024-04-25T22:41:39.417764+0000","last_peered":"2024-04-25T22:41:39.417764+0000","last_clean":"2024-04-25T22:41:34.254985+0000","last_became_active":"2024-04-25T22:41:35.393032+0000","last_became_peered":"2024-04-25T22:41:35.393032+0000","last_unstale":"2024-04-25T22:41:39.417764+0000","last_undegraded":"2024-04-25T22:41:39.417764+0000","last_fullsized":"2024-04-25T22:41:35.380017+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:20:13.661542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":71,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.418249+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:41:39.418249+0000","last_peered":"2024-04-25T22:41:39.418249+0000","last_clean":"2024-04-25T22:41:39.418249+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:41:39.418249+0000","last_undegraded":"2024-04-25T22:41:39.418249+0000","last_fullsized":"2024-04-25T22:41:39.418249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.419242+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:41:39.419242+0000","last_peered":"2024-04-25T22:41:39.419242+0000","last_clean":"2024-04-25T22:41:39.419242+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:41:39.419242+0000","last_undegraded":"2024-04-25T22:41:39.419242+0000","last_fullsized":"2024-04-25T22:41:39.419242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":71,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.419725+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:41:39.419725+0000","last_peered":"2024-04-25T22:41:39.419725+0000","last_clean":"2024-04-25T22:41:39.419725+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:41:39.419725+0000","last_undegraded":"2024-04-25T22:41:39.419725+0000","last_fullsized":"2024-04-25T22:41:39.419725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":78,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-04-25T22:41:39.419231+0000","last_change":"2024-04-25T22:41:35.390641+0000","last_active":"2024-04-25T22:41:39.419231+0000","last_peered":"2024-04-25T22:41:39.419231+0000","last_clean":"2024-04-25T22:41:34.255563+0000","last_became_active":"2024-04-25T22:41:35.390641+0000","last_became_peered":"2024-04-25T22:41:35.390641+0000","last_unstale":"2024-04-25T22:41:39.419231+0000","last_undegraded":"2024-04-25T22:41:35.381369+0000","last_fullsized":"2024-04-25T22:41:35.381157+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:30:52.345706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":37,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.414378+0000","last_change":"2024-04-25T22:41:35.377748+0000","last_active":"2024-04-25T22:41:39.414378+0000","last_peered":"2024-04-25T22:41:39.414378+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:41:35.377748+0000","last_became_peered":"2024-04-25T22:41:35.377748+0000","last_unstale":"2024-04-25T22:41:39.414378+0000","last_undegraded":"2024-04-25T22:41:39.414378+0000","last_fullsized":"2024-04-25T22:41:35.372778+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:14:19.691007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":77,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-04-25T22:41:39.416480+0000","last_change":"2024-04-25T22:41:35.382622+0000","last_active":"2024-04-25T22:41:39.416480+0000","last_peered":"2024-04-25T22:41:39.416480+0000","last_clean":"2024-04-25T22:41:33.342124+0000","last_became_active":"2024-04-25T22:41:35.382622+0000","last_became_peered":"2024-04-25T22:41:35.382622+0000","last_unstale":"2024-04-25T22:41:39.416480+0000","last_undegraded":"2024-04-25T22:41:39.416480+0000","last_fullsized":"2024-04-25T22:41:35.376460+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:38:55.031312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":71,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.421225+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:41:39.421225+0000","last_peered":"2024-04-25T22:41:39.421225+0000","last_clean":"2024-04-25T22:41:39.421225+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:41:39.421225+0000","last_undegraded":"2024-04-25T22:41:39.421225+0000","last_fullsized":"2024-04-25T22:41:39.421225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":57,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T22:41:39.420490+0000","last_change":"2024-04-25T22:40:52.550558+0000","last_active":"2024-04-25T22:41:39.420490+0000","last_peered":"2024-04-25T22:41:39.420490+0000","last_clean":"2024-04-25T22:41:39.420490+0000","last_became_active":"2024-04-25T22:40:52.549850+0000","last_became_peered":"2024-04-25T22:40:52.549850+0000","last_unstale":"2024-04-25T22:41:39.420490+0000","last_undegraded":"2024-04-25T22:41:39.420490+0000","last_fullsized":"2024-04-25T22:41:39.420490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:14:18.662022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":86,"acting":86,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":15,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":46,"acting":46,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":1,"acting":1,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738393,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":186639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738390,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":991232,"data_stored":760525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738393,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1040384,"data_stored":783742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:41:48.580 INFO:tasks.thrashosds.thrasher:Setting 4.16 to [1, 2] 2024-04-25T22:41:48.581 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.16', '1', '2'] 2024-04-25T22:41:48.581 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.16 1 2 2024-04-25T22:41:48.614 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:48.613+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:48.667 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is set 2024-04-25T22:41:48.715 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:48.713+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:48.730 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:48.730 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:48.744 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:48.816 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:48.812+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:48.861 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:48.861 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:48.876 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:48.886 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:41:48.923 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:48.920+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:49.009 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:49.009 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:49.018 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:49.016+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:49.026 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:49.084 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:49.085 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:49.085 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:41:49.118 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:49.116+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:49.119 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:49.119 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:49.123 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:41:49.123 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:41:49.149 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:49.149 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:49.163 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:49.220 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:49.220+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:49.280 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:41:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:41:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:41:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.684660672000007, 2024-04-25T22:41:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:41:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:49.281 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.282 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:49.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:49.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:49.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:49.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:49.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:41:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:41:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:41:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:41:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:41:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:41:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:41:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:41:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:41:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:41:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:41:49.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:41:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:41:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:41:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:41:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:41:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:49.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:41:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:41:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:41:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:41:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:41:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:41:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:49.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:41:49.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:41:49.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:49.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:41:49.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:41:49.287 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.287 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.287 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.287 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.287 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:49.287 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.684572658999997, 2024-04-25T22:41:49.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:41:49.288 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:49.288 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:49.288 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.288 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:49.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:49.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:49.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:49.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:49.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:49.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:41:49.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:41:49.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:49.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:49.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:41:49.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:49.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:41:49.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:41:49.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:41:49.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:41:49.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:41:49.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:41:49.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:49.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:49.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:41:49.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:41:49.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:41:49.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:49.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:41:49.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:41:49.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:49.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:41:49.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:41:49.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:49.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:41:49.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:41:49.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:41:49.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:41:49.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:49.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:41:49.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:41:49.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:49.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:41:49.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:41:49.292 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.293 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.293 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.293 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.293 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:49.293 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.684500537000005, 2024-04-25T22:41:49.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:41:49.293 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:49.293 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:49.293 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.293 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:49.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:49.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:49.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:49.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:49.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:49.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:41:49.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:41:49.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:49.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:41:49.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:41:49.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:49.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:41:49.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:41:49.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:41:49.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:41:49.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:41:49.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:41:49.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:49.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:41:49.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:41:49.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:41:49.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:41:49.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:49.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:41:49.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:41:49.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:49.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:41:49.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:41:49.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:41:49.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:41:49.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:49.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:41:49.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:41:49.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:49.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:41:49.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:41:49.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:49.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:41:49.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:41:49.298 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.298 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.298 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.298 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.298 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:49.299 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.684392224000007, 2024-04-25T22:41:49.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:41:49.299 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:49.299 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:49.299 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.299 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:49.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:49.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:49.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:49.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:49.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:49.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:41:49.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:41:49.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:49.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:41:49.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:41:49.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:49.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:41:49.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:41:49.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:41:49.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:41:49.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:41:49.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:41:49.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:49.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:41:49.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:41:49.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:41:49.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:41:49.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:49.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:41:49.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:41:49.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:49.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:41:49.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:41:49.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:41:49.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:41:49.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:49.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:41:49.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:41:49.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:49.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:41:49.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:41:49.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:49.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:41:49.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:41:49.304 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.304 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.304 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.304 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.304 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:49.304 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.684325568000006, 2024-04-25T22:41:49.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:41:49.304 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:49.305 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:49.305 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.305 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:49.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:49.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:49.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:49.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:49.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:49.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:41:49.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:41:49.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:49.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:41:49.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:41:49.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:49.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:41:49.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:41:49.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:41:49.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:41:49.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:41:49.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:41:49.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:49.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:41:49.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:41:49.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:41:49.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:41:49.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:49.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:41:49.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:41:49.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:49.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:41:49.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:41:49.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:41:49.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:41:49.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:49.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:41:49.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:41:49.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:49.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:41:49.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:41:49.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:49.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:41:49.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:41:49.309 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.310 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.310 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.310 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.310 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:49.310 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.684234971999999, 2024-04-25T22:41:49.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:41:49.310 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:49.310 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:49.310 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.310 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:49.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:49.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:49.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:49.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:49.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:49.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:41:49.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:41:49.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:49.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:41:49.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:41:49.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:49.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:41:49.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:41:49.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:41:49.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:41:49.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:41:49.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:41:49.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:49.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:41:49.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:41:49.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:41:49.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:41:49.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:49.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:41:49.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:41:49.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:49.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:41:49.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:41:49.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:49.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:41:49.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:41:49.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:41:49.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:41:49.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:49.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:41:49.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:41:49.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:49.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:41:49.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:41:49.316 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.316 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.316 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.316 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.316 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:49.316 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.684170398999996, 2024-04-25T22:41:49.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:41:49.316 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:49.316 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:49.317 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.317 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:49.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:49.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:49.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:49.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:49.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:49.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:41:49.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:41:49.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:49.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:41:49.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:41:49.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:49.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:41:49.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:41:49.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:41:49.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:41:49.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:49.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:41:49.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:49.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:41:49.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:41:49.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:41:49.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:41:49.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:49.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:41:49.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:41:49.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:49.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:41:49.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:41:49.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:41:49.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:41:49.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:49.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:41:49.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:41:49.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:49.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:41:49.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:41:49.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:49.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:41:49.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:41:49.322 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.322 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.322 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.322 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.322 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:49.322 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.684104976, 2024-04-25T22:41:49.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:41:49.322 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:49.322 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:49.322 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.322 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:49.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:49.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:49.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:49.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:49.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:49.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:41:49.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:49.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:49.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:41:49.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:41:49.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:49.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:41:49.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:41:49.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:41:49.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:41:49.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:41:49.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:41:49.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:49.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:41:49.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:41:49.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:41:49.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:41:49.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:49.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:41:49.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:41:49.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:49.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:41:49.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:41:49.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:41:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:41:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:41:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:41:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:41:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:41:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:41:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:41:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.684048910000001, 2024-04-25T22:41:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:41:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:41:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:41:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:41:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:41:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:41:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:41:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:41:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:41:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:41:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:41:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:41:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:41:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:41:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:41:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:41:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:41:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:41:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:41:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:41:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:41:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:41:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:41:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:41:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:41:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:41:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.683981803999998, 2024-04-25T22:41:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:41:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:49.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:49.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:49.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:49.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:49.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:49.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:41:49.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:41:49.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:49.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:41:49.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:41:49.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:49.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:41:49.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:41:49.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:41:49.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:41:49.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:41:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:41:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:41:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:41:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:41:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:41:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:49.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:41:49.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:41:49.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:49.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:41:49.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:41:49.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:41:49.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:41:49.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:49.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:41:49.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:41:49.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:49.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:41:49.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:41:49.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:49.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:41:49.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:41:49.339 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.339 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.339 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.683926681000003, 2024-04-25T22:41:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:41:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:41:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:41:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:41:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:41:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:41:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:41:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:41:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:41:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:41:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:41:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:41:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:41:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:41:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:41:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:41:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:41:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:41:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:41:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:41:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:41:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:41:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:41:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:41:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:41:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:41:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.683824442000002, 2024-04-25T22:41:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:41:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:41:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:41:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:41:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:41:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:41:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:41:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:41:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:41:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:41:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:41:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:41:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:41:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:41:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:41:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:41:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:41:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:41:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:41:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:41:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:41:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:41:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:41:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:41:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:41:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:41:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:41:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.683765618999999, 2024-04-25T22:41:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:41:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:41:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:41:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:41:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:41:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:41:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:41:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:41:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:41:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:41:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:41:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:41:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:41:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:41:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:41:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:41:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:41:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:41:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:41:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:41:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:41:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:41:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:41:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:41:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:41:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:41:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:41:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.683686886000004, 2024-04-25T22:41:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:41:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:49.359 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.359 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:49.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:49.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:49.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:49.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:49.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:49.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:41:49.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:49.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:49.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:41:49.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:41:49.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:49.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:41:49.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:41:49.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:41:49.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:41:49.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:41:49.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:41:49.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:49.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:41:49.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:41:49.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:41:49.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:41:49.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:49.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:41:49.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:41:49.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:49.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:41:49.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:41:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:41:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:41:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:41:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:41:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:41:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:41:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:41:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:41:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.683647472999994, 2024-04-25T22:41:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:41:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:41:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:41:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:41:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:41:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:41:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:41:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:41:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:41:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:41:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:41:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:41:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:41:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:41:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:41:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:41:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:41:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:41:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:41:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:41:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:41:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:41:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:41:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:41:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:41:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:41:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:41:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.683577627000005, 2024-04-25T22:41:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:41:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:41:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:41:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:41:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:41:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:41:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:41:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:41:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:41:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:41:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:41:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:41:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:41:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:41:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:41:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:41:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:41:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:41:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:41:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:41:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:41:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:41:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:41:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:41:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:41:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:41:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:41:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.683527889999993, 2024-04-25T22:41:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:41:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:41:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:41:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:41:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:41:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:41:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:41:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:41:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:41:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:41:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:41:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:41:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:41:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:41:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:41:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:41:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:41:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:41:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:41:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:41:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:41:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:41:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:41:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:41:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:41:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.683443275000002, 2024-04-25T22:41:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:41:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:41:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:41:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:41:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:41:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:41:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:41:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:41:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:41:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:41:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:41:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:41:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:41:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:41:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:41:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:41:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:41:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:41:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:41:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:41:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:41:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:41:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:41:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:41:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:41:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:41:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.683379625000001, 2024-04-25T22:41:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:41:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:41:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:41:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:41:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:41:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:41:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:41:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:41:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:41:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:41:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:41:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:41:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:41:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:41:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:41:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:41:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:41:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:41:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:41:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:41:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 94.676376094999995, 2024-04-25T22:41:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:41:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:41:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:41:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:41:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:41:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:41:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:41:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:41:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:41:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:41:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:41:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:41:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:41:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:41:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:41:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:41:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:41:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.398 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:49.398 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:49.398 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:49.399 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:49.400 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:49.400+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:49.500 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:49.497+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:49.531 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:49.531 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:49.531 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:49.531 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:49.545 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:49.600 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:49.596+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:49.667 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:49.668 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:49.668 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:49.668 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:49.668 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:49.683 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:49.701 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:49.701+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:49.724 INFO:teuthology.orchestra.run.smithi057.stderr:set 4.16 pg_upmap mapping to [1,2] 2024-04-25T22:41:49.802 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:49.796+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:49.858 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:49.858 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:49.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:49.858 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:49.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.858 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.858 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:49.858 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 95.259657541999999, 2024-04-25T22:41:49.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:49.858 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:49.858 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:49.858 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.859 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:49.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:49.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:49.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:49.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:49.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:49.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:49.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:49.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:49.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:49.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:49.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:49.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:49.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:49.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:49.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:49.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:49.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:49.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:49.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:49.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:49.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:49.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:49.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:49.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:49.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:49.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:49.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:49.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:49.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:49.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:49.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:49.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:49.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:49.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:49.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:49.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:49.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:49.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:49.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:49.864 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.864 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.864 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.864 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.864 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:49.864 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 95.259520285999997, 2024-04-25T22:41:49.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:49.864 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:49.864 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:49.865 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.865 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:49.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:49.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:49.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:49.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:49.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:49.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:49.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:49.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:49.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:49.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:49.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:49.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:49.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:49.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:49.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:49.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:49.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:49.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:49.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:49.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:49.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:49.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:49.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:49.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:49.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:49.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:49.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:49.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:49.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:49.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:49.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:49.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:49.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:49.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:49.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:49.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:49.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:49.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:49.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:49.870 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.870 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.870 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.870 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.870 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:49.870 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 95.259432734000001, 2024-04-25T22:41:49.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:49.870 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:49.870 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:49.870 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.870 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:49.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:49.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:49.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:49.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:49.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:49.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:49.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:49.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:49.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:49.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:49.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:49.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:49.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:49.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:49.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:49.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:49.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:49.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:49.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:49.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:49.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:49.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:49.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:49.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:49.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:49.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:49.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:49.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:49.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:49.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:49.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:49.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:49.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:49.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:49.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:49.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:49.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:49.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:49.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:49.876 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.876 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.876 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.876 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.876 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:49.876 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 95.259328908000001, 2024-04-25T22:41:49.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:49.876 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:49.876 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:49.876 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.876 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:49.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:49.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:49.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:49.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:49.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:49.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:49.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:49.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:49.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:49.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:49.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:49.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:49.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:49.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:49.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:49.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:49.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:49.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:49.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:49.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:49.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:49.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:49.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:49.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:49.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:49.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:49.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:49.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:49.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:49.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:49.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:49.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:49.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:49.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:49.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:49.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:49.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:49.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:49.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:49.882 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.882 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.882 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.882 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.882 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:49.882 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 95.259260118, 2024-04-25T22:41:49.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:49.882 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:49.882 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:49.882 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.882 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:49.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:49.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:49.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:49.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:49.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:49.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:49.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:49.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:49.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:49.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:49.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:49.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:49.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:49.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:49.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:49.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:49.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:49.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:49.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:49.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:49.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:49.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:49.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:49.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:49.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:49.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:49.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:49.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:49.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:49.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:49.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:49.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:49.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:49.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:49.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:49.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:49.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:49.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:49.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:49.888 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.888 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.888 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.888 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.888 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:49.888 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 95.259191032000004, 2024-04-25T22:41:49.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:49.888 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:49.888 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:49.888 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.888 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:49.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:49.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:49.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:49.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:49.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:49.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:49.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:49.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:49.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:49.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:49.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:49.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:49.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:49.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:49.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:49.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:49.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:49.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:49.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:49.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:49.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:49.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:49.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:49.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:49.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:49.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:49.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:49.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:49.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:49.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:49.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:49.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:49.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:49.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:49.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:49.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:49.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:49.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:49.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:49.893 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.894 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.894 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.894 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.894 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:49.894 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 95.259094919000006, 2024-04-25T22:41:49.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:49.894 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:49.894 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:49.894 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:49.894 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:49.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:49.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:49.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:49.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:49.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:49.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:49.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:49.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:49.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:49.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:49.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:49.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:49.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:49.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:49.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:49.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:49.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:49.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:49.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:49.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:49.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:49.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:49.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:49.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:49.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:49.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:49.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:49.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:49.898 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.898 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.898 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.898 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.898 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:49.899 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 95.259029256999995, 2024-04-25T22:41:49.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:49.899 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:49.899 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:49.899 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:49.899 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:49.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:49.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:49.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:49.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:49.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:49.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:49.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:49.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:49.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:49.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:49.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:49.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:49.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:49.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:49.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:49.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:49.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:49.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:49.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:49.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:49.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:49.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:49.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:49.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:49.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:49.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:49.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:49.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:49.903 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.903 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.903 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.903 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:49.903 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:49.903 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 95.258960130000006, 2024-04-25T22:41:49.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:49.903 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:49.903 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:49.903 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:49.903 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:49.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:49.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:49.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:49.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:49.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:49.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:49.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:49.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:49.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:49.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:49.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:49.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:49.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:49.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:49.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:49.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:49.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:49.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:49.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:49.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:49.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:49.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:49.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:49.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:49.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:49.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:49.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:49.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:49.907 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.907 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.907 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.907 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:49.907 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:49.907 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 95.248143474000003, 2024-04-25T22:41:49.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:49.908 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:49.908 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:49.908 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:49.908 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:49.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:49.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:49.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:49.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:49.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:49.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:49.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:49.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:49.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:49.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:49.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:49.911 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.911 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.911 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.911 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:49.911 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:49.911 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 95.231245121000001, 2024-04-25T22:41:49.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:49.911 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:49.911 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:49.911 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:49.911 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:49.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:49.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:49.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:49.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:49.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:49.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:49.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:49.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:49.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:49.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:49.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:49.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:49.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:49.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:49.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:49.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:49.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:49.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:49.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:49.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:49.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:49.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:49.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:49.914 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.914 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.915 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.915 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:49.915 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:49.915 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 95.230424231000001, 2024-04-25T22:41:49.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:49.915 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:49.915 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:49.915 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:49.915 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:49.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:49.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:49.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:49.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:49.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:49.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:49.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:49.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:49.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:49.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:49.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:49.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:49.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:49.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:49.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:49.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:49.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:49.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:49.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:49.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:49.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:49.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:49.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:49.918 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.918 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.918 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.919 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:49.919 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:49.919 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 95.228723502999998, 2024-04-25T22:41:49.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:49.919 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:49.919 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:49.919 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.919 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:49.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:49.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:49.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:49.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:49.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:49.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:49.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:49.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:49.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:49.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:49.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:49.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:49.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:49.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:49.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:49.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:49.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:49.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:49.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:49.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:49.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:49.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:49.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:49.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:49.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:49.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:49.922 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.922 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.923 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.923 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:49.923 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:49.923 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 95.228126828000001, 2024-04-25T22:41:49.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:49.923 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:49.923 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:49.923 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.923 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:49.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:49.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:49.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:49.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:49.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:49.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:49.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:49.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:49.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:49.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:49.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:49.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:49.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:49.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:49.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:49.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:49.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:49.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:49.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:49.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:49.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:49.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:49.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:49.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:49.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:49.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:49.927 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.927 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.927 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.927 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:49.927 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:49.927 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 95.218691101999994, 2024-04-25T22:41:49.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:49.927 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:49.927 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:49.927 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:49.928 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:49.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:49.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:49.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:49.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:49.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:49.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:49.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:49.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:49.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:49.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:49.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:49.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:49.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:49.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:49.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:49.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:49.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:49.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:49.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:49.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:49.930 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.930 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.930 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.931 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:49.931 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:49.931 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 95.218043675999994, 2024-04-25T22:41:49.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:49.931 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:49.931 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:49.931 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.931 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:49.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:49.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:49.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:49.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:49.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:49.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:49.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:49.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:49.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:49.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:49.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:49.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:49.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:49.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:49.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:49.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:49.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:49.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:49.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:49.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:49.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:49.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:49.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:49.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:49.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:49.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:49.935 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.935 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.935 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.935 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:49.935 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:49.935 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 95.216602856999998, 2024-04-25T22:41:49.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:49.935 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:49.935 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:49.935 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.935 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:49.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:49.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:49.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:49.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:49.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:49.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:49.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:49.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:49.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:49.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:49.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:49.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:49.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:49.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:49.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:49.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:49.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:49.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:49.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:49.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:49.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:49.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:49.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:49.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:49.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:49.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:49.939 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.939 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.939 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.939 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:49.939 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:49.939 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 93.264164413000003, 2024-04-25T22:41:49.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:49.940 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:49.940 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:49.940 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.940 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:49.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:49.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:49.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:49.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:49.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:49.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:49.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:49.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:49.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:49.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:49.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:49.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:49.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:49.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:49.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:49.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:49.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:49.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:49.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:49.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:49.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:49.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:49.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:49.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:49.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:49.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:49.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:49.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:49.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:49.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:49.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:49.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:49.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:49.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:49.944 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.944 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.944 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.945 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:49.945 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:49.945 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 71.261505088999996, 2024-04-25T22:41:49.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:49.945 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:49.945 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:49.945 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.945 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:49.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:49.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:49.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:49.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:49.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:49.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:49.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:49.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:49.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:49.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:49.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:49.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:49.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:49.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:49.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:49.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:49.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:49.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:49.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:49.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:49.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:49.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:49.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:49.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:49.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:49.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:49.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:49.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:49.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:49.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:49.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:49.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:49.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:49.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:49.949 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.949 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.949 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.950 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:49.950 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:49.950 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 66.261212838000006, 2024-04-25T22:41:49.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:49.950 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:49.950 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:49.950 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:49.950 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:49.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:49.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:49.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:49.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:49.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:49.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:49.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:49.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:49.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:49.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:49.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:49.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:49.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:49.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:49.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:49.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:49.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:49.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:49.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:49.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:49.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:49.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:49.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:49.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:49.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:49.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:49.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:49.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:49.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:49.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:49.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:49.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:49.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:49.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:49.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:49.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:49.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:49.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:49.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:49.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:49.954 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.955 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.955 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.955 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:49.955 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:49.955 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:49.956 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:49.957 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:49.956+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:50.057 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:50.052+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:50.087 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:50.087 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:50.087 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:41:50.087 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:50.102 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:50.158 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:50.152+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:50.223 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:50.223 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:50.223 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:50.223 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:50.223 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:50.237 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:50.281 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:50.281+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:50.360 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:50.360+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:50.364 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:50.364 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:41:50.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:41:50.364 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:41:50.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.364 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.364 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:50.364 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.766135435999999, 2024-04-25T22:41:50.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:41:50.364 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:50.364 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:50.365 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.365 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:50.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:50.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:50.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:50.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:50.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:50.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:41:50.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:41:50.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:50.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:41:50.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:41:50.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:50.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:41:50.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:41:50.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:41:50.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:41:50.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:41:50.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:41:50.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:50.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:41:50.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:41:50.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:41:50.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:41:50.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:50.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:41:50.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:41:50.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:50.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:41:50.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:41:50.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:41:50.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:41:50.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:50.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:41:50.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:41:50.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:50.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:41:50.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:41:50.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:50.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:41:50.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:41:50.370 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.370 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.370 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.370 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.371 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:50.371 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.766047423000003, 2024-04-25T22:41:50.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:41:50.371 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:50.371 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:50.371 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.371 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:50.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:50.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:50.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:50.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:50.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:50.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:41:50.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:41:50.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:50.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:50.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:41:50.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:50.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:41:50.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:41:50.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:41:50.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:41:50.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:41:50.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:41:50.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:50.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:50.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:41:50.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:41:50.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:41:50.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:50.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:41:50.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:41:50.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:50.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:41:50.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:41:50.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:50.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:41:50.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:41:50.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:41:50.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:41:50.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:50.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:41:50.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:41:50.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:50.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:41:50.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:41:50.376 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.376 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.376 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.376 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.376 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:50.377 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.765975300999997, 2024-04-25T22:41:50.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:41:50.377 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:50.377 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:50.377 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.377 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:50.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:50.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:50.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:50.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:50.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:50.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:41:50.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:41:50.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:50.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:41:50.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:41:50.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:50.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:41:50.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:41:50.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:41:50.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:41:50.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:41:50.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:41:50.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:50.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:41:50.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:41:50.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:41:50.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:41:50.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:50.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:41:50.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:41:50.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:50.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:41:50.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:41:50.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:41:50.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:41:50.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:50.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:41:50.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:41:50.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:50.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:41:50.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:41:50.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:50.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:41:50.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:41:50.382 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.382 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.382 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.382 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.382 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:50.382 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.765866987999999, 2024-04-25T22:41:50.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:41:50.383 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:50.383 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:50.383 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.383 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:50.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:50.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:50.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:50.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:50.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:50.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:41:50.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:41:50.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:50.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:41:50.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:41:50.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:50.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:41:50.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:41:50.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:41:50.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:41:50.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:41:50.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:41:50.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:50.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:41:50.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:41:50.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:41:50.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:41:50.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:50.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:41:50.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:41:50.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:50.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:41:50.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:41:50.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:41:50.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:41:50.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:50.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:41:50.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:41:50.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:50.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:41:50.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:41:50.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:50.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:41:50.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:41:50.388 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.388 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.388 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.388 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.388 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:50.388 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.765800331999998, 2024-04-25T22:41:50.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:41:50.389 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:50.389 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:50.389 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.389 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:50.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:50.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:50.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:50.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:50.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:50.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:41:50.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:41:50.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:50.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:41:50.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:41:50.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:50.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:41:50.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:41:50.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:41:50.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:41:50.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:41:50.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:41:50.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:50.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:41:50.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:41:50.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:41:50.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:41:50.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:50.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:41:50.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:41:50.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:50.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:41:50.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:41:50.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:41:50.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:41:50.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:50.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:41:50.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:41:50.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:50.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:41:50.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:41:50.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:50.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:41:50.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:41:50.394 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.394 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.394 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.394 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.394 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:50.395 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.765709736000005, 2024-04-25T22:41:50.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:41:50.395 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:50.395 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:50.395 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.395 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:50.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:50.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:50.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:50.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:50.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:50.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:41:50.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:41:50.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:50.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:41:50.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:41:50.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:50.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:41:50.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:41:50.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:41:50.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:41:50.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:41:50.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:41:50.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:50.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:41:50.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:41:50.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:41:50.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:41:50.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:50.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:41:50.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:41:50.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:50.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:41:50.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:41:50.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:50.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:41:50.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:41:50.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:41:50.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:41:50.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:50.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:41:50.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:41:50.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:50.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:41:50.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:41:50.400 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.400 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.400 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.400 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.400 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:50.400 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.765645163000002, 2024-04-25T22:41:50.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:41:50.400 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:50.401 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:50.401 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.401 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:50.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:50.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:50.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:50.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:50.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:50.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:41:50.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:41:50.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:50.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:41:50.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:41:50.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:50.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:41:50.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:41:50.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:41:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:41:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:41:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:41:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:41:50.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:41:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:41:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:41:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:41:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:41:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:41:50.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:41:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:41:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:41:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:41:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:41:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:41:50.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:50.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:41:50.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:41:50.406 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.406 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.406 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.406 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.406 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:50.406 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.765579740000007, 2024-04-25T22:41:50.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:41:50.407 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:50.407 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:50.407 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.407 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:50.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.407 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:50.407 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:50.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.407 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:50.407 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:50.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:50.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:41:50.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:50.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:50.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:41:50.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:41:50.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:50.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:41:50.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:41:50.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:41:50.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:41:50.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:41:50.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:41:50.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:50.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:41:50.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:41:50.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:41:50.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:41:50.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:50.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:41:50.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:41:50.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:50.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:41:50.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:41:50.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:50.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:41:50.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:41:50.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:41:50.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:41:50.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:50.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:41:50.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:41:50.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:50.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:41:50.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:41:50.412 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.412 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.412 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.412 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.412 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:50.412 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.765523673999994, 2024-04-25T22:41:50.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:41:50.413 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:50.413 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:50.413 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.413 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:50.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:50.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:50.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:50.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:50.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:50.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:50.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:41:50.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:50.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:41:50.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:41:50.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:50.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:41:50.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:41:50.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:41:50.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:41:50.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:41:50.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:41:50.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:50.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:41:50.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:41:50.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:41:50.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:41:50.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:50.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:41:50.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:41:50.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:41:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:41:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:41:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:41:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:41:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:41:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:41:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:41:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:41:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:41:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.765456568000005, 2024-04-25T22:41:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:41:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:41:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:41:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:41:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:41:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:41:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:41:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:41:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:41:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:41:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:41:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:41:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:41:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:41:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:41:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:41:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:41:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:41:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:41:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:41:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:41:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:41:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:41:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:41:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:41:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:41:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:41:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.765401444999995, 2024-04-25T22:41:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:41:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:41:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:41:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:41:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:41:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:41:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:41:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:41:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:41:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:41:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:41:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:41:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:41:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:41:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:41:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:41:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:41:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:41:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:41:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:41:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:41:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:41:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:41:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:41:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:41:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:41:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.765299205999995, 2024-04-25T22:41:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:41:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:41:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:41:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:41:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:41:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:41:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:41:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:41:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:41:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:41:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:41:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:41:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:41:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:41:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:41:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:41:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:41:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:41:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:41:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:41:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:41:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:41:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:41:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:41:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:41:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:41:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:41:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.765240383000005, 2024-04-25T22:41:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:41:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:41:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:41:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:41:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:41:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:41:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:41:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:41:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:41:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:41:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:41:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:41:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:41:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:41:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:41:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:41:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:41:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:41:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:41:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:41:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:41:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:41:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:41:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:41:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:41:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:41:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:41:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.765161649999996, 2024-04-25T22:41:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:41:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:41:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:41:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:41:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:41:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:41:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:41:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:41:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:41:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:41:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:41:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:41:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:41:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:41:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:41:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:41:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:41:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:41:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:41:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:41:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:41:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:41:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:41:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:41:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:41:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:41:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.765122237, 2024-04-25T22:41:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:41:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:41:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:41:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:41:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:41:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:41:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:41:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:41:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:41:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:41:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:41:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:41:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:41:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:41:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:41:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:41:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:41:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:41:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:41:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:41:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:41:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:41:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:41:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:41:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:41:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:41:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:41:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.765052390999998, 2024-04-25T22:41:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:41:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:50.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:41:50.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:41:50.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:50.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:41:50.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:41:50.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:50.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:41:50.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:41:50.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:41:50.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:41:50.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:41:50.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:41:50.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:50.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:41:50.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:41:50.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:41:50.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:41:50.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:50.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:41:50.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:41:50.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:50.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:41:50.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:41:50.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:41:50.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:41:50.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:50.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:41:50.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:41:50.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:50.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:41:50.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:41:50.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:50.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:41:50.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:41:50.462 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.462 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.462 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.463 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.463 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:50.463 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.765002654, 2024-04-25T22:41:50.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:41:50.463 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:50.463 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:50.463 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.463 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:50.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:50.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:50.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:50.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:50.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:50.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:41:50.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:50.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:50.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:41:50.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:41:50.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:50.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:41:50.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:41:50.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:41:50.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:41:50.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:41:50.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:41:50.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:50.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:41:50.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:41:50.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:41:50.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:41:50.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:50.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:41:50.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:41:50.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:50.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:41:50.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:41:50.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:50.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:41:50.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:41:50.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:41:50.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:41:50.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:50.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:50.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:41:50.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:50.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:41:50.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:41:50.468 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.468 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.468 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.469 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.469 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:50.469 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.764918038999994, 2024-04-25T22:41:50.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:41:50.469 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:50.469 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:50.469 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.469 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:50.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:50.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:50.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:50.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:50.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:50.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:41:50.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:50.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:50.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:41:50.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:41:50.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:50.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:41:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:41:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:41:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:41:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:41:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:41:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:41:50.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:41:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:41:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:41:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:41:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:41:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:41:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:41:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:41:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:41:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:41:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:41:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:41:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:41:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:41:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:41:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.764854389000007, 2024-04-25T22:41:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:41:50.474 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:41:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:41:50.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:41:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:41:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:41:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:41:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:41:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:41:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:41:50.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:41:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:41:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:41:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:41:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:41:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:41:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:41:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:41:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:41:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:41:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.757850859000001, 2024-04-25T22:41:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:41:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:41:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:41:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:41:50.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:41:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:41:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:41:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:41:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:41:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:41:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:41:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:41:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:41:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:41:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:41:50.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:41:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:41:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:50.483 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:50.483 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:50.485 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:50.485 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:50.480+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:50.586 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:50.580+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:50.612 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:50.613 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:50.613 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:50.613 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:50.627 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:50.686 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:50.685+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:50.695 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:41:50.787 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:50.785+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:50.794 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:50.795 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:50.795 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:50.795 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:50.795 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:50.810 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:50.888 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:50.889+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:50.935 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 96.336901621999999, 2024-04-25T22:41:50.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:50.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:50.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:50.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:50.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:50.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:50.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:50.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:50.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:50.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:50.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:50.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:50.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:50.941 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.941 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:50.941 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.941 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.941 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:50.941 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 96.336764365999997, 2024-04-25T22:41:50.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:50.941 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:50.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:50.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 96.336676814, 2024-04-25T22:41:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.947 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 96.336572988, 2024-04-25T22:41:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:50.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:50.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:50.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:50.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:50.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:50.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:50.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:50.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:50.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:50.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:50.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:50.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:50.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:50.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:50.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:50.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:50.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:50.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:50.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:50.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:50.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:50.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:50.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:50.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:50.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:50.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:50.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:50.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:50.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:50.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:50.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:50.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:50.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:50.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:50.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:50.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:50.958 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.958 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:50.958 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.958 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.958 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:50.958 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 96.336504198, 2024-04-25T22:41:50.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:50.958 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:50.958 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:50.958 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.958 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:50.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:50.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:50.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:50.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:50.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:50.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:50.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:50.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:50.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:50.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:50.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:50.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:50.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:50.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:50.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:50.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:50.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:50.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:50.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:50.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:50.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:50.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:50.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:50.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:50.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:50.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:50.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:50.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:50.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:50.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:50.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:50.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:50.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:50.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:50.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:50.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:50.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:50.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:50.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:50.963 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.963 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:50.963 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.963 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.964 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:50.964 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 96.336435112000004, 2024-04-25T22:41:50.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:50.964 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:50.964 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:50.964 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.964 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:50.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:50.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:50.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:50.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:50.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:50.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:50.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:50.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:50.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:50.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:50.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:50.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:50.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:50.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:50.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:50.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:50.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:50.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:50.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:50.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:50.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:50.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:50.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:50.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:50.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:50.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:50.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:50.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:50.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:50.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:50.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:50.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:50.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:50.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:50.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:50.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:50.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:50.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:50.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:50.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:50.969 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.969 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:50.969 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.969 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.969 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:50.969 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 96.336338999000006, 2024-04-25T22:41:50.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:50.969 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:50.969 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:50.969 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:50.969 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:50.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:50.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:50.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:50.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:50.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:50.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:50.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:50.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:50.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:50.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:50.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:50.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:50.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:50.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:50.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:50.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:50.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:50.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:50.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:50.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:50.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:50.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:50.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:50.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:50.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:50.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:50.973 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:50.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:50.973 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.973 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:50.973 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.973 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.973 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.973 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:50.973 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 96.336273336999994, 2024-04-25T22:41:50.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:50.973 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:50.973 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:50.973 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:50.973 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:50.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:50.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:50.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:50.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:50.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:50.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:50.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:50.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.975 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:50.975 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:50.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:50.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.975 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:50.975 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:50.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:50.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.975 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.975 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:50.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:50.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:50.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:50.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:50.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:50.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:50.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:50.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:50.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:50.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:50.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:50.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:50.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:50.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:50.977 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.977 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:50.977 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.977 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:50.977 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:50.978 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 96.336204210000005, 2024-04-25T22:41:50.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:50.978 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:50.978 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:50.978 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:50.978 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:50.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:50.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:50.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:50.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:50.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.979 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:50.979 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:50.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:50.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.979 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:50.979 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:50.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:50.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.979 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:50.979 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:50.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:50.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:50.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:50.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:50.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:50.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:50.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:50.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:50.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:50.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:50.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:50.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:50.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:50.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:50.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:50.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:50.981 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.981 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:50.982 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.982 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:50.982 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:50.982 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 96.325387554000002, 2024-04-25T22:41:50.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:50.982 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:50.982 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:50.982 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:50.982 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:50.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:50.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:50.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:50.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:50.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:50.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:50.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:50.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:50.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:50.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:50.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.984 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:50.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:50.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:50.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.984 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:50.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:50.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.984 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:50.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:50.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.985 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:50.985 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:50.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:50.985 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.985 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:50.985 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.985 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:50.985 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:50.985 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 96.308489201, 2024-04-25T22:41:50.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:50.985 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:50.985 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:50.985 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:50.986 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:50.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:50.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:50.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:50.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:50.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:50.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:50.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:50.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:50.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:50.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:50.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:50.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:50.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:50.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:50.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:50.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.988 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.988 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:50.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:50.988 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.988 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:50.988 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:50.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:50.988 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.988 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:50.988 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:50.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:50.988 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.988 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:50.989 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.989 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:50.989 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:50.989 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 96.307668311, 2024-04-25T22:41:50.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:50.989 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:50.989 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:50.989 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:50.989 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:50.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:50.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:50.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:50.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:50.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:50.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:50.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:50.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:50.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:50.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:50.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:50.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:50.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:50.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:50.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:50.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:50.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:50.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:50.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:50.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:50.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:50.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:50.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:50.992 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.992 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:50.992 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.992 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:50.992 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:50.992 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 96.305967582999997, 2024-04-25T22:41:50.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:50.993 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:50.993 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:50.993 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.993 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:50.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:50.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:50.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:50.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:50.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:50.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:50.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:50.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.994 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.994 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:50.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:50.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:50.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.994 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.994 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:50.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:50.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:50.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.994 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.995 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:50.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:50.995 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.995 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:50.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:50.995 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:50.995 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:50.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:50.995 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:50.996 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:50.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:50.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:50.996 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:50.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:50.996 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.996 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:50.996 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:50.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.996 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:50.996 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:50.997 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 96.305370908, 2024-04-25T22:41:50.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:50.997 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:50.997 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:50.997 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:50.997 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:50.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:50.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:50.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:50.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:50.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:50.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:50.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:50.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:50.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:50.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:50.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:50.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:50.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:50.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:50.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:50.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:50.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:50.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:50.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:50.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:50.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:50.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:50.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:50.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:50.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:50.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:51.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:51.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:51.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:51.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:51.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:51.000 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:51.000 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:51.000 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:51.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.000 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-04-25T22:41:51.000 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:51.000 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 96.295935181999994, 2024-04-25T22:41:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001098323, 2024-04-25T22:41:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636581+0000", 2024-04-25T22:41:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1699999999999998e-07 2024-04-25T22:41:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636585+0000", 2024-04-25T22:41:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8890000000000004e-06 2024-04-25T22:41:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636600+0000", 2024-04-25T22:41:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5160000000000001e-05 2024-04-25T22:41:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636610+0000", 2024-04-25T22:41:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7510000000000003e-06 2024-04-25T22:41:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637462+0000", 2024-04-25T22:41:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00085220000000000001 2024-04-25T22:41:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637679+0000", 2024-04-25T22:41:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021670599999999999 2024-04-25T22:41:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:51.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 96.295287755999993, 2024-04-25T22:41:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:51.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:51.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:51.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.007 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 96.293846936999998, 2024-04-25T22:41:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:51.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 94.341408493000003, 2024-04-25T22:41:51.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:51.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:51.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:51.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 72.338749168999996, 2024-04-25T22:41:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:51.016 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:51.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:51.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.019 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:51.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 67.338456918000006, 2024-04-25T22:41:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:51.021 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.023 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.024 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:51.025 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:51.026 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:51.026 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:51.027 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:51.024+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:51.028 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:51.125 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:41:51.128 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:51.125+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:51.158 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:51.158 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:51.158 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:41:51.158 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:51.172 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:51.261 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:51.261+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:51.273 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:51.273 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:51.273 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:41:51.294 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:51.294 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:51.297 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:41:51.298 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:41:51.329 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:51.329+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:51.335 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:51.335 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:51.349 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:51.430 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:51.428+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:51.514 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:51.514 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:51.526 INFO:tasks.workunit.client.0.smithi057.stderr:Updating files: 97% (12238/12492) Updating files: 98% (12243/12492) Updating files: 99% (12368/12492) Updating files: 100% (12492/12492) Updating files: 100% (12492/12492), done. 2024-04-25T22:41:51.528 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:51.531 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:51.529+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:51.632 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:51.628+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:51.660 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:51.661 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:51.675 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:51.729 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is set 2024-04-25T22:41:51.762 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:51.760+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:51.834 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:51.828+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:51.841 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:51.841 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:51.855 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:51.946 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:51.944+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:52.022 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:52.022 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:52.036 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:52.032+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:52.036 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:52.136 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:52.133+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:52.157 INFO:tasks.workunit.client.0.smithi057.stderr:Note: switching to 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a'. 2024-04-25T22:41:52.158 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-04-25T22:41:52.158 INFO:tasks.workunit.client.0.smithi057.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T22:41:52.158 INFO:tasks.workunit.client.0.smithi057.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T22:41:52.158 INFO:tasks.workunit.client.0.smithi057.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T22:41:52.158 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-04-25T22:41:52.158 INFO:tasks.workunit.client.0.smithi057.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T22:41:52.158 INFO:tasks.workunit.client.0.smithi057.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T22:41:52.158 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-04-25T22:41:52.158 INFO:tasks.workunit.client.0.smithi057.stderr: git switch -c 2024-04-25T22:41:52.159 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-04-25T22:41:52.159 INFO:tasks.workunit.client.0.smithi057.stderr:Or undo this operation with: 2024-04-25T22:41:52.159 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-04-25T22:41:52.159 INFO:tasks.workunit.client.0.smithi057.stderr: git switch - 2024-04-25T22:41:52.159 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-04-25T22:41:52.159 INFO:tasks.workunit.client.0.smithi057.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T22:41:52.159 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-04-25T22:41:52.159 INFO:tasks.workunit.client.0.smithi057.stderr:HEAD is now at b22e2ebdeb2 Merge pull request #57078 from adk3798/squid-cephadm-no-downgrade 2024-04-25T22:41:52.162 DEBUG:teuthology.orchestra.run.smithi057:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T22:41:52.167 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:52.167 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:52.169 INFO:tasks.workunit.client.0.smithi057.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T22:41:52.172 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T22:41:52.172 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T22:41:52.181 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:52.237 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:52.231+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:52.338 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:52.337+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:52.347 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:52.348 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:52.362 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:52.449 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:52.449+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:52.527 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:52.527 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:52.540 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:52.537+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:52.542 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:52.641 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:52.635+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:52.673 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:52.673 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:52.687 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:52.778 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:52.775+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:52.807 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~18s 2024-04-25T22:41:52.844 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:52.845+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:52.855 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:52.855 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:52.871 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:52.958 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:52.955+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:52.996 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T22:41:53.038 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:53.039 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:53.045 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:53.039+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:53.052 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:53.086 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T22:41:53.139 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T22:41:53.141 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T22:41:53.141 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T22:41:53.146 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:53.143+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:53.184 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:53.184 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:53.185 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T22:41:53.189 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:41:53.189 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T22:41:53.198 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:53.235 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-25T22:41:53.237 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-25T22:41:53.237 DEBUG:teuthology.orchestra.run.smithi057:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b22e2ebdeb24376882b7bda2a7329c8cccc2276a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-25T22:41:53.247 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:53.247+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:53.293 INFO:tasks.workunit.client.0.smithi057.stderr:+ mkdir -p fsstress 2024-04-25T22:41:53.295 INFO:tasks.workunit.client.0.smithi057.stderr:+ pushd fsstress 2024-04-25T22:41:53.296 INFO:tasks.workunit.client.0.smithi057.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T22:41:53.296 INFO:tasks.workunit.client.0.smithi057.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-25T22:41:53.299 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:41:53.315 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:53.315 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:53.329 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:53.377 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:53.377+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:53.449 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:53.449 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:53.449 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:53.449+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:53.452 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:53.453 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:53.453 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:41:53.463 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:53.474 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:53.475 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:53.478 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:41:53.478 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:41:53.550 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:53.543+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:53.593 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:53.593 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:53.593 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:53.593 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:53.608 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:53.651 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:53.649+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:53.751 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:53.749+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:53.754 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:41:53.766 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:53.766 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:53.766 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:53.767 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:53.767 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:53.780 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:53.851 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:53.847+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:53.907 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:53.907 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:53.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:53.908 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:53.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.908 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:53.908 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:53.908 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 99.309088861000006, 2024-04-25T22:41:53.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:53.908 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:53.908 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:53.908 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:53.908 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:53.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:53.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:53.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:53.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:53.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:53.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:53.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:53.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:53.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:53.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:53.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:53.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:53.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:53.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:53.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:53.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:53.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:53.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:53.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:53.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:53.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:53.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:53.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:53.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:53.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:53.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:53.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:53.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:53.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:53.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:53.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:53.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:53.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:53.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:53.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:53.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:53.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:53.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:53.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:53.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:53.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:53.914 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.914 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:53.914 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.914 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:53.914 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:53.914 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 99.308951605000004, 2024-04-25T22:41:53.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:53.914 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:53.914 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:53.914 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:53.914 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:53.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:53.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:53.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:53.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:53.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:53.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:53.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:53.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:53.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:53.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:53.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:53.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:53.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:53.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:53.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:53.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:53.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:53.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:53.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:53.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:53.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:53.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:53.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:53.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:53.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:53.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:53.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:53.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:53.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:53.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:53.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:53.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:53.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:53.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:53.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:53.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:53.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:53.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:53.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:53.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:53.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:53.920 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.920 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:53.920 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.920 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:53.920 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:53.920 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 99.308864052999994, 2024-04-25T22:41:53.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:53.920 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:53.920 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:53.920 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:53.921 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:53.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:53.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:53.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:53.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:53.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:53.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:53.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:53.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:53.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:53.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:53.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:53.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:53.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:53.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:53.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:53.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:53.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:53.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:53.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:53.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:53.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:53.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:53.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:53.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:53.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:53.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:53.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:53.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:53.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:53.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:53.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:53.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:53.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:53.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:53.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:53.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:53.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:53.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:53.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:53.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:53.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:53.926 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.926 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:53.926 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.926 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:53.926 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:53.926 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 99.308760226999993, 2024-04-25T22:41:53.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:53.927 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:53.927 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:53.927 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:53.927 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:53.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:53.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:53.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:53.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:53.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:53.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:53.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:53.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:53.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:53.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:53.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:53.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:53.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:53.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:53.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:53.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:53.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:53.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:53.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:53.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:53.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:53.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:53.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:53.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:53.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:53.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:53.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:53.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:53.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:53.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:53.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:53.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:53.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:53.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:53.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:53.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:53.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:53.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:53.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:53.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:53.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:53.932 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.932 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:53.932 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.932 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:53.932 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:53.932 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 99.308691436999993, 2024-04-25T22:41:53.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:53.933 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:53.933 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:53.933 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:53.933 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:53.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:53.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:53.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:53.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:53.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:53.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:53.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:53.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:53.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:53.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:53.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:53.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:53.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:53.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:53.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:53.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:53.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:53.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:53.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:53.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:53.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:53.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:53.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:53.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:53.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:53.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:53.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:53.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:53.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:53.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:53.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:53.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:53.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:53.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:53.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:53.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:53.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:53.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:53.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:53.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:53.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:53.938 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.938 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:53.938 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.939 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:53.939 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:53.939 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 99.308622350999997, 2024-04-25T22:41:53.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:53.939 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:53.939 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:53.939 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:53.939 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:53.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:53.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:53.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:53.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:53.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:53.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:53.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:53.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:53.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:53.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:53.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:53.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:53.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:53.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:53.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:53.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:53.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:53.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:53.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:53.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:53.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:53.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:53.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:53.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:53.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:53.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:53.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:53.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:53.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:53.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:53.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:53.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:53.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:53.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:53.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:53.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:53.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:53.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:53.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:53.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:53.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:53.945 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.945 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:53.945 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.945 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:53.945 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:53.945 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 99.308526237999999, 2024-04-25T22:41:53.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:53.945 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:53.945 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:53.945 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:53.945 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:53.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:53.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:53.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:53.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:53.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:53.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:53.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:53.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:53.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:53.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:53.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:53.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:53.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:53.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:53.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:53.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:53.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:53.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:53.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:53.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:53.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:53.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:53.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:53.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:53.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:53.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:53.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.953 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:53.953 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:53.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:53.953 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.953 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:53.953 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.953 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:53.953 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:53.953 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 99.308460576000002, 2024-04-25T22:41:53.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:53.953 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:53.954 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:53.954 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:53.954 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:53.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:53.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:53.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:53.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:53.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:53.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:53.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:53.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:53.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:53.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:53.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:53.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:53.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:53.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:53.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:53.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:53.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:53.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:53.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:53.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:53.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:53.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:53.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:53.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:53.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:53.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:53.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:53.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:53.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:53.958 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.958 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:53.958 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.958 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:53.958 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:53.958 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 99.308391448999998, 2024-04-25T22:41:53.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:53.958 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:53.958 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:53.958 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:53.958 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:53.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:53.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:53.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:53.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:53.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:53.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:53.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:53.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:53.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:53.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:53.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:53.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:53.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:53.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:53.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:53.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:53.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:53.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:53.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:53.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:53.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:53.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:53.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:53.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:53.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:53.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:53.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:53.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:53.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:53.963 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.963 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:53.963 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.963 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:53.963 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:53.963 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 99.297574792999995, 2024-04-25T22:41:53.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:53.963 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:53.963 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:53.963 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:53.964 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:53.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:53.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:53.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:53.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:53.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.964 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.964 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.964 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:53.964 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:53.964 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:53.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:53.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:53.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:53.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:53.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:53.965 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:53.965 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.965 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.965 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:53.965 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:53.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:53.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:53.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:53.966 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.966 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.966 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:53.966 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:53.966 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:53.966 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.966 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:53.967 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.967 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.967 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:53.967 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:53.967 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 99.280676439999993, 2024-04-25T22:41:53.967 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001461876, 2024-04-25T22:41:53.967 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:53.967 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:53.967 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:53.967 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:53.967 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.967 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:53.967 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:53.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:53.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:53.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:53.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624027+0000", 2024-04-25T22:41:53.968 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1999999999999999e-07 2024-04-25T22:41:53.968 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.968 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.968 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:53.968 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624034+0000", 2024-04-25T22:41:53.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9770000000000003e-06 2024-04-25T22:41:53.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:53.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624051+0000", 2024-04-25T22:41:53.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6616000000000002e-05 2024-04-25T22:41:53.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:53.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624065+0000", 2024-04-25T22:41:53.969 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4173e-05 2024-04-25T22:41:53.969 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.969 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.969 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.969 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625181+0000", 2024-04-25T22:41:53.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001116192 2024-04-25T22:41:53.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:53.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625205+0000", 2024-04-25T22:41:53.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3502999999999998e-05 2024-04-25T22:41:53.970 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.970 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.970 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:53.970 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625489+0000", 2024-04-25T22:41:53.970 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028379499999999999 2024-04-25T22:41:53.970 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.970 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:53.971 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.971 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.971 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e18/16 ondisk, result = 0)", 2024-04-25T22:41:53.971 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:53.971 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 99.279855549999994, 2024-04-25T22:41:53.971 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030883429999999999, 2024-04-25T22:41:53.971 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:53.971 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:53.971 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:53.971 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:53.971 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.971 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:53.971 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:53.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:53.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624848+0000", 2024-04-25T22:41:53.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:53.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624849+0000", 2024-04-25T22:41:53.972 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.147e-06 2024-04-25T22:41:53.972 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.972 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.972 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:53.972 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624857+0000", 2024-04-25T22:41:53.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9060000000000002e-06 2024-04-25T22:41:53.973 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.973 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:53.973 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624877+0000", 2024-04-25T22:41:53.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0463e-05 2024-04-25T22:41:53.973 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.973 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:53.973 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624893+0000", 2024-04-25T22:41:53.973 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5489999999999999e-05 2024-04-25T22:41:53.973 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.973 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.973 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.973 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627642+0000", 2024-04-25T22:41:53.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002749526 2024-04-25T22:41:53.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:53.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627662+0000", 2024-04-25T22:41:53.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9502999999999999e-05 2024-04-25T22:41:53.974 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.974 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.974 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:53.974 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627936+0000", 2024-04-25T22:41:53.974 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027430800000000002 2024-04-25T22:41:53.974 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.974 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:53.974 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.975 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:53.975 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:53.975 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 99.278154822000005, 2024-04-25T22:41:53.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063952829999999999, 2024-04-25T22:41:53.975 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:53.975 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:53.975 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:53.975 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:53.975 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.975 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:53.975 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:53.975 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.975 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:53.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626548+0000", 2024-04-25T22:41:53.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:53.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626550+0000", 2024-04-25T22:41:53.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3599999999999999e-06 2024-04-25T22:41:53.976 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.976 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.976 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:53.976 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626578+0000", 2024-04-25T22:41:53.976 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8472000000000001e-05 2024-04-25T22:41:53.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:53.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626603+0000", 2024-04-25T22:41:53.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.472e-05 2024-04-25T22:41:53.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:53.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626639+0000", 2024-04-25T22:41:53.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5840000000000002e-05 2024-04-25T22:41:53.977 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.977 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.977 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626749+0000", 2024-04-25T22:41:53.977 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011078600000000001 2024-04-25T22:41:53.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:53.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.626878+0000", 2024-04-25T22:41:53.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000128245 2024-04-25T22:41:53.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:53.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632845+0000", 2024-04-25T22:41:53.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059676340000000003 2024-04-25T22:41:53.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:53.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.632944+0000", 2024-04-25T22:41:53.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8226000000000004e-05 2024-04-25T22:41:53.979 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.979 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:53.979 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.979 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:53.979 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:53.979 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 99.277558146999993, 2024-04-25T22:41:53.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:53.979 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:53.979 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:53.979 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:53.979 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:53.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:53.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:53.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:53.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:53.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:53.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:53.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:53.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:53.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:53.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:53.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:53.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:53.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:53.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:53.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:53.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:53.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:53.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:53.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:53.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:53.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:53.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:53.982 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:53.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:53.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:53.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:53.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:53.983 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.983 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:53.983 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.983 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:53.983 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:53.983 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 99.267474995000001, 2024-04-25T22:41:53.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0022186860000000001, 2024-04-25T22:41:53.984 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:53.984 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:53.984 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:53.984 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:53.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.984 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:53.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:53.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.984 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:53.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637228+0000", 2024-04-25T22:41:53.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.985 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:53.985 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637229+0000", 2024-04-25T22:41:53.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1000000000000001e-06 2024-04-25T22:41:53.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.985 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:53.985 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637255+0000", 2024-04-25T22:41:53.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5683000000000001e-05 2024-04-25T22:41:53.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.985 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:53.985 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637269+0000", 2024-04-25T22:41:53.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:41:53.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:53.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637280+0000", 2024-04-25T22:41:53.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0844e-05 2024-04-25T22:41:53.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.986 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637388+0000", 2024-04-25T22:41:53.986 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000108719 2024-04-25T22:41:53.986 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.986 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.986 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:53.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637431+0000", 2024-04-25T22:41:53.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2862999999999999e-05 2024-04-25T22:41:53.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:53.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639303+0000", 2024-04-25T22:41:53.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001872119 2024-04-25T22:41:53.987 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.987 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.987 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:53.987 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.639447+0000", 2024-04-25T22:41:53.987 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014329499999999999 2024-04-25T22:41:53.987 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.987 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:53.988 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.988 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.988 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:53.988 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:53.988 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 99.266034176000005, 2024-04-25T22:41:53.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018941089999999999, 2024-04-25T22:41:53.988 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:53.988 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:53.988 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:53.988 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:53.988 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.988 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:53.988 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:53.988 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:53.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638669+0000", 2024-04-25T22:41:53.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:53.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638670+0000", 2024-04-25T22:41:53.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:41:53.989 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.989 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.989 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:53.989 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638679+0000", 2024-04-25T22:41:53.989 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3170000000000008e-06 2024-04-25T22:41:53.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:53.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638721+0000", 2024-04-25T22:41:53.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1449999999999998e-05 2024-04-25T22:41:53.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.990 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:53.990 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638735+0000", 2024-04-25T22:41:53.990 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:53.990 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.990 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638852+0000", 2024-04-25T22:41:53.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000117216 2024-04-25T22:41:53.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:53.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.638914+0000", 2024-04-25T22:41:53.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1192000000000006e-05 2024-04-25T22:41:53.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.991 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.991 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:53.991 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640498+0000", 2024-04-25T22:41:53.991 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0015841080000000001 2024-04-25T22:41:53.991 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.992 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:53.992 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.640563+0000", 2024-04-25T22:41:53.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5300000000000002e-05 2024-04-25T22:41:53.992 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.992 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:53.992 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.992 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.992 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.992 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-04-25T22:41:53.992 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:53.992 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 97.313595731999996, 2024-04-25T22:41:53.992 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0032261379999999999, 2024-04-25T22:41:53.992 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:53.993 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:53.993 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:53.993 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:53.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:53.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:53.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:53.993 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591107+0000", 2024-04-25T22:41:53.993 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.993 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.993 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.993 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:53.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591110+0000", 2024-04-25T22:41:53.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5229999999999998e-06 2024-04-25T22:41:53.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.994 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.994 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:53.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591141+0000", 2024-04-25T22:41:53.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.078e-05 2024-04-25T22:41:53.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.994 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.994 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:53.994 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591172+0000", 2024-04-25T22:41:53.994 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1633e-05 2024-04-25T22:41:53.994 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:53.995 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591188+0000", 2024-04-25T22:41:53.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.588e-05 2024-04-25T22:41:53.995 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:53.995 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591307+0000", 2024-04-25T22:41:53.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119239 2024-04-25T22:41:53.995 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.995 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.995 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:53.995 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591523+0000", 2024-04-25T22:41:53.995 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021579800000000001 2024-04-25T22:41:53.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:53.996 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.591713+0000", 2024-04-25T22:41:53.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000189736 2024-04-25T22:41:53.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:53.996 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.592933+0000", 2024-04-25T22:41:53.996 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012204270000000001 2024-04-25T22:41:53.996 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.996 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.996 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:53.996 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594146+0000", 2024-04-25T22:41:53.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0012128239999999999 2024-04-25T22:41:53.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:53.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594229+0000", 2024-04-25T22:41:53.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2619000000000003e-05 2024-04-25T22:41:53.997 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:53.997 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:16.594333+0000", 2024-04-25T22:41:53.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010467900000000001 2024-04-25T22:41:53.997 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.997 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:53.997 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:53.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.998 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-04-25T22:41:53.998 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:53.998 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 75.310936408000003, 2024-04-25T22:41:53.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031636540000000001, 2024-04-25T22:41:53.998 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:53.998 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:53.998 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:53.998 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:53.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:53.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:53.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:53.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593767+0000", 2024-04-25T22:41:53.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:53.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:53.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593769+0000", 2024-04-25T22:41:53.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8200000000000001e-06 2024-04-25T22:41:53.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:53.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:53.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:53.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593782+0000", 2024-04-25T22:41:54.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.29e-05 2024-04-25T22:41:54.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:54.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593815+0000", 2024-04-25T22:41:54.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2184000000000002e-05 2024-04-25T22:41:54.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.593832+0000", 2024-04-25T22:41:54.000 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7323e-05 2024-04-25T22:41:54.000 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.000 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.000 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:54.000 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594021+0000", 2024-04-25T22:41:54.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018898600000000001 2024-04-25T22:41:54.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:54.001 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594173+0000", 2024-04-25T22:41:54.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015180099999999999 2024-04-25T22:41:54.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:54.001 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.594394+0000", 2024-04-25T22:41:54.001 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000221451 2024-04-25T22:41:54.001 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.001 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.001 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:54.001 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.595706+0000", 2024-04-25T22:41:54.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013121840000000001 2024-04-25T22:41:54.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:54.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596774+0000", 2024-04-25T22:41:54.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001068067 2024-04-25T22:41:54.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:54.002 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596864+0000", 2024-04-25T22:41:54.002 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9732000000000001e-05 2024-04-25T22:41:54.002 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.002 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.002 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:54.003 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:38.596930+0000", 2024-04-25T22:41:54.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6205999999999996e-05 2024-04-25T22:41:54.003 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:54.003 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:54.003 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:54.003 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.003 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-04-25T22:41:54.003 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:54.003 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 70.310644156999999, 2024-04-25T22:41:54.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025768660000000001, 2024-04-25T22:41:54.003 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:54.003 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:54.003 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.003 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:54.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:54.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:54.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:54.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:54.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594059+0000", 2024-04-25T22:41:54.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:54.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:54.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594061+0000", 2024-04-25T22:41:54.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5519999999999999e-06 2024-04-25T22:41:54.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:54.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594074+0000", 2024-04-25T22:41:54.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2471e-05 2024-04-25T22:41:54.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:54.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594094+0000", 2024-04-25T22:41:54.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9718e-05 2024-04-25T22:41:54.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594104+0000", 2024-04-25T22:41:54.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0655e-05 2024-04-25T22:41:54.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:54.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594223+0000", 2024-04-25T22:41:54.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011887699999999999 2024-04-25T22:41:54.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:54.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594345+0000", 2024-04-25T22:41:54.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012150999999999999 2024-04-25T22:41:54.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:54.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.594516+0000", 2024-04-25T22:41:54.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017177499999999999 2024-04-25T22:41:54.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:54.007 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.595380+0000", 2024-04-25T22:41:54.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086395000000000005 2024-04-25T22:41:54.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:54.007 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596550+0000", 2024-04-25T22:41:54.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001169352 2024-04-25T22:41:54.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:54.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596596+0000", 2024-04-25T22:41:54.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5989999999999998e-05 2024-04-25T22:41:54.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:54.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:43.596636+0000", 2024-04-25T22:41:54.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0015999999999998e-05 2024-04-25T22:41:54.008 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:54.008 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:54.008 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:54.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.008 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:46 3.6 e55/30 3:654134d2:::mds0_openfiles.0:head v 55'4, mlcod=0'0)", 2024-04-25T22:41:54.008 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:53.601171+0000", 2024-04-25T22:41:54.008 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.30353175900000001, 2024-04-25T22:41:54.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001406877, 2024-04-25T22:41:54.009 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:54.009 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:54.009 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.009 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:54.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:54.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.601171+0000", 2024-04-25T22:41:54.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:54.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:54.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.601171+0000", 2024-04-25T22:41:54.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:54.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:54.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.601174+0000", 2024-04-25T22:41:54.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9660000000000001e-06 2024-04-25T22:41:54.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:54.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.601191+0000", 2024-04-25T22:41:54.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6684000000000002e-05 2024-04-25T22:41:54.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:54.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.601226+0000", 2024-04-25T22:41:54.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4644999999999998e-05 2024-04-25T22:41:54.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.601249+0000", 2024-04-25T22:41:54.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2938999999999998e-05 2024-04-25T22:41:54.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:54.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.601380+0000", 2024-04-25T22:41:54.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013108999999999999 2024-04-25T22:41:54.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:54.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.601421+0000", 2024-04-25T22:41:54.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1211999999999998e-05 2024-04-25T22:41:54.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:54.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.602453+0000", 2024-04-25T22:41:54.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001031901 2024-04-25T22:41:54.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:54.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:54.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:54.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.602578+0000", 2024-04-25T22:41:54.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012543999999999999 2024-04-25T22:41:54.012 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:54.012 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:54.012 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:54.012 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:54.013 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:54.013 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:54.014 INFO:tasks.workunit.client.0.smithi057.stderr:+ tar xzf ltp-full.tgz 2024-04-25T22:41:54.014 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:54.015 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:54.012+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:54.114 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:54.112+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:54.157 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:54.157 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:41:54.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.158 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:139 4.38 4:1dd4f8af:::10000000284.00000000:head [write 0~1979 in=1979b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-25T22:41:54.158 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:41:54.152741+0000", 2024-04-25T22:41:54.158 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0043372430000000002, 2024-04-25T22:41:54.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043974340000000004, 2024-04-25T22:41:54.158 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.158 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.158 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:41:54.158 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:41:54.158 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:41:54.158 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:54.158 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 139 2024-04-25T22:41:54.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.158 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:41:54.152741+0000", 2024-04-25T22:41:54.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:41:54.152741+0000", 2024-04-25T22:41:54.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:41:54.152742+0000", 2024-04-25T22:41:54.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.311e-06 2024-04-25T22:41:54.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:41:54.152750+0000", 2024-04-25T22:41:54.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1099999999999997e-06 2024-04-25T22:41:54.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:41:54.152764+0000", 2024-04-25T22:41:54.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4316e-05 2024-04-25T22:41:54.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:41:54.152773+0000", 2024-04-25T22:41:54.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2960000000000004e-06 2024-04-25T22:41:54.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:41:54.152835+0000", 2024-04-25T22:41:54.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1459999999999998e-05 2024-04-25T22:41:54.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:41:54.152918+0000", 2024-04-25T22:41:54.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3788999999999993e-05 2024-04-25T22:41:54.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:54.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:41:54.152998+0000", 2024-04-25T22:41:54.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9769000000000001e-05 2024-04-25T22:41:54.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:54.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:41:54.153650+0000", 2024-04-25T22:41:54.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000651606 2024-04-25T22:41:54.162 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.162 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.162 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.162 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:143 4.11 4:8885baf4:::10000000288.00000000:head [write 0~111 in=111b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-25T22:41:54.162 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:41:54.157066+0000", 2024-04-25T22:41:54.163 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 1.2482e-05, 2024-04-25T22:41:54.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021665599999999999, 2024-04-25T22:41:54.163 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.163 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.163 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:41:54.163 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:41:54.163 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:41:54.163 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:54.163 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 143 2024-04-25T22:41:54.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.163 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:41:54.157066+0000", 2024-04-25T22:41:54.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:41:54.157066+0000", 2024-04-25T22:41:54.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:41:54.157067+0000", 2024-04-25T22:41:54.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2799999999999995e-07 2024-04-25T22:41:54.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:41:54.157071+0000", 2024-04-25T22:41:54.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4309999999999996e-06 2024-04-25T22:41:54.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:41:54.157082+0000", 2024-04-25T22:41:54.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1276e-05 2024-04-25T22:41:54.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:41:54.157088+0000", 2024-04-25T22:41:54.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.066e-06 2024-04-25T22:41:54.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:41:54.157135+0000", 2024-04-25T22:41:54.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6366999999999998e-05 2024-04-25T22:41:54.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:41:54.157218+0000", 2024-04-25T22:41:54.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3518999999999998e-05 2024-04-25T22:41:54.166 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.166 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.166 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.166 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.166 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-25T22:41:54.167 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 2 2024-04-25T22:41:54.167 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:54.171 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:54.209 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is unset 2024-04-25T22:41:54.215 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:54.211+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:54.316 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:54.312+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:54.345 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:54.345 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:54.345 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:54.346 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:54.346 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:54.361 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:54.417 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:54.411+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:54.519 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:54.515+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:54.531 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:54.531 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:41:54.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:41:54.531 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:41:54.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.532 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:54.532 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:54.532 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.935015898000003, 2024-04-25T22:41:54.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:41:54.532 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.532 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.532 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.532 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:54.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:54.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:41:54.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:41:54.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:41:54.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:41:54.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:41:54.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:41:54.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:41:54.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:41:54.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:41:54.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:41:54.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:54.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:41:54.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:41:54.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:41:54.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:41:54.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:41:54.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:41:54.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:54.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:41:54.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:41:54.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:54.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:41:54.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:41:54.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:54.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:41:54.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:41:54.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:54.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:41:54.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:41:54.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:54.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:41:54.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:41:54.537 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.537 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.537 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.537 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:54.537 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:54.538 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.934927884999993, 2024-04-25T22:41:54.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:41:54.538 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.538 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.538 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.538 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:54.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:54.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:41:54.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:41:54.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:54.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:41:54.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:41:54.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:41:54.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:41:54.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:41:54.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:41:54.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:41:54.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:54.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:54.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:41:54.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:41:54.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:41:54.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:41:54.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:41:54.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:54.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:41:54.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:41:54.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:54.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:41:54.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:41:54.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:54.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:41:54.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:41:54.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:54.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:41:54.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:41:54.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:54.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:41:54.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:41:54.543 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.543 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.543 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.543 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:54.543 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:54.543 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.934855763000002, 2024-04-25T22:41:54.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:41:54.543 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.543 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.543 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.544 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:54.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:54.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:41:54.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:41:54.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:41:54.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:41:54.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:41:54.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:41:54.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:41:54.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:41:54.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:41:54.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:41:54.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:54.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:41:54.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:41:54.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:41:54.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:41:54.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:41:54.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:41:54.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:54.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:41:54.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:41:54.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:54.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:41:54.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:41:54.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:54.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:41:54.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:41:54.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:54.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:41:54.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:41:54.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:54.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:41:54.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:41:54.548 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.548 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.549 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.549 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:54.549 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:54.549 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.934747450000003, 2024-04-25T22:41:54.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:41:54.549 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.549 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.549 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.549 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:54.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:54.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:41:54.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:41:54.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:41:54.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:41:54.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:41:54.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:41:54.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:41:54.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:41:54.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:41:54.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:41:54.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:54.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:41:54.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:41:54.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:41:54.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:41:54.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:41:54.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:41:54.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:54.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:41:54.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:41:54.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:54.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:41:54.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:41:54.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:54.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:41:54.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:41:54.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:54.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:41:54.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:41:54.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:54.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:41:54.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:41:54.554 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.554 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.554 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.554 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:54.554 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:54.554 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.934680794000002, 2024-04-25T22:41:54.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:41:54.554 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.555 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.555 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.555 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:54.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:54.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:41:54.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:41:54.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:41:54.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:41:54.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:41:54.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:41:54.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:41:54.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:41:54.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:41:54.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:41:54.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:54.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:41:54.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:41:54.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:41:54.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:41:54.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:41:54.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:41:54.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:54.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:41:54.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:41:54.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:54.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:41:54.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:41:54.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:54.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:41:54.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:41:54.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:54.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:41:54.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:41:54.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:54.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:41:54.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:41:54.561 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.562 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.562 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.562 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:54.562 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:54.562 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.934590197999995, 2024-04-25T22:41:54.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:41:54.562 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.562 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.562 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.562 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:54.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:54.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:41:54.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:41:54.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:41:54.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:41:54.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:41:54.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:41:54.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:41:54.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:41:54.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:41:54.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:41:54.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:54.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:41:54.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:41:54.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:41:54.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:41:54.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:41:54.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:41:54.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:54.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:41:54.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:41:54.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:54.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:41:54.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:41:54.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:54.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:41:54.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:41:54.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:54.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:41:54.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:41:54.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:54.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:41:54.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:41:54.567 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.567 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.567 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.568 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:54.568 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:54.568 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.934525625000006, 2024-04-25T22:41:54.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:41:54.568 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.568 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.568 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.568 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:54.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:54.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:41:54.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:41:54.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:41:54.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:41:54.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:41:54.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:41:54.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:41:54.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:41:54.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:54.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:41:54.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:54.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:41:54.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:41:54.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:41:54.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:41:54.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:41:54.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:41:54.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:54.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:41:54.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:41:54.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:54.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:41:54.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:41:54.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:54.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:41:54.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:41:54.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:54.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:41:54.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:41:54.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:54.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:41:54.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:41:54.573 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.573 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.573 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.573 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:54.573 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:54.573 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.934460201999997, 2024-04-25T22:41:54.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:41:54.573 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.573 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.573 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.574 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:54.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:54.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:41:54.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:54.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:41:54.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:41:54.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:41:54.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:41:54.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:41:54.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:41:54.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:41:54.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:41:54.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:54.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:41:54.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:41:54.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:41:54.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:41:54.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:41:54.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:41:54.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:54.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:41:54.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:41:54.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:54.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:41:54.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:41:54.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:54.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:41:54.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:41:54.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:54.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:41:54.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:41:54.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:54.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:41:54.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:41:54.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.579 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.579 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.579 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:54.579 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:54.579 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.934404135999998, 2024-04-25T22:41:54.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:41:54.579 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.579 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.579 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.579 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:54.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:54.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:54.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:41:54.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:41:54.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:41:54.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:41:54.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:41:54.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:41:54.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:41:54.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:41:54.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:41:54.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:54.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:41:54.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:41:54.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:41:54.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:41:54.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:41:54.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:41:54.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:54.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:41:54.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:41:54.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:54.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:41:54.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:41:54.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:54.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:41:54.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:41:54.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:54.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:41:54.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:41:54.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:54.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:41:54.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:41:54.584 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.584 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.585 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.585 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:54.585 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:54.585 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.934337029999995, 2024-04-25T22:41:54.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:41:54.585 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.585 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.585 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.585 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:54.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:54.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:41:54.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:41:54.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:41:54.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:41:54.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:41:54.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:41:54.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:41:54.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:41:54.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:41:54.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:41:54.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:54.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:41:54.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:41:54.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:41:54.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:41:54.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:41:54.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:41:54.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:54.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:41:54.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:41:54.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:54.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:41:54.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:41:54.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:54.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:41:54.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:41:54.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:54.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:41:54.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:41:54.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:54.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:41:54.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:41:54.590 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.590 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.591 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.591 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:54.591 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:54.591 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.934281906999999, 2024-04-25T22:41:54.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:41:54.591 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.591 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.591 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.591 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:54.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:54.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:41:54.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:54.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:41:54.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:41:54.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:41:54.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:41:54.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:41:54.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:41:54.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:41:54.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:41:54.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:54.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:41:54.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:41:54.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:41:54.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:41:54.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:41:54.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:41:54.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:54.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:41:54.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:41:54.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:54.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:41:54.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:41:54.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:54.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:41:54.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:41:54.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:54.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:41:54.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:41:54.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:54.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:41:54.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:41:54.596 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.596 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.596 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.597 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:54.597 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:54.597 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.934179667999999, 2024-04-25T22:41:54.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:41:54.597 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.597 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.597 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.597 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:54.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:54.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:41:54.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:41:54.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:41:54.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:41:54.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:41:54.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:41:54.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:41:54.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:41:54.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:41:54.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:41:54.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:54.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:41:54.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:41:54.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:41:54.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:41:54.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:41:54.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:41:54.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:54.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:41:54.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:41:54.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:54.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:41:54.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:41:54.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:54.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:41:54.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:41:54.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:54.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:41:54.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:41:54.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:54.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:41:54.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:41:54.602 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.602 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.602 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.603 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:54.603 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:54.603 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.934120844999995, 2024-04-25T22:41:54.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:41:54.603 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.603 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.603 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.603 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:54.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:54.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:41:54.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:41:54.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:41:54.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:41:54.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:41:54.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:41:54.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:41:54.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:41:54.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:41:54.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:41:54.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:54.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:41:54.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:41:54.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:41:54.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:41:54.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:41:54.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:41:54.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:54.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:41:54.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:41:54.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:54.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:41:54.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:41:54.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:54.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:41:54.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:41:54.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:54.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:41:54.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:41:54.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:54.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:41:54.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:41:54.608 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.608 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.608 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.609 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:54.609 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:54.609 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.934042112, 2024-04-25T22:41:54.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:41:54.609 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.609 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.609 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.609 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:54.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:54.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:41:54.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:54.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:41:54.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:41:54.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:41:54.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:41:54.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:41:54.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:41:54.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:41:54.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:41:54.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:54.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:41:54.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:41:54.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:41:54.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:41:54.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:41:54.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:41:54.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:54.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:41:54.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:41:54.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:54.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:41:54.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:41:54.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:54.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:41:54.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:41:54.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:54.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:41:54.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:41:54.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:54.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:41:54.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:41:54.614 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.614 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.614 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.615 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:54.615 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:54.615 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.934002699000004, 2024-04-25T22:41:54.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:41:54.615 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.615 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.615 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.615 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:54.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:54.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:41:54.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:41:54.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:41:54.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:41:54.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:41:54.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:41:54.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:41:54.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:41:54.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:41:54.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:41:54.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:54.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:41:54.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:41:54.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:41:54.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:41:54.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:41:54.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:41:54.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:54.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:41:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:41:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:41:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:41:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:41:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:41:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:41:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:41:54.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:54.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:41:54.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:41:54.620 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.620 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.620 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.620 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:54.620 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:54.620 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.933932853000002, 2024-04-25T22:41:54.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:41:54.620 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:41:54.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:41:54.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:41:54.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:41:54.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:41:54.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:41:54.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:41:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:41:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:41:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:41:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:41:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:41:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:41:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:41:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:41:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:41:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:41:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:41:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:41:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:41:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:41:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:41:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:41:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:41:54.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:41:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:41:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.933883116000004, 2024-04-25T22:41:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:41:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.626 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:41:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:41:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:41:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:41:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:41:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:41:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:41:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:41:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:41:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:41:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:41:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:41:54.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:41:54.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:41:54.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:41:54.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.630 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:54.630 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:41:54.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:41:54.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:54.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:41:54.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:41:54.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:54.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:41:54.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:41:54.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:54.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:54.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:41:54.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:54.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:41:54.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:41:54.632 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.632 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.632 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.632 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:54.632 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:54.632 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.933798500999998, 2024-04-25T22:41:54.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:41:54.632 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.632 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.633 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.633 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:54.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:54.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:41:54.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:54.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:41:54.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:41:54.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:41:54.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:41:54.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:41:54.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:41:54.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:41:54.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:41:54.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:54.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:41:54.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:41:54.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:41:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:41:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:41:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:41:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:41:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:41:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:54.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:41:54.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:41:54.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:54.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:41:54.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:41:54.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:54.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:41:54.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:41:54.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:54.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:41:54.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:41:54.638 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.638 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.638 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.638 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:54.638 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:54.638 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.933734850999997, 2024-04-25T22:41:54.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:41:54.638 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.638 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.638 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:41:54.639 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:54.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:54.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:41:54.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:41:54.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:41:54.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:41:54.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:41:54.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:41:54.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:41:54.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:41:54.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:41:54.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:41:54.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:54.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:41:54.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:41:54.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:41:54.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:41:54.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:41:54.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:41:54.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:54.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:41:54.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:41:54.642 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.642 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.642 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.643 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:54.643 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:54.643 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.926731321000005, 2024-04-25T22:41:54.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:41:54.643 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:54.643 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:54.643 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:54.643 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:54.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:54.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:54.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:54.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:54.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:54.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:54.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:41:54.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:41:54.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:54.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:41:54.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:41:54.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:54.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:41:54.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:41:54.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:54.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:41:54.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:41:54.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:54.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:41:54.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:41:54.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:54.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:41:54.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:41:54.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:54.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:41:54.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:41:54.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:54.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:54.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:54.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:41:54.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:41:54.646 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.647 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.647 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.647 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:54.647 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:54.647 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:54.648 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:54.649 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:54.643+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:54.743 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-25T22:41:54.743 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:41:54.744 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-25T22:41:54.744 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.000000 2024-04-25T22:41:54.744 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0 2024-04-25T22:41:54.749 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:54.743+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:54.786 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:54.786 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:54.786 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:54.786 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:54.802 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:54.890 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:54.887+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:54.950 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:54.948+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:54.988 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:54.989 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:54.989 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:54.989 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:54.989 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:55.005 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:55.094 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:55.091+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:55.152 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:55.148+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:55.181 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:55.181 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:55.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 100.58286071800001, 2024-04-25T22:41:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:55.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:55.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:55.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:55.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.187 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 100.582723462, 2024-04-25T22:41:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:55.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:55.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:55.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:55.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.193 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 100.58263590999999, 2024-04-25T22:41:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:55.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:55.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:55.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:55.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:55.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:55.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:55.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:55.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:55.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:55.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:55.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:55.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:55.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:55.199 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:55.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:55.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:55.199 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:55.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:55.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:55.199 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.199 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.199 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.200 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:55.200 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:55.200 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 100.58253208399999, 2024-04-25T22:41:55.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:55.200 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:55.200 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:55.200 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:55.200 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:55.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:55.200 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:55.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:55.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:55.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:55.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:55.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:55.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:55.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:55.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:55.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:55.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:55.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:55.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:55.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:55.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:55.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:55.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:55.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:55.203 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:55.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:55.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.203 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:55.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:55.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:55.203 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:55.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:55.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:55.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:55.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:55.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:55.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:55.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:55.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:55.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:55.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:55.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:55.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:55.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:55.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:55.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:55.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:55.205 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.205 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.205 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.206 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:55.206 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:55.206 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 100.58246329399999, 2024-04-25T22:41:55.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:55.206 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:55.206 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:55.206 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:55.206 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:55.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:55.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:55.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.206 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.207 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:55.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:55.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.207 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:55.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:55.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:55.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.207 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:55.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:55.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:55.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.208 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:55.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:55.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:55.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.208 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:55.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:55.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:55.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.208 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:55.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:55.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:55.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:55.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:55.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:55.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:55.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:55.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:55.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:55.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:55.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:55.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:55.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:55.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:55.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:55.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:55.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:55.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:55.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:55.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:55.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:55.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:55.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:55.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:55.211 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.211 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.212 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.212 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.212 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:55.212 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:55.212 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 100.582394208, 2024-04-25T22:41:55.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:55.212 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:55.212 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:55.212 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:55.212 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:55.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.212 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:55.212 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:55.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:55.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:55.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:55.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:55.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:55.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:55.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:55.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:55.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.214 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:55.214 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:55.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:55.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.214 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:55.214 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:55.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:55.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.214 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:55.215 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:55.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.215 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:55.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:55.215 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:55.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.215 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:55.215 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:55.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:55.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:55.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:55.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:55.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:55.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:55.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:55.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:55.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:55.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.217 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:55.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:55.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:55.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.217 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:55.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:55.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:55.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.217 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:55.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:55.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:55.217 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.218 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.218 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.218 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:55.218 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:55.218 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 100.582298095, 2024-04-25T22:41:55.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:55.218 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:55.218 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:55.218 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:55.218 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:55.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:55.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:55.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:55.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:55.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:55.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:55.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:55.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:55.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:55.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:55.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:55.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:55.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:55.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:55.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:55.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:55.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.221 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:55.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:55.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.221 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:55.221 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:55.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:55.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.221 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.221 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:55.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:55.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.221 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:55.222 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:55.222 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:55.222 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.222 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:55.222 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:55.222 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:55.222 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.222 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.222 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.222 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.222 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:55.222 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:55.222 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 100.582232433, 2024-04-25T22:41:55.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:55.223 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:55.223 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:55.223 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:55.223 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:55.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:55.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:55.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:55.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:55.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:55.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:55.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:55.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:55.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:55.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:55.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:55.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:55.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:55.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:55.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:55.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:55.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:55.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:55.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:55.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:55.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:55.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:55.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:55.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:55.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:55.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:55.227 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.227 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.227 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:55.227 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:55.227 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:55.227 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.227 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.227 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.227 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.227 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.227 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:55.227 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:55.227 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 100.582163306, 2024-04-25T22:41:55.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:55.228 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:55.228 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:55.228 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:55.228 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:55.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:55.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:55.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:55.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:55.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:55.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:55.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:55.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:55.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:55.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:55.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:55.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:55.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:55.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:55.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:55.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:55.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:55.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:55.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:55.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:55.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:55.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:55.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:55.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:55.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:55.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:55.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:55.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:55.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:55.232 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.232 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.232 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.232 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:41:55.232 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:55.232 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 100.57134665, 2024-04-25T22:41:55.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070840260000000002, 2024-04-25T22:41:55.232 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:55.232 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:55.232 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:41:55.232 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:55.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:55.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:55.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:55.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607128+0000", 2024-04-25T22:41:55.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:55.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607129+0000", 2024-04-25T22:41:55.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:41:55.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:55.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607144+0000", 2024-04-25T22:41:55.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.56e-05 2024-04-25T22:41:55.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:55.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607183+0000", 2024-04-25T22:41:55.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8590000000000002e-05 2024-04-25T22:41:55.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:55.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607223+0000", 2024-04-25T22:41:55.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0259999999999997e-05 2024-04-25T22:41:55.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607435+0000", 2024-04-25T22:41:55.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021151500000000001 2024-04-25T22:41:55.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:55.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614212+0000", 2024-04-25T22:41:55.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067775350000000003 2024-04-25T22:41:55.235 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.235 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.235 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.235 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:28 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-04-25T22:41:55.236 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:55.236 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 100.55133000399999, 2024-04-25T22:41:55.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072742429999999997, 2024-04-25T22:41:55.236 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:55.236 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:55.236 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:55.236 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:55.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:55.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:55.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:55.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627145+0000", 2024-04-25T22:41:55.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:55.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627146+0000", 2024-04-25T22:41:55.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6000000000000002e-07 2024-04-25T22:41:55.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:55.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627154+0000", 2024-04-25T22:41:55.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6030000000000005e-06 2024-04-25T22:41:55.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:55.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627172+0000", 2024-04-25T22:41:55.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7350000000000002e-05 2024-04-25T22:41:55.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:55.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627186+0000", 2024-04-25T22:41:55.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.435e-05 2024-04-25T22:41:55.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628624+0000", 2024-04-25T22:41:55.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014375480000000001 2024-04-25T22:41:55.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:55.239 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.628667+0000", 2024-04-25T22:41:55.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2892999999999997e-05 2024-04-25T22:41:55.239 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:55.239 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634332+0000", 2024-04-25T22:41:55.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.005665013 2024-04-25T22:41:55.239 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:55.239 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.634419+0000", 2024-04-25T22:41:55.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7626000000000004e-05 2024-04-25T22:41:55.239 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.239 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.240 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.240 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-25T22:41:55.240 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:41:55.240 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.1833654469999999, 2024-04-25T22:41:55.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.02435211, 2024-04-25T22:41:55.240 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:55.240 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:55.240 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:55.240 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:55.240 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:55.240 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:55.240 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 5 2024-04-25T22:41:55.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.240 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:55.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:55.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:41:55.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:55.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:41:55.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:55.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995113+0000", 2024-04-25T22:41:55.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2760000000000001e-06 2024-04-25T22:41:55.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:55.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002825+0000", 2024-04-25T22:41:55.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077127000000000003 2024-04-25T22:41:55.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:55.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002852+0000", 2024-04-25T22:41:55.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6570000000000001e-05 2024-04-25T22:41:55.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:55.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002866+0000", 2024-04-25T22:41:55.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4144999999999999e-05 2024-04-25T22:41:55.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002947+0000", 2024-04-25T22:41:55.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0740000000000003e-05 2024-04-25T22:41:55.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:55.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.003049+0000", 2024-04-25T22:41:55.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101829 2024-04-25T22:41:55.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:55.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019091+0000", 2024-04-25T22:41:55.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016042638000000001 2024-04-25T22:41:55.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:55.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019227+0000", 2024-04-25T22:41:55.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000135826 2024-04-25T22:41:55.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:55.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019462+0000", 2024-04-25T22:41:55.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000234386 2024-04-25T22:41:55.244 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.244 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.244 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.245 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:59 4.3f 4:fd83cc12:::10000000232.00000000:head [write 0~1578] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-25T22:41:55.245 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:54.062283+0000", 2024-04-25T22:41:55.245 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.116191513, 2024-04-25T22:41:55.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0078795859999999992, 2024-04-25T22:41:55.245 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:55.245 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:55.245 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:55.245 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:55.245 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:55.245 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:55.245 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 59 2024-04-25T22:41:55.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.245 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:55.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:55.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.062283+0000", 2024-04-25T22:41:55.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:55.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.062283+0000", 2024-04-25T22:41:55.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:55.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.062286+0000", 2024-04-25T22:41:55.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0899999999999999e-06 2024-04-25T22:41:55.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:55.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.062297+0000", 2024-04-25T22:41:55.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1296e-05 2024-04-25T22:41:55.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:55.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.062324+0000", 2024-04-25T22:41:55.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6832999999999999e-05 2024-04-25T22:41:55.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:55.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.062342+0000", 2024-04-25T22:41:55.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8036000000000001e-05 2024-04-25T22:41:55.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.062477+0000", 2024-04-25T22:41:55.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013562900000000001 2024-04-25T22:41:55.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:55.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.062783+0000", 2024-04-25T22:41:55.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030587399999999998 2024-04-25T22:41:55.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:55.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.069933+0000", 2024-04-25T22:41:55.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071501919999999997 2024-04-25T22:41:55.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:55.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.070027+0000", 2024-04-25T22:41:55.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3919999999999995e-05 2024-04-25T22:41:55.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:55.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.070163+0000", 2024-04-25T22:41:55.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000135716 2024-04-25T22:41:55.249 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.249 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.249 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.250 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.250 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:60 4.28 4:14ce3b86:::10000000233.00000000:head [write 0~1557] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-25T22:41:55.250 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:54.063431+0000", 2024-04-25T22:41:55.250 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.1150438039999999, 2024-04-25T22:41:55.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073852780000000003, 2024-04-25T22:41:55.250 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:55.250 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:55.250 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:55.250 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:55.250 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:55.250 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:55.250 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 60 2024-04-25T22:41:55.250 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.251 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:55.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:55.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.063431+0000", 2024-04-25T22:41:55.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:55.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.063431+0000", 2024-04-25T22:41:55.251 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.251 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.251 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.251 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:55.251 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.063433+0000", 2024-04-25T22:41:55.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:55.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:55.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.063446+0000", 2024-04-25T22:41:55.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2058999999999999e-05 2024-04-25T22:41:55.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:55.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.063472+0000", 2024-04-25T22:41:55.252 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6616000000000001e-05 2024-04-25T22:41:55.252 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.252 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.252 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:55.252 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.063492+0000", 2024-04-25T22:41:55.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9763e-05 2024-04-25T22:41:55.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.063588+0000", 2024-04-25T22:41:55.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6314e-05 2024-04-25T22:41:55.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:55.253 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.063772+0000", 2024-04-25T22:41:55.253 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018367500000000001 2024-04-25T22:41:55.253 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.253 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.253 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:55.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.070627+0000", 2024-04-25T22:41:55.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0068555220000000002 2024-04-25T22:41:55.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:55.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.070702+0000", 2024-04-25T22:41:55.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4462000000000006e-05 2024-04-25T22:41:55.254 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.254 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.254 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:55.254 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.070816+0000", 2024-04-25T22:41:55.254 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011453 2024-04-25T22:41:55.254 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.255 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.255 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.255 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.255 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.255 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:77 4.30 e55/17 4:0c28cce1:::10000000244.00000000:head v 55'3, mlcod=55'1)", 2024-04-25T22:41:55.255 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:54.082279+0000", 2024-04-25T22:41:55.255 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.096196124, 2024-04-25T22:41:55.255 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0078144180000000001, 2024-04-25T22:41:55.255 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:55.255 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:55.255 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:55.255 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:55.255 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.255 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:55.255 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.082279+0000", 2024-04-25T22:41:55.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:55.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.082279+0000", 2024-04-25T22:41:55.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:55.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.082281+0000", 2024-04-25T22:41:55.256 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7060000000000001e-06 2024-04-25T22:41:55.256 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.256 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.256 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:55.256 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.082293+0000", 2024-04-25T22:41:55.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.295e-05 2024-04-25T22:41:55.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:55.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.082319+0000", 2024-04-25T22:41:55.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5102000000000001e-05 2024-04-25T22:41:55.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:55.257 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.082331+0000", 2024-04-25T22:41:55.257 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2754e-05 2024-04-25T22:41:55.257 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.257 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.257 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.082479+0000", 2024-04-25T22:41:55.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014768499999999999 2024-04-25T22:41:55.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:55.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.082519+0000", 2024-04-25T22:41:55.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9728999999999999e-05 2024-04-25T22:41:55.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:55.258 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.090002+0000", 2024-04-25T22:41:55.258 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074833979999999996 2024-04-25T22:41:55.258 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.258 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.258 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:55.259 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.090093+0000", 2024-04-25T22:41:55.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1094000000000006e-05 2024-04-25T22:41:55.259 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.259 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.259 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.259 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.259 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.259 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:277 4.12 4:48bacb2f:::1000000031c.00000000:head [write 0~455] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-25T22:41:55.259 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:54.335970+0000", 2024-04-25T22:41:55.259 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.84250464700000005, 2024-04-25T22:41:55.259 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0094207330000000006, 2024-04-25T22:41:55.259 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:55.259 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:55.259 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:55.259 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:55.260 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:55.260 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:55.260 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 277 2024-04-25T22:41:55.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.260 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:55.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:55.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.335970+0000", 2024-04-25T22:41:55.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.260 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.260 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:55.260 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.335970+0000", 2024-04-25T22:41:55.260 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.260 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:55.261 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.335973+0000", 2024-04-25T22:41:55.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3499999999999999e-06 2024-04-25T22:41:55.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:55.261 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.335984+0000", 2024-04-25T22:41:55.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.165e-05 2024-04-25T22:41:55.261 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.261 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.261 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:55.261 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.336015+0000", 2024-04-25T22:41:55.261 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1186000000000003e-05 2024-04-25T22:41:55.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:55.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.336034+0000", 2024-04-25T22:41:55.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8576e-05 2024-04-25T22:41:55.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.262 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.336141+0000", 2024-04-25T22:41:55.262 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000106797 2024-04-25T22:41:55.262 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.262 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.262 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:55.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.336390+0000", 2024-04-25T22:41:55.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00024891900000000001 2024-04-25T22:41:55.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:55.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.345179+0000", 2024-04-25T22:41:55.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0087893250000000006 2024-04-25T22:41:55.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.263 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.263 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:55.263 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.345266+0000", 2024-04-25T22:41:55.263 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7133999999999996e-05 2024-04-25T22:41:55.263 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.264 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:55.264 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.345391+0000", 2024-04-25T22:41:55.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012479599999999999 2024-04-25T22:41:55.264 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.264 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.264 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.264 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.264 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.264 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:278 4.6 4:62248761:::1000000031d.00000000:head [write 0~171] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-25T22:41:55.264 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:54.337385+0000", 2024-04-25T22:41:55.264 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.84109038199999997, 2024-04-25T22:41:55.264 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091701739999999997, 2024-04-25T22:41:55.265 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:55.265 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:55.265 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:55.265 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:55.265 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:55.265 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:55.265 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 278 2024-04-25T22:41:55.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.265 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:55.265 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.265 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:55.265 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.337385+0000", 2024-04-25T22:41:55.265 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.265 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:55.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.337385+0000", 2024-04-25T22:41:55.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:55.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.337387+0000", 2024-04-25T22:41:55.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:41:55.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.266 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.266 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:55.266 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.337399+0000", 2024-04-25T22:41:55.266 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2126999999999999e-05 2024-04-25T22:41:55.266 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.267 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:55.267 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.337429+0000", 2024-04-25T22:41:55.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0479000000000001e-05 2024-04-25T22:41:55.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.267 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:55.267 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.337448+0000", 2024-04-25T22:41:55.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8304999999999998e-05 2024-04-25T22:41:55.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.267 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.267 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.267 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.337584+0000", 2024-04-25T22:41:55.267 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013653600000000001 2024-04-25T22:41:55.267 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.268 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:55.268 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.337929+0000", 2024-04-25T22:41:55.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00034445999999999999 2024-04-25T22:41:55.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.268 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:55.268 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.346362+0000", 2024-04-25T22:41:55.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0084329360000000003 2024-04-25T22:41:55.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.268 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.268 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:55.268 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.346438+0000", 2024-04-25T22:41:55.268 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6594999999999994e-05 2024-04-25T22:41:55.268 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.269 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:55.269 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.346555+0000", 2024-04-25T22:41:55.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000116443 2024-04-25T22:41:55.269 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.269 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.269 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.269 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.269 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.269 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:279 4.3f 4:fc75d1f7:::1000000031e.00000000:head [write 0~1763] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-25T22:41:55.269 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:54.338771+0000", 2024-04-25T22:41:55.269 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.83970384300000001, 2024-04-25T22:41:55.269 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073553070000000002, 2024-04-25T22:41:55.269 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:55.269 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:55.269 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:55.270 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:55.270 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:55.270 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:55.270 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 279 2024-04-25T22:41:55.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.270 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:55.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:55.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.338771+0000", 2024-04-25T22:41:55.270 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.270 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.270 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.270 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:55.270 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.338771+0000", 2024-04-25T22:41:55.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:55.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.338773+0000", 2024-04-25T22:41:55.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4030000000000001e-06 2024-04-25T22:41:55.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:55.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.338786+0000", 2024-04-25T22:41:55.271 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2391999999999999e-05 2024-04-25T22:41:55.271 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.271 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.271 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:55.271 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.338817+0000", 2024-04-25T22:41:55.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0676000000000002e-05 2024-04-25T22:41:55.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.272 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:55.272 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.338832+0000", 2024-04-25T22:41:55.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4993e-05 2024-04-25T22:41:55.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.272 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.272 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.338937+0000", 2024-04-25T22:41:55.272 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010505699999999999 2024-04-25T22:41:55.272 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.272 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.272 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:55.272 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.339209+0000", 2024-04-25T22:41:55.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027210199999999998 2024-04-25T22:41:55.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:55.273 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.345769+0000", 2024-04-25T22:41:55.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006560242 2024-04-25T22:41:55.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:55.273 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.345925+0000", 2024-04-25T22:41:55.273 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015622499999999999 2024-04-25T22:41:55.273 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.273 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.273 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:55.273 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.346126+0000", 2024-04-25T22:41:55.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020121700000000001 2024-04-25T22:41:55.274 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.274 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.274 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.274 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.274 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.274 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:732 4.3a e56/17 4:5ca2d296:::1000000054c.00000000:head v 56'10, mlcod=56'8)", 2024-04-25T22:41:55.274 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:54.988086+0000", 2024-04-25T22:41:55.274 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.19038843699999999, 2024-04-25T22:41:55.274 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070951240000000004, 2024-04-25T22:41:55.274 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:55.274 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:55.274 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:55.274 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:55.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:55.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.988086+0000", 2024-04-25T22:41:55.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:55.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.988086+0000", 2024-04-25T22:41:55.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.275 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.275 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:55.275 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.988088+0000", 2024-04-25T22:41:55.275 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.73e-06 2024-04-25T22:41:55.275 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:55.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.988105+0000", 2024-04-25T22:41:55.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6336000000000001e-05 2024-04-25T22:41:55.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:55.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.988130+0000", 2024-04-25T22:41:55.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5758999999999999e-05 2024-04-25T22:41:55.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.276 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.276 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:55.276 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.988143+0000", 2024-04-25T22:41:55.276 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.22e-05 2024-04-25T22:41:55.276 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.988284+0000", 2024-04-25T22:41:55.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000141612 2024-04-25T22:41:55.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:55.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.988321+0000", 2024-04-25T22:41:55.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.7138999999999998e-05 2024-04-25T22:41:55.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.277 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.277 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:55.277 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.995127+0000", 2024-04-25T22:41:55.277 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0068054539999999998 2024-04-25T22:41:55.277 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.278 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.278 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:55.278 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.995182+0000", 2024-04-25T22:41:55.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4894e-05 2024-04-25T22:41:55.278 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.278 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.278 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.278 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.278 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.278 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:736 4.23 4:c77a9099:::10000000550.00000000:head [write 0~2117] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-25T22:41:55.278 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:54.990688+0000", 2024-04-25T22:41:55.278 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.18778693399999999, 2024-04-25T22:41:55.278 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0075942539999999999, 2024-04-25T22:41:55.278 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:55.278 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:55.279 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:55.279 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:55.279 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:55.279 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:55.279 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 736 2024-04-25T22:41:55.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.279 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:55.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.279 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:55.279 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.990688+0000", 2024-04-25T22:41:55.279 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.279 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.279 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.279 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:55.279 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.990688+0000", 2024-04-25T22:41:55.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:55.280 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.280 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.280 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:55.280 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.990689+0000", 2024-04-25T22:41:55.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.22e-06 2024-04-25T22:41:55.280 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.280 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.280 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:55.280 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.990705+0000", 2024-04-25T22:41:55.280 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5917999999999999e-05 2024-04-25T22:41:55.280 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.280 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.280 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:55.280 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.990715+0000", 2024-04-25T22:41:55.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4979999999999995e-06 2024-04-25T22:41:55.281 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.281 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:55.281 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.990720+0000", 2024-04-25T22:41:55.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.057e-06 2024-04-25T22:41:55.281 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.281 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:55.281 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.990797+0000", 2024-04-25T22:41:55.281 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6966999999999997e-05 2024-04-25T22:41:55.281 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.281 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.281 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:55.281 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.991021+0000", 2024-04-25T22:41:55.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000224253 2024-04-25T22:41:55.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:55.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.998065+0000", 2024-04-25T22:41:55.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070439710000000004 2024-04-25T22:41:55.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:55.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.998153+0000", 2024-04-25T22:41:55.282 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7923999999999994e-05 2024-04-25T22:41:55.282 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:55.282 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:55.282 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:55.282 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.998282+0000", 2024-04-25T22:41:55.283 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012944599999999999 2024-04-25T22:41:55.283 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.283 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.283 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.283 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:55.283 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:55.283 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:55.285 INFO:teuthology.orchestra.run.smithi057.stderr:set osd.0 primary-affinity to 0 (802) 2024-04-25T22:41:55.285 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:55.279+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:55.285 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:55.385 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:55.384+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:55.424 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:55.424 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:55.424 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:41:55.424 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:55.440 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:55.480 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:41:55.486 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:55.479+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:55.587 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:55.583+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:55.612 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:55.612 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:55.612 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:55.612 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:55.612 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:55.628 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:55.629 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:55.630 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:55.630 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:41:55.654 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:55.654 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:55.657 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:41:55.658 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:41:55.688 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:55.683+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:55.760 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:55.760 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:55.778 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:55.826 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:55.823+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:55.889 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:55.888+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:55.916 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:55.916 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:55.933 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:56.018 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:56.015+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:56.091 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:56.088+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:56.102 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:56.102 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:56.118 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:56.210 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:56.207+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:56.239 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:41:56.293 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:56.292+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:56.316 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:56.317 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:56.333 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:56.393 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:56.392+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:56.468 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:56.468 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:56.485 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:56.529 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:56.528+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:56.595 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:56.592+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:56.654 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:56.654 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:56.669 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:56.696 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:56.691+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:56.798 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:56.791+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:56.846 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:56.846 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:56.862 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:56.910 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:56.907+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:56.999 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:56.996+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:57.005 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:57.005 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:57.021 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:57.110 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:57.107+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:57.198 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:57.198 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:57.200 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:57.195+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:57.213 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:57.275 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is unset 2024-04-25T22:41:57.301 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:57.300+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:57.388 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:57.388 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:57.402 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:57.395+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:57.403 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:57.503 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:57.500+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:57.537 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:57.538 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:57.552 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:57.637 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:57.636+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:57.659 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:41:57.704 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:57.700+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:57.728 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:41:57.728 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:41:57.744 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:57.819 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:41:57.819 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:41:57.820 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:41:57.833 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:57.832+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:57.846 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:41:57.846 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:41:57.849 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:41:57.850 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:41:57.906 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:57.903+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:57.930 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:41:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:41:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:41:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.33274755799999, 2024-04-25T22:41:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:41:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:41:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:41:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:41:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:41:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:41:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:41:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:41:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:41:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:41:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:41:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:41:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:41:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:41:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:41:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:41:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:41:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:41:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:41:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:41:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:41:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:41:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:41:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:41:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:41:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:41:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:41:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.332659545, 2024-04-25T22:41:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:41:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:41:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:41:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:41:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:41:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:41:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:41:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:41:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:41:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:41:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:41:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:41:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:41:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:41:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:41:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:41:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:41:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:41:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:41:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:41:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:41:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:41:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:41:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:41:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:41:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.33258742300001, 2024-04-25T22:41:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:41:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:41:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:41:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:41:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:41:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:41:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:41:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:41:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:41:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:41:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:41:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:41:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:41:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:41:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:41:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:41:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:41:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:41:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:41:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:41:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:41:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:41:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:41:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:41:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:41:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:41:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:41:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.33247910999999, 2024-04-25T22:41:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:41:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:41:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:41:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:41:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:41:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:41:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:41:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:41:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:41:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:41:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:41:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:41:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:41:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:41:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:41:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:41:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:41:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:41:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:41:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:41:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:41:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.33241245400001, 2024-04-25T22:41:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:41:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:41:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:41:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:41:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:41:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:41:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:41:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:41:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:41:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:41:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:41:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:41:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:41:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:41:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:41:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:41:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:41:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:41:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:41:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:41:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:41:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:41:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:41:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:41:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:41:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:41:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:41:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.332321858, 2024-04-25T22:41:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:41:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:41:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:41:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:41:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:41:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:41:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:41:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:41:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:41:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:41:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:41:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:41:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:41:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:41:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:41:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:41:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:41:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:41:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:41:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:41:57.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:41:57.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:57.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:41:57.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:41:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:41:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:41:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:41:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:41:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.332257285, 2024-04-25T22:41:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:41:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:41:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:41:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:41:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:41:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:41:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:41:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:41:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:41:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:41:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:41:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:41:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:41:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:41:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:41:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:41:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:41:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:41:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:41:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:41:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:41:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:41:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:41:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:41:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:41:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:41:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:57.985 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:57.985 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:57.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.985 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:57.985 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:57.985 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.332191862, 2024-04-25T22:41:57.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:41:57.985 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:57.985 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:57.985 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:57.985 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:57.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:57.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:57.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:57.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:57.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:57.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:57.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:57.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:41:57.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:57.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:57.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:41:57.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:41:57.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:57.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:41:57.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:41:57.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:57.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:41:57.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:41:57.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:57.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:41:57.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:41:57.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:57.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:41:57.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:41:57.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:57.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:41:57.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:41:57.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:57.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:41:57.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:41:57.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:57.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:41:57.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:41:57.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:57.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:41:57.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:41:57.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:57.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:41:57.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:41:57.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:57.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:41:57.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:41:57.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:57.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:41:57.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:41:57.993 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:57.994 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:57.994 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:57.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.994 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:57.994 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:57.994 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.332135796, 2024-04-25T22:41:57.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:41:57.994 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:57.994 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:57.994 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:57.994 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:57.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:57.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:57.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:57.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:57.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:57.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:57.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:57.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:57.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:41:57.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:57.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:41:57.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:41:57.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:57.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:41:57.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:41:57.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:57.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:41:57.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:41:57.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:57.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:41:57.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:41:57.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:57.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:41:57.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:41:57.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:57.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:41:57.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:41:57.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:57.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:41:57.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:41:57.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:57.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:41:57.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:41:57.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:57.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:41:57.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:41:57.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:57.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:57.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:57.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:41:57.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:41:57.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:58.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:41:58.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:41:58.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:58.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:41:58.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:41:58.000 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.000 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:58.002 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.003 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:58.003 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:58.003 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.33206869, 2024-04-25T22:41:58.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:41:58.003 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:58.003 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:58.003 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.003 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:58.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:58.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:58.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:58.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:58.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:58.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:41:58.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:41:58.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:58.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:41:58.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:41:58.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:58.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:41:58.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:41:58.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:41:58.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:41:58.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:41:58.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:41:58.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:58.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:41:58.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:41:58.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:41:58.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:41:58.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:58.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:41:58.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:41:58.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:58.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:41:58.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:41:58.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:58.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:41:58.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:41:58.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:58.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:41:58.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:41:58.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:58.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:41:58.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:41:58.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:58.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:41:58.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:41:58.010 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.010 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:58.010 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.010 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:58.010 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:58.010 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.332013567, 2024-04-25T22:41:58.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:41:58.010 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:58.010 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:58.010 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.010 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:58.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:58.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:58.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:58.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:58.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:58.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:41:58.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:58.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:58.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:41:58.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:41:58.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:58.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:41:58.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:41:58.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:41:58.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:41:58.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:41:58.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:41:58.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:58.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:41:58.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:41:58.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:41:58.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:41:58.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:58.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:41:58.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:41:58.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:58.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:41:58.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:41:58.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:58.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:41:58.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:41:58.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:58.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:41:58.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:41:58.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:58.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:41:58.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:41:58.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:58.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:41:58.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:41:58.016 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.016 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:58.016 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.016 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:58.016 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:58.017 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.331911328, 2024-04-25T22:41:58.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:41:58.017 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:58.017 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:58.017 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.017 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:58.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:58.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:58.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:58.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:58.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:58.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:41:58.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:41:58.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:58.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:41:58.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:41:58.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:58.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:41:58.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:41:58.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:41:58.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:41:58.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:41:58.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:41:58.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:58.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:41:58.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:41:58.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:41:58.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:41:58.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:58.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:41:58.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:41:58.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:58.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:41:58.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:41:58.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:58.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:41:58.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:41:58.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:58.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:41:58.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:41:58.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:58.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:41:58.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:41:58.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:58.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:41:58.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:41:58.022 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.023 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:58.023 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.023 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:58.023 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:58.023 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.331852505, 2024-04-25T22:41:58.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:41:58.023 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:58.023 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:58.023 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.023 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:58.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:58.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:58.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:58.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:58.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:58.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:41:58.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:41:58.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:58.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:41:58.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:41:58.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:58.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:41:58.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:41:58.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:41:58.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:41:58.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:41:58.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:41:58.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:58.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:41:58.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:41:58.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:41:58.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:41:58.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:58.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:41:58.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:41:58.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:58.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:41:58.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:41:58.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:58.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:41:58.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:41:58.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:58.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:41:58.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:41:58.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:58.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:41:58.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:41:58.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:58.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:41:58.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:41:58.029 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.029 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:58.029 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.029 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:58.029 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:58.029 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.33177377200001, 2024-04-25T22:41:58.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:41:58.029 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:58.029 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:58.029 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.029 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:58.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:58.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:58.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:58.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:58.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:58.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:41:58.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:58.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:58.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:41:58.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:41:58.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:58.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:41:58.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:41:58.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:41:58.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:41:58.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:41:58.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:41:58.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:58.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:41:58.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:41:58.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:41:58.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:41:58.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:58.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:41:58.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:41:58.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:58.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:41:58.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:41:58.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:58.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:41:58.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:41:58.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:58.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:41:58.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:41:58.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:58.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:41:58.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:41:58.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:58.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:41:58.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:41:58.035 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.035 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:58.035 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.035 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.331734359, 2024-04-25T22:41:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:41:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:41:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:41:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:41:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:41:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:41:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:41:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:41:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:41:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:41:58.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:41:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:41:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:41:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:41:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:41:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:58.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:41:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:41:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:41:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:41:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:41:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:41:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:41:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:41:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:41:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:41:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:58.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:41:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:41:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.33166451300001, 2024-04-25T22:41:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:41:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.042 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:58.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:58.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:58.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:58.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:58.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:58.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:41:58.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:41:58.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:58.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:41:58.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:41:58.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:58.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:41:58.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:41:58.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:41:58.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:41:58.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:41:58.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:41:58.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:58.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:41:58.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:41:58.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:41:58.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:41:58.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:58.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:41:58.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:41:58.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:58.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:41:58.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:41:58.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:58.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:41:58.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:41:58.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:58.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:41:58.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:41:58.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:58.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:41:58.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:41:58.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:58.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:41:58.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:41:58.048 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.048 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:58.048 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.049 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:58.049 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:58.049 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.331614776, 2024-04-25T22:41:58.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:41:58.049 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:58.049 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:58.049 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.049 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:58.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:58.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:58.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:58.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:58.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:58.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:41:58.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:58.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:58.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:41:58.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:41:58.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:58.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:41:58.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:41:58.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:41:58.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:41:58.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:41:58.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:41:58.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:58.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:41:58.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:41:58.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:41:58.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:41:58.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:58.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:41:58.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:41:58.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:58.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:41:58.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:41:58.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:58.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:41:58.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:41:58.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:58.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:41:58.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:41:58.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:58.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:58.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:41:58.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:58.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:41:58.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:41:58.057 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.057 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:58.057 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.057 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:58.059 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:58.059 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.331530161, 2024-04-25T22:41:58.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:41:58.059 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:58.059 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:58.059 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.060 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:58.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:58.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:58.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:58.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:58.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:58.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:41:58.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:58.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:58.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:41:58.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:41:58.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:58.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:41:58.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:41:58.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:41:58.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:41:58.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:41:58.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:41:58.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:58.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:41:58.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:41:58.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:41:58.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:41:58.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:58.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:41:58.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:41:58.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:58.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:41:58.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:41:58.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:58.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:41:58.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:41:58.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:58.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:41:58.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:41:58.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:58.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:41:58.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:41:58.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:58.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:41:58.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:41:58.065 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.065 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:58.065 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.066 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:58.066 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:58.066 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.331466511, 2024-04-25T22:41:58.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:41:58.066 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:58.066 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:58.066 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:41:58.066 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:58.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:58.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:58.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:58.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:58.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:58.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:41:58.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:41:58.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:58.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:41:58.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:41:58.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:58.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:41:58.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:41:58.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:41:58.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:41:58.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:41:58.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:41:58.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:58.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:41:58.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:41:58.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:41:58.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:41:58.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:58.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:41:58.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:41:58.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:58.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:41:58.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:41:58.070 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.070 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:58.070 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.071 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:58.071 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:58.071 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 103.324462981, 2024-04-25T22:41:58.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:41:58.071 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:58.071 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:58.071 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.071 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:58.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:58.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:58.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:58.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:58.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:58.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:58.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:41:58.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:41:58.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:58.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:41:58.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:41:58.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:58.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:41:58.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:41:58.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:41:58.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:41:58.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:58.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:41:58.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:41:58.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:58.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:41:58.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:41:58.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:58.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:41:58.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:41:58.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:58.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:58.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:58.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:41:58.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:41:58.074 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.074 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:58.075 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.075 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:58.075 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:58.075 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:58.076 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:58.077 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:58.071+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:58.177 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:58.171+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:58.224 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:58.224 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:58.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.224 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:3225 4.7 4:e3fb56f9:::10000000ffd.00000000:head [write 0~20190 in=20190b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-25T22:41:58.224 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:58.217484+0000", 2024-04-25T22:41:58.224 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0067210799999999999, 2024-04-25T22:41:58.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067654789999999996, 2024-04-25T22:41:58.225 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.225 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.225 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.225 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:58.225 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:58.225 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:58.225 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 3225 2024-04-25T22:41:58.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.225 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.217484+0000", 2024-04-25T22:41:58.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.217484+0000", 2024-04-25T22:41:58.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.217487+0000", 2024-04-25T22:41:58.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6199999999999999e-06 2024-04-25T22:41:58.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.217521+0000", 2024-04-25T22:41:58.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.3828999999999997e-05 2024-04-25T22:41:58.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.227 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.227 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.227 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.217550+0000", 2024-04-25T22:41:58.227 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9856e-05 2024-04-25T22:41:58.227 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.227 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.217567+0000", 2024-04-25T22:41:58.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6733000000000001e-05 2024-04-25T22:41:58.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.217641+0000", 2024-04-25T22:41:58.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4023000000000006e-05 2024-04-25T22:41:58.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.217826+0000", 2024-04-25T22:41:58.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000184709 2024-04-25T22:41:58.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:58.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.223954+0000", 2024-04-25T22:41:58.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0061277939999999998 2024-04-25T22:41:58.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:58.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.224130+0000", 2024-04-25T22:41:58.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000176348 2024-04-25T22:41:58.229 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.229 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.229 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.230 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:3227 4.7 4:e3cf56d2:::10000000fff.00000000:head [write 0~1427 in=1427b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-25T22:41:58.230 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:58.219270+0000", 2024-04-25T22:41:58.230 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0049349179999999999, 2024-04-25T22:41:58.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0051218390000000004, 2024-04-25T22:41:58.230 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.230 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.230 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:58.230 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:58.230 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:58.230 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:58.230 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 3227 2024-04-25T22:41:58.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.230 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.219270+0000", 2024-04-25T22:41:58.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.219270+0000", 2024-04-25T22:41:58.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.219271+0000", 2024-04-25T22:41:58.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:41:58.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.219281+0000", 2024-04-25T22:41:58.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8679999999999994e-06 2024-04-25T22:41:58.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.219295+0000", 2024-04-25T22:41:58.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.436e-05 2024-04-25T22:41:58.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.219303+0000", 2024-04-25T22:41:58.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0700000000000007e-06 2024-04-25T22:41:58.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.219475+0000", 2024-04-25T22:41:58.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017198300000000001 2024-04-25T22:41:58.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.219773+0000", 2024-04-25T22:41:58.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029799900000000002 2024-04-25T22:41:58.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:58.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.224402+0000", 2024-04-25T22:41:58.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046284530000000003 2024-04-25T22:41:58.233 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.234 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.234 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.234 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:3228 4.1e 4:7a7069c6:::10000001000.00000000:head [write 0~2333 in=2333b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-25T22:41:58.234 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:58.220187+0000", 2024-04-25T22:41:58.234 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0040178990000000001, 2024-04-25T22:41:58.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0043345629999999996, 2024-04-25T22:41:58.234 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.234 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.234 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:41:58.234 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:58.234 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:58.234 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:58.235 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 3228 2024-04-25T22:41:58.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.235 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.220187+0000", 2024-04-25T22:41:58.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.220187+0000", 2024-04-25T22:41:58.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.220188+0000", 2024-04-25T22:41:58.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4399999999999999e-07 2024-04-25T22:41:58.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.220199+0000", 2024-04-25T22:41:58.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0817e-05 2024-04-25T22:41:58.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.220216+0000", 2024-04-25T22:41:58.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.717e-05 2024-04-25T22:41:58.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.239 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.220226+0000", 2024-04-25T22:41:58.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0156999999999999e-05 2024-04-25T22:41:58.239 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.239 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.220370+0000", 2024-04-25T22:41:58.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000143237 2024-04-25T22:41:58.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.220827+0000", 2024-04-25T22:41:58.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00045737799999999998 2024-04-25T22:41:58.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:58.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.221057+0000", 2024-04-25T22:41:58.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000229786 2024-04-25T22:41:58.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:58.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.223688+0000", 2024-04-25T22:41:58.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0026314039999999999 2024-04-25T22:41:58.241 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.241 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.241 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.241 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:3230 4.16 4:69cf6bb4:::10000001002.00000000:head [write 0~1437 in=1437b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-25T22:41:58.241 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:58.222004+0000", 2024-04-25T22:41:58.242 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0022008940000000001, 2024-04-25T22:41:58.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0026709920000000001, 2024-04-25T22:41:58.242 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.242 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.242 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:41:58.242 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:58.242 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:58.242 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:58.242 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 3230 2024-04-25T22:41:58.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.242 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.222004+0000", 2024-04-25T22:41:58.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.222004+0000", 2024-04-25T22:41:58.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.222006+0000", 2024-04-25T22:41:58.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9130000000000001e-06 2024-04-25T22:41:58.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.222019+0000", 2024-04-25T22:41:58.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2500000000000001e-05 2024-04-25T22:41:58.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.222043+0000", 2024-04-25T22:41:58.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4428999999999999e-05 2024-04-25T22:41:58.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.222059+0000", 2024-04-25T22:41:58.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5863e-05 2024-04-25T22:41:58.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.222131+0000", 2024-04-25T22:41:58.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1978999999999996e-05 2024-04-25T22:41:58.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.222265+0000", 2024-04-25T22:41:58.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000134394 2024-04-25T22:41:58.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:58.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.222421+0000", 2024-04-25T22:41:58.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015528800000000001 2024-04-25T22:41:58.245 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.245 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.246 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.246 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:3231 4.b 4:d252853d:::10000001003.00000000:head [write 0~30029 in=30029b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-25T22:41:58.246 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:58.223268+0000", 2024-04-25T22:41:58.246 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.00093750500000000004, 2024-04-25T22:41:58.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0014819189999999999, 2024-04-25T22:41:58.246 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.246 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.246 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:41:58.246 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:58.246 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:58.246 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:58.246 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 3231 2024-04-25T22:41:58.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.247 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.223268+0000", 2024-04-25T22:41:58.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.223268+0000", 2024-04-25T22:41:58.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.223270+0000", 2024-04-25T22:41:58.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0540000000000002e-06 2024-04-25T22:41:58.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.223317+0000", 2024-04-25T22:41:58.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7528999999999998e-05 2024-04-25T22:41:58.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.223357+0000", 2024-04-25T22:41:58.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9925000000000001e-05 2024-04-25T22:41:58.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.223373+0000", 2024-04-25T22:41:58.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5792999999999999e-05 2024-04-25T22:41:58.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.223452+0000", 2024-04-25T22:41:58.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8467999999999995e-05 2024-04-25T22:41:58.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.223602+0000", 2024-04-25T22:41:58.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015040799999999999 2024-04-25T22:41:58.249 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.249 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.249 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:58.250 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.223746+0000", 2024-04-25T22:41:58.250 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014448799999999999 2024-04-25T22:41:58.250 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.250 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.250 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.250 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.250 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-25T22:41:58.250 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 5 2024-04-25T22:41:58.250 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:58.251 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:58.294 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:58.291+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:58.379 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:58.375+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:58.423 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:58.423 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:58.423 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:58.423 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:58.423 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:58.438 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:58.482 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:58.479+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:58.580 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:58.575+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:58.617 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:58.617 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:58.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:58.617 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:58.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.617 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:58.617 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:58.618 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 104.01809497399999, 2024-04-25T22:41:58.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:58.618 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.618 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.618 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.618 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:58.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:58.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:58.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:58.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:58.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:58.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:58.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:58.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:58.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:58.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:58.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:58.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:58.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:58.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:58.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:58.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:58.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:58.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:58.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:58.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:58.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:58.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:58.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:58.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:58.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:58.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:58.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:58.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.623 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:58.623 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:58.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:58.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.623 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:58.623 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:58.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:58.623 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.623 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.623 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.623 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:58.624 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:58.624 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 104.01795771800001, 2024-04-25T22:41:58.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:58.624 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.624 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.624 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.624 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:58.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:58.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:58.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:58.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:58.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:58.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.626 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:58.626 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:58.626 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.626 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.626 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.626 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:58.626 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:58.626 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.626 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.626 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.626 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:58.626 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:58.626 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.626 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.627 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:58.627 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:58.627 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:58.627 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.627 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.627 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.627 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:58.627 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:58.627 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.627 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.627 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.627 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:58.627 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:58.627 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.627 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.628 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:58.628 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:58.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:58.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.628 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:58.628 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:58.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:58.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.628 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:58.628 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:58.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:58.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.629 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.629 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:58.629 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:58.629 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:58.629 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.629 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.629 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:58.629 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:58.629 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:58.629 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.629 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.629 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.629 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.629 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.629 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:58.630 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:58.630 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 104.01787016599999, 2024-04-25T22:41:58.630 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:58.630 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.630 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.630 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.630 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.630 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.630 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.630 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:58.630 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.630 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.630 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.631 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:58.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.631 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:58.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:58.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.631 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:58.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:58.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.632 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:58.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:58.632 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.632 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:58.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:58.632 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.632 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:58.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:58.632 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.633 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:58.633 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:58.633 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:58.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.633 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.633 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.633 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:58.633 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:58.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.633 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.633 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.633 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:58.633 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:58.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.634 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.634 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:58.634 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:58.634 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:58.634 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.634 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.634 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:58.634 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:58.634 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:58.634 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.634 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.634 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:58.635 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:58.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:58.635 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.635 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:58.635 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:58.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:58.635 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.635 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:58.635 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:58.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:58.635 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.636 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.636 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.636 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.636 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.636 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:58.636 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:58.636 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 104.01776633999999, 2024-04-25T22:41:58.636 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:58.636 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.636 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.636 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.636 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.636 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.636 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:58.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:58.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:58.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:58.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.638 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:58.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:58.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.638 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:58.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:58.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.638 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:58.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:58.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:58.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:58.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:58.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:58.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:58.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:58.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:58.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.640 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.640 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:58.640 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:58.640 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.640 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:58.640 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:58.640 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:58.640 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.640 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:58.640 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:58.640 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:58.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:58.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:58.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:58.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:58.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:58.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:58.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:58.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:58.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:58.642 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.642 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.642 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.642 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:58.642 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:58.642 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 104.01769754999999, 2024-04-25T22:41:58.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:58.642 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.642 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.642 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.642 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:58.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:58.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:58.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:58.644 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.644 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.644 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:58.644 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:58.644 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.644 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.644 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:58.644 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:58.644 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.644 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.644 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:58.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:58.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.645 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.645 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:58.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:58.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.645 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:58.645 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:58.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:58.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.646 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:58.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:58.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.646 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:58.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:58.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.646 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:58.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:58.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:58.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:58.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:58.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:58.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:58.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:58.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:58.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.650 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.650 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:58.650 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:58.650 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:58.650 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.650 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.650 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:58.650 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:58.650 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:58.650 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.651 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.651 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.651 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.651 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.651 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:58.651 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:58.651 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 104.017628464, 2024-04-25T22:41:58.651 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:58.651 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.651 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.651 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.651 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.651 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:58.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.652 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:58.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.652 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:58.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:58.652 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:58.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:58.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:58.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:58.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:58.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:58.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:58.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:58.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:58.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:58.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:58.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:58.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:58.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:58.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:58.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:58.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:58.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:58.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:58.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:58.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:58.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:58.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:58.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:58.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:58.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:58.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:58.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:58.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:58.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:58.657 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.657 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.657 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.657 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:58.657 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:58.657 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 104.017532351, 2024-04-25T22:41:58.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:58.657 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.657 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.657 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:58.657 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:58.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:58.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:58.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:58.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:58.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:58.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:58.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:58.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:58.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:58.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:58.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:58.660 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:58.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:58.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:58.660 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:58.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:58.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:58.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:58.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:58.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:58.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:58.661 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.661 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.661 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.662 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:58.662 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:58.662 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 104.017466689, 2024-04-25T22:41:58.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:58.662 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.662 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.662 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:58.662 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.662 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.662 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:58.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.663 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.663 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:58.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.663 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.663 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.663 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:58.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:58.663 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.663 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.663 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:58.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:58.664 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.664 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:58.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:58.664 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.664 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:58.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:58.664 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:58.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:58.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:58.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:58.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:58.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:58.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:58.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:58.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:58.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:58.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:58.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:58.666 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.666 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.666 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.666 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:58.667 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:58.667 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 104.017397562, 2024-04-25T22:41:58.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:58.667 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.667 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.667 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:58.667 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:58.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:58.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.668 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:58.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:58.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.668 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:58.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:58.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:58.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:58.669 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:58.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:58.669 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:58.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:58.669 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:58.670 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:58.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:58.670 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.670 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.670 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.670 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:58.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:58.670 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.670 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.670 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.670 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:58.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:58.670 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.670 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.670 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:58.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:58.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:58.671 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.671 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.671 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.671 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-25T22:41:58.671 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:41:58.671 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.6185997030000001, 2024-04-25T22:41:58.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.02435211, 2024-04-25T22:41:58.671 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.671 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.672 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.672 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:58.672 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:58.672 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:58.672 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 5 2024-04-25T22:41:58.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.672 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:41:58.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:41:58.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995113+0000", 2024-04-25T22:41:58.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2760000000000001e-06 2024-04-25T22:41:58.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002825+0000", 2024-04-25T22:41:58.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077127000000000003 2024-04-25T22:41:58.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002852+0000", 2024-04-25T22:41:58.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6570000000000001e-05 2024-04-25T22:41:58.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002866+0000", 2024-04-25T22:41:58.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4144999999999999e-05 2024-04-25T22:41:58.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002947+0000", 2024-04-25T22:41:58.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0740000000000003e-05 2024-04-25T22:41:58.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.675 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.003049+0000", 2024-04-25T22:41:58.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101829 2024-04-25T22:41:58.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.675 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:58.675 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019091+0000", 2024-04-25T22:41:58.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016042638000000001 2024-04-25T22:41:58.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.675 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:58.675 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019227+0000", 2024-04-25T22:41:58.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000135826 2024-04-25T22:41:58.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.676 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.676 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:58.676 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019462+0000", 2024-04-25T22:41:58.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000234386 2024-04-25T22:41:58.676 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.676 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.676 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.676 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.676 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.676 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:59 4.3f 4:fd83cc12:::10000000232.00000000:head [write 0~1578] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-25T22:41:58.676 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:54.062283+0000", 2024-04-25T22:41:58.676 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.5514257689999997, 2024-04-25T22:41:58.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0078795859999999992, 2024-04-25T22:41:58.676 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.677 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.677 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.677 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:58.677 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:58.677 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:58.677 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 59 2024-04-25T22:41:58.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.677 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.677 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.677 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.062283+0000", 2024-04-25T22:41:58.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.062283+0000", 2024-04-25T22:41:58.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.062286+0000", 2024-04-25T22:41:58.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0899999999999999e-06 2024-04-25T22:41:58.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.062297+0000", 2024-04-25T22:41:58.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1296e-05 2024-04-25T22:41:58.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.062324+0000", 2024-04-25T22:41:58.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6832999999999999e-05 2024-04-25T22:41:58.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.062342+0000", 2024-04-25T22:41:58.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8036000000000001e-05 2024-04-25T22:41:58.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.062477+0000", 2024-04-25T22:41:58.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013562900000000001 2024-04-25T22:41:58.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.062783+0000", 2024-04-25T22:41:58.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030587399999999998 2024-04-25T22:41:58.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:58.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.069933+0000", 2024-04-25T22:41:58.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071501919999999997 2024-04-25T22:41:58.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:58.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.070027+0000", 2024-04-25T22:41:58.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3919999999999995e-05 2024-04-25T22:41:58.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.681 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:58.681 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.070163+0000", 2024-04-25T22:41:58.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000135716 2024-04-25T22:41:58.681 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.681 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.681 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.681 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:77 4.30 e55/17 4:0c28cce1:::10000000244.00000000:head v 55'3, mlcod=55'1)", 2024-04-25T22:41:58.681 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:54.082279+0000", 2024-04-25T22:41:58.681 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.5314303799999998, 2024-04-25T22:41:58.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0078144180000000001, 2024-04-25T22:41:58.681 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.681 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.682 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.682 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.082279+0000", 2024-04-25T22:41:58.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.082279+0000", 2024-04-25T22:41:58.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.082281+0000", 2024-04-25T22:41:58.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7060000000000001e-06 2024-04-25T22:41:58.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.683 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.082293+0000", 2024-04-25T22:41:58.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.295e-05 2024-04-25T22:41:58.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.683 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.082319+0000", 2024-04-25T22:41:58.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5102000000000001e-05 2024-04-25T22:41:58.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.684 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.082331+0000", 2024-04-25T22:41:58.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2754e-05 2024-04-25T22:41:58.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.684 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.684 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.082479+0000", 2024-04-25T22:41:58.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014768499999999999 2024-04-25T22:41:58.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.684 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.684 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.082519+0000", 2024-04-25T22:41:58.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9728999999999999e-05 2024-04-25T22:41:58.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:58.685 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.090002+0000", 2024-04-25T22:41:58.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074833979999999996 2024-04-25T22:41:58.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:58.685 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.090093+0000", 2024-04-25T22:41:58.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1094000000000006e-05 2024-04-25T22:41:58.685 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.685 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.685 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.685 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:277 4.12 4:48bacb2f:::1000000031c.00000000:head [write 0~455] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-25T22:41:58.685 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:54.335970+0000", 2024-04-25T22:41:58.686 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.2777389030000004, 2024-04-25T22:41:58.686 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0094207330000000006, 2024-04-25T22:41:58.686 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.686 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.686 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.686 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:58.686 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:58.686 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:58.686 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 277 2024-04-25T22:41:58.686 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.686 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.686 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.686 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.686 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.335970+0000", 2024-04-25T22:41:58.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.335970+0000", 2024-04-25T22:41:58.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.335973+0000", 2024-04-25T22:41:58.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3499999999999999e-06 2024-04-25T22:41:58.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.335984+0000", 2024-04-25T22:41:58.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.165e-05 2024-04-25T22:41:58.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.336015+0000", 2024-04-25T22:41:58.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1186000000000003e-05 2024-04-25T22:41:58.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.336034+0000", 2024-04-25T22:41:58.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8576e-05 2024-04-25T22:41:58.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.336141+0000", 2024-04-25T22:41:58.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000106797 2024-04-25T22:41:58.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.336390+0000", 2024-04-25T22:41:58.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00024891900000000001 2024-04-25T22:41:58.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:58.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.345179+0000", 2024-04-25T22:41:58.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0087893250000000006 2024-04-25T22:41:58.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:58.690 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.345266+0000", 2024-04-25T22:41:58.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7133999999999996e-05 2024-04-25T22:41:58.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.690 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:58.690 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.345391+0000", 2024-04-25T22:41:58.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012479599999999999 2024-04-25T22:41:58.690 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.690 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.690 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.690 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:278 4.6 4:62248761:::1000000031d.00000000:head [write 0~171] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-25T22:41:58.690 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:54.337385+0000", 2024-04-25T22:41:58.690 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.2763246380000002, 2024-04-25T22:41:58.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091701739999999997, 2024-04-25T22:41:58.691 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.691 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.691 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.691 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:58.691 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:58.691 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:58.691 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 278 2024-04-25T22:41:58.691 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.691 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.691 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.691 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.691 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.337385+0000", 2024-04-25T22:41:58.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.692 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.337385+0000", 2024-04-25T22:41:58.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.692 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.337387+0000", 2024-04-25T22:41:58.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2929999999999999e-06 2024-04-25T22:41:58.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.692 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.337399+0000", 2024-04-25T22:41:58.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2126999999999999e-05 2024-04-25T22:41:58.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.337429+0000", 2024-04-25T22:41:58.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0479000000000001e-05 2024-04-25T22:41:58.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.337448+0000", 2024-04-25T22:41:58.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8304999999999998e-05 2024-04-25T22:41:58.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.337584+0000", 2024-04-25T22:41:58.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013653600000000001 2024-04-25T22:41:58.694 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.694 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.694 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.694 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.337929+0000", 2024-04-25T22:41:58.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00034445999999999999 2024-04-25T22:41:58.694 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.694 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.694 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:58.694 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.346362+0000", 2024-04-25T22:41:58.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0084329360000000003 2024-04-25T22:41:58.694 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.694 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.694 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:58.694 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.346438+0000", 2024-04-25T22:41:58.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6594999999999994e-05 2024-04-25T22:41:58.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.695 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:58.695 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.346555+0000", 2024-04-25T22:41:58.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000116443 2024-04-25T22:41:58.695 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.695 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.695 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.695 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:881 4.2b e56/17 4:d799a0d1:::100000005fd.00000000:head v 56'21, mlcod=56'19)", 2024-04-25T22:41:58.695 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:55.186254+0000", 2024-04-25T22:41:58.695 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 3.4274548029999998, 2024-04-25T22:41:58.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0079730979999999996, 2024-04-25T22:41:58.695 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.696 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.696 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.696 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.186254+0000", 2024-04-25T22:41:58.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.186254+0000", 2024-04-25T22:41:58.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.186256+0000", 2024-04-25T22:41:58.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.097e-06 2024-04-25T22:41:58.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.186282+0000", 2024-04-25T22:41:58.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5551999999999999e-05 2024-04-25T22:41:58.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.186311+0000", 2024-04-25T22:41:58.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8768999999999998e-05 2024-04-25T22:41:58.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.186329+0000", 2024-04-25T22:41:58.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.772e-05 2024-04-25T22:41:58.698 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.698 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.698 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.186460+0000", 2024-04-25T22:41:58.698 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013124600000000001 2024-04-25T22:41:58.698 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.698 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.698 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.186516+0000", 2024-04-25T22:41:58.698 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6518000000000003e-05 2024-04-25T22:41:58.698 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.698 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:58.698 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.194117+0000", 2024-04-25T22:41:58.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076010449999999999 2024-04-25T22:41:58.699 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.699 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.699 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:58.699 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.194227+0000", 2024-04-25T22:41:58.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000110151 2024-04-25T22:41:58.699 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.699 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.699 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.699 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.699 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.699 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:888 4.1c 4:3a29cf59:::10000000606.00000000:head [write 0~2590] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-25T22:41:58.699 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:55.196100+0000", 2024-04-25T22:41:58.699 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 3.4176096789999999, 2024-04-25T22:41:58.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0093686710000000003, 2024-04-25T22:41:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 888 2024-04-25T22:41:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.196100+0000", 2024-04-25T22:41:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.196100+0000", 2024-04-25T22:41:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.196102+0000", 2024-04-25T22:41:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6000000000000001e-06 2024-04-25T22:41:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.196114+0000", 2024-04-25T22:41:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1933000000000001e-05 2024-04-25T22:41:58.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.196145+0000", 2024-04-25T22:41:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0599000000000003e-05 2024-04-25T22:41:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.196167+0000", 2024-04-25T22:41:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2789000000000002e-05 2024-04-25T22:41:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.702 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.196268+0000", 2024-04-25T22:41:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000100734 2024-04-25T22:41:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.196495+0000", 2024-04-25T22:41:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022705699999999999 2024-04-25T22:41:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.205067+0000", 2024-04-25T22:41:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085715530000000009 2024-04-25T22:41:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.205239+0000", 2024-04-25T22:41:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000172072 2024-04-25T22:41:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.205468+0000", 2024-04-25T22:41:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022933400000000001 2024-04-25T22:41:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:898 4.7 4:e39c4c7a:::10000000614.00000000:head [write 0~136] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-25T22:41:58.704 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:55.212968+0000", 2024-04-25T22:41:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 3.4007415700000001, 2024-04-25T22:41:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0084531069999999996, 2024-04-25T22:41:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 898 2024-04-25T22:41:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.212968+0000", 2024-04-25T22:41:58.705 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.212968+0000", 2024-04-25T22:41:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.212970+0000", 2024-04-25T22:41:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.12e-06 2024-04-25T22:41:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.706 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.212980+0000", 2024-04-25T22:41:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0376e-05 2024-04-25T22:41:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.213009+0000", 2024-04-25T22:41:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8963e-05 2024-04-25T22:41:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.213026+0000", 2024-04-25T22:41:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7286e-05 2024-04-25T22:41:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.213156+0000", 2024-04-25T22:41:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012998600000000001 2024-04-25T22:41:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.213424+0000", 2024-04-25T22:41:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026733600000000002 2024-04-25T22:41:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.221139+0000", 2024-04-25T22:41:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077156550000000001 2024-04-25T22:41:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.221253+0000", 2024-04-25T22:41:58.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000113903 2024-04-25T22:41:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.221421+0000", 2024-04-25T22:41:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016748199999999999 2024-04-25T22:41:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:1042 4.2b e57/17 4:d4c5e0d3:::100000006d2.00000000:head v 57'24, mlcod=57'22)", 2024-04-25T22:41:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:55.441621+0000", 2024-04-25T22:41:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 3.1720882769999998, 2024-04-25T22:41:58.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082101440000000008, 2024-04-25T22:41:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.441621+0000", 2024-04-25T22:41:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.441621+0000", 2024-04-25T22:41:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.441622+0000", 2024-04-25T22:41:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5269999999999999e-06 2024-04-25T22:41:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.441639+0000", 2024-04-25T22:41:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6962000000000001e-05 2024-04-25T22:41:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.441661+0000", 2024-04-25T22:41:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1189999999999999e-05 2024-04-25T22:41:58.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.441673+0000", 2024-04-25T22:41:58.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2196e-05 2024-04-25T22:41:58.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.441783+0000", 2024-04-25T22:41:58.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011066299999999999 2024-04-25T22:41:58.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.441820+0000", 2024-04-25T22:41:58.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6429e-05 2024-04-25T22:41:58.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.713 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:58.713 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.449688+0000", 2024-04-25T22:41:58.713 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0078682909999999995 2024-04-25T22:41:58.713 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.713 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:58.713 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:55.449831+0000", 2024-04-25T22:41:58.713 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000142886 2024-04-25T22:41:58.713 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.713 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.713 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.713 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.713 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:3031 4.1c 4:3bdcaeb1:::10000000f2f.00000000:head [write 0~1680] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-25T22:41:58.713 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:57.978149+0000", 2024-04-25T22:41:58.714 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.63556017499999995, 2024-04-25T22:41:58.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0097710650000000007, 2024-04-25T22:41:58.714 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.714 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.714 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.714 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:58.714 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:58.714 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:58.714 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 3031 2024-04-25T22:41:58.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.714 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.714 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.714 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:57.978149+0000", 2024-04-25T22:41:58.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.715 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:57.978149+0000", 2024-04-25T22:41:58.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.715 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:57.978151+0000", 2024-04-25T22:41:58.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3829999999999999e-06 2024-04-25T22:41:58.715 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:57.978163+0000", 2024-04-25T22:41:58.716 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1556000000000001e-05 2024-04-25T22:41:58.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.716 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.716 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:57.978184+0000", 2024-04-25T22:41:58.716 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0593000000000001e-05 2024-04-25T22:41:58.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.716 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.716 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:57.978202+0000", 2024-04-25T22:41:58.716 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8416000000000001e-05 2024-04-25T22:41:58.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.716 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:57.978317+0000", 2024-04-25T22:41:58.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000114743 2024-04-25T22:41:58.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:57.978594+0000", 2024-04-25T22:41:58.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027745599999999998 2024-04-25T22:41:58.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:58.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:57.987724+0000", 2024-04-25T22:41:58.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091301170000000001 2024-04-25T22:41:58.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:58.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:57.987805+0000", 2024-04-25T22:41:58.718 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0983999999999996e-05 2024-04-25T22:41:58.718 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.718 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.718 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:58.718 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:57.987920+0000", 2024-04-25T22:41:58.718 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000114817 2024-04-25T22:41:58.718 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.718 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.718 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.718 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.718 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.718 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:3051 4.11 4:8afd8039:::10000000f44.00000000:head [write 0~672130] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-25T22:41:58.718 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:58.010431+0000", 2024-04-25T22:41:58.718 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.60327772099999999, 2024-04-25T22:41:58.718 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0098788299999999999, 2024-04-25T22:41:58.718 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:58.719 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:58.719 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:58.719 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:58.719 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:58.719 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:58.719 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 3051 2024-04-25T22:41:58.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.719 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:58.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:58.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.010431+0000", 2024-04-25T22:41:58.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:58.720 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.010431+0000", 2024-04-25T22:41:58.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:58.720 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.720 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:58.720 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.010433+0000", 2024-04-25T22:41:58.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.917e-06 2024-04-25T22:41:58.720 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.720 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:58.720 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.011298+0000", 2024-04-25T22:41:58.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00086448000000000004 2024-04-25T22:41:58.720 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:58.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.011337+0000", 2024-04-25T22:41:58.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9436e-05 2024-04-25T22:41:58.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:58.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.011352+0000", 2024-04-25T22:41:58.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4283e-05 2024-04-25T22:41:58.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:58.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.011499+0000", 2024-04-25T22:41:58.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014762600000000001 2024-04-25T22:41:58.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:58.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.011836+0000", 2024-04-25T22:41:58.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033716399999999999 2024-04-25T22:41:58.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:58.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.012205+0000", 2024-04-25T22:41:58.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036903000000000001 2024-04-25T22:41:58.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:58.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.016889+0000", 2024-04-25T22:41:58.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046833889999999996 2024-04-25T22:41:58.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.723 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:58.723 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.020023+0000", 2024-04-25T22:41:58.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031340830000000002 2024-04-25T22:41:58.723 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.723 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:58.723 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.020205+0000", 2024-04-25T22:41:58.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018249800000000001 2024-04-25T22:41:58.723 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:58.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:58.723 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:58.723 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:58.020310+0000", 2024-04-25T22:41:58.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000104924 2024-04-25T22:41:58.723 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.724 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.724 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.724 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:58.724 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:58.724 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:58.724 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~23s 2024-04-25T22:41:58.726 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:58.726 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:58.724+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:58.826 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:58.823+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:58.857 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:58.858 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:58.858 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:41:58.858 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:58.872 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:41:58.927 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:58.923+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:59.000 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:41:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:41:59.000 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:59.014 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:41:59.061 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:59.060+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:59.128 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:59.123+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:59.139 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:59.139 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:41:59.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:41:59.140 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:41:59.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.140 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.140 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:59.140 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.541032749, 2024-04-25T22:41:59.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:41:59.140 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:59.140 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:59.140 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.140 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:59.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:59.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:59.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:59.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:41:59.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:59.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:41:59.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:41:59.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:59.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:41:59.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:41:59.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:59.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:41:59.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:41:59.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:41:59.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:41:59.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:41:59.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:41:59.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:59.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:41:59.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:41:59.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:41:59.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:41:59.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:59.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:41:59.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:41:59.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:59.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:41:59.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:41:59.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:41:59.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:41:59.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:59.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:41:59.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:41:59.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:59.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:41:59.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:41:59.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:59.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:41:59.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:41:59.146 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.146 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.146 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.146 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.146 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:59.146 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.540944736, 2024-04-25T22:41:59.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:41:59.146 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:59.146 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:59.146 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.146 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:59.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:59.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:59.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:59.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:41:59.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:59.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:41:59.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:41:59.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:59.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:59.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:41:59.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:59.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:41:59.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:41:59.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:41:59.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:41:59.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:41:59.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:41:59.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:59.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:59.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:41:59.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:41:59.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:41:59.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:59.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:41:59.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:41:59.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:59.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:41:59.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:41:59.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:59.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:41:59.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:41:59.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:41:59.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:41:59.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:59.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:41:59.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:41:59.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:59.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:41:59.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:41:59.152 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.152 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.152 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.152 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.152 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:59.152 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.54087261399999, 2024-04-25T22:41:59.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:41:59.152 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:59.152 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:59.153 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.153 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:59.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:59.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:59.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:59.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:41:59.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:59.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:41:59.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:41:59.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:59.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:41:59.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:41:59.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:59.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:41:59.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:41:59.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:41:59.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:41:59.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:41:59.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:41:59.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:59.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:41:59.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:41:59.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:41:59.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:41:59.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:59.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:41:59.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:41:59.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:59.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:41:59.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:41:59.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:41:59.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:41:59.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:59.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:41:59.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:41:59.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:59.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:41:59.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:41:59.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:59.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:41:59.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:41:59.158 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.158 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.158 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.158 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.158 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:59.158 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.540764301, 2024-04-25T22:41:59.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:41:59.159 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:59.159 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:59.159 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.159 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:59.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:59.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:59.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:59.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:41:59.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:59.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:41:59.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:41:59.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:59.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:41:59.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:41:59.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:59.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:41:59.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:41:59.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:41:59.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:41:59.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:41:59.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:41:59.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:59.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:41:59.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:41:59.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:41:59.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:41:59.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:59.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:41:59.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:41:59.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:59.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:41:59.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:41:59.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:41:59.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:41:59.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:59.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:41:59.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:41:59.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:59.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:41:59.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:41:59.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:59.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:41:59.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:41:59.164 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.164 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.164 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.164 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.164 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:59.164 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.54069764499999, 2024-04-25T22:41:59.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:41:59.165 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:59.165 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:59.165 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.165 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:59.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:59.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:59.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:59.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:41:59.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:59.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:41:59.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:41:59.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:59.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:41:59.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:41:59.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:59.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:41:59.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:41:59.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:41:59.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:41:59.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:41:59.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:41:59.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:59.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:41:59.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:41:59.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:41:59.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:41:59.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:59.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:41:59.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:41:59.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:59.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:41:59.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:41:59.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:41:59.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:41:59.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:59.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:41:59.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:41:59.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:59.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:41:59.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:41:59.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:59.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:41:59.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:41:59.170 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.170 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.170 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.170 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.170 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:59.170 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.540607049, 2024-04-25T22:41:59.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:41:59.170 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:59.170 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:59.171 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.171 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:59.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:59.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:59.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:59.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:41:59.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:59.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:41:59.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:41:59.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:59.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:41:59.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:41:59.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:59.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:41:59.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:41:59.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:41:59.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:41:59.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:41:59.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:41:59.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:59.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:41:59.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:41:59.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:41:59.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:41:59.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:59.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:41:59.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:41:59.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:59.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:41:59.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:41:59.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:59.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:41:59.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:41:59.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:41:59.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:41:59.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:59.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:41:59.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:41:59.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:59.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:41:59.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:41:59.176 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.176 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.176 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.176 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.176 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:59.176 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.540542476, 2024-04-25T22:41:59.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:41:59.176 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:59.176 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:59.176 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.176 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:59.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:59.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:59.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:59.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:41:59.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:59.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:41:59.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:41:59.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:59.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:41:59.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:41:59.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:59.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:41:59.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:41:59.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:41:59.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:41:59.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:59.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:41:59.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:59.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:41:59.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:41:59.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:41:59.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:41:59.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:59.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:41:59.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:41:59.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:59.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:41:59.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:41:59.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:41:59.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:41:59.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:59.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:41:59.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:41:59.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:59.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:41:59.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:41:59.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:59.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:41:59.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:41:59.182 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.182 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.182 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.182 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.182 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:59.182 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.540477053, 2024-04-25T22:41:59.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:41:59.182 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:59.182 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:59.182 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.182 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:59.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:59.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:59.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:59.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:41:59.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:59.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:41:59.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:59.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:59.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:41:59.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:41:59.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:59.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:41:59.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:41:59.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:41:59.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:41:59.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:41:59.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:41:59.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:59.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:41:59.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:41:59.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:41:59.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:41:59.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:59.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:41:59.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:41:59.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:59.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:41:59.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:41:59.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:59.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:41:59.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:41:59.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:41:59.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:41:59.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:59.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:41:59.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:41:59.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:59.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:41:59.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:41:59.187 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.188 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.188 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.188 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.188 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:59.188 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.540420987, 2024-04-25T22:41:59.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:41:59.188 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:59.188 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:59.188 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.188 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:59.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:59.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:59.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:59.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:41:59.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:59.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:41:59.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:41:59.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:59.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:41:59.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:41:59.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:59.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:41:59.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:41:59.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:41:59.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:41:59.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:41:59.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:41:59.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:59.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:41:59.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:41:59.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:41:59.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:41:59.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:59.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:41:59.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:41:59.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:59.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:41:59.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:41:59.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:41:59.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:41:59.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:59.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:41:59.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:41:59.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:59.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:41:59.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:41:59.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:59.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:41:59.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:41:59.193 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.193 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.193 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.194 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.194 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:59.194 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.540353881, 2024-04-25T22:41:59.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:41:59.194 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:59.194 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:59.194 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.194 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:59.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:59.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:59.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:59.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:41:59.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:59.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:41:59.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:41:59.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:59.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:41:59.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:41:59.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:59.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:41:59.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:41:59.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:41:59.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:41:59.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:41:59.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:41:59.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:59.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:41:59.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:41:59.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:41:59.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:41:59.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:59.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:41:59.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:41:59.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:59.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:41:59.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:41:59.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:41:59.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:41:59.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:59.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:41:59.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:41:59.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:59.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:41:59.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:41:59.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:59.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:41:59.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:41:59.199 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.199 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.199 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.199 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.200 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:59.200 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.54029875800001, 2024-04-25T22:41:59.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:41:59.200 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:59.200 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:59.200 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.200 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:59.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:59.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:59.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:59.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:41:59.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:59.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:41:59.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:59.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:59.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:41:59.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:41:59.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:59.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:41:59.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:41:59.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:41:59.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:41:59.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:41:59.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:41:59.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:59.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:41:59.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:41:59.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:41:59.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:41:59.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:59.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:41:59.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:41:59.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:59.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:41:59.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:41:59.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:41:59.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:41:59.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:59.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:41:59.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:41:59.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:59.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:41:59.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:41:59.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:59.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:41:59.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:41:59.205 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.205 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.205 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.205 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.205 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:59.205 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.54019651900001, 2024-04-25T22:41:59.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:41:59.205 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:59.205 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:59.205 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.206 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:59.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:59.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:59.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:59.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:41:59.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:59.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:41:59.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:41:59.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:59.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:41:59.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:41:59.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:59.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:41:59.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:41:59.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:41:59.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:41:59.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:41:59.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:41:59.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:59.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:41:59.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:41:59.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:41:59.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:41:59.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:59.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:41:59.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:41:59.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:59.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:41:59.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:41:59.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:41:59.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:41:59.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:59.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:41:59.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:41:59.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:59.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:41:59.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:41:59.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:59.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:41:59.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:41:59.211 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.211 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.211 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.211 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.211 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:59.211 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.540137696, 2024-04-25T22:41:59.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:41:59.211 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:59.211 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:59.211 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.212 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:59.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:59.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:59.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:59.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:41:59.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:59.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:41:59.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:41:59.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:59.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:41:59.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:41:59.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:59.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:41:59.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:41:59.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:41:59.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:41:59.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:41:59.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:41:59.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:59.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:41:59.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:41:59.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:41:59.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:41:59.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:59.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:41:59.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:41:59.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:59.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:41:59.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:41:59.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:59.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:41:59.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:41:59.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:41:59.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:41:59.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:59.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:41:59.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:41:59.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:59.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:41:59.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:41:59.217 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.217 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.217 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.217 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.217 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:59.217 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.54005896300001, 2024-04-25T22:41:59.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:41:59.217 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:59.217 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:59.218 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.218 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:59.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:59.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:59.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:59.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:41:59.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:59.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:41:59.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:41:59.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:59.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:41:59.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:41:59.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:59.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:41:59.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:41:59.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:41:59.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:41:59.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:41:59.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:41:59.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:59.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:41:59.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:41:59.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:41:59.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:41:59.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:59.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:41:59.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:41:59.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:59.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:41:59.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:41:59.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:59.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:41:59.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:41:59.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:41:59.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:41:59.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:59.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:41:59.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:41:59.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:59.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:41:59.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:41:59.223 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.223 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.223 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.223 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.223 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:59.223 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.54001955, 2024-04-25T22:41:59.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:41:59.223 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:59.224 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:59.224 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.224 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:59.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:59.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:59.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:59.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:41:59.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:59.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:41:59.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:41:59.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:59.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:41:59.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:41:59.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:59.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:41:59.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:41:59.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:41:59.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:41:59.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:41:59.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:41:59.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:59.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:41:59.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:41:59.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:41:59.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:41:59.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:59.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:41:59.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:41:59.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:59.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:41:59.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:41:59.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:41:59.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:41:59.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:59.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:41:59.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:41:59.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:59.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:41:59.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:41:59.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:59.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:41:59.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:41:59.229 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.229 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.229 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.229 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.229 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:59.229 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.53994970399999, 2024-04-25T22:41:59.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:41:59.229 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:59.229 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:59.229 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.229 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:59.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:59.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:59.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:59.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:41:59.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:59.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:41:59.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:41:59.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:59.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:41:59.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:41:59.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:59.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:41:59.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:41:59.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:41:59.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:41:59.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:41:59.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:41:59.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:59.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:41:59.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:41:59.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:41:59.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:41:59.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:59.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:41:59.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:41:59.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:59.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:41:59.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:41:59.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:41:59.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:41:59.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:59.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:41:59.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:41:59.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:59.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:41:59.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:41:59.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:59.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:41:59.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:41:59.235 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.235 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.235 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.235 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.235 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:59.235 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.539899967, 2024-04-25T22:41:59.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:41:59.235 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:59.235 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:59.235 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.236 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:59.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:59.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:59.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:59.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:41:59.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:59.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:41:59.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:41:59.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:59.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:41:59.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:41:59.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:59.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:41:59.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:41:59.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:41:59.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:41:59.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:41:59.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:41:59.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:59.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:41:59.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:41:59.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:41:59.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:41:59.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:59.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:41:59.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:41:59.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:41:59.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:41:59.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:41:59.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:59.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:41:59.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:41:59.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:41:59.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:41:59.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:59.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:59.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:41:59.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:59.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:41:59.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:41:59.241 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.241 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.241 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.241 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.241 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:59.241 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.53981535200001, 2024-04-25T22:41:59.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:41:59.241 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:59.241 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:59.241 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.241 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:59.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:59.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:59.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:59.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:41:59.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:59.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:41:59.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:59.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:41:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:41:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:41:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:41:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:41:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:41:59.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:41:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:41:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:41:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:41:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:41:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:41:59.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:41:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:41:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:41:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:41:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:41:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:41:59.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:41:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:41:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:41:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:41:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:41:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:41:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:59.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:41:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:41:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.539751702, 2024-04-25T22:41:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:41:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:41:59.247 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:41:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:41:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:41:59.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:59.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:41:59.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:41:59.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:59.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:41:59.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:41:59.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:41:59.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:41:59.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:41:59.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:41:59.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:59.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:41:59.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:41:59.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:41:59.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:41:59.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:59.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:41:59.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:41:59.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:59.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:41:59.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:41:59.251 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.251 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.251 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.252 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:41:59.252 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:59.252 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.532748172, 2024-04-25T22:41:59.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:41:59.252 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:41:59.252 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:41:59.252 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.252 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:41:59.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:41:59.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:59.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:41:59.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:41:59.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:41:59.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:41:59.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:41:59.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:41:59.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:41:59.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:41:59.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:41:59.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:41:59.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:41:59.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:41:59.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:41:59.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:41:59.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:41:59.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:41:59.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:41:59.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:41:59.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:41:59.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:41:59.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:41:59.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:41:59.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:41:59.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:41:59.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:41:59.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:41:59.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:41:59.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:41:59.255 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.256 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.256 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.256 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:41:59.256 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:41:59.256 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:59.257 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:41:59.258 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:59.251+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:59.294 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:41:59.358 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:59.355+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:59.393 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:59.393 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:59.394 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:41:59.394 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:59.408 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:41:59.459 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:59.456+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:59.560 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:59.556+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:59.589 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:59.589 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:41:59.589 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:41:59.589 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:41:59.589 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:59.606 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:41:59.661 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:41:59.655+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:41:59.731 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:41:59.731 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:41:59.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:41:59.731 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:41:59.731 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.731 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.732 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:59.732 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 105.13206440800001, 2024-04-25T22:41:59.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:41:59.732 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:59.732 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:59.732 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.732 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:59.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.732 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:59.732 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:59.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.732 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.732 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:59.732 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:41:59.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:59.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:41:59.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:41:59.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:59.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:41:59.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:41:59.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:59.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:41:59.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:41:59.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:41:59.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:41:59.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:41:59.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:41:59.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:59.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:41:59.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:41:59.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:41:59.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:41:59.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:59.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:41:59.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:41:59.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:59.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:41:59.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:41:59.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:59.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:41:59.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:41:59.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:41:59.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:41:59.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:59.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:41:59.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:41:59.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:59.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:41:59.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:41:59.737 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.737 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.737 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.737 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.737 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:59.737 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 105.131927152, 2024-04-25T22:41:59.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:41:59.738 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:59.738 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:59.738 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.738 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:59.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:59.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:59.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:59.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:41:59.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:59.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:41:59.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:41:59.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:59.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:41:59.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:41:59.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:59.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:41:59.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:41:59.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:41:59.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:41:59.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:41:59.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:41:59.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:59.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:41:59.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:41:59.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:41:59.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:41:59.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:59.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:41:59.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:41:59.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:59.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:41:59.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:41:59.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:59.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:41:59.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:41:59.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:41:59.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:41:59.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:59.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:41:59.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:41:59.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:59.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:41:59.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:41:59.743 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.743 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.743 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.743 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.743 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:59.743 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 105.13183960000001, 2024-04-25T22:41:59.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:41:59.743 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:59.743 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:59.743 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.743 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:59.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:59.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:59.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:59.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:41:59.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:59.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:41:59.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:41:59.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:59.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:41:59.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:41:59.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:59.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:41:59.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:41:59.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:41:59.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:41:59.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:41:59.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:41:59.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:59.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:41:59.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:41:59.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:41:59.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:41:59.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.747 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:59.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:41:59.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:41:59.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.747 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:59.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:41:59.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:41:59.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.747 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:59.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:41:59.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:41:59.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:41:59.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:41:59.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:59.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:41:59.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:41:59.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:59.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:41:59.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:41:59.748 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.749 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.749 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.749 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.749 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:59.749 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 105.13173577400001, 2024-04-25T22:41:59.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:41:59.749 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:59.749 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:59.749 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.749 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:59.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:59.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:59.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.750 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:59.750 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:41:59.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.750 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:59.750 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:41:59.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:41:59.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.750 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:59.750 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:41:59.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:41:59.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:59.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:41:59.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:41:59.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:41:59.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:41:59.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:41:59.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:41:59.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:59.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:41:59.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:41:59.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:41:59.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:41:59.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:59.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:41:59.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:41:59.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:41:59.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:41:59.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:41:59.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:59.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:41:59.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:41:59.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.754 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:41:59.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:41:59.754 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.754 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:59.754 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:41:59.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:41:59.754 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.754 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:59.754 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:41:59.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:41:59.754 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.754 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.755 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.755 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.755 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.755 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.755 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:59.755 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 105.13166698400001, 2024-04-25T22:41:59.755 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:41:59.755 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:59.755 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:59.755 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.755 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:59.755 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.755 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:59.755 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:59.755 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.756 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:59.756 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:41:59.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.756 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:59.756 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:41:59.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:41:59.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.756 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:59.756 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:41:59.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:41:59.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:59.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:41:59.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:41:59.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:41:59.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:41:59.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:41:59.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:41:59.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:59.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:41:59.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:41:59.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:41:59.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:41:59.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:59.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:41:59.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:41:59.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.759 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:59.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:41:59.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:41:59.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.759 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:59.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:41:59.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:41:59.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.759 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.760 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:41:59.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:41:59.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.760 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:59.760 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:41:59.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:41:59.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.760 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:59.760 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:41:59.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:41:59.760 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.760 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.760 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.761 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.761 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:59.761 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 105.131597898, 2024-04-25T22:41:59.761 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:41:59.761 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:59.761 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:59.761 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.761 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:59.761 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.761 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:59.761 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:59.761 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.761 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.761 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.761 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:59.762 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:41:59.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.762 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:59.762 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:41:59.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:41:59.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.762 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:59.762 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:41:59.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:41:59.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:59.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:41:59.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:41:59.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:41:59.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:41:59.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:41:59.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:41:59.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:59.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:41:59.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:41:59.764 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:41:59.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:41:59.764 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:59.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:41:59.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:41:59.764 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:59.765 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:41:59.765 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:41:59.765 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.765 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.765 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:59.765 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:41:59.765 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:41:59.765 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.765 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.765 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.765 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:41:59.765 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:41:59.765 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.765 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.765 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:59.766 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:41:59.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:41:59.766 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.766 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:59.766 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:41:59.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:41:59.766 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.766 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.766 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.766 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.766 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.767 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:59.767 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 105.131501785, 2024-04-25T22:41:59.767 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:41:59.767 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:59.767 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:59.767 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:59.767 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:59.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.767 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:59.767 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:59.767 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.767 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.767 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:59.767 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:41:59.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:59.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:41:59.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:41:59.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:59.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:41:59.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:41:59.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:59.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:41:59.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:41:59.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:41:59.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:41:59.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:41:59.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:41:59.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:59.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:41:59.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:41:59.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.770 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:41:59.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:41:59.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.770 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:59.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:41:59.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:41:59.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.770 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:59.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:41:59.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:41:59.770 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.771 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.771 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.771 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.771 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:59.771 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 105.131436123, 2024-04-25T22:41:59.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:41:59.771 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:59.771 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:59.771 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:59.771 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:59.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:59.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:59.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:59.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:41:59.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:59.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:41:59.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:41:59.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:59.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:41:59.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:41:59.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:59.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:41:59.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:41:59.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:41:59.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:41:59.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:41:59.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:41:59.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:41:59.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:41:59.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:41:59.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:41:59.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:41:59.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:59.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:41:59.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:41:59.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.775 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:59.775 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:41:59.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:41:59.775 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.775 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.775 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.775 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.775 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.775 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:41:59.775 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:59.775 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 105.131366996, 2024-04-25T22:41:59.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:41:59.775 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:59.775 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:59.775 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:41:59.775 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:59.775 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:59.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:59.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:59.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:41:59.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:59.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:41:59.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:41:59.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:59.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:41:59.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:41:59.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:59.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:41:59.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:41:59.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:41:59.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:41:59.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.778 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:41:59.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:41:59.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:41:59.778 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:41:59.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:41:59.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.778 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:41:59.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:41:59.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.779 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:59.779 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:41:59.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:41:59.779 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.779 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.779 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:59.779 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:41:59.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:41:59.779 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.779 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.779 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.779 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.779 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.779 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-25T22:41:59.779 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:41:59.779 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 5.7325691370000005, 2024-04-25T22:41:59.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.02435211, 2024-04-25T22:41:59.780 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:59.780 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:59.780 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.780 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:41:59.780 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:41:59.780 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:41:59.780 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 5 2024-04-25T22:41:59.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.780 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:59.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.780 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:59.780 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:41:59.780 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.780 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:59.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:41:59.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:59.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995113+0000", 2024-04-25T22:41:59.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2760000000000001e-06 2024-04-25T22:41:59.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:59.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002825+0000", 2024-04-25T22:41:59.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077127000000000003 2024-04-25T22:41:59.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:59.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002852+0000", 2024-04-25T22:41:59.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6570000000000001e-05 2024-04-25T22:41:59.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002866+0000", 2024-04-25T22:41:59.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4144999999999999e-05 2024-04-25T22:41:59.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002947+0000", 2024-04-25T22:41:59.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0740000000000003e-05 2024-04-25T22:41:59.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:59.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.003049+0000", 2024-04-25T22:41:59.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101829 2024-04-25T22:41:59.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:59.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019091+0000", 2024-04-25T22:41:59.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016042638000000001 2024-04-25T22:41:59.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:59.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019227+0000", 2024-04-25T22:41:59.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000135826 2024-04-25T22:41:59.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:59.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019462+0000", 2024-04-25T22:41:59.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000234386 2024-04-25T22:41:59.784 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.784 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.784 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.784 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:73 3.b 3:d5c7a900:::200.00000003:head [write 920531~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:41:59.784 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.598864+0000", 2024-04-25T22:41:59.784 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.128814911, 2024-04-25T22:41:59.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016865775999999999, 2024-04-25T22:41:59.784 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:59.784 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:59.784 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.784 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:59.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.785 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:59.785 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598864+0000", 2024-04-25T22:41:59.785 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.785 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.785 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:59.785 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598864+0000", 2024-04-25T22:41:59.785 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.785 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.785 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:59.785 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598865+0000", 2024-04-25T22:41:59.785 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2299999999999999e-07 2024-04-25T22:41:59.785 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.785 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:59.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598880+0000", 2024-04-25T22:41:59.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5051999999999999e-05 2024-04-25T22:41:59.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:59.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598897+0000", 2024-04-25T22:41:59.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7748999999999999e-05 2024-04-25T22:41:59.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598909+0000", 2024-04-25T22:41:59.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1187e-05 2024-04-25T22:41:59.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.605650+0000", 2024-04-25T22:41:59.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067413070000000002 2024-04-25T22:41:59.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:59.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.605741+0000", 2024-04-25T22:41:59.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1181999999999995e-05 2024-04-25T22:41:59.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:59.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.605878+0000", 2024-04-25T22:41:59.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013704200000000001 2024-04-25T22:41:59.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:59.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611026+0000", 2024-04-25T22:41:59.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0051482189999999999 2024-04-25T22:41:59.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615619+0000", 2024-04-25T22:41:59.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0045930900000000002 2024-04-25T22:41:59.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:59.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615683+0000", 2024-04-25T22:41:59.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3200999999999993e-05 2024-04-25T22:41:59.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:59.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615729+0000", 2024-04-25T22:41:59.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6823999999999998e-05 2024-04-25T22:41:59.789 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.789 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.789 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.789 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:74 3.b 3:d5c7a900:::200.00000003:head [write 921931~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:41:59.789 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.598924+0000", 2024-04-25T22:41:59.789 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.12875436000000001, 2024-04-25T22:41:59.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016937026000000001, 2024-04-25T22:41:59.789 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:59.789 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:59.789 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.789 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:59.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:59.790 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598924+0000", 2024-04-25T22:41:59.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.790 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.790 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:59.790 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598924+0000", 2024-04-25T22:41:59.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.790 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.790 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:59.790 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598925+0000", 2024-04-25T22:41:59.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0020000000000001e-06 2024-04-25T22:41:59.790 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.791 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:59.791 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598934+0000", 2024-04-25T22:41:59.791 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6270000000000006e-06 2024-04-25T22:41:59.791 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.791 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.791 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:59.791 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598948+0000", 2024-04-25T22:41:59.791 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3953e-05 2024-04-25T22:41:59.791 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.791 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.791 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.791 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598975+0000", 2024-04-25T22:41:59.791 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6673999999999999e-05 2024-04-25T22:41:59.791 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.791 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606235+0000", 2024-04-25T22:41:59.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.007260463 2024-04-25T22:41:59.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:59.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606332+0000", 2024-04-25T22:41:59.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7252999999999999e-05 2024-04-25T22:41:59.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:59.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606478+0000", 2024-04-25T22:41:59.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014544100000000001 2024-04-25T22:41:59.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:59.793 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611041+0000", 2024-04-25T22:41:59.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0045634359999999997 2024-04-25T22:41:59.793 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.793 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.793 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.793 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615781+0000", 2024-04-25T22:41:59.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0047398750000000002 2024-04-25T22:41:59.793 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.793 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.793 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:59.793 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615823+0000", 2024-04-25T22:41:59.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1927e-05 2024-04-25T22:41:59.793 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.793 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.793 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:59.793 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615861+0000", 2024-04-25T22:41:59.794 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8374999999999998e-05 2024-04-25T22:41:59.794 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.794 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.794 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.794 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.794 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.794 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:75 3.b 3:d5c7a900:::200.00000003:head [write 923330~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:41:59.794 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.598989+0000", 2024-04-25T22:41:59.794 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.12868933499999999, 2024-04-25T22:41:59.794 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017059059000000001, 2024-04-25T22:41:59.794 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:59.794 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:59.794 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.794 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:59.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.795 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:59.795 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598989+0000", 2024-04-25T22:41:59.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.795 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:59.795 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598989+0000", 2024-04-25T22:41:59.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.795 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:59.795 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598990+0000", 2024-04-25T22:41:59.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0279999999999999e-06 2024-04-25T22:41:59.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.796 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:59.796 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599003+0000", 2024-04-25T22:41:59.796 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2306999999999999e-05 2024-04-25T22:41:59.796 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.796 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.796 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:59.796 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599017+0000", 2024-04-25T22:41:59.796 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4064e-05 2024-04-25T22:41:59.796 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.796 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.796 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.796 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599041+0000", 2024-04-25T22:41:59.796 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4054999999999999e-05 2024-04-25T22:41:59.796 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.796 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606871+0000", 2024-04-25T22:41:59.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0078301580000000003 2024-04-25T22:41:59.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.797 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:59.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606928+0000", 2024-04-25T22:41:59.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7479999999999999e-05 2024-04-25T22:41:59.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.797 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:59.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607019+0000", 2024-04-25T22:41:59.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0761999999999996e-05 2024-04-25T22:41:59.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.797 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:59.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611057+0000", 2024-04-25T22:41:59.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040381260000000004 2024-04-25T22:41:59.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615923+0000", 2024-04-25T22:41:59.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048658319999999996 2024-04-25T22:41:59.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:59.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615996+0000", 2024-04-25T22:41:59.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3108000000000005e-05 2024-04-25T22:41:59.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:59.799 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616048+0000", 2024-04-25T22:41:59.799 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2138999999999997e-05 2024-04-25T22:41:59.799 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.799 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.799 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.799 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.799 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.799 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:76 3.b 3:d5c7a900:::200.00000003:head [write 924729~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:41:59.799 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.599056+0000", 2024-04-25T22:41:59.799 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.128622291, 2024-04-25T22:41:59.799 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017101028000000001, 2024-04-25T22:41:59.799 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:59.799 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:59.799 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.799 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:59.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:59.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599056+0000", 2024-04-25T22:41:59.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:59.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599056+0000", 2024-04-25T22:41:59.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:59.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599057+0000", 2024-04-25T22:41:59.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1500000000000003e-07 2024-04-25T22:41:59.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.801 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:59.801 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599063+0000", 2024-04-25T22:41:59.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6930000000000004e-06 2024-04-25T22:41:59.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.801 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:59.801 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599085+0000", 2024-04-25T22:41:59.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2544e-05 2024-04-25T22:41:59.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.801 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.801 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599098+0000", 2024-04-25T22:41:59.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2425999999999999e-05 2024-04-25T22:41:59.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.802 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.802 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607316+0000", 2024-04-25T22:41:59.802 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082178489999999993 2024-04-25T22:41:59.802 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.802 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.802 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:59.802 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607452+0000", 2024-04-25T22:41:59.802 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000135885 2024-04-25T22:41:59.802 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.802 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.802 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:59.802 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607602+0000", 2024-04-25T22:41:59.802 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015049200000000001 2024-04-25T22:41:59.802 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:59.803 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611073+0000", 2024-04-25T22:41:59.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0034707079999999999 2024-04-25T22:41:59.803 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.803 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616091+0000", 2024-04-25T22:41:59.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0050181779999999999 2024-04-25T22:41:59.803 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:59.803 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616121+0000", 2024-04-25T22:41:59.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0399000000000002e-05 2024-04-25T22:41:59.803 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:59.804 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616157+0000", 2024-04-25T22:41:59.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6038999999999998e-05 2024-04-25T22:41:59.804 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.804 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.804 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.804 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:77 3.b 3:d5c7a900:::200.00000003:head [write 926128~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:41:59.804 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.599112+0000", 2024-04-25T22:41:59.804 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.128566123, 2024-04-25T22:41:59.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017211087, 2024-04-25T22:41:59.804 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:59.804 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:59.804 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.804 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:59.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.805 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:59.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599112+0000", 2024-04-25T22:41:59.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.805 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:59.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599112+0000", 2024-04-25T22:41:59.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.805 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:59.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599113+0000", 2024-04-25T22:41:59.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7499999999999999e-07 2024-04-25T22:41:59.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.806 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:59.806 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599119+0000", 2024-04-25T22:41:59.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0349999999999998e-06 2024-04-25T22:41:59.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.806 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:59.806 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599138+0000", 2024-04-25T22:41:59.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8345000000000001e-05 2024-04-25T22:41:59.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.806 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.806 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599150+0000", 2024-04-25T22:41:59.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1902000000000001e-05 2024-04-25T22:41:59.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.807 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.807 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.807 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608267+0000", 2024-04-25T22:41:59.807 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091174380000000003 2024-04-25T22:41:59.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.807 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.807 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:59.807 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608341+0000", 2024-04-25T22:41:59.807 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4029000000000006e-05 2024-04-25T22:41:59.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.807 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.807 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:59.807 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608435+0000", 2024-04-25T22:41:59.807 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3541000000000004e-05 2024-04-25T22:41:59.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.807 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.808 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:59.808 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.613682+0000", 2024-04-25T22:41:59.808 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0052474829999999998 2024-04-25T22:41:59.808 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.808 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.808 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.808 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616211+0000", 2024-04-25T22:41:59.808 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025291490000000001 2024-04-25T22:41:59.808 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.808 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.808 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:59.808 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616276+0000", 2024-04-25T22:41:59.808 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4590000000000003e-05 2024-04-25T22:41:59.808 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.808 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.809 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:59.809 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616324+0000", 2024-04-25T22:41:59.809 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7700000000000001e-05 2024-04-25T22:41:59.809 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.809 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.809 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.809 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.809 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:78 3.b 3:d5c7a900:::200.00000003:head [write 927532~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:41:59.809 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.599164+0000", 2024-04-25T22:41:59.809 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.12851467599999999, 2024-04-25T22:41:59.809 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017312029999999999, 2024-04-25T22:41:59.809 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:59.810 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:59.810 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.810 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:59.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.810 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:59.810 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599164+0000", 2024-04-25T22:41:59.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.810 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:59.810 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599164+0000", 2024-04-25T22:41:59.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.811 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:59.811 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599165+0000", 2024-04-25T22:41:59.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6899999999999996e-07 2024-04-25T22:41:59.811 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.811 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:59.811 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599177+0000", 2024-04-25T22:41:59.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2461e-05 2024-04-25T22:41:59.811 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.811 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:59.811 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599191+0000", 2024-04-25T22:41:59.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3888e-05 2024-04-25T22:41:59.811 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599206+0000", 2024-04-25T22:41:59.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4346e-05 2024-04-25T22:41:59.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608700+0000", 2024-04-25T22:41:59.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0094949140000000001 2024-04-25T22:41:59.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:59.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608786+0000", 2024-04-25T22:41:59.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5587000000000006e-05 2024-04-25T22:41:59.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.813 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.813 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:59.813 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608921+0000", 2024-04-25T22:41:59.813 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013478900000000001 2024-04-25T22:41:59.813 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.813 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.813 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:59.813 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.613698+0000", 2024-04-25T22:41:59.813 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0047773859999999998 2024-04-25T22:41:59.813 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.813 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.813 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.813 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616386+0000", 2024-04-25T22:41:59.814 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0026877770000000001 2024-04-25T22:41:59.814 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.814 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.814 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:59.814 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616440+0000", 2024-04-25T22:41:59.814 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4490000000000002e-05 2024-04-25T22:41:59.814 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.814 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.814 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:59.814 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616476+0000", 2024-04-25T22:41:59.814 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5522999999999999e-05 2024-04-25T22:41:59.814 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.814 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.815 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.815 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.815 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.815 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:80 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:41:59.815 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.611504+0000", 2024-04-25T22:41:59.815 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.116174211, 2024-04-25T22:41:59.815 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015504957, 2024-04-25T22:41:59.815 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:59.815 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:59.815 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.815 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:59.815 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.815 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:59.815 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611504+0000", 2024-04-25T22:41:59.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.816 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:59.816 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611504+0000", 2024-04-25T22:41:59.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.816 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:59.816 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611506+0000", 2024-04-25T22:41:59.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.733e-06 2024-04-25T22:41:59.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.816 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:59.817 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611585+0000", 2024-04-25T22:41:59.817 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8634999999999995e-05 2024-04-25T22:41:59.817 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.817 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.817 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:59.817 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611602+0000", 2024-04-25T22:41:59.817 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7011e-05 2024-04-25T22:41:59.817 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.817 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.817 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.817 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611611+0000", 2024-04-25T22:41:59.817 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1959999999999997e-06 2024-04-25T22:41:59.817 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.817 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.818 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.818 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611685+0000", 2024-04-25T22:41:59.818 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3711e-05 2024-04-25T22:41:59.818 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.818 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.818 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:59.818 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611780+0000", 2024-04-25T22:41:59.818 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5605000000000004e-05 2024-04-25T22:41:59.818 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.818 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.818 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:59.818 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616401+0000", 2024-04-25T22:41:59.818 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046204549999999999 2024-04-25T22:41:59.819 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.819 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.819 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.819 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.626036+0000", 2024-04-25T22:41:59.819 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0096348070000000004 2024-04-25T22:41:59.819 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.819 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.819 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:59.819 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.626818+0000", 2024-04-25T22:41:59.819 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00078275199999999995 2024-04-25T22:41:59.819 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.819 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.819 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:59.819 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.626924+0000", 2024-04-25T22:41:59.819 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010579 2024-04-25T22:41:59.819 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.820 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.820 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:59.820 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.627009+0000", 2024-04-25T22:41:59.820 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5261999999999998e-05 2024-04-25T22:41:59.820 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.820 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.820 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.820 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.820 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.820 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:86 3.b 3:d5c7a900:::200.00000003:head [write 946309~3444 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:41:59.820 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.616898+0000", 2024-04-25T22:41:59.820 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.110780579, 2024-04-25T22:41:59.820 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014696196, 2024-04-25T22:41:59.820 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:59.820 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:59.821 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.821 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:59.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:59.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616898+0000", 2024-04-25T22:41:59.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:59.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616898+0000", 2024-04-25T22:41:59.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:59.822 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616909+0000", 2024-04-25T22:41:59.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0526000000000001e-05 2024-04-25T22:41:59.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.822 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.822 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:59.822 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616916+0000", 2024-04-25T22:41:59.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7970000000000001e-06 2024-04-25T22:41:59.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.822 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.822 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:59.822 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616939+0000", 2024-04-25T22:41:59.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2286e-05 2024-04-25T22:41:59.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.822 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.822 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.823 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616946+0000", 2024-04-25T22:41:59.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0360000000000001e-06 2024-04-25T22:41:59.823 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.823 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.620384+0000", 2024-04-25T22:41:59.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0034386030000000001 2024-04-25T22:41:59.823 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:59.823 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.620460+0000", 2024-04-25T22:41:59.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5691000000000004e-05 2024-04-25T22:41:59.823 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.824 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:59.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.620579+0000", 2024-04-25T22:41:59.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011941400000000001 2024-04-25T22:41:59.824 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.824 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:59.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.628308+0000", 2024-04-25T22:41:59.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077284019999999997 2024-04-25T22:41:59.824 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.824 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.631380+0000", 2024-04-25T22:41:59.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0030724839999999999 2024-04-25T22:41:59.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.825 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.825 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:59.825 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.631498+0000", 2024-04-25T22:41:59.825 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011775 2024-04-25T22:41:59.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.825 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.825 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:59.825 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.631594+0000", 2024-04-25T22:41:59.825 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6206999999999996e-05 2024-04-25T22:41:59.825 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.825 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.825 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.826 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:87 3.b 3:d5c7a900:::200.00000003:head [write 949753~2421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:41:59.826 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.617029+0000", 2024-04-25T22:41:59.826 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.11064919400000001, 2024-04-25T22:41:59.826 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014709559000000001, 2024-04-25T22:41:59.826 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:59.826 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:59.826 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.826 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:59.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.826 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:59.826 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.617029+0000", 2024-04-25T22:41:59.826 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:59.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.617029+0000", 2024-04-25T22:41:59.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:59.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.617030+0000", 2024-04-25T22:41:59.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3600000000000002e-07 2024-04-25T22:41:59.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:59.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.617036+0000", 2024-04-25T22:41:59.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3879999999999999e-06 2024-04-25T22:41:59.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:59.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.617047+0000", 2024-04-25T22:41:59.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1514e-05 2024-04-25T22:41:59.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.617054+0000", 2024-04-25T22:41:59.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2520000000000002e-06 2024-04-25T22:41:59.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.621025+0000", 2024-04-25T22:41:59.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0039706300000000002 2024-04-25T22:41:59.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:59.829 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.621098+0000", 2024-04-25T22:41:59.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3139000000000006e-05 2024-04-25T22:41:59.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:59.829 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.621212+0000", 2024-04-25T22:41:59.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000113655 2024-04-25T22:41:59.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:59.829 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.628327+0000", 2024-04-25T22:41:59.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071152910000000002 2024-04-25T22:41:59.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.830 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.631656+0000", 2024-04-25T22:41:59.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.003328499 2024-04-25T22:41:59.830 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.830 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:59.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.631698+0000", 2024-04-25T22:41:59.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2345000000000002e-05 2024-04-25T22:41:59.830 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.830 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:59.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.631739+0000", 2024-04-25T22:41:59.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1010000000000002e-05 2024-04-25T22:41:59.830 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.831 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.831 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.831 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.831 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.831 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:88 3.b 3:d5c7a900:::200.00000003:head [write 952174~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:41:59.831 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.617070+0000", 2024-04-25T22:41:59.831 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.110608919, 2024-04-25T22:41:59.831 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014822811, 2024-04-25T22:41:59.831 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:41:59.831 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:41:59.831 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:41:59.831 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:41:59.831 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.831 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:41:59.832 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.617070+0000", 2024-04-25T22:41:59.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.832 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.832 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:41:59.832 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.617070+0000", 2024-04-25T22:41:59.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:41:59.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.832 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.832 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:41:59.832 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.617070+0000", 2024-04-25T22:41:59.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3399999999999999e-07 2024-04-25T22:41:59.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.832 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:41:59.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.617074+0000", 2024-04-25T22:41:59.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.794e-06 2024-04-25T22:41:59.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:41:59.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.617083+0000", 2024-04-25T22:41:59.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3750000000000003e-06 2024-04-25T22:41:59.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:41:59.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.617089+0000", 2024-04-25T22:41:59.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3269999999999997e-06 2024-04-25T22:41:59.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:41:59.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.621670+0000", 2024-04-25T22:41:59.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0045812279999999997 2024-04-25T22:41:59.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:41:59.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.621719+0000", 2024-04-25T22:41:59.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9122999999999997e-05 2024-04-25T22:41:59.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:41:59.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.621796+0000", 2024-04-25T22:41:59.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7016999999999998e-05 2024-04-25T22:41:59.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:41:59.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.628352+0000", 2024-04-25T22:41:59.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0065557599999999999 2024-04-25T22:41:59.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:41:59.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.631791+0000", 2024-04-25T22:41:59.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.003438862 2024-04-25T22:41:59.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:41:59.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.631853+0000", 2024-04-25T22:41:59.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2014999999999995e-05 2024-04-25T22:41:59.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:41:59.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:41:59.836 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:41:59.836 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.631893+0000", 2024-04-25T22:41:59.836 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.9675999999999998e-05 2024-04-25T22:41:59.836 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.836 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.836 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.836 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:41:59.836 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:41:59.836 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:41:59.838 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:41:59.838 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:59.836+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:59.850 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:41:59.939 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:41:59.936+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:41:59.977 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:41:59.977 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:41:59.977 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:41:59.977 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:41:59.993 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:00.027 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:00.027 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:00.027 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:00.039 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:00.035+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:00.049 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:00.050 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:00.052 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:00.053 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:00.140 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:00.135+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:00.166 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:00.167 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:00.183 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:00.241 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:00.240+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:00.286 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-25T22:42:00.286 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:42:00.286 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-04-25T22:42:00.286 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2024-04-25T22:42:00.318 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:00.318 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:00.330 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is set 2024-04-25T22:42:00.334 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:00.382 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:00.379+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:00.443 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:00.439+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:00.474 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:00.474 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:00.489 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:00.543 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:00.540+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:00.644 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:00.639+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:00.647 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:42:00.647+0000 7fe448719640 -1 mgr.server reply reply (1) Operation not permitted no change 2024-04-25T22:42:00.647 INFO:teuthology.orchestra.run.smithi057.stdout:moved 9 / 210 (4.28571%) 2024-04-25T22:42:00.647 INFO:teuthology.orchestra.run.smithi057.stdout:avg 105 2024-04-25T22:42:00.647 INFO:teuthology.orchestra.run.smithi057.stdout:stddev 34.0147 -> 37.6563 (expected baseline 7.24569) 2024-04-25T22:42:00.647 INFO:teuthology.orchestra.run.smithi057.stdout:min osd.0 with 70 -> 61 pgs (0.666667 -> 0.580952 * mean) 2024-04-25T22:42:00.647 INFO:teuthology.orchestra.run.smithi057.stdout:max osd.2 with 72 -> 75 pgs (0.685714 -> 0.714286 * mean) 2024-04-25T22:42:00.648 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:42:00.648 INFO:teuthology.orchestra.run.smithi057.stdout:oload 110 2024-04-25T22:42:00.648 INFO:teuthology.orchestra.run.smithi057.stdout:max_change 1 2024-04-25T22:42:00.648 INFO:teuthology.orchestra.run.smithi057.stdout:max_change_osds 4 2024-04-25T22:42:00.648 INFO:teuthology.orchestra.run.smithi057.stdout:average_utilization 0.0005 2024-04-25T22:42:00.648 INFO:teuthology.orchestra.run.smithi057.stdout:overload_utilization 0.0005 2024-04-25T22:42:00.648 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 weight 1.0000 -> 0.8356 2024-04-25T22:42:00.648 INFO:teuthology.orchestra.run.smithi057.stderr:no change 2024-04-25T22:42:00.669 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-04-25T22:42:00.669 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 3.0 2024-04-25T22:42:00.692 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:00.692 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:00.710 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:00.754 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:00.751+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:00.846 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:00.844+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:00.890 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:00.890 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:00.907 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:00.957 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:00.956+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:00.983 INFO:teuthology.orchestra.run.smithi057.stdout:moved 0 / 210 (0%) 2024-04-25T22:42:00.983 INFO:teuthology.orchestra.run.smithi057.stdout:avg 105 2024-04-25T22:42:00.983 INFO:teuthology.orchestra.run.smithi057.stdout:stddev 34.0147 -> 34.0147 (expected baseline 7.24569) 2024-04-25T22:42:00.983 INFO:teuthology.orchestra.run.smithi057.stdout:min osd.0 with 70 -> 70 pgs (0.666667 -> 0.666667 * mean) 2024-04-25T22:42:00.983 INFO:teuthology.orchestra.run.smithi057.stdout:max osd.2 with 72 -> 72 pgs (0.685714 -> 0.685714 * mean) 2024-04-25T22:42:00.983 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:42:00.984 INFO:teuthology.orchestra.run.smithi057.stdout:oload 1000 2024-04-25T22:42:00.984 INFO:teuthology.orchestra.run.smithi057.stdout:max_change 3 2024-04-25T22:42:00.984 INFO:teuthology.orchestra.run.smithi057.stdout:max_change_osds 4 2024-04-25T22:42:00.984 INFO:teuthology.orchestra.run.smithi057.stdout:average_utilization 0.0005 2024-04-25T22:42:00.984 INFO:teuthology.orchestra.run.smithi057.stdout:overload_utilization 0.0048 2024-04-25T22:42:00.984 INFO:teuthology.orchestra.run.smithi057.stderr:no change 2024-04-25T22:42:01.001 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-04-25T22:42:01.001 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 0.05 2024-04-25T22:42:01.045 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:01.046 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:01.048 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:01.044+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:01.062 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:01.149 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:01.143+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:01.242 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:01.242 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:01.250 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:01.248+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:01.257 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:01.329 INFO:teuthology.orchestra.run.smithi057.stdout:moved 0 / 210 (0%) 2024-04-25T22:42:01.329 INFO:teuthology.orchestra.run.smithi057.stdout:avg 105 2024-04-25T22:42:01.329 INFO:teuthology.orchestra.run.smithi057.stdout:stddev 34.0147 -> 34.0147 (expected baseline 7.24569) 2024-04-25T22:42:01.329 INFO:teuthology.orchestra.run.smithi057.stdout:min osd.0 with 70 -> 70 pgs (0.666667 -> 0.666667 * mean) 2024-04-25T22:42:01.329 INFO:teuthology.orchestra.run.smithi057.stdout:max osd.2 with 72 -> 72 pgs (0.685714 -> 0.685714 * mean) 2024-04-25T22:42:01.329 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:42:01.329 INFO:teuthology.orchestra.run.smithi057.stdout:oload 1000 2024-04-25T22:42:01.329 INFO:teuthology.orchestra.run.smithi057.stdout:max_change 0.05 2024-04-25T22:42:01.329 INFO:teuthology.orchestra.run.smithi057.stdout:max_change_osds 4 2024-04-25T22:42:01.329 INFO:teuthology.orchestra.run.smithi057.stdout:average_utilization 0.0005 2024-04-25T22:42:01.329 INFO:teuthology.orchestra.run.smithi057.stdout:overload_utilization 0.0048 2024-04-25T22:42:01.330 INFO:teuthology.orchestra.run.smithi057.stderr:no change 2024-04-25T22:42:01.350 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-04-25T22:42:01.350 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 1.0 2024-04-25T22:42:01.351 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:01.347+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:01.427 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:01.427 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:01.444 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:01.494 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:01.491+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:01.552 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:01.547+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:01.591 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:01.591 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:01.608 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:01.653 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:01.648+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:01.676 INFO:teuthology.orchestra.run.smithi057.stdout:moved 0 / 210 (0%) 2024-04-25T22:42:01.676 INFO:teuthology.orchestra.run.smithi057.stdout:avg 105 2024-04-25T22:42:01.676 INFO:teuthology.orchestra.run.smithi057.stdout:stddev 34.0147 -> 34.0147 (expected baseline 7.24569) 2024-04-25T22:42:01.676 INFO:teuthology.orchestra.run.smithi057.stdout:min osd.0 with 70 -> 70 pgs (0.666667 -> 0.666667 * mean) 2024-04-25T22:42:01.676 INFO:teuthology.orchestra.run.smithi057.stdout:max osd.2 with 72 -> 72 pgs (0.685714 -> 0.685714 * mean) 2024-04-25T22:42:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:42:01.676 INFO:teuthology.orchestra.run.smithi057.stdout:oload 1000 2024-04-25T22:42:01.676 INFO:teuthology.orchestra.run.smithi057.stdout:max_change 1 2024-04-25T22:42:01.677 INFO:teuthology.orchestra.run.smithi057.stdout:max_change_osds 4 2024-04-25T22:42:01.677 INFO:teuthology.orchestra.run.smithi057.stdout:average_utilization 0.0005 2024-04-25T22:42:01.677 INFO:teuthology.orchestra.run.smithi057.stdout:overload_utilization 0.0048 2024-04-25T22:42:01.677 INFO:teuthology.orchestra.run.smithi057.stderr:no change 2024-04-25T22:42:01.693 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-04-25T22:42:01.694 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 3.0 2024-04-25T22:42:01.754 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:01.752+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:01.786 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:01.786 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:01.803 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:01.855 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:01.851+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:01.928 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:01.928 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:01.944 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:01.986 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:01.983+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:02.027 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-04-25T22:42:02.027+0000 7fe448719640 -1 mgr.server reply reply (1) Operation not permitted no change 2024-04-25T22:42:02.028 INFO:teuthology.orchestra.run.smithi057.stdout:moved 9 / 210 (4.28571%) 2024-04-25T22:42:02.028 INFO:teuthology.orchestra.run.smithi057.stdout:avg 105 2024-04-25T22:42:02.028 INFO:teuthology.orchestra.run.smithi057.stdout:stddev 34.0147 -> 37.6563 (expected baseline 7.24569) 2024-04-25T22:42:02.028 INFO:teuthology.orchestra.run.smithi057.stdout:min osd.0 with 70 -> 61 pgs (0.666667 -> 0.580952 * mean) 2024-04-25T22:42:02.028 INFO:teuthology.orchestra.run.smithi057.stdout:max osd.2 with 72 -> 75 pgs (0.685714 -> 0.714286 * mean) 2024-04-25T22:42:02.028 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:42:02.028 INFO:teuthology.orchestra.run.smithi057.stdout:oload 110 2024-04-25T22:42:02.028 INFO:teuthology.orchestra.run.smithi057.stdout:max_change 3 2024-04-25T22:42:02.029 INFO:teuthology.orchestra.run.smithi057.stdout:max_change_osds 4 2024-04-25T22:42:02.029 INFO:teuthology.orchestra.run.smithi057.stdout:average_utilization 0.0005 2024-04-25T22:42:02.029 INFO:teuthology.orchestra.run.smithi057.stdout:overload_utilization 0.0005 2024-04-25T22:42:02.029 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0 weight 1.0000 -> 0.8356 2024-04-25T22:42:02.029 INFO:teuthology.orchestra.run.smithi057.stderr:no change 2024-04-25T22:42:02.053 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:42:02.056 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:02.052+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:02.088 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:02.088 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:02.103 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:02.157 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:02.151+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:02.187 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:02.187 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:02.187 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:02.213 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:02.213 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:02.216 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:02.217 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:02.258 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:02.256+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:02.284 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:02.284 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:02.284 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:42:02.284 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:42:02.284 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:02.299 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:02.355 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:42:02.359 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:02.355+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:02.460 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:02.455+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:02.473 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:42:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:42:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:42:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.87488277, 2024-04-25T22:42:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:42:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:42:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:42:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:42:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:42:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:42:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:42:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:42:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:42:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:42:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:42:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:42:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:42:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:42:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:42:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:42:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:42:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:42:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:42:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:42:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:42:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:42:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:42:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:42:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:42:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:42:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:42:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:42:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:42:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:42:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.874794757, 2024-04-25T22:42:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:42:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:42:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:42:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:42:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:42:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:42:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:42:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:02.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:42:02.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:42:02.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:42:02.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:42:02.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:42:02.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:42:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:42:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:42:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:42:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:42:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:42:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:42:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:42:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:42:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:42:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:42:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:42:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:42:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:42:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:42:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:42:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.874722635, 2024-04-25T22:42:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:42:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:42:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:42:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:42:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:42:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:42:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:42:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:42:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:42:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:42:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:42:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:42:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:42:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:42:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:42:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:42:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:42:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:42:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:42:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:42:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:42:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:42:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:42:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:42:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:42:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:42:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:42:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.874614322, 2024-04-25T22:42:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:42:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:42:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:42:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:42:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:42:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:42:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:42:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:42:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:42:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:42:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:42:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:42:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:42:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:42:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:42:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:42:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:42:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:42:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:42:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:42:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:42:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:42:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:42:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:42:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:42:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:42:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:42:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.874547666, 2024-04-25T22:42:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:42:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:42:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:42:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:42:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:42:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:42:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:42:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:42:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:42:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:42:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:42:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:42:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:42:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:42:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:42:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:42:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:42:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:42:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:42:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:42:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:42:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:42:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:42:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:42:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:42:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:42:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:42:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.87445707000001, 2024-04-25T22:42:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:42:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:42:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:42:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:42:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:42:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:42:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:42:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:42:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:42:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:42:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:42:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:42:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:42:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:42:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:42:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:42:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:42:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:42:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:42:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:42:02.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:42:02.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:02.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:42:02.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:42:02.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:02.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:42:02.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:42:02.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:02.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:42:02.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:42:02.511 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.511 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.511 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.511 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:02.511 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:02.511 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.874392497, 2024-04-25T22:42:02.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:42:02.511 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:02.511 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:02.512 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:02.512 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:02.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:02.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:02.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:02.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:02.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:02.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:42:02.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:42:02.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:02.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:42:02.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:42:02.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:02.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:42:02.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:42:02.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:42:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:42:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:42:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:42:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:42:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:42:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:42:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:42:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:42:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:42:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:42:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:42:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:42:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:42:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:42:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:42:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:42:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:42:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:42:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.87432707400001, 2024-04-25T22:42:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:42:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:42:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:42:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:42:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:42:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:42:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:42:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:42:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:42:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:42:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:42:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:42:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:42:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:42:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:42:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:42:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:42:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:42:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:42:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:42:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:42:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:42:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:42:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:42:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:42:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:42:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:42:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.87427100799999, 2024-04-25T22:42:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:42:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:42:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:42:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:42:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:42:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:42:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:42:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:42:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:42:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:42:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:42:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:42:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:42:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:42:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:42:02.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:42:02.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:02.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:42:02.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:42:02.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:02.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:42:02.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:42:02.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:02.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:42:02.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:42:02.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:02.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:42:02.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:42:02.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:02.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:42:02.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:42:02.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:02.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:42:02.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:42:02.531 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.531 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.531 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.531 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:02.531 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:42:02.531 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.874203902, 2024-04-25T22:42:02.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:42:02.531 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:02.531 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:02.531 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:02.531 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:02.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:02.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:42:02.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:02.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:42:02.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:02.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:42:02.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:42:02.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:02.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:42:02.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:42:02.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:02.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:42:02.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:42:02.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:42:02.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:42:02.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:42:02.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:42:02.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:02.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:42:02.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:42:02.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:42:02.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:42:02.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:02.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:42:02.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:42:02.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:02.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:42:02.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:42:02.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:02.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:42:02.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:42:02.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:02.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:42:02.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:42:02.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:02.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:42:02.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:42:02.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:02.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:42:02.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:42:02.537 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.537 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.537 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.537 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:02.537 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:02.537 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.874148779, 2024-04-25T22:42:02.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:42:02.537 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:02.537 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:02.538 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:02.538 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:02.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:02.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:02.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:02.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:02.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:02.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:42:02.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:42:02.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:02.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:42:02.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:42:02.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:02.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:42:02.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:42:02.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:42:02.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:42:02.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:42:02.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:42:02.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:02.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:42:02.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:42:02.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:42:02.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:42:02.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:02.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:42:02.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:42:02.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:02.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:42:02.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:42:02.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:02.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:42:02.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:42:02.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:02.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:42:02.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:42:02.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:02.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:42:02.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:42:02.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:02.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:42:02.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:42:02.543 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.543 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.543 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.543 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:02.543 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:02.543 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.87404653999999, 2024-04-25T22:42:02.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:42:02.544 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:02.544 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:02.544 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:02.544 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:02.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:02.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:02.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:02.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:02.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:02.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:42:02.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:42:02.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:02.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:42:02.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:42:02.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:02.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:42:02.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:42:02.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:42:02.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:42:02.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:42:02.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:42:02.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:02.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:42:02.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:42:02.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:42:02.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:42:02.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:02.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:42:02.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:42:02.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:02.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:42:02.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:42:02.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:02.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:42:02.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:42:02.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:02.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:42:02.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:42:02.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:02.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:42:02.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:42:02.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:02.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:42:02.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:42:02.549 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.549 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.549 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.550 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:02.550 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:42:02.550 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.87398771700001, 2024-04-25T22:42:02.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:42:02.550 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:02.550 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:02.550 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:02.550 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:02.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:02.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:42:02.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:02.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:42:02.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:02.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:42:02.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:42:02.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:02.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:42:02.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:42:02.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:02.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:42:02.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:42:02.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:42:02.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:42:02.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:42:02.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:42:02.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:02.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:42:02.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:42:02.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:42:02.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:42:02.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:02.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:42:02.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:42:02.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:02.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:42:02.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:42:02.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:02.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:42:02.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:42:02.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:02.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:42:02.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:42:02.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:02.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:42:02.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:42:02.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:02.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:42:02.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:42:02.556 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.556 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.556 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.556 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:02.556 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:42:02.556 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.873908984, 2024-04-25T22:42:02.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:42:02.556 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:02.556 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:02.556 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:02.557 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:02.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:02.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:42:02.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:02.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:42:02.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:02.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:42:02.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:42:02.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:02.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:42:02.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:42:02.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:02.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:42:02.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:42:02.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:42:02.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:42:02.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:42:02.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:42:02.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:02.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:42:02.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:42:02.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:42:02.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:42:02.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:02.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:42:02.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:42:02.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:02.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:42:02.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:42:02.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:02.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:42:02.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:42:02.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:02.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:42:02.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:42:02.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:02.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:42:02.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:42:02.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:02.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:42:02.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:42:02.562 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.562 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.562 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.562 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:02.562 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:42:02.562 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.873869571, 2024-04-25T22:42:02.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:42:02.563 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:02.563 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:02.563 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:02.563 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:02.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:02.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:42:02.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:02.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:42:02.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:02.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:42:02.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:42:02.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:02.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:42:02.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:42:02.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:02.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:42:02.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:42:02.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:42:02.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:42:02.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:42:02.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:42:02.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:02.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:42:02.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:42:02.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:42:02.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:42:02.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:02.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:42:02.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:42:02.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:02.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:42:02.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:42:02.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:02.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:42:02.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:42:02.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:02.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:42:02.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:42:02.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:02.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:42:02.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:42:02.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:02.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:42:02.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:42:02.568 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.568 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.568 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.568 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:02.568 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:42:02.568 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.873799725, 2024-04-25T22:42:02.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:42:02.568 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:02.569 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:02.569 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:02.569 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:02.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:02.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:42:02.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:02.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:42:02.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:02.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:42:02.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:42:02.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:02.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:42:02.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:42:02.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:02.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:42:02.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:42:02.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:42:02.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:42:02.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:42:02.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:42:02.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:02.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:42:02.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:42:02.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:42:02.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:42:02.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:02.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:42:02.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:42:02.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:02.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:42:02.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:42:02.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:02.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:42:02.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:42:02.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:02.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:42:02.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:42:02.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:02.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:42:02.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:42:02.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:02.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:42:02.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:42:02.574 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.574 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.574 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.574 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:02.574 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:42:02.574 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.873749988, 2024-04-25T22:42:02.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:42:02.574 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:02.574 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:02.574 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:02.574 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:02.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:02.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:42:02.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:02.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:42:02.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:02.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:42:02.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:02.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:02.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:42:02.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:42:02.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:02.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:42:02.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:42:02.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:42:02.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:42:02.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:42:02.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:42:02.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:02.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:42:02.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:42:02.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:42:02.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:42:02.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:02.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:42:02.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:42:02.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:02.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:42:02.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:42:02.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:02.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:42:02.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:42:02.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:02.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:42:02.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:42:02.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:02.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:02.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:42:02.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:02.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:42:02.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:42:02.579 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.579 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.579 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.579 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:02.580 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:02.580 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.87366537299999, 2024-04-25T22:42:02.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:42:02.580 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:02.580 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:02.580 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:02.580 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:02.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:02.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:02.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:02.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:02.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:02.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:42:02.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:02.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:02.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:42:02.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:42:02.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:02.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:42:02.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:42:02.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:42:02.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:42:02.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:42:02.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:42:02.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:02.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:42:02.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:42:02.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:42:02.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:42:02.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:02.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:42:02.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:42:02.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:02.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:42:02.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:42:02.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:02.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:42:02.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:42:02.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:02.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:42:02.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:42:02.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:02.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:42:02.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:42:02.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:02.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:42:02.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:42:02.585 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.585 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.585 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.585 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:02.585 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:42:02.585 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.87360172299999, 2024-04-25T22:42:02.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:42:02.585 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:02.585 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:02.586 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:02.586 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:02.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:02.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:42:02.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:02.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:42:02.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:02.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:42:02.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:42:02.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:02.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:42:02.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:42:02.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:02.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:42:02.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:42:02.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:42:02.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:42:02.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:42:02.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:42:02.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:02.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:42:02.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:42:02.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:42:02.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:42:02.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:02.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:42:02.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:42:02.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:02.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:42:02.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:42:02.589 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.589 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.590 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.590 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:42:02.590 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:42:02.590 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 107.866598193, 2024-04-25T22:42:02.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:42:02.590 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:02.590 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:02.590 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:02.590 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:02.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:02.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:42:02.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:02.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:42:02.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:02.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:02.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:42:02.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:42:02.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:02.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:42:02.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:42:02.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:02.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:42:02.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:42:02.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:42:02.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:42:02.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:02.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:42:02.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:42:02.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:02.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:42:02.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:42:02.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:02.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:42:02.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:42:02.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:02.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:02.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:02.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:42:02.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:42:02.594 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.594 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.594 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.594 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:02.594 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:02.594 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:02.595 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:02.596 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:02.591+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:02.697 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:02.691+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:02.734 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:02.734 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:02.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:02.734 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:6393 4.1a e60/17 4:5b97708b:::10000001d43.00000000:head v 60'103, mlcod=60'101)", 2024-04-25T22:42:02.734 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:02.733755+0000", 2024-04-25T22:42:02.734 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.00051579700000000002, 2024-04-25T22:42:02.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00056953600000000004, 2024-04-25T22:42:02.734 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:02.734 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:02.734 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:02.734 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:02.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:02.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:02.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.733755+0000", 2024-04-25T22:42:02.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:02.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:02.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:02.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:02.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.733755+0000", 2024-04-25T22:42:02.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:02.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:02.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:02.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:02.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.733763+0000", 2024-04-25T22:42:02.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7129999999999994e-06 2024-04-25T22:42:02.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:02.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:02.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:02.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.733774+0000", 2024-04-25T22:42:02.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0502999999999999e-05 2024-04-25T22:42:02.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:02.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:02.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:02.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.733792+0000", 2024-04-25T22:42:02.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8366e-05 2024-04-25T22:42:02.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:02.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:02.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.733804+0000", 2024-04-25T22:42:02.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1756000000000001e-05 2024-04-25T22:42:02.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:02.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:02.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:02.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.733873+0000", 2024-04-25T22:42:02.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8625000000000001e-05 2024-04-25T22:42:02.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:02.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:02.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:02.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.733893+0000", 2024-04-25T22:42:02.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0339e-05 2024-04-25T22:42:02.737 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:02.737 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:02.737 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:02.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:02.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:02.737 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:6394 4.37 4.3a658337 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-25T22:42:02.737 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:02.734253+0000", 2024-04-25T22:42:02.737 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.8006999999999999e-05, 2024-04-25T22:42:02.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020221200000000001, 2024-04-25T22:42:02.738 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:02.738 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:02.738 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:42:02.738 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:02.738 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:02.738 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:02.738 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 6394 2024-04-25T22:42:02.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:02.738 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:02.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:02.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:02.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.734253+0000", 2024-04-25T22:42:02.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:02.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:02.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:02.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:02.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.734253+0000", 2024-04-25T22:42:02.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:02.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:02.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:02.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:02.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.734255+0000", 2024-04-25T22:42:02.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.26e-06 2024-04-25T22:42:02.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:02.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:02.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:02.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.734267+0000", 2024-04-25T22:42:02.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2272999999999999e-05 2024-04-25T22:42:02.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:02.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:02.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:02.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.734299+0000", 2024-04-25T22:42:02.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1662999999999998e-05 2024-04-25T22:42:02.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:02.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:02.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:02.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.734317+0000", 2024-04-25T22:42:02.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:42:02.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:02.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:02.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:02.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.734453+0000", 2024-04-25T22:42:02.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013515900000000001 2024-04-25T22:42:02.741 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:02.741 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:02.741 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:02.741 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:02.741 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-25T22:42:02.741 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 2 2024-04-25T22:42:02.741 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:02.750 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:02.798 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:02.796+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:02.898 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:02.895+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:02.929 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:02.929 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:02.929 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:42:02.929 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:42:02.929 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:02.944 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:03.030 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:03.027+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:03.100 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:03.095+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:03.122 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:03.122 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:03.122 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:03.122 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:03.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.122 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.122 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:03.123 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 108.52332069000001, 2024-04-25T22:42:03.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:03.123 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.123 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.123 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.123 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.123 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.123 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:03.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.123 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.123 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:03.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.124 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.124 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:03.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:03.124 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.124 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:03.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:03.124 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.125 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.125 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:03.125 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:03.125 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.125 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.125 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.125 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:03.125 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:03.125 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.125 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.125 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.125 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:03.125 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:03.125 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.126 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:03.126 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:03.126 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:03.126 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.126 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.126 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:03.126 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:03.126 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.126 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.126 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:03.126 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:03.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:03.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:03.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:03.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:03.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:03.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:03.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:03.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:03.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:03.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:03.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:03.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:03.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:03.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:03.128 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.128 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.128 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.129 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.129 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:03.129 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 108.523183434, 2024-04-25T22:42:03.129 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:03.129 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.129 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.129 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.129 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.129 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.129 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:03.129 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:03.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:03.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:03.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:03.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:03.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.131 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.131 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:03.131 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:03.131 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.131 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.131 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:03.131 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:03.131 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.131 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.131 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:03.131 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:03.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:03.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:03.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:03.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:03.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:03.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:03.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:03.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:03.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:03.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:03.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:03.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:03.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:03.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:03.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:03.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:03.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:03.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:03.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:03.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:03.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:03.134 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.134 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.134 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.135 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.135 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.135 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.135 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:42:03.135 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 108.52309588200001, 2024-04-25T22:42:03.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:42:03.135 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.135 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.135 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.135 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.135 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.135 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.135 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:42:03.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.136 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:42:03.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.136 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:42:03.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:42:03.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.136 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:42:03.137 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:42:03.137 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.137 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.137 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.137 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:42:03.137 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:42:03.137 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.137 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.137 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.137 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:42:03.137 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:42:03.137 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.137 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.137 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.137 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:42:03.138 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:42:03.138 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.138 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.138 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:03.138 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:42:03.138 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:42:03.138 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.138 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.141 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.141 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:42:03.142 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:42:03.142 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.142 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.142 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.142 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:42:03.142 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:42:03.142 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.142 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.142 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:03.142 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:42:03.142 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:42:03.142 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.142 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.142 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:03.143 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:42:03.143 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:42:03.143 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.143 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.143 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.143 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:42:03.143 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:42:03.143 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.143 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.143 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:03.143 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:42:03.143 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:42:03.143 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.144 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.144 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:03.144 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:42:03.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:42:03.144 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.144 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.144 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.144 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.144 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.144 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.144 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:03.144 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 108.52299205600001, 2024-04-25T22:42:03.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:42:03.145 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.145 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.145 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.145 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.145 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:03.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.145 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:03.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.146 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.146 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.146 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:42:03.146 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:42:03.146 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.146 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.146 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.146 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:42:03.146 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:42:03.146 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.146 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.146 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.146 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:42:03.146 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:42:03.147 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.147 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.147 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.147 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:42:03.147 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:42:03.147 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.147 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.147 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.147 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:42:03.147 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:42:03.147 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.147 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.147 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:03.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:42:03.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:42:03.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:42:03.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:42:03.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:42:03.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:42:03.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:42:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:42:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:42:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:42:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:42:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:42:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:42:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:42:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:42:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:42:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.151 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.151 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:03.151 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 108.52292326600001, 2024-04-25T22:42:03.151 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:03.151 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.151 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.151 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.151 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.151 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.151 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.151 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:03.151 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.151 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.151 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.152 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.152 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:03.152 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.152 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.152 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.152 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.152 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:03.152 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:03.152 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.152 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.152 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.152 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:03.152 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:03.152 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.152 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.153 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.153 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:03.153 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:03.153 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.153 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.153 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.153 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:03.153 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:03.153 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.153 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.153 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.153 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:03.153 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:03.153 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:03.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:03.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:03.154 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:03.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:03.154 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:03.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:03.155 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.155 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.155 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:03.155 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:03.155 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:03.155 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.155 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.155 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:03.155 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:03.155 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:03.155 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.155 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.155 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.155 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:03.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:03.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:03.156 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:03.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:03.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:03.156 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:03.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:03.156 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.156 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.156 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.157 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.157 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.157 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.157 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:03.157 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 108.52285418, 2024-04-25T22:42:03.157 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:42:03.157 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.157 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.157 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.157 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.157 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.157 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.157 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:03.157 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.158 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.158 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.158 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.158 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:03.158 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.158 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.158 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.158 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.158 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:42:03.158 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:42:03.158 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.158 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.158 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.158 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:42:03.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:42:03.159 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:42:03.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:42:03.159 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:42:03.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:42:03.159 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.160 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:42:03.160 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:42:03.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.160 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:03.160 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:42:03.160 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:42:03.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.160 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.160 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:42:03.160 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:42:03.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.160 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:42:03.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:42:03.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:03.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:42:03.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:42:03.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:03.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:42:03.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:42:03.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:42:03.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:42:03.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:03.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:42:03.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:42:03.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:03.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:42:03.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:42:03.162 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.163 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.163 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.163 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.163 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.163 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:03.163 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 108.522758067, 2024-04-25T22:42:03.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:03.163 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.163 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.163 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:03.163 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.163 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.164 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:03.164 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.164 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.164 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.164 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:03.164 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.164 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.164 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.164 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:03.164 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:03.164 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:03.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:03.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:03.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:03.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:03.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:03.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:03.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:03.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:03.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:03.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:03.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:03.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:03.167 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.167 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.167 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:03.167 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:03.167 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.167 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:03.167 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:03.167 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:03.167 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.167 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.167 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.167 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.168 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.168 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.168 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:03.168 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 108.522692405, 2024-04-25T22:42:03.168 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:03.168 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.168 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.168 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:03.168 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.168 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.168 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.168 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:03.168 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.168 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:03.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:03.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:03.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:03.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:03.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:03.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:03.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:03.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:03.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:03.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:03.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:03.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:03.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:03.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:03.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:03.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.172 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:03.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:03.172 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.172 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.172 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:03.172 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:03.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:03.172 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.172 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.172 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.172 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.172 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.172 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.172 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:03.173 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 108.522623278, 2024-04-25T22:42:03.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:42:03.173 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.173 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.173 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:03.173 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:03.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:03.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:42:03.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:42:03.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:42:03.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:42:03.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:42:03.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:42:03.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:42:03.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:42:03.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:42:03.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:42:03.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:03.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:42:03.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:42:03.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:42:03.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:42:03.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:42:03.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:42:03.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:03.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:42:03.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:42:03.177 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.177 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.177 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.177 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-25T22:42:03.177 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:42:03.177 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 9.1238254189999992, 2024-04-25T22:42:03.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.02435211, 2024-04-25T22:42:03.177 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.177 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.177 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.178 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:03.178 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:03.178 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:03.178 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 5 2024-04-25T22:42:03.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.178 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:42:03.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:42:03.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995113+0000", 2024-04-25T22:42:03.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2760000000000001e-06 2024-04-25T22:42:03.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002825+0000", 2024-04-25T22:42:03.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077127000000000003 2024-04-25T22:42:03.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.180 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002852+0000", 2024-04-25T22:42:03.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6570000000000001e-05 2024-04-25T22:42:03.180 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.180 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.180 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.180 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002866+0000", 2024-04-25T22:42:03.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4144999999999999e-05 2024-04-25T22:42:03.180 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.180 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.180 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.180 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002947+0000", 2024-04-25T22:42:03.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0740000000000003e-05 2024-04-25T22:42:03.180 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.180 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.003049+0000", 2024-04-25T22:42:03.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101829 2024-04-25T22:42:03.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:03.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019091+0000", 2024-04-25T22:42:03.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016042638000000001 2024-04-25T22:42:03.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:03.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019227+0000", 2024-04-25T22:42:03.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000135826 2024-04-25T22:42:03.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:03.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019462+0000", 2024-04-25T22:42:03.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000234386 2024-04-25T22:42:03.182 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.182 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.182 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.182 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:73 3.b 3:d5c7a900:::200.00000003:head [write 920531~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:03.182 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.598864+0000", 2024-04-25T22:42:03.182 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 3.5200711930000002, 2024-04-25T22:42:03.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016865775999999999, 2024-04-25T22:42:03.182 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.183 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.183 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.183 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598864+0000", 2024-04-25T22:42:03.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598864+0000", 2024-04-25T22:42:03.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.184 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.184 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598865+0000", 2024-04-25T22:42:03.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2299999999999999e-07 2024-04-25T22:42:03.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.184 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.184 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598880+0000", 2024-04-25T22:42:03.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5051999999999999e-05 2024-04-25T22:42:03.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.184 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.184 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598897+0000", 2024-04-25T22:42:03.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7748999999999999e-05 2024-04-25T22:42:03.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598909+0000", 2024-04-25T22:42:03.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1187e-05 2024-04-25T22:42:03.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.605650+0000", 2024-04-25T22:42:03.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067413070000000002 2024-04-25T22:42:03.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.605741+0000", 2024-04-25T22:42:03.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1181999999999995e-05 2024-04-25T22:42:03.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:03.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.605878+0000", 2024-04-25T22:42:03.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013704200000000001 2024-04-25T22:42:03.186 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:03.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611026+0000", 2024-04-25T22:42:03.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0051482189999999999 2024-04-25T22:42:03.186 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615619+0000", 2024-04-25T22:42:03.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0045930900000000002 2024-04-25T22:42:03.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:03.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615683+0000", 2024-04-25T22:42:03.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3200999999999993e-05 2024-04-25T22:42:03.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:03.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615729+0000", 2024-04-25T22:42:03.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6823999999999998e-05 2024-04-25T22:42:03.187 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.187 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.187 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.188 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.188 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.188 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:74 3.b 3:d5c7a900:::200.00000003:head [write 921931~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:03.188 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.598924+0000", 2024-04-25T22:42:03.188 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 3.5200106419999999, 2024-04-25T22:42:03.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016937026000000001, 2024-04-25T22:42:03.188 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.188 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.188 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.188 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.188 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.188 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.188 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598924+0000", 2024-04-25T22:42:03.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598924+0000", 2024-04-25T22:42:03.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598925+0000", 2024-04-25T22:42:03.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0020000000000001e-06 2024-04-25T22:42:03.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598934+0000", 2024-04-25T22:42:03.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6270000000000006e-06 2024-04-25T22:42:03.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598948+0000", 2024-04-25T22:42:03.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3953e-05 2024-04-25T22:42:03.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598975+0000", 2024-04-25T22:42:03.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6673999999999999e-05 2024-04-25T22:42:03.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606235+0000", 2024-04-25T22:42:03.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.007260463 2024-04-25T22:42:03.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606332+0000", 2024-04-25T22:42:03.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7252999999999999e-05 2024-04-25T22:42:03.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:03.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606478+0000", 2024-04-25T22:42:03.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014544100000000001 2024-04-25T22:42:03.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:03.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611041+0000", 2024-04-25T22:42:03.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0045634359999999997 2024-04-25T22:42:03.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615781+0000", 2024-04-25T22:42:03.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0047398750000000002 2024-04-25T22:42:03.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:03.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615823+0000", 2024-04-25T22:42:03.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1927e-05 2024-04-25T22:42:03.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.193 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:03.193 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615861+0000", 2024-04-25T22:42:03.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8374999999999998e-05 2024-04-25T22:42:03.193 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.193 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.193 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.193 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.193 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:75 3.b 3:d5c7a900:::200.00000003:head [write 923330~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:03.193 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.598989+0000", 2024-04-25T22:42:03.193 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 3.5199456169999999, 2024-04-25T22:42:03.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017059059000000001, 2024-04-25T22:42:03.194 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.194 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.194 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.194 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598989+0000", 2024-04-25T22:42:03.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598989+0000", 2024-04-25T22:42:03.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598990+0000", 2024-04-25T22:42:03.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0279999999999999e-06 2024-04-25T22:42:03.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599003+0000", 2024-04-25T22:42:03.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2306999999999999e-05 2024-04-25T22:42:03.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599017+0000", 2024-04-25T22:42:03.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4064e-05 2024-04-25T22:42:03.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599041+0000", 2024-04-25T22:42:03.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4054999999999999e-05 2024-04-25T22:42:03.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606871+0000", 2024-04-25T22:42:03.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0078301580000000003 2024-04-25T22:42:03.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606928+0000", 2024-04-25T22:42:03.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7479999999999999e-05 2024-04-25T22:42:03.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:03.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607019+0000", 2024-04-25T22:42:03.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0761999999999996e-05 2024-04-25T22:42:03.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:03.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611057+0000", 2024-04-25T22:42:03.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040381260000000004 2024-04-25T22:42:03.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615923+0000", 2024-04-25T22:42:03.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048658319999999996 2024-04-25T22:42:03.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:03.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615996+0000", 2024-04-25T22:42:03.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3108000000000005e-05 2024-04-25T22:42:03.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.198 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:03.198 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616048+0000", 2024-04-25T22:42:03.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2138999999999997e-05 2024-04-25T22:42:03.198 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.198 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.199 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.199 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.199 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:76 3.b 3:d5c7a900:::200.00000003:head [write 924729~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:03.199 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.599056+0000", 2024-04-25T22:42:03.199 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 3.5198785729999997, 2024-04-25T22:42:03.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017101028000000001, 2024-04-25T22:42:03.199 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.199 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.199 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.199 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599056+0000", 2024-04-25T22:42:03.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.200 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599056+0000", 2024-04-25T22:42:03.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.200 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599057+0000", 2024-04-25T22:42:03.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1500000000000003e-07 2024-04-25T22:42:03.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.200 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599063+0000", 2024-04-25T22:42:03.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6930000000000004e-06 2024-04-25T22:42:03.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599085+0000", 2024-04-25T22:42:03.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2544e-05 2024-04-25T22:42:03.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599098+0000", 2024-04-25T22:42:03.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2425999999999999e-05 2024-04-25T22:42:03.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607316+0000", 2024-04-25T22:42:03.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082178489999999993 2024-04-25T22:42:03.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607452+0000", 2024-04-25T22:42:03.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000135885 2024-04-25T22:42:03.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:03.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607602+0000", 2024-04-25T22:42:03.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015049200000000001 2024-04-25T22:42:03.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:03.203 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611073+0000", 2024-04-25T22:42:03.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0034707079999999999 2024-04-25T22:42:03.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.203 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616091+0000", 2024-04-25T22:42:03.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0050181779999999999 2024-04-25T22:42:03.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.203 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:03.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616121+0000", 2024-04-25T22:42:03.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0399000000000002e-05 2024-04-25T22:42:03.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:03.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616157+0000", 2024-04-25T22:42:03.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6038999999999998e-05 2024-04-25T22:42:03.204 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.204 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.204 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.204 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:77 3.b 3:d5c7a900:::200.00000003:head [write 926128~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:03.204 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.599112+0000", 2024-04-25T22:42:03.204 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 3.5198224050000002, 2024-04-25T22:42:03.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017211087, 2024-04-25T22:42:03.205 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.205 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.205 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.205 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599112+0000", 2024-04-25T22:42:03.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599112+0000", 2024-04-25T22:42:03.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.206 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599113+0000", 2024-04-25T22:42:03.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7499999999999999e-07 2024-04-25T22:42:03.206 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599119+0000", 2024-04-25T22:42:03.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0349999999999998e-06 2024-04-25T22:42:03.206 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599138+0000", 2024-04-25T22:42:03.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8345000000000001e-05 2024-04-25T22:42:03.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.207 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599150+0000", 2024-04-25T22:42:03.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1902000000000001e-05 2024-04-25T22:42:03.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.207 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608267+0000", 2024-04-25T22:42:03.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091174380000000003 2024-04-25T22:42:03.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.207 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608341+0000", 2024-04-25T22:42:03.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4029000000000006e-05 2024-04-25T22:42:03.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.208 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:03.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608435+0000", 2024-04-25T22:42:03.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3541000000000004e-05 2024-04-25T22:42:03.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.208 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:03.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.613682+0000", 2024-04-25T22:42:03.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0052474829999999998 2024-04-25T22:42:03.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616211+0000", 2024-04-25T22:42:03.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025291490000000001 2024-04-25T22:42:03.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:03.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616276+0000", 2024-04-25T22:42:03.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4590000000000003e-05 2024-04-25T22:42:03.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:03.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616324+0000", 2024-04-25T22:42:03.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7700000000000001e-05 2024-04-25T22:42:03.210 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.210 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.210 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.210 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:78 3.b 3:d5c7a900:::200.00000003:head [write 927532~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:03.210 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.599164+0000", 2024-04-25T22:42:03.210 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 3.5197709580000001, 2024-04-25T22:42:03.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017312029999999999, 2024-04-25T22:42:03.210 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.210 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.210 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.210 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599164+0000", 2024-04-25T22:42:03.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599164+0000", 2024-04-25T22:42:03.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599165+0000", 2024-04-25T22:42:03.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6899999999999996e-07 2024-04-25T22:42:03.212 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.212 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.212 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599177+0000", 2024-04-25T22:42:03.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2461e-05 2024-04-25T22:42:03.212 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.212 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.212 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599191+0000", 2024-04-25T22:42:03.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3888e-05 2024-04-25T22:42:03.212 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.212 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599206+0000", 2024-04-25T22:42:03.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4346e-05 2024-04-25T22:42:03.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608700+0000", 2024-04-25T22:42:03.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0094949140000000001 2024-04-25T22:42:03.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608786+0000", 2024-04-25T22:42:03.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5587000000000006e-05 2024-04-25T22:42:03.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:03.214 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608921+0000", 2024-04-25T22:42:03.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013478900000000001 2024-04-25T22:42:03.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.214 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:03.214 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.613698+0000", 2024-04-25T22:42:03.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0047773859999999998 2024-04-25T22:42:03.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.214 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.214 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616386+0000", 2024-04-25T22:42:03.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0026877770000000001 2024-04-25T22:42:03.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.215 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:03.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616440+0000", 2024-04-25T22:42:03.215 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4490000000000002e-05 2024-04-25T22:42:03.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.215 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:03.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616476+0000", 2024-04-25T22:42:03.215 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5522999999999999e-05 2024-04-25T22:42:03.215 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.215 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.215 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.215 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:80 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:03.216 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.611504+0000", 2024-04-25T22:42:03.216 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 3.5074304930000002, 2024-04-25T22:42:03.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015504957, 2024-04-25T22:42:03.216 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.216 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.216 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.216 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611504+0000", 2024-04-25T22:42:03.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611504+0000", 2024-04-25T22:42:03.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.217 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611506+0000", 2024-04-25T22:42:03.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.733e-06 2024-04-25T22:42:03.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.217 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611585+0000", 2024-04-25T22:42:03.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8634999999999995e-05 2024-04-25T22:42:03.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611602+0000", 2024-04-25T22:42:03.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7011e-05 2024-04-25T22:42:03.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611611+0000", 2024-04-25T22:42:03.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1959999999999997e-06 2024-04-25T22:42:03.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611685+0000", 2024-04-25T22:42:03.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3711e-05 2024-04-25T22:42:03.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611780+0000", 2024-04-25T22:42:03.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5605000000000004e-05 2024-04-25T22:42:03.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:03.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616401+0000", 2024-04-25T22:42:03.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046204549999999999 2024-04-25T22:42:03.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.626036+0000", 2024-04-25T22:42:03.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0096348070000000004 2024-04-25T22:42:03.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:03.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.626818+0000", 2024-04-25T22:42:03.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00078275199999999995 2024-04-25T22:42:03.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:03.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.626924+0000", 2024-04-25T22:42:03.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010579 2024-04-25T22:42:03.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:03.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.627009+0000", 2024-04-25T22:42:03.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5261999999999998e-05 2024-04-25T22:42:03.221 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.221 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.221 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.221 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:109 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:42:03.221 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:02.620631+0000", 2024-04-25T22:42:03.221 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.49830392299999998, 2024-04-25T22:42:03.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027780309999999999, 2024-04-25T22:42:03.221 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.221 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.221 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.222 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.222 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.222 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620631+0000", 2024-04-25T22:42:03.222 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.222 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.222 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.222 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620631+0000", 2024-04-25T22:42:03.222 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.222 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.222 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.222 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620632+0000", 2024-04-25T22:42:03.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.364e-06 2024-04-25T22:42:03.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620751+0000", 2024-04-25T22:42:03.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011838299999999999 2024-04-25T22:42:03.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620764+0000", 2024-04-25T22:42:03.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3203e-05 2024-04-25T22:42:03.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620771+0000", 2024-04-25T22:42:03.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4080000000000001e-06 2024-04-25T22:42:03.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620840+0000", 2024-04-25T22:42:03.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8696999999999996e-05 2024-04-25T22:42:03.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620919+0000", 2024-04-25T22:42:03.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9379e-05 2024-04-25T22:42:03.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:03.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.626976+0000", 2024-04-25T22:42:03.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060565610000000002 2024-04-25T22:42:03.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:03.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643495+0000", 2024-04-25T22:42:03.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016518950000000001 2024-04-25T22:42:03.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.648308+0000", 2024-04-25T22:42:03.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048133799999999999 2024-04-25T22:42:03.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:03.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.648369+0000", 2024-04-25T22:42:03.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0285000000000003e-05 2024-04-25T22:42:03.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:03.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.648411+0000", 2024-04-25T22:42:03.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2700000000000001e-05 2024-04-25T22:42:03.226 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.226 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.226 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.226 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:6294 4.2d 4:b5ee1071:::10000001cd6.00000000:head [write 0~6362] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-25T22:42:03.227 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:02.625474+0000", 2024-04-25T22:42:03.227 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.49346089999999998, 2024-04-25T22:42:03.227 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018135539999999999, 2024-04-25T22:42:03.227 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.227 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.227 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.227 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:03.227 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:03.227 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:03.227 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 6294 2024-04-25T22:42:03.227 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.227 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.227 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.227 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.227 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625474+0000", 2024-04-25T22:42:03.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625474+0000", 2024-04-25T22:42:03.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625475+0000", 2024-04-25T22:42:03.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6899999999999996e-07 2024-04-25T22:42:03.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625485+0000", 2024-04-25T22:42:03.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:42:03.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625493+0000", 2024-04-25T22:42:03.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2800000000000003e-06 2024-04-25T22:42:03.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625499+0000", 2024-04-25T22:42:03.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7830000000000004e-06 2024-04-25T22:42:03.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625555+0000", 2024-04-25T22:42:03.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6776e-05 2024-04-25T22:42:03.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625685+0000", 2024-04-25T22:42:03.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000129519 2024-04-25T22:42:03.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:03.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643438+0000", 2024-04-25T22:42:03.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017753023 2024-04-25T22:42:03.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:03.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643510+0000", 2024-04-25T22:42:03.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2020999999999994e-05 2024-04-25T22:42:03.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:03.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643610+0000", 2024-04-25T22:42:03.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9543999999999994e-05 2024-04-25T22:42:03.231 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.231 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.231 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.231 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:6295 4.3c e60/17 4:3da972f4:::10000001cd7.00000000:head v 60'76, mlcod=60'74)", 2024-04-25T22:42:03.231 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:02.627611+0000", 2024-04-25T22:42:03.231 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.49132437000000001, 2024-04-25T22:42:03.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015914080000000001, 2024-04-25T22:42:03.232 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.232 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.232 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.232 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.627611+0000", 2024-04-25T22:42:03.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.627611+0000", 2024-04-25T22:42:03.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.627611+0000", 2024-04-25T22:42:03.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3900000000000003e-07 2024-04-25T22:42:03.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.627621+0000", 2024-04-25T22:42:03.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6700000000000006e-06 2024-04-25T22:42:03.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.233 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.233 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.627634+0000", 2024-04-25T22:42:03.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2361000000000001e-05 2024-04-25T22:42:03.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.627641+0000", 2024-04-25T22:42:03.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5510000000000002e-06 2024-04-25T22:42:03.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.627715+0000", 2024-04-25T22:42:03.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3565000000000005e-05 2024-04-25T22:42:03.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.627739+0000", 2024-04-25T22:42:03.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4351000000000001e-05 2024-04-25T22:42:03.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:03.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643466+0000", 2024-04-25T22:42:03.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015727016999999999 2024-04-25T22:42:03.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:03.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643525+0000", 2024-04-25T22:42:03.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8625999999999997e-05 2024-04-25T22:42:03.235 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.235 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.235 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.236 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.236 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.236 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:03.237 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:03.231+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:03.238 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:03.338 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:03.331+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:03.344 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is set 2024-04-25T22:42:03.377 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:6756 4.20 4:0657f66a:::10000001ee0.00000000:head [write 0~17653 in=17653b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-25T22:42:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:03.374068+0000", 2024-04-25T22:42:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0039968169999999997, 2024-04-25T22:42:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040586550000000004, 2024-04-25T22:42:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:42:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 6756 2024-04-25T22:42:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.374068+0000", 2024-04-25T22:42:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.374068+0000", 2024-04-25T22:42:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.374069+0000", 2024-04-25T22:42:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7499999999999998e-07 2024-04-25T22:42:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.374080+0000", 2024-04-25T22:42:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0892e-05 2024-04-25T22:42:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.374091+0000", 2024-04-25T22:42:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0180000000000001e-05 2024-04-25T22:42:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.374096+0000", 2024-04-25T22:42:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.626e-06 2024-04-25T22:42:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.374170+0000", 2024-04-25T22:42:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3553999999999994e-05 2024-04-25T22:42:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.374343+0000", 2024-04-25T22:42:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000172824 2024-04-25T22:42:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.374474+0000", 2024-04-25T22:42:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000131953 2024-04-25T22:42:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.376704+0000", 2024-04-25T22:42:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022297369999999999 2024-04-25T22:42:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:6757 4.17 e61/57 4:e9713120:::10000001ee2.00000000:head v 61'103, mlcod=60'101)", 2024-04-25T22:42:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:03.377445+0000", 2024-04-25T22:42:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00062063299999999999, 2024-04-25T22:42:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00082564499999999996, 2024-04-25T22:42:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.377445+0000", 2024-04-25T22:42:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.377445+0000", 2024-04-25T22:42:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.377445+0000", 2024-04-25T22:42:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0999999999999998e-07 2024-04-25T22:42:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.377459+0000", 2024-04-25T22:42:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3225e-05 2024-04-25T22:42:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.377471+0000", 2024-04-25T22:42:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2376e-05 2024-04-25T22:42:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.377478+0000", 2024-04-25T22:42:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8889999999999996e-06 2024-04-25T22:42:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.377583+0000", 2024-04-25T22:42:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010524800000000001 2024-04-25T22:42:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.377659+0000", 2024-04-25T22:42:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6470999999999993e-05 2024-04-25T22:42:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:6758 4.2a 4:57fcf282:::10000001ee3.00000000:head [write 0~372 in=372b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-25T22:42:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:03.377966+0000", 2024-04-25T22:42:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8871999999999998e-05, 2024-04-25T22:42:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000405043, 2024-04-25T22:42:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 6758 2024-04-25T22:42:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.377966+0000", 2024-04-25T22:42:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.377966+0000", 2024-04-25T22:42:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.377967+0000", 2024-04-25T22:42:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3699999999999999e-07 2024-04-25T22:42:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.377973+0000", 2024-04-25T22:42:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7690000000000002e-06 2024-04-25T22:42:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.377983+0000", 2024-04-25T22:42:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7459999999999995e-06 2024-04-25T22:42:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.377988+0000", 2024-04-25T22:42:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4450000000000004e-06 2024-04-25T22:42:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.378033+0000", 2024-04-25T22:42:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4388999999999998e-05 2024-04-25T22:42:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:03.378111+0000", 2024-04-25T22:42:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8665000000000007e-05 2024-04-25T22:42:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-25T22:42:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 3 2024-04-25T22:42:03.390 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:03.392 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:03.439 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:03.436+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:03.522 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:03.523 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:03.523 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:42:03.523 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:42:03.523 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:03.538 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:03.581 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:03.580+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:03.640 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:03.636+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:03.715 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:42:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:42:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:42:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.11874580999999, 2024-04-25T22:42:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:42:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:42:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:42:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:42:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:42:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:42:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:42:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:42:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:42:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:42:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:42:03.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:42:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:42:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:42:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:42:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:42:03.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:42:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:42:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:42:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:42:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:42:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:42:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:42:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:42:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:42:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:42:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:42:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:42:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:42:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:42:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.118657797, 2024-04-25T22:42:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:42:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.722 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:42:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:42:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:42:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:42:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:42:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:42:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:42:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:42:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:42:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:42:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:42:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:42:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:42:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:42:03.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:42:03.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:42:03.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:42:03.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:03.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:42:03.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:42:03.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:03.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:42:03.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:42:03.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:42:03.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:42:03.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:03.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:42:03.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:42:03.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:03.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:42:03.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:42:03.728 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.728 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.728 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.728 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.728 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:03.728 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.11858567500001, 2024-04-25T22:42:03.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:42:03.728 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.729 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.729 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.729 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:03.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:03.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:42:03.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:42:03.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:42:03.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:42:03.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:42:03.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:42:03.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:42:03.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:42:03.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:42:03.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:42:03.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:03.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:42:03.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:42:03.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:42:03.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:42:03.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:42:03.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:42:03.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:03.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:42:03.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:42:03.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:42:03.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:42:03.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:03.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:42:03.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:42:03.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:03.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:42:03.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:42:03.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:03.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:42:03.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:42:03.734 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.734 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.734 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.734 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.734 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:03.735 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.11847736199999, 2024-04-25T22:42:03.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:42:03.735 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.735 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.735 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.735 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:03.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:03.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:42:03.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:42:03.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:42:03.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:42:03.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:42:03.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:42:03.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:42:03.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:42:03.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:42:03.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:42:03.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:03.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:42:03.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:42:03.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:42:03.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:42:03.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:42:03.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:42:03.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:03.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:42:03.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:42:03.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:42:03.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:42:03.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:03.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:42:03.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:42:03.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:03.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:42:03.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:42:03.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:03.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:42:03.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:42:03.740 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.740 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.741 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.741 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.741 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:03.741 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.11841070600001, 2024-04-25T22:42:03.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:42:03.741 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.741 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.741 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.741 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:03.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:03.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:42:03.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:42:03.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:42:03.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:42:03.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:42:03.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:42:03.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:42:03.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:42:03.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:42:03.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:42:03.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:03.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:42:03.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:42:03.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:42:03.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:42:03.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:42:03.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:42:03.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:03.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:42:03.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:42:03.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:42:03.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:42:03.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:03.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:42:03.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:42:03.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:03.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:42:03.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:42:03.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:03.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:42:03.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:42:03.747 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.747 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.747 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.747 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.747 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:03.747 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.11832011, 2024-04-25T22:42:03.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:42:03.747 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.747 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.747 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.747 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:03.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:03.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:42:03.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:42:03.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:42:03.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:42:03.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:42:03.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:42:03.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:42:03.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:42:03.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:42:03.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:42:03.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:03.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:42:03.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:42:03.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:42:03.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:42:03.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:42:03.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:42:03.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:03.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:42:03.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:42:03.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:03.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:42:03.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:42:03.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:42:03.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:42:03.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:03.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:42:03.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:42:03.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:03.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:42:03.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:42:03.753 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.753 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.753 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.753 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.753 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:03.753 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.118255537, 2024-04-25T22:42:03.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:42:03.753 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.753 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.754 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.754 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:03.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:03.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:42:03.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:42:03.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:42:03.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:42:03.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:42:03.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:42:03.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:42:03.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:42:03.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:03.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:42:03.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:03.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:42:03.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:42:03.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:42:03.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:42:03.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:42:03.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:42:03.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:03.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:42:03.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:42:03.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:42:03.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:42:03.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:03.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:42:03.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:42:03.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:03.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:42:03.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:42:03.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:03.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:42:03.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:42:03.759 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.759 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.759 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.759 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.759 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:03.759 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.118190114, 2024-04-25T22:42:03.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:42:03.760 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.760 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.760 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.760 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:03.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:03.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:42:03.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:03.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:42:03.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:42:03.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:42:03.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:42:03.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:42:03.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:42:03.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:42:03.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:42:03.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:03.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:42:03.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:42:03.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:42:03.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:42:03.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:42:03.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:42:03.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:03.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:42:03.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:42:03.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:03.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:42:03.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:42:03.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:42:03.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:42:03.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:03.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:42:03.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:42:03.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:03.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:42:03.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:42:03.765 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.765 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.765 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.765 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.765 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:42:03.765 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.118134048, 2024-04-25T22:42:03.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:42:03.766 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.766 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.766 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.766 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:42:03.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:42:03.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:03.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:42:03.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:42:03.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:42:03.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:42:03.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:42:03.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:42:03.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:42:03.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:42:03.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:42:03.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:03.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:42:03.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:42:03.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:42:03.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:42:03.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:42:03.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:42:03.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:03.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:42:03.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:42:03.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:42:03.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:42:03.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:03.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:42:03.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:42:03.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:03.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:42:03.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:42:03.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:03.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:42:03.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:42:03.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.771 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.771 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.771 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:42:03.772 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.118066942, 2024-04-25T22:42:03.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:42:03.772 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.772 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.772 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.772 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:42:03.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:42:03.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:42:03.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:42:03.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:42:03.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:42:03.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:42:03.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:42:03.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:42:03.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:42:03.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:42:03.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:42:03.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:03.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:42:03.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:42:03.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:42:03.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:42:03.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:42:03.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:42:03.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:03.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:42:03.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:42:03.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:42:03.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:42:03.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:03.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:42:03.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:42:03.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:03.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:42:03.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:42:03.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:03.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:42:03.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:42:03.777 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.777 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.777 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.777 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.778 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:03.778 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.118011819, 2024-04-25T22:42:03.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:42:03.778 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.778 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.778 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.778 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:03.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:03.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:42:03.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:42:03.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:42:03.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:42:03.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:42:03.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:42:03.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:42:03.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:42:03.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:42:03.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:42:03.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:03.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:42:03.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:42:03.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:42:03.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:42:03.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:42:03.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:42:03.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:03.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:42:03.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:42:03.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:42:03.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:42:03.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:03.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:42:03.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:42:03.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:03.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:42:03.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:42:03.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:03.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:42:03.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:42:03.783 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.783 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.784 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.784 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.784 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:03.784 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.11790958, 2024-04-25T22:42:03.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:42:03.784 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.784 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.784 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.784 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:03.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:03.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:42:03.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:42:03.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:42:03.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:42:03.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:42:03.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:42:03.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:42:03.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:42:03.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:42:03.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:42:03.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:03.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:42:03.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:42:03.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:42:03.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:42:03.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:42:03.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:42:03.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:03.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:42:03.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:42:03.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:42:03.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:42:03.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:03.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:42:03.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:42:03.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:03.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:42:03.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:42:03.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:03.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:42:03.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:42:03.789 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.790 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.790 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.790 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.790 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:42:03.790 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.117850757, 2024-04-25T22:42:03.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:42:03.790 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.790 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.790 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.790 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:42:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:42:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:42:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:42:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:42:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:42:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:42:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:42:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:42:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:42:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:42:03.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:42:03.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:03.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:42:03.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:42:03.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:42:03.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:42:03.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:42:03.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:42:03.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:03.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:42:03.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:42:03.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:03.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:42:03.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:42:03.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:42:03.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:42:03.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:03.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:42:03.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:42:03.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:03.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:42:03.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:42:03.796 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.796 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.796 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.796 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.796 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:42:03.796 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.117772024, 2024-04-25T22:42:03.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:42:03.796 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.796 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.796 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.796 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:42:03.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:42:03.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:42:03.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:42:03.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:42:03.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:42:03.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:42:03.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:42:03.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:42:03.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:42:03.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:42:03.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:42:03.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:03.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:42:03.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:42:03.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:42:03.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:42:03.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:42:03.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:42:03.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:03.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:42:03.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:42:03.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:03.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:42:03.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:42:03.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:42:03.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:42:03.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:03.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:42:03.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:42:03.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:03.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:42:03.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:42:03.802 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.802 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.802 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.802 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.802 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:42:03.802 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.11773261099999, 2024-04-25T22:42:03.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:42:03.803 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.803 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.803 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.803 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:42:03.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:42:03.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:42:03.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:42:03.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:42:03.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:42:03.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:42:03.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:42:03.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:42:03.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:42:03.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:42:03.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:42:03.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:03.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:42:03.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:42:03.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:42:03.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:42:03.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:42:03.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:42:03.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:03.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:42:03.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:42:03.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:42:03.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:42:03.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:03.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:42:03.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:42:03.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:03.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:42:03.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:42:03.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:03.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:42:03.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:42:03.808 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.808 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.808 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.808 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.808 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:42:03.808 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.11766276500001, 2024-04-25T22:42:03.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:42:03.809 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.809 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.809 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.809 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:42:03.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:42:03.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:42:03.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:42:03.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:42:03.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:42:03.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:42:03.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:42:03.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:42:03.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:42:03.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:42:03.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:42:03.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:03.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:42:03.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:42:03.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:42:03.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:42:03.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:42:03.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:42:03.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:03.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:42:03.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:42:03.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:42:03.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:42:03.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:03.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:42:03.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:42:03.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:03.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:42:03.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:42:03.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:03.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:42:03.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:42:03.814 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.814 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.815 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.815 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.815 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:42:03.815 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.11761302799999, 2024-04-25T22:42:03.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:42:03.815 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.815 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.815 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.815 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:42:03.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:42:03.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:42:03.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:03.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:42:03.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:42:03.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:42:03.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:42:03.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:42:03.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:42:03.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:42:03.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:42:03.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:03.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:42:03.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:42:03.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:42:03.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:42:03.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:42:03.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:42:03.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:03.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:42:03.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:42:03.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:03.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:42:03.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:42:03.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:42:03.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:42:03.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:03.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:03.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:42:03.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:03.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:42:03.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:42:03.821 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.821 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.821 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.821 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.821 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:03.821 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.117528413, 2024-04-25T22:42:03.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:42:03.821 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.821 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.821 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.821 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:03.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:03.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:42:03.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:03.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:42:03.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:42:03.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:42:03.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:42:03.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:42:03.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:42:03.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:42:03.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:42:03.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:03.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:42:03.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:42:03.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:42:03.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:42:03.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:42:03.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:42:03.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:03.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:42:03.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:42:03.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:03.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:42:03.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:42:03.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:03.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:42:03.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:42:03.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:03.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:42:03.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:42:03.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:03.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:42:03.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:42:03.827 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.827 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.827 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.827 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:03.827 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:42:03.827 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.117464763, 2024-04-25T22:42:03.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:42:03.828 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.828 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.828 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:03.828 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:42:03.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:42:03.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:42:03.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:42:03.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:42:03.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:42:03.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:42:03.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:42:03.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:42:03.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:42:03.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:42:03.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:42:03.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:03.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:42:03.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:42:03.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:42:03.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:42:03.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:42:03.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:42:03.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:03.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:42:03.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:42:03.832 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.832 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.832 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.832 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:42:03.832 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:42:03.832 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 109.110461233, 2024-04-25T22:42:03.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:42:03.832 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:03.832 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:03.832 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.833 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:03.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:03.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:42:03.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:03.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:42:03.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:03.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:03.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:42:03.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:42:03.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:03.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:42:03.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:42:03.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:03.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:42:03.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:42:03.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:42:03.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:42:03.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:03.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:42:03.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:42:03.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:03.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:42:03.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:42:03.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:03.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:42:03.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:42:03.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:03.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:03.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:03.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:42:03.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:42:03.836 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.836 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.836 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.836 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:03.836 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:03.836 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:03.838 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:03.839 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:03.831+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:03.938 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:03.935+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:03.977 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:03.977 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:03.977 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.977 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:7138 4.2c e61/17 4:3745beea:::100000020a4.00000000:head v 61'122, mlcod=61'120)", 2024-04-25T22:42:03.977 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:03.976297+0000", 2024-04-25T22:42:03.977 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.001311172, 2024-04-25T22:42:03.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001368885, 2024-04-25T22:42:03.978 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.978 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.978 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:03.978 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.976297+0000", 2024-04-25T22:42:03.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.978 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.978 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.978 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.978 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.976297+0000", 2024-04-25T22:42:03.978 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.979 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.979 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.976305+0000", 2024-04-25T22:42:03.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4900000000000003e-06 2024-04-25T22:42:03.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.979 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.979 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.976320+0000", 2024-04-25T22:42:03.979 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4766999999999999e-05 2024-04-25T22:42:03.979 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.979 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.979 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.979 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.976341+0000", 2024-04-25T22:42:03.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1052000000000001e-05 2024-04-25T22:42:03.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.976352+0000", 2024-04-25T22:42:03.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1416999999999999e-05 2024-04-25T22:42:03.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.976463+0000", 2024-04-25T22:42:03.980 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011085 2024-04-25T22:42:03.980 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.980 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.980 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.980 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.976499+0000", 2024-04-25T22:42:03.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5836e-05 2024-04-25T22:42:03.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.981 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:03.981 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.977634+0000", 2024-04-25T22:42:03.981 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001135343 2024-04-25T22:42:03.981 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.981 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.981 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.981 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.981 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.981 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:7139 4.4 4:21cccb2c:::100000020a5.00000000:head [write 0~2865 in=2865b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-25T22:42:03.981 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:03.976550+0000", 2024-04-25T22:42:03.981 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0010589950000000001, 2024-04-25T22:42:03.982 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013411779999999999, 2024-04-25T22:42:03.982 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:03.982 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:03.982 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:03.982 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:03.982 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:03.982 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:03.982 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 7139 2024-04-25T22:42:03.982 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.982 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:03.982 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.982 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:03.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.976550+0000", 2024-04-25T22:42:03.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:03.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.976550+0000", 2024-04-25T22:42:03.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:03.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.983 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:03.983 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.976552+0000", 2024-04-25T22:42:03.983 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1169999999999998e-06 2024-04-25T22:42:03.983 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.983 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.984 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:03.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.976563+0000", 2024-04-25T22:42:03.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1473e-05 2024-04-25T22:42:03.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.984 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:03.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.976590+0000", 2024-04-25T22:42:03.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6746000000000001e-05 2024-04-25T22:42:03.984 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.984 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.984 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:03.984 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.976604+0000", 2024-04-25T22:42:03.984 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4610000000000001e-05 2024-04-25T22:42:03.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.985 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:03.985 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.976705+0000", 2024-04-25T22:42:03.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010087800000000001 2024-04-25T22:42:03.985 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:03.985 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:03.985 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:03.985 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.976912+0000", 2024-04-25T22:42:03.985 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020631499999999999 2024-04-25T22:42:03.985 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.985 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:03.985 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.985 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:03.986 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-25T22:42:03.986 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 2 2024-04-25T22:42:03.986 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:03.994 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:04.039 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:04.035+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:04.140 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:04.136+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:04.181 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:04.181 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:04.181 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:42:04.181 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:42:04.181 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:04.198 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:04.217 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:42:04.241 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:04.240+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:04.332 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:04.332 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:04.332 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:04.332 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:04.333 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.333 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:04.333 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:04.333 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 109.735340362, 2024-04-25T22:42:04.333 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:04.333 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:04.333 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:04.333 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:04.333 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:04.333 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.333 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:04.333 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:04.333 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.334 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.334 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.334 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:04.334 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:04.334 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.334 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.334 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.334 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:04.334 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:04.334 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:04.334 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.335 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.335 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:04.335 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:04.335 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:04.335 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.335 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.335 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:04.335 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:04.335 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:04.335 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.335 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.335 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:04.335 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:04.335 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:04.335 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.336 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.336 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.336 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:04.336 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:04.336 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.336 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.336 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:04.336 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:04.336 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:04.336 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.336 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.336 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.336 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:04.336 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:04.336 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.337 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.337 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:04.337 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:04.337 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:04.337 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.337 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.337 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:04.337 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:04.337 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:04.337 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.337 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.337 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:04.337 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:04.337 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:04.337 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.338 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.338 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:04.338 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:04.338 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:04.338 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.338 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.338 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:04.338 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:04.338 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:04.338 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.338 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.338 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:04.338 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:04.339 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:04.339 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.339 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.339 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.339 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.339 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.339 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:04.339 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:04.339 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 109.735203106, 2024-04-25T22:42:04.339 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:04.339 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:04.339 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:04.339 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:04.339 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:04.340 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.340 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:04.340 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:04.340 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.340 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.340 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.340 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:04.340 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:04.340 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.340 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.340 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.340 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:04.340 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:04.340 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:04.340 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.341 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.341 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:04.341 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:04.341 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:04.341 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.341 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.341 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:04.341 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:04.341 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:04.341 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.341 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.341 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:04.341 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:04.341 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:04.342 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.342 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.342 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.342 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:04.342 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:04.342 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.342 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.342 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:04.342 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:04.342 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:04.342 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.342 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.342 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.342 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:04.343 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:04.343 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.343 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.343 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:04.343 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:04.343 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:04.343 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.343 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.343 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:04.343 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:04.343 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:04.343 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.343 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.343 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:04.344 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:04.344 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:04.344 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.344 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.344 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:04.344 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:04.344 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:04.344 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.344 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.344 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:04.344 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:04.344 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:04.344 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.344 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.345 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:04.345 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:04.345 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:04.345 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.345 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.345 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.345 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.345 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.345 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:04.345 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:42:04.345 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 109.735115554, 2024-04-25T22:42:04.345 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:42:04.345 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:04.345 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:04.346 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:04.346 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:04.346 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.346 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:04.346 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:42:04.346 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.346 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.346 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.346 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:04.346 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:42:04.346 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.346 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.346 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.347 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:04.347 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:42:04.347 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:42:04.347 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.347 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.347 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:04.347 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:42:04.347 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:42:04.347 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.347 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.347 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:04.347 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:42:04.347 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:42:04.347 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.348 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.348 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:04.348 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:42:04.348 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:42:04.348 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.348 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.348 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.348 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:42:04.348 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:42:04.348 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.348 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.348 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:04.348 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:42:04.349 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:42:04.349 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.349 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.349 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.349 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:42:04.349 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:42:04.349 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.349 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.349 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:04.349 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:42:04.349 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:42:04.349 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.349 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.350 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:04.350 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:42:04.350 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:42:04.350 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.350 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.350 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:04.350 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:42:04.350 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:42:04.350 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.350 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.350 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:04.350 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:42:04.350 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:42:04.350 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.351 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.351 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:04.351 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:42:04.351 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:42:04.351 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.351 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.351 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:04.351 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:42:04.351 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:42:04.351 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.351 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.351 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.352 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.352 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.352 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:04.352 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:04.352 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 109.735011728, 2024-04-25T22:42:04.352 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:42:04.352 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:04.352 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:04.352 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:04.352 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:04.352 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.352 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:04.352 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:04.352 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.353 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.353 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.353 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:04.353 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:04.353 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.353 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.353 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.353 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:04.353 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:42:04.353 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:42:04.353 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.353 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.353 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:04.354 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:42:04.354 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:42:04.354 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.354 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.354 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:04.354 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:42:04.354 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:42:04.354 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.354 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.354 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:04.354 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:42:04.354 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:42:04.354 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.354 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.355 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.355 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:42:04.355 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:42:04.355 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.355 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.355 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:04.355 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:42:04.355 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:42:04.355 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.355 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.355 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.355 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:42:04.355 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:42:04.355 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.356 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.356 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:04.356 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:42:04.356 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:42:04.356 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.356 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.356 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:04.356 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:42:04.356 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:42:04.356 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.356 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.356 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:04.356 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:42:04.357 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:42:04.357 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.357 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.357 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:04.357 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:42:04.357 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:42:04.357 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.357 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.357 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:04.357 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:42:04.357 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:42:04.357 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.357 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.357 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:04.357 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:42:04.358 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:42:04.358 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.358 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.358 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.358 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.358 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.358 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:04.358 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:04.358 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 109.734942938, 2024-04-25T22:42:04.358 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:04.358 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:04.359 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:04.359 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:04.359 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:04.359 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.359 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:04.359 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:04.359 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.359 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.359 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.359 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:04.359 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:04.359 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.359 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.359 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.359 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:04.360 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:04.360 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:04.360 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.360 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.360 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:04.360 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:04.360 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:04.360 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.360 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.360 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:04.360 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:04.360 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:04.360 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.361 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.361 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:04.361 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:04.361 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:04.361 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.361 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.361 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.361 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:04.361 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:04.361 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.361 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.361 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:04.361 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:04.361 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:04.362 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.362 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.362 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.362 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:04.362 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:04.362 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.362 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.362 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:04.362 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:04.362 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:04.362 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.363 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.363 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:04.363 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:04.363 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:04.363 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.363 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.363 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:04.363 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:04.363 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:04.363 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.363 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.363 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:04.363 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:04.363 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:04.364 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.364 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.364 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:04.364 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:04.364 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:04.364 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.364 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.364 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:04.364 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:04.364 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:04.364 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.364 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.364 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.364 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.364 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.365 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:04.365 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:04.365 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 109.73487385200001, 2024-04-25T22:42:04.365 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:42:04.365 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:04.365 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:04.365 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:04.365 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:04.365 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.365 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:04.365 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:04.365 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.365 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.365 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.366 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:04.366 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:04.366 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.366 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.366 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.366 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:04.366 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:42:04.366 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:42:04.366 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.366 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.366 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:04.366 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:42:04.367 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:42:04.367 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.367 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.367 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:04.367 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:42:04.367 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:42:04.367 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.367 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.367 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:04.367 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:42:04.367 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:42:04.367 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.367 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:42:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:42:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:42:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:42:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:42:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:42:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:42:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:42:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:42:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:42:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.370 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.370 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:04.370 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:42:04.370 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:42:04.370 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.370 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.370 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:04.370 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:42:04.370 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:42:04.370 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.370 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.370 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:04.370 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:42:04.371 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:42:04.371 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.371 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.371 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:04.371 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:42:04.371 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:42:04.371 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.371 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.371 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.371 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.371 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.371 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:04.371 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:04.371 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 109.73477773899999, 2024-04-25T22:42:04.372 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:04.372 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:04.372 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:04.372 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:04.372 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:04.372 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.372 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:04.372 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:04.372 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.372 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.372 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.372 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:04.372 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:04.372 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.372 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.373 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.373 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:04.373 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:04.373 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:04.373 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.373 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.373 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:04.373 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:04.373 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:04.373 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.373 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.373 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:04.373 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:04.373 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:04.374 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.374 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.374 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:04.374 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:04.374 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:04.374 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.374 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.374 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.374 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:04.374 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:04.374 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.374 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.374 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:04.374 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:04.375 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:04.375 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.375 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.375 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.375 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:04.375 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:04.375 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.375 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.375 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:04.377 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:04.377 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:04.378 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.378 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.378 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:04.378 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:04.378 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:04.378 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.378 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.378 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.378 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.378 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.378 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:04.378 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:04.378 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 109.734712077, 2024-04-25T22:42:04.379 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:04.379 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:04.379 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:04.379 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:04.379 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:04.379 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.379 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:04.379 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:04.379 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.379 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.379 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.379 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:04.379 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:04.379 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.380 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.380 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.380 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:04.380 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:04.380 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:04.380 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.380 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.380 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:04.380 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:04.380 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:04.380 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.380 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.380 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:04.381 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:04.381 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:04.381 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.381 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.381 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:04.381 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:04.381 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:04.381 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.381 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.381 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.381 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:04.381 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:04.381 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.382 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.382 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:04.382 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:04.382 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:04.382 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.382 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.382 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.382 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:04.382 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:04.382 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.382 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.382 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:04.382 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:04.382 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:04.383 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.383 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.383 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:04.383 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:04.383 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:04.383 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.383 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.383 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.383 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.383 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.383 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:04.383 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:04.383 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 109.73464294999999, 2024-04-25T22:42:04.384 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:42:04.384 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:04.384 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:04.384 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:04.384 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:04.384 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.384 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:04.384 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:04.384 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.384 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.384 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.384 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:04.384 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:04.384 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.385 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.385 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.385 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:04.385 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:42:04.385 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:42:04.385 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.385 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.385 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:04.385 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:42:04.385 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:42:04.385 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.385 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.385 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:04.385 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:42:04.386 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:42:04.386 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.386 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.386 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:04.386 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:42:04.386 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:42:04.386 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.386 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.386 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.386 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:42:04.386 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:42:04.386 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.386 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.386 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:04.387 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:42:04.387 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:42:04.387 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.387 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.387 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.387 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:42:04.387 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:42:04.387 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.387 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.387 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:04.387 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:42:04.387 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:42:04.387 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.387 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.388 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:04.388 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:42:04.388 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:42:04.388 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.388 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.388 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.388 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.388 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.388 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-25T22:42:04.388 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:42:04.388 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 10.335845090999999, 2024-04-25T22:42:04.388 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.02435211, 2024-04-25T22:42:04.388 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:04.388 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:04.388 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:04.389 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:04.389 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:04.389 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:04.389 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 5 2024-04-25T22:42:04.389 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.389 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:04.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.389 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:04.389 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:42:04.389 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.389 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.389 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:04.389 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:42:04.390 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.390 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.390 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.390 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:04.390 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995113+0000", 2024-04-25T22:42:04.390 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2760000000000001e-06 2024-04-25T22:42:04.390 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.390 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.390 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:04.390 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002825+0000", 2024-04-25T22:42:04.390 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077127000000000003 2024-04-25T22:42:04.390 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.390 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.391 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:04.391 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002852+0000", 2024-04-25T22:42:04.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6570000000000001e-05 2024-04-25T22:42:04.391 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.391 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.391 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:04.391 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002866+0000", 2024-04-25T22:42:04.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4144999999999999e-05 2024-04-25T22:42:04.391 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.391 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.391 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.391 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002947+0000", 2024-04-25T22:42:04.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0740000000000003e-05 2024-04-25T22:42:04.391 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.392 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.392 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:04.392 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.003049+0000", 2024-04-25T22:42:04.392 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101829 2024-04-25T22:42:04.392 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.392 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.392 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:04.392 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019091+0000", 2024-04-25T22:42:04.392 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016042638000000001 2024-04-25T22:42:04.392 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.392 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.392 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:04.392 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019227+0000", 2024-04-25T22:42:04.393 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000135826 2024-04-25T22:42:04.393 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.393 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.393 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:04.393 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019462+0000", 2024-04-25T22:42:04.393 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000234386 2024-04-25T22:42:04.393 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.393 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.393 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.393 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.393 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.393 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:73 3.b 3:d5c7a900:::200.00000003:head [write 920531~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:04.393 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.598864+0000", 2024-04-25T22:42:04.393 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.732090865, 2024-04-25T22:42:04.393 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016865775999999999, 2024-04-25T22:42:04.394 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:04.394 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:04.394 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:04.394 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:04.394 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.394 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:04.394 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598864+0000", 2024-04-25T22:42:04.394 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.394 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.394 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.394 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:04.394 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598864+0000", 2024-04-25T22:42:04.394 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.394 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.395 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.395 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:04.395 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598865+0000", 2024-04-25T22:42:04.395 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2299999999999999e-07 2024-04-25T22:42:04.395 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.395 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.395 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:04.395 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598880+0000", 2024-04-25T22:42:04.395 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5051999999999999e-05 2024-04-25T22:42:04.395 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.395 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.395 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:04.395 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598897+0000", 2024-04-25T22:42:04.395 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7748999999999999e-05 2024-04-25T22:42:04.396 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.396 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.396 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:04.396 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598909+0000", 2024-04-25T22:42:04.396 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1187e-05 2024-04-25T22:42:04.396 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.396 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.396 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.396 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.605650+0000", 2024-04-25T22:42:04.396 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067413070000000002 2024-04-25T22:42:04.396 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.396 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.396 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:04.396 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.605741+0000", 2024-04-25T22:42:04.397 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1181999999999995e-05 2024-04-25T22:42:04.397 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.397 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.397 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:04.397 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.605878+0000", 2024-04-25T22:42:04.397 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013704200000000001 2024-04-25T22:42:04.397 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.397 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.397 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:04.397 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611026+0000", 2024-04-25T22:42:04.397 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0051482189999999999 2024-04-25T22:42:04.397 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.397 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.397 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:04.398 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615619+0000", 2024-04-25T22:42:04.398 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0045930900000000002 2024-04-25T22:42:04.398 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.398 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.398 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:04.398 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615683+0000", 2024-04-25T22:42:04.398 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3200999999999993e-05 2024-04-25T22:42:04.398 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.398 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.398 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:04.398 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615729+0000", 2024-04-25T22:42:04.398 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6823999999999998e-05 2024-04-25T22:42:04.398 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.398 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.399 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.399 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.399 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.399 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:74 3.b 3:d5c7a900:::200.00000003:head [write 921931~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:04.399 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.598924+0000", 2024-04-25T22:42:04.399 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.7320303140000002, 2024-04-25T22:42:04.399 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016937026000000001, 2024-04-25T22:42:04.399 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:04.399 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:04.399 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:04.399 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:04.399 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.399 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:04.400 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598924+0000", 2024-04-25T22:42:04.400 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.400 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.400 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.400 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:04.400 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598924+0000", 2024-04-25T22:42:04.400 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.400 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.400 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.400 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:04.400 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598925+0000", 2024-04-25T22:42:04.400 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0020000000000001e-06 2024-04-25T22:42:04.400 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.400 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.401 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:04.401 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598934+0000", 2024-04-25T22:42:04.401 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6270000000000006e-06 2024-04-25T22:42:04.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.401 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.401 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:04.401 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598948+0000", 2024-04-25T22:42:04.401 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3953e-05 2024-04-25T22:42:04.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.401 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.401 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:04.401 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598975+0000", 2024-04-25T22:42:04.401 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6673999999999999e-05 2024-04-25T22:42:04.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.401 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606235+0000", 2024-04-25T22:42:04.402 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.007260463 2024-04-25T22:42:04.402 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.402 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:04.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606332+0000", 2024-04-25T22:42:04.402 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7252999999999999e-05 2024-04-25T22:42:04.402 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.402 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:04.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606478+0000", 2024-04-25T22:42:04.402 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014544100000000001 2024-04-25T22:42:04.403 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.403 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.403 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:04.403 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611041+0000", 2024-04-25T22:42:04.403 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0045634359999999997 2024-04-25T22:42:04.403 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.403 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.403 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:04.403 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615781+0000", 2024-04-25T22:42:04.403 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0047398750000000002 2024-04-25T22:42:04.403 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.403 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.403 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:04.403 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615823+0000", 2024-04-25T22:42:04.404 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1927e-05 2024-04-25T22:42:04.404 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.404 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.404 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:04.404 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615861+0000", 2024-04-25T22:42:04.404 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8374999999999998e-05 2024-04-25T22:42:04.404 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.404 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.404 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.404 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.404 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.404 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:75 3.b 3:d5c7a900:::200.00000003:head [write 923330~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:04.404 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.598989+0000", 2024-04-25T22:42:04.404 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.7319652889999997, 2024-04-25T22:42:04.405 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017059059000000001, 2024-04-25T22:42:04.405 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:04.405 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:04.405 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:04.405 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:04.405 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.405 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:04.405 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598989+0000", 2024-04-25T22:42:04.405 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.405 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.405 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.405 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:04.405 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598989+0000", 2024-04-25T22:42:04.405 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.406 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.406 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.406 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:04.406 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598990+0000", 2024-04-25T22:42:04.406 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0279999999999999e-06 2024-04-25T22:42:04.406 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.406 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.406 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:04.406 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599003+0000", 2024-04-25T22:42:04.406 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2306999999999999e-05 2024-04-25T22:42:04.406 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.406 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.406 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:04.406 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599017+0000", 2024-04-25T22:42:04.407 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4064e-05 2024-04-25T22:42:04.407 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.407 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.407 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:04.407 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599041+0000", 2024-04-25T22:42:04.407 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4054999999999999e-05 2024-04-25T22:42:04.407 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.407 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.407 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.407 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606871+0000", 2024-04-25T22:42:04.407 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0078301580000000003 2024-04-25T22:42:04.407 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.407 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.407 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:04.407 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606928+0000", 2024-04-25T22:42:04.408 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7479999999999999e-05 2024-04-25T22:42:04.408 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.408 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.408 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:04.408 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607019+0000", 2024-04-25T22:42:04.408 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0761999999999996e-05 2024-04-25T22:42:04.408 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.408 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.408 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:04.408 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611057+0000", 2024-04-25T22:42:04.408 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040381260000000004 2024-04-25T22:42:04.408 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.408 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.408 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:04.409 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615923+0000", 2024-04-25T22:42:04.409 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048658319999999996 2024-04-25T22:42:04.409 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.409 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.409 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:04.409 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615996+0000", 2024-04-25T22:42:04.409 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3108000000000005e-05 2024-04-25T22:42:04.409 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.409 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.409 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:04.409 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616048+0000", 2024-04-25T22:42:04.409 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2138999999999997e-05 2024-04-25T22:42:04.409 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.409 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.410 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.410 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.410 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.410 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:76 3.b 3:d5c7a900:::200.00000003:head [write 924729~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:04.410 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.599056+0000", 2024-04-25T22:42:04.410 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.731898245, 2024-04-25T22:42:04.410 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017101028000000001, 2024-04-25T22:42:04.410 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:04.410 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:04.410 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:04.410 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:04.410 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.410 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:04.411 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599056+0000", 2024-04-25T22:42:04.411 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.411 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.411 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.411 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:04.411 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599056+0000", 2024-04-25T22:42:04.411 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.411 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.411 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.411 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:04.411 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599057+0000", 2024-04-25T22:42:04.411 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1500000000000003e-07 2024-04-25T22:42:04.411 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.412 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:04.412 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599063+0000", 2024-04-25T22:42:04.412 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6930000000000004e-06 2024-04-25T22:42:04.412 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.412 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:04.412 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599085+0000", 2024-04-25T22:42:04.412 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2544e-05 2024-04-25T22:42:04.412 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.412 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:04.412 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599098+0000", 2024-04-25T22:42:04.412 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2425999999999999e-05 2024-04-25T22:42:04.413 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.413 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.413 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.413 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607316+0000", 2024-04-25T22:42:04.413 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082178489999999993 2024-04-25T22:42:04.413 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.413 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.413 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:04.413 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607452+0000", 2024-04-25T22:42:04.413 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000135885 2024-04-25T22:42:04.413 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.413 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.413 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:04.413 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607602+0000", 2024-04-25T22:42:04.414 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015049200000000001 2024-04-25T22:42:04.414 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.414 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.414 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:04.414 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611073+0000", 2024-04-25T22:42:04.414 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0034707079999999999 2024-04-25T22:42:04.414 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.414 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.414 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:04.414 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616091+0000", 2024-04-25T22:42:04.414 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0050181779999999999 2024-04-25T22:42:04.414 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.414 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.415 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:04.415 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616121+0000", 2024-04-25T22:42:04.415 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0399000000000002e-05 2024-04-25T22:42:04.415 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.415 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.415 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:04.415 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616157+0000", 2024-04-25T22:42:04.415 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6038999999999998e-05 2024-04-25T22:42:04.415 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.415 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.415 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.415 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.415 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.416 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:77 3.b 3:d5c7a900:::200.00000003:head [write 926128~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:04.416 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.599112+0000", 2024-04-25T22:42:04.416 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.7318420769999996, 2024-04-25T22:42:04.416 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017211087, 2024-04-25T22:42:04.416 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:04.416 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:04.416 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:04.416 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:04.416 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.416 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:04.416 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599112+0000", 2024-04-25T22:42:04.416 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.416 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.416 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.417 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:04.417 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599112+0000", 2024-04-25T22:42:04.417 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.417 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.417 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.417 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:04.417 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599113+0000", 2024-04-25T22:42:04.417 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7499999999999999e-07 2024-04-25T22:42:04.417 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.417 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.417 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:04.417 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599119+0000", 2024-04-25T22:42:04.417 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0349999999999998e-06 2024-04-25T22:42:04.417 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.418 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.418 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:04.418 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599138+0000", 2024-04-25T22:42:04.418 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8345000000000001e-05 2024-04-25T22:42:04.418 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.418 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.418 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:04.418 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599150+0000", 2024-04-25T22:42:04.418 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1902000000000001e-05 2024-04-25T22:42:04.418 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.418 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.418 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.418 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608267+0000", 2024-04-25T22:42:04.419 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091174380000000003 2024-04-25T22:42:04.419 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.419 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.419 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:04.419 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608341+0000", 2024-04-25T22:42:04.419 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4029000000000006e-05 2024-04-25T22:42:04.419 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.419 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.419 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:04.419 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608435+0000", 2024-04-25T22:42:04.419 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3541000000000004e-05 2024-04-25T22:42:04.419 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.419 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.419 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:04.420 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.613682+0000", 2024-04-25T22:42:04.420 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0052474829999999998 2024-04-25T22:42:04.420 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.420 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.420 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:04.420 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616211+0000", 2024-04-25T22:42:04.420 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025291490000000001 2024-04-25T22:42:04.420 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.420 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.420 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:04.420 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616276+0000", 2024-04-25T22:42:04.420 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4590000000000003e-05 2024-04-25T22:42:04.420 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.420 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.421 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:04.421 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616324+0000", 2024-04-25T22:42:04.421 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7700000000000001e-05 2024-04-25T22:42:04.421 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.421 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.421 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.421 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.421 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.421 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:78 3.b 3:d5c7a900:::200.00000003:head [write 927532~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:04.421 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.599164+0000", 2024-04-25T22:42:04.421 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.7317906299999999, 2024-04-25T22:42:04.421 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017312029999999999, 2024-04-25T22:42:04.421 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:04.421 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:04.422 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:04.422 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:04.422 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.422 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:04.422 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599164+0000", 2024-04-25T22:42:04.422 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.422 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.422 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.422 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:04.422 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599164+0000", 2024-04-25T22:42:04.422 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.422 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.422 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.422 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:04.423 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599165+0000", 2024-04-25T22:42:04.423 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6899999999999996e-07 2024-04-25T22:42:04.423 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.423 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.423 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:04.423 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599177+0000", 2024-04-25T22:42:04.423 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2461e-05 2024-04-25T22:42:04.423 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.423 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.423 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:04.423 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599191+0000", 2024-04-25T22:42:04.423 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3888e-05 2024-04-25T22:42:04.423 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.424 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.424 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:04.424 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599206+0000", 2024-04-25T22:42:04.424 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4346e-05 2024-04-25T22:42:04.424 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.424 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.424 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.424 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608700+0000", 2024-04-25T22:42:04.424 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0094949140000000001 2024-04-25T22:42:04.424 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.424 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.424 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:04.424 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608786+0000", 2024-04-25T22:42:04.424 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5587000000000006e-05 2024-04-25T22:42:04.424 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.425 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.425 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:04.425 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608921+0000", 2024-04-25T22:42:04.425 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013478900000000001 2024-04-25T22:42:04.425 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.425 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.425 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:04.425 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.613698+0000", 2024-04-25T22:42:04.425 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0047773859999999998 2024-04-25T22:42:04.425 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.425 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.425 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:04.425 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616386+0000", 2024-04-25T22:42:04.425 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0026877770000000001 2024-04-25T22:42:04.426 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.426 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.426 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:04.426 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616440+0000", 2024-04-25T22:42:04.426 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4490000000000002e-05 2024-04-25T22:42:04.426 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.426 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.426 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:04.426 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616476+0000", 2024-04-25T22:42:04.426 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5522999999999999e-05 2024-04-25T22:42:04.426 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.426 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.426 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.427 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.427 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.427 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:109 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:42:04.427 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:02.620631+0000", 2024-04-25T22:42:04.427 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.710323595, 2024-04-25T22:42:04.427 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027780309999999999, 2024-04-25T22:42:04.427 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:04.427 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:04.427 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:04.427 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:04.427 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.427 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:04.427 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620631+0000", 2024-04-25T22:42:04.427 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.427 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.428 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.428 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:04.428 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620631+0000", 2024-04-25T22:42:04.428 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.428 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.428 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.428 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:04.428 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620632+0000", 2024-04-25T22:42:04.428 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.364e-06 2024-04-25T22:42:04.428 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.428 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.428 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:04.428 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620751+0000", 2024-04-25T22:42:04.428 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011838299999999999 2024-04-25T22:42:04.429 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.429 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.429 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:04.429 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620764+0000", 2024-04-25T22:42:04.429 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3203e-05 2024-04-25T22:42:04.429 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.429 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.429 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:04.429 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620771+0000", 2024-04-25T22:42:04.429 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4080000000000001e-06 2024-04-25T22:42:04.429 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.429 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.429 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.429 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620840+0000", 2024-04-25T22:42:04.430 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8696999999999996e-05 2024-04-25T22:42:04.430 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.430 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.430 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:04.430 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620919+0000", 2024-04-25T22:42:04.430 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9379e-05 2024-04-25T22:42:04.430 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.430 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.430 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:04.430 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.626976+0000", 2024-04-25T22:42:04.430 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060565610000000002 2024-04-25T22:42:04.430 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.430 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.431 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:04.431 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643495+0000", 2024-04-25T22:42:04.431 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016518950000000001 2024-04-25T22:42:04.431 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.431 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.431 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:04.431 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.648308+0000", 2024-04-25T22:42:04.431 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048133799999999999 2024-04-25T22:42:04.431 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.431 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.431 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:04.431 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.648369+0000", 2024-04-25T22:42:04.431 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0285000000000003e-05 2024-04-25T22:42:04.432 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.432 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.432 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:04.432 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.648411+0000", 2024-04-25T22:42:04.432 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2700000000000001e-05 2024-04-25T22:42:04.432 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.432 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.432 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.432 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.432 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.432 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:6294 4.2d 4:b5ee1071:::10000001cd6.00000000:head [write 0~6362] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-25T22:42:04.432 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:02.625474+0000", 2024-04-25T22:42:04.432 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.7054805719999999, 2024-04-25T22:42:04.432 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018135539999999999, 2024-04-25T22:42:04.433 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:04.433 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:04.433 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:04.433 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:04.433 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:04.433 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:04.433 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 6294 2024-04-25T22:42:04.433 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.433 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:04.433 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.433 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:04.433 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625474+0000", 2024-04-25T22:42:04.433 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.433 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.434 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.434 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:04.434 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625474+0000", 2024-04-25T22:42:04.434 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.434 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.434 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.434 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:04.434 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625475+0000", 2024-04-25T22:42:04.434 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6899999999999996e-07 2024-04-25T22:42:04.434 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.434 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.434 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:04.434 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625485+0000", 2024-04-25T22:42:04.434 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:42:04.435 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.435 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.435 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:04.435 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625493+0000", 2024-04-25T22:42:04.435 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2800000000000003e-06 2024-04-25T22:42:04.435 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.435 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.435 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:04.435 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625499+0000", 2024-04-25T22:42:04.435 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7830000000000004e-06 2024-04-25T22:42:04.435 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.435 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.435 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.435 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625555+0000", 2024-04-25T22:42:04.436 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6776e-05 2024-04-25T22:42:04.436 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.436 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.436 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:04.436 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625685+0000", 2024-04-25T22:42:04.436 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000129519 2024-04-25T22:42:04.436 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.436 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.436 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:04.436 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643438+0000", 2024-04-25T22:42:04.436 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017753023 2024-04-25T22:42:04.436 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.436 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.436 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:04.437 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643510+0000", 2024-04-25T22:42:04.437 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2020999999999994e-05 2024-04-25T22:42:04.437 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.437 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.437 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:04.437 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643610+0000", 2024-04-25T22:42:04.437 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9543999999999994e-05 2024-04-25T22:42:04.437 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.437 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.437 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.437 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.437 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.437 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:6295 4.3c e60/17 4:3da972f4:::10000001cd7.00000000:head v 60'76, mlcod=60'74)", 2024-04-25T22:42:04.437 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:02.627611+0000", 2024-04-25T22:42:04.438 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.7033440419999999, 2024-04-25T22:42:04.438 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015914080000000001, 2024-04-25T22:42:04.438 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:04.438 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:04.438 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:04.438 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:04.438 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.438 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:04.438 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.627611+0000", 2024-04-25T22:42:04.438 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.438 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.438 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.438 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:04.439 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.627611+0000", 2024-04-25T22:42:04.439 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.439 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.439 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.439 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:04.439 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.627611+0000", 2024-04-25T22:42:04.439 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3900000000000003e-07 2024-04-25T22:42:04.439 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.439 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.439 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:04.439 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.627621+0000", 2024-04-25T22:42:04.439 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6700000000000006e-06 2024-04-25T22:42:04.439 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.439 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.440 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:04.440 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.627634+0000", 2024-04-25T22:42:04.440 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2361000000000001e-05 2024-04-25T22:42:04.440 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.440 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.440 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:04.440 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.627641+0000", 2024-04-25T22:42:04.440 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5510000000000002e-06 2024-04-25T22:42:04.440 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.440 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.440 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.440 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.627715+0000", 2024-04-25T22:42:04.440 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3565000000000005e-05 2024-04-25T22:42:04.440 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.441 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.441 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:04.441 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.627739+0000", 2024-04-25T22:42:04.441 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4351000000000001e-05 2024-04-25T22:42:04.441 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.441 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.441 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:04.441 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643466+0000", 2024-04-25T22:42:04.441 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015727016999999999 2024-04-25T22:42:04.441 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.441 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.441 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:04.441 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643525+0000", 2024-04-25T22:42:04.441 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8625999999999997e-05 2024-04-25T22:42:04.442 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.442 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.442 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.442 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.442 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.442 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:113 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-25T22:42:04.442 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:03.622392+0000", 2024-04-25T22:42:04.442 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.70856255400000001, 2024-04-25T22:42:04.442 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027294512999999999, 2024-04-25T22:42:04.442 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:04.442 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:04.442 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:04.442 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:04.442 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.443 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:04.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622392+0000", 2024-04-25T22:42:04.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.443 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.443 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:04.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622392+0000", 2024-04-25T22:42:04.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:04.443 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.443 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:04.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622394+0000", 2024-04-25T22:42:04.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.39e-06 2024-04-25T22:42:04.443 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:04.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622486+0000", 2024-04-25T22:42:04.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1497999999999997e-05 2024-04-25T22:42:04.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:04.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622516+0000", 2024-04-25T22:42:04.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0281999999999999e-05 2024-04-25T22:42:04.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:04.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622531+0000", 2024-04-25T22:42:04.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4980000000000001e-05 2024-04-25T22:42:04.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:04.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622653+0000", 2024-04-25T22:42:04.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012210000000000001 2024-04-25T22:42:04.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:04.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622795+0000", 2024-04-25T22:42:04.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014171 2024-04-25T22:42:04.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:04.446 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.630487+0000", 2024-04-25T22:42:04.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076922680000000004 2024-04-25T22:42:04.446 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.446 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:04.446 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.640781+0000", 2024-04-25T22:42:04.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010293416 2024-04-25T22:42:04.446 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.446 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:04.446 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.649494+0000", 2024-04-25T22:42:04.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0087134670000000008 2024-04-25T22:42:04.446 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.447 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.447 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:04.447 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.649575+0000", 2024-04-25T22:42:04.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0655000000000006e-05 2024-04-25T22:42:04.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:04.447 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:04.447 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:04.447 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.649687+0000", 2024-04-25T22:42:04.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000111747 2024-04-25T22:42:04.447 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.447 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.447 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.447 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:04.447 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:04.448 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:04.449 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:04.449 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:04.449 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:04.450 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:04.451 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:04.443+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:04.451 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:04.451 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:04.452 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:04.452 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:04.549 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:04.548+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:04.592 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:04.592 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:04.610 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:04.650 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:04.647+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:04.750 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~30s 2024-04-25T22:42:04.751 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:04.747+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:04.794 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:04.794 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:04.809 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:04.853 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:04.852+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:04.942 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:04.943 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:04.952 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:04.948+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:04.959 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:05.053 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:05.047+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:05.099 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:05.099 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:05.115 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:05.158 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:05.155+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:05.254 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:05.252+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:05.289 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:05.290 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:05.305 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:05.355 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:05.352+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:05.365 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:42:05.442 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:05.442 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:05.456 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:05.452+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:05.457 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:05.557 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:05.551+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:05.590 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:05.590 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:05.606 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:05.658 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:05.656+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:05.735 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:05.735 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:05.750 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:05.760 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:05.755+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:05.860 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:05.855+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:05.923 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:05.923 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:05.938 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:05.961 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:05.960+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:06.062 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:06.060+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:06.073 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:06.073 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:06.089 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:06.163 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:06.160+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:06.214 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:06.214 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:06.230 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:06.278 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:06.275+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:06.362 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:06.362 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:06.364 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:06.360+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:06.378 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:06.403 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is unset 2024-04-25T22:42:06.453 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:42:06.465 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:06.459+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:06.521 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:06.521 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:06.536 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:06.565 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:06.559+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:06.598 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:06.599 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:06.599 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:06.623 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:06.623 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:06.625 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:06.625 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:06.666 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:06.659+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:06.668 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:06.669 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:06.669 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:42:06.669 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:42:06.669 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:06.685 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:06.767 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:06.764+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:06.833 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:06.833 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:42:06.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:42:06.834 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:06.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.834 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:06.834 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:42:06.834 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.23478577100001, 2024-04-25T22:42:06.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:42:06.834 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:06.834 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:06.834 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:06.834 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:06.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:06.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:42:06.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:06.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:42:06.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:06.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:42:06.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:42:06.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:06.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:42:06.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:42:06.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:06.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:42:06.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:42:06.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:06.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:42:06.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:42:06.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:42:06.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:42:06.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:06.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:42:06.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:42:06.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:42:06.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:42:06.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:06.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:42:06.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:42:06.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:06.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:42:06.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:42:06.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:06.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:42:06.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:42:06.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:06.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:42:06.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:42:06.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:06.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:42:06.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:42:06.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:06.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:42:06.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:42:06.839 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.839 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.840 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.840 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:06.840 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:42:06.840 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.234697758, 2024-04-25T22:42:06.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:42:06.840 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:06.840 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:06.840 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:06.840 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:06.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:06.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:42:06.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:06.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:42:06.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:06.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:42:06.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:42:06.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:06.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:42:06.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:42:06.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:06.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:42:06.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:42:06.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:06.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:42:06.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:42:06.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:42:06.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:42:06.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:06.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:06.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:42:06.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:42:06.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:42:06.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:06.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:42:06.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:42:06.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:06.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:42:06.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:42:06.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:06.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:42:06.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:42:06.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:06.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:42:06.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:42:06.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:06.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:42:06.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:42:06.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:06.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:42:06.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:42:06.845 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.845 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.845 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.846 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:06.846 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:06.846 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.234625636, 2024-04-25T22:42:06.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:42:06.846 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:06.846 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:06.846 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:06.846 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:06.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:06.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:06.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:06.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:06.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:06.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:42:06.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:42:06.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:06.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:42:06.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:42:06.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:06.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:42:06.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:42:06.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:06.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:42:06.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:42:06.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:42:06.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:42:06.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:06.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:42:06.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:42:06.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:42:06.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:42:06.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:06.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:42:06.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:42:06.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:06.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:42:06.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:42:06.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:06.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:42:06.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:42:06.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:06.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:42:06.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:42:06.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:06.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:42:06.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:42:06.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:06.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:42:06.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:42:06.851 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.851 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.852 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.852 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:06.852 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:06.852 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.23451732300001, 2024-04-25T22:42:06.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:42:06.852 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:06.852 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:06.852 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:06.852 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:06.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:06.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:06.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:06.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:06.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:06.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:42:06.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:42:06.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:06.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:42:06.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:42:06.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:06.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:42:06.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:42:06.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:06.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:42:06.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:42:06.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:42:06.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:42:06.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:06.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:42:06.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:42:06.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:42:06.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:42:06.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:06.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:42:06.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:42:06.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:06.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:42:06.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:42:06.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:06.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:42:06.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:42:06.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:06.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:42:06.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:42:06.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:06.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:42:06.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:42:06.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:06.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:42:06.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:42:06.857 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.858 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.858 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.858 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:06.858 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:06.858 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.234450667, 2024-04-25T22:42:06.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:42:06.858 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:06.858 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:06.858 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:06.858 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:06.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:06.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:06.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:06.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:06.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:06.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:42:06.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:42:06.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:06.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:42:06.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:42:06.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:06.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:42:06.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:42:06.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:06.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:42:06.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:42:06.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:42:06.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:42:06.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:06.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:42:06.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:42:06.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:42:06.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:42:06.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:06.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:42:06.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:42:06.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:06.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:42:06.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:42:06.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:06.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:42:06.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:42:06.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:06.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:42:06.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:42:06.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:06.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:42:06.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:42:06.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:06.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:42:06.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:42:06.863 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.864 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.864 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.864 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:06.864 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:06.864 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.234360071, 2024-04-25T22:42:06.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:42:06.864 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:06.864 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:06.864 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:06.864 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:06.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:06.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:06.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:06.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:06.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:06.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:42:06.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:42:06.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:06.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:42:06.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:42:06.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:06.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:42:06.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:42:06.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:06.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:42:06.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:42:06.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:42:06.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:42:06.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:06.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:42:06.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:42:06.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:42:06.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:42:06.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:06.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:42:06.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:42:06.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:06.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:42:06.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:42:06.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:06.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:42:06.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:42:06.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:06.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:42:06.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:42:06.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:06.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:42:06.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:42:06.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:06.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:42:06.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:42:06.869 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.870 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.870 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.870 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:06.870 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:06.870 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.23429549799999, 2024-04-25T22:42:06.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:42:06.870 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:06.870 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:06.870 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:06.870 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:06.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:06.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:06.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:06.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:06.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:06.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:42:06.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:42:06.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:06.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:42:06.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:42:06.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:06.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:42:06.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:42:06.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:06.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:42:06.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:42:06.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:06.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:42:06.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:06.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:42:06.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:42:06.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:42:06.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:42:06.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:06.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:42:06.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:42:06.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:06.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:42:06.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:42:06.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:06.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:42:06.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:42:06.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:06.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:42:06.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:42:06.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:06.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:42:06.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:42:06.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:06.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:42:06.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:42:06.875 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.876 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.876 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.876 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:06.876 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:06.876 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.234230075, 2024-04-25T22:42:06.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:42:06.876 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:06.876 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:06.876 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:06.876 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:06.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:06.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:06.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:06.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:06.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:06.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:42:06.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:06.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:06.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:42:06.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:42:06.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:06.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:42:06.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:42:06.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:06.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:42:06.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:42:06.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:42:06.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:42:06.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:06.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:42:06.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:42:06.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:42:06.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:42:06.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:06.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:42:06.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:42:06.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:06.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:42:06.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:42:06.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:06.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:42:06.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:42:06.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:06.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:42:06.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:42:06.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:06.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:42:06.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:42:06.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:06.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:42:06.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:42:06.882 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.882 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.882 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.882 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:06.882 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:42:06.882 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.234174009, 2024-04-25T22:42:06.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:42:06.882 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:06.882 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:06.882 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:06.882 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:06.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:06.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:42:06.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:06.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:42:06.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:06.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:06.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:42:06.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:06.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:42:06.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:42:06.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:06.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:42:06.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:42:06.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:06.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:42:06.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:42:06.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:42:06.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:42:06.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:06.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:42:06.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:42:06.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:42:06.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:42:06.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:06.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:42:06.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:42:06.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:06.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:42:06.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:42:06.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:06.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:42:06.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:42:06.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:06.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:42:06.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:42:06.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:06.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:42:06.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:42:06.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:06.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:42:06.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:42:06.887 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.888 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.888 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.888 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:06.888 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:42:06.888 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.234106903, 2024-04-25T22:42:06.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:42:06.888 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:06.888 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:06.888 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:06.888 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:06.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:06.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:42:06.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:06.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:42:06.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:06.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:42:06.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:42:06.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:06.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:42:06.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:42:06.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:06.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:42:06.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:42:06.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:06.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:42:06.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:42:06.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:42:06.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:42:06.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:06.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:42:06.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:42:06.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:42:06.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:42:06.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:06.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:42:06.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:42:06.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:06.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:42:06.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:42:06.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:06.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:42:06.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:42:06.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:06.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:42:06.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:42:06.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:06.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:42:06.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:42:06.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:06.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:42:06.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:42:06.894 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.894 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.894 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.894 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:06.894 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:06.894 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.23405178, 2024-04-25T22:42:06.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:42:06.894 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:06.894 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:06.894 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:06.895 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:06.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:06.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:06.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:06.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:06.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:06.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:42:06.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:42:06.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:06.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:42:06.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:42:06.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:06.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:42:06.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:42:06.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:06.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:42:06.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:42:06.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:42:06.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:42:06.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:06.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:42:06.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:42:06.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:42:06.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:42:06.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:06.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:42:06.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:42:06.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:06.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:42:06.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:42:06.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:06.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:42:06.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:42:06.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:06.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:42:06.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:42:06.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:06.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:42:06.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:42:06.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:06.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:42:06.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:42:06.900 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.900 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.900 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.900 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:06.900 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:06.900 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.233949541, 2024-04-25T22:42:06.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:42:06.900 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:06.900 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:06.900 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:06.900 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:06.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:06.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:06.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:06.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:06.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:06.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:42:06.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:42:06.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:06.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:42:06.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:42:06.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:06.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:42:06.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:42:06.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:06.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:42:06.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:42:06.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:42:06.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:42:06.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:06.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:42:06.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:42:06.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:42:06.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:42:06.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:06.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:42:06.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:42:06.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:06.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:42:06.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:42:06.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:06.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:42:06.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:42:06.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:06.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:42:06.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:42:06.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:06.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:42:06.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:42:06.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:06.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:42:06.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:42:06.906 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.906 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.906 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.906 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:06.906 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:42:06.906 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.233890718, 2024-04-25T22:42:06.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:42:06.906 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:06.906 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:06.906 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:06.906 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:06.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:06.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:42:06.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:06.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:42:06.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:06.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:42:06.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:42:06.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:06.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:42:06.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:42:06.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:06.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:42:06.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:42:06.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:06.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:42:06.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:42:06.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:42:06.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:42:06.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:06.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:42:06.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:42:06.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:42:06.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:42:06.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:06.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:42:06.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:42:06.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:06.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:42:06.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:42:06.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:06.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:42:06.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:42:06.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:06.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:42:06.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:42:06.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:06.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:42:06.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:42:06.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:06.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:42:06.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:42:06.912 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.912 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.912 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.912 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:06.912 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:42:06.912 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.233811985, 2024-04-25T22:42:06.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:42:06.912 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:06.912 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:06.912 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:06.912 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:06.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:06.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:42:06.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:06.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:42:06.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:06.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:42:06.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:42:06.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:06.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:42:06.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:42:06.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:06.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:42:06.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:42:06.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:06.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:42:06.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:42:06.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:42:06.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:42:06.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:06.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:42:06.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:42:06.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:42:06.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:42:06.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:06.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:42:06.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:42:06.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:06.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:42:06.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:42:06.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:06.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:42:06.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:42:06.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:06.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:42:06.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:42:06.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:06.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:42:06.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:42:06.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:06.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:42:06.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:42:06.917 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.918 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.918 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.918 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:06.918 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:42:06.918 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.23377257200001, 2024-04-25T22:42:06.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:42:06.918 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:06.918 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:06.918 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:06.918 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:06.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:06.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:42:06.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:06.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:42:06.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:06.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:42:06.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:42:06.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:06.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:42:06.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:42:06.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:06.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:42:06.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:42:06.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:06.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:42:06.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:42:06.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:42:06.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:42:06.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:06.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:42:06.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:42:06.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:42:06.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:42:06.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:06.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:42:06.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:42:06.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:06.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:42:06.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:42:06.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:06.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:42:06.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:42:06.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:06.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:42:06.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:42:06.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:06.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:42:06.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:42:06.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:06.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:42:06.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:42:06.923 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.923 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.924 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.924 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:06.924 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:42:06.924 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.233702726, 2024-04-25T22:42:06.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:42:06.924 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:06.924 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:06.924 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:06.924 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:06.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:06.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:42:06.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:06.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:42:06.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:06.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:42:06.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:42:06.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:06.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:42:06.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:42:06.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:06.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:42:06.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:42:06.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:06.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:42:06.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:42:06.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:42:06.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:42:06.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:06.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:42:06.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:42:06.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:42:06.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:42:06.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:06.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:42:06.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:42:06.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:06.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:42:06.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:42:06.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:06.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:42:06.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:42:06.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:06.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:42:06.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:42:06.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:06.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:42:06.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:42:06.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:06.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:42:06.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:42:06.930 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.930 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.930 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.930 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:06.930 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:42:06.930 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.23365298900001, 2024-04-25T22:42:06.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:42:06.930 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:06.930 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:06.930 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:06.930 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:06.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:06.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:42:06.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:06.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:42:06.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:06.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:42:06.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:06.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:06.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:42:06.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:42:06.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:06.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:42:06.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:42:06.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:06.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:42:06.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:42:06.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:42:06.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:42:06.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:06.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:42:06.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:42:06.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:42:06.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:42:06.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:06.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:42:06.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:42:06.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:06.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:42:06.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:42:06.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:06.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:42:06.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:42:06.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:06.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:42:06.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:42:06.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:06.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:06.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:42:06.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:06.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:42:06.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:42:06.935 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.936 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.936 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.936 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:06.936 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:06.936 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.233568374, 2024-04-25T22:42:06.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:42:06.936 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:06.936 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:06.936 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:06.936 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:06.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:06.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:06.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:06.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:06.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:06.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:42:06.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:06.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:06.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:42:06.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:42:06.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:06.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:42:06.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:42:06.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:06.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:42:06.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:42:06.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:42:06.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:42:06.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:06.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:42:06.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:42:06.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:42:06.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:42:06.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:06.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:42:06.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:42:06.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:06.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:42:06.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:42:06.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:06.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:42:06.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:42:06.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:06.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:42:06.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:42:06.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:06.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:42:06.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:42:06.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:06.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:42:06.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:42:06.941 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.942 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.942 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.942 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:06.942 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:42:06.942 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.233504724, 2024-04-25T22:42:06.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:42:06.942 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:06.942 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:06.942 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:06.945 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:06.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:06.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:42:06.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:06.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:42:06.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:06.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:42:06.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:42:06.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:06.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:42:06.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:42:06.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:06.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:42:06.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:42:06.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:06.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:42:06.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:42:06.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:42:06.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:42:06.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:06.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:42:06.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:42:06.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:42:06.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:42:06.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:06.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:42:06.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:42:06.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:06.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:42:06.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:42:06.949 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.949 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.949 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.949 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:42:06.949 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:42:06.949 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 112.22650119399999, 2024-04-25T22:42:06.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:42:06.950 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:06.950 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:06.950 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:06.950 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:06.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:06.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:42:06.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:06.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:42:06.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:06.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:06.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:42:06.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:42:06.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:06.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:42:06.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:42:06.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:06.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:42:06.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:42:06.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:06.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:42:06.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:42:06.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:06.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:42:06.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:42:06.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:06.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:42:06.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:42:06.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:06.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:42:06.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:42:06.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:06.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:06.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:06.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:42:06.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:42:06.953 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.953 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.953 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.953 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:06.953 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:06.954 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:06.955 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:06.955 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:06.951+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:07.049 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-25T22:42:07.049 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:42:07.049 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-25T22:42:07.049 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-25T22:42:07.050 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-25T22:42:07.050 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-25T22:42:07.055 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:07.052+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:07.090 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:07.090 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:07.090 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.091 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:9416 4.16 4:6adcaf0d:::10000002b32.00000000:head [write 0~4769 in=4769b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-25T22:42:07.091 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:07.089530+0000", 2024-04-25T22:42:07.091 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.00173559, 2024-04-25T22:42:07.091 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001753257, 2024-04-25T22:42:07.091 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.091 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.091 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:42:07.091 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:07.091 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:07.091 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:07.091 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 9416 2024-04-25T22:42:07.091 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.091 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.092 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.092 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.092 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.089530+0000", 2024-04-25T22:42:07.092 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.092 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.092 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.092 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.092 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.089530+0000", 2024-04-25T22:42:07.092 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.092 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.092 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.092 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.092 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.089531+0000", 2024-04-25T22:42:07.092 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9199999999999999e-07 2024-04-25T22:42:07.093 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.093 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.093 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.093 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.089539+0000", 2024-04-25T22:42:07.093 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3370000000000002e-06 2024-04-25T22:42:07.093 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.093 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.093 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.093 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.089549+0000", 2024-04-25T22:42:07.093 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0006e-05 2024-04-25T22:42:07.093 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.093 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.093 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.093 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.089554+0000", 2024-04-25T22:42:07.094 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0440000000000003e-06 2024-04-25T22:42:07.094 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.094 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.094 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.094 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.089608+0000", 2024-04-25T22:42:07.094 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4135999999999998e-05 2024-04-25T22:42:07.094 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.094 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.094 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.094 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.089762+0000", 2024-04-25T22:42:07.094 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000154041 2024-04-25T22:42:07.094 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.094 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.095 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:07.095 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.089928+0000", 2024-04-25T22:42:07.095 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000165985 2024-04-25T22:42:07.095 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.095 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.095 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.095 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.095 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.095 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:9415 4.36 4:6fb665e7:::10000002b31.00000000:head [write 0~915 in=915b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-25T22:42:07.095 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:07.088360+0000", 2024-04-25T22:42:07.095 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0029055840000000001, 2024-04-25T22:42:07.095 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.003009379, 2024-04-25T22:42:07.095 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.095 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.096 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:07.096 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:07.096 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:07.096 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:07.096 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 9415 2024-04-25T22:42:07.096 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.096 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.096 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.096 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.096 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.088360+0000", 2024-04-25T22:42:07.096 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.096 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.096 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.096 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.096 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.088360+0000", 2024-04-25T22:42:07.097 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.097 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.097 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.097 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.097 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.088361+0000", 2024-04-25T22:42:07.097 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7599999999999996e-07 2024-04-25T22:42:07.097 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.097 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.097 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.097 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.088366+0000", 2024-04-25T22:42:07.097 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8069999999999999e-06 2024-04-25T22:42:07.097 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.097 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.097 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.098 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.088374+0000", 2024-04-25T22:42:07.098 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8040000000000002e-06 2024-04-25T22:42:07.098 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.098 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.098 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.098 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.088378+0000", 2024-04-25T22:42:07.098 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3819999999999997e-06 2024-04-25T22:42:07.098 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.098 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.098 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.098 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.088415+0000", 2024-04-25T22:42:07.098 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6810999999999997e-05 2024-04-25T22:42:07.098 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.098 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.099 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.099 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.088503+0000", 2024-04-25T22:42:07.099 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8058000000000003e-05 2024-04-25T22:42:07.099 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.099 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.099 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.099 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.099 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-25T22:42:07.099 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 2 2024-04-25T22:42:07.099 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:07.107 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:07.157 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:07.152+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:07.179 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:07.179 INFO:teuthology.orchestra.run.smithi188.stdout: "success": "" 2024-04-25T22:42:07.180 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:07.257 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:07.251+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:07.275 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:07.275 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:07.275 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:42:07.275 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:42:07.275 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:07.290 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:07.382 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:07.379+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:07.459 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:07.455+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:07.476 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:07.476 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:07.476 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:07.477 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:07.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.477 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:07.477 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:07.477 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 112.876283989, 2024-04-25T22:42:07.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:07.477 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.477 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.477 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:07.477 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:07.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.478 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.478 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:07.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.478 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.478 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:07.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:07.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.478 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.478 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:07.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:07.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:07.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:07.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:07.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:07.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:07.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:07.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.480 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.480 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:07.480 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:07.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:07.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.480 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.480 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.480 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:07.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:07.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.480 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.480 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.480 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:07.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:07.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.481 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.481 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:07.481 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:07.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:07.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.481 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.481 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:07.481 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:07.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:07.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.481 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.481 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:07.481 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:07.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:07.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.481 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.482 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:07.482 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:07.482 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:07.482 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.482 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.482 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:07.482 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:07.482 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:07.482 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.482 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.482 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.482 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.482 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.483 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:07.483 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:07.483 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 112.876146733, 2024-04-25T22:42:07.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:07.483 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.483 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.483 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:07.483 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:07.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:07.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.484 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.484 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:07.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:07.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.484 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.484 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:07.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:07.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.484 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.484 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:07.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:07.485 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.485 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.485 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:07.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:07.485 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.485 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.485 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:07.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:07.485 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.485 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:07.485 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:07.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:07.486 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.486 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.486 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.486 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:07.486 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:07.486 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.486 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.486 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.486 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:07.486 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:07.486 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.486 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.486 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:07.486 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:07.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:07.487 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:07.487 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:07.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:07.487 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:07.487 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:07.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:07.487 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:07.487 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:07.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:07.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.488 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:07.488 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:07.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:07.488 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.488 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.488 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.488 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:07.488 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:42:07.488 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 112.876059181, 2024-04-25T22:42:07.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:42:07.488 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.489 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.489 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:07.489 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.489 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:42:07.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.489 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.489 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:42:07.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.489 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:42:07.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:42:07.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:42:07.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:42:07.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:42:07.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:42:07.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:42:07.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:42:07.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:42:07.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:42:07.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:07.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:42:07.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:42:07.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:42:07.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:42:07.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:42:07.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:42:07.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:07.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:42:07.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:42:07.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:07.493 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:42:07.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:42:07.493 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.493 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:07.493 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:42:07.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:42:07.493 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.493 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:07.493 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:42:07.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:42:07.493 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.493 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:07.494 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:42:07.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:42:07.494 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.494 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.494 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.494 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.494 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.494 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:07.494 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:07.494 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 112.875955355, 2024-04-25T22:42:07.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:42:07.494 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.494 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.494 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:07.494 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:07.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:07.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:42:07.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:42:07.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:42:07.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:42:07.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:42:07.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:42:07.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:42:07.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:42:07.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:42:07.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:42:07.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:07.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:42:07.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:42:07.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:42:07.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:42:07.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:42:07.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:42:07.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:07.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:42:07.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:42:07.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:07.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:42:07.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:42:07.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:07.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:42:07.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:42:07.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:07.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:42:07.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:42:07.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:07.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:42:07.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:42:07.499 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.500 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.500 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.500 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:07.500 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:07.500 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 112.875886565, 2024-04-25T22:42:07.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:07.500 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.500 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.500 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:07.500 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.500 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.500 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:07.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:07.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:07.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:07.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:07.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:07.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:07.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:07.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:07.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:07.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:07.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:07.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:07.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:07.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:07.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:07.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:07.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:07.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:07.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:07.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:07.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:07.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:07.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:07.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:07.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:07.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:07.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:07.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.505 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:07.505 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:07.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:07.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.505 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:07.505 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:07.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:07.505 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.505 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.505 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.505 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:07.505 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:07.506 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 112.87581747900001, 2024-04-25T22:42:07.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:42:07.506 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.506 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.506 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:07.506 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:07.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:07.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:42:07.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:42:07.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:42:07.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:42:07.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:42:07.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:42:07.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:42:07.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:42:07.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:42:07.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:42:07.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:07.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:42:07.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:42:07.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:42:07.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:42:07.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:42:07.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:42:07.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:07.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:42:07.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:42:07.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:07.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:42:07.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:42:07.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:07.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:42:07.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:42:07.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:07.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:42:07.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:42:07.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:07.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:42:07.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:42:07.511 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.511 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.511 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.511 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:07.511 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:07.511 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 112.87572136599999, 2024-04-25T22:42:07.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:07.512 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.512 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.512 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:07.512 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:07.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:07.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:07.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:07.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:07.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:07.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:07.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:07.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:07.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:07.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:07.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:07.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:07.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:07.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:07.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:07.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:07.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:07.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:07.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:07.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:07.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:07.515 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.515 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.515 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.516 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:07.516 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:07.516 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 112.875655704, 2024-04-25T22:42:07.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:07.516 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.516 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.516 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:07.516 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:07.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:07.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:07.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:07.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:07.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:07.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:07.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:07.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:07.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:07.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:07.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:07.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:07.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:07.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:07.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:07.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:07.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:07.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:07.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:07.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:07.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:07.520 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.520 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.520 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.520 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:07.520 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:07.520 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 112.87558657700001, 2024-04-25T22:42:07.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:42:07.520 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.521 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.521 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:07.521 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:07.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:07.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:42:07.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:42:07.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:42:07.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:42:07.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:42:07.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:42:07.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:42:07.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:42:07.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:42:07.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:42:07.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:07.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:42:07.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:42:07.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:42:07.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:42:07.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:42:07.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:42:07.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:07.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:42:07.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:42:07.524 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.524 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.524 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.525 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-25T22:42:07.525 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:42:07.525 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 13.476788718, 2024-04-25T22:42:07.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.02435211, 2024-04-25T22:42:07.525 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.525 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.525 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:07.525 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:07.525 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:07.525 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:07.525 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 5 2024-04-25T22:42:07.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.525 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:42:07.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:42:07.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995113+0000", 2024-04-25T22:42:07.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2760000000000001e-06 2024-04-25T22:42:07.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002825+0000", 2024-04-25T22:42:07.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077127000000000003 2024-04-25T22:42:07.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002852+0000", 2024-04-25T22:42:07.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6570000000000001e-05 2024-04-25T22:42:07.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002866+0000", 2024-04-25T22:42:07.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4144999999999999e-05 2024-04-25T22:42:07.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002947+0000", 2024-04-25T22:42:07.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0740000000000003e-05 2024-04-25T22:42:07.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.003049+0000", 2024-04-25T22:42:07.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101829 2024-04-25T22:42:07.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:07.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019091+0000", 2024-04-25T22:42:07.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016042638000000001 2024-04-25T22:42:07.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:07.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019227+0000", 2024-04-25T22:42:07.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000135826 2024-04-25T22:42:07.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:07.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019462+0000", 2024-04-25T22:42:07.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000234386 2024-04-25T22:42:07.529 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.529 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.529 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.530 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:73 3.b 3:d5c7a900:::200.00000003:head [write 920531~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:07.530 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.598864+0000", 2024-04-25T22:42:07.530 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 7.8730344920000004, 2024-04-25T22:42:07.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016865775999999999, 2024-04-25T22:42:07.530 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.530 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.530 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:07.530 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.530 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598864+0000", 2024-04-25T22:42:07.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.530 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598864+0000", 2024-04-25T22:42:07.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598865+0000", 2024-04-25T22:42:07.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2299999999999999e-07 2024-04-25T22:42:07.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598880+0000", 2024-04-25T22:42:07.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5051999999999999e-05 2024-04-25T22:42:07.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598897+0000", 2024-04-25T22:42:07.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7748999999999999e-05 2024-04-25T22:42:07.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598909+0000", 2024-04-25T22:42:07.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1187e-05 2024-04-25T22:42:07.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.605650+0000", 2024-04-25T22:42:07.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067413070000000002 2024-04-25T22:42:07.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.605741+0000", 2024-04-25T22:42:07.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1181999999999995e-05 2024-04-25T22:42:07.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:07.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.605878+0000", 2024-04-25T22:42:07.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013704200000000001 2024-04-25T22:42:07.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:07.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611026+0000", 2024-04-25T22:42:07.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0051482189999999999 2024-04-25T22:42:07.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:07.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615619+0000", 2024-04-25T22:42:07.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0045930900000000002 2024-04-25T22:42:07.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:07.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615683+0000", 2024-04-25T22:42:07.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3200999999999993e-05 2024-04-25T22:42:07.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:07.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615729+0000", 2024-04-25T22:42:07.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6823999999999998e-05 2024-04-25T22:42:07.534 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.534 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.534 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.535 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:74 3.b 3:d5c7a900:::200.00000003:head [write 921931~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:07.535 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.598924+0000", 2024-04-25T22:42:07.535 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 7.8729739409999997, 2024-04-25T22:42:07.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016937026000000001, 2024-04-25T22:42:07.535 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.535 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.535 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:07.535 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598924+0000", 2024-04-25T22:42:07.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598924+0000", 2024-04-25T22:42:07.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598925+0000", 2024-04-25T22:42:07.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0020000000000001e-06 2024-04-25T22:42:07.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598934+0000", 2024-04-25T22:42:07.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6270000000000006e-06 2024-04-25T22:42:07.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598948+0000", 2024-04-25T22:42:07.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3953e-05 2024-04-25T22:42:07.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598975+0000", 2024-04-25T22:42:07.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6673999999999999e-05 2024-04-25T22:42:07.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606235+0000", 2024-04-25T22:42:07.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.007260463 2024-04-25T22:42:07.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606332+0000", 2024-04-25T22:42:07.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7252999999999999e-05 2024-04-25T22:42:07.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:07.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606478+0000", 2024-04-25T22:42:07.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014544100000000001 2024-04-25T22:42:07.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:07.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611041+0000", 2024-04-25T22:42:07.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0045634359999999997 2024-04-25T22:42:07.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:07.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615781+0000", 2024-04-25T22:42:07.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0047398750000000002 2024-04-25T22:42:07.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:07.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615823+0000", 2024-04-25T22:42:07.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1927e-05 2024-04-25T22:42:07.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:07.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615861+0000", 2024-04-25T22:42:07.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8374999999999998e-05 2024-04-25T22:42:07.539 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.539 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.539 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.540 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:75 3.b 3:d5c7a900:::200.00000003:head [write 923330~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:07.540 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.598989+0000", 2024-04-25T22:42:07.540 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 7.8729089160000001, 2024-04-25T22:42:07.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017059059000000001, 2024-04-25T22:42:07.540 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.540 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.540 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:07.540 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598989+0000", 2024-04-25T22:42:07.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598989+0000", 2024-04-25T22:42:07.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598990+0000", 2024-04-25T22:42:07.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0279999999999999e-06 2024-04-25T22:42:07.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599003+0000", 2024-04-25T22:42:07.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2306999999999999e-05 2024-04-25T22:42:07.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599017+0000", 2024-04-25T22:42:07.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4064e-05 2024-04-25T22:42:07.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599041+0000", 2024-04-25T22:42:07.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4054999999999999e-05 2024-04-25T22:42:07.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606871+0000", 2024-04-25T22:42:07.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0078301580000000003 2024-04-25T22:42:07.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606928+0000", 2024-04-25T22:42:07.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7479999999999999e-05 2024-04-25T22:42:07.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:07.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607019+0000", 2024-04-25T22:42:07.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0761999999999996e-05 2024-04-25T22:42:07.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:07.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611057+0000", 2024-04-25T22:42:07.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040381260000000004 2024-04-25T22:42:07.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:07.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615923+0000", 2024-04-25T22:42:07.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048658319999999996 2024-04-25T22:42:07.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:07.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615996+0000", 2024-04-25T22:42:07.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3108000000000005e-05 2024-04-25T22:42:07.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:07.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616048+0000", 2024-04-25T22:42:07.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2138999999999997e-05 2024-04-25T22:42:07.545 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.545 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.545 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.545 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:76 3.b 3:d5c7a900:::200.00000003:head [write 924729~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:07.545 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.599056+0000", 2024-04-25T22:42:07.545 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 7.8728418720000004, 2024-04-25T22:42:07.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017101028000000001, 2024-04-25T22:42:07.545 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.545 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.545 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:07.545 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599056+0000", 2024-04-25T22:42:07.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599056+0000", 2024-04-25T22:42:07.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599057+0000", 2024-04-25T22:42:07.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1500000000000003e-07 2024-04-25T22:42:07.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599063+0000", 2024-04-25T22:42:07.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6930000000000004e-06 2024-04-25T22:42:07.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599085+0000", 2024-04-25T22:42:07.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2544e-05 2024-04-25T22:42:07.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599098+0000", 2024-04-25T22:42:07.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2425999999999999e-05 2024-04-25T22:42:07.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607316+0000", 2024-04-25T22:42:07.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082178489999999993 2024-04-25T22:42:07.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607452+0000", 2024-04-25T22:42:07.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000135885 2024-04-25T22:42:07.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:07.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607602+0000", 2024-04-25T22:42:07.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015049200000000001 2024-04-25T22:42:07.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:07.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611073+0000", 2024-04-25T22:42:07.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0034707079999999999 2024-04-25T22:42:07.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:07.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616091+0000", 2024-04-25T22:42:07.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0050181779999999999 2024-04-25T22:42:07.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:07.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616121+0000", 2024-04-25T22:42:07.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0399000000000002e-05 2024-04-25T22:42:07.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:07.550 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616157+0000", 2024-04-25T22:42:07.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6038999999999998e-05 2024-04-25T22:42:07.550 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.550 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.550 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.550 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.550 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.550 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:77 3.b 3:d5c7a900:::200.00000003:head [write 926128~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:07.550 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.599112+0000", 2024-04-25T22:42:07.550 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 7.872785704, 2024-04-25T22:42:07.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017211087, 2024-04-25T22:42:07.550 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.550 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.550 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:07.550 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.550 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599112+0000", 2024-04-25T22:42:07.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599112+0000", 2024-04-25T22:42:07.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599113+0000", 2024-04-25T22:42:07.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7499999999999999e-07 2024-04-25T22:42:07.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599119+0000", 2024-04-25T22:42:07.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0349999999999998e-06 2024-04-25T22:42:07.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599138+0000", 2024-04-25T22:42:07.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8345000000000001e-05 2024-04-25T22:42:07.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599150+0000", 2024-04-25T22:42:07.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1902000000000001e-05 2024-04-25T22:42:07.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608267+0000", 2024-04-25T22:42:07.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091174380000000003 2024-04-25T22:42:07.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608341+0000", 2024-04-25T22:42:07.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4029000000000006e-05 2024-04-25T22:42:07.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:07.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608435+0000", 2024-04-25T22:42:07.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3541000000000004e-05 2024-04-25T22:42:07.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:07.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.613682+0000", 2024-04-25T22:42:07.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0052474829999999998 2024-04-25T22:42:07.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:07.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616211+0000", 2024-04-25T22:42:07.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025291490000000001 2024-04-25T22:42:07.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:07.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616276+0000", 2024-04-25T22:42:07.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4590000000000003e-05 2024-04-25T22:42:07.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:07.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616324+0000", 2024-04-25T22:42:07.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7700000000000001e-05 2024-04-25T22:42:07.555 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.555 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.555 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.555 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:78 3.b 3:d5c7a900:::200.00000003:head [write 927532~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:07.555 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.599164+0000", 2024-04-25T22:42:07.555 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 7.8727342570000003, 2024-04-25T22:42:07.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017312029999999999, 2024-04-25T22:42:07.555 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.556 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.556 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:07.556 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599164+0000", 2024-04-25T22:42:07.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599164+0000", 2024-04-25T22:42:07.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599165+0000", 2024-04-25T22:42:07.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6899999999999996e-07 2024-04-25T22:42:07.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599177+0000", 2024-04-25T22:42:07.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2461e-05 2024-04-25T22:42:07.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599191+0000", 2024-04-25T22:42:07.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3888e-05 2024-04-25T22:42:07.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599206+0000", 2024-04-25T22:42:07.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4346e-05 2024-04-25T22:42:07.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608700+0000", 2024-04-25T22:42:07.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0094949140000000001 2024-04-25T22:42:07.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608786+0000", 2024-04-25T22:42:07.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5587000000000006e-05 2024-04-25T22:42:07.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:07.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608921+0000", 2024-04-25T22:42:07.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013478900000000001 2024-04-25T22:42:07.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:07.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.613698+0000", 2024-04-25T22:42:07.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0047773859999999998 2024-04-25T22:42:07.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:07.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616386+0000", 2024-04-25T22:42:07.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0026877770000000001 2024-04-25T22:42:07.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:07.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616440+0000", 2024-04-25T22:42:07.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4490000000000002e-05 2024-04-25T22:42:07.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:07.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616476+0000", 2024-04-25T22:42:07.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5522999999999999e-05 2024-04-25T22:42:07.560 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.560 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.560 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.560 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:109 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:42:07.560 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:02.620631+0000", 2024-04-25T22:42:07.561 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.8512672219999997, 2024-04-25T22:42:07.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027780309999999999, 2024-04-25T22:42:07.561 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.561 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.561 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:07.561 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620631+0000", 2024-04-25T22:42:07.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620631+0000", 2024-04-25T22:42:07.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.562 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620632+0000", 2024-04-25T22:42:07.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.364e-06 2024-04-25T22:42:07.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.562 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620751+0000", 2024-04-25T22:42:07.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011838299999999999 2024-04-25T22:42:07.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.562 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620764+0000", 2024-04-25T22:42:07.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3203e-05 2024-04-25T22:42:07.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620771+0000", 2024-04-25T22:42:07.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4080000000000001e-06 2024-04-25T22:42:07.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620840+0000", 2024-04-25T22:42:07.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8696999999999996e-05 2024-04-25T22:42:07.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620919+0000", 2024-04-25T22:42:07.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9379e-05 2024-04-25T22:42:07.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:07.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.626976+0000", 2024-04-25T22:42:07.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060565610000000002 2024-04-25T22:42:07.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:07.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643495+0000", 2024-04-25T22:42:07.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016518950000000001 2024-04-25T22:42:07.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:07.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.648308+0000", 2024-04-25T22:42:07.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048133799999999999 2024-04-25T22:42:07.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:07.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.648369+0000", 2024-04-25T22:42:07.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0285000000000003e-05 2024-04-25T22:42:07.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:07.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.648411+0000", 2024-04-25T22:42:07.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2700000000000001e-05 2024-04-25T22:42:07.565 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.565 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.565 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.566 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:6294 4.2d 4:b5ee1071:::10000001cd6.00000000:head [write 0~6362] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-25T22:42:07.566 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:02.625474+0000", 2024-04-25T22:42:07.566 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.8464241990000003, 2024-04-25T22:42:07.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018135539999999999, 2024-04-25T22:42:07.566 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.566 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.566 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:07.566 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:07.566 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:07.566 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:07.566 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 6294 2024-04-25T22:42:07.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.566 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625474+0000", 2024-04-25T22:42:07.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625474+0000", 2024-04-25T22:42:07.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625475+0000", 2024-04-25T22:42:07.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6899999999999996e-07 2024-04-25T22:42:07.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625485+0000", 2024-04-25T22:42:07.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:42:07.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625493+0000", 2024-04-25T22:42:07.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2800000000000003e-06 2024-04-25T22:42:07.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625499+0000", 2024-04-25T22:42:07.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7830000000000004e-06 2024-04-25T22:42:07.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625555+0000", 2024-04-25T22:42:07.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6776e-05 2024-04-25T22:42:07.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625685+0000", 2024-04-25T22:42:07.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000129519 2024-04-25T22:42:07.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:07.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643438+0000", 2024-04-25T22:42:07.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017753023 2024-04-25T22:42:07.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.570 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:07.570 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643510+0000", 2024-04-25T22:42:07.570 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2020999999999994e-05 2024-04-25T22:42:07.570 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.570 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:07.570 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643610+0000", 2024-04-25T22:42:07.570 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9543999999999994e-05 2024-04-25T22:42:07.570 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.570 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.570 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.570 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.570 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:113 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-25T22:42:07.571 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:03.622392+0000", 2024-04-25T22:42:07.571 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 3.8495061809999997, 2024-04-25T22:42:07.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027294512999999999, 2024-04-25T22:42:07.571 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.571 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.571 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:07.571 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622392+0000", 2024-04-25T22:42:07.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622392+0000", 2024-04-25T22:42:07.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622394+0000", 2024-04-25T22:42:07.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.39e-06 2024-04-25T22:42:07.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622486+0000", 2024-04-25T22:42:07.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1497999999999997e-05 2024-04-25T22:42:07.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622516+0000", 2024-04-25T22:42:07.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0281999999999999e-05 2024-04-25T22:42:07.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622531+0000", 2024-04-25T22:42:07.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4980000000000001e-05 2024-04-25T22:42:07.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622653+0000", 2024-04-25T22:42:07.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012210000000000001 2024-04-25T22:42:07.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622795+0000", 2024-04-25T22:42:07.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014171 2024-04-25T22:42:07.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.574 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:07.574 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.630487+0000", 2024-04-25T22:42:07.574 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076922680000000004 2024-04-25T22:42:07.574 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.574 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:07.574 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.640781+0000", 2024-04-25T22:42:07.574 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010293416 2024-04-25T22:42:07.574 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.574 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:07.574 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.649494+0000", 2024-04-25T22:42:07.574 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0087134670000000008 2024-04-25T22:42:07.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:07.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.649575+0000", 2024-04-25T22:42:07.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0655000000000006e-05 2024-04-25T22:42:07.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:07.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.649687+0000", 2024-04-25T22:42:07.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000111747 2024-04-25T22:42:07.575 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.575 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.575 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.576 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:206 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T22:42:07.576 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:06.627161+0000", 2024-04-25T22:42:07.576 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.84473699300000005, 2024-04-25T22:42:07.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023978682000000001, 2024-04-25T22:42:07.576 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:07.576 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:07.576 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:07.576 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:07.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:07.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627161+0000", 2024-04-25T22:42:07.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:07.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627161+0000", 2024-04-25T22:42:07.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:07.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:07.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627163+0000", 2024-04-25T22:42:07.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.697e-06 2024-04-25T22:42:07.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:07.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627376+0000", 2024-04-25T22:42:07.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021294799999999999 2024-04-25T22:42:07.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:07.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627396+0000", 2024-04-25T22:42:07.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9715999999999999e-05 2024-04-25T22:42:07.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627408+0000", 2024-04-25T22:42:07.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2357e-05 2024-04-25T22:42:07.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:07.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627513+0000", 2024-04-25T22:42:07.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000105308 2024-04-25T22:42:07.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:07.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627648+0000", 2024-04-25T22:42:07.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000134623 2024-04-25T22:42:07.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:07.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.635301+0000", 2024-04-25T22:42:07.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076529060000000001 2024-04-25T22:42:07.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:07.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.643793+0000", 2024-04-25T22:42:07.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0084921070000000005 2024-04-25T22:42:07.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:07.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.650872+0000", 2024-04-25T22:42:07.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070795500000000004 2024-04-25T22:42:07.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:07.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.651029+0000", 2024-04-25T22:42:07.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000156296 2024-04-25T22:42:07.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:07.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:07.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:07.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.651140+0000", 2024-04-25T22:42:07.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000111174 2024-04-25T22:42:07.580 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.580 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.580 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.580 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:07.580 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:07.580 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:07.582 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:07.582 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:07.580+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:07.683 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:07.680+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:07.719 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:07.719 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:07.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:07.720 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:9701 4.35 4:ae95bf22:::10000002c91.00000000:head [write 0~3920 in=3920b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-25T22:42:07.720 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:07.719563+0000", 2024-04-25T22:42:07.720 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.001400449, 2024-04-25T22:42:07.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001418533, 2024-04-25T22:42:07.720 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:07.720 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:07.720 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:42:07.720 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:07.720 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:07.720 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:07.720 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 9701 2024-04-25T22:42:07.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:07.720 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:07.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:07.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:07.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:07.719563+0000", 2024-04-25T22:42:07.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:07.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:07.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:07.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:07.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:07.719563+0000", 2024-04-25T22:42:07.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:07.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:07.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:07.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:07.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:07.719564+0000", 2024-04-25T22:42:07.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0279999999999999e-06 2024-04-25T22:42:07.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:07.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:07.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:07.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:07.719572+0000", 2024-04-25T22:42:07.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5029999999999997e-06 2024-04-25T22:42:07.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:07.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:07.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:07.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:07.719591+0000", 2024-04-25T22:42:07.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8709e-05 2024-04-25T22:42:07.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:07.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:07.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:07.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:07.719600+0000", 2024-04-25T22:42:07.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8829999999999995e-06 2024-04-25T22:42:07.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:07.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:07.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:07.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:07.719761+0000", 2024-04-25T22:42:07.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016074899999999999 2024-04-25T22:42:07.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:07.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:07.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:07.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:07.719960+0000", 2024-04-25T22:42:07.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000199703 2024-04-25T22:42:07.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:07.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:07.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:07.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:07.720159+0000", 2024-04-25T22:42:07.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019838700000000001 2024-04-25T22:42:07.723 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:07.724 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:07.724 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:07.724 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:07.724 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-25T22:42:07.724 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 1 2024-04-25T22:42:07.724 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:07.734 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:07.784 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:07.779+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:07.884 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:07.880+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:07.902 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:07.902 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:07.902 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:42:07.902 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:42:07.902 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:07.916 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:07.985 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:07.979+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:08.085 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:08.084+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:08.092 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:08.092 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:42:08.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:42:08.093 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:08.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.093 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.093 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:42:08.093 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.493649701, 2024-04-25T22:42:08.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:42:08.093 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:08.093 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:08.093 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.093 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:08.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:08.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:42:08.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:08.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:42:08.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:08.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:42:08.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:42:08.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:08.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:42:08.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:42:08.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:08.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:42:08.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:42:08.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:42:08.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:42:08.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:42:08.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:42:08.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:08.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:42:08.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:42:08.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:42:08.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:42:08.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:08.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:42:08.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:42:08.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:08.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:42:08.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:42:08.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:42:08.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:42:08.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:08.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:42:08.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:42:08.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:08.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:42:08.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:42:08.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:08.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:42:08.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:42:08.099 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.099 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.099 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.099 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.099 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:42:08.099 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.493561688, 2024-04-25T22:42:08.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:42:08.099 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:08.099 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:08.099 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.099 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:08.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:08.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:42:08.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:08.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:42:08.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:08.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:42:08.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:42:08.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:08.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:42:08.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:42:08.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:08.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:42:08.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:42:08.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:42:08.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:42:08.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:42:08.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:42:08.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:08.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:08.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:42:08.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:42:08.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:42:08.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:08.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:42:08.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:42:08.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:08.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:42:08.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:42:08.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:08.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:42:08.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:42:08.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:42:08.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:42:08.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:08.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:42:08.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:42:08.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:08.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:42:08.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:42:08.105 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.105 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.105 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.105 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.105 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:08.105 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.49348956599999, 2024-04-25T22:42:08.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:42:08.105 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:08.105 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:08.105 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.105 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:08.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:08.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:08.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:08.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:08.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:08.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:42:08.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:42:08.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:08.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:42:08.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:42:08.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:08.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:42:08.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:42:08.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:42:08.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:42:08.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:42:08.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:42:08.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:08.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:42:08.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:42:08.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:42:08.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:42:08.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:08.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:42:08.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:42:08.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:08.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:42:08.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:42:08.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:42:08.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:42:08.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:08.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:42:08.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:42:08.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:08.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:42:08.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:42:08.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:08.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:42:08.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:42:08.111 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.111 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.111 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.112 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.112 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:08.112 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.493381253, 2024-04-25T22:42:08.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:42:08.112 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:08.112 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:08.112 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.112 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:08.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:08.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:08.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:08.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:08.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:08.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:42:08.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:42:08.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:08.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:42:08.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:42:08.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:08.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:42:08.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:42:08.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:42:08.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:42:08.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:42:08.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:42:08.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:08.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:42:08.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:42:08.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:42:08.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:42:08.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:08.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:42:08.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:42:08.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:08.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:42:08.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:42:08.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:42:08.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:42:08.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:08.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:42:08.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:42:08.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:08.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:42:08.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:42:08.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:08.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:42:08.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:42:08.117 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.117 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.117 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.117 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.118 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:08.118 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.49331459699999, 2024-04-25T22:42:08.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:42:08.118 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:08.118 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:08.118 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.118 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:08.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:08.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:08.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:08.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:08.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:08.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:42:08.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:42:08.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:08.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:42:08.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:42:08.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:08.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:42:08.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:42:08.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:42:08.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:42:08.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:42:08.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:42:08.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:08.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:42:08.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:42:08.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:42:08.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:42:08.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:08.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:42:08.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:42:08.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:08.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:42:08.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:42:08.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:42:08.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:42:08.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:08.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:42:08.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:42:08.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:08.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:42:08.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:42:08.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:08.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:42:08.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:42:08.123 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.123 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.123 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.123 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.124 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:08.124 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.493224001, 2024-04-25T22:42:08.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:42:08.124 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:08.124 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:08.124 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.124 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:08.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:08.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:08.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:08.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:08.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:08.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:42:08.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:42:08.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:08.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:42:08.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:42:08.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:08.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:42:08.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:42:08.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:42:08.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:42:08.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:42:08.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:42:08.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:08.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:42:08.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:42:08.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:42:08.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:42:08.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:08.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:42:08.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:42:08.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:08.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:42:08.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:42:08.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:08.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:42:08.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:42:08.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:42:08.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:42:08.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:08.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:42:08.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:42:08.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:08.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:42:08.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:42:08.129 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.129 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.129 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.129 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.130 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:08.130 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.493159428, 2024-04-25T22:42:08.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:42:08.130 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:08.130 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:08.130 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.130 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:08.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:08.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:08.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:08.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:08.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:08.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:42:08.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:42:08.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:08.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:42:08.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:42:08.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:08.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:42:08.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:42:08.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:42:08.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:42:08.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:08.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:42:08.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:08.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:42:08.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:42:08.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:42:08.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:42:08.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:08.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:42:08.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:42:08.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:08.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:42:08.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:42:08.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:42:08.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:42:08.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:08.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:42:08.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:42:08.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:08.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:42:08.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:42:08.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:08.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:42:08.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:42:08.135 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.135 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.135 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.136 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.136 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:08.136 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.493094005, 2024-04-25T22:42:08.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:42:08.136 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:08.136 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:08.136 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.136 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:08.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:08.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:08.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:08.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:08.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:08.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:42:08.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:08.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:08.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:42:08.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:42:08.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:08.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:42:08.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:42:08.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:42:08.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:42:08.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:42:08.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:42:08.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:08.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:42:08.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:42:08.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:42:08.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:42:08.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:08.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:42:08.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:42:08.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:08.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:42:08.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:42:08.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:08.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:42:08.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:42:08.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:42:08.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:42:08.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:08.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:42:08.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:42:08.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:08.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:42:08.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:42:08.141 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.141 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.141 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.142 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.142 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:42:08.142 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.493037939, 2024-04-25T22:42:08.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:42:08.142 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:08.142 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:08.142 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.142 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:08.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:08.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:42:08.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:08.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:42:08.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:08.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:08.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:42:08.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:08.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:42:08.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:42:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:42:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:42:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:42:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:42:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:42:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:42:08.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:08.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:42:08.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:42:08.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:42:08.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:42:08.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:08.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:42:08.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:42:08.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:08.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:42:08.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:42:08.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:42:08.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:42:08.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:08.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:42:08.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:42:08.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:08.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:42:08.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:42:08.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:08.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:42:08.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:42:08.147 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.147 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.148 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.148 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.148 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:42:08.148 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.492970833, 2024-04-25T22:42:08.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:42:08.148 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:08.148 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:08.148 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.148 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:08.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:08.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:42:08.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:08.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:42:08.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:08.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:42:08.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:42:08.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:08.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:42:08.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:42:08.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:08.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:42:08.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:42:08.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:42:08.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:42:08.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:42:08.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:42:08.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:08.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:42:08.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:42:08.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:42:08.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:42:08.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:08.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:42:08.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:42:08.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:08.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:42:08.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:42:08.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:42:08.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:42:08.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:08.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:42:08.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:42:08.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:08.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:42:08.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:42:08.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:08.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:42:08.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:42:08.154 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.154 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.154 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.154 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.154 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:08.154 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.49291571000001, 2024-04-25T22:42:08.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:42:08.154 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:08.154 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:08.154 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.154 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:08.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:08.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:08.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:08.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:08.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:08.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:42:08.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:42:08.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:08.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:42:08.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:42:08.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:08.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:42:08.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:42:08.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:42:08.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:42:08.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:42:08.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:42:08.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:08.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:42:08.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:42:08.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:42:08.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:42:08.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:08.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:42:08.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:42:08.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:08.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:42:08.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:42:08.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:42:08.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:42:08.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:08.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:42:08.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:42:08.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:08.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:42:08.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:42:08.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:08.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:42:08.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:42:08.160 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.160 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.160 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.160 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.160 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:08.160 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.49281347100001, 2024-04-25T22:42:08.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:42:08.160 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:08.161 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:08.161 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.161 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:08.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:08.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:08.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:08.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:08.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:08.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:42:08.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:42:08.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:08.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:42:08.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:42:08.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:08.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:42:08.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:42:08.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:42:08.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:42:08.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:42:08.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:42:08.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:08.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:42:08.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:42:08.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:42:08.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:42:08.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:08.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:42:08.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:42:08.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:08.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:42:08.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:42:08.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:42:08.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:42:08.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:08.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:42:08.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:42:08.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:08.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:42:08.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:42:08.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:08.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:42:08.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:42:08.166 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.166 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.166 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.166 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.166 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:42:08.167 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.492754648, 2024-04-25T22:42:08.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:42:08.167 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:08.167 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:08.167 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.167 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:08.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:08.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:42:08.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:08.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:42:08.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:08.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:42:08.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:42:08.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:08.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:42:08.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:42:08.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:08.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:42:08.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:42:08.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:42:08.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:42:08.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:42:08.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:42:08.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:08.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:42:08.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:42:08.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:42:08.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:42:08.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:08.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:42:08.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:42:08.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:08.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:42:08.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:42:08.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:08.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:42:08.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:42:08.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:42:08.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:42:08.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:08.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:42:08.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:42:08.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:08.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:42:08.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:42:08.172 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.172 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.172 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.173 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.173 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:42:08.173 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.49267591500001, 2024-04-25T22:42:08.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:42:08.173 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:08.173 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:08.173 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.173 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:08.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:08.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:42:08.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:08.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:42:08.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:08.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:42:08.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:42:08.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:08.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:42:08.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:42:08.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:08.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:42:08.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:42:08.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:42:08.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:42:08.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:42:08.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:42:08.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:08.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:42:08.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:42:08.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:42:08.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:42:08.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:08.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:42:08.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:42:08.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:08.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:42:08.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:42:08.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:08.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:42:08.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:42:08.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:42:08.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:42:08.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:08.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:42:08.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:42:08.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:08.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:42:08.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:42:08.178 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.178 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.178 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.179 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.179 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:42:08.179 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.492636502, 2024-04-25T22:42:08.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:42:08.179 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:08.179 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:08.179 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.179 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:08.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:08.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:42:08.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:08.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:42:08.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:08.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:42:08.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:42:08.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:08.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:42:08.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:42:08.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:08.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:42:08.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:42:08.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:42:08.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:42:08.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:42:08.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:42:08.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:08.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:42:08.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:42:08.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:42:08.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:42:08.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:08.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:42:08.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:42:08.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:08.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:42:08.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:42:08.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:42:08.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:42:08.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:08.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:42:08.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:42:08.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:08.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:42:08.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:42:08.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:08.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:42:08.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:42:08.185 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.185 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.185 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.185 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.185 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:42:08.185 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.49256665599999, 2024-04-25T22:42:08.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:42:08.185 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:08.185 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:08.185 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.185 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:08.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:08.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:42:08.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:08.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:42:08.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:08.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:42:08.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:42:08.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:08.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:42:08.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:42:08.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:08.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:42:08.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:42:08.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:42:08.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:42:08.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:42:08.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:42:08.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:08.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:42:08.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:42:08.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:42:08.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:42:08.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:08.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:42:08.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:42:08.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:08.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:42:08.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:42:08.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:42:08.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:42:08.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:08.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:42:08.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:42:08.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:08.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:42:08.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:42:08.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:08.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:42:08.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:42:08.191 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.191 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.191 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.191 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.192 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:42:08.192 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.492516919, 2024-04-25T22:42:08.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:42:08.192 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:08.192 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:08.192 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.192 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:08.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:08.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:42:08.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:08.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:42:08.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:08.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:42:08.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:08.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:08.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:42:08.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:42:08.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:08.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:42:08.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:42:08.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:42:08.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:42:08.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:42:08.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:42:08.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:08.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:42:08.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:42:08.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:42:08.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:42:08.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:08.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:42:08.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:42:08.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:08.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:42:08.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:42:08.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:08.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:42:08.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:42:08.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:42:08.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:42:08.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:08.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:08.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:42:08.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:08.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:42:08.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:42:08.198 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.198 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.198 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.198 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.198 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:08.198 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.492432304, 2024-04-25T22:42:08.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:42:08.198 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:08.198 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:08.198 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.198 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:08.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:08.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:08.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:08.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:08.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:08.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:42:08.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:08.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:08.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:42:08.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:42:08.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:08.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:42:08.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:42:08.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:42:08.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:42:08.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:42:08.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:42:08.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:08.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:42:08.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:42:08.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:42:08.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:42:08.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:08.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:42:08.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:42:08.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:08.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:42:08.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:42:08.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:42:08.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:42:08.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:08.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:42:08.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:42:08.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:08.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:42:08.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:42:08.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:08.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:42:08.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:42:08.204 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.204 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.204 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.204 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.204 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:42:08.204 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.492368654, 2024-04-25T22:42:08.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:42:08.204 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:08.205 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:08.205 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:08.205 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:08.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:08.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:42:08.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:08.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:42:08.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:08.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:42:08.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:42:08.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:08.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:42:08.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:42:08.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:08.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:42:08.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:42:08.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:42:08.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:42:08.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:42:08.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:42:08.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:08.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:42:08.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:42:08.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:42:08.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:42:08.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:08.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:42:08.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:42:08.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:08.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:42:08.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:42:08.209 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.209 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.209 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.209 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:42:08.209 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:42:08.209 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 113.485365124, 2024-04-25T22:42:08.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:42:08.209 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:08.209 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:08.209 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.210 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:08.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:08.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:42:08.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:08.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:42:08.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:08.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:08.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:42:08.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:42:08.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:08.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:42:08.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:42:08.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:08.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:42:08.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:42:08.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:42:08.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:42:08.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:08.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:42:08.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:42:08.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:08.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:42:08.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:42:08.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:08.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:42:08.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:42:08.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:08.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:08.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:08.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:42:08.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:42:08.213 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.213 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.213 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.213 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:08.213 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:08.213 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:08.215 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:08.215 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:08.211+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:08.316 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:08.311+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:08.350 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:08.350 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:08.350 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:42:08.350 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:08.365 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:08.424 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:42:08.454 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:08.451+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:08.518 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:08.516+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:08.531 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:08.532 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:08.532 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:42:08.532 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:42:08.532 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:08.547 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:08.619 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:08.616+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:08.626 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:42:08.719 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:08.716+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:08.724 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:08.724 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:08.724 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:08.724 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:08.724 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.725 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.725 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:08.725 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 114.12572569699999, 2024-04-25T22:42:08.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:08.725 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:08.725 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:08.725 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.725 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:08.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:08.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:08.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:08.726 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:08.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:08.726 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:08.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:08.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:08.726 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:08.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:08.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:08.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:08.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:08.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:08.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:08.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:08.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:08.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:08.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:08.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:08.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:08.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:08.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:08.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:08.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:08.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:08.729 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:08.729 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:08.729 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.729 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.729 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:08.729 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:08.729 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:08.729 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.729 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.729 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.729 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:08.729 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:08.729 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.729 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:08.730 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:08.730 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:08.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:08.730 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:08.730 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:08.730 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.730 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.730 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.730 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.731 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:08.731 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 114.125588441, 2024-04-25T22:42:08.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:08.731 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:08.731 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:08.731 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.731 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:08.731 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.731 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:08.731 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:08.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.731 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.731 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.731 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:08.731 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:08.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.732 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.732 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:08.732 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:08.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:08.732 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.732 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:08.732 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:08.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:08.732 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.732 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:08.732 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:08.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:08.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:08.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:08.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:08.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:08.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:08.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:08.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:08.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:08.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:08.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:08.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:08.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:08.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:08.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:08.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:08.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:08.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:08.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:08.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:08.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:08.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:08.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:08.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:08.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:08.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:08.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:08.736 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.736 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.736 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.737 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.737 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:42:08.737 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 114.12550088899999, 2024-04-25T22:42:08.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:42:08.737 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:08.737 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:08.737 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.737 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:08.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:08.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:42:08.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:08.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:42:08.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:08.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:42:08.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:42:08.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:08.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:42:08.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:42:08.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:08.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:42:08.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:42:08.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:42:08.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:42:08.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:42:08.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:42:08.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:08.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:42:08.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:42:08.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:42:08.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:42:08.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:08.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:42:08.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:42:08.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:08.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:42:08.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:42:08.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:08.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:42:08.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:42:08.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:42:08.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:42:08.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:08.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:42:08.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:42:08.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:08.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:42:08.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:42:08.742 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.742 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.742 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.743 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.743 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:08.743 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 114.12539706299999, 2024-04-25T22:42:08.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:42:08.743 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:08.743 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:08.743 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.743 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:08.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:08.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:08.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:08.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:08.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:08.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:42:08.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:42:08.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:08.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:42:08.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:42:08.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:08.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:42:08.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:42:08.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:42:08.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:42:08.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:42:08.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:42:08.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:08.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:42:08.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:42:08.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:42:08.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:42:08.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:08.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:42:08.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:42:08.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.747 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:08.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:42:08.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:42:08.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.747 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:08.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:42:08.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:42:08.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.747 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:42:08.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:42:08.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:08.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:42:08.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:42:08.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:08.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:42:08.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:42:08.748 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.748 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.748 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.749 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.749 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:08.749 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 114.12532827299999, 2024-04-25T22:42:08.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:08.749 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:08.749 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:08.749 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.749 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:08.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:08.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:08.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:08.750 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:08.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.750 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:08.750 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:08.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:08.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.750 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:08.750 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:08.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:08.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:08.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:08.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:08.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:08.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:08.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:08.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:08.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:08.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:08.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:08.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:08.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:08.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:08.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:08.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:08.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:08.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:08.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:08.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:08.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:08.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:08.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:08.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:08.754 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.754 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:08.754 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:08.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:08.754 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.754 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:08.754 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:08.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:08.754 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.754 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.754 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.755 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.755 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.755 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.755 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:08.755 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 114.125259187, 2024-04-25T22:42:08.755 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:42:08.755 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:08.755 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:08.755 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.755 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:08.755 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.755 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:08.755 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:08.755 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.756 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:08.756 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:08.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.756 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:08.756 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:42:08.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:42:08.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.756 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:08.756 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:42:08.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:42:08.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:08.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:42:08.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:42:08.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:42:08.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:42:08.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:42:08.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:42:08.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:08.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:42:08.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:42:08.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:42:08.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:42:08.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:08.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:42:08.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:42:08.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.759 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:08.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:42:08.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:42:08.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.759 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:08.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:42:08.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:42:08.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.760 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.760 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:42:08.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:42:08.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.760 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:08.760 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:42:08.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:42:08.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.760 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:08.760 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:42:08.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:42:08.760 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.760 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.760 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.761 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.761 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.761 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.761 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:08.761 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 114.125163074, 2024-04-25T22:42:08.761 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:08.761 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:08.761 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:08.761 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:08.761 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:08.761 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.761 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:08.761 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:08.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.762 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:08.762 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:08.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.762 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:08.762 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:08.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:08.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:08.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:08.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:08.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:08.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:08.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:08.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:08.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:08.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:08.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:08.764 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:08.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:08.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:08.764 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:08.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:08.765 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.765 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.765 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:08.765 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:08.765 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:08.765 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.765 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.765 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:08.765 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:08.765 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:08.765 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.765 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.765 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.765 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.766 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.766 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:08.766 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 114.125097412, 2024-04-25T22:42:08.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:08.766 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:08.766 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:08.766 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:08.766 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:08.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.766 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:08.766 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:08.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.766 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.767 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:08.767 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:08.767 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.767 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.767 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:08.767 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:08.767 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:08.767 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.767 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:08.767 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:08.767 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:08.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:08.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:08.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:08.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:08.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:08.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:08.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:08.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:08.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:08.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:08.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:08.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:08.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:08.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:08.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:08.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.770 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:08.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:08.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:08.770 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.770 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.770 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.770 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:08.770 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:08.770 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 114.125028285, 2024-04-25T22:42:08.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:42:08.771 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:08.771 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:08.771 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:08.771 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:08.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:08.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:08.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:08.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:08.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:08.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:42:08.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:42:08.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:08.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:42:08.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:42:08.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:08.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:42:08.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:42:08.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:42:08.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:42:08.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:42:08.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:42:08.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:08.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:42:08.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:42:08.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:42:08.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:42:08.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:08.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:42:08.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:42:08.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:08.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:42:08.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:42:08.775 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.775 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.775 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.775 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.775 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.775 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-25T22:42:08.775 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:42:08.775 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 14.726230426000001, 2024-04-25T22:42:08.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.02435211, 2024-04-25T22:42:08.775 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:08.775 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:08.775 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.775 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:08.775 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:08.775 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:08.775 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 5 2024-04-25T22:42:08.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.776 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:08.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:08.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:42:08.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:08.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:42:08.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:08.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995113+0000", 2024-04-25T22:42:08.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2760000000000001e-06 2024-04-25T22:42:08.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:08.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002825+0000", 2024-04-25T22:42:08.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077127000000000003 2024-04-25T22:42:08.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:08.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002852+0000", 2024-04-25T22:42:08.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6570000000000001e-05 2024-04-25T22:42:08.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002866+0000", 2024-04-25T22:42:08.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4144999999999999e-05 2024-04-25T22:42:08.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.778 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002947+0000", 2024-04-25T22:42:08.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0740000000000003e-05 2024-04-25T22:42:08.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:08.778 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.003049+0000", 2024-04-25T22:42:08.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101829 2024-04-25T22:42:08.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:08.779 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019091+0000", 2024-04-25T22:42:08.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016042638000000001 2024-04-25T22:42:08.779 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.779 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.779 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:08.779 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019227+0000", 2024-04-25T22:42:08.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000135826 2024-04-25T22:42:08.779 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.779 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.779 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:08.779 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019462+0000", 2024-04-25T22:42:08.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000234386 2024-04-25T22:42:08.779 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.779 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.780 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.780 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:75 3.b 3:d5c7a900:::200.00000003:head [write 923330~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:08.780 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.598989+0000", 2024-04-25T22:42:08.780 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 9.1223506239999992, 2024-04-25T22:42:08.780 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017059059000000001, 2024-04-25T22:42:08.780 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:08.780 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:08.780 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.780 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:08.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:08.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598989+0000", 2024-04-25T22:42:08.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:08.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598989+0000", 2024-04-25T22:42:08.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:08.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598990+0000", 2024-04-25T22:42:08.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0279999999999999e-06 2024-04-25T22:42:08.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:08.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599003+0000", 2024-04-25T22:42:08.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2306999999999999e-05 2024-04-25T22:42:08.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:08.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599017+0000", 2024-04-25T22:42:08.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4064e-05 2024-04-25T22:42:08.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599041+0000", 2024-04-25T22:42:08.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4054999999999999e-05 2024-04-25T22:42:08.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606871+0000", 2024-04-25T22:42:08.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0078301580000000003 2024-04-25T22:42:08.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:08.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606928+0000", 2024-04-25T22:42:08.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7479999999999999e-05 2024-04-25T22:42:08.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.784 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:08.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607019+0000", 2024-04-25T22:42:08.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0761999999999996e-05 2024-04-25T22:42:08.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.784 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:08.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611057+0000", 2024-04-25T22:42:08.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040381260000000004 2024-04-25T22:42:08.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.784 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615923+0000", 2024-04-25T22:42:08.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048658319999999996 2024-04-25T22:42:08.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.785 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:08.785 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615996+0000", 2024-04-25T22:42:08.785 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3108000000000005e-05 2024-04-25T22:42:08.785 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.785 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:08.785 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616048+0000", 2024-04-25T22:42:08.785 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2138999999999997e-05 2024-04-25T22:42:08.785 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.785 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.785 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.785 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.785 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:76 3.b 3:d5c7a900:::200.00000003:head [write 924729~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:08.785 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.599056+0000", 2024-04-25T22:42:08.786 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 9.1222835799999995, 2024-04-25T22:42:08.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017101028000000001, 2024-04-25T22:42:08.786 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:08.786 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:08.786 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.786 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:08.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:08.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599056+0000", 2024-04-25T22:42:08.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:08.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599056+0000", 2024-04-25T22:42:08.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:08.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599057+0000", 2024-04-25T22:42:08.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1500000000000003e-07 2024-04-25T22:42:08.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:08.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599063+0000", 2024-04-25T22:42:08.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6930000000000004e-06 2024-04-25T22:42:08.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:08.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599085+0000", 2024-04-25T22:42:08.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2544e-05 2024-04-25T22:42:08.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599098+0000", 2024-04-25T22:42:08.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2425999999999999e-05 2024-04-25T22:42:08.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607316+0000", 2024-04-25T22:42:08.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082178489999999993 2024-04-25T22:42:08.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:08.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607452+0000", 2024-04-25T22:42:08.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000135885 2024-04-25T22:42:08.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:08.789 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607602+0000", 2024-04-25T22:42:08.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015049200000000001 2024-04-25T22:42:08.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:08.789 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611073+0000", 2024-04-25T22:42:08.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0034707079999999999 2024-04-25T22:42:08.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.789 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616091+0000", 2024-04-25T22:42:08.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0050181779999999999 2024-04-25T22:42:08.790 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.790 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:08.790 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616121+0000", 2024-04-25T22:42:08.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0399000000000002e-05 2024-04-25T22:42:08.790 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.790 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:08.790 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616157+0000", 2024-04-25T22:42:08.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6038999999999998e-05 2024-04-25T22:42:08.790 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.790 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.790 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.791 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.791 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.791 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:77 3.b 3:d5c7a900:::200.00000003:head [write 926128~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:08.791 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.599112+0000", 2024-04-25T22:42:08.791 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 9.1222274120000009, 2024-04-25T22:42:08.791 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017211087, 2024-04-25T22:42:08.791 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:08.791 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:08.791 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.791 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:08.791 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.791 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:08.791 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599112+0000", 2024-04-25T22:42:08.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:08.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599112+0000", 2024-04-25T22:42:08.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:08.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599113+0000", 2024-04-25T22:42:08.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7499999999999999e-07 2024-04-25T22:42:08.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:08.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599119+0000", 2024-04-25T22:42:08.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0349999999999998e-06 2024-04-25T22:42:08.793 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.793 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.793 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:08.793 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599138+0000", 2024-04-25T22:42:08.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8345000000000001e-05 2024-04-25T22:42:08.793 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.793 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.793 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.793 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599150+0000", 2024-04-25T22:42:08.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1902000000000001e-05 2024-04-25T22:42:08.793 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.793 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.793 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.794 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608267+0000", 2024-04-25T22:42:08.794 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091174380000000003 2024-04-25T22:42:08.794 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.794 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.794 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:08.794 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608341+0000", 2024-04-25T22:42:08.794 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4029000000000006e-05 2024-04-25T22:42:08.794 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.794 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.794 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:08.794 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608435+0000", 2024-04-25T22:42:08.794 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3541000000000004e-05 2024-04-25T22:42:08.794 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.795 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:08.795 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.613682+0000", 2024-04-25T22:42:08.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0052474829999999998 2024-04-25T22:42:08.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.795 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.795 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616211+0000", 2024-04-25T22:42:08.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025291490000000001 2024-04-25T22:42:08.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.795 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:08.796 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616276+0000", 2024-04-25T22:42:08.796 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4590000000000003e-05 2024-04-25T22:42:08.796 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.796 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.796 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:08.796 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616324+0000", 2024-04-25T22:42:08.796 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7700000000000001e-05 2024-04-25T22:42:08.796 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.796 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.796 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.796 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.796 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.796 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:78 3.b 3:d5c7a900:::200.00000003:head [write 927532~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:08.796 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.599164+0000", 2024-04-25T22:42:08.797 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 9.1221759650000003, 2024-04-25T22:42:08.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017312029999999999, 2024-04-25T22:42:08.797 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:08.797 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:08.797 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.797 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:08.797 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:08.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599164+0000", 2024-04-25T22:42:08.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.797 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:08.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599164+0000", 2024-04-25T22:42:08.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:08.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599165+0000", 2024-04-25T22:42:08.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6899999999999996e-07 2024-04-25T22:42:08.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:08.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599177+0000", 2024-04-25T22:42:08.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2461e-05 2024-04-25T22:42:08.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:08.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599191+0000", 2024-04-25T22:42:08.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3888e-05 2024-04-25T22:42:08.799 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.799 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.799 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.799 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599206+0000", 2024-04-25T22:42:08.799 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4346e-05 2024-04-25T22:42:08.799 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.799 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.799 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.799 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608700+0000", 2024-04-25T22:42:08.799 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0094949140000000001 2024-04-25T22:42:08.799 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.799 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.799 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:08.799 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608786+0000", 2024-04-25T22:42:08.799 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5587000000000006e-05 2024-04-25T22:42:08.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:08.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608921+0000", 2024-04-25T22:42:08.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013478900000000001 2024-04-25T22:42:08.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:08.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.613698+0000", 2024-04-25T22:42:08.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0047773859999999998 2024-04-25T22:42:08.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616386+0000", 2024-04-25T22:42:08.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0026877770000000001 2024-04-25T22:42:08.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.801 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:08.801 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616440+0000", 2024-04-25T22:42:08.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4490000000000002e-05 2024-04-25T22:42:08.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.801 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:08.801 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616476+0000", 2024-04-25T22:42:08.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5522999999999999e-05 2024-04-25T22:42:08.801 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.801 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.801 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.802 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:109 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:42:08.802 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:02.620631+0000", 2024-04-25T22:42:08.802 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 6.1007089299999997, 2024-04-25T22:42:08.802 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027780309999999999, 2024-04-25T22:42:08.802 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:08.802 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:08.802 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.802 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:08.802 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.802 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:08.802 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620631+0000", 2024-04-25T22:42:08.802 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.802 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.802 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:08.803 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620631+0000", 2024-04-25T22:42:08.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.803 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:08.803 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620632+0000", 2024-04-25T22:42:08.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.364e-06 2024-04-25T22:42:08.803 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:08.803 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620751+0000", 2024-04-25T22:42:08.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011838299999999999 2024-04-25T22:42:08.803 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.804 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:08.804 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620764+0000", 2024-04-25T22:42:08.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3203e-05 2024-04-25T22:42:08.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.804 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.804 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620771+0000", 2024-04-25T22:42:08.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4080000000000001e-06 2024-04-25T22:42:08.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.804 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.804 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620840+0000", 2024-04-25T22:42:08.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8696999999999996e-05 2024-04-25T22:42:08.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.805 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:08.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620919+0000", 2024-04-25T22:42:08.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9379e-05 2024-04-25T22:42:08.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.805 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:08.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.626976+0000", 2024-04-25T22:42:08.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060565610000000002 2024-04-25T22:42:08.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.805 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:08.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643495+0000", 2024-04-25T22:42:08.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016518950000000001 2024-04-25T22:42:08.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.806 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.648308+0000", 2024-04-25T22:42:08.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048133799999999999 2024-04-25T22:42:08.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.806 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:08.806 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.648369+0000", 2024-04-25T22:42:08.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0285000000000003e-05 2024-04-25T22:42:08.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.806 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:08.806 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.648411+0000", 2024-04-25T22:42:08.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2700000000000001e-05 2024-04-25T22:42:08.806 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.807 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.807 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.807 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.807 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:6294 4.2d 4:b5ee1071:::10000001cd6.00000000:head [write 0~6362] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-25T22:42:08.807 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:02.625474+0000", 2024-04-25T22:42:08.807 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 6.0958659070000003, 2024-04-25T22:42:08.807 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018135539999999999, 2024-04-25T22:42:08.807 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:08.807 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:08.807 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.807 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:08.807 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:08.807 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:08.808 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 6294 2024-04-25T22:42:08.808 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.808 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:08.808 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.808 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:08.808 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625474+0000", 2024-04-25T22:42:08.808 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.808 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.808 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.808 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:08.808 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625474+0000", 2024-04-25T22:42:08.808 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.808 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.808 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.808 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:08.808 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625475+0000", 2024-04-25T22:42:08.809 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6899999999999996e-07 2024-04-25T22:42:08.809 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.809 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:08.809 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625485+0000", 2024-04-25T22:42:08.809 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:42:08.809 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.809 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:08.809 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625493+0000", 2024-04-25T22:42:08.809 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2800000000000003e-06 2024-04-25T22:42:08.809 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.809 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.809 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625499+0000", 2024-04-25T22:42:08.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7830000000000004e-06 2024-04-25T22:42:08.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.810 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.810 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625555+0000", 2024-04-25T22:42:08.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6776e-05 2024-04-25T22:42:08.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.810 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:08.810 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625685+0000", 2024-04-25T22:42:08.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000129519 2024-04-25T22:42:08.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.810 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:08.811 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643438+0000", 2024-04-25T22:42:08.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017753023 2024-04-25T22:42:08.811 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.811 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:08.811 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643510+0000", 2024-04-25T22:42:08.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2020999999999994e-05 2024-04-25T22:42:08.811 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.811 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:08.811 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643610+0000", 2024-04-25T22:42:08.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9543999999999994e-05 2024-04-25T22:42:08.811 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.811 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.811 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.812 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:113 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-25T22:42:08.812 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:03.622392+0000", 2024-04-25T22:42:08.812 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 5.0989478889999997, 2024-04-25T22:42:08.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027294512999999999, 2024-04-25T22:42:08.812 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:08.812 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:08.812 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.812 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:08.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:08.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622392+0000", 2024-04-25T22:42:08.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.813 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.813 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.813 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:08.813 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622392+0000", 2024-04-25T22:42:08.813 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.813 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.813 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.813 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:08.813 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622394+0000", 2024-04-25T22:42:08.813 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.39e-06 2024-04-25T22:42:08.813 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.813 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.813 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:08.813 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622486+0000", 2024-04-25T22:42:08.813 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1497999999999997e-05 2024-04-25T22:42:08.814 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.814 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.814 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:08.814 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622516+0000", 2024-04-25T22:42:08.814 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0281999999999999e-05 2024-04-25T22:42:08.814 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.814 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.814 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.814 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622531+0000", 2024-04-25T22:42:08.814 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4980000000000001e-05 2024-04-25T22:42:08.814 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.814 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.814 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.814 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622653+0000", 2024-04-25T22:42:08.815 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012210000000000001 2024-04-25T22:42:08.815 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.815 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.815 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:08.815 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622795+0000", 2024-04-25T22:42:08.815 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014171 2024-04-25T22:42:08.815 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.815 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.815 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:08.815 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.630487+0000", 2024-04-25T22:42:08.815 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076922680000000004 2024-04-25T22:42:08.815 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.815 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.815 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.815 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.640781+0000", 2024-04-25T22:42:08.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010293416 2024-04-25T22:42:08.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.816 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:08.816 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.649494+0000", 2024-04-25T22:42:08.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0087134670000000008 2024-04-25T22:42:08.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.816 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:08.816 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.649575+0000", 2024-04-25T22:42:08.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0655000000000006e-05 2024-04-25T22:42:08.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.816 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:08.816 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.649687+0000", 2024-04-25T22:42:08.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000111747 2024-04-25T22:42:08.817 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.817 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.817 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.817 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.817 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.817 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:206 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T22:42:08.817 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:06.627161+0000", 2024-04-25T22:42:08.817 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 2.0941787010000001, 2024-04-25T22:42:08.817 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023978682000000001, 2024-04-25T22:42:08.817 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:08.817 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:08.817 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.817 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:08.817 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.817 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:08.817 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627161+0000", 2024-04-25T22:42:08.818 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.818 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.818 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.818 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:08.818 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627161+0000", 2024-04-25T22:42:08.818 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.818 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.818 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.818 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:08.818 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627163+0000", 2024-04-25T22:42:08.818 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.697e-06 2024-04-25T22:42:08.818 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.818 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.819 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:08.819 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627376+0000", 2024-04-25T22:42:08.819 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021294799999999999 2024-04-25T22:42:08.819 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.819 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.819 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:08.819 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627396+0000", 2024-04-25T22:42:08.819 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9715999999999999e-05 2024-04-25T22:42:08.819 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.819 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.819 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.819 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627408+0000", 2024-04-25T22:42:08.819 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2357e-05 2024-04-25T22:42:08.819 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.819 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.820 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.820 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627513+0000", 2024-04-25T22:42:08.820 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000105308 2024-04-25T22:42:08.820 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.820 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.820 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:08.820 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627648+0000", 2024-04-25T22:42:08.820 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000134623 2024-04-25T22:42:08.820 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.820 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.820 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:08.820 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.635301+0000", 2024-04-25T22:42:08.820 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076529060000000001 2024-04-25T22:42:08.820 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.820 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.820 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.643793+0000", 2024-04-25T22:42:08.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0084921070000000005 2024-04-25T22:42:08.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:08.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.650872+0000", 2024-04-25T22:42:08.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070795500000000004 2024-04-25T22:42:08.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:08.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.651029+0000", 2024-04-25T22:42:08.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000156296 2024-04-25T22:42:08.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:08.822 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.651140+0000", 2024-04-25T22:42:08.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000111174 2024-04-25T22:42:08.822 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.822 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.822 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.822 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.822 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:210 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T22:42:08.822 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:07.630424+0000", 2024-04-25T22:42:08.822 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.090915734, 2024-04-25T22:42:08.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025612091999999999, 2024-04-25T22:42:08.822 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:08.822 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:08.822 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.822 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:08.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:08.823 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.630424+0000", 2024-04-25T22:42:08.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.823 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:08.823 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.630424+0000", 2024-04-25T22:42:08.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.823 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:08.823 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.630431+0000", 2024-04-25T22:42:08.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7839999999999998e-06 2024-04-25T22:42:08.824 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.824 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:08.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.630669+0000", 2024-04-25T22:42:08.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000237691 2024-04-25T22:42:08.824 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.824 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:08.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.630695+0000", 2024-04-25T22:42:08.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6596000000000001e-05 2024-04-25T22:42:08.824 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.824 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.630720+0000", 2024-04-25T22:42:08.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4828999999999999e-05 2024-04-25T22:42:08.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.825 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.825 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.825 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.630848+0000", 2024-04-25T22:42:08.825 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012828699999999999 2024-04-25T22:42:08.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.825 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.825 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:08.825 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.631091+0000", 2024-04-25T22:42:08.825 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000243105 2024-04-25T22:42:08.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.825 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.825 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:08.825 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.639016+0000", 2024-04-25T22:42:08.825 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0079241669999999993 2024-04-25T22:42:08.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.826 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:08.826 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.648739+0000", 2024-04-25T22:42:08.826 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0097232450000000002 2024-04-25T22:42:08.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.826 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:08.826 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.655858+0000", 2024-04-25T22:42:08.826 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071188919999999999 2024-04-25T22:42:08.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.826 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:08.826 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.655973+0000", 2024-04-25T22:42:08.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000114838 2024-04-25T22:42:08.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:08.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.656036+0000", 2024-04-25T22:42:08.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3658000000000006e-05 2024-04-25T22:42:08.827 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.827 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.827 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.827 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:9757 4.3a e62/17 4:5e14edba:::10000002cd2.00000000:head v 62'154, mlcod=62'152)", 2024-04-25T22:42:08.827 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:07.959466+0000", 2024-04-25T22:42:08.827 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.76187430899999997, 2024-04-25T22:42:08.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017281594000000001, 2024-04-25T22:42:08.828 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:08.828 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:08.828 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:08.828 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:08.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:08.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.959466+0000", 2024-04-25T22:42:08.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:08.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.959466+0000", 2024-04-25T22:42:08.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:08.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:08.829 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.959472+0000", 2024-04-25T22:42:08.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8770000000000004e-06 2024-04-25T22:42:08.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:08.829 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.965456+0000", 2024-04-25T22:42:08.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059831709999999998 2024-04-25T22:42:08.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:08.829 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.965486+0000", 2024-04-25T22:42:08.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0508999999999999e-05 2024-04-25T22:42:08.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.830 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:08.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.965501+0000", 2024-04-25T22:42:08.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4722999999999999e-05 2024-04-25T22:42:08.830 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.830 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:08.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.965632+0000", 2024-04-25T22:42:08.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013080000000000001 2024-04-25T22:42:08.830 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.830 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:08.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.965667+0000", 2024-04-25T22:42:08.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4972999999999999e-05 2024-04-25T22:42:08.830 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.831 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.831 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:08.831 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.976627+0000", 2024-04-25T22:42:08.831 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010960701 2024-04-25T22:42:08.831 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:08.831 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:08.831 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:08.831 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.976747+0000", 2024-04-25T22:42:08.831 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011984 2024-04-25T22:42:08.831 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.831 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.831 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.831 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:08.831 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:08.831 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:08.832 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:08.833 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:08.833 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:08.833 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:08.834 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:08.827+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:08.834 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:08.835 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:08.835 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:08.835 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:08.934 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:08.927+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:08.982 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:08.982 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:08.998 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:09.035 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:09.031+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:09.130 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:09.130 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:09.136 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:09.131+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:09.146 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:09.237 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:09.232+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:09.264 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:09.264 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:09.278 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:09.337 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:09.336+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:09.423 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:09.423 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:09.438 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:09.431+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:09.439 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:09.490 INFO:tasks.workunit.client.0.smithi057.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-25T22:42:09.494 INFO:tasks.workunit.client.0.smithi057.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T22:42:09.495 INFO:tasks.workunit.client.0.smithi057.stderr:+ make 2024-04-25T22:42:09.539 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:09.536+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:09.555 INFO:tasks.workunit.client.0.smithi057.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-25T22:42:09.606 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:09.606 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:09.621 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:09.640 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:09.636+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:09.741 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:09.736+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:09.747 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:09.747 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:09.762 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:09.821 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is unset 2024-04-25T22:42:09.841 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:09.840+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:09.894 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:09.894 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:09.908 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:09.941 INFO:tasks.workunit.client.0.smithi057.stderr:++ readlink -f fsstress 2024-04-25T22:42:09.942 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:09.939+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:09.943 INFO:tasks.workunit.client.0.smithi057.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-25T22:42:09.943 INFO:tasks.workunit.client.0.smithi057.stderr:+ popd 2024-04-25T22:42:09.944 INFO:tasks.workunit.client.0.smithi057.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T22:42:09.944 INFO:tasks.workunit.client.0.smithi057.stderr:+ popd 2024-04-25T22:42:09.944 INFO:tasks.workunit.client.0.smithi057.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-25T22:42:09.945 INFO:tasks.workunit.client.0.smithi057.stderr:++ mktemp -d -p . 2024-04-25T22:42:09.946 INFO:tasks.workunit.client.0.smithi057.stderr:+ T=./tmp.NQ9Lo7tXV9 2024-04-25T22:42:09.946 INFO:tasks.workunit.client.0.smithi057.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.NQ9Lo7tXV9 -l 1 -n 1000 -p 10 -v 2024-04-25T22:42:09.948 INFO:tasks.workunit.client.0.smithi057.stdout:seed = 1713676542 2024-04-25T22:42:09.949 INFO:tasks.workunit.client.0.smithi057.stdout:0/0: write - no filename 2024-04-25T22:42:09.949 INFO:tasks.workunit.client.0.smithi057.stdout:0/1: fsync - no filename 2024-04-25T22:42:09.949 INFO:tasks.workunit.client.0.smithi057.stdout:0/2: unlink - no file 2024-04-25T22:42:09.949 INFO:tasks.workunit.client.0.smithi057.stdout:0/3: write - no filename 2024-04-25T22:42:09.949 INFO:tasks.workunit.client.0.smithi057.stdout:0/4: rename - no filename 2024-04-25T22:42:09.951 INFO:tasks.workunit.client.0.smithi057.stdout:0/5: mkdir d0 0 2024-04-25T22:42:09.951 INFO:tasks.workunit.client.0.smithi057.stdout:0/6: dwrite - no filename 2024-04-25T22:42:09.951 INFO:tasks.workunit.client.0.smithi057.stdout:2/0: dread - no filename 2024-04-25T22:42:09.952 INFO:tasks.workunit.client.0.smithi057.stdout:2/1: write - no filename 2024-04-25T22:42:09.952 INFO:tasks.workunit.client.0.smithi057.stdout:2/2: chown . 276103 1 2024-04-25T22:42:09.952 INFO:tasks.workunit.client.0.smithi057.stdout:2/3: truncate - no filename 2024-04-25T22:42:09.952 INFO:tasks.workunit.client.0.smithi057.stdout:1/0: getdents . 0 2024-04-25T22:42:09.952 INFO:tasks.workunit.client.0.smithi057.stdout:1/1: write - no filename 2024-04-25T22:42:09.952 INFO:tasks.workunit.client.0.smithi057.stdout:1/2: truncate - no filename 2024-04-25T22:42:09.952 INFO:tasks.workunit.client.0.smithi057.stdout:1/3: rmdir - no directory 2024-04-25T22:42:09.952 INFO:tasks.workunit.client.0.smithi057.stdout:1/4: dwrite - no filename 2024-04-25T22:42:09.952 INFO:tasks.workunit.client.0.smithi057.stdout:2/4: chown . 56662235 1 2024-04-25T22:42:09.952 INFO:tasks.workunit.client.0.smithi057.stdout:0/7: symlink d0/l1 0 2024-04-25T22:42:09.952 INFO:tasks.workunit.client.0.smithi057.stdout:2/5: chown . 343529761 1 2024-04-25T22:42:09.952 INFO:tasks.workunit.client.0.smithi057.stdout:2/6: truncate - no filename 2024-04-25T22:42:09.952 INFO:tasks.workunit.client.0.smithi057.stdout:2/7: rmdir - no directory 2024-04-25T22:42:09.952 INFO:tasks.workunit.client.0.smithi057.stdout:2/8: read - no filename 2024-04-25T22:42:09.953 INFO:tasks.workunit.client.0.smithi057.stdout:3/0: read - no filename 2024-04-25T22:42:09.953 INFO:tasks.workunit.client.0.smithi057.stdout:3/1: write - no filename 2024-04-25T22:42:09.953 INFO:tasks.workunit.client.0.smithi057.stdout:3/2: dread - no filename 2024-04-25T22:42:09.953 INFO:tasks.workunit.client.0.smithi057.stdout:3/3: dwrite - no filename 2024-04-25T22:42:09.953 INFO:tasks.workunit.client.0.smithi057.stdout:2/9: chown . 639 1 2024-04-25T22:42:09.953 INFO:tasks.workunit.client.0.smithi057.stdout:4/0: rmdir - no directory 2024-04-25T22:42:09.953 INFO:tasks.workunit.client.0.smithi057.stdout:0/8: chown d0/l1 656 1 2024-04-25T22:42:09.953 INFO:tasks.workunit.client.0.smithi057.stdout:0/9: dwrite - no filename 2024-04-25T22:42:09.953 INFO:tasks.workunit.client.0.smithi057.stdout:0/10: dwrite - no filename 2024-04-25T22:42:09.953 INFO:tasks.workunit.client.0.smithi057.stdout:0/11: dread - no filename 2024-04-25T22:42:09.953 INFO:tasks.workunit.client.0.smithi057.stdout:0/12: truncate - no filename 2024-04-25T22:42:09.953 INFO:tasks.workunit.client.0.smithi057.stdout:4/1: chown . 18 1 2024-04-25T22:42:09.953 INFO:tasks.workunit.client.0.smithi057.stdout:4/2: dwrite - no filename 2024-04-25T22:42:09.953 INFO:tasks.workunit.client.0.smithi057.stdout:4/3: dread - no filename 2024-04-25T22:42:09.958 INFO:tasks.workunit.client.0.smithi057.stdout:2/10: creat f0 x:0 0 0 2024-04-25T22:42:09.958 INFO:tasks.workunit.client.0.smithi057.stdout:3/4: mkdir d0 0 2024-04-25T22:42:09.958 INFO:tasks.workunit.client.0.smithi057.stdout:2/11: symlink l1 0 2024-04-25T22:42:09.958 INFO:tasks.workunit.client.0.smithi057.stdout:4/4: mknod c0 0 2024-04-25T22:42:09.958 INFO:tasks.workunit.client.0.smithi057.stdout:4/5: dread - no filename 2024-04-25T22:42:09.959 INFO:tasks.workunit.client.0.smithi057.stdout:4/6: dwrite - no filename 2024-04-25T22:42:09.959 INFO:tasks.workunit.client.0.smithi057.stdout:4/7: rmdir - no directory 2024-04-25T22:42:09.959 INFO:tasks.workunit.client.0.smithi057.stdout:4/8: readlink - no filename 2024-04-25T22:42:09.959 INFO:tasks.workunit.client.0.smithi057.stdout:6/0: rmdir - no directory 2024-04-25T22:42:09.959 INFO:tasks.workunit.client.0.smithi057.stdout:3/5: symlink d0/l1 0 2024-04-25T22:42:09.959 INFO:tasks.workunit.client.0.smithi057.stdout:7/0: dwrite - no filename 2024-04-25T22:42:09.959 INFO:tasks.workunit.client.0.smithi057.stdout:7/1: dwrite - no filename 2024-04-25T22:42:09.959 INFO:tasks.workunit.client.0.smithi057.stdout:1/5: getdents . 0 2024-04-25T22:42:09.959 INFO:tasks.workunit.client.0.smithi057.stdout:1/6: fsync - no filename 2024-04-25T22:42:09.959 INFO:tasks.workunit.client.0.smithi057.stdout:1/7: write - no filename 2024-04-25T22:42:09.959 INFO:tasks.workunit.client.0.smithi057.stdout:1/8: write - no filename 2024-04-25T22:42:09.959 INFO:tasks.workunit.client.0.smithi057.stdout:1/9: write - no filename 2024-04-25T22:42:09.959 INFO:tasks.workunit.client.0.smithi057.stdout:7/2: chown . 1346617 1 2024-04-25T22:42:09.959 INFO:tasks.workunit.client.0.smithi057.stdout:7/3: rename - no filename 2024-04-25T22:42:09.960 INFO:tasks.workunit.client.0.smithi057.stdout:7/4: fsync - no filename 2024-04-25T22:42:09.960 INFO:tasks.workunit.client.0.smithi057.stdout:4/9: chown c0 12279 1 2024-04-25T22:42:09.960 INFO:tasks.workunit.client.0.smithi057.stdout:0/13: mknod d0/c2 0 2024-04-25T22:42:09.960 INFO:tasks.workunit.client.0.smithi057.stdout:6/1: getdents . 0 2024-04-25T22:42:09.960 INFO:tasks.workunit.client.0.smithi057.stdout:6/2: truncate - no filename 2024-04-25T22:42:09.960 INFO:tasks.workunit.client.0.smithi057.stdout:6/3: stat - no entries 2024-04-25T22:42:09.960 INFO:tasks.workunit.client.0.smithi057.stdout:6/4: fdatasync - no filename 2024-04-25T22:42:09.960 INFO:tasks.workunit.client.0.smithi057.stdout:6/5: read - no filename 2024-04-25T22:42:09.960 INFO:tasks.workunit.client.0.smithi057.stdout:6/6: dwrite - no filename 2024-04-25T22:42:09.960 INFO:tasks.workunit.client.0.smithi057.stdout:6/7: rmdir - no directory 2024-04-25T22:42:09.960 INFO:tasks.workunit.client.0.smithi057.stdout:6/8: write - no filename 2024-04-25T22:42:09.960 INFO:tasks.workunit.client.0.smithi057.stdout:6/9: unlink - no file 2024-04-25T22:42:09.960 INFO:tasks.workunit.client.0.smithi057.stdout:6/10: write - no filename 2024-04-25T22:42:09.960 INFO:tasks.workunit.client.0.smithi057.stdout:6/11: rmdir - no directory 2024-04-25T22:42:09.961 INFO:tasks.workunit.client.0.smithi057.stdout:6/12: write - no filename 2024-04-25T22:42:09.961 INFO:tasks.workunit.client.0.smithi057.stdout:8/0: chown . 506505 1 2024-04-25T22:42:09.961 INFO:tasks.workunit.client.0.smithi057.stdout:8/1: dwrite - no filename 2024-04-25T22:42:09.961 INFO:tasks.workunit.client.0.smithi057.stdout:3/6: symlink d0/l2 0 2024-04-25T22:42:09.961 INFO:tasks.workunit.client.0.smithi057.stdout:8/2: chown . 20 1 2024-04-25T22:42:09.961 INFO:tasks.workunit.client.0.smithi057.stdout:8/3: rename - no filename 2024-04-25T22:42:09.961 INFO:tasks.workunit.client.0.smithi057.stdout:7/5: creat f0 x:0 0 0 2024-04-25T22:42:09.961 INFO:tasks.workunit.client.0.smithi057.stdout:4/10: rename c0 to c1 0 2024-04-25T22:42:09.961 INFO:tasks.workunit.client.0.smithi057.stdout:4/11: truncate - no filename 2024-04-25T22:42:09.961 INFO:tasks.workunit.client.0.smithi057.stdout:6/13: creat f0 x:0 0 0 2024-04-25T22:42:09.961 INFO:tasks.workunit.client.0.smithi057.stdout:9/0: dread - no filename 2024-04-25T22:42:09.961 INFO:tasks.workunit.client.0.smithi057.stdout:9/1: dwrite - no filename 2024-04-25T22:42:09.961 INFO:tasks.workunit.client.0.smithi057.stdout:9/2: readlink - no filename 2024-04-25T22:42:09.961 INFO:tasks.workunit.client.0.smithi057.stdout:1/10: creat f0 x:0 0 0 2024-04-25T22:42:09.961 INFO:tasks.workunit.client.0.smithi057.stdout:6/14: stat f0 0 2024-04-25T22:42:09.962 INFO:tasks.workunit.client.0.smithi057.stdout:3/7: mknod d0/c3 0 2024-04-25T22:42:09.962 INFO:tasks.workunit.client.0.smithi057.stdout:7/6: truncate f0 528494 0 2024-04-25T22:42:09.962 INFO:tasks.workunit.client.0.smithi057.stdout:4/12: symlink l2 0 2024-04-25T22:42:09.962 INFO:tasks.workunit.client.0.smithi057.stdout:8/4: symlink l0 0 2024-04-25T22:42:09.962 INFO:tasks.workunit.client.0.smithi057.stdout:6/15: mknod c1 0 2024-04-25T22:42:09.962 INFO:tasks.workunit.client.0.smithi057.stdout:1/11: chown f0 3 1 2024-04-25T22:42:09.962 INFO:tasks.workunit.client.0.smithi057.stdout:9/3: mkdir d0 0 2024-04-25T22:42:09.962 INFO:tasks.workunit.client.0.smithi057.stdout:4/13: creat f3 x:0 0 0 2024-04-25T22:42:09.962 INFO:tasks.workunit.client.0.smithi057.stdout:3/8: mkdir d0/d4 0 2024-04-25T22:42:09.962 INFO:tasks.workunit.client.0.smithi057.stdout:6/16: mkdir d2 0 2024-04-25T22:42:09.962 INFO:tasks.workunit.client.0.smithi057.stdout:8/5: rename l0 to l1 0 2024-04-25T22:42:09.962 INFO:tasks.workunit.client.0.smithi057.stdout:8/6: dwrite - no filename 2024-04-25T22:42:09.962 INFO:tasks.workunit.client.0.smithi057.stdout:9/4: rmdir d0 0 2024-04-25T22:42:09.962 INFO:tasks.workunit.client.0.smithi057.stdout:8/7: mknod c2 0 2024-04-25T22:42:09.963 INFO:tasks.workunit.client.0.smithi057.stdout:8/8: dwrite - no filename 2024-04-25T22:42:09.963 INFO:tasks.workunit.client.0.smithi057.stdout:6/17: truncate f0 697748 0 2024-04-25T22:42:09.963 INFO:tasks.workunit.client.0.smithi057.stdout:7/7: dread f0 [0,4194304] 0 2024-04-25T22:42:09.963 INFO:tasks.workunit.client.0.smithi057.stdout:3/9: link d0/l2 d0/d4/l5 0 2024-04-25T22:42:09.963 INFO:tasks.workunit.client.0.smithi057.stdout:3/10: write - no filename 2024-04-25T22:42:09.963 INFO:tasks.workunit.client.0.smithi057.stdout:9/5: creat f1 x:0 0 0 2024-04-25T22:42:09.963 INFO:tasks.workunit.client.0.smithi057.stdout:9/6: readlink - no filename 2024-04-25T22:42:09.963 INFO:tasks.workunit.client.0.smithi057.stdout:9/7: readlink - no filename 2024-04-25T22:42:09.963 INFO:tasks.workunit.client.0.smithi057.stdout:6/18: chown f0 22 1 2024-04-25T22:42:09.963 INFO:tasks.workunit.client.0.smithi057.stdout:3/11: creat d0/f6 x:0 0 0 2024-04-25T22:42:09.963 INFO:tasks.workunit.client.0.smithi057.stdout:7/8: rename f0 to f1 0 2024-04-25T22:42:09.963 INFO:tasks.workunit.client.0.smithi057.stdout:9/8: symlink l2 0 2024-04-25T22:42:09.965 INFO:tasks.workunit.client.0.smithi057.stdout:7/9: chown f1 1148189 1 2024-04-25T22:42:09.965 INFO:tasks.workunit.client.0.smithi057.stdout:3/12: dread - d0/f6 zero size 2024-04-25T22:42:09.965 INFO:tasks.workunit.client.0.smithi057.stdout:6/19: symlink d2/l3 0 2024-04-25T22:42:09.966 INFO:tasks.workunit.client.0.smithi057.stdout:9/9: mkdir d3 0 2024-04-25T22:42:09.966 INFO:tasks.workunit.client.0.smithi057.stdout:3/13: unlink d0/c3 0 2024-04-25T22:42:09.966 INFO:tasks.workunit.client.0.smithi057.stdout:2/12: fsync f0 0 2024-04-25T22:42:09.966 INFO:tasks.workunit.client.0.smithi057.stdout:3/14: dread - d0/f6 zero size 2024-04-25T22:42:09.966 INFO:tasks.workunit.client.0.smithi057.stdout:0/14: getdents d0 0 2024-04-25T22:42:09.966 INFO:tasks.workunit.client.0.smithi057.stdout:9/10: write f1 [568257,41945] 0 2024-04-25T22:42:09.966 INFO:tasks.workunit.client.0.smithi057.stdout:1/12: dwrite f0 [0,4194304] 0 2024-04-25T22:42:09.966 INFO:tasks.workunit.client.0.smithi057.stdout:2/13: symlink l2 0 2024-04-25T22:42:09.966 INFO:tasks.workunit.client.0.smithi057.stdout:0/15: mkdir d0/d3 0 2024-04-25T22:42:09.966 INFO:tasks.workunit.client.0.smithi057.stdout:0/16: write - no filename 2024-04-25T22:42:09.966 INFO:tasks.workunit.client.0.smithi057.stdout:4/14: unlink c1 0 2024-04-25T22:42:09.966 INFO:tasks.workunit.client.0.smithi057.stdout:2/14: readlink l1 0 2024-04-25T22:42:09.966 INFO:tasks.workunit.client.0.smithi057.stdout:0/17: readlink d0/l1 0 2024-04-25T22:42:09.966 INFO:tasks.workunit.client.0.smithi057.stdout:2/15: fdatasync f0 0 2024-04-25T22:42:09.967 INFO:tasks.workunit.client.0.smithi057.stdout:9/11: mknod d3/c4 0 2024-04-25T22:42:09.967 INFO:tasks.workunit.client.0.smithi057.stdout:0/18: chown d0/d3 30223247 1 2024-04-25T22:42:09.967 INFO:tasks.workunit.client.0.smithi057.stdout:4/15: creat f4 x:0 0 0 2024-04-25T22:42:09.967 INFO:tasks.workunit.client.0.smithi057.stdout:8/9: stat l1 0 2024-04-25T22:42:09.968 INFO:tasks.workunit.client.0.smithi057.stdout:8/10: truncate - no filename 2024-04-25T22:42:09.968 INFO:tasks.workunit.client.0.smithi057.stdout:0/19: unlink d0/l1 0 2024-04-25T22:42:09.968 INFO:tasks.workunit.client.0.smithi057.stdout:8/11: mknod c3 0 2024-04-25T22:42:09.968 INFO:tasks.workunit.client.0.smithi057.stdout:8/12: unlink l1 0 2024-04-25T22:42:09.968 INFO:tasks.workunit.client.0.smithi057.stdout:8/13: dread - no filename 2024-04-25T22:42:09.968 INFO:tasks.workunit.client.0.smithi057.stdout:2/16: creat f3 x:0 0 0 2024-04-25T22:42:09.968 INFO:tasks.workunit.client.0.smithi057.stdout:8/14: mkdir d4 0 2024-04-25T22:42:09.968 INFO:tasks.workunit.client.0.smithi057.stdout:8/15: read - no filename 2024-04-25T22:42:09.969 INFO:tasks.workunit.client.0.smithi057.stdout:2/17: write f0 [913880,72095] 0 2024-04-25T22:42:09.970 INFO:tasks.workunit.client.0.smithi057.stdout:6/20: getdents d2 0 2024-04-25T22:42:09.971 INFO:tasks.workunit.client.0.smithi057.stdout:4/16: fsync f4 0 2024-04-25T22:42:09.971 INFO:tasks.workunit.client.0.smithi057.stdout:8/16: mkdir d4/d5 0 2024-04-25T22:42:09.972 INFO:tasks.workunit.client.0.smithi057.stdout:6/21: creat d2/f4 x:0 0 0 2024-04-25T22:42:09.972 INFO:tasks.workunit.client.0.smithi057.stdout:8/17: stat c2 0 2024-04-25T22:42:09.972 INFO:tasks.workunit.client.0.smithi057.stdout:4/17: dread - f4 zero size 2024-04-25T22:42:09.974 INFO:tasks.workunit.client.0.smithi057.stdout:8/18: mkdir d4/d6 0 2024-04-25T22:42:09.974 INFO:tasks.workunit.client.0.smithi057.stdout:8/19: dwrite - no filename 2024-04-25T22:42:09.974 INFO:tasks.workunit.client.0.smithi057.stdout:8/20: truncate - no filename 2024-04-25T22:42:09.975 INFO:tasks.workunit.client.0.smithi057.stdout:6/22: mknod d2/c5 0 2024-04-25T22:42:09.975 INFO:tasks.workunit.client.0.smithi057.stdout:4/18: symlink l5 0 2024-04-25T22:42:09.978 INFO:tasks.workunit.client.0.smithi057.stdout:3/15: dwrite d0/f6 [0,4194304] 0 2024-04-25T22:42:09.978 INFO:tasks.workunit.client.0.smithi057.stdout:6/23: rename d2/l3 to d2/l6 0 2024-04-25T22:42:09.979 INFO:tasks.workunit.client.0.smithi057.stdout:9/12: dwrite f1 [0,4194304] 0 2024-04-25T22:42:09.979 INFO:tasks.workunit.client.0.smithi057.stdout:8/21: creat d4/d5/f7 x:0 0 0 2024-04-25T22:42:09.981 INFO:tasks.workunit.client.0.smithi057.stdout:9/13: creat d3/f5 x:0 0 0 2024-04-25T22:42:09.981 INFO:tasks.workunit.client.0.smithi057.stdout:1/13: dwrite f0 [4194304,4194304] 0 2024-04-25T22:42:09.982 INFO:tasks.workunit.client.0.smithi057.stdout:8/22: link c2 d4/c8 0 2024-04-25T22:42:09.982 INFO:tasks.workunit.client.0.smithi057.stdout:9/14: symlink d3/l6 0 2024-04-25T22:42:09.982 INFO:tasks.workunit.client.0.smithi057.stdout:1/14: symlink l1 0 2024-04-25T22:42:09.982 INFO:tasks.workunit.client.0.smithi057.stdout:9/15: creat d3/f7 x:0 0 0 2024-04-25T22:42:09.983 INFO:tasks.workunit.client.0.smithi057.stdout:2/18: dwrite f0 [0,4194304] 0 2024-04-25T22:42:09.983 INFO:tasks.workunit.client.0.smithi057.stdout:9/16: write d3/f5 [645457,22735] 0 2024-04-25T22:42:09.983 INFO:tasks.workunit.client.0.smithi057.stdout:2/19: creat f4 x:0 0 0 2024-04-25T22:42:09.984 INFO:tasks.workunit.client.0.smithi057.stdout:2/20: truncate f3 11107 0 2024-04-25T22:42:09.984 INFO:tasks.workunit.client.0.smithi057.stdout:9/17: truncate d3/f7 987646 0 2024-04-25T22:42:09.984 INFO:tasks.workunit.client.0.smithi057.stdout:2/21: stat l1 0 2024-04-25T22:42:09.984 INFO:tasks.workunit.client.0.smithi057.stdout:9/18: symlink d3/l8 0 2024-04-25T22:42:09.984 INFO:tasks.workunit.client.0.smithi057.stdout:2/22: symlink l5 0 2024-04-25T22:42:09.991 INFO:tasks.workunit.client.0.smithi057.stdout:9/19: getdents d3 0 2024-04-25T22:42:09.992 INFO:tasks.workunit.client.0.smithi057.stdout:9/20: rename d3/f7 to d3/f9 0 2024-04-25T22:42:09.993 INFO:tasks.workunit.client.0.smithi057.stdout:2/23: dread f3 [0,4194304] 0 2024-04-25T22:42:09.993 INFO:tasks.workunit.client.0.smithi057.stdout:2/24: chown f0 136248 1 2024-04-25T22:42:09.994 INFO:tasks.workunit.client.0.smithi057.stdout:2/25: write f3 [924609,7880] 0 2024-04-25T22:42:09.994 INFO:tasks.workunit.client.0.smithi057.stdout:2/26: rename f4 to f6 0 2024-04-25T22:42:09.995 INFO:tasks.workunit.client.0.smithi057.stdout:2/27: rename l5 to l7 0 2024-04-25T22:42:09.995 INFO:tasks.workunit.client.0.smithi057.stdout:9/21: dread f1 [0,4194304] 0 2024-04-25T22:42:09.995 INFO:tasks.workunit.client.0.smithi057.stdout:2/28: link f6 f8 0 2024-04-25T22:42:09.996 INFO:tasks.workunit.client.0.smithi057.stdout:2/29: creat f9 x:0 0 0 2024-04-25T22:42:10.002 INFO:tasks.workunit.client.0.smithi057.stdout:9/22: getdents d3 0 2024-04-25T22:42:10.003 INFO:tasks.workunit.client.0.smithi057.stdout:9/23: rename d3/l8 to d3/la 0 2024-04-25T22:42:10.003 INFO:tasks.workunit.client.0.smithi057.stdout:9/24: mknod d3/cb 0 2024-04-25T22:42:10.007 INFO:tasks.workunit.client.0.smithi057.stdout:3/16: fdatasync d0/f6 0 2024-04-25T22:42:10.008 INFO:tasks.workunit.client.0.smithi057.stdout:3/17: mkdir d0/d4/d7 0 2024-04-25T22:42:10.009 INFO:tasks.workunit.client.0.smithi057.stdout:3/18: link d0/f6 d0/d4/f8 0 2024-04-25T22:42:10.010 INFO:tasks.workunit.client.0.smithi057.stdout:9/25: dwrite d3/f9 [0,4194304] 0 2024-04-25T22:42:10.010 INFO:tasks.workunit.client.0.smithi057.stdout:3/19: write d0/f6 [4739688,38601] 0 2024-04-25T22:42:10.011 INFO:tasks.workunit.client.0.smithi057.stdout:3/20: unlink d0/d4/f8 0 2024-04-25T22:42:10.017 INFO:tasks.workunit.client.0.smithi057.stdout:3/21: dwrite d0/f6 [0,4194304] 0 2024-04-25T22:42:10.018 INFO:tasks.workunit.client.0.smithi057.stdout:3/22: truncate d0/f6 5425523 0 2024-04-25T22:42:10.021 INFO:tasks.workunit.client.0.smithi057.stdout:2/30: getdents . 0 2024-04-25T22:42:10.021 INFO:tasks.workunit.client.0.smithi057.stdout:2/31: read - f8 zero size 2024-04-25T22:42:10.030 INFO:tasks.workunit.client.0.smithi057.stdout:2/32: write f6 [962912,27942] 0 2024-04-25T22:42:10.030 INFO:tasks.workunit.client.0.smithi057.stdout:2/33: readlink l2 0 2024-04-25T22:42:10.031 INFO:tasks.workunit.client.0.smithi057.stdout:2/34: mknod ca 0 2024-04-25T22:42:10.031 INFO:tasks.workunit.client.0.smithi057.stdout:2/35: creat fb x:0 0 0 2024-04-25T22:42:10.033 INFO:tasks.workunit.client.0.smithi057.stdout:3/23: dread d0/f6 [4194304,4194304] 0 2024-04-25T22:42:10.039 INFO:tasks.workunit.client.0.smithi057.stdout:2/36: truncate f6 255986 0 2024-04-25T22:42:10.039 INFO:tasks.workunit.client.0.smithi057.stdout:2/37: symlink lc 0 2024-04-25T22:42:10.039 INFO:tasks.workunit.client.0.smithi057.stdout:2/38: dread - fb zero size 2024-04-25T22:42:10.040 INFO:tasks.workunit.client.0.smithi057.stdout:2/39: creat fd x:0 0 0 2024-04-25T22:42:10.040 INFO:tasks.workunit.client.0.smithi057.stdout:2/40: truncate f0 4782342 0 2024-04-25T22:42:10.043 INFO:tasks.workunit.client.0.smithi057.stdout:2/41: dread f0 [0,4194304] 0 2024-04-25T22:42:10.043 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:10.040+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:10.044 INFO:tasks.workunit.client.0.smithi057.stdout:2/42: write fd [708039,122133] 0 2024-04-25T22:42:10.086 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:10.087 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:10.100 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:10.143 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:10.140+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:10.238 INFO:tasks.workunit.client.0.smithi057.stdout:9/26: read d3/f5 [358332,17555] 0 2024-04-25T22:42:10.239 INFO:tasks.workunit.client.0.smithi057.stdout:9/27: mknod d3/cc 0 2024-04-25T22:42:10.240 INFO:tasks.workunit.client.0.smithi057.stdout:9/28: creat d3/fd x:0 0 0 2024-04-25T22:42:10.245 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:10.239+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:10.247 INFO:tasks.workunit.client.0.smithi057.stdout:9/29: dread d3/f9 [0,4194304] 0 2024-04-25T22:42:10.249 INFO:tasks.workunit.client.0.smithi057.stdout:9/30: unlink d3/cc 0 2024-04-25T22:42:10.251 INFO:tasks.workunit.client.0.smithi057.stdout:9/31: write f1 [5061036,81838] 0 2024-04-25T22:42:10.252 INFO:tasks.workunit.client.0.smithi057.stdout:9/32: chown d3/fd 12 1 2024-04-25T22:42:10.253 INFO:tasks.workunit.client.0.smithi057.stdout:9/33: write f1 [2108163,80113] 0 2024-04-25T22:42:10.255 INFO:tasks.workunit.client.0.smithi057.stdout:9/34: rename d3/cb to d3/ce 0 2024-04-25T22:42:10.255 INFO:tasks.workunit.client.0.smithi057.stdout:9/35: fdatasync d3/fd 0 2024-04-25T22:42:10.256 INFO:tasks.workunit.client.0.smithi057.stdout:9/36: fsync d3/f5 0 2024-04-25T22:42:10.258 INFO:tasks.workunit.client.0.smithi057.stdout:9/37: creat d3/ff x:0 0 0 2024-04-25T22:42:10.259 INFO:tasks.workunit.client.0.smithi057.stdout:9/38: dread - d3/fd zero size 2024-04-25T22:42:10.259 INFO:tasks.workunit.client.0.smithi057.stdout:9/39: rmdir d3 39 2024-04-25T22:42:10.261 INFO:tasks.workunit.client.0.smithi057.stdout:9/40: rename d3/c4 to d3/c10 0 2024-04-25T22:42:10.264 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:10.264 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:10.278 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:10.345 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:10.344+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:10.408 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:10.408 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:10.422 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:10.466 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:10.463+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:10.539 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:10.539 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:10.547 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:10.543+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:10.553 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:10.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2024-04-25T22:42:10.647 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:10.643+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:10.718 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:10.718 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:10.732 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:10.777 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:10.776+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:10.836 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:42:10.849 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:10.848+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:10.864 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:10.865 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:10.879 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:10.950 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:10.947+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:10.996 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:10.996 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:10.996 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:11.017 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:11.017 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:11.020 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:11.020 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:11.044 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:11.044 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:11.044 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:42:11.044 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:42:11.044 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:11.050 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:11.047+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:11.058 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:11.152 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:11.148+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:11.177 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:42:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:42:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:42:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.58027370000001, 2024-04-25T22:42:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:42:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:11.177 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:42:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:42:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:42:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:42:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:42:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:42:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:42:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:42:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:42:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:42:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:42:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:42:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:42:11.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:42:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:42:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:42:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:42:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:42:11.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:42:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:42:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:42:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:42:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:42:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:42:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:42:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:42:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:42:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:42:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:42:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.580185687, 2024-04-25T22:42:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:42:11.185 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:42:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:42:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:42:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:42:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:11.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:42:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:42:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:42:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:42:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:42:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:42:11.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:42:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:42:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:42:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:42:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:42:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:42:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:42:11.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:42:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:42:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:42:11.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:42:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:42:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:42:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:42:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:42:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:42:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:42:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.580113565, 2024-04-25T22:42:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:42:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:11.193 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:11.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:42:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:42:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:11.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:42:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:42:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:42:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:42:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:42:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:42:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:42:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:42:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:11.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:42:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:42:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:42:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:42:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:42:11.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:42:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:42:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:42:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:42:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:42:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:42:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:42:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:42:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:42:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:11.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:42:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:42:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.58000525200001, 2024-04-25T22:42:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:42:11.201 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:11.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:42:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:42:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:42:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:42:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:42:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:42:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:42:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:42:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:42:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:42:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:42:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:42:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:42:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:42:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:42:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:42:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:42:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:42:11.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:42:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:42:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:42:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:42:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:42:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:42:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:42:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:42:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.208 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.57993859600001, 2024-04-25T22:42:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:42:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:42:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:42:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:42:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:42:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:42:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:42:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:42:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:42:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:42:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:42:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:42:11.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:42:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:42:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:42:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:42:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:42:11.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:42:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:42:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:42:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:42:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:42:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:42:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:42:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:42:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:42:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:42:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:11.216 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.579848, 2024-04-25T22:42:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:42:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:11.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:11.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:42:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:42:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:42:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:42:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:42:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:42:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:42:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:42:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:42:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:42:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:42:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:42:11.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:42:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:42:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:42:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:42:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:42:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:42:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:42:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:42:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:42:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:42:11.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:42:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:42:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:42:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:42:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.579783427, 2024-04-25T22:42:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:42:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:11.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:42:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:42:11.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:42:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:42:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:42:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:42:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:42:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:42:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:42:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:42:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:42:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:42:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:42:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:42:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:42:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:11.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:42:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:42:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:42:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:42:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:42:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:42:11.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:42:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:42:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:42:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:42:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.579718004, 2024-04-25T22:42:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:42:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:11.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:42:11.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:42:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:42:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:42:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:42:11.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:42:11.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:42:11.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:42:11.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:42:11.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:11.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:42:11.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:42:11.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:42:11.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:42:11.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:11.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:42:11.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:42:11.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:11.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:42:11.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:42:11.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:11.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:42:11.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:42:11.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:42:11.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:42:11.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:11.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:42:11.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:42:11.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:11.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:42:11.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:42:11.240 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.240 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.240 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.240 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.240 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:42:11.240 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.579661938, 2024-04-25T22:42:11.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:42:11.241 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:11.241 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:11.241 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.241 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:11.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:11.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:42:11.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:11.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:42:11.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:11.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:11.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:42:11.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:11.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:42:11.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:42:11.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:11.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:42:11.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:42:11.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:42:11.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:42:11.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:42:11.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:42:11.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:11.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:42:11.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:42:11.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:42:11.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:42:11.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:11.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:42:11.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:42:11.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:11.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:42:11.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:42:11.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:42:11.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:42:11.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:11.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:42:11.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:42:11.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:11.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:42:11.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:42:11.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:11.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:42:11.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:42:11.248 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.248 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.248 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.249 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.249 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:42:11.249 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.579594832, 2024-04-25T22:42:11.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:42:11.249 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:11.249 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:11.249 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.249 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:11.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:11.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:42:11.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:11.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:42:11.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:11.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:42:11.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:42:11.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:11.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:42:11.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:42:11.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:11.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:42:11.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:42:11.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:42:11.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:42:11.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:42:11.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:42:11.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:11.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:42:11.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:42:11.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:42:11.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:42:11.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:11.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:42:11.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:42:11.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:11.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:42:11.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:42:11.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:42:11.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:42:11.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:11.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:42:11.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:42:11.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:11.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:42:11.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:42:11.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:11.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:42:11.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:42:11.256 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.256 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.256 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.256 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.256 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:11.257 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.579539709, 2024-04-25T22:42:11.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:42:11.257 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:11.257 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:11.257 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.257 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:11.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:11.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:11.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:11.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:11.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:11.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:42:11.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:42:11.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:11.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:42:11.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:42:11.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:11.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:42:11.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:42:11.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:42:11.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:42:11.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:42:11.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:42:11.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:11.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:42:11.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:42:11.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:42:11.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:42:11.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:11.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:42:11.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:42:11.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:11.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:42:11.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:42:11.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:42:11.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:42:11.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:11.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:42:11.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:42:11.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:11.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:42:11.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:42:11.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:11.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:42:11.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:42:11.264 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.264 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.264 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.264 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.264 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:11.264 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.57943747, 2024-04-25T22:42:11.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:42:11.265 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:11.265 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:11.265 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.265 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:11.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:11.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:11.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:11.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:11.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:11.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:42:11.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:42:11.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:11.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:42:11.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:42:11.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:11.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:42:11.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:42:11.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:42:11.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:42:11.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:42:11.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:42:11.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:11.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:42:11.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:42:11.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:42:11.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:42:11.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:11.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:42:11.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:42:11.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:11.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:42:11.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:42:11.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:42:11.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:42:11.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:11.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:42:11.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:42:11.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:11.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:42:11.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:42:11.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:11.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:42:11.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:42:11.272 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.272 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.272 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.272 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.272 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:42:11.272 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.579378647, 2024-04-25T22:42:11.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:42:11.272 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:11.272 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:11.272 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.273 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:11.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:11.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:42:11.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:11.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:42:11.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:11.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:42:11.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:42:11.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:11.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:42:11.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:42:11.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:11.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:42:11.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:42:11.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:42:11.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:42:11.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:42:11.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:42:11.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:11.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:42:11.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:42:11.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:42:11.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:42:11.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:11.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:42:11.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:42:11.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:11.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:42:11.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:42:11.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:11.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:42:11.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:42:11.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:42:11.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:42:11.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:11.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:42:11.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:42:11.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:11.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:42:11.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:42:11.279 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.279 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.279 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.279 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.279 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:42:11.279 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.579299914, 2024-04-25T22:42:11.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:42:11.280 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:11.280 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:11.280 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.280 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:11.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:11.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:42:11.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:11.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:42:11.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:11.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:42:11.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:42:11.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:11.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:42:11.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:42:11.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:11.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:42:11.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:42:11.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:42:11.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:42:11.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:42:11.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:42:11.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:11.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:42:11.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:42:11.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:42:11.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:42:11.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:11.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:42:11.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:42:11.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:11.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:42:11.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:42:11.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:11.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:42:11.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:42:11.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:42:11.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:42:11.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:11.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:42:11.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:42:11.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:11.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:42:11.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:42:11.287 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.287 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.287 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.287 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.287 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:42:11.287 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.57926050099999, 2024-04-25T22:42:11.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:42:11.287 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:11.287 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:11.288 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.288 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:11.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:11.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:42:11.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:11.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:42:11.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:11.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:42:11.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:42:11.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:11.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:42:11.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:42:11.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:11.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:42:11.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:42:11.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:42:11.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:42:11.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:42:11.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:42:11.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:11.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:42:11.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:42:11.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:42:11.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:42:11.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:11.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:42:11.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:42:11.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:11.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:42:11.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:42:11.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:42:11.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:42:11.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:11.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:42:11.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:42:11.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:11.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:42:11.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:42:11.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:11.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:42:11.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:42:11.294 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.294 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.295 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.295 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.295 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:42:11.295 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.579190655, 2024-04-25T22:42:11.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:42:11.295 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:11.295 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:11.295 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.295 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:11.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:11.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:42:11.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:11.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:42:11.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:11.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:42:11.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:42:11.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:11.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:42:11.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:42:11.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:11.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:42:11.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:42:11.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:42:11.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:42:11.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:42:11.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:42:11.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:11.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:42:11.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:42:11.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:42:11.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:42:11.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:11.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:42:11.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:42:11.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:11.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:42:11.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:42:11.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:42:11.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:42:11.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:11.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:42:11.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:42:11.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:11.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:42:11.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:42:11.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:42:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:42:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:42:11.302 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.57914091799999, 2024-04-25T22:42:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:42:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:42:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:42:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:42:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:42:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:42:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:42:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:42:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:42:11.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:42:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:42:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:42:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:42:11.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:42:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:42:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:42:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:42:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:42:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:42:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:42:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:42:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:42:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:42:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:42:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:42:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:11.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:42:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:42:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.579056303, 2024-04-25T22:42:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:42:11.310 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:11.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:42:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:42:11.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:42:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:42:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:42:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:42:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:42:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:42:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:42:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:42:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:42:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:42:11.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:42:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:42:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:42:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:42:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:42:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:42:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:42:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:42:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:42:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:42:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:42:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:42:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:42:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:42:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.578992653, 2024-04-25T22:42:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:42:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:11.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:42:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:42:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:42:11.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:42:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:42:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:42:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:42:11.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:42:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:42:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:42:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:42:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:42:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:42:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:42:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:42:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:42:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:42:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:42:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:42:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:42:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.323 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:42:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:42:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 116.57198912299999, 2024-04-25T22:42:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:42:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.324 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:42:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:42:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:42:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:42:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:42:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:42:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:11.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:42:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:42:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:42:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:42:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:42:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:42:11.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:42:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:42:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:42:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:42:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:11.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:42:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:42:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:11.329 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:11.329 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:11.331 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:11.331 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:11.332+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:11.431 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:11.427+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:11.463 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:11.463 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:11.464 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:42:11.464 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:11.478 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:11.562 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:11.559+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:11.633 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:11.627+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:11.642 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:11.642 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:11.642 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:42:11.642 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:42:11.642 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:11.656 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:11.735 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:11.736+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:11.824 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:11.824 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:11.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:11.824 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:11.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.824 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.824 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:11.824 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 117.22497759399999, 2024-04-25T22:42:11.825 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:11.825 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:11.825 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:11.825 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.825 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:11.825 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.825 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:11.825 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:11.825 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.825 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.825 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:11.825 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:11.826 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.826 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:11.826 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:11.826 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:11.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.826 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:11.826 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:11.826 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:11.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:11.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:11.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:11.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:11.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:11.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:11.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:11.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:11.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:11.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:11.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:11.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:11.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:11.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:11.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:11.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:11.829 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:11.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:11.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:11.829 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:11.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:11.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.829 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:11.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:11.830 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.830 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:11.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:11.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:11.830 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.830 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:11.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:11.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:11.830 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.830 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.830 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.831 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.831 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.831 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.831 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:11.831 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 117.22484033800001, 2024-04-25T22:42:11.831 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:11.831 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:11.831 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:11.831 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.831 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:11.831 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.831 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:11.831 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:11.831 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.832 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.832 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:11.832 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:11.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.832 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.832 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:11.832 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:11.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:11.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.832 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.832 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:11.832 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:11.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:11.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.832 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:11.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:11.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:11.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:11.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:11.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:11.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:11.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:11.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:11.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:11.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:11.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:11.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:11.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:11.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:11.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:11.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:11.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:11.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:11.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:11.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:11.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.836 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.836 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:11.836 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:11.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.836 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:11.836 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:11.836 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:11.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.836 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:11.836 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:11.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:11.837 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.837 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.837 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.837 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.837 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.837 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.837 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:42:11.837 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 117.224752786, 2024-04-25T22:42:11.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029615392000000001, 2024-04-25T22:42:11.837 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:11.837 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:11.837 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.837 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:11.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:11.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:42:11.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.838 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:11.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595839+0000", 2024-04-25T22:42:11.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.838 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:11.839 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595841+0000", 2024-04-25T22:42:11.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.573e-06 2024-04-25T22:42:11.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:11.839 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595876+0000", 2024-04-25T22:42:11.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5784000000000002e-05 2024-04-25T22:42:11.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:11.839 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595897+0000", 2024-04-25T22:42:11.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0959999999999999e-05 2024-04-25T22:42:11.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595915+0000", 2024-04-25T22:42:11.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.732e-05 2024-04-25T22:42:11.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595983+0000", 2024-04-25T22:42:11.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8459000000000003e-05 2024-04-25T22:42:11.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:11.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595991+0000", 2024-04-25T22:42:11.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5660000000000001e-06 2024-04-25T22:42:11.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.841 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.608653+0000", 2024-04-25T22:42:11.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012662753000000001 2024-04-25T22:42:11.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:11.841 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610557+0000", 2024-04-25T22:42:11.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001903322 2024-04-25T22:42:11.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:11.841 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.610866+0000", 2024-04-25T22:42:11.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00030948100000000001 2024-04-25T22:42:11.842 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.842 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.842 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:11.842 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619156+0000", 2024-04-25T22:42:11.842 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082900319999999993 2024-04-25T22:42:11.842 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.842 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.842 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.842 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625223+0000", 2024-04-25T22:42:11.842 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006066241 2024-04-25T22:42:11.842 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.842 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.842 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:11.842 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625352+0000", 2024-04-25T22:42:11.843 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012969899999999999 2024-04-25T22:42:11.843 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.843 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.843 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:11.843 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625454+0000", 2024-04-25T22:42:11.843 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010220199999999999 2024-04-25T22:42:11.843 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.843 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.843 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.843 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.843 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.843 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.843 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:11.843 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 117.22464896, 2024-04-25T22:42:11.843 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:42:11.843 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:11.844 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:11.844 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.844 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:11.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:11.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:11.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:11.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:11.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:11.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:42:11.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:42:11.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:11.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:42:11.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:42:11.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:11.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:42:11.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:42:11.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:42:11.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:42:11.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:42:11.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:42:11.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:11.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:42:11.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:42:11.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.847 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:42:11.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:42:11.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.847 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:11.847 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:42:11.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:42:11.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.847 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:11.847 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:42:11.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:42:11.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.847 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:11.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:42:11.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:42:11.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:42:11.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:42:11.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:11.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:42:11.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:42:11.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:11.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:42:11.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:42:11.849 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.849 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.849 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.849 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.849 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:11.849 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 117.22458017, 2024-04-25T22:42:11.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:11.849 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:11.850 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:11.850 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.850 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:11.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:11.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:11.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:11.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:11.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:11.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:11.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:11.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:11.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:11.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:11.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:11.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:11.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:11.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:11.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:11.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:11.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:11.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:11.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:11.853 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:11.853 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.853 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.853 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.853 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:11.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:11.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.854 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:11.854 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:11.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:11.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.854 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:11.854 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:11.854 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:11.854 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.854 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.854 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:11.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:11.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:11.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:11.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:11.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.855 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:11.855 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:11.855 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:11.855 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.855 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.856 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:11.856 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:11.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:11.856 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.856 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.856 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.856 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.856 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.856 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.856 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:11.856 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 117.224511084, 2024-04-25T22:42:11.856 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:42:11.856 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:11.856 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:11.856 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.857 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:11.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:11.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:11.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:11.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:11.857 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.857 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.857 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.857 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:11.857 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:42:11.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:42:11.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:11.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:42:11.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:42:11.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.858 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:11.858 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:42:11.858 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:42:11.858 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.858 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:42:11.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:42:11.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:42:11.859 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:42:11.859 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.859 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.859 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:11.859 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:42:11.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:42:11.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:42:11.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:42:11.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.860 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:11.860 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:42:11.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:42:11.860 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:11.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:42:11.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:42:11.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:11.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:42:11.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:42:11.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:42:11.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:42:11.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:11.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:42:11.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:42:11.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:11.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:42:11.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:42:11.862 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.862 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.863 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.863 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.863 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:11.863 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 117.224414971, 2024-04-25T22:42:11.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:11.863 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:11.863 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:11.863 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:11.863 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:11.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:11.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:11.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:11.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:11.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:11.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:11.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:11.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:11.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:11.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:11.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:11.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:11.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:11.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:11.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:11.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:11.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:11.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:11.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:11.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:11.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:11.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:11.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:11.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:11.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:11.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:11.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:11.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:11.867 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.867 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.867 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.868 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.868 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:11.868 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 117.224349309, 2024-04-25T22:42:11.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:11.868 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:11.868 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:11.868 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:11.868 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:11.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:11.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:11.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:11.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:11.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:11.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:11.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:11.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:11.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:11.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:11.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:11.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:11.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:11.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:11.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:11.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:11.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:11.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:11.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:11.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:11.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:11.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:11.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:11.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:11.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:11.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:11.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:11.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:11.872 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.872 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.872 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.873 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:11.873 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:11.873 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 117.224280182, 2024-04-25T22:42:11.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.028481389999999999, 2024-04-25T22:42:11.873 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:11.873 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:11.873 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:11.873 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:11.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:11.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:11.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:11.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:11.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:11.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596313+0000", 2024-04-25T22:42:11.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2860000000000001e-06 2024-04-25T22:42:11.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:11.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596319+0000", 2024-04-25T22:42:11.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0170000000000002e-06 2024-04-25T22:42:11.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:11.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596336+0000", 2024-04-25T22:42:11.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7306e-05 2024-04-25T22:42:11.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596351+0000", 2024-04-25T22:42:11.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4703e-05 2024-04-25T22:42:11.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596436+0000", 2024-04-25T22:42:11.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.543e-05 2024-04-25T22:42:11.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:11.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596448+0000", 2024-04-25T22:42:11.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.208e-05 2024-04-25T22:42:11.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612090+0000", 2024-04-25T22:42:11.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015641886000000001 2024-04-25T22:42:11.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:11.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612412+0000", 2024-04-25T22:42:11.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032191400000000002 2024-04-25T22:42:11.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.877 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:11.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.624793+0000", 2024-04-25T22:42:11.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012380768 2024-04-25T22:42:11.877 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.877 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.877 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.877 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-25T22:42:11.877 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:42:11.877 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 17.825482322999999, 2024-04-25T22:42:11.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.02435211, 2024-04-25T22:42:11.877 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:11.878 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:11.878 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.878 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:11.878 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:11.878 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:11.878 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 5 2024-04-25T22:42:11.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.878 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:11.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:11.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:42:11.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:11.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995109+0000", 2024-04-25T22:42:11.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:11.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:53.995113+0000", 2024-04-25T22:42:11.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.2760000000000001e-06 2024-04-25T22:42:11.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:11.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002825+0000", 2024-04-25T22:42:11.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077127000000000003 2024-04-25T22:42:11.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:11.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002852+0000", 2024-04-25T22:42:11.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6570000000000001e-05 2024-04-25T22:42:11.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002866+0000", 2024-04-25T22:42:11.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4144999999999999e-05 2024-04-25T22:42:11.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.002947+0000", 2024-04-25T22:42:11.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0740000000000003e-05 2024-04-25T22:42:11.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:11.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.003049+0000", 2024-04-25T22:42:11.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101829 2024-04-25T22:42:11.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:11.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019091+0000", 2024-04-25T22:42:11.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016042638000000001 2024-04-25T22:42:11.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.882 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:11.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019227+0000", 2024-04-25T22:42:11.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000135826 2024-04-25T22:42:11.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.882 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:11.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:54.019462+0000", 2024-04-25T22:42:11.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000234386 2024-04-25T22:42:11.882 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.882 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.883 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.883 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:75 3.b 3:d5c7a900:::200.00000003:head [write 923330~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:11.883 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.598989+0000", 2024-04-25T22:42:11.883 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.221602520999999, 2024-04-25T22:42:11.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017059059000000001, 2024-04-25T22:42:11.883 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:11.883 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:11.883 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.883 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:11.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:11.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598989+0000", 2024-04-25T22:42:11.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:11.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598989+0000", 2024-04-25T22:42:11.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:11.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.598990+0000", 2024-04-25T22:42:11.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0279999999999999e-06 2024-04-25T22:42:11.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:11.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599003+0000", 2024-04-25T22:42:11.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2306999999999999e-05 2024-04-25T22:42:11.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:11.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599017+0000", 2024-04-25T22:42:11.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4064e-05 2024-04-25T22:42:11.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599041+0000", 2024-04-25T22:42:11.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4054999999999999e-05 2024-04-25T22:42:11.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606871+0000", 2024-04-25T22:42:11.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0078301580000000003 2024-04-25T22:42:11.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:11.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.606928+0000", 2024-04-25T22:42:11.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7479999999999999e-05 2024-04-25T22:42:11.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.886 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:11.886 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607019+0000", 2024-04-25T22:42:11.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.0761999999999996e-05 2024-04-25T22:42:11.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:11.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611057+0000", 2024-04-25T22:42:11.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0040381260000000004 2024-04-25T22:42:11.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615923+0000", 2024-04-25T22:42:11.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048658319999999996 2024-04-25T22:42:11.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:11.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.615996+0000", 2024-04-25T22:42:11.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3108000000000005e-05 2024-04-25T22:42:11.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:11.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616048+0000", 2024-04-25T22:42:11.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2138999999999997e-05 2024-04-25T22:42:11.888 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.888 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.888 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.888 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:76 3.b 3:d5c7a900:::200.00000003:head [write 924729~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:11.888 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.599056+0000", 2024-04-25T22:42:11.888 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.221535477, 2024-04-25T22:42:11.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017101028000000001, 2024-04-25T22:42:11.889 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:11.889 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:11.889 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.889 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:11.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:11.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599056+0000", 2024-04-25T22:42:11.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:11.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599056+0000", 2024-04-25T22:42:11.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:11.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599057+0000", 2024-04-25T22:42:11.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1500000000000003e-07 2024-04-25T22:42:11.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:11.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599063+0000", 2024-04-25T22:42:11.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6930000000000004e-06 2024-04-25T22:42:11.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599085+0000", 2024-04-25T22:42:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2544e-05 2024-04-25T22:42:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599098+0000", 2024-04-25T22:42:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2425999999999999e-05 2024-04-25T22:42:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607316+0000", 2024-04-25T22:42:11.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0082178489999999993 2024-04-25T22:42:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607452+0000", 2024-04-25T22:42:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000135885 2024-04-25T22:42:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.607602+0000", 2024-04-25T22:42:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015049200000000001 2024-04-25T22:42:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.611073+0000", 2024-04-25T22:42:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0034707079999999999 2024-04-25T22:42:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616091+0000", 2024-04-25T22:42:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0050181779999999999 2024-04-25T22:42:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616121+0000", 2024-04-25T22:42:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0399000000000002e-05 2024-04-25T22:42:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616157+0000", 2024-04-25T22:42:11.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.6038999999999998e-05 2024-04-25T22:42:11.894 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.894 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.894 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.894 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:77 3.b 3:d5c7a900:::200.00000003:head [write 926128~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:11.894 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.599112+0000", 2024-04-25T22:42:11.894 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.221479308999999, 2024-04-25T22:42:11.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017211087, 2024-04-25T22:42:11.894 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:11.894 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:11.894 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.895 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:11.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:11.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599112+0000", 2024-04-25T22:42:11.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:11.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599112+0000", 2024-04-25T22:42:11.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:11.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599113+0000", 2024-04-25T22:42:11.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7499999999999999e-07 2024-04-25T22:42:11.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:11.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599119+0000", 2024-04-25T22:42:11.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0349999999999998e-06 2024-04-25T22:42:11.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:11.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599138+0000", 2024-04-25T22:42:11.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8345000000000001e-05 2024-04-25T22:42:11.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599150+0000", 2024-04-25T22:42:11.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1902000000000001e-05 2024-04-25T22:42:11.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608267+0000", 2024-04-25T22:42:11.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091174380000000003 2024-04-25T22:42:11.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:11.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608341+0000", 2024-04-25T22:42:11.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4029000000000006e-05 2024-04-25T22:42:11.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.897 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:11.897 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608435+0000", 2024-04-25T22:42:11.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3541000000000004e-05 2024-04-25T22:42:11.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:11.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.613682+0000", 2024-04-25T22:42:11.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0052474829999999998 2024-04-25T22:42:11.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616211+0000", 2024-04-25T22:42:11.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0025291490000000001 2024-04-25T22:42:11.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:11.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616276+0000", 2024-04-25T22:42:11.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4590000000000003e-05 2024-04-25T22:42:11.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:11.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616324+0000", 2024-04-25T22:42:11.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7700000000000001e-05 2024-04-25T22:42:11.899 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.899 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.899 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.900 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:78 3.b 3:d5c7a900:::200.00000003:head [write 927532~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-04-25T22:42:11.900 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:41:59.599164+0000", 2024-04-25T22:42:11.900 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.221427862000001, 2024-04-25T22:42:11.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017312029999999999, 2024-04-25T22:42:11.900 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:11.900 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:11.900 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.900 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:11.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:11.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599164+0000", 2024-04-25T22:42:11.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:11.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599164+0000", 2024-04-25T22:42:11.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:11.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599165+0000", 2024-04-25T22:42:11.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6899999999999996e-07 2024-04-25T22:42:11.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:11.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599177+0000", 2024-04-25T22:42:11.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2461e-05 2024-04-25T22:42:11.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:11.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599191+0000", 2024-04-25T22:42:11.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3888e-05 2024-04-25T22:42:11.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.599206+0000", 2024-04-25T22:42:11.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4346e-05 2024-04-25T22:42:11.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608700+0000", 2024-04-25T22:42:11.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0094949140000000001 2024-04-25T22:42:11.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:11.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608786+0000", 2024-04-25T22:42:11.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5587000000000006e-05 2024-04-25T22:42:11.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:11.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.608921+0000", 2024-04-25T22:42:11.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013478900000000001 2024-04-25T22:42:11.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:11.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.613698+0000", 2024-04-25T22:42:11.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0047773859999999998 2024-04-25T22:42:11.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616386+0000", 2024-04-25T22:42:11.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0026877770000000001 2024-04-25T22:42:11.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:11.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616440+0000", 2024-04-25T22:42:11.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4490000000000002e-05 2024-04-25T22:42:11.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:11.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:41:59.616476+0000", 2024-04-25T22:42:11.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.5522999999999999e-05 2024-04-25T22:42:11.905 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.905 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.905 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.905 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:109 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-25T22:42:11.905 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:02.620631+0000", 2024-04-25T22:42:11.905 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 9.199960827, 2024-04-25T22:42:11.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027780309999999999, 2024-04-25T22:42:11.905 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:11.905 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:11.905 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.906 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:11.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:11.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620631+0000", 2024-04-25T22:42:11.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:11.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620631+0000", 2024-04-25T22:42:11.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:11.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620632+0000", 2024-04-25T22:42:11.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.364e-06 2024-04-25T22:42:11.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:11.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620751+0000", 2024-04-25T22:42:11.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011838299999999999 2024-04-25T22:42:11.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:11.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620764+0000", 2024-04-25T22:42:11.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3203e-05 2024-04-25T22:42:11.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620771+0000", 2024-04-25T22:42:11.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4080000000000001e-06 2024-04-25T22:42:11.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620840+0000", 2024-04-25T22:42:11.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8696999999999996e-05 2024-04-25T22:42:11.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.908 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:11.908 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.620919+0000", 2024-04-25T22:42:11.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9379e-05 2024-04-25T22:42:11.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:11.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.626976+0000", 2024-04-25T22:42:11.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060565610000000002 2024-04-25T22:42:11.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:11.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643495+0000", 2024-04-25T22:42:11.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016518950000000001 2024-04-25T22:42:11.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.648308+0000", 2024-04-25T22:42:11.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0048133799999999999 2024-04-25T22:42:11.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:11.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.648369+0000", 2024-04-25T22:42:11.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.0285000000000003e-05 2024-04-25T22:42:11.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:11.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.648411+0000", 2024-04-25T22:42:11.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2700000000000001e-05 2024-04-25T22:42:11.910 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.910 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.911 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.911 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:6294 4.2d 4:b5ee1071:::10000001cd6.00000000:head [write 0~6362] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-25T22:42:11.911 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:02.625474+0000", 2024-04-25T22:42:11.911 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 9.1951178040000006, 2024-04-25T22:42:11.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018135539999999999, 2024-04-25T22:42:11.911 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:11.911 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:11.911 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.911 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:11.911 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:11.911 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:11.911 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 6294 2024-04-25T22:42:11.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.912 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:11.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:11.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625474+0000", 2024-04-25T22:42:11.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:11.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625474+0000", 2024-04-25T22:42:11.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:11.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625475+0000", 2024-04-25T22:42:11.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6899999999999996e-07 2024-04-25T22:42:11.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:11.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625485+0000", 2024-04-25T22:42:11.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:42:11.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:11.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625493+0000", 2024-04-25T22:42:11.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2800000000000003e-06 2024-04-25T22:42:11.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625499+0000", 2024-04-25T22:42:11.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7830000000000004e-06 2024-04-25T22:42:11.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625555+0000", 2024-04-25T22:42:11.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6776e-05 2024-04-25T22:42:11.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:11.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.625685+0000", 2024-04-25T22:42:11.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000129519 2024-04-25T22:42:11.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:11.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643438+0000", 2024-04-25T22:42:11.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017753023 2024-04-25T22:42:11.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:11.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643510+0000", 2024-04-25T22:42:11.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2020999999999994e-05 2024-04-25T22:42:11.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:11.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:02.643610+0000", 2024-04-25T22:42:11.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9543999999999994e-05 2024-04-25T22:42:11.915 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.915 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.915 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.916 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:113 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-25T22:42:11.916 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:03.622392+0000", 2024-04-25T22:42:11.916 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 8.198199786, 2024-04-25T22:42:11.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027294512999999999, 2024-04-25T22:42:11.916 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:11.916 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:11.916 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.916 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:11.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:11.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622392+0000", 2024-04-25T22:42:11.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:11.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622392+0000", 2024-04-25T22:42:11.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:11.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622394+0000", 2024-04-25T22:42:11.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.39e-06 2024-04-25T22:42:11.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:11.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622486+0000", 2024-04-25T22:42:11.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1497999999999997e-05 2024-04-25T22:42:11.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:11.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622516+0000", 2024-04-25T22:42:11.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0281999999999999e-05 2024-04-25T22:42:11.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622531+0000", 2024-04-25T22:42:11.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4980000000000001e-05 2024-04-25T22:42:11.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622653+0000", 2024-04-25T22:42:11.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012210000000000001 2024-04-25T22:42:11.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:11.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.622795+0000", 2024-04-25T22:42:11.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014171 2024-04-25T22:42:11.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:11.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.630487+0000", 2024-04-25T22:42:11.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076922680000000004 2024-04-25T22:42:11.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.640781+0000", 2024-04-25T22:42:11.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010293416 2024-04-25T22:42:11.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:11.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.649494+0000", 2024-04-25T22:42:11.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0087134670000000008 2024-04-25T22:42:11.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:11.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.649575+0000", 2024-04-25T22:42:11.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0655000000000006e-05 2024-04-25T22:42:11.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:11.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:03.649687+0000", 2024-04-25T22:42:11.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000111747 2024-04-25T22:42:11.921 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.921 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.921 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.921 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:206 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T22:42:11.921 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:06.627161+0000", 2024-04-25T22:42:11.922 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 5.193430598, 2024-04-25T22:42:11.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023978682000000001, 2024-04-25T22:42:11.922 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:11.922 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:11.922 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.922 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:11.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:11.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627161+0000", 2024-04-25T22:42:11.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:11.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627161+0000", 2024-04-25T22:42:11.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:11.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627163+0000", 2024-04-25T22:42:11.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.697e-06 2024-04-25T22:42:11.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:11.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627376+0000", 2024-04-25T22:42:11.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021294799999999999 2024-04-25T22:42:11.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:11.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627396+0000", 2024-04-25T22:42:11.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9715999999999999e-05 2024-04-25T22:42:11.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627408+0000", 2024-04-25T22:42:11.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2357e-05 2024-04-25T22:42:11.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627513+0000", 2024-04-25T22:42:11.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000105308 2024-04-25T22:42:11.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:11.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.627648+0000", 2024-04-25T22:42:11.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000134623 2024-04-25T22:42:11.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:11.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.635301+0000", 2024-04-25T22:42:11.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076529060000000001 2024-04-25T22:42:11.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.643793+0000", 2024-04-25T22:42:11.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0084921070000000005 2024-04-25T22:42:11.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:11.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.650872+0000", 2024-04-25T22:42:11.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0070795500000000004 2024-04-25T22:42:11.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:11.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.651029+0000", 2024-04-25T22:42:11.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000156296 2024-04-25T22:42:11.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:11.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:06.651140+0000", 2024-04-25T22:42:11.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000111174 2024-04-25T22:42:11.926 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.926 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.926 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.927 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:210 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-25T22:42:11.927 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:07.630424+0000", 2024-04-25T22:42:11.927 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.1901676309999996, 2024-04-25T22:42:11.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025612091999999999, 2024-04-25T22:42:11.927 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:11.927 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:11.927 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.927 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:11.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:11.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.630424+0000", 2024-04-25T22:42:11.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:11.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.630424+0000", 2024-04-25T22:42:11.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:11.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.630431+0000", 2024-04-25T22:42:11.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7839999999999998e-06 2024-04-25T22:42:11.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:11.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.630669+0000", 2024-04-25T22:42:11.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000237691 2024-04-25T22:42:11.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:11.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.630695+0000", 2024-04-25T22:42:11.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6596000000000001e-05 2024-04-25T22:42:11.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.630720+0000", 2024-04-25T22:42:11.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4828999999999999e-05 2024-04-25T22:42:11.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.630848+0000", 2024-04-25T22:42:11.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012828699999999999 2024-04-25T22:42:11.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:11.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.631091+0000", 2024-04-25T22:42:11.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000243105 2024-04-25T22:42:11.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:11.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.639016+0000", 2024-04-25T22:42:11.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0079241669999999993 2024-04-25T22:42:11.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:11.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.648739+0000", 2024-04-25T22:42:11.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0097232450000000002 2024-04-25T22:42:11.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:11.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.655858+0000", 2024-04-25T22:42:11.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071188919999999999 2024-04-25T22:42:11.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:11.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.655973+0000", 2024-04-25T22:42:11.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000114838 2024-04-25T22:42:11.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:11.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.656036+0000", 2024-04-25T22:42:11.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3658000000000006e-05 2024-04-25T22:42:11.932 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.932 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.932 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.932 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:9757 4.3a e62/17 4:5e14edba:::10000002cd2.00000000:head v 62'154, mlcod=62'152)", 2024-04-25T22:42:11.932 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:07.959466+0000", 2024-04-25T22:42:11.932 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 3.8611262059999998, 2024-04-25T22:42:11.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017281594000000001, 2024-04-25T22:42:11.933 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:11.933 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:11.933 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:11.933 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:11.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:11.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.959466+0000", 2024-04-25T22:42:11.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:11.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.959466+0000", 2024-04-25T22:42:11.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:11.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:11.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.959472+0000", 2024-04-25T22:42:11.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8770000000000004e-06 2024-04-25T22:42:11.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:11.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.965456+0000", 2024-04-25T22:42:11.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0059831709999999998 2024-04-25T22:42:11.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:11.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.965486+0000", 2024-04-25T22:42:11.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0508999999999999e-05 2024-04-25T22:42:11.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:11.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.965501+0000", 2024-04-25T22:42:11.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4722999999999999e-05 2024-04-25T22:42:11.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:11.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.965632+0000", 2024-04-25T22:42:11.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013080000000000001 2024-04-25T22:42:11.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.937 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:11.937 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.965667+0000", 2024-04-25T22:42:11.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4972999999999999e-05 2024-04-25T22:42:11.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:11.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.976627+0000", 2024-04-25T22:42:11.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010960701 2024-04-25T22:42:11.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:11.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:11.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:11.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:07.976747+0000", 2024-04-25T22:42:11.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011984 2024-04-25T22:42:11.938 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.938 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.938 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.939 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:11.939 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:11.939 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:11.939 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:42:11.940 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:11.940+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:11.941 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:12.041 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:12.039+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:12.070 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:12.071 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:12.071 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:42:12.071 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:12.086 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:12.142 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:12.139+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:12.148 INFO:tasks.workunit.client.0.smithi057.stdout:5/0: sync 2024-04-25T22:42:12.148 INFO:tasks.workunit.client.0.smithi057.stdout:5/1: rename - no filename 2024-04-25T22:42:12.150 INFO:tasks.workunit.client.0.smithi057.stdout:5/2: symlink l0 0 2024-04-25T22:42:12.150 INFO:tasks.workunit.client.0.smithi057.stdout:5/3: truncate - no filename 2024-04-25T22:42:12.150 INFO:tasks.workunit.client.0.smithi057.stdout:5/4: creat f1 x:0 0 0 2024-04-25T22:42:12.196 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-25T22:42:12.196 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:42:12.196 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-04-25T22:42:12.196 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi148.front.sepia.ceph.com 2024-04-25T22:42:12.196 INFO:teuthology.orchestra.console.smithi148:Power on 2024-04-25T22:42:12.197 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-25T22:42:12.210 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:12.210 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:12.210 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:42:12.210 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:42:12.210 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:12.220 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On 2024-04-25T22:42:12.220 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:42:12.229 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:12.241 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-04-25T22:42:12.274 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:12.272+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:12.347 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:12.347+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:12.351 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:12.351 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:42:12.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:42:12.351 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:42:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.754486497, 2024-04-25T22:42:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038298031000000003, 2024-04-25T22:42:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:42:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596004+0000", 2024-04-25T22:42:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596007+0000", 2024-04-25T22:42:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4040000000000002e-06 2024-04-25T22:42:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596019+0000", 2024-04-25T22:42:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1993e-05 2024-04-25T22:42:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596040+0000", 2024-04-25T22:42:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1535999999999998e-05 2024-04-25T22:42:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596058+0000", 2024-04-25T22:42:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7363e-05 2024-04-25T22:42:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596165+0000", 2024-04-25T22:42:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107013 2024-04-25T22:42:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596175+0000", 2024-04-25T22:42:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0499999999999999e-05 2024-04-25T22:42:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616562+0000", 2024-04-25T22:42:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020387213000000001 2024-04-25T22:42:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618754+0000", 2024-04-25T22:42:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021916290000000001 2024-04-25T22:42:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619027+0000", 2024-04-25T22:42:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027287200000000001 2024-04-25T22:42:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633821+0000", 2024-04-25T22:42:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014794059 2024-04-25T22:42:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633855+0000", 2024-04-25T22:42:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4422999999999999e-05 2024-04-25T22:42:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633975+0000", 2024-04-25T22:42:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120013 2024-04-25T22:42:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634302+0000", 2024-04-25T22:42:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032701300000000002 2024-04-25T22:42:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:42:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.75439848400001, 2024-04-25T22:42:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039775996000000001, 2024-04-25T22:42:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:42:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596092+0000", 2024-04-25T22:42:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596094+0000", 2024-04-25T22:42:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3430000000000001e-06 2024-04-25T22:42:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:42:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7670000000000003e-06 2024-04-25T22:42:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596120+0000", 2024-04-25T22:42:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8790000000000001e-05 2024-04-25T22:42:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596135+0000", 2024-04-25T22:42:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.486e-05 2024-04-25T22:42:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596297+0000", 2024-04-25T22:42:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016193499999999999 2024-04-25T22:42:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596312+0000", 2024-04-25T22:42:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.49e-05 2024-04-25T22:42:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619594+0000", 2024-04-25T22:42:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023281950999999999 2024-04-25T22:42:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619805+0000", 2024-04-25T22:42:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021077100000000001 2024-04-25T22:42:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620175+0000", 2024-04-25T22:42:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037018000000000001 2024-04-25T22:42:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634385+0000", 2024-04-25T22:42:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014210501 2024-04-25T22:42:12.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:12.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634492+0000", 2024-04-25T22:42:12.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106943 2024-04-25T22:42:12.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:12.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634748+0000", 2024-04-25T22:42:12.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025551399999999998 2024-04-25T22:42:12.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:12.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.635868+0000", 2024-04-25T22:42:12.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011205410000000001 2024-04-25T22:42:12.363 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.363 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.363 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.363 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:12.363 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:12.363 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.754326362, 2024-04-25T22:42:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:42:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:42:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:42:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:42:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:42:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:42:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:42:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:42:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:42:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:42:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:42:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:42:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:42:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:42:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:42:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:42:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:42:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:42:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:42:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:42:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:42:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:42:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:42:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:42:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:42:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:42:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:42:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.754218049, 2024-04-25T22:42:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:42:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:42:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:42:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:42:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:42:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:42:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:42:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:42:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:42:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:42:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:42:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:42:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:42:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:42:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:42:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:42:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:42:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:42:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:42:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:42:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:42:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:42:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:42:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:42:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:42:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:42:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:42:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.754151393, 2024-04-25T22:42:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:42:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:42:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:42:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:42:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:42:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:42:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:42:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:42:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:42:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:42:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:42:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:42:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:42:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:42:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:42:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:42:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:42:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:42:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:42:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:42:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:42:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:42:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:42:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:42:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:42:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:42:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:42:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.75406079699999, 2024-04-25T22:42:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:42:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:42:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:42:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:42:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:42:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:42:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:42:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:42:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:42:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:42:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:42:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:42:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:42:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:42:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:42:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:42:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:42:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:42:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:42:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:42:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:42:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:42:12.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:42:12.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:42:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:42:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:42:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:42:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.75399622400001, 2024-04-25T22:42:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:42:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:42:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:42:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:42:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:42:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:42:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:42:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:42:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:42:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:42:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:42:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:42:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:42:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:42:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:42:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:42:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:42:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:42:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:42:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:42:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:42:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:42:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:42:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:42:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:42:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:42:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.753930801, 2024-04-25T22:42:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:42:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:42:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:42:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:42:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:42:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:42:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:42:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:42:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:42:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:42:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:42:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:42:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:42:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:42:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:42:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:42:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:42:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:42:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:42:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:42:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:42:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:42:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:12.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:42:12.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:42:12.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:12.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:42:12.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:42:12.437 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.437 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.437 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.437 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:12.437 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:42:12.437 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.753874735, 2024-04-25T22:42:12.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037419971000000003, 2024-04-25T22:42:12.438 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:12.438 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:12.438 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:12.438 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:12.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:12.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:42:12.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:12.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596616+0000", 2024-04-25T22:42:12.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:12.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:12.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.184e-06 2024-04-25T22:42:12.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:12.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596625+0000", 2024-04-25T22:42:12.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.216e-06 2024-04-25T22:42:12.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:12.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596642+0000", 2024-04-25T22:42:12.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7050000000000001e-05 2024-04-25T22:42:12.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596655+0000", 2024-04-25T22:42:12.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3869999999999999e-05 2024-04-25T22:42:12.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596740+0000", 2024-04-25T22:42:12.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4536000000000005e-05 2024-04-25T22:42:12.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:12.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596747+0000", 2024-04-25T22:42:12.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-25T22:42:12.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615792+0000", 2024-04-25T22:42:12.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019044673000000002 2024-04-25T22:42:12.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:12.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616077+0000", 2024-04-25T22:42:12.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028533399999999999 2024-04-25T22:42:12.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:12.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616365+0000", 2024-04-25T22:42:12.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000288058 2024-04-25T22:42:12.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:12.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.627938+0000", 2024-04-25T22:42:12.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011572661 2024-04-25T22:42:12.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:12.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633803+0000", 2024-04-25T22:42:12.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058655720000000003 2024-04-25T22:42:12.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:12.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633931+0000", 2024-04-25T22:42:12.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012722499999999999 2024-04-25T22:42:12.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:12.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634036+0000", 2024-04-25T22:42:12.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105479 2024-04-25T22:42:12.443 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.443 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.443 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.443 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:12.443 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:42:12.443 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.75380762899999, 2024-04-25T22:42:12.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.037595102999999998, 2024-04-25T22:42:12.443 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:12.443 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:12.443 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:12.443 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:12.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:12.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:42:12.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:12.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596683+0000", 2024-04-25T22:42:12.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:12.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596684+0000", 2024-04-25T22:42:12.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-06 2024-04-25T22:42:12.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:12.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596691+0000", 2024-04-25T22:42:12.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6069999999999996e-06 2024-04-25T22:42:12.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:12.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596708+0000", 2024-04-25T22:42:12.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7217000000000001e-05 2024-04-25T22:42:12.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596721+0000", 2024-04-25T22:42:12.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2279999999999999e-05 2024-04-25T22:42:12.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596837+0000", 2024-04-25T22:42:12.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011691199999999999 2024-04-25T22:42:12.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:12.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596846+0000", 2024-04-25T22:42:12.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1929999999999993e-06 2024-04-25T22:42:12.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618474+0000", 2024-04-25T22:42:12.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021628363000000001 2024-04-25T22:42:12.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:12.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.618692+0000", 2024-04-25T22:42:12.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021808299999999999 2024-04-25T22:42:12.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:12.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619045+0000", 2024-04-25T22:42:12.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035329300000000002 2024-04-25T22:42:12.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:12.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.628945+0000", 2024-04-25T22:42:12.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098991470000000005 2024-04-25T22:42:12.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:12.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634053+0000", 2024-04-25T22:42:12.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051083739999999997 2024-04-25T22:42:12.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:12.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634181+0000", 2024-04-25T22:42:12.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128109 2024-04-25T22:42:12.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:12.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634278+0000", 2024-04-25T22:42:12.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7322000000000001e-05 2024-04-25T22:42:12.449 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.449 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.449 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.449 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:12.449 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:12.449 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.753752506, 2024-04-25T22:42:12.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:42:12.449 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:12.449 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:12.449 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:12.449 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:12.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:12.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:12.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:12.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:12.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:12.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:42:12.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:42:12.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:12.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:42:12.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:42:12.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:12.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:42:12.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:42:12.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:42:12.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:42:12.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:42:12.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:42:12.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:12.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:42:12.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:42:12.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:42:12.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:42:12.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:12.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:42:12.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:42:12.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:12.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:42:12.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:42:12.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:12.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:42:12.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:42:12.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:12.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:42:12.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:42:12.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:12.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:42:12.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:42:12.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:12.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:42:12.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:42:12.454 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.455 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.455 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.455 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:12.455 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:12.455 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.753650267, 2024-04-25T22:42:12.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:42:12.455 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:12.455 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:12.455 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:12.455 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:12.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:12.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:12.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:12.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:12.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:12.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:42:12.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:42:12.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:12.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:42:12.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:42:12.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:12.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:42:12.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:42:12.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:42:12.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:42:12.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:42:12.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:42:12.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:12.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:42:12.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:42:12.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:42:12.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:42:12.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:12.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:42:12.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:42:12.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:12.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:42:12.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:42:12.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:12.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:42:12.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:42:12.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:12.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:42:12.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:42:12.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:12.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:42:12.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:42:12.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:12.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:42:12.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:42:12.460 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.460 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.460 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.461 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:12.461 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:42:12.461 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.75359144399999, 2024-04-25T22:42:12.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039443435999999998, 2024-04-25T22:42:12.461 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:12.461 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:12.461 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:12.461 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:12.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:12.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:42:12.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:12.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596899+0000", 2024-04-25T22:42:12.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:12.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596900+0000", 2024-04-25T22:42:12.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.08e-06 2024-04-25T22:42:12.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:12.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596917+0000", 2024-04-25T22:42:12.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6682999999999999e-05 2024-04-25T22:42:12.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:12.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596945+0000", 2024-04-25T22:42:12.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7347000000000001e-05 2024-04-25T22:42:12.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596958+0000", 2024-04-25T22:42:12.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3176000000000001e-05 2024-04-25T22:42:12.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597066+0000", 2024-04-25T22:42:12.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010798600000000001 2024-04-25T22:42:12.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:12.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597077+0000", 2024-04-25T22:42:12.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.133e-05 2024-04-25T22:42:12.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619732+0000", 2024-04-25T22:42:12.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022655319 2024-04-25T22:42:12.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:12.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619996+0000", 2024-04-25T22:42:12.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000263231 2024-04-25T22:42:12.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:12.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.621894+0000", 2024-04-25T22:42:12.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001898669 2024-04-25T22:42:12.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:12.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633819+0000", 2024-04-25T22:42:12.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011925031000000001 2024-04-25T22:42:12.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:12.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636180+0000", 2024-04-25T22:42:12.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023604590000000001 2024-04-25T22:42:12.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:12.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636270+0000", 2024-04-25T22:42:12.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0051999999999998e-05 2024-04-25T22:42:12.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:12.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636343+0000", 2024-04-25T22:42:12.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3072999999999996e-05 2024-04-25T22:42:12.466 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.466 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.466 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.466 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:12.467 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:42:12.467 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.753512711, 2024-04-25T22:42:12.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039370455999999998, 2024-04-25T22:42:12.467 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:12.467 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:12.467 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:12.467 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:12.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:12.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:42:12.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:12.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596978+0000", 2024-04-25T22:42:12.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:12.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596979+0000", 2024-04-25T22:42:12.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:42:12.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:12.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596984+0000", 2024-04-25T22:42:12.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1229999999999999e-06 2024-04-25T22:42:12.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:12.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596995+0000", 2024-04-25T22:42:12.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-25T22:42:12.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597002+0000", 2024-04-25T22:42:12.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4560000000000003e-06 2024-04-25T22:42:12.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597058+0000", 2024-04-25T22:42:12.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5763000000000001e-05 2024-04-25T22:42:12.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:12.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597067+0000", 2024-04-25T22:42:12.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9260000000000006e-06 2024-04-25T22:42:12.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619666+0000", 2024-04-25T22:42:12.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022599296000000001 2024-04-25T22:42:12.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:12.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.619962+0000", 2024-04-25T22:42:12.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000295798 2024-04-25T22:42:12.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:12.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.620279+0000", 2024-04-25T22:42:12.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031728099999999999 2024-04-25T22:42:12.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:12.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634298+0000", 2024-04-25T22:42:12.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014018625 2024-04-25T22:42:12.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:12.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636104+0000", 2024-04-25T22:42:12.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018061189999999999 2024-04-25T22:42:12.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:12.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636237+0000", 2024-04-25T22:42:12.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132473 2024-04-25T22:42:12.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:12.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636349+0000", 2024-04-25T22:42:12.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112032 2024-04-25T22:42:12.472 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.472 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.472 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.472 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:12.472 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:42:12.472 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.753473298, 2024-04-25T22:42:12.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.036336332999999998, 2024-04-25T22:42:12.473 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:12.473 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:12.473 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:12.473 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:12.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:12.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:42:12.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:12.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597018+0000", 2024-04-25T22:42:12.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:12.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597019+0000", 2024-04-25T22:42:12.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:42:12.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:12.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597026+0000", 2024-04-25T22:42:12.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-25T22:42:12.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:12.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597044+0000", 2024-04-25T22:42:12.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7949e-05 2024-04-25T22:42:12.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597061+0000", 2024-04-25T22:42:12.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.774e-05 2024-04-25T22:42:12.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597133+0000", 2024-04-25T22:42:12.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1853000000000005e-05 2024-04-25T22:42:12.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:12.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597140+0000", 2024-04-25T22:42:12.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:42:12.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615628+0000", 2024-04-25T22:42:12.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018488003999999999 2024-04-25T22:42:12.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:12.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.615932+0000", 2024-04-25T22:42:12.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030415100000000001 2024-04-25T22:42:12.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:12.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.616229+0000", 2024-04-25T22:42:12.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029692400000000001 2024-04-25T22:42:12.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:12.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.626398+0000", 2024-04-25T22:42:12.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010168618000000001 2024-04-25T22:42:12.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:12.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633099+0000", 2024-04-25T22:42:12.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067007890000000004 2024-04-25T22:42:12.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:12.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633233+0000", 2024-04-25T22:42:12.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440199999999999 2024-04-25T22:42:12.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:12.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633354+0000", 2024-04-25T22:42:12.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012079900000000001 2024-04-25T22:42:12.478 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.478 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.478 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.478 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:12.478 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:42:12.478 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.753403452, 2024-04-25T22:42:12.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039798130000000001, 2024-04-25T22:42:12.478 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:12.478 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:12.479 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:12.479 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:12.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:12.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:42:12.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:12.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597087+0000", 2024-04-25T22:42:12.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:12.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597088+0000", 2024-04-25T22:42:12.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0299999999999997e-07 2024-04-25T22:42:12.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:12.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597100+0000", 2024-04-25T22:42:12.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1394e-05 2024-04-25T22:42:12.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:12.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597110+0000", 2024-04-25T22:42:12.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0796e-05 2024-04-25T22:42:12.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597118+0000", 2024-04-25T22:42:12.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-25T22:42:12.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597209+0000", 2024-04-25T22:42:12.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0906e-05 2024-04-25T22:42:12.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:12.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597220+0000", 2024-04-25T22:42:12.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1073000000000001e-05 2024-04-25T22:42:12.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622283+0000", 2024-04-25T22:42:12.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025062853999999999 2024-04-25T22:42:12.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:12.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622623+0000", 2024-04-25T22:42:12.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033971000000000001 2024-04-25T22:42:12.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:12.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.622961+0000", 2024-04-25T22:42:12.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033868100000000002 2024-04-25T22:42:12.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:12.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636433+0000", 2024-04-25T22:42:12.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013471723 2024-04-25T22:42:12.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:12.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636634+0000", 2024-04-25T22:42:12.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020090799999999999 2024-04-25T22:42:12.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:12.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636772+0000", 2024-04-25T22:42:12.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013744300000000001 2024-04-25T22:42:12.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:12.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636886+0000", 2024-04-25T22:42:12.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113959 2024-04-25T22:42:12.483 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.483 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.484 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.484 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:12.484 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:42:12.484 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.753353715, 2024-04-25T22:42:12.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039530765000000002, 2024-04-25T22:42:12.484 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:12.484 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:12.484 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:12.484 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:12.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:12.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:42:12.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:12.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597137+0000", 2024-04-25T22:42:12.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:12.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597138+0000", 2024-04-25T22:42:12.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:12.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:12.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597166+0000", 2024-04-25T22:42:12.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7809000000000001e-05 2024-04-25T22:42:12.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:12.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597184+0000", 2024-04-25T22:42:12.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8142999999999999e-05 2024-04-25T22:42:12.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597198+0000", 2024-04-25T22:42:12.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3293e-05 2024-04-25T22:42:12.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597296+0000", 2024-04-25T22:42:12.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8746999999999995e-05 2024-04-25T22:42:12.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:12.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597312+0000", 2024-04-25T22:42:12.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5903e-05 2024-04-25T22:42:12.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.624797+0000", 2024-04-25T22:42:12.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027484864000000001 2024-04-25T22:42:12.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:12.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625095+0000", 2024-04-25T22:42:12.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000298301 2024-04-25T22:42:12.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:12.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.625418+0000", 2024-04-25T22:42:12.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032306400000000002 2024-04-25T22:42:12.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:12.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634151+0000", 2024-04-25T22:42:12.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087326599999999997 2024-04-25T22:42:12.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:12.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636481+0000", 2024-04-25T22:42:12.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002329678 2024-04-25T22:42:12.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:12.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:12.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0647000000000001e-05 2024-04-25T22:42:12.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:12.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636668+0000", 2024-04-25T22:42:12.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6465999999999994e-05 2024-04-25T22:42:12.489 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.489 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.489 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.489 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:12.489 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:12.489 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.7532691, 2024-04-25T22:42:12.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:42:12.489 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:12.489 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:12.490 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:12.490 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:12.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:12.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:12.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:12.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:12.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:12.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:42:12.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:12.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:12.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:42:12.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:42:12.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:12.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:42:12.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:42:12.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:42:12.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:42:12.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:42:12.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:42:12.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:12.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:42:12.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:42:12.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:42:12.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:42:12.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:12.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:42:12.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:42:12.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:12.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:42:12.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:42:12.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:12.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:42:12.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:42:12.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:12.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:42:12.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:42:12.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:12.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:42:12.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:42:12.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:12.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:42:12.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:42:12.494 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.494 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.494 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.495 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:12.495 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:42:12.495 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.75320545, 2024-04-25T22:42:12.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042723696999999998, 2024-04-25T22:42:12.495 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:12.495 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:12.495 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:12.495 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:12.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:12.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:42:12.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:12.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597285+0000", 2024-04-25T22:42:12.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:12.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597286+0000", 2024-04-25T22:42:12.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0470000000000001e-06 2024-04-25T22:42:12.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:12.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597289+0000", 2024-04-25T22:42:12.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9500000000000001e-06 2024-04-25T22:42:12.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:12.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597299+0000", 2024-04-25T22:42:12.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-25T22:42:12.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597309+0000", 2024-04-25T22:42:12.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-25T22:42:12.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597367+0000", 2024-04-25T22:42:12.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8832999999999997e-05 2024-04-25T22:42:12.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:12.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597373+0000", 2024-04-25T22:42:12.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8000000000000004e-06 2024-04-25T22:42:12.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.629051+0000", 2024-04-25T22:42:12.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031678211999999997 2024-04-25T22:42:12.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:12.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.630382+0000", 2024-04-25T22:42:12.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013301369999999999 2024-04-25T22:42:12.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:12.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640009+0000", 2024-04-25T22:42:12.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096275019999999996 2024-04-25T22:42:12.499 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.499 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.499 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.499 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:29 3.b e18/16 3:d0630e4c:::mds0_sessionmap:head v 18'1, mlcod=0'0)", 2024-04-25T22:42:12.499 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:42:12.499 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 117.74620192, 2024-04-25T22:42:12.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029307494, 2024-04-25T22:42:12.499 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:12.499 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:12.499 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:12.499 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:12.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:12.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:42:12.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:12.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604289+0000", 2024-04-25T22:42:12.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:12.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:12.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604290+0000", 2024-04-25T22:42:12.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9999999999999996e-07 2024-04-25T22:42:12.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:12.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604315+0000", 2024-04-25T22:42:12.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5230000000000001e-05 2024-04-25T22:42:12.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:12.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604342+0000", 2024-04-25T22:42:12.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6726000000000001e-05 2024-04-25T22:42:12.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.604361+0000", 2024-04-25T22:42:12.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9505999999999999e-05 2024-04-25T22:42:12.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:12.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612170+0000", 2024-04-25T22:42:12.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007808817 2024-04-25T22:42:12.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:12.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.612217+0000", 2024-04-25T22:42:12.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6678999999999998e-05 2024-04-25T22:42:12.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:12.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.632073+0000", 2024-04-25T22:42:12.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019856309999999999 2024-04-25T22:42:12.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:12.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:12.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:12.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633596+0000", 2024-04-25T22:42:12.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001523426 2024-04-25T22:42:12.502 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.502 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.503 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.503 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:12.503 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:12.503 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:12.505 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:12.511 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:12.499+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:12.513 INFO:tasks.workunit.client.0.smithi057.stdout:7/10: sync 2024-04-25T22:42:12.513 INFO:tasks.workunit.client.0.smithi057.stdout:6/24: sync 2024-04-25T22:42:12.513 INFO:tasks.workunit.client.0.smithi057.stdout:7/11: creat f2 x:0 0 0 2024-04-25T22:42:12.513 INFO:tasks.workunit.client.0.smithi057.stdout:6/25: creat d2/f7 x:0 0 0 2024-04-25T22:42:12.513 INFO:tasks.workunit.client.0.smithi057.stdout:7/12: link f1 f3 0 2024-04-25T22:42:12.513 INFO:tasks.workunit.client.0.smithi057.stdout:7/13: rmdir - no directory 2024-04-25T22:42:12.513 INFO:tasks.workunit.client.0.smithi057.stdout:7/14: creat f4 x:0 0 0 2024-04-25T22:42:12.513 INFO:tasks.workunit.client.0.smithi057.stdout:7/15: write f4 [746623,15913] 0 2024-04-25T22:42:12.513 INFO:tasks.workunit.client.0.smithi057.stdout:1/15: sync 2024-04-25T22:42:12.513 INFO:tasks.workunit.client.0.smithi057.stdout:3/24: sync 2024-04-25T22:42:12.513 INFO:tasks.workunit.client.0.smithi057.stdout:5/5: sync 2024-04-25T22:42:12.514 INFO:tasks.workunit.client.0.smithi057.stdout:2/43: sync 2024-04-25T22:42:12.514 INFO:tasks.workunit.client.0.smithi057.stdout:9/41: sync 2024-04-25T22:42:12.514 INFO:tasks.workunit.client.0.smithi057.stdout:4/19: sync 2024-04-25T22:42:12.514 INFO:tasks.workunit.client.0.smithi057.stdout:0/20: sync 2024-04-25T22:42:12.514 INFO:tasks.workunit.client.0.smithi057.stdout:0/21: write - no filename 2024-04-25T22:42:12.514 INFO:tasks.workunit.client.0.smithi057.stdout:8/23: sync 2024-04-25T22:42:12.514 INFO:tasks.workunit.client.0.smithi057.stdout:8/24: dread - d4/d5/f7 zero size 2024-04-25T22:42:12.514 INFO:tasks.workunit.client.0.smithi057.stdout:4/20: dwrite f3 [0,4194304] 0 2024-04-25T22:42:12.514 INFO:tasks.workunit.client.0.smithi057.stdout:4/21: write f4 [104226,49900] 0 2024-04-25T22:42:12.514 INFO:tasks.workunit.client.0.smithi057.stdout:1/16: dwrite f0 [0,4194304] 0 2024-04-25T22:42:12.514 INFO:tasks.workunit.client.0.smithi057.stdout:1/17: write f0 [6464971,83288] 0 2024-04-25T22:42:12.514 INFO:tasks.workunit.client.0.smithi057.stdout:1/18: stat f0 0 2024-04-25T22:42:12.514 INFO:tasks.workunit.client.0.smithi057.stdout:7/16: truncate f4 504501 0 2024-04-25T22:42:12.514 INFO:tasks.workunit.client.0.smithi057.stdout:2/44: creat fe x:0 0 0 2024-04-25T22:42:12.514 INFO:tasks.workunit.client.0.smithi057.stdout:5/6: mkdir d2 0 2024-04-25T22:42:12.515 INFO:tasks.workunit.client.0.smithi057.stdout:1/19: mknod c2 0 2024-04-25T22:42:12.515 INFO:tasks.workunit.client.0.smithi057.stdout:0/22: creat d0/d3/f4 x:0 0 0 2024-04-25T22:42:12.515 INFO:tasks.workunit.client.0.smithi057.stdout:1/20: chown l1 1736 1 2024-04-25T22:42:12.515 INFO:tasks.workunit.client.0.smithi057.stdout:2/45: symlink lf 0 2024-04-25T22:42:12.515 INFO:tasks.workunit.client.0.smithi057.stdout:8/25: rmdir d4/d6 0 2024-04-25T22:42:12.515 INFO:tasks.workunit.client.0.smithi057.stdout:9/42: rename d3/c10 to d3/c11 0 2024-04-25T22:42:12.515 INFO:tasks.workunit.client.0.smithi057.stdout:0/23: dread - d0/d3/f4 zero size 2024-04-25T22:42:12.515 INFO:tasks.workunit.client.0.smithi057.stdout:5/7: mknod d2/c3 0 2024-04-25T22:42:12.515 INFO:tasks.workunit.client.0.smithi057.stdout:2/46: unlink fd 0 2024-04-25T22:42:12.515 INFO:tasks.workunit.client.0.smithi057.stdout:8/26: mkdir d4/d5/d9 0 2024-04-25T22:42:12.515 INFO:tasks.workunit.client.0.smithi057.stdout:5/8: chown d2 0 1 2024-04-25T22:42:12.515 INFO:tasks.workunit.client.0.smithi057.stdout:9/43: dread - d3/fd zero size 2024-04-25T22:42:12.515 INFO:tasks.workunit.client.0.smithi057.stdout:0/24: stat d0/d3/f4 0 2024-04-25T22:42:12.515 INFO:tasks.workunit.client.0.smithi057.stdout:5/9: read - f1 zero size 2024-04-25T22:42:12.515 INFO:tasks.workunit.client.0.smithi057.stdout:5/10: rmdir d2 39 2024-04-25T22:42:12.515 INFO:tasks.workunit.client.0.smithi057.stdout:2/47: link lf l10 0 2024-04-25T22:42:12.515 INFO:tasks.workunit.client.0.smithi057.stdout:0/25: write d0/d3/f4 [278583,94525] 0 2024-04-25T22:42:12.516 INFO:tasks.workunit.client.0.smithi057.stdout:5/11: dread - f1 zero size 2024-04-25T22:42:12.516 INFO:tasks.workunit.client.0.smithi057.stdout:5/12: fdatasync f1 0 2024-04-25T22:42:12.516 INFO:tasks.workunit.client.0.smithi057.stdout:2/48: creat f11 x:0 0 0 2024-04-25T22:42:12.516 INFO:tasks.workunit.client.0.smithi057.stdout:6/26: sync 2024-04-25T22:42:12.516 INFO:tasks.workunit.client.0.smithi057.stdout:9/44: sync 2024-04-25T22:42:12.516 INFO:tasks.workunit.client.0.smithi057.stdout:5/13: read - f1 zero size 2024-04-25T22:42:12.516 INFO:tasks.workunit.client.0.smithi057.stdout:3/25: dwrite d0/f6 [4194304,4194304] 0 2024-04-25T22:42:12.516 INFO:tasks.workunit.client.0.smithi057.stdout:6/27: fsync d2/f7 0 2024-04-25T22:42:12.516 INFO:tasks.workunit.client.0.smithi057.stdout:0/26: truncate d0/d3/f4 502845 0 2024-04-25T22:42:12.516 INFO:tasks.workunit.client.0.smithi057.stdout:2/49: write f11 [771609,60173] 0 2024-04-25T22:42:12.516 INFO:tasks.workunit.client.0.smithi057.stdout:9/45: link d3/ff d3/f12 0 2024-04-25T22:42:12.516 INFO:tasks.workunit.client.0.smithi057.stdout:3/26: write d0/f6 [904521,45533] 0 2024-04-25T22:42:12.516 INFO:tasks.workunit.client.0.smithi057.stdout:2/50: truncate f11 991633 0 2024-04-25T22:42:12.516 INFO:tasks.workunit.client.0.smithi057.stdout:6/28: write d2/f7 [215080,90605] 0 2024-04-25T22:42:12.516 INFO:tasks.workunit.client.0.smithi057.stdout:1/21: dwrite f0 [4194304,4194304] 0 2024-04-25T22:42:12.516 INFO:tasks.workunit.client.0.smithi057.stdout:2/51: fsync f8 0 2024-04-25T22:42:12.517 INFO:tasks.workunit.client.0.smithi057.stdout:6/29: fdatasync f0 0 2024-04-25T22:42:12.517 INFO:tasks.workunit.client.0.smithi057.stdout:9/46: write d3/fd [632578,108615] 0 2024-04-25T22:42:12.517 INFO:tasks.workunit.client.0.smithi057.stdout:3/27: write d0/f6 [3994650,114261] 0 2024-04-25T22:42:12.517 INFO:tasks.workunit.client.0.smithi057.stdout:2/52: creat f12 x:0 0 0 2024-04-25T22:42:12.517 INFO:tasks.workunit.client.0.smithi057.stdout:6/30: truncate d2/f7 1298184 0 2024-04-25T22:42:12.517 INFO:tasks.workunit.client.0.smithi057.stdout:9/47: truncate d3/f12 593287 0 2024-04-25T22:42:12.517 INFO:tasks.workunit.client.0.smithi057.stdout:3/28: creat d0/d4/f9 x:0 0 0 2024-04-25T22:42:12.517 INFO:tasks.workunit.client.0.smithi057.stdout:2/53: symlink l13 0 2024-04-25T22:42:12.517 INFO:tasks.workunit.client.0.smithi057.stdout:8/27: dwrite d4/d5/f7 [0,4194304] 0 2024-04-25T22:42:12.517 INFO:tasks.workunit.client.0.smithi057.stdout:1/22: write f0 [5879349,105550] 0 2024-04-25T22:42:12.517 INFO:tasks.workunit.client.0.smithi057.stdout:9/48: rmdir d3 39 2024-04-25T22:42:12.517 INFO:tasks.workunit.client.0.smithi057.stdout:3/29: creat d0/fa x:0 0 0 2024-04-25T22:42:12.517 INFO:tasks.workunit.client.0.smithi057.stdout:8/28: chown d4/d5/f7 175879 1 2024-04-25T22:42:12.517 INFO:tasks.workunit.client.0.smithi057.stdout:3/30: write d0/f6 [6192871,13686] 0 2024-04-25T22:42:12.517 INFO:tasks.workunit.client.0.smithi057.stdout:3/31: rename d0/d4 to d0/d4/d7/db 22 2024-04-25T22:42:12.517 INFO:tasks.workunit.client.0.smithi057.stdout:3/32: write d0/f6 [1512108,98082] 0 2024-04-25T22:42:12.517 INFO:tasks.workunit.client.0.smithi057.stdout:0/27: fdatasync d0/d3/f4 0 2024-04-25T22:42:12.518 INFO:tasks.workunit.client.0.smithi057.stdout:8/29: symlink d4/d5/la 0 2024-04-25T22:42:12.518 INFO:tasks.workunit.client.0.smithi057.stdout:8/30: write d4/d5/f7 [861417,8243] 0 2024-04-25T22:42:12.518 INFO:tasks.workunit.client.0.smithi057.stdout:1/23: dwrite f0 [4194304,4194304] 0 2024-04-25T22:42:12.518 INFO:tasks.workunit.client.0.smithi057.stdout:9/49: dread d3/f5 [0,4194304] 0 2024-04-25T22:42:12.518 INFO:tasks.workunit.client.0.smithi057.stdout:1/24: write f0 [5165529,86041] 0 2024-04-25T22:42:12.518 INFO:tasks.workunit.client.0.smithi057.stdout:3/33: mknod d0/cc 0 2024-04-25T22:42:12.518 INFO:tasks.workunit.client.0.smithi057.stdout:7/17: sync 2024-04-25T22:42:12.518 INFO:tasks.workunit.client.0.smithi057.stdout:1/25: mknod c3 0 2024-04-25T22:42:12.518 INFO:tasks.workunit.client.0.smithi057.stdout:6/31: sync 2024-04-25T22:42:12.518 INFO:tasks.workunit.client.0.smithi057.stdout:0/28: sync 2024-04-25T22:42:12.518 INFO:tasks.workunit.client.0.smithi057.stdout:5/14: creat d2/f4 x:0 0 0 2024-04-25T22:42:12.518 INFO:tasks.workunit.client.0.smithi057.stdout:0/29: mkdir d0/d5 0 2024-04-25T22:42:12.518 INFO:tasks.workunit.client.0.smithi057.stdout:6/32: creat d2/f8 x:0 0 0 2024-04-25T22:42:12.518 INFO:tasks.workunit.client.0.smithi057.stdout:6/33: stat f0 0 2024-04-25T22:42:12.518 INFO:tasks.workunit.client.0.smithi057.stdout:5/15: write f1 [726581,13511] 0 2024-04-25T22:42:12.519 INFO:tasks.workunit.client.0.smithi057.stdout:9/50: getdents d3 0 2024-04-25T22:42:12.519 INFO:tasks.workunit.client.0.smithi057.stdout:0/30: mkdir d0/d3/d6 0 2024-04-25T22:42:12.519 INFO:tasks.workunit.client.0.smithi057.stdout:9/51: stat d3 0 2024-04-25T22:42:12.519 INFO:tasks.workunit.client.0.smithi057.stdout:8/31: getdents d4/d5 0 2024-04-25T22:42:12.519 INFO:tasks.workunit.client.0.smithi057.stdout:0/31: rmdir d0 39 2024-04-25T22:42:12.519 INFO:tasks.workunit.client.0.smithi057.stdout:0/32: readlink - no filename 2024-04-25T22:42:12.519 INFO:tasks.workunit.client.0.smithi057.stdout:6/34: chown d2/l6 155469082 1 2024-04-25T22:42:12.519 INFO:tasks.workunit.client.0.smithi057.stdout:9/52: creat d3/f13 x:0 0 0 2024-04-25T22:42:12.519 INFO:tasks.workunit.client.0.smithi057.stdout:6/35: mkdir d2/d9 0 2024-04-25T22:42:12.519 INFO:tasks.workunit.client.0.smithi057.stdout:8/32: rename d4/d5/d9 to d4/db 0 2024-04-25T22:42:12.519 INFO:tasks.workunit.client.0.smithi057.stdout:9/53: fsync d3/f5 0 2024-04-25T22:42:12.519 INFO:tasks.workunit.client.0.smithi057.stdout:4/22: dwrite f3 [4194304,4194304] 0 2024-04-25T22:42:12.519 INFO:tasks.workunit.client.0.smithi057.stdout:8/33: creat d4/db/fc x:0 0 0 2024-04-25T22:42:12.519 INFO:tasks.workunit.client.0.smithi057.stdout:4/23: read f4 [129180,116893] 0 2024-04-25T22:42:12.521 INFO:tasks.workunit.client.0.smithi057.stdout:2/54: dread f6 [0,4194304] 0 2024-04-25T22:42:12.521 INFO:tasks.workunit.client.0.smithi057.stdout:2/55: chown l13 54827141 1 2024-04-25T22:42:12.521 INFO:tasks.workunit.client.0.smithi057.stdout:3/34: truncate d0/f6 6196352 0 2024-04-25T22:42:12.521 INFO:tasks.workunit.client.0.smithi057.stdout:7/18: dwrite f2 [0,4194304] 0 2024-04-25T22:42:12.521 INFO:tasks.workunit.client.0.smithi057.stdout:2/56: dread f6 [0,4194304] 0 2024-04-25T22:42:12.521 INFO:tasks.workunit.client.0.smithi057.stdout:1/26: truncate f0 685258 0 2024-04-25T22:42:12.521 INFO:tasks.workunit.client.0.smithi057.stdout:2/57: sync 2024-04-25T22:42:12.521 INFO:tasks.workunit.client.0.smithi057.stdout:5/16: truncate f1 126414 0 2024-04-25T22:42:12.525 INFO:tasks.workunit.client.0.smithi057.stdout:7/19: rename f4 to f5 0 2024-04-25T22:42:12.527 INFO:tasks.workunit.client.0.smithi057.stdout:0/33: dwrite d0/d3/f4 [0,4194304] 0 2024-04-25T22:42:12.527 INFO:tasks.workunit.client.0.smithi057.stdout:7/20: mkdir d6 0 2024-04-25T22:42:12.529 INFO:tasks.workunit.client.0.smithi057.stdout:2/58: getdents . 0 2024-04-25T22:42:12.529 INFO:tasks.workunit.client.0.smithi057.stdout:9/54: dwrite d3/f13 [0,4194304] 0 2024-04-25T22:42:12.530 INFO:tasks.workunit.client.0.smithi057.stdout:8/34: dwrite d4/d5/f7 [0,4194304] 0 2024-04-25T22:42:12.532 INFO:tasks.workunit.client.0.smithi057.stdout:7/21: mknod d6/c7 0 2024-04-25T22:42:12.532 INFO:tasks.workunit.client.0.smithi057.stdout:9/55: readlink d3/l6 0 2024-04-25T22:42:12.532 INFO:tasks.workunit.client.0.smithi057.stdout:4/24: dwrite f4 [0,4194304] 0 2024-04-25T22:42:12.533 INFO:tasks.workunit.client.0.smithi057.stdout:6/36: dread d2/f7 [0,4194304] 0 2024-04-25T22:42:12.533 INFO:tasks.workunit.client.0.smithi057.stdout:8/35: read - d4/db/fc zero size 2024-04-25T22:42:12.534 INFO:tasks.workunit.client.0.smithi057.stdout:0/34: creat d0/d3/f7 x:0 0 0 2024-04-25T22:42:12.534 INFO:tasks.workunit.client.0.smithi057.stdout:9/56: stat d3/f9 0 2024-04-25T22:42:12.534 INFO:tasks.workunit.client.0.smithi057.stdout:0/35: sync 2024-04-25T22:42:12.535 INFO:tasks.workunit.client.0.smithi057.stdout:8/36: stat c3 0 2024-04-25T22:42:12.535 INFO:tasks.workunit.client.0.smithi057.stdout:2/59: dread f3 [0,4194304] 0 2024-04-25T22:42:12.535 INFO:tasks.workunit.client.0.smithi057.stdout:9/57: readlink l2 0 2024-04-25T22:42:12.537 INFO:tasks.workunit.client.0.smithi057.stdout:4/25: creat f6 x:0 0 0 2024-04-25T22:42:12.537 INFO:tasks.workunit.client.0.smithi057.stdout:2/60: write f6 [1018883,67613] 0 2024-04-25T22:42:12.537 INFO:tasks.workunit.client.0.smithi057.stdout:6/37: rename d2/f8 to d2/d9/fa 0 2024-04-25T22:42:12.538 INFO:tasks.workunit.client.0.smithi057.stdout:8/37: mkdir d4/db/dd 0 2024-04-25T22:42:12.540 INFO:tasks.workunit.client.0.smithi057.stdout:6/38: readlink d2/l6 0 2024-04-25T22:42:12.540 INFO:tasks.workunit.client.0.smithi057.stdout:9/58: unlink d3/c11 0 2024-04-25T22:42:12.540 INFO:tasks.workunit.client.0.smithi057.stdout:6/39: readlink d2/l6 0 2024-04-25T22:42:12.540 INFO:tasks.workunit.client.0.smithi057.stdout:5/17: dwrite d2/f4 [0,4194304] 0 2024-04-25T22:42:12.541 INFO:tasks.workunit.client.0.smithi057.stdout:2/61: getdents . 0 2024-04-25T22:42:12.541 INFO:tasks.workunit.client.0.smithi057.stdout:8/38: creat d4/db/dd/fe x:0 0 0 2024-04-25T22:42:12.542 INFO:tasks.workunit.client.0.smithi057.stdout:8/39: chown d4 395 1 2024-04-25T22:42:12.544 INFO:tasks.workunit.client.0.smithi057.stdout:6/40: rename d2/f7 to d2/fb 0 2024-04-25T22:42:12.545 INFO:tasks.workunit.client.0.smithi057.stdout:2/62: getdents . 0 2024-04-25T22:42:12.546 INFO:tasks.workunit.client.0.smithi057.stdout:3/35: dwrite d0/f6 [4194304,4194304] 0 2024-04-25T22:42:12.547 INFO:tasks.workunit.client.0.smithi057.stdout:5/18: link d2/c3 d2/c5 0 2024-04-25T22:42:12.548 INFO:tasks.workunit.client.0.smithi057.stdout:8/40: read d4/d5/f7 [2014444,11968] 0 2024-04-25T22:42:12.548 INFO:tasks.workunit.client.0.smithi057.stdout:7/22: dwrite f2 [0,4194304] 0 2024-04-25T22:42:12.548 INFO:tasks.workunit.client.0.smithi057.stdout:4/26: dread f4 [0,4194304] 0 2024-04-25T22:42:12.548 INFO:tasks.workunit.client.0.smithi057.stdout:2/63: rename f12 to f14 0 2024-04-25T22:42:12.549 INFO:tasks.workunit.client.0.smithi057.stdout:7/23: chown d6 3797 1 2024-04-25T22:42:12.549 INFO:tasks.workunit.client.0.smithi057.stdout:8/41: stat d4/d5/la 0 2024-04-25T22:42:12.549 INFO:tasks.workunit.client.0.smithi057.stdout:5/19: chown d2/c5 411 1 2024-04-25T22:42:12.550 INFO:tasks.workunit.client.0.smithi057.stdout:5/20: sync 2024-04-25T22:42:12.550 INFO:tasks.workunit.client.0.smithi057.stdout:3/36: creat d0/d4/fd x:0 0 0 2024-04-25T22:42:12.550 INFO:tasks.workunit.client.0.smithi057.stdout:2/64: creat f15 x:0 0 0 2024-04-25T22:42:12.551 INFO:tasks.workunit.client.0.smithi057.stdout:8/42: chown c3 1942 1 2024-04-25T22:42:12.551 INFO:tasks.workunit.client.0.smithi057.stdout:0/36: dwrite d0/d3/f7 [0,4194304] 0 2024-04-25T22:42:12.552 INFO:tasks.workunit.client.0.smithi057.stdout:5/21: truncate f1 265315 0 2024-04-25T22:42:12.552 INFO:tasks.workunit.client.0.smithi057.stdout:2/65: creat f16 x:0 0 0 2024-04-25T22:42:12.552 INFO:tasks.workunit.client.0.smithi057.stdout:2/66: dread - fb zero size 2024-04-25T22:42:12.554 INFO:tasks.workunit.client.0.smithi057.stdout:6/41: link d2/l6 d2/d9/lc 0 2024-04-25T22:42:12.554 INFO:tasks.workunit.client.0.smithi057.stdout:4/27: rename l5 to l7 0 2024-04-25T22:42:12.555 INFO:tasks.workunit.client.0.smithi057.stdout:6/42: creat d2/fd x:0 0 0 2024-04-25T22:42:12.556 INFO:tasks.workunit.client.0.smithi057.stdout:4/28: rename f6 to f8 0 2024-04-25T22:42:12.559 INFO:tasks.workunit.client.0.smithi057.stdout:4/29: creat f9 x:0 0 0 2024-04-25T22:42:12.559 INFO:tasks.workunit.client.0.smithi057.stdout:4/30: rmdir - no directory 2024-04-25T22:42:12.560 INFO:tasks.workunit.client.0.smithi057.stdout:6/43: chown d2/d9/lc 887245 1 2024-04-25T22:42:12.561 INFO:tasks.workunit.client.0.smithi057.stdout:5/22: dread d2/f4 [0,4194304] 0 2024-04-25T22:42:12.561 INFO:tasks.workunit.client.0.smithi057.stdout:4/31: chown f9 429 1 2024-04-25T22:42:12.563 INFO:tasks.workunit.client.0.smithi057.stdout:9/59: truncate d3/fd 462698 0 2024-04-25T22:42:12.563 INFO:tasks.workunit.client.0.smithi057.stdout:2/67: unlink f14 0 2024-04-25T22:42:12.564 INFO:tasks.workunit.client.0.smithi057.stdout:7/24: write f1 [792384,21822] 0 2024-04-25T22:42:12.565 INFO:tasks.workunit.client.0.smithi057.stdout:6/44: write d2/fd [139248,89364] 0 2024-04-25T22:42:12.565 INFO:tasks.workunit.client.0.smithi057.stdout:2/68: mknod c17 0 2024-04-25T22:42:12.565 INFO:tasks.workunit.client.0.smithi057.stdout:3/37: dwrite d0/d4/fd [0,4194304] 0 2024-04-25T22:42:12.566 INFO:tasks.workunit.client.0.smithi057.stdout:5/23: mkdir d2/d6 0 2024-04-25T22:42:12.567 INFO:tasks.workunit.client.0.smithi057.stdout:4/32: write f8 [142959,13251] 0 2024-04-25T22:42:12.567 INFO:tasks.workunit.client.0.smithi057.stdout:2/69: dread - fe zero size 2024-04-25T22:42:12.567 INFO:tasks.workunit.client.0.smithi057.stdout:8/43: dwrite d4/db/dd/fe [0,4194304] 0 2024-04-25T22:42:12.568 INFO:tasks.workunit.client.0.smithi057.stdout:3/38: dread - d0/fa zero size 2024-04-25T22:42:12.568 INFO:tasks.workunit.client.0.smithi057.stdout:7/25: mknod d6/c8 0 2024-04-25T22:42:12.569 INFO:tasks.workunit.client.0.smithi057.stdout:0/37: dwrite d0/d3/f7 [0,4194304] 0 2024-04-25T22:42:12.569 INFO:tasks.workunit.client.0.smithi057.stdout:6/45: write d2/fd [811392,2835] 0 2024-04-25T22:42:12.569 INFO:tasks.workunit.client.0.smithi057.stdout:8/44: dread - d4/db/fc zero size 2024-04-25T22:42:12.569 INFO:tasks.workunit.client.0.smithi057.stdout:5/24: write d2/f4 [4216527,88004] 0 2024-04-25T22:42:12.570 INFO:tasks.workunit.client.0.smithi057.stdout:8/45: readlink d4/d5/la 0 2024-04-25T22:42:12.571 INFO:tasks.workunit.client.0.smithi057.stdout:4/33: symlink la 0 2024-04-25T22:42:12.571 INFO:tasks.workunit.client.0.smithi057.stdout:9/60: write d3/f12 [18597,9313] 0 2024-04-25T22:42:12.571 INFO:tasks.workunit.client.0.smithi057.stdout:3/39: creat d0/fe x:0 0 0 2024-04-25T22:42:12.572 INFO:tasks.workunit.client.0.smithi057.stdout:0/38: rename d0/c2 to d0/d3/c8 0 2024-04-25T22:42:12.572 INFO:tasks.workunit.client.0.smithi057.stdout:4/34: truncate f4 4581074 0 2024-04-25T22:42:12.572 INFO:tasks.workunit.client.0.smithi057.stdout:3/40: fdatasync d0/fe 0 2024-04-25T22:42:12.572 INFO:tasks.workunit.client.0.smithi057.stdout:8/46: mkdir d4/db/dd/df 0 2024-04-25T22:42:12.573 INFO:tasks.workunit.client.0.smithi057.stdout:0/39: creat d0/f9 x:0 0 0 2024-04-25T22:42:12.573 INFO:tasks.workunit.client.0.smithi057.stdout:0/40: readlink - no filename 2024-04-25T22:42:12.573 INFO:tasks.workunit.client.0.smithi057.stdout:9/61: unlink d3/f5 0 2024-04-25T22:42:12.574 INFO:tasks.workunit.client.0.smithi057.stdout:8/47: readlink d4/d5/la 0 2024-04-25T22:42:12.575 INFO:tasks.workunit.client.0.smithi057.stdout:4/35: write f9 [348733,117077] 0 2024-04-25T22:42:12.575 INFO:tasks.workunit.client.0.smithi057.stdout:9/62: rename f1 to d3/f14 0 2024-04-25T22:42:12.576 INFO:tasks.workunit.client.0.smithi057.stdout:0/41: write d0/d3/f7 [3790306,94940] 0 2024-04-25T22:42:12.576 INFO:tasks.workunit.client.0.smithi057.stdout:8/48: creat d4/f10 x:0 0 0 2024-04-25T22:42:12.576 INFO:tasks.workunit.client.0.smithi057.stdout:4/36: symlink lb 0 2024-04-25T22:42:12.578 INFO:tasks.workunit.client.0.smithi057.stdout:4/37: creat fc x:0 0 0 2024-04-25T22:42:12.578 INFO:tasks.workunit.client.0.smithi057.stdout:8/49: dread - d4/f10 zero size 2024-04-25T22:42:12.579 INFO:tasks.workunit.client.0.smithi057.stdout:3/41: rename d0/l1 to d0/d4/lf 0 2024-04-25T22:42:12.579 INFO:tasks.workunit.client.0.smithi057.stdout:9/63: symlink d3/l15 0 2024-04-25T22:42:12.579 INFO:tasks.workunit.client.0.smithi057.stdout:0/42: chown d0/d3/f4 221 1 2024-04-25T22:42:12.580 INFO:tasks.workunit.client.0.smithi057.stdout:0/43: rmdir d0 39 2024-04-25T22:42:12.580 INFO:tasks.workunit.client.0.smithi057.stdout:3/42: read - d0/d4/f9 zero size 2024-04-25T22:42:12.581 INFO:tasks.workunit.client.0.smithi057.stdout:2/70: dwrite f16 [0,4194304] 0 2024-04-25T22:42:12.581 INFO:tasks.workunit.client.0.smithi057.stdout:9/64: truncate d3/ff 1269888 0 2024-04-25T22:42:12.581 INFO:tasks.workunit.client.0.smithi057.stdout:5/25: dwrite d2/f4 [4194304,4194304] 0 2024-04-25T22:42:12.582 INFO:tasks.workunit.client.0.smithi057.stdout:9/65: chown d3/ff 1 1 2024-04-25T22:42:12.582 INFO:tasks.workunit.client.0.smithi057.stdout:3/43: write d0/f6 [7201996,35273] 0 2024-04-25T22:42:12.584 INFO:tasks.workunit.client.0.smithi057.stdout:2/71: link l1 l18 0 2024-04-25T22:42:12.586 INFO:tasks.workunit.client.0.smithi057.stdout:2/72: chown l1 4419962 1 2024-04-25T22:42:12.586 INFO:tasks.workunit.client.0.smithi057.stdout:0/44: rmdir d0/d3 39 2024-04-25T22:42:12.587 INFO:tasks.workunit.client.0.smithi057.stdout:2/73: truncate f11 1355891 0 2024-04-25T22:42:12.588 INFO:tasks.workunit.client.0.smithi057.stdout:0/45: mkdir d0/d3/da 0 2024-04-25T22:42:12.589 INFO:tasks.workunit.client.0.smithi057.stdout:0/46: fdatasync d0/f9 0 2024-04-25T22:42:12.589 INFO:tasks.workunit.client.0.smithi057.stdout:4/38: dwrite f8 [0,4194304] 0 2024-04-25T22:42:12.589 INFO:tasks.workunit.client.0.smithi057.stdout:8/50: dwrite d4/f10 [0,4194304] 0 2024-04-25T22:42:12.590 INFO:tasks.workunit.client.0.smithi057.stdout:0/47: mknod d0/d3/cb 0 2024-04-25T22:42:12.591 INFO:tasks.workunit.client.0.smithi057.stdout:8/51: symlink d4/d5/l11 0 2024-04-25T22:42:12.593 INFO:tasks.workunit.client.0.smithi057.stdout:0/48: rmdir d0/d3/da 0 2024-04-25T22:42:12.594 INFO:tasks.workunit.client.0.smithi057.stdout:8/52: mkdir d4/db/d12 0 2024-04-25T22:42:12.595 INFO:tasks.workunit.client.0.smithi057.stdout:1/27: truncate f0 217359 0 2024-04-25T22:42:12.595 INFO:tasks.workunit.client.0.smithi057.stdout:3/44: stat d0/d4/lf 0 2024-04-25T22:42:12.597 INFO:tasks.workunit.client.0.smithi057.stdout:4/39: dread f3 [0,4194304] 0 2024-04-25T22:42:12.597 INFO:tasks.workunit.client.0.smithi057.stdout:1/28: creat f4 x:0 0 0 2024-04-25T22:42:12.598 INFO:tasks.workunit.client.0.smithi057.stdout:3/45: unlink d0/d4/l5 0 2024-04-25T22:42:12.599 INFO:tasks.workunit.client.0.smithi057.stdout:2/74: dwrite f8 [0,4194304] 0 2024-04-25T22:42:12.599 INFO:tasks.workunit.client.0.smithi057.stdout:1/29: symlink l5 0 2024-04-25T22:42:12.600 INFO:tasks.workunit.client.0.smithi057.stdout:5/26: dread f1 [0,4194304] 0 2024-04-25T22:42:12.600 INFO:tasks.workunit.client.0.smithi057.stdout:7/26: fdatasync f2 0 2024-04-25T22:42:12.601 INFO:tasks.workunit.client.0.smithi057.stdout:6/46: dread d2/fd [0,4194304] 0 2024-04-25T22:42:12.601 INFO:tasks.workunit.client.0.smithi057.stdout:2/75: write f11 [647765,69551] 0 2024-04-25T22:42:12.602 INFO:tasks.workunit.client.0.smithi057.stdout:8/53: dread d4/f10 [0,4194304] 0 2024-04-25T22:42:12.603 INFO:tasks.workunit.client.0.smithi057.stdout:7/27: creat d6/f9 x:0 0 0 2024-04-25T22:42:12.604 INFO:tasks.workunit.client.0.smithi057.stdout:5/27: write f1 [1173284,5461] 0 2024-04-25T22:42:12.604 INFO:tasks.workunit.client.0.smithi057.stdout:3/46: getdents d0/d4/d7 0 2024-04-25T22:42:12.604 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:12.599+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:12.605 INFO:tasks.workunit.client.0.smithi057.stdout:7/28: fdatasync f2 0 2024-04-25T22:42:12.605 INFO:tasks.workunit.client.0.smithi057.stdout:6/47: mknod d2/d9/ce 0 2024-04-25T22:42:12.605 INFO:tasks.workunit.client.0.smithi057.stdout:8/54: readlink d4/d5/l11 0 2024-04-25T22:42:12.605 INFO:tasks.workunit.client.0.smithi057.stdout:5/28: readlink l0 0 2024-04-25T22:42:12.606 INFO:tasks.workunit.client.0.smithi057.stdout:0/49: dwrite d0/d3/f4 [0,4194304] 0 2024-04-25T22:42:12.606 INFO:tasks.workunit.client.0.smithi057.stdout:3/47: chown d0/f6 5036965 1 2024-04-25T22:42:12.606 INFO:tasks.workunit.client.0.smithi057.stdout:6/48: read - d2/d9/fa zero size 2024-04-25T22:42:12.608 INFO:tasks.workunit.client.0.smithi057.stdout:8/55: creat d4/db/dd/df/f13 x:0 0 0 2024-04-25T22:42:12.608 INFO:tasks.workunit.client.0.smithi057.stdout:5/29: creat d2/d6/f7 x:0 0 0 2024-04-25T22:42:12.608 INFO:tasks.workunit.client.0.smithi057.stdout:6/49: rmdir d2 39 2024-04-25T22:42:12.608 INFO:tasks.workunit.client.0.smithi057.stdout:9/66: sync 2024-04-25T22:42:12.608 INFO:tasks.workunit.client.0.smithi057.stdout:4/40: dwrite f8 [4194304,4194304] 0 2024-04-25T22:42:12.609 INFO:tasks.workunit.client.0.smithi057.stdout:0/50: creat d0/d3/fc x:0 0 0 2024-04-25T22:42:12.609 INFO:tasks.workunit.client.0.smithi057.stdout:0/51: readlink - no filename 2024-04-25T22:42:12.609 INFO:tasks.workunit.client.0.smithi057.stdout:3/48: chown d0/d4/f9 8065 1 2024-04-25T22:42:12.614 INFO:tasks.workunit.client.0.smithi057.stdout:1/30: dread f0 [0,4194304] 0 2024-04-25T22:42:12.615 INFO:tasks.workunit.client.0.smithi057.stdout:6/50: fdatasync d2/fb 0 2024-04-25T22:42:12.615 INFO:tasks.workunit.client.0.smithi057.stdout:3/49: mknod d0/c10 0 2024-04-25T22:42:12.615 INFO:tasks.workunit.client.0.smithi057.stdout:4/41: chown l7 5 1 2024-04-25T22:42:12.617 INFO:tasks.workunit.client.0.smithi057.stdout:0/52: unlink d0/d3/cb 0 2024-04-25T22:42:12.618 INFO:tasks.workunit.client.0.smithi057.stdout:3/50: dread - d0/fe zero size 2024-04-25T22:42:12.620 INFO:tasks.workunit.client.0.smithi057.stdout:7/29: dwrite f5 [0,4194304] 0 2024-04-25T22:42:12.620 INFO:tasks.workunit.client.0.smithi057.stdout:4/42: fdatasync f3 0 2024-04-25T22:42:12.620 INFO:tasks.workunit.client.0.smithi057.stdout:2/76: dwrite f3 [0,4194304] 0 2024-04-25T22:42:12.620 INFO:tasks.workunit.client.0.smithi057.stdout:9/67: dread d3/f9 [0,4194304] 0 2024-04-25T22:42:12.621 INFO:tasks.workunit.client.0.smithi057.stdout:1/31: unlink l5 0 2024-04-25T22:42:12.621 INFO:tasks.workunit.client.0.smithi057.stdout:3/51: mkdir d0/d11 0 2024-04-25T22:42:12.622 INFO:tasks.workunit.client.0.smithi057.stdout:6/51: creat d2/d9/ff x:0 0 0 2024-04-25T22:42:12.622 INFO:tasks.workunit.client.0.smithi057.stdout:7/30: read f1 [360364,88367] 0 2024-04-25T22:42:12.622 INFO:tasks.workunit.client.0.smithi057.stdout:4/43: symlink ld 0 2024-04-25T22:42:12.622 INFO:tasks.workunit.client.0.smithi057.stdout:0/53: mkdir d0/d5/dd 0 2024-04-25T22:42:12.623 INFO:tasks.workunit.client.0.smithi057.stdout:9/68: write d3/ff [1321936,62878] 0 2024-04-25T22:42:12.624 INFO:tasks.workunit.client.0.smithi057.stdout:7/31: fsync f2 0 2024-04-25T22:42:12.625 INFO:tasks.workunit.client.0.smithi057.stdout:5/30: dwrite d2/f4 [4194304,4194304] 0 2024-04-25T22:42:12.625 INFO:tasks.workunit.client.0.smithi057.stdout:8/56: dwrite d4/db/fc [0,4194304] 0 2024-04-25T22:42:12.625 INFO:tasks.workunit.client.0.smithi057.stdout:6/52: rmdir d2/d9 39 2024-04-25T22:42:12.625 INFO:tasks.workunit.client.0.smithi057.stdout:0/54: read d0/d3/f4 [3550066,55530] 0 2024-04-25T22:42:12.627 INFO:tasks.workunit.client.0.smithi057.stdout:2/77: getdents . 0 2024-04-25T22:42:12.628 INFO:tasks.workunit.client.0.smithi057.stdout:2/78: read - fe zero size 2024-04-25T22:42:12.630 INFO:tasks.workunit.client.0.smithi057.stdout:7/32: creat d6/fa x:0 0 0 2024-04-25T22:42:12.631 INFO:tasks.workunit.client.0.smithi057.stdout:6/53: symlink d2/l10 0 2024-04-25T22:42:12.631 INFO:tasks.workunit.client.0.smithi057.stdout:3/52: link d0/fa d0/d11/f12 0 2024-04-25T22:42:12.632 INFO:tasks.workunit.client.0.smithi057.stdout:8/57: mkdir d4/db/d12/d14 0 2024-04-25T22:42:12.634 INFO:tasks.workunit.client.0.smithi057.stdout:3/53: read - d0/d11/f12 zero size 2024-04-25T22:42:12.634 INFO:tasks.workunit.client.0.smithi057.stdout:0/55: creat d0/d5/dd/fe x:0 0 0 2024-04-25T22:42:12.636 INFO:tasks.workunit.client.0.smithi057.stdout:4/44: dwrite f8 [4194304,4194304] 0 2024-04-25T22:42:12.636 INFO:tasks.workunit.client.0.smithi057.stdout:3/54: fsync d0/d4/f9 0 2024-04-25T22:42:12.636 INFO:tasks.workunit.client.0.smithi057.stdout:6/54: write d2/fd [1478288,121747] 0 2024-04-25T22:42:12.636 INFO:tasks.workunit.client.0.smithi057.stdout:5/31: getdents d2 0 2024-04-25T22:42:12.636 INFO:tasks.workunit.client.0.smithi057.stdout:8/58: fdatasync d4/d5/f7 0 2024-04-25T22:42:12.637 INFO:tasks.workunit.client.0.smithi057.stdout:4/45: creat fe x:0 0 0 2024-04-25T22:42:12.638 INFO:tasks.workunit.client.0.smithi057.stdout:8/59: fsync d4/d5/f7 0 2024-04-25T22:42:12.638 INFO:tasks.workunit.client.0.smithi057.stdout:5/32: symlink d2/d6/l8 0 2024-04-25T22:42:12.639 INFO:tasks.workunit.client.0.smithi057.stdout:9/69: dwrite d3/f9 [0,4194304] 0 2024-04-25T22:42:12.640 INFO:tasks.workunit.client.0.smithi057.stdout:7/33: dread f5 [0,4194304] 0 2024-04-25T22:42:12.640 INFO:tasks.workunit.client.0.smithi057.stdout:4/46: rename f8 to ff 0 2024-04-25T22:42:12.641 INFO:tasks.workunit.client.0.smithi057.stdout:5/33: creat d2/f9 x:0 0 0 2024-04-25T22:42:12.641 INFO:tasks.workunit.client.0.smithi057.stdout:9/70: chown d3/la 412416988 1 2024-04-25T22:42:12.641 INFO:tasks.workunit.client.0.smithi057.stdout:1/32: write f0 [1030235,62130] 0 2024-04-25T22:42:12.641 INFO:tasks.workunit.client.0.smithi057.stdout:6/55: creat d2/f11 x:0 0 0 2024-04-25T22:42:12.642 INFO:tasks.workunit.client.0.smithi057.stdout:8/60: link d4/db/dd/df/f13 d4/d5/f15 0 2024-04-25T22:42:12.643 INFO:tasks.workunit.client.0.smithi057.stdout:7/34: dread f1 [0,4194304] 0 2024-04-25T22:42:12.643 INFO:tasks.workunit.client.0.smithi057.stdout:5/34: creat d2/d6/fa x:0 0 0 2024-04-25T22:42:12.643 INFO:tasks.workunit.client.0.smithi057.stdout:8/61: creat d4/f16 x:0 0 0 2024-04-25T22:42:12.644 INFO:tasks.workunit.client.0.smithi057.stdout:0/56: dread d0/d3/f4 [0,4194304] 0 2024-04-25T22:42:12.645 INFO:tasks.workunit.client.0.smithi057.stdout:8/62: write d4/f16 [344602,73140] 0 2024-04-25T22:42:12.645 INFO:tasks.workunit.client.0.smithi057.stdout:5/35: write d2/d6/f7 [804574,32486] 0 2024-04-25T22:42:12.645 INFO:tasks.workunit.client.0.smithi057.stdout:5/36: read f1 [241970,18085] 0 2024-04-25T22:42:12.647 INFO:tasks.workunit.client.0.smithi057.stdout:8/63: mkdir d4/d5/d17 0 2024-04-25T22:42:12.648 INFO:tasks.workunit.client.0.smithi057.stdout:3/55: dwrite d0/f6 [0,4194304] 0 2024-04-25T22:42:12.648 INFO:tasks.workunit.client.0.smithi057.stdout:7/35: getdents d6 0 2024-04-25T22:42:12.648 INFO:tasks.workunit.client.0.smithi057.stdout:5/37: mkdir d2/d6/db 0 2024-04-25T22:42:12.649 INFO:tasks.workunit.client.0.smithi057.stdout:2/79: write f0 [3544236,81081] 0 2024-04-25T22:42:12.649 INFO:tasks.workunit.client.0.smithi057.stdout:0/57: getdents d0/d3/d6 0 2024-04-25T22:42:12.649 INFO:tasks.workunit.client.0.smithi057.stdout:8/64: rmdir d4/db/d12 39 2024-04-25T22:42:12.650 INFO:tasks.workunit.client.0.smithi057.stdout:5/38: chown d2/d6/l8 46789162 1 2024-04-25T22:42:12.650 INFO:tasks.workunit.client.0.smithi057.stdout:7/36: creat d6/fb x:0 0 0 2024-04-25T22:42:12.651 INFO:tasks.workunit.client.0.smithi057.stdout:2/80: symlink l19 0 2024-04-25T22:42:12.652 INFO:tasks.workunit.client.0.smithi057.stdout:0/58: creat d0/d5/ff x:0 0 0 2024-04-25T22:42:12.653 INFO:tasks.workunit.client.0.smithi057.stdout:7/37: rename f5 to d6/fc 0 2024-04-25T22:42:12.653 INFO:tasks.workunit.client.0.smithi057.stdout:8/65: write d4/f10 [3314233,30229] 0 2024-04-25T22:42:12.654 INFO:tasks.workunit.client.0.smithi057.stdout:7/38: rmdir d6 39 2024-04-25T22:42:12.654 INFO:tasks.workunit.client.0.smithi057.stdout:4/47: dwrite ff [0,4194304] 0 2024-04-25T22:42:12.654 INFO:tasks.workunit.client.0.smithi057.stdout:0/59: symlink d0/d3/d6/l10 0 2024-04-25T22:42:12.655 INFO:tasks.workunit.client.0.smithi057.stdout:8/66: creat d4/db/dd/f18 x:0 0 0 2024-04-25T22:42:12.656 INFO:tasks.workunit.client.0.smithi057.stdout:7/39: fdatasync d6/fb 0 2024-04-25T22:42:12.656 INFO:tasks.workunit.client.0.smithi057.stdout:4/48: rename ld to l10 0 2024-04-25T22:42:12.656 INFO:tasks.workunit.client.0.smithi057.stdout:4/49: rmdir - no directory 2024-04-25T22:42:12.657 INFO:tasks.workunit.client.0.smithi057.stdout:6/56: dwrite d2/d9/ff [0,4194304] 0 2024-04-25T22:42:12.657 INFO:tasks.workunit.client.0.smithi057.stdout:5/39: fsync d2/d6/f7 0 2024-04-25T22:42:12.658 INFO:tasks.workunit.client.0.smithi057.stdout:6/57: readlink d2/l10 0 2024-04-25T22:42:12.658 INFO:tasks.workunit.client.0.smithi057.stdout:1/33: truncate f0 427258 0 2024-04-25T22:42:12.659 INFO:tasks.workunit.client.0.smithi057.stdout:1/34: rmdir - no directory 2024-04-25T22:42:12.659 INFO:tasks.workunit.client.0.smithi057.stdout:1/35: rmdir - no directory 2024-04-25T22:42:12.659 INFO:tasks.workunit.client.0.smithi057.stdout:3/56: dread d0/f6 [0,4194304] 0 2024-04-25T22:42:12.659 INFO:tasks.workunit.client.0.smithi057.stdout:0/60: symlink d0/d3/l11 0 2024-04-25T22:42:12.660 INFO:tasks.workunit.client.0.smithi057.stdout:6/58: rmdir d2/d9 39 2024-04-25T22:42:12.661 INFO:tasks.workunit.client.0.smithi057.stdout:0/61: fsync d0/d3/f7 0 2024-04-25T22:42:12.662 INFO:tasks.workunit.client.0.smithi057.stdout:4/50: write f9 [739972,109679] 0 2024-04-25T22:42:12.662 INFO:tasks.workunit.client.0.smithi057.stdout:1/36: creat f6 x:0 0 0 2024-04-25T22:42:12.662 INFO:tasks.workunit.client.0.smithi057.stdout:7/40: fsync d6/fc 0 2024-04-25T22:42:12.662 INFO:tasks.workunit.client.0.smithi057.stdout:9/71: dread d3/ff [0,4194304] 0 2024-04-25T22:42:12.663 INFO:tasks.workunit.client.0.smithi057.stdout:5/40: link l0 d2/lc 0 2024-04-25T22:42:12.663 INFO:tasks.workunit.client.0.smithi057.stdout:3/57: symlink d0/d4/d7/l13 0 2024-04-25T22:42:12.663 INFO:tasks.workunit.client.0.smithi057.stdout:7/41: sync 2024-04-25T22:42:12.663 INFO:tasks.workunit.client.0.smithi057.stdout:1/37: mkdir d7 0 2024-04-25T22:42:12.664 INFO:tasks.workunit.client.0.smithi057.stdout:0/62: rename d0/d5 to d0/d5/d12 22 2024-04-25T22:42:12.665 INFO:tasks.workunit.client.0.smithi057.stdout:6/59: chown d2/f4 95 1 2024-04-25T22:42:12.665 INFO:tasks.workunit.client.0.smithi057.stdout:4/51: write f4 [2030914,59422] 0 2024-04-25T22:42:12.665 INFO:tasks.workunit.client.0.smithi057.stdout:2/81: dwrite f15 [0,4194304] 0 2024-04-25T22:42:12.665 INFO:tasks.workunit.client.0.smithi057.stdout:1/38: symlink d7/l8 0 2024-04-25T22:42:12.666 INFO:tasks.workunit.client.0.smithi057.stdout:7/42: write d6/fb [742441,48264] 0 2024-04-25T22:42:12.667 INFO:tasks.workunit.client.0.smithi057.stdout:0/63: mknod d0/c13 0 2024-04-25T22:42:12.667 INFO:tasks.workunit.client.0.smithi057.stdout:1/39: mkdir d7/d9 0 2024-04-25T22:42:12.668 INFO:tasks.workunit.client.0.smithi057.stdout:6/60: write d2/f11 [952530,121225] 0 2024-04-25T22:42:12.669 INFO:tasks.workunit.client.0.smithi057.stdout:4/52: link l7 l11 0 2024-04-25T22:42:12.672 INFO:tasks.workunit.client.0.smithi057.stdout:8/67: dwrite d4/f10 [4194304,4194304] 0 2024-04-25T22:42:12.673 INFO:tasks.workunit.client.0.smithi057.stdout:1/40: rename l1 to d7/d9/la 0 2024-04-25T22:42:12.675 INFO:tasks.workunit.client.0.smithi057.stdout:0/64: getdents d0/d3 0 2024-04-25T22:42:12.675 INFO:tasks.workunit.client.0.smithi057.stdout:1/41: mkdir d7/db 0 2024-04-25T22:42:12.675 INFO:tasks.workunit.client.0.smithi057.stdout:9/72: dread d3/f9 [0,4194304] 0 2024-04-25T22:42:12.676 INFO:tasks.workunit.client.0.smithi057.stdout:4/53: link l10 l12 0 2024-04-25T22:42:12.676 INFO:tasks.workunit.client.0.smithi057.stdout:1/42: readlink d7/l8 0 2024-04-25T22:42:12.677 INFO:tasks.workunit.client.0.smithi057.stdout:7/43: truncate f1 195441 0 2024-04-25T22:42:12.678 INFO:tasks.workunit.client.0.smithi057.stdout:0/65: write d0/d5/ff [711286,36867] 0 2024-04-25T22:42:12.678 INFO:tasks.workunit.client.0.smithi057.stdout:2/82: dread f6 [0,4194304] 0 2024-04-25T22:42:12.678 INFO:tasks.workunit.client.0.smithi057.stdout:4/54: mknod c13 0 2024-04-25T22:42:12.678 INFO:tasks.workunit.client.0.smithi057.stdout:3/58: dwrite d0/d4/fd [0,4194304] 0 2024-04-25T22:42:12.679 INFO:tasks.workunit.client.0.smithi057.stdout:5/41: dwrite d2/d6/f7 [0,4194304] 0 2024-04-25T22:42:12.679 INFO:tasks.workunit.client.0.smithi057.stdout:2/83: fdatasync f11 0 2024-04-25T22:42:12.679 INFO:tasks.workunit.client.0.smithi057.stdout:2/84: rmdir - no directory 2024-04-25T22:42:12.679 INFO:tasks.workunit.client.0.smithi057.stdout:9/73: rename d3/la to d3/l16 0 2024-04-25T22:42:12.679 INFO:tasks.workunit.client.0.smithi057.stdout:1/43: mknod d7/d9/cc 0 2024-04-25T22:42:12.680 INFO:tasks.workunit.client.0.smithi057.stdout:7/44: mknod d6/cd 0 2024-04-25T22:42:12.680 INFO:tasks.workunit.client.0.smithi057.stdout:5/42: dread - d2/d6/fa zero size 2024-04-25T22:42:12.680 INFO:tasks.workunit.client.0.smithi057.stdout:3/59: dread - d0/d4/f9 zero size 2024-04-25T22:42:12.680 INFO:tasks.workunit.client.0.smithi057.stdout:0/66: write d0/d5/dd/fe [477275,115308] 0 2024-04-25T22:42:12.680 INFO:tasks.workunit.client.0.smithi057.stdout:1/44: fsync f6 0 2024-04-25T22:42:12.681 INFO:tasks.workunit.client.0.smithi057.stdout:2/85: readlink l10 0 2024-04-25T22:42:12.682 INFO:tasks.workunit.client.0.smithi057.stdout:5/43: truncate d2/d6/f7 4982201 0 2024-04-25T22:42:12.682 INFO:tasks.workunit.client.0.smithi057.stdout:0/67: chown d0/d3/fc 3381 1 2024-04-25T22:42:12.682 INFO:tasks.workunit.client.0.smithi057.stdout:1/45: mkdir d7/dd 0 2024-04-25T22:42:12.682 INFO:tasks.workunit.client.0.smithi057.stdout:2/86: stat c17 0 2024-04-25T22:42:12.683 INFO:tasks.workunit.client.0.smithi057.stdout:6/61: read d2/f11 [360641,11823] 0 2024-04-25T22:42:12.683 INFO:tasks.workunit.client.0.smithi057.stdout:1/46: stat c3 0 2024-04-25T22:42:12.683 INFO:tasks.workunit.client.0.smithi057.stdout:0/68: readlink d0/d3/l11 0 2024-04-25T22:42:12.683 INFO:tasks.workunit.client.0.smithi057.stdout:8/68: dread d4/db/dd/fe [0,4194304] 0 2024-04-25T22:42:12.684 INFO:tasks.workunit.client.0.smithi057.stdout:3/60: rename d0/l2 to d0/d4/d7/l14 0 2024-04-25T22:42:12.684 INFO:tasks.workunit.client.0.smithi057.stdout:1/47: chown f4 1508 1 2024-04-25T22:42:12.686 INFO:tasks.workunit.client.0.smithi057.stdout:1/48: mknod d7/d9/ce 0 2024-04-25T22:42:12.686 INFO:tasks.workunit.client.0.smithi057.stdout:9/74: dread d3/f14 [0,4194304] 0 2024-04-25T22:42:12.687 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:12.687 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:12.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.687 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:10771 4.30 e63/17 4:0ecbb745:::1000000310c.00000000:head v 63'175, mlcod=62'173)", 2024-04-25T22:42:12.687 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.673505+0000", 2024-04-25T22:42:12.687 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.013004173000000001, 2024-04-25T22:42:12.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013049415, 2024-04-25T22:42:12.687 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:12.687 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:12.687 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:12.687 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:12.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:12.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.673505+0000", 2024-04-25T22:42:12.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:12.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:12.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.673505+0000", 2024-04-25T22:42:12.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:12.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:12.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.673506+0000", 2024-04-25T22:42:12.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4199999999999995e-07 2024-04-25T22:42:12.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:12.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.681160+0000", 2024-04-25T22:42:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076544229999999996 2024-04-25T22:42:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.681181+0000", 2024-04-25T22:42:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0471000000000001e-05 2024-04-25T22:42:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.681193+0000", 2024-04-25T22:42:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1977999999999999e-05 2024-04-25T22:42:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.681297+0000", 2024-04-25T22:42:12.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000103841 2024-04-25T22:42:12.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.690 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:12.690 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.681335+0000", 2024-04-25T22:42:12.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.8624999999999997e-05 2024-04-25T22:42:12.690 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:12.690 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:12.690 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:12.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.690 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10775 4.2d 4:b5f32131:::10000003117.00000001:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:12.690 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.674687+0000", 2024-04-25T22:42:12.690 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.011822363000000001, 2024-04-25T22:42:12.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011987232, 2024-04-25T22:42:12.691 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:12.691 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:12.691 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:12.691 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:12.691 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:12.691 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:12.691 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10775 2024-04-25T22:42:12.691 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.691 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:12.691 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.691 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:12.691 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.674687+0000", 2024-04-25T22:42:12.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:12.691 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.691 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:12.692 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.674687+0000", 2024-04-25T22:42:12.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:12.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:12.692 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.674688+0000", 2024-04-25T22:42:12.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.1500000000000003e-07 2024-04-25T22:42:12.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:12.692 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.681457+0000", 2024-04-25T22:42:12.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067692059999999998 2024-04-25T22:42:12.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:12.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.681473+0000", 2024-04-25T22:42:12.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5735000000000001e-05 2024-04-25T22:42:12.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.681483+0000", 2024-04-25T22:42:12.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7559999999999994e-06 2024-04-25T22:42:12.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:12.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.681556+0000", 2024-04-25T22:42:12.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3528000000000005e-05 2024-04-25T22:42:12.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:12.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.681708+0000", 2024-04-25T22:42:12.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015170900000000001 2024-04-25T22:42:12.694 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:12.694 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:12.694 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:12.694 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.694 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.694 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10777 4.10 4:096b9514:::1000000310b.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:12.694 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.681597+0000", 2024-04-25T22:42:12.694 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0049123939999999996, 2024-04-25T22:42:12.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0051876639999999998, 2024-04-25T22:42:12.694 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:12.694 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:12.694 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:42:12.694 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:12.694 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:12.695 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:12.695 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10777 2024-04-25T22:42:12.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.695 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:12.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.695 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:12.695 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.681597+0000", 2024-04-25T22:42:12.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:12.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.695 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:12.695 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.681597+0000", 2024-04-25T22:42:12.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:12.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.695 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:12.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.681598+0000", 2024-04-25T22:42:12.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1299999999999999e-07 2024-04-25T22:42:12.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:12.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.686582+0000", 2024-04-25T22:42:12.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049839150000000002 2024-04-25T22:42:12.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:12.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.686598+0000", 2024-04-25T22:42:12.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6702999999999999e-05 2024-04-25T22:42:12.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.686609+0000", 2024-04-25T22:42:12.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1173e-05 2024-04-25T22:42:12.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:12.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.686689+0000", 2024-04-25T22:42:12.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9309999999999998e-05 2024-04-25T22:42:12.697 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:12.697 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:12.697 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:12.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.697 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:443 4.1c 4.7243231c (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-25T22:42:12.697 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.686796+0000", 2024-04-25T22:42:12.697 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4294967295.9997134, 2024-04-25T22:42:12.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5915000000000007e-05, 2024-04-25T22:42:12.697 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:12.698 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:12.698 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "queued for pg", 2024-04-25T22:42:12.698 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:12.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.698 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:12.698 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.686796+0000", 2024-04-25T22:42:12.698 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:12.698 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.698 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:12.698 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.686796+0000", 2024-04-25T22:42:12.698 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:12.698 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.698 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:12.699 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.686797+0000", 2024-04-25T22:42:12.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.176e-06 2024-04-25T22:42:12.699 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.699 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.699 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:12.699 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.686807+0000", 2024-04-25T22:42:12.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9760000000000007e-06 2024-04-25T22:42:12.699 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.699 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.699 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:12.699 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.686821+0000", 2024-04-25T22:42:12.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3482000000000001e-05 2024-04-25T22:42:12.699 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:12.699 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:12.699 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:12.699 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.686828+0000", 2024-04-25T22:42:12.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.729e-06 2024-04-25T22:42:12.700 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:12.700 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:12.700 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:12.700 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:12.700 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-25T22:42:12.700 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 4 2024-04-25T22:42:12.700 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:12.702 INFO:tasks.workunit.client.0.smithi057.stdout:5/44: write d2/f9 [966410,59623] 0 2024-04-25T22:42:12.702 INFO:tasks.workunit.client.0.smithi057.stdout:4/55: getdents . 0 2024-04-25T22:42:12.703 INFO:tasks.workunit.client.0.smithi057.stdout:3/61: chown d0/fa 238898996 1 2024-04-25T22:42:12.703 INFO:tasks.workunit.client.0.smithi057.stdout:4/56: mkdir d14 0 2024-04-25T22:42:12.703 INFO:tasks.workunit.client.0.smithi057.stdout:7/45: dread d6/fc [0,4194304] 0 2024-04-25T22:42:12.703 INFO:tasks.workunit.client.0.smithi057.stdout:1/49: fdatasync f4 0 2024-04-25T22:42:12.703 INFO:tasks.workunit.client.0.smithi057.stdout:1/50: fsync f6 0 2024-04-25T22:42:12.703 INFO:tasks.workunit.client.0.smithi057.stdout:9/75: mknod d3/c17 0 2024-04-25T22:42:12.703 INFO:tasks.workunit.client.0.smithi057.stdout:7/46: mknod d6/ce 0 2024-04-25T22:42:12.703 INFO:tasks.workunit.client.0.smithi057.stdout:5/45: write f1 [1406389,8349] 0 2024-04-25T22:42:12.703 INFO:tasks.workunit.client.0.smithi057.stdout:4/57: getdents d14 0 2024-04-25T22:42:12.703 INFO:tasks.workunit.client.0.smithi057.stdout:9/76: write d3/f14 [424296,12916] 0 2024-04-25T22:42:12.703 INFO:tasks.workunit.client.0.smithi057.stdout:4/58: unlink f3 0 2024-04-25T22:42:12.703 INFO:tasks.workunit.client.0.smithi057.stdout:1/51: symlink d7/db/lf 0 2024-04-25T22:42:12.703 INFO:tasks.workunit.client.0.smithi057.stdout:7/47: write d6/fa [509528,71930] 0 2024-04-25T22:42:12.703 INFO:tasks.workunit.client.0.smithi057.stdout:5/46: dread - d2/d6/fa zero size 2024-04-25T22:42:12.703 INFO:tasks.workunit.client.0.smithi057.stdout:6/62: dwrite d2/fb [0,4194304] 0 2024-04-25T22:42:12.704 INFO:tasks.workunit.client.0.smithi057.stdout:4/59: chown l12 27022 1 2024-04-25T22:42:12.704 INFO:tasks.workunit.client.0.smithi057.stdout:2/87: dwrite fb [0,4194304] 0 2024-04-25T22:42:12.704 INFO:tasks.workunit.client.0.smithi057.stdout:2/88: fsync f16 0 2024-04-25T22:42:12.704 INFO:tasks.workunit.client.0.smithi057.stdout:9/77: creat d3/f18 x:0 0 0 2024-04-25T22:42:12.704 INFO:tasks.workunit.client.0.smithi057.stdout:7/48: truncate d6/fc 4423010 0 2024-04-25T22:42:12.704 INFO:tasks.workunit.client.0.smithi057.stdout:3/62: fsync d0/d4/fd 0 2024-04-25T22:42:12.704 INFO:tasks.workunit.client.0.smithi057.stdout:4/60: chown l2 25 1 2024-04-25T22:42:12.704 INFO:tasks.workunit.client.0.smithi057.stdout:0/69: dwrite d0/d3/f4 [0,4194304] 0 2024-04-25T22:42:12.704 INFO:tasks.workunit.client.0.smithi057.stdout:4/61: sync 2024-04-25T22:42:12.704 INFO:tasks.workunit.client.0.smithi057.stdout:5/47: getdents d2/d6 0 2024-04-25T22:42:12.705 INFO:tasks.workunit.client.0.smithi057.stdout:8/69: dwrite d4/db/fc [0,4194304] 0 2024-04-25T22:42:12.705 INFO:tasks.workunit.client.0.smithi057.stdout:9/78: rename d3/fd to d3/f19 0 2024-04-25T22:42:12.705 INFO:tasks.workunit.client.0.smithi057.stdout:3/63: write d0/d4/fd [3952771,15874] 0 2024-04-25T22:42:12.705 INFO:tasks.workunit.client.0.smithi057.stdout:4/62: truncate f9 1853275 0 2024-04-25T22:42:12.705 INFO:tasks.workunit.client.0.smithi057.stdout:5/48: symlink d2/ld 0 2024-04-25T22:42:12.705 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:12.704+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:12.706 INFO:tasks.workunit.client.0.smithi057.stdout:0/70: write d0/d3/f7 [2951013,124632] 0 2024-04-25T22:42:12.706 INFO:tasks.workunit.client.0.smithi057.stdout:3/64: sync 2024-04-25T22:42:12.707 INFO:tasks.workunit.client.0.smithi057.stdout:4/63: dread - fe zero size 2024-04-25T22:42:12.707 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:12.708 INFO:tasks.workunit.client.0.smithi057.stdout:9/79: creat d3/f1a x:0 0 0 2024-04-25T22:42:12.708 INFO:tasks.workunit.client.0.smithi057.stdout:5/49: write d2/d6/fa [840643,69505] 0 2024-04-25T22:42:12.708 INFO:tasks.workunit.client.0.smithi057.stdout:6/63: dread d2/fd [0,4194304] 0 2024-04-25T22:42:12.709 INFO:tasks.workunit.client.0.smithi057.stdout:3/65: dread - d0/d11/f12 zero size 2024-04-25T22:42:12.709 INFO:tasks.workunit.client.0.smithi057.stdout:8/70: mkdir d4/d5/d17/d19 0 2024-04-25T22:42:12.709 INFO:tasks.workunit.client.0.smithi057.stdout:4/64: symlink d14/l15 0 2024-04-25T22:42:12.709 INFO:tasks.workunit.client.0.smithi057.stdout:6/64: stat d2/c5 0 2024-04-25T22:42:12.709 INFO:tasks.workunit.client.0.smithi057.stdout:9/80: dread - d3/f18 zero size 2024-04-25T22:42:12.709 INFO:tasks.workunit.client.0.smithi057.stdout:8/71: stat d4/d5 0 2024-04-25T22:42:12.710 INFO:tasks.workunit.client.0.smithi057.stdout:6/65: sync 2024-04-25T22:42:12.710 INFO:tasks.workunit.client.0.smithi057.stdout:3/66: read d0/d4/fd [3265738,27744] 0 2024-04-25T22:42:12.710 INFO:tasks.workunit.client.0.smithi057.stdout:2/89: dread f8 [0,4194304] 0 2024-04-25T22:42:12.711 INFO:tasks.workunit.client.0.smithi057.stdout:4/65: write f9 [2162015,5118] 0 2024-04-25T22:42:12.711 INFO:tasks.workunit.client.0.smithi057.stdout:8/72: write d4/f16 [971991,57524] 0 2024-04-25T22:42:12.712 INFO:tasks.workunit.client.0.smithi057.stdout:6/66: symlink d2/d9/l12 0 2024-04-25T22:42:12.712 INFO:tasks.workunit.client.0.smithi057.stdout:2/90: chown fe 95905685 1 2024-04-25T22:42:12.712 INFO:tasks.workunit.client.0.smithi057.stdout:1/52: dwrite f0 [0,4194304] 0 2024-04-25T22:42:12.712 INFO:tasks.workunit.client.0.smithi057.stdout:6/67: sync 2024-04-25T22:42:12.712 INFO:tasks.workunit.client.0.smithi057.stdout:5/50: fsync d2/f4 0 2024-04-25T22:42:12.713 INFO:tasks.workunit.client.0.smithi057.stdout:3/67: mknod d0/d11/c15 0 2024-04-25T22:42:12.713 INFO:tasks.workunit.client.0.smithi057.stdout:6/68: unlink f0 0 2024-04-25T22:42:12.714 INFO:tasks.workunit.client.0.smithi057.stdout:2/91: chown f9 144 1 2024-04-25T22:42:12.714 INFO:tasks.workunit.client.0.smithi057.stdout:1/53: rename f4 to d7/db/f10 0 2024-04-25T22:42:12.715 INFO:tasks.workunit.client.0.smithi057.stdout:2/92: symlink l1a 0 2024-04-25T22:42:12.715 INFO:tasks.workunit.client.0.smithi057.stdout:6/69: mknod d2/d9/c13 0 2024-04-25T22:42:12.716 INFO:tasks.workunit.client.0.smithi057.stdout:6/70: sync 2024-04-25T22:42:12.716 INFO:tasks.workunit.client.0.smithi057.stdout:8/73: rmdir d4/db/d12/d14 0 2024-04-25T22:42:12.716 INFO:tasks.workunit.client.0.smithi057.stdout:2/93: creat f1b x:0 0 0 2024-04-25T22:42:12.718 INFO:tasks.workunit.client.0.smithi057.stdout:7/49: read d6/fa [331960,128619] 0 2024-04-25T22:42:12.718 INFO:tasks.workunit.client.0.smithi057.stdout:6/71: creat d2/f14 x:0 0 0 2024-04-25T22:42:12.718 INFO:tasks.workunit.client.0.smithi057.stdout:2/94: truncate f11 1908184 0 2024-04-25T22:42:12.718 INFO:tasks.workunit.client.0.smithi057.stdout:8/74: dread - d4/db/dd/f18 zero size 2024-04-25T22:42:12.719 INFO:tasks.workunit.client.0.smithi057.stdout:2/95: dread - f1b zero size 2024-04-25T22:42:12.720 INFO:tasks.workunit.client.0.smithi057.stdout:0/71: dwrite d0/d5/ff [0,4194304] 0 2024-04-25T22:42:12.721 INFO:tasks.workunit.client.0.smithi057.stdout:2/96: truncate f16 4393181 0 2024-04-25T22:42:12.722 INFO:tasks.workunit.client.0.smithi057.stdout:5/51: dread d2/d6/f7 [0,4194304] 0 2024-04-25T22:42:12.723 INFO:tasks.workunit.client.0.smithi057.stdout:7/50: symlink d6/lf 0 2024-04-25T22:42:12.724 INFO:tasks.workunit.client.0.smithi057.stdout:3/68: dread d0/f6 [4194304,4194304] 0 2024-04-25T22:42:12.724 INFO:tasks.workunit.client.0.smithi057.stdout:8/75: symlink d4/d5/d17/l1a 0 2024-04-25T22:42:12.725 INFO:tasks.workunit.client.0.smithi057.stdout:0/72: mkdir d0/d3/d6/d14 0 2024-04-25T22:42:12.725 INFO:tasks.workunit.client.0.smithi057.stdout:2/97: rename l7 to l1c 0 2024-04-25T22:42:12.725 INFO:tasks.workunit.client.0.smithi057.stdout:0/73: stat d0 0 2024-04-25T22:42:12.726 INFO:tasks.workunit.client.0.smithi057.stdout:5/52: creat d2/fe x:0 0 0 2024-04-25T22:42:12.726 INFO:tasks.workunit.client.0.smithi057.stdout:9/81: rename d3/f19 to d3/f1b 0 2024-04-25T22:42:12.726 INFO:tasks.workunit.client.0.smithi057.stdout:7/51: mknod d6/c10 0 2024-04-25T22:42:12.726 INFO:tasks.workunit.client.0.smithi057.stdout:8/76: creat d4/db/dd/f1b x:0 0 0 2024-04-25T22:42:12.727 INFO:tasks.workunit.client.0.smithi057.stdout:2/98: truncate fe 670375 0 2024-04-25T22:42:12.727 INFO:tasks.workunit.client.0.smithi057.stdout:9/82: fsync d3/f18 0 2024-04-25T22:42:12.727 INFO:tasks.workunit.client.0.smithi057.stdout:5/53: mknod d2/d6/cf 0 2024-04-25T22:42:12.728 INFO:tasks.workunit.client.0.smithi057.stdout:3/69: mknod d0/d4/c16 0 2024-04-25T22:42:12.728 INFO:tasks.workunit.client.0.smithi057.stdout:2/99: fdatasync f15 0 2024-04-25T22:42:12.728 INFO:tasks.workunit.client.0.smithi057.stdout:1/54: dwrite f6 [0,4194304] 0 2024-04-25T22:42:12.729 INFO:tasks.workunit.client.0.smithi057.stdout:7/52: read d6/fb [138408,44132] 0 2024-04-25T22:42:12.729 INFO:tasks.workunit.client.0.smithi057.stdout:9/83: chown d3/f1a 53497 1 2024-04-25T22:42:12.730 INFO:tasks.workunit.client.0.smithi057.stdout:5/54: write d2/fe [720520,110951] 0 2024-04-25T22:42:12.730 INFO:tasks.workunit.client.0.smithi057.stdout:2/100: dread - f9 zero size 2024-04-25T22:42:12.730 INFO:tasks.workunit.client.0.smithi057.stdout:7/53: rmdir d6 39 2024-04-25T22:42:12.731 INFO:tasks.workunit.client.0.smithi057.stdout:7/54: sync 2024-04-25T22:42:12.731 INFO:tasks.workunit.client.0.smithi057.stdout:3/70: symlink d0/d11/l17 0 2024-04-25T22:42:12.731 INFO:tasks.workunit.client.0.smithi057.stdout:9/84: mknod d3/c1c 0 2024-04-25T22:42:12.731 INFO:tasks.workunit.client.0.smithi057.stdout:2/101: chown f0 224159169 1 2024-04-25T22:42:12.733 INFO:tasks.workunit.client.0.smithi057.stdout:6/72: dwrite d2/fb [0,4194304] 0 2024-04-25T22:42:12.733 INFO:tasks.workunit.client.0.smithi057.stdout:1/55: write d7/db/f10 [415723,107496] 0 2024-04-25T22:42:12.734 INFO:tasks.workunit.client.0.smithi057.stdout:2/102: creat f1d x:0 0 0 2024-04-25T22:42:12.734 INFO:tasks.workunit.client.0.smithi057.stdout:3/71: mknod d0/d11/c18 0 2024-04-25T22:42:12.735 INFO:tasks.workunit.client.0.smithi057.stdout:6/73: unlink d2/d9/fa 0 2024-04-25T22:42:12.736 INFO:tasks.workunit.client.0.smithi057.stdout:1/56: rename d7/d9/la to d7/dd/l11 0 2024-04-25T22:42:12.737 INFO:tasks.workunit.client.0.smithi057.stdout:0/74: dwrite d0/d5/dd/fe [0,4194304] 0 2024-04-25T22:42:12.738 INFO:tasks.workunit.client.0.smithi057.stdout:6/74: fsync d2/f4 0 2024-04-25T22:42:12.740 INFO:tasks.workunit.client.0.smithi057.stdout:0/75: creat d0/d3/f15 x:0 0 0 2024-04-25T22:42:12.741 INFO:tasks.workunit.client.0.smithi057.stdout:6/75: write d2/f4 [802142,7873] 0 2024-04-25T22:42:12.741 INFO:tasks.workunit.client.0.smithi057.stdout:6/76: sync 2024-04-25T22:42:12.744 INFO:tasks.workunit.client.0.smithi057.stdout:5/55: dread d2/f9 [0,4194304] 0 2024-04-25T22:42:12.744 INFO:tasks.workunit.client.0.smithi057.stdout:4/66: fdatasync f9 0 2024-04-25T22:42:12.745 INFO:tasks.workunit.client.0.smithi057.stdout:7/55: getdents d6 0 2024-04-25T22:42:12.745 INFO:tasks.workunit.client.0.smithi057.stdout:5/56: stat d2/d6/f7 0 2024-04-25T22:42:12.746 INFO:tasks.workunit.client.0.smithi057.stdout:8/77: write d4/d5/f15 [367366,17020] 0 2024-04-25T22:42:12.747 INFO:tasks.workunit.client.0.smithi057.stdout:6/77: write d2/d9/ff [991672,62068] 0 2024-04-25T22:42:12.747 INFO:tasks.workunit.client.0.smithi057.stdout:2/103: dwrite f0 [0,4194304] 0 2024-04-25T22:42:12.748 INFO:tasks.workunit.client.0.smithi057.stdout:4/67: read - fe zero size 2024-04-25T22:42:12.749 INFO:tasks.workunit.client.0.smithi057.stdout:7/56: write d6/fc [1931287,82676] 0 2024-04-25T22:42:12.749 INFO:tasks.workunit.client.0.smithi057.stdout:2/104: creat f1e x:0 0 0 2024-04-25T22:42:12.749 INFO:tasks.workunit.client.0.smithi057.stdout:3/72: dwrite d0/d4/fd [0,4194304] 0 2024-04-25T22:42:12.750 INFO:tasks.workunit.client.0.smithi057.stdout:0/76: mknod d0/d3/d6/d14/c16 0 2024-04-25T22:42:12.750 INFO:tasks.workunit.client.0.smithi057.stdout:5/57: write d2/d6/fa [1005781,113523] 0 2024-04-25T22:42:12.750 INFO:tasks.workunit.client.0.smithi057.stdout:8/78: creat d4/db/d12/f1c x:0 0 0 2024-04-25T22:42:12.751 INFO:tasks.workunit.client.0.smithi057.stdout:2/105: readlink lc 0 2024-04-25T22:42:12.751 INFO:tasks.workunit.client.0.smithi057.stdout:1/57: dwrite f0 [0,4194304] 0 2024-04-25T22:42:12.751 INFO:tasks.workunit.client.0.smithi057.stdout:4/68: truncate f9 2043125 0 2024-04-25T22:42:12.753 INFO:tasks.workunit.client.0.smithi057.stdout:2/106: write fe [1341799,58195] 0 2024-04-25T22:42:12.753 INFO:tasks.workunit.client.0.smithi057.stdout:4/69: creat d14/f16 x:0 0 0 2024-04-25T22:42:12.753 INFO:tasks.workunit.client.0.smithi057.stdout:3/73: link d0/f6 d0/d11/f19 0 2024-04-25T22:42:12.754 INFO:tasks.workunit.client.0.smithi057.stdout:0/77: link d0/d5/ff d0/f17 0 2024-04-25T22:42:12.754 INFO:tasks.workunit.client.0.smithi057.stdout:4/70: chown f9 33385077 1 2024-04-25T22:42:12.754 INFO:tasks.workunit.client.0.smithi057.stdout:2/107: mkdir d1f 0 2024-04-25T22:42:12.755 INFO:tasks.workunit.client.0.smithi057.stdout:6/78: link d2/d9/lc d2/d9/l15 0 2024-04-25T22:42:12.755 INFO:tasks.workunit.client.0.smithi057.stdout:4/71: chown l10 1405809153 1 2024-04-25T22:42:12.756 INFO:tasks.workunit.client.0.smithi057.stdout:3/74: write d0/d4/f9 [557960,3113] 0 2024-04-25T22:42:12.756 INFO:tasks.workunit.client.0.smithi057.stdout:2/108: fdatasync f6 0 2024-04-25T22:42:12.758 INFO:tasks.workunit.client.0.smithi057.stdout:0/78: symlink d0/l18 0 2024-04-25T22:42:12.758 INFO:tasks.workunit.client.0.smithi057.stdout:9/85: dread d3/f1b [0,4194304] 0 2024-04-25T22:42:12.759 INFO:tasks.workunit.client.0.smithi057.stdout:2/109: unlink f1e 0 2024-04-25T22:42:12.760 INFO:tasks.workunit.client.0.smithi057.stdout:9/86: mknod d3/c1d 0 2024-04-25T22:42:12.761 INFO:tasks.workunit.client.0.smithi057.stdout:0/79: truncate d0/f9 285056 0 2024-04-25T22:42:12.762 INFO:tasks.workunit.client.0.smithi057.stdout:6/79: getdents d2 0 2024-04-25T22:42:12.764 INFO:tasks.workunit.client.0.smithi057.stdout:0/80: mknod d0/d3/d6/c19 0 2024-04-25T22:42:12.765 INFO:tasks.workunit.client.0.smithi057.stdout:5/58: dwrite f1 [0,4194304] 0 2024-04-25T22:42:12.766 INFO:tasks.workunit.client.0.smithi057.stdout:6/80: read d2/d9/ff [1546687,39762] 0 2024-04-25T22:42:12.767 INFO:tasks.workunit.client.0.smithi057.stdout:9/87: dread d3/ff [0,4194304] 0 2024-04-25T22:42:12.767 INFO:tasks.workunit.client.0.smithi057.stdout:1/58: dread f0 [0,4194304] 0 2024-04-25T22:42:12.767 INFO:tasks.workunit.client.0.smithi057.stdout:7/57: truncate d6/fc 2383751 0 2024-04-25T22:42:12.768 INFO:tasks.workunit.client.0.smithi057.stdout:0/81: mknod d0/d5/c1a 0 2024-04-25T22:42:12.768 INFO:tasks.workunit.client.0.smithi057.stdout:8/79: dwrite d4/d5/f15 [0,4194304] 0 2024-04-25T22:42:12.769 INFO:tasks.workunit.client.0.smithi057.stdout:6/81: write d2/f4 [428483,87564] 0 2024-04-25T22:42:12.769 INFO:tasks.workunit.client.0.smithi057.stdout:5/59: creat d2/f10 x:0 0 0 2024-04-25T22:42:12.769 INFO:tasks.workunit.client.0.smithi057.stdout:7/58: rmdir d6 39 2024-04-25T22:42:12.770 INFO:tasks.workunit.client.0.smithi057.stdout:4/72: dwrite f4 [0,4194304] 0 2024-04-25T22:42:12.773 INFO:tasks.workunit.client.0.smithi057.stdout:4/73: creat d14/f17 x:0 0 0 2024-04-25T22:42:12.773 INFO:tasks.workunit.client.0.smithi057.stdout:7/59: creat d6/f11 x:0 0 0 2024-04-25T22:42:12.773 INFO:tasks.workunit.client.0.smithi057.stdout:0/82: creat d0/d3/d6/f1b x:0 0 0 2024-04-25T22:42:12.774 INFO:tasks.workunit.client.0.smithi057.stdout:8/80: link d4/f16 d4/db/d12/f1d 0 2024-04-25T22:42:12.774 INFO:tasks.workunit.client.0.smithi057.stdout:4/74: mknod d14/c18 0 2024-04-25T22:42:12.775 INFO:tasks.workunit.client.0.smithi057.stdout:1/59: link d7/d9/ce d7/db/c12 0 2024-04-25T22:42:12.775 INFO:tasks.workunit.client.0.smithi057.stdout:2/110: dwrite fb [0,4194304] 0 2024-04-25T22:42:12.776 INFO:tasks.workunit.client.0.smithi057.stdout:0/83: creat d0/d3/f1c x:0 0 0 2024-04-25T22:42:12.776 INFO:tasks.workunit.client.0.smithi057.stdout:7/60: symlink d6/l12 0 2024-04-25T22:42:12.778 INFO:tasks.workunit.client.0.smithi057.stdout:7/61: stat d6/ce 0 2024-04-25T22:42:12.782 INFO:tasks.workunit.client.0.smithi057.stdout:5/60: dread f1 [0,4194304] 0 2024-04-25T22:42:12.784 INFO:tasks.workunit.client.0.smithi057.stdout:3/75: dwrite d0/d11/f12 [0,4194304] 0 2024-04-25T22:42:12.784 INFO:tasks.workunit.client.0.smithi057.stdout:1/60: getdents d7/d9 0 2024-04-25T22:42:12.784 INFO:tasks.workunit.client.0.smithi057.stdout:9/88: dwrite d3/f9 [0,4194304] 0 2024-04-25T22:42:12.787 INFO:tasks.workunit.client.0.smithi057.stdout:5/61: chown d2/fe 16062 1 2024-04-25T22:42:12.787 INFO:tasks.workunit.client.0.smithi057.stdout:5/62: sync 2024-04-25T22:42:12.788 INFO:tasks.workunit.client.0.smithi057.stdout:9/89: read d3/f9 [3660686,92481] 0 2024-04-25T22:42:12.790 INFO:tasks.workunit.client.0.smithi057.stdout:6/82: dwrite d2/f11 [0,4194304] 0 2024-04-25T22:42:12.790 INFO:tasks.workunit.client.0.smithi057.stdout:5/63: readlink l0 0 2024-04-25T22:42:12.791 INFO:tasks.workunit.client.0.smithi057.stdout:8/81: dread d4/d5/f7 [0,4194304] 0 2024-04-25T22:42:12.793 INFO:tasks.workunit.client.0.smithi057.stdout:6/83: symlink d2/l16 0 2024-04-25T22:42:12.794 INFO:tasks.workunit.client.0.smithi057.stdout:4/75: dwrite ff [0,4194304] 0 2024-04-25T22:42:12.801 INFO:tasks.workunit.client.0.smithi057.stdout:0/84: dwrite d0/f9 [0,4194304] 0 2024-04-25T22:42:12.802 INFO:tasks.workunit.client.0.smithi057.stdout:8/82: write d4/db/dd/f18 [278936,128843] 0 2024-04-25T22:42:12.803 INFO:tasks.workunit.client.0.smithi057.stdout:7/62: dwrite d6/f9 [0,4194304] 0 2024-04-25T22:42:12.804 INFO:tasks.workunit.client.0.smithi057.stdout:0/85: read - d0/d3/f1c zero size 2024-04-25T22:42:12.805 INFO:tasks.workunit.client.0.smithi057.stdout:9/90: getdents d3 0 2024-04-25T22:42:12.806 INFO:tasks.workunit.client.0.smithi057.stdout:1/61: dwrite f0 [0,4194304] 0 2024-04-25T22:42:12.806 INFO:tasks.workunit.client.0.smithi057.stdout:8/83: chown d4/db/d12/f1d 21803369 1 2024-04-25T22:42:12.806 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:12.804+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:12.807 INFO:tasks.workunit.client.0.smithi057.stdout:4/76: getdents d14 0 2024-04-25T22:42:12.807 INFO:tasks.workunit.client.0.smithi057.stdout:2/111: dread f11 [0,4194304] 0 2024-04-25T22:42:12.808 INFO:tasks.workunit.client.0.smithi057.stdout:3/76: dwrite d0/d11/f12 [0,4194304] 0 2024-04-25T22:42:12.808 INFO:tasks.workunit.client.0.smithi057.stdout:6/84: creat d2/f17 x:0 0 0 2024-04-25T22:42:12.809 INFO:tasks.workunit.client.0.smithi057.stdout:9/91: chown d3/f13 523865533 1 2024-04-25T22:42:12.809 INFO:tasks.workunit.client.0.smithi057.stdout:9/92: sync 2024-04-25T22:42:12.810 INFO:tasks.workunit.client.0.smithi057.stdout:2/112: chown f3 2 1 2024-04-25T22:42:12.814 INFO:tasks.workunit.client.0.smithi057.stdout:3/77: chown d0/d4/d7/l14 3477 1 2024-04-25T22:42:12.814 INFO:tasks.workunit.client.0.smithi057.stdout:9/93: rename d3/f18 to d3/f1e 0 2024-04-25T22:42:12.815 INFO:tasks.workunit.client.0.smithi057.stdout:8/84: creat d4/db/dd/df/f1e x:0 0 0 2024-04-25T22:42:12.815 INFO:tasks.workunit.client.0.smithi057.stdout:5/64: dwrite d2/d6/fa [0,4194304] 0 2024-04-25T22:42:12.815 INFO:tasks.workunit.client.0.smithi057.stdout:6/85: link d2/f11 d2/d9/f18 0 2024-04-25T22:42:12.815 INFO:tasks.workunit.client.0.smithi057.stdout:7/63: dread d6/fc [0,4194304] 0 2024-04-25T22:42:12.818 INFO:tasks.workunit.client.0.smithi057.stdout:3/78: write d0/d4/f9 [867074,24161] 0 2024-04-25T22:42:12.820 INFO:tasks.workunit.client.0.smithi057.stdout:5/65: truncate d2/d6/f7 1731382 0 2024-04-25T22:42:12.820 INFO:tasks.workunit.client.0.smithi057.stdout:3/79: symlink d0/l1a 0 2024-04-25T22:42:12.825 INFO:tasks.workunit.client.0.smithi057.stdout:2/113: dread f16 [0,4194304] 0 2024-04-25T22:42:12.825 INFO:tasks.workunit.client.0.smithi057.stdout:0/86: dwrite d0/d3/f7 [0,4194304] 0 2024-04-25T22:42:12.827 INFO:tasks.workunit.client.0.smithi057.stdout:5/66: getdents d2/d6 0 2024-04-25T22:42:12.827 INFO:tasks.workunit.client.0.smithi057.stdout:4/77: dwrite fc [0,4194304] 0 2024-04-25T22:42:12.830 INFO:tasks.workunit.client.0.smithi057.stdout:5/67: mknod d2/d6/c11 0 2024-04-25T22:42:12.830 INFO:tasks.workunit.client.0.smithi057.stdout:0/87: write d0/d3/f7 [5141638,17106] 0 2024-04-25T22:42:12.831 INFO:tasks.workunit.client.0.smithi057.stdout:9/94: dwrite d3/f12 [0,4194304] 0 2024-04-25T22:42:12.832 INFO:tasks.workunit.client.0.smithi057.stdout:5/68: creat d2/f12 x:0 0 0 2024-04-25T22:42:12.832 INFO:tasks.workunit.client.0.smithi057.stdout:7/64: dwrite d6/fb [0,4194304] 0 2024-04-25T22:42:12.833 INFO:tasks.workunit.client.0.smithi057.stdout:8/85: dwrite d4/d5/f15 [0,4194304] 0 2024-04-25T22:42:12.833 INFO:tasks.workunit.client.0.smithi057.stdout:9/95: write d3/f14 [2816070,18800] 0 2024-04-25T22:42:12.835 INFO:tasks.workunit.client.0.smithi057.stdout:5/69: creat d2/d6/f13 x:0 0 0 2024-04-25T22:42:12.835 INFO:tasks.workunit.client.0.smithi057.stdout:9/96: creat d3/f1f x:0 0 0 2024-04-25T22:42:12.835 INFO:tasks.workunit.client.0.smithi057.stdout:7/65: fdatasync f3 0 2024-04-25T22:42:12.835 INFO:tasks.workunit.client.0.smithi057.stdout:7/66: fsync f2 0 2024-04-25T22:42:12.835 INFO:tasks.workunit.client.0.smithi057.stdout:0/88: getdents d0/d3/d6 0 2024-04-25T22:42:12.835 INFO:tasks.workunit.client.0.smithi057.stdout:5/70: creat d2/d6/f14 x:0 0 0 2024-04-25T22:42:12.836 INFO:tasks.workunit.client.0.smithi057.stdout:9/97: write d3/f1f [360846,102462] 0 2024-04-25T22:42:12.836 INFO:tasks.workunit.client.0.smithi057.stdout:9/98: chown d3/l16 13171069 1 2024-04-25T22:42:12.836 INFO:tasks.workunit.client.0.smithi057.stdout:5/71: mknod d2/c15 0 2024-04-25T22:42:12.837 INFO:tasks.workunit.client.0.smithi057.stdout:7/67: symlink d6/l13 0 2024-04-25T22:42:12.838 INFO:tasks.workunit.client.0.smithi057.stdout:9/99: creat d3/f20 x:0 0 0 2024-04-25T22:42:12.838 INFO:tasks.workunit.client.0.smithi057.stdout:1/62: truncate f6 3563308 0 2024-04-25T22:42:12.838 INFO:tasks.workunit.client.0.smithi057.stdout:5/72: chown d2/f12 134013825 1 2024-04-25T22:42:12.838 INFO:tasks.workunit.client.0.smithi057.stdout:0/89: truncate d0/f17 3068692 0 2024-04-25T22:42:12.838 INFO:tasks.workunit.client.0.smithi057.stdout:9/100: fdatasync d3/f20 0 2024-04-25T22:42:12.839 INFO:tasks.workunit.client.0.smithi057.stdout:7/68: creat d6/f14 x:0 0 0 2024-04-25T22:42:12.839 INFO:tasks.workunit.client.0.smithi057.stdout:0/90: dread - d0/d3/d6/f1b zero size 2024-04-25T22:42:12.839 INFO:tasks.workunit.client.0.smithi057.stdout:1/63: symlink d7/l13 0 2024-04-25T22:42:12.839 INFO:tasks.workunit.client.0.smithi057.stdout:9/101: truncate d3/f1e 871886 0 2024-04-25T22:42:12.839 INFO:tasks.workunit.client.0.smithi057.stdout:1/64: fdatasync d7/db/f10 0 2024-04-25T22:42:12.840 INFO:tasks.workunit.client.0.smithi057.stdout:9/102: rename d3 to d3/d21 22 2024-04-25T22:42:12.840 INFO:tasks.workunit.client.0.smithi057.stdout:5/73: dread d2/f9 [0,4194304] 0 2024-04-25T22:42:12.840 INFO:tasks.workunit.client.0.smithi057.stdout:9/103: rmdir d3 39 2024-04-25T22:42:12.840 INFO:tasks.workunit.client.0.smithi057.stdout:1/65: unlink d7/d9/cc 0 2024-04-25T22:42:12.840 INFO:tasks.workunit.client.0.smithi057.stdout:0/91: creat d0/d5/dd/f1d x:0 0 0 2024-04-25T22:42:12.841 INFO:tasks.workunit.client.0.smithi057.stdout:5/74: getdents d2/d6/db 0 2024-04-25T22:42:12.841 INFO:tasks.workunit.client.0.smithi057.stdout:9/104: symlink d3/l22 0 2024-04-25T22:42:12.841 INFO:tasks.workunit.client.0.smithi057.stdout:5/75: stat d2/d6 0 2024-04-25T22:42:12.842 INFO:tasks.workunit.client.0.smithi057.stdout:6/86: truncate d2/fb 2817831 0 2024-04-25T22:42:12.842 INFO:tasks.workunit.client.0.smithi057.stdout:9/105: creat d3/f23 x:0 0 0 2024-04-25T22:42:12.842 INFO:tasks.workunit.client.0.smithi057.stdout:5/76: fdatasync f1 0 2024-04-25T22:42:12.842 INFO:tasks.workunit.client.0.smithi057.stdout:6/87: mkdir d2/d19 0 2024-04-25T22:42:12.842 INFO:tasks.workunit.client.0.smithi057.stdout:9/106: creat d3/f24 x:0 0 0 2024-04-25T22:42:12.843 INFO:tasks.workunit.client.0.smithi057.stdout:6/88: mkdir d2/d9/d1a 0 2024-04-25T22:42:12.843 INFO:tasks.workunit.client.0.smithi057.stdout:9/107: truncate d3/f12 4304147 0 2024-04-25T22:42:12.844 INFO:tasks.workunit.client.0.smithi057.stdout:6/89: rename d2/d9/c13 to d2/d9/c1b 0 2024-04-25T22:42:12.845 INFO:tasks.workunit.client.0.smithi057.stdout:6/90: chown d2/d9/lc 813858 1 2024-04-25T22:42:12.850 INFO:tasks.workunit.client.0.smithi057.stdout:3/80: truncate d0/d4/f9 609307 0 2024-04-25T22:42:12.851 INFO:tasks.workunit.client.0.smithi057.stdout:0/92: dwrite d0/d3/fc [0,4194304] 0 2024-04-25T22:42:12.851 INFO:tasks.workunit.client.0.smithi057.stdout:3/81: creat d0/f1b x:0 0 0 2024-04-25T22:42:12.852 INFO:tasks.workunit.client.0.smithi057.stdout:4/78: truncate fc 746554 0 2024-04-25T22:42:12.852 INFO:tasks.workunit.client.0.smithi057.stdout:2/114: dread fe [0,4194304] 0 2024-04-25T22:42:12.852 INFO:tasks.workunit.client.0.smithi057.stdout:0/93: symlink d0/d5/l1e 0 2024-04-25T22:42:12.854 INFO:tasks.workunit.client.0.smithi057.stdout:4/79: unlink d14/c18 0 2024-04-25T22:42:12.854 INFO:tasks.workunit.client.0.smithi057.stdout:0/94: dread - d0/d5/dd/f1d zero size 2024-04-25T22:42:12.854 INFO:tasks.workunit.client.0.smithi057.stdout:2/115: creat d1f/f20 x:0 0 0 2024-04-25T22:42:12.854 INFO:tasks.workunit.client.0.smithi057.stdout:2/116: truncate f11 2515440 0 2024-04-25T22:42:12.854 INFO:tasks.workunit.client.0.smithi057.stdout:0/95: readlink d0/d3/d6/l10 0 2024-04-25T22:42:12.855 INFO:tasks.workunit.client.0.smithi057.stdout:2/117: read - f1b zero size 2024-04-25T22:42:12.855 INFO:tasks.workunit.client.0.smithi057.stdout:4/80: link l11 d14/l19 0 2024-04-25T22:42:12.855 INFO:tasks.workunit.client.0.smithi057.stdout:7/69: write f3 [421657,93430] 0 2024-04-25T22:42:12.856 INFO:tasks.workunit.client.0.smithi057.stdout:0/96: dread - d0/d3/f1c zero size 2024-04-25T22:42:12.856 INFO:tasks.workunit.client.0.smithi057.stdout:4/81: creat d14/f1a x:0 0 0 2024-04-25T22:42:12.857 INFO:tasks.workunit.client.0.smithi057.stdout:1/66: getdents d7/d9 0 2024-04-25T22:42:12.860 INFO:tasks.workunit.client.0.smithi057.stdout:6/91: fsync d2/fb 0 2024-04-25T22:42:12.860 INFO:tasks.workunit.client.0.smithi057.stdout:8/86: dwrite d4/db/d12/f1d [0,4194304] 0 2024-04-25T22:42:12.860 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is set 2024-04-25T22:42:12.860 INFO:tasks.workunit.client.0.smithi057.stdout:6/92: dread - d2/f17 zero size 2024-04-25T22:42:12.861 INFO:tasks.workunit.client.0.smithi057.stdout:0/97: read d0/d3/f4 [2382750,25694] 0 2024-04-25T22:42:12.861 INFO:tasks.workunit.client.0.smithi057.stdout:1/67: creat d7/dd/f14 x:0 0 0 2024-04-25T22:42:12.861 INFO:tasks.workunit.client.0.smithi057.stdout:8/87: readlink d4/d5/la 0 2024-04-25T22:42:12.862 INFO:tasks.workunit.client.0.smithi057.stdout:7/70: link f1 d6/f15 0 2024-04-25T22:42:12.862 INFO:tasks.workunit.client.0.smithi057.stdout:4/82: chown l7 1573969 1 2024-04-25T22:42:12.863 INFO:tasks.workunit.client.0.smithi057.stdout:8/88: symlink d4/db/dd/l1f 0 2024-04-25T22:42:12.863 INFO:tasks.workunit.client.0.smithi057.stdout:7/71: rmdir d6 39 2024-04-25T22:42:12.863 INFO:tasks.workunit.client.0.smithi057.stdout:0/98: mknod d0/d3/d6/d14/c1f 0 2024-04-25T22:42:12.865 INFO:tasks.workunit.client.0.smithi057.stdout:1/68: mknod d7/d9/c15 0 2024-04-25T22:42:12.865 INFO:tasks.workunit.client.0.smithi057.stdout:9/108: getdents d3 0 2024-04-25T22:42:12.865 INFO:tasks.workunit.client.0.smithi057.stdout:6/93: creat d2/f1c x:0 0 0 2024-04-25T22:42:12.866 INFO:tasks.workunit.client.0.smithi057.stdout:3/82: dwrite d0/fe [0,4194304] 0 2024-04-25T22:42:12.866 INFO:tasks.workunit.client.0.smithi057.stdout:2/118: getdents d1f 0 2024-04-25T22:42:12.866 INFO:tasks.workunit.client.0.smithi057.stdout:9/109: stat d3/f13 0 2024-04-25T22:42:12.866 INFO:tasks.workunit.client.0.smithi057.stdout:6/94: chown d2/f17 2390237 1 2024-04-25T22:42:12.866 INFO:tasks.workunit.client.0.smithi057.stdout:0/99: dread - d0/d3/d6/f1b zero size 2024-04-25T22:42:12.872 INFO:tasks.workunit.client.0.smithi057.stdout:4/83: mknod d14/c1b 0 2024-04-25T22:42:12.872 INFO:tasks.workunit.client.0.smithi057.stdout:1/69: rename d7/db to d7/dd/d16 0 2024-04-25T22:42:12.872 INFO:tasks.workunit.client.0.smithi057.stdout:4/84: chown l12 15264708 1 2024-04-25T22:42:12.873 INFO:tasks.workunit.client.0.smithi057.stdout:9/110: symlink d3/l25 0 2024-04-25T22:42:12.873 INFO:tasks.workunit.client.0.smithi057.stdout:0/100: mknod d0/d3/c20 0 2024-04-25T22:42:12.873 INFO:tasks.workunit.client.0.smithi057.stdout:6/95: read d2/fd [796199,95826] 0 2024-04-25T22:42:12.873 INFO:tasks.workunit.client.0.smithi057.stdout:9/111: readlink d3/l25 0 2024-04-25T22:42:12.873 INFO:tasks.workunit.client.0.smithi057.stdout:4/85: dread - d14/f1a zero size 2024-04-25T22:42:12.873 INFO:tasks.workunit.client.0.smithi057.stdout:8/89: rename d4/f16 to d4/db/dd/f20 0 2024-04-25T22:42:12.873 INFO:tasks.workunit.client.0.smithi057.stdout:4/86: truncate d14/f17 778780 0 2024-04-25T22:42:12.874 INFO:tasks.workunit.client.0.smithi057.stdout:0/101: write d0/d3/fc [2030511,65156] 0 2024-04-25T22:42:12.874 INFO:tasks.workunit.client.0.smithi057.stdout:4/87: fdatasync fe 0 2024-04-25T22:42:12.874 INFO:tasks.workunit.client.0.smithi057.stdout:1/70: mknod d7/c17 0 2024-04-25T22:42:12.875 INFO:tasks.workunit.client.0.smithi057.stdout:9/112: mkdir d3/d26 0 2024-04-25T22:42:12.875 INFO:tasks.workunit.client.0.smithi057.stdout:7/72: link d6/f15 d6/f16 0 2024-04-25T22:42:12.876 INFO:tasks.workunit.client.0.smithi057.stdout:0/102: dread - d0/d3/d6/f1b zero size 2024-04-25T22:42:12.876 INFO:tasks.workunit.client.0.smithi057.stdout:6/96: mknod d2/d9/d1a/c1d 0 2024-04-25T22:42:12.877 INFO:tasks.workunit.client.0.smithi057.stdout:7/73: chown d6/l13 18904238 1 2024-04-25T22:42:12.877 INFO:tasks.workunit.client.0.smithi057.stdout:5/77: write d2/d6/f7 [2251866,49537] 0 2024-04-25T22:42:12.877 INFO:tasks.workunit.client.0.smithi057.stdout:4/88: creat d14/f1c x:0 0 0 2024-04-25T22:42:12.877 INFO:tasks.workunit.client.0.smithi057.stdout:1/71: write d7/dd/f14 [489101,27764] 0 2024-04-25T22:42:12.877 INFO:tasks.workunit.client.0.smithi057.stdout:2/119: dread f6 [0,4194304] 0 2024-04-25T22:42:12.877 INFO:tasks.workunit.client.0.smithi057.stdout:7/74: readlink d6/lf 0 2024-04-25T22:42:12.878 INFO:tasks.workunit.client.0.smithi057.stdout:4/89: write d14/f16 [698067,45140] 0 2024-04-25T22:42:12.878 INFO:tasks.workunit.client.0.smithi057.stdout:5/78: chown d2/d6/f13 28823216 1 2024-04-25T22:42:12.880 INFO:tasks.workunit.client.0.smithi057.stdout:6/97: rename d2/fd to d2/d19/f1e 0 2024-04-25T22:42:12.881 INFO:tasks.workunit.client.0.smithi057.stdout:4/90: dread - fe zero size 2024-04-25T22:42:12.881 INFO:tasks.workunit.client.0.smithi057.stdout:2/120: mkdir d1f/d21 0 2024-04-25T22:42:12.881 INFO:tasks.workunit.client.0.smithi057.stdout:4/91: write d14/f16 [350918,57825] 0 2024-04-25T22:42:12.881 INFO:tasks.workunit.client.0.smithi057.stdout:3/83: dwrite d0/fa [0,4194304] 0 2024-04-25T22:42:12.882 INFO:tasks.workunit.client.0.smithi057.stdout:3/84: truncate d0/d4/f9 903384 0 2024-04-25T22:42:12.883 INFO:tasks.workunit.client.0.smithi057.stdout:7/75: symlink d6/l17 0 2024-04-25T22:42:12.883 INFO:tasks.workunit.client.0.smithi057.stdout:6/98: unlink d2/d9/l12 0 2024-04-25T22:42:12.884 INFO:tasks.workunit.client.0.smithi057.stdout:9/113: truncate d3/f1f 284040 0 2024-04-25T22:42:12.884 INFO:tasks.workunit.client.0.smithi057.stdout:4/92: fdatasync fc 0 2024-04-25T22:42:12.884 INFO:tasks.workunit.client.0.smithi057.stdout:1/72: write f6 [3159393,126381] 0 2024-04-25T22:42:12.884 INFO:tasks.workunit.client.0.smithi057.stdout:5/79: creat d2/d6/db/f16 x:0 0 0 2024-04-25T22:42:12.885 INFO:tasks.workunit.client.0.smithi057.stdout:2/121: getdents d1f/d21 0 2024-04-25T22:42:12.885 INFO:tasks.workunit.client.0.smithi057.stdout:1/73: rmdir d7 39 2024-04-25T22:42:12.886 INFO:tasks.workunit.client.0.smithi057.stdout:2/122: read fb [2808195,3347] 0 2024-04-25T22:42:12.886 INFO:tasks.workunit.client.0.smithi057.stdout:4/93: mknod d14/c1d 0 2024-04-25T22:42:12.886 INFO:tasks.workunit.client.0.smithi057.stdout:2/123: fsync f15 0 2024-04-25T22:42:12.886 INFO:tasks.workunit.client.0.smithi057.stdout:4/94: symlink d14/l1e 0 2024-04-25T22:42:12.887 INFO:tasks.workunit.client.0.smithi057.stdout:1/74: unlink d7/l13 0 2024-04-25T22:42:12.888 INFO:tasks.workunit.client.0.smithi057.stdout:2/124: creat d1f/d21/f22 x:0 0 0 2024-04-25T22:42:12.889 INFO:tasks.workunit.client.0.smithi057.stdout:5/80: truncate f1 1583659 0 2024-04-25T22:42:12.889 INFO:tasks.workunit.client.0.smithi057.stdout:2/125: stat l1 0 2024-04-25T22:42:12.890 INFO:tasks.workunit.client.0.smithi057.stdout:7/76: truncate d6/fa 3091 0 2024-04-25T22:42:12.890 INFO:tasks.workunit.client.0.smithi057.stdout:3/85: dread d0/d11/f12 [0,4194304] 0 2024-04-25T22:42:12.891 INFO:tasks.workunit.client.0.smithi057.stdout:9/114: truncate d3/f14 1427915 0 2024-04-25T22:42:12.892 INFO:tasks.workunit.client.0.smithi057.stdout:6/99: dread d2/f11 [0,4194304] 0 2024-04-25T22:42:12.892 INFO:tasks.workunit.client.0.smithi057.stdout:0/103: dwrite d0/f17 [0,4194304] 0 2024-04-25T22:42:12.892 INFO:tasks.workunit.client.0.smithi057.stdout:9/115: fdatasync d3/f24 0 2024-04-25T22:42:12.892 INFO:tasks.workunit.client.0.smithi057.stdout:5/81: link d2/f10 d2/d6/db/f17 0 2024-04-25T22:42:12.892 INFO:tasks.workunit.client.0.smithi057.stdout:1/75: getdents d7/dd/d16 0 2024-04-25T22:42:12.893 INFO:tasks.workunit.client.0.smithi057.stdout:3/86: creat d0/d11/f1c x:0 0 0 2024-04-25T22:42:12.893 INFO:tasks.workunit.client.0.smithi057.stdout:1/76: truncate f0 4876302 0 2024-04-25T22:42:12.893 INFO:tasks.workunit.client.0.smithi057.stdout:6/100: mknod d2/d9/c1f 0 2024-04-25T22:42:12.893 INFO:tasks.workunit.client.0.smithi057.stdout:7/77: link d6/f14 d6/f18 0 2024-04-25T22:42:12.894 INFO:tasks.workunit.client.0.smithi057.stdout:5/82: symlink d2/d6/db/l18 0 2024-04-25T22:42:12.894 INFO:tasks.workunit.client.0.smithi057.stdout:4/95: dread ff [0,4194304] 0 2024-04-25T22:42:12.894 INFO:tasks.workunit.client.0.smithi057.stdout:7/78: readlink d6/l12 0 2024-04-25T22:42:12.894 INFO:tasks.workunit.client.0.smithi057.stdout:9/116: creat d3/d26/f27 x:0 0 0 2024-04-25T22:42:12.894 INFO:tasks.workunit.client.0.smithi057.stdout:1/77: rmdir d7 39 2024-04-25T22:42:12.894 INFO:tasks.workunit.client.0.smithi057.stdout:6/101: mkdir d2/d19/d20 0 2024-04-25T22:42:12.895 INFO:tasks.workunit.client.0.smithi057.stdout:0/104: rename d0/d3/d6/c19 to d0/c21 0 2024-04-25T22:42:12.895 INFO:tasks.workunit.client.0.smithi057.stdout:3/87: read d0/d4/f9 [246357,102432] 0 2024-04-25T22:42:12.895 INFO:tasks.workunit.client.0.smithi057.stdout:5/83: write d2/f12 [890697,117464] 0 2024-04-25T22:42:12.895 INFO:tasks.workunit.client.0.smithi057.stdout:4/96: truncate d14/f16 1386099 0 2024-04-25T22:42:12.896 INFO:tasks.workunit.client.0.smithi057.stdout:5/84: mknod d2/c19 0 2024-04-25T22:42:12.896 INFO:tasks.workunit.client.0.smithi057.stdout:1/78: chown d7/dd/d16/c12 0 1 2024-04-25T22:42:12.896 INFO:tasks.workunit.client.0.smithi057.stdout:3/88: creat d0/d4/d7/f1d x:0 0 0 2024-04-25T22:42:12.896 INFO:tasks.workunit.client.0.smithi057.stdout:1/79: write f6 [1210088,60891] 0 2024-04-25T22:42:12.897 INFO:tasks.workunit.client.0.smithi057.stdout:6/102: dread d2/d19/f1e [0,4194304] 0 2024-04-25T22:42:12.897 INFO:tasks.workunit.client.0.smithi057.stdout:9/117: mkdir d3/d26/d28 0 2024-04-25T22:42:12.898 INFO:tasks.workunit.client.0.smithi057.stdout:1/80: mkdir d7/dd/d16/d18 0 2024-04-25T22:42:12.898 INFO:tasks.workunit.client.0.smithi057.stdout:6/103: symlink d2/d19/d20/l21 0 2024-04-25T22:42:12.899 INFO:tasks.workunit.client.0.smithi057.stdout:6/104: mkdir d2/d9/d1a/d22 0 2024-04-25T22:42:12.900 INFO:tasks.workunit.client.0.smithi057.stdout:1/81: read d7/dd/d16/f10 [180421,17716] 0 2024-04-25T22:42:12.902 INFO:tasks.workunit.client.0.smithi057.stdout:1/82: symlink d7/d9/l19 0 2024-04-25T22:42:12.902 INFO:tasks.workunit.client.0.smithi057.stdout:3/89: fdatasync d0/fa 0 2024-04-25T22:42:12.902 INFO:tasks.workunit.client.0.smithi057.stdout:5/85: getdents d2 0 2024-04-25T22:42:12.902 INFO:tasks.workunit.client.0.smithi057.stdout:7/79: dwrite d6/f11 [0,4194304] 0 2024-04-25T22:42:12.904 INFO:tasks.workunit.client.0.smithi057.stdout:4/97: dwrite fc [0,4194304] 0 2024-04-25T22:42:12.904 INFO:tasks.workunit.client.0.smithi057.stdout:9/118: getdents d3/d26 0 2024-04-25T22:42:12.904 INFO:tasks.workunit.client.0.smithi057.stdout:5/86: write d2/d6/f14 [74845,87862] 0 2024-04-25T22:42:12.904 INFO:tasks.workunit.client.0.smithi057.stdout:7/80: truncate d6/f16 149589 0 2024-04-25T22:42:12.905 INFO:tasks.workunit.client.0.smithi057.stdout:4/98: mknod d14/c1f 0 2024-04-25T22:42:12.905 INFO:tasks.workunit.client.0.smithi057.stdout:9/119: rmdir d3 39 2024-04-25T22:42:12.905 INFO:tasks.workunit.client.0.smithi057.stdout:1/83: link d7/dd/l11 d7/d9/l1a 0 2024-04-25T22:42:12.905 INFO:tasks.workunit.client.0.smithi057.stdout:4/99: fsync fe 0 2024-04-25T22:42:12.906 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:12.906 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:12.906 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:42:12.906 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:42:12.906 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:12.907 INFO:tasks.workunit.client.0.smithi057.stdout:1/84: write f6 [541878,7406] 0 2024-04-25T22:42:12.907 INFO:tasks.workunit.client.0.smithi057.stdout:4/100: creat d14/f20 x:0 0 0 2024-04-25T22:42:12.907 INFO:tasks.workunit.client.0.smithi057.stdout:9/120: creat d3/f29 x:0 0 0 2024-04-25T22:42:12.907 INFO:tasks.workunit.client.0.smithi057.stdout:9/121: rmdir d3/d26 39 2024-04-25T22:42:12.907 INFO:tasks.workunit.client.0.smithi057.stdout:7/81: stat d6/f16 0 2024-04-25T22:42:12.907 INFO:tasks.workunit.client.0.smithi057.stdout:7/82: fsync f2 0 2024-04-25T22:42:12.908 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:12.904+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:12.908 INFO:tasks.workunit.client.0.smithi057.stdout:9/122: read d3/f12 [1039812,44007] 0 2024-04-25T22:42:12.908 INFO:tasks.workunit.client.0.smithi057.stdout:3/90: dread d0/d4/fd [0,4194304] 0 2024-04-25T22:42:12.909 INFO:tasks.workunit.client.0.smithi057.stdout:3/91: chown d0/d4/d7/l13 441187 1 2024-04-25T22:42:12.910 INFO:tasks.workunit.client.0.smithi057.stdout:9/123: dread d3/f1b [0,4194304] 0 2024-04-25T22:42:12.910 INFO:tasks.workunit.client.0.smithi057.stdout:3/92: chown d0/d11 2 1 2024-04-25T22:42:12.912 INFO:tasks.workunit.client.0.smithi057.stdout:9/124: stat d3/d26/f27 0 2024-04-25T22:42:12.913 INFO:tasks.workunit.client.0.smithi057.stdout:9/125: read d3/f1b [197520,10094] 0 2024-04-25T22:42:12.914 INFO:tasks.workunit.client.0.smithi057.stdout:5/87: dwrite d2/d6/f13 [0,4194304] 0 2024-04-25T22:42:12.915 INFO:tasks.workunit.client.0.smithi057.stdout:4/101: dwrite d14/f17 [0,4194304] 0 2024-04-25T22:42:12.916 INFO:tasks.workunit.client.0.smithi057.stdout:1/85: dread f0 [4194304,4194304] 0 2024-04-25T22:42:12.916 INFO:tasks.workunit.client.0.smithi057.stdout:5/88: mkdir d2/d6/db/d1a 0 2024-04-25T22:42:12.916 INFO:tasks.workunit.client.0.smithi057.stdout:4/102: fsync ff 0 2024-04-25T22:42:12.917 INFO:tasks.workunit.client.0.smithi057.stdout:9/126: link d3/f20 d3/f2a 0 2024-04-25T22:42:12.917 INFO:tasks.workunit.client.0.smithi057.stdout:4/103: mknod d14/c21 0 2024-04-25T22:42:12.917 INFO:tasks.workunit.client.0.smithi057.stdout:3/93: dread d0/fe [0,4194304] 0 2024-04-25T22:42:12.918 INFO:tasks.workunit.client.0.smithi057.stdout:3/94: creat d0/d11/f1e x:0 0 0 2024-04-25T22:42:12.918 INFO:tasks.workunit.client.0.smithi057.stdout:9/127: link d3/f24 d3/d26/f2b 0 2024-04-25T22:42:12.918 INFO:tasks.workunit.client.0.smithi057.stdout:9/128: readlink d3/l15 0 2024-04-25T22:42:12.919 INFO:tasks.workunit.client.0.smithi057.stdout:9/129: dread - d3/d26/f27 zero size 2024-04-25T22:42:12.920 INFO:tasks.workunit.client.0.smithi057.stdout:7/83: write d6/f15 [707098,38220] 0 2024-04-25T22:42:12.923 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:12.923 INFO:tasks.workunit.client.0.smithi057.stdout:5/89: truncate d2/d6/fa 3941124 0 2024-04-25T22:42:12.925 INFO:tasks.workunit.client.0.smithi057.stdout:5/90: rename d2/c5 to d2/c1b 0 2024-04-25T22:42:12.925 INFO:tasks.workunit.client.0.smithi057.stdout:3/95: dwrite d0/d4/fd [0,4194304] 0 2024-04-25T22:42:12.926 INFO:tasks.workunit.client.0.smithi057.stdout:5/91: fsync d2/d6/db/f16 0 2024-04-25T22:42:12.926 INFO:tasks.workunit.client.0.smithi057.stdout:1/86: dwrite d7/dd/d16/f10 [0,4194304] 0 2024-04-25T22:42:12.927 INFO:tasks.workunit.client.0.smithi057.stdout:5/92: mkdir d2/d1c 0 2024-04-25T22:42:12.927 INFO:tasks.workunit.client.0.smithi057.stdout:3/96: creat d0/d11/f1f x:0 0 0 2024-04-25T22:42:12.927 INFO:tasks.workunit.client.0.smithi057.stdout:9/130: dread d3/f1f [0,4194304] 0 2024-04-25T22:42:12.928 INFO:tasks.workunit.client.0.smithi057.stdout:3/97: fdatasync d0/f6 0 2024-04-25T22:42:12.929 INFO:tasks.workunit.client.0.smithi057.stdout:9/131: link d3/c17 d3/d26/d28/c2c 0 2024-04-25T22:42:12.930 INFO:tasks.workunit.client.0.smithi057.stdout:9/132: mkdir d3/d26/d28/d2d 0 2024-04-25T22:42:12.932 INFO:tasks.workunit.client.0.smithi057.stdout:1/87: dread f6 [0,4194304] 0 2024-04-25T22:42:12.932 INFO:tasks.workunit.client.0.smithi057.stdout:1/88: truncate d7/dd/f14 1214748 0 2024-04-25T22:42:12.933 INFO:tasks.workunit.client.0.smithi057.stdout:1/89: readlink d7/d9/l1a 0 2024-04-25T22:42:12.933 INFO:tasks.workunit.client.0.smithi057.stdout:1/90: chown d7/d9/l1a 4904 1 2024-04-25T22:42:12.934 INFO:tasks.workunit.client.0.smithi057.stdout:5/93: dread d2/f4 [4194304,4194304] 0 2024-04-25T22:42:12.935 INFO:tasks.workunit.client.0.smithi057.stdout:1/91: rename d7/l8 to d7/dd/d16/d18/l1b 0 2024-04-25T22:42:12.935 INFO:tasks.workunit.client.0.smithi057.stdout:5/94: dread - d2/d6/db/f17 zero size 2024-04-25T22:42:12.935 INFO:tasks.workunit.client.0.smithi057.stdout:5/95: fdatasync d2/f4 0 2024-04-25T22:42:12.936 INFO:tasks.workunit.client.0.smithi057.stdout:7/84: dread f3 [0,4194304] 0 2024-04-25T22:42:12.936 INFO:tasks.workunit.client.0.smithi057.stdout:5/96: mknod d2/d6/db/d1a/c1d 0 2024-04-25T22:42:12.937 INFO:tasks.workunit.client.0.smithi057.stdout:7/85: rename d6/f11 to d6/f19 0 2024-04-25T22:42:12.938 INFO:tasks.workunit.client.0.smithi057.stdout:7/86: creat d6/f1a x:0 0 0 2024-04-25T22:42:12.938 INFO:tasks.workunit.client.0.smithi057.stdout:3/98: truncate d0/d11/f19 8073486 0 2024-04-25T22:42:12.939 INFO:tasks.workunit.client.0.smithi057.stdout:3/99: fsync d0/f1b 0 2024-04-25T22:42:12.940 INFO:tasks.workunit.client.0.smithi057.stdout:3/100: symlink d0/d4/d7/l20 0 2024-04-25T22:42:12.940 INFO:tasks.workunit.client.0.smithi057.stdout:3/101: rmdir d0/d4 39 2024-04-25T22:42:12.940 INFO:tasks.workunit.client.0.smithi057.stdout:9/133: write d3/f12 [5170382,16440] 0 2024-04-25T22:42:12.941 INFO:tasks.workunit.client.0.smithi057.stdout:7/87: dread d6/fc [0,4194304] 0 2024-04-25T22:42:12.942 INFO:tasks.workunit.client.0.smithi057.stdout:9/134: mknod d3/c2e 0 2024-04-25T22:42:12.942 INFO:tasks.workunit.client.0.smithi057.stdout:3/102: rmdir d0/d4/d7 39 2024-04-25T22:42:12.943 INFO:tasks.workunit.client.0.smithi057.stdout:9/135: symlink d3/d26/l2f 0 2024-04-25T22:42:12.943 INFO:tasks.workunit.client.0.smithi057.stdout:1/92: dwrite d7/dd/f14 [0,4194304] 0 2024-04-25T22:42:12.944 INFO:tasks.workunit.client.0.smithi057.stdout:1/93: chown d7/dd/d16 1038953583 1 2024-04-25T22:42:12.945 INFO:tasks.workunit.client.0.smithi057.stdout:1/94: fsync f0 0 2024-04-25T22:42:12.948 INFO:tasks.workunit.client.0.smithi057.stdout:5/97: dwrite d2/f10 [0,4194304] 0 2024-04-25T22:42:12.949 INFO:tasks.workunit.client.0.smithi057.stdout:3/103: dread d0/fa [0,4194304] 0 2024-04-25T22:42:12.952 INFO:tasks.workunit.client.0.smithi057.stdout:1/95: dread f6 [0,4194304] 0 2024-04-25T22:42:12.952 INFO:tasks.workunit.client.0.smithi057.stdout:7/88: dwrite d6/fb [0,4194304] 0 2024-04-25T22:42:12.952 INFO:tasks.workunit.client.0.smithi057.stdout:3/104: creat d0/d4/f21 x:0 0 0 2024-04-25T22:42:12.953 INFO:tasks.workunit.client.0.smithi057.stdout:9/136: dwrite d3/f1e [0,4194304] 0 2024-04-25T22:42:12.958 INFO:tasks.workunit.client.0.smithi057.stdout:3/105: dread - d0/d4/d7/f1d zero size 2024-04-25T22:42:12.958 INFO:tasks.workunit.client.0.smithi057.stdout:9/137: symlink d3/l30 0 2024-04-25T22:42:12.959 INFO:tasks.workunit.client.0.smithi057.stdout:7/89: mkdir d6/d1b 0 2024-04-25T22:42:12.959 INFO:tasks.workunit.client.0.smithi057.stdout:9/138: unlink d3/l16 0 2024-04-25T22:42:12.959 INFO:tasks.workunit.client.0.smithi057.stdout:3/106: mkdir d0/d4/d7/d22 0 2024-04-25T22:42:12.959 INFO:tasks.workunit.client.0.smithi057.stdout:1/96: dread f0 [0,4194304] 0 2024-04-25T22:42:12.959 INFO:tasks.workunit.client.0.smithi057.stdout:9/139: mknod d3/c31 0 2024-04-25T22:42:12.959 INFO:tasks.workunit.client.0.smithi057.stdout:7/90: rename d6/f18 to d6/d1b/f1c 0 2024-04-25T22:42:12.959 INFO:tasks.workunit.client.0.smithi057.stdout:3/107: write d0/d4/fd [3213133,35520] 0 2024-04-25T22:42:12.959 INFO:tasks.workunit.client.0.smithi057.stdout:9/140: fdatasync d3/f20 0 2024-04-25T22:42:12.959 INFO:tasks.workunit.client.0.smithi057.stdout:5/98: dwrite d2/d6/f14 [0,4194304] 0 2024-04-25T22:42:12.960 INFO:tasks.workunit.client.0.smithi057.stdout:1/97: mknod d7/dd/d16/d18/c1c 0 2024-04-25T22:42:12.960 INFO:tasks.workunit.client.0.smithi057.stdout:3/108: stat d0/d11/f1c 0 2024-04-25T22:42:12.960 INFO:tasks.workunit.client.0.smithi057.stdout:9/141: creat d3/f32 x:0 0 0 2024-04-25T22:42:12.961 INFO:tasks.workunit.client.0.smithi057.stdout:9/142: unlink d3/d26/d28/c2c 0 2024-04-25T22:42:12.963 INFO:tasks.workunit.client.0.smithi057.stdout:9/143: read d3/f1b [372300,34189] 0 2024-04-25T22:42:12.965 INFO:tasks.workunit.client.0.smithi057.stdout:9/144: write d3/f13 [4761948,121758] 0 2024-04-25T22:42:12.966 INFO:tasks.workunit.client.0.smithi057.stdout:1/98: dread d7/dd/d16/f10 [0,4194304] 0 2024-04-25T22:42:12.967 INFO:tasks.workunit.client.0.smithi057.stdout:7/91: dwrite d6/fb [0,4194304] 0 2024-04-25T22:42:12.968 INFO:tasks.workunit.client.0.smithi057.stdout:1/99: creat d7/dd/d16/d18/f1d x:0 0 0 2024-04-25T22:42:12.969 INFO:tasks.workunit.client.0.smithi057.stdout:5/99: dwrite d2/d6/db/f17 [0,4194304] 0 2024-04-25T22:42:12.969 INFO:tasks.workunit.client.0.smithi057.stdout:7/92: mkdir d6/d1b/d1d 0 2024-04-25T22:42:12.969 INFO:tasks.workunit.client.0.smithi057.stdout:1/100: creat d7/dd/d16/f1e x:0 0 0 2024-04-25T22:42:12.970 INFO:tasks.workunit.client.0.smithi057.stdout:5/100: readlink d2/d6/db/l18 0 2024-04-25T22:42:12.970 INFO:tasks.workunit.client.0.smithi057.stdout:7/93: unlink d6/lf 0 2024-04-25T22:42:12.970 INFO:tasks.workunit.client.0.smithi057.stdout:5/101: fdatasync d2/f4 0 2024-04-25T22:42:12.971 INFO:tasks.workunit.client.0.smithi057.stdout:5/102: write d2/f4 [2718507,45790] 0 2024-04-25T22:42:12.971 INFO:tasks.workunit.client.0.smithi057.stdout:5/103: symlink d2/l1e 0 2024-04-25T22:42:12.973 INFO:tasks.workunit.client.0.smithi057.stdout:5/104: creat d2/d1c/f1f x:0 0 0 2024-04-25T22:42:12.975 INFO:tasks.workunit.client.0.smithi057.stdout:5/105: chown d2/d6/f7 27 1 2024-04-25T22:42:12.975 INFO:tasks.workunit.client.0.smithi057.stdout:1/101: dread d7/dd/d16/f10 [0,4194304] 0 2024-04-25T22:42:12.977 INFO:tasks.workunit.client.0.smithi057.stdout:5/106: mknod d2/d6/c20 0 2024-04-25T22:42:12.981 INFO:tasks.workunit.client.0.smithi057.stdout:7/94: dwrite d6/f16 [0,4194304] 0 2024-04-25T22:42:12.981 INFO:tasks.workunit.client.0.smithi057.stdout:9/145: dwrite d3/f20 [0,4194304] 0 2024-04-25T22:42:12.982 INFO:tasks.workunit.client.0.smithi057.stdout:3/109: dwrite d0/d11/f19 [4194304,4194304] 0 2024-04-25T22:42:12.982 INFO:tasks.workunit.client.0.smithi057.stdout:7/95: rmdir d6 39 2024-04-25T22:42:12.983 INFO:tasks.workunit.client.0.smithi057.stdout:9/146: symlink d3/l33 0 2024-04-25T22:42:12.984 INFO:tasks.workunit.client.0.smithi057.stdout:9/147: mkdir d3/d34 0 2024-04-25T22:42:12.984 INFO:tasks.workunit.client.0.smithi057.stdout:1/102: dwrite f0 [0,4194304] 0 2024-04-25T22:42:12.986 INFO:tasks.workunit.client.0.smithi057.stdout:7/96: symlink d6/d1b/d1d/l1e 0 2024-04-25T22:42:12.986 INFO:tasks.workunit.client.0.smithi057.stdout:1/103: rename d7/c17 to d7/dd/d16/c1f 0 2024-04-25T22:42:12.986 INFO:tasks.workunit.client.0.smithi057.stdout:1/104: readlink d7/dd/d16/d18/l1b 0 2024-04-25T22:42:12.991 INFO:tasks.workunit.client.0.smithi057.stdout:1/105: dread f0 [0,4194304] 0 2024-04-25T22:42:12.993 INFO:tasks.workunit.client.0.smithi057.stdout:9/148: dwrite d3/f9 [0,4194304] 0 2024-04-25T22:42:12.993 INFO:tasks.workunit.client.0.smithi057.stdout:7/97: dwrite d6/f15 [0,4194304] 0 2024-04-25T22:42:12.993 INFO:tasks.workunit.client.0.smithi057.stdout:9/149: dread d3/f1f [0,4194304] 0 2024-04-25T22:42:12.994 INFO:tasks.workunit.client.0.smithi057.stdout:7/98: mknod d6/d1b/d1d/c1f 0 2024-04-25T22:42:12.996 INFO:tasks.workunit.client.0.smithi057.stdout:9/150: rename d3/c31 to d3/d26/d28/d2d/c35 0 2024-04-25T22:42:12.996 INFO:tasks.workunit.client.0.smithi057.stdout:7/99: creat d6/f20 x:0 0 0 2024-04-25T22:42:12.996 INFO:tasks.workunit.client.0.smithi057.stdout:9/151: read - d3/d26/f27 zero size 2024-04-25T22:42:12.996 INFO:tasks.workunit.client.0.smithi057.stdout:7/100: fdatasync d6/fa 0 2024-04-25T22:42:12.996 INFO:tasks.workunit.client.0.smithi057.stdout:7/101: creat d6/f21 x:0 0 0 2024-04-25T22:42:12.997 INFO:tasks.workunit.client.0.smithi057.stdout:7/102: link d6/f20 d6/d1b/f22 0 2024-04-25T22:42:12.998 INFO:tasks.workunit.client.0.smithi057.stdout:7/103: unlink d6/c7 0 2024-04-25T22:42:12.999 INFO:tasks.workunit.client.0.smithi057.stdout:7/104: symlink d6/d1b/l23 0 2024-04-25T22:42:12.999 INFO:tasks.workunit.client.0.smithi057.stdout:7/105: chown d6/l13 1506567564 1 2024-04-25T22:42:13.001 INFO:tasks.workunit.client.0.smithi057.stdout:7/106: write d6/fc [2551880,62370] 0 2024-04-25T22:42:13.001 INFO:tasks.workunit.client.0.smithi057.stdout:7/107: stat d6/d1b 0 2024-04-25T22:42:13.002 INFO:tasks.workunit.client.0.smithi057.stdout:9/152: dwrite d3/f29 [0,4194304] 0 2024-04-25T22:42:13.002 INFO:tasks.workunit.client.0.smithi057.stdout:9/153: dread - d3/f24 zero size 2024-04-25T22:42:13.002 INFO:tasks.workunit.client.0.smithi057.stdout:7/108: symlink d6/d1b/d1d/l24 0 2024-04-25T22:42:13.003 INFO:tasks.workunit.client.0.smithi057.stdout:9/154: getdents d3/d34 0 2024-04-25T22:42:13.007 INFO:tasks.workunit.client.0.smithi057.stdout:8/90: sync 2024-04-25T22:42:13.007 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:13.003+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:13.008 INFO:tasks.workunit.client.0.smithi057.stdout:8/91: mkdir d4/d5/d21 0 2024-04-25T22:42:13.008 INFO:tasks.workunit.client.0.smithi057.stdout:1/106: truncate f6 918412 0 2024-04-25T22:42:13.008 INFO:tasks.workunit.client.0.smithi057.stdout:9/155: dwrite d3/ff [4194304,4194304] 0 2024-04-25T22:42:13.009 INFO:tasks.workunit.client.0.smithi057.stdout:5/107: dread d2/f12 [0,4194304] 0 2024-04-25T22:42:13.009 INFO:tasks.workunit.client.0.smithi057.stdout:9/156: chown d3/d26/d28 77153 1 2024-04-25T22:42:13.009 INFO:tasks.workunit.client.0.smithi057.stdout:5/108: mknod d2/c21 0 2024-04-25T22:42:13.010 INFO:tasks.workunit.client.0.smithi057.stdout:5/109: creat d2/d6/db/d1a/f22 x:0 0 0 2024-04-25T22:42:13.011 INFO:tasks.workunit.client.0.smithi057.stdout:5/110: dread - d2/d1c/f1f zero size 2024-04-25T22:42:13.011 INFO:tasks.workunit.client.0.smithi057.stdout:5/111: write d2/d1c/f1f [770082,38152] 0 2024-04-25T22:42:13.012 INFO:tasks.workunit.client.0.smithi057.stdout:8/92: dread d4/d5/f7 [0,4194304] 0 2024-04-25T22:42:13.012 INFO:tasks.workunit.client.0.smithi057.stdout:5/112: mknod d2/c23 0 2024-04-25T22:42:13.013 INFO:tasks.workunit.client.0.smithi057.stdout:8/93: mkdir d4/db/dd/df/d22 0 2024-04-25T22:42:13.013 INFO:tasks.workunit.client.0.smithi057.stdout:5/113: rmdir d2/d1c 39 2024-04-25T22:42:13.014 INFO:tasks.workunit.client.0.smithi057.stdout:8/94: creat d4/d5/f23 x:0 0 0 2024-04-25T22:42:13.014 INFO:tasks.workunit.client.0.smithi057.stdout:5/114: mkdir d2/d1c/d24 0 2024-04-25T22:42:13.014 INFO:tasks.workunit.client.0.smithi057.stdout:8/95: rmdir d4/db 39 2024-04-25T22:42:13.015 INFO:tasks.workunit.client.0.smithi057.stdout:8/96: mknod d4/db/c24 0 2024-04-25T22:42:13.016 INFO:tasks.workunit.client.0.smithi057.stdout:1/107: dwrite d7/dd/d16/d18/f1d [0,4194304] 0 2024-04-25T22:42:13.017 INFO:tasks.workunit.client.0.smithi057.stdout:8/97: link d4/db/dd/fe d4/f25 0 2024-04-25T22:42:13.017 INFO:tasks.workunit.client.0.smithi057.stdout:1/108: read d7/dd/d16/d18/f1d [3606868,46540] 0 2024-04-25T22:42:13.018 INFO:tasks.workunit.client.0.smithi057.stdout:8/98: write d4/db/dd/f18 [1079665,89564] 0 2024-04-25T22:42:13.019 INFO:tasks.workunit.client.0.smithi057.stdout:8/99: readlink d4/d5/d17/l1a 0 2024-04-25T22:42:13.021 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:42:13.022 INFO:tasks.workunit.client.0.smithi057.stdout:7/109: getdents d6 0 2024-04-25T22:42:13.022 INFO:tasks.workunit.client.0.smithi057.stdout:8/100: creat d4/d5/d17/d19/f26 x:0 0 0 2024-04-25T22:42:13.022 INFO:tasks.workunit.client.0.smithi057.stdout:9/157: write d3/d26/f2b [694820,103548] 0 2024-04-25T22:42:13.022 INFO:tasks.workunit.client.0.smithi057.stdout:7/110: fdatasync d6/f19 0 2024-04-25T22:42:13.022 INFO:tasks.workunit.client.0.smithi057.stdout:8/101: fdatasync d4/d5/f7 0 2024-04-25T22:42:13.023 INFO:tasks.workunit.client.0.smithi057.stdout:5/115: dwrite d2/d6/db/d1a/f22 [0,4194304] 0 2024-04-25T22:42:13.023 INFO:tasks.workunit.client.0.smithi057.stdout:9/158: write d3/f9 [3365339,15625] 0 2024-04-25T22:42:13.023 INFO:tasks.workunit.client.0.smithi057.stdout:7/111: symlink d6/l25 0 2024-04-25T22:42:13.023 INFO:tasks.workunit.client.0.smithi057.stdout:5/116: stat d2/c1b 0 2024-04-25T22:42:13.024 INFO:tasks.workunit.client.0.smithi057.stdout:1/109: dread d7/dd/d16/d18/f1d [0,4194304] 0 2024-04-25T22:42:13.024 INFO:tasks.workunit.client.0.smithi057.stdout:9/159: fdatasync d3/f23 0 2024-04-25T22:42:13.026 INFO:tasks.workunit.client.0.smithi057.stdout:7/112: rename d6/d1b/f1c to d6/f26 0 2024-04-25T22:42:13.026 INFO:tasks.workunit.client.0.smithi057.stdout:1/110: rename d7/dd/d16/c12 to d7/dd/c20 0 2024-04-25T22:42:13.028 INFO:tasks.workunit.client.0.smithi057.stdout:1/111: truncate d7/dd/d16/f1e 537684 0 2024-04-25T22:42:13.028 INFO:tasks.workunit.client.0.smithi057.stdout:7/113: write d6/f14 [74561,41134] 0 2024-04-25T22:42:13.029 INFO:tasks.workunit.client.0.smithi057.stdout:7/114: write d6/f26 [411785,100988] 0 2024-04-25T22:42:13.029 INFO:tasks.workunit.client.0.smithi057.stdout:1/112: creat d7/dd/d16/d18/f21 x:0 0 0 2024-04-25T22:42:13.029 INFO:tasks.workunit.client.0.smithi057.stdout:9/160: dread d3/f9 [0,4194304] 0 2024-04-25T22:42:13.032 INFO:tasks.workunit.client.0.smithi057.stdout:5/117: dwrite d2/d6/f14 [4194304,4194304] 0 2024-04-25T22:42:13.033 INFO:tasks.workunit.client.0.smithi057.stdout:1/113: write f6 [510167,30327] 0 2024-04-25T22:42:13.035 INFO:tasks.workunit.client.0.smithi057.stdout:9/161: dread d3/ff [4194304,4194304] 0 2024-04-25T22:42:13.035 INFO:tasks.workunit.client.0.smithi057.stdout:1/114: dread f6 [0,4194304] 0 2024-04-25T22:42:13.036 INFO:tasks.workunit.client.0.smithi057.stdout:1/115: chown d7/dd/f14 0 1 2024-04-25T22:42:13.036 INFO:tasks.workunit.client.0.smithi057.stdout:7/115: dwrite f1 [4194304,4194304] 0 2024-04-25T22:42:13.037 INFO:tasks.workunit.client.0.smithi057.stdout:1/116: creat d7/d9/f22 x:0 0 0 2024-04-25T22:42:13.042 INFO:tasks.workunit.client.0.smithi057.stdout:9/162: dwrite d3/f2a [0,4194304] 0 2024-04-25T22:42:13.042 INFO:tasks.workunit.client.0.smithi057.stdout:9/163: chown d3/c1d 146 1 2024-04-25T22:42:13.042 INFO:tasks.workunit.client.0.smithi057.stdout:7/116: dwrite d6/f21 [0,4194304] 0 2024-04-25T22:42:13.043 INFO:tasks.workunit.client.0.smithi057.stdout:1/117: truncate d7/dd/f14 3655807 0 2024-04-25T22:42:13.043 INFO:tasks.workunit.client.0.smithi057.stdout:7/117: rename f3 to d6/f27 0 2024-04-25T22:42:13.044 INFO:tasks.workunit.client.0.smithi057.stdout:9/164: symlink d3/l36 0 2024-04-25T22:42:13.044 INFO:tasks.workunit.client.0.smithi057.stdout:1/118: creat d7/dd/d16/d18/f23 x:0 0 0 2024-04-25T22:42:13.044 INFO:tasks.workunit.client.0.smithi057.stdout:7/118: chown d6/ce 0 1 2024-04-25T22:42:13.045 INFO:tasks.workunit.client.0.smithi057.stdout:1/119: rename d7/d9 to d7/dd/d16/d24 0 2024-04-25T22:42:13.045 INFO:tasks.workunit.client.0.smithi057.stdout:9/165: unlink d3/d26/d28/d2d/c35 0 2024-04-25T22:42:13.045 INFO:tasks.workunit.client.0.smithi057.stdout:1/120: dread - d7/dd/d16/d18/f23 zero size 2024-04-25T22:42:13.045 INFO:tasks.workunit.client.0.smithi057.stdout:9/166: unlink d3/f1b 0 2024-04-25T22:42:13.047 INFO:tasks.workunit.client.0.smithi057.stdout:9/167: rename d3/d26/f27 to d3/d26/d28/f37 0 2024-04-25T22:42:13.047 INFO:tasks.workunit.client.0.smithi057.stdout:1/121: link d7/dd/d16/d18/f1d d7/dd/d16/d24/f25 0 2024-04-25T22:42:13.048 INFO:tasks.workunit.client.0.smithi057.stdout:9/168: symlink d3/d34/l38 0 2024-04-25T22:42:13.050 INFO:tasks.workunit.client.0.smithi057.stdout:1/122: mkdir d7/dd/d26 0 2024-04-25T22:42:13.051 INFO:tasks.workunit.client.0.smithi057.stdout:7/119: dwrite d6/f14 [0,4194304] 0 2024-04-25T22:42:13.051 INFO:tasks.workunit.client.0.smithi057.stdout:9/169: write d3/f9 [3401307,121202] 0 2024-04-25T22:42:13.051 INFO:tasks.workunit.client.0.smithi057.stdout:1/123: mknod d7/dd/c27 0 2024-04-25T22:42:13.051 INFO:tasks.workunit.client.0.smithi057.stdout:1/124: chown d7/dd/d26 766 1 2024-04-25T22:42:13.051 INFO:tasks.workunit.client.0.smithi057.stdout:7/120: write d6/f1a [440730,74756] 0 2024-04-25T22:42:13.051 INFO:tasks.workunit.client.0.smithi057.stdout:9/170: truncate d3/ff 8989429 0 2024-04-25T22:42:13.052 INFO:tasks.workunit.client.0.smithi057.stdout:7/121: write d6/f19 [3118198,125597] 0 2024-04-25T22:42:13.052 INFO:tasks.workunit.client.0.smithi057.stdout:9/171: write d3/f1e [2172810,65433] 0 2024-04-25T22:42:13.053 INFO:tasks.workunit.client.0.smithi057.stdout:7/122: mkdir d6/d28 0 2024-04-25T22:42:13.053 INFO:tasks.workunit.client.0.smithi057.stdout:9/172: mkdir d3/d26/d28/d39 0 2024-04-25T22:42:13.054 INFO:tasks.workunit.client.0.smithi057.stdout:7/123: rmdir d6/d1b/d1d 39 2024-04-25T22:42:13.056 INFO:tasks.workunit.client.0.smithi057.stdout:9/173: creat d3/d26/d28/d39/f3a x:0 0 0 2024-04-25T22:42:13.056 INFO:tasks.workunit.client.0.smithi057.stdout:7/124: mknod d6/d1b/c29 0 2024-04-25T22:42:13.056 INFO:tasks.workunit.client.0.smithi057.stdout:9/174: creat d3/d26/d28/f3b x:0 0 0 2024-04-25T22:42:13.056 INFO:tasks.workunit.client.0.smithi057.stdout:1/125: dread d7/dd/d16/f10 [0,4194304] 0 2024-04-25T22:42:13.056 INFO:tasks.workunit.client.0.smithi057.stdout:7/125: write d6/f27 [3644366,22892] 0 2024-04-25T22:42:13.057 INFO:tasks.workunit.client.0.smithi057.stdout:1/126: creat d7/dd/f28 x:0 0 0 2024-04-25T22:42:13.057 INFO:tasks.workunit.client.0.smithi057.stdout:9/175: rename d3/l22 to d3/d26/d28/d2d/l3c 0 2024-04-25T22:42:13.057 INFO:tasks.workunit.client.0.smithi057.stdout:9/176: dread - d3/d26/d28/f3b zero size 2024-04-25T22:42:13.058 INFO:tasks.workunit.client.0.smithi057.stdout:7/126: rename d6/fc to d6/d1b/d1d/f2a 0 2024-04-25T22:42:13.059 INFO:tasks.workunit.client.0.smithi057.stdout:7/127: symlink d6/d28/l2b 0 2024-04-25T22:42:13.064 INFO:tasks.workunit.client.0.smithi057.stdout:1/127: dwrite d7/dd/d16/f1e [0,4194304] 0 2024-04-25T22:42:13.064 INFO:tasks.workunit.client.0.smithi057.stdout:7/128: dread f1 [4194304,4194304] 0 2024-04-25T22:42:13.066 INFO:tasks.workunit.client.0.smithi057.stdout:1/128: readlink d7/dd/d16/d18/l1b 0 2024-04-25T22:42:13.066 INFO:tasks.workunit.client.0.smithi057.stdout:7/129: chown d6/f27 0 1 2024-04-25T22:42:13.066 INFO:tasks.workunit.client.0.smithi057.stdout:9/177: dwrite d3/f20 [4194304,4194304] 0 2024-04-25T22:42:13.066 INFO:tasks.workunit.client.0.smithi057.stdout:7/130: creat d6/d28/f2c x:0 0 0 2024-04-25T22:42:13.067 INFO:tasks.workunit.client.0.smithi057.stdout:5/118: dread d2/f4 [0,4194304] 0 2024-04-25T22:42:13.067 INFO:tasks.workunit.client.0.smithi057.stdout:9/178: link d3/f14 d3/d26/d28/d2d/f3d 0 2024-04-25T22:42:13.068 INFO:tasks.workunit.client.0.smithi057.stdout:5/119: fsync d2/d6/db/f16 0 2024-04-25T22:42:13.068 INFO:tasks.workunit.client.0.smithi057.stdout:9/179: mkdir d3/d26/d28/d2d/d3e 0 2024-04-25T22:42:13.070 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:13.070 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:13.070 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:13.070 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:13.070 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.070 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:13.070 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:13.071 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 118.473231908, 2024-04-25T22:42:13.071 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:13.071 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:13.071 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:13.071 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:13.071 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:13.071 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.071 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:13.071 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:13.071 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.071 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.071 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.071 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:13.071 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:13.072 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.072 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.072 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.072 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:13.072 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:13.072 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:13.072 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.072 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.072 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:13.072 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:13.072 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:13.072 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.072 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.072 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:13.072 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:13.072 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:13.073 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.073 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.073 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:13.073 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:13.073 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:13.073 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.073 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.073 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.073 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:13.073 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:13.073 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.073 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.073 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:13.073 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:13.073 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:13.073 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.073 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.074 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.074 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:13.074 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:13.074 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.074 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.074 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:13.074 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:13.074 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:13.074 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.074 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.074 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:13.074 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:13.074 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:13.074 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.075 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.075 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:13.075 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:13.075 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:13.075 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.075 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.075 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:13.075 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:13.075 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:13.075 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.075 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.075 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:13.075 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:13.075 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:13.075 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.076 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.076 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:13.076 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:13.076 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:13.076 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.076 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.076 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.076 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.076 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.076 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:13.076 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:13.076 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 118.473094652, 2024-04-25T22:42:13.076 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:13.076 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:13.077 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:13.077 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:13.077 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:13.077 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.077 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:13.077 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:13.077 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.077 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.077 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.077 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:13.077 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:13.077 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.077 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.077 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.077 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:13.077 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:13.078 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:13.078 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.078 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.078 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:13.078 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:13.078 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:13.078 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.078 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.078 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:13.078 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:13.078 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:13.078 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.078 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.078 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:13.078 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:13.079 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:13.079 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.079 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.079 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.079 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:13.079 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:13.079 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.079 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.079 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:13.079 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:13.079 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:13.079 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.079 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.080 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.080 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:13.080 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:13.080 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.080 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.080 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:13.080 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:13.080 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:13.080 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.080 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.080 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:13.080 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:13.080 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:13.080 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.080 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.080 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:13.081 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:13.081 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:13.081 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.081 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.081 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:13.081 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:13.081 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:13.081 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.081 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.081 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:13.081 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:13.081 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:13.081 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.081 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.081 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:13.081 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:13.081 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:13.082 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.082 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.082 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.082 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.082 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.082 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:13.082 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:13.082 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 118.472903274, 2024-04-25T22:42:13.082 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:42:13.082 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:13.082 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:13.082 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:13.082 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:13.082 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.083 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:13.083 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:13.083 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.083 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.083 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.083 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:13.083 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:13.083 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.083 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.083 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.083 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:13.083 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:42:13.083 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:42:13.083 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.083 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.084 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:13.084 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:42:13.084 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:42:13.084 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.084 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.084 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:13.084 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:42:13.084 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:42:13.084 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.084 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.084 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:13.084 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:42:13.084 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:42:13.084 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.084 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.085 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.085 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:42:13.085 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:42:13.085 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.085 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.085 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:13.085 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:42:13.085 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:42:13.085 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.085 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.085 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.085 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:42:13.085 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:42:13.085 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.085 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.085 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:13.086 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:42:13.086 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:42:13.086 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.086 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.086 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:13.086 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:42:13.086 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:42:13.086 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.086 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.086 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:13.086 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:42:13.086 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:42:13.086 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.086 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.086 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:13.087 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:42:13.087 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:42:13.087 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.087 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.087 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:13.087 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:42:13.087 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:42:13.087 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.087 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.087 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:13.087 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:42:13.087 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:42:13.087 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.088 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.088 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.088 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.088 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.088 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:13.088 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:13.088 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 118.472834484, 2024-04-25T22:42:13.088 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:13.088 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:13.088 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:13.088 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:13.088 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:13.088 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.088 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:13.088 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:13.089 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.089 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.089 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.089 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:13.089 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:13.089 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.089 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.089 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.089 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:13.089 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:13.089 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:13.089 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.089 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.089 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:13.089 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:13.089 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:13.090 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.090 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.090 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:13.090 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:13.090 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:13.090 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.090 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.090 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:13.090 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:13.090 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:13.090 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.090 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.090 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.090 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:13.090 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:13.091 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.091 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.091 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:13.091 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:13.091 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:13.091 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.091 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.091 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.091 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:13.091 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:13.091 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.091 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.091 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:13.092 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:13.092 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:13.092 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.092 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.092 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:13.092 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:13.092 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:13.092 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.092 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.092 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:13.092 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:13.092 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:13.092 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.092 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.092 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:13.092 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:13.093 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:13.093 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.093 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.093 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:13.093 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:13.093 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:13.093 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.093 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.093 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:13.093 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:13.093 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:13.093 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.093 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.093 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.093 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.094 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.094 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:13.094 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:13.094 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 118.47276539800001, 2024-04-25T22:42:13.094 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:42:13.094 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:13.094 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:13.094 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:13.094 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:13.094 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.094 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:13.094 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:13.094 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.094 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.095 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.095 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:13.095 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:13.095 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.095 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.095 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.095 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:13.095 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:42:13.095 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:42:13.095 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.095 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.095 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:13.095 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:42:13.095 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:42:13.095 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.096 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.096 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:13.096 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:42:13.096 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:42:13.096 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.096 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.096 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:13.096 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:42:13.096 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:42:13.096 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.096 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.096 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.096 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:42:13.097 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:42:13.097 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.097 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.097 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:13.097 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:42:13.097 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:42:13.097 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.097 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.097 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.097 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:42:13.097 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:42:13.097 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.097 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.098 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:13.098 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:42:13.098 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:42:13.098 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.098 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.098 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:13.098 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:42:13.098 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:42:13.098 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.098 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.098 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:13.098 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:42:13.098 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:42:13.098 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.099 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.099 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:13.099 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:42:13.099 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:42:13.099 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.099 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.099 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:13.099 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:42:13.099 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:42:13.099 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.099 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.099 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:13.099 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:42:13.099 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:42:13.099 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.100 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.100 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.100 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.100 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.100 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:13.100 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:13.100 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 118.47266928499999, 2024-04-25T22:42:13.100 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:13.100 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:13.100 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:13.100 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:13.100 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:13.100 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.100 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:13.100 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:13.101 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.101 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.101 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.101 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:13.101 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:13.101 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.101 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.101 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.101 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:13.101 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:13.101 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:13.101 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.101 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.101 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:13.101 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:13.102 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:13.102 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.102 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.102 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:13.102 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:13.102 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:13.102 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.102 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.102 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:13.102 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:13.102 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:13.102 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.102 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.102 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.103 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:13.103 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:13.103 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.103 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.103 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:13.103 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:13.103 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:13.103 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.103 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.103 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.103 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:13.103 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:13.103 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.103 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.103 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:13.103 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:13.104 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:13.104 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.104 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.104 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:13.104 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:13.104 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:13.104 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.104 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.104 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.104 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.104 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.104 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:13.104 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:13.104 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 118.472603623, 2024-04-25T22:42:13.104 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:13.105 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:13.105 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:13.105 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:13.105 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:13.105 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.105 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:13.105 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:13.105 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.105 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.105 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.105 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:13.105 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:13.105 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.105 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.105 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.105 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:13.106 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:13.106 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:13.106 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.106 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.106 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:13.106 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:13.106 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:13.106 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.106 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.106 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:13.106 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:13.106 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:13.106 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.106 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.106 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:13.107 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:13.107 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:13.107 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.107 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.107 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.107 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:13.107 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:13.107 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.107 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.107 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:13.107 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:13.107 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:13.107 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.107 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.107 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.108 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:13.108 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:13.108 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.108 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.108 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:13.108 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:13.108 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:13.108 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.108 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.108 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:13.108 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:13.108 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:13.108 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.108 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.108 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.109 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.109 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.109 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:10678 4.2c e63/17 4:36971e45:::100000030bd.00000001:head v 63'185, mlcod=63'183)", 2024-04-25T22:42:13.109 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.496727+0000", 2024-04-25T22:42:13.109 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.572118762, 2024-04-25T22:42:13.109 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034699661, 2024-04-25T22:42:13.109 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:13.109 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:13.109 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:13.109 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:13.109 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.109 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:13.109 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.496727+0000", 2024-04-25T22:42:13.109 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.109 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.109 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.110 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:13.110 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.496727+0000", 2024-04-25T22:42:13.110 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.110 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.110 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.110 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:13.110 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.496730+0000", 2024-04-25T22:42:13.110 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3e-06 2024-04-25T22:42:13.110 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.110 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.110 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:13.110 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.508896+0000", 2024-04-25T22:42:13.110 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012166692999999999 2024-04-25T22:42:13.110 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.110 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.111 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:13.111 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.508922+0000", 2024-04-25T22:42:13.111 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5927000000000001e-05 2024-04-25T22:42:13.111 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.111 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.111 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:13.111 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.508936+0000", 2024-04-25T22:42:13.111 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:42:13.111 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.111 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.111 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.111 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.509067+0000", 2024-04-25T22:42:13.111 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000130257 2024-04-25T22:42:13.111 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.111 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.111 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:13.112 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.509121+0000", 2024-04-25T22:42:13.112 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3936e-05 2024-04-25T22:42:13.112 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.112 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.112 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:13.112 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.531364+0000", 2024-04-25T22:42:13.112 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022243242 2024-04-25T22:42:13.112 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.112 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.112 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:13.112 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.531427+0000", 2024-04-25T22:42:13.112 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3243000000000004e-05 2024-04-25T22:42:13.112 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.112 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.112 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.113 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.113 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.113 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10700 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:13.113 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:13.113 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.54973640599999996, 2024-04-25T22:42:13.113 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066789482999999997, 2024-04-25T22:42:13.113 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:13.113 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:13.113 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:13.113 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:13.113 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:13.113 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:13.113 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10700 2024-04-25T22:42:13.113 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.113 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:13.114 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.114 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:13.114 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:13.114 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.114 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.114 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.114 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:13.114 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:13.114 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.114 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.114 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.114 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:13.114 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519112+0000", 2024-04-25T22:42:13.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1399999999999998e-06 2024-04-25T22:42:13.115 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.115 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:13.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527187+0000", 2024-04-25T22:42:13.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080748899999999995 2024-04-25T22:42:13.115 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.115 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:13.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527232+0000", 2024-04-25T22:42:13.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4895999999999998e-05 2024-04-25T22:42:13.115 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.115 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:13.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527259+0000", 2024-04-25T22:42:13.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7331999999999999e-05 2024-04-25T22:42:13.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529418+0000", 2024-04-25T22:42:13.116 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002158765 2024-04-25T22:42:13.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:13.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529572+0000", 2024-04-25T22:42:13.116 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015438499999999999 2024-04-25T22:42:13.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:13.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529762+0000", 2024-04-25T22:42:13.117 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018998100000000001 2024-04-25T22:42:13.117 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:13.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.548359+0000", 2024-04-25T22:42:13.117 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018596444 2024-04-25T22:42:13.117 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:13.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585801+0000", 2024-04-25T22:42:13.117 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.037442469999999999 2024-04-25T22:42:13.117 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:13.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585847+0000", 2024-04-25T22:42:13.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5565000000000002e-05 2024-04-25T22:42:13.118 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.118 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.118 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:13.118 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585899+0000", 2024-04-25T22:42:13.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2614999999999997e-05 2024-04-25T22:42:13.118 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.118 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.118 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.118 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.118 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.118 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10714 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:13.118 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:13.118 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.51605544299999995, 2024-04-25T22:42:13.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.048080623000000003, 2024-04-25T22:42:13.119 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:13.119 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:13.119 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:13.119 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:13.119 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:13.119 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:13.119 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10714 2024-04-25T22:42:13.119 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.119 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:13.119 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.119 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:13.119 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:13.119 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.119 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.119 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.119 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:13.120 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:13.120 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.120 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.120 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.120 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:13.120 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552792+0000", 2024-04-25T22:42:13.120 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:42:13.120 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.120 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.120 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:13.120 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559915+0000", 2024-04-25T22:42:13.120 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071231690000000004 2024-04-25T22:42:13.120 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.120 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.120 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:13.120 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559932+0000", 2024-04-25T22:42:13.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7169000000000001e-05 2024-04-25T22:42:13.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:13.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559942+0000", 2024-04-25T22:42:13.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0261999999999999e-05 2024-04-25T22:42:13.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560018+0000", 2024-04-25T22:42:13.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5358000000000006e-05 2024-04-25T22:42:13.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:13.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560118+0000", 2024-04-25T22:42:13.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000100911 2024-04-25T22:42:13.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:13.122 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560281+0000", 2024-04-25T22:42:13.122 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016288500000000001 2024-04-25T22:42:13.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:13.122 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.579740+0000", 2024-04-25T22:42:13.122 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019458598000000001 2024-04-25T22:42:13.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:13.122 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600484+0000", 2024-04-25T22:42:13.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020744483000000001 2024-04-25T22:42:13.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.123 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:13.123 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600664+0000", 2024-04-25T22:42:13.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017953899999999999 2024-04-25T22:42:13.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.123 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:13.123 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600871+0000", 2024-04-25T22:42:13.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020737199999999999 2024-04-25T22:42:13.123 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.123 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.123 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.124 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10747 4.1e 4:7b0f9ddb:::100000030ee.00000000:head [write 0~4194304 [2@504501]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:13.124 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.623419+0000", 2024-04-25T22:42:13.124 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.44542682700000003, 2024-04-25T22:42:13.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.032309891, 2024-04-25T22:42:13.124 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:13.124 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:13.124 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:13.124 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:13.124 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:13.124 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:13.124 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10747 2024-04-25T22:42:13.124 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.124 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:13.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:13.125 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.623419+0000", 2024-04-25T22:42:13.125 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.125 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.125 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.125 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:13.125 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.623419+0000", 2024-04-25T22:42:13.125 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.125 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.125 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.125 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:13.125 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.623421+0000", 2024-04-25T22:42:13.125 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.818e-06 2024-04-25T22:42:13.125 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.125 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.125 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:13.126 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.630043+0000", 2024-04-25T22:42:13.126 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066221179999999998 2024-04-25T22:42:13.126 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.126 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:13.126 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.630066+0000", 2024-04-25T22:42:13.126 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2833e-05 2024-04-25T22:42:13.126 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.126 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:13.126 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.630080+0000", 2024-04-25T22:42:13.126 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3987e-05 2024-04-25T22:42:13.126 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.126 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.630163+0000", 2024-04-25T22:42:13.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2640999999999997e-05 2024-04-25T22:42:13.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:13.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.630237+0000", 2024-04-25T22:42:13.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4281000000000003e-05 2024-04-25T22:42:13.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:13.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.630361+0000", 2024-04-25T22:42:13.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000123578 2024-04-25T22:42:13.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:13.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.646905+0000", 2024-04-25T22:42:13.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016544432000000001 2024-04-25T22:42:13.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:13.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.655662+0000", 2024-04-25T22:42:13.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0087570029999999993 2024-04-25T22:42:13.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:13.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.655703+0000", 2024-04-25T22:42:13.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1186000000000002e-05 2024-04-25T22:42:13.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:13.129 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.655729+0000", 2024-04-25T22:42:13.129 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6013999999999999e-05 2024-04-25T22:42:13.129 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.129 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.129 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.129 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10813 4.17 4:e8010137:::100000030b0.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:13.129 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:13.129 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.32110643700000002, 2024-04-25T22:42:13.129 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.047503799999999999, 2024-04-25T22:42:13.129 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:13.129 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:13.129 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:13.129 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:13.129 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:13.130 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:13.130 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10813 2024-04-25T22:42:13.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.130 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:13.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:13.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:13.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:13.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:13.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.131 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:13.131 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747741+0000", 2024-04-25T22:42:13.131 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1119999999999999e-06 2024-04-25T22:42:13.131 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.131 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:13.131 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752366+0000", 2024-04-25T22:42:13.131 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046253240000000001 2024-04-25T22:42:13.131 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.131 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:13.131 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752382+0000", 2024-04-25T22:42:13.131 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5639999999999999e-05 2024-04-25T22:42:13.131 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:13.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752393+0000", 2024-04-25T22:42:13.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1626e-05 2024-04-25T22:42:13.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752459+0000", 2024-04-25T22:42:13.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5309999999999996e-05 2024-04-25T22:42:13.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:13.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752529+0000", 2024-04-25T22:42:13.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0543000000000005e-05 2024-04-25T22:42:13.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:13.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752637+0000", 2024-04-25T22:42:13.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010788799999999999 2024-04-25T22:42:13.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:13.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760295+0000", 2024-04-25T22:42:13.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076583290000000002 2024-04-25T22:42:13.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:13.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.794990+0000", 2024-04-25T22:42:13.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034694317000000002 2024-04-25T22:42:13.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:13.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795097+0000", 2024-04-25T22:42:13.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010768999999999999 2024-04-25T22:42:13.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:13.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795243+0000", 2024-04-25T22:42:13.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000146021 2024-04-25T22:42:13.134 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.134 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.134 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.135 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10816 4.17 4:e8010137:::100000030b0.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:13.135 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:13.135 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.31577697700000001, 2024-04-25T22:42:13.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042406530999999997, 2024-04-25T22:42:13.135 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:13.135 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:13.135 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:13.135 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:13.135 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:13.135 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:13.135 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10816 2024-04-25T22:42:13.135 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.135 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:13.135 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.135 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:13.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:13.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.136 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:13.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:13.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.136 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:13.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753070+0000", 2024-04-25T22:42:13.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9800000000000002e-07 2024-04-25T22:42:13.136 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.136 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.136 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:13.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753288+0000", 2024-04-25T22:42:13.137 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000217789 2024-04-25T22:42:13.137 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.137 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.137 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:13.137 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753301+0000", 2024-04-25T22:42:13.137 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2764e-05 2024-04-25T22:42:13.137 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.137 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.137 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:13.137 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753310+0000", 2024-04-25T22:42:13.137 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:42:13.137 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.137 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.137 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.137 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758240+0000", 2024-04-25T22:42:13.138 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049304910000000004 2024-04-25T22:42:13.138 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.138 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.138 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:13.138 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758374+0000", 2024-04-25T22:42:13.138 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000133428 2024-04-25T22:42:13.138 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.138 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.138 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:13.138 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758576+0000", 2024-04-25T22:42:13.138 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020177899999999999 2024-04-25T22:42:13.138 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.138 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.139 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:13.139 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760626+0000", 2024-04-25T22:42:13.139 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0020501489999999998 2024-04-25T22:42:13.139 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.139 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.139 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:13.139 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795329+0000", 2024-04-25T22:42:13.139 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034703352999999999 2024-04-25T22:42:13.139 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.139 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.139 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:13.139 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795414+0000", 2024-04-25T22:42:13.139 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5292999999999998e-05 2024-04-25T22:42:13.139 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.139 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.139 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:13.140 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795476+0000", 2024-04-25T22:42:13.140 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1206999999999999e-05 2024-04-25T22:42:13.140 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.140 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.140 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.140 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.140 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.140 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10865 4.26 4:6414d19f:::10000003137.00000000:head [write 0~3801088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:13.140 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.833503+0000", 2024-04-25T22:42:13.140 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.23534269699999999, 2024-04-25T22:42:13.140 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031509151999999999, 2024-04-25T22:42:13.140 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:13.140 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:13.140 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:13.140 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:13.141 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:13.141 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:13.141 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10865 2024-04-25T22:42:13.141 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.141 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:13.141 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.141 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:13.141 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.833503+0000", 2024-04-25T22:42:13.141 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.141 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.141 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.141 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:13.141 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.833503+0000", 2024-04-25T22:42:13.141 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.141 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.142 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.142 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:13.142 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.833505+0000", 2024-04-25T22:42:13.142 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0329999999999998e-06 2024-04-25T22:42:13.142 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.142 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.142 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:13.142 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.840364+0000", 2024-04-25T22:42:13.142 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0068586699999999999 2024-04-25T22:42:13.142 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.142 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.142 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:13.142 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.840386+0000", 2024-04-25T22:42:13.142 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2161999999999999e-05 2024-04-25T22:42:13.143 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.143 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.143 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:13.143 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.840399+0000", 2024-04-25T22:42:13.143 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2465e-05 2024-04-25T22:42:13.143 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.143 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.143 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.143 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.840525+0000", 2024-04-25T22:42:13.143 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012587199999999999 2024-04-25T22:42:13.143 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.143 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.143 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:13.143 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.840658+0000", 2024-04-25T22:42:13.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013379099999999999 2024-04-25T22:42:13.144 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.144 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.144 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:13.144 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.840817+0000", 2024-04-25T22:42:13.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015905699999999999 2024-04-25T22:42:13.144 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.144 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.144 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:13.144 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.851197+0000", 2024-04-25T22:42:13.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010379233 2024-04-25T22:42:13.144 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.144 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.144 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:13.144 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.864827+0000", 2024-04-25T22:42:13.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013629888 2024-04-25T22:42:13.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:13.145 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.864973+0000", 2024-04-25T22:42:13.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014591800000000001 2024-04-25T22:42:13.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:13.145 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.865013+0000", 2024-04-25T22:42:13.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0062999999999999e-05 2024-04-25T22:42:13.145 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.145 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.145 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.146 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10886 4.29 4:94939cb2:::10000003139.00000000:head [write 0~4194304 [2@3068692]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:13.146 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.893646+0000", 2024-04-25T22:42:13.146 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.17519974399999999, 2024-04-25T22:42:13.146 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.039527421, 2024-04-25T22:42:13.146 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:13.146 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:13.146 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:13.146 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:13.146 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:13.146 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:13.146 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10886 2024-04-25T22:42:13.146 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.146 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:13.146 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.147 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:13.147 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.893646+0000", 2024-04-25T22:42:13.147 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.147 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.147 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.147 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:13.147 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.893646+0000", 2024-04-25T22:42:13.147 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.147 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.147 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.147 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:13.147 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.893649+0000", 2024-04-25T22:42:13.147 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2979999999999999e-06 2024-04-25T22:42:13.147 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.147 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:13.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.897975+0000", 2024-04-25T22:42:13.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0043259010000000001 2024-04-25T22:42:13.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:13.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.897997+0000", 2024-04-25T22:42:13.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2541e-05 2024-04-25T22:42:13.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:13.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.898010+0000", 2024-04-25T22:42:13.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2519e-05 2024-04-25T22:42:13.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.149 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.898099+0000", 2024-04-25T22:42:13.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9510000000000002e-05 2024-04-25T22:42:13.149 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.149 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:13.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.898207+0000", 2024-04-25T22:42:13.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000107886 2024-04-25T22:42:13.149 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.149 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:13.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.898377+0000", 2024-04-25T22:42:13.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016960400000000001 2024-04-25T22:42:13.150 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.150 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.150 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:13.150 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.905921+0000", 2024-04-25T22:42:13.150 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0075444509999999998 2024-04-25T22:42:13.150 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.150 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.150 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:13.150 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.933046+0000", 2024-04-25T22:42:13.150 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027124662000000001 2024-04-25T22:42:13.150 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.150 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.150 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:13.150 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.933116+0000", 2024-04-25T22:42:13.151 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0467000000000001e-05 2024-04-25T22:42:13.151 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.151 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.151 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:13.151 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.933174+0000", 2024-04-25T22:42:13.151 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7581999999999999e-05 2024-04-25T22:42:13.151 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.151 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.151 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.151 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.151 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.151 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10914 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:13.151 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:13.152 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.114976595, 2024-04-25T22:42:13.152 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044452984000000001, 2024-04-25T22:42:13.152 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:13.152 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:13.152 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:13.152 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:13.152 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:13.152 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:13.152 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10914 2024-04-25T22:42:13.152 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.152 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:13.152 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.152 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:13.152 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:13.152 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.152 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.153 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.153 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:13.153 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:13.153 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.153 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.153 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.153 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:13.153 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953871+0000", 2024-04-25T22:42:13.153 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1829999999999999e-06 2024-04-25T22:42:13.153 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.153 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.153 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:13.153 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.962992+0000", 2024-04-25T22:42:13.153 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091217409999999992 2024-04-25T22:42:13.153 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.153 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:13.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963027+0000", 2024-04-25T22:42:13.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4229e-05 2024-04-25T22:42:13.154 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:13.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963042+0000", 2024-04-25T22:42:13.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5152e-05 2024-04-25T22:42:13.154 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963143+0000", 2024-04-25T22:42:13.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101171 2024-04-25T22:42:13.154 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.155 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:13.155 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963269+0000", 2024-04-25T22:42:13.155 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012623499999999999 2024-04-25T22:42:13.155 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.155 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.155 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:13.155 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963453+0000", 2024-04-25T22:42:13.155 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018357900000000001 2024-04-25T22:42:13.155 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.155 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.155 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:13.155 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998133+0000", 2024-04-25T22:42:13.155 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034679789000000003 2024-04-25T22:42:13.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:13.156 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998220+0000", 2024-04-25T22:42:13.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7153999999999999e-05 2024-04-25T22:42:13.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:13.156 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998278+0000", 2024-04-25T22:42:13.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8035000000000003e-05 2024-04-25T22:42:13.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:13.156 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998323+0000", 2024-04-25T22:42:13.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4715999999999997e-05 2024-04-25T22:42:13.156 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.157 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.157 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.157 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.157 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.157 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10915 4.3e 4:7c16b777:::1000000314d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:13.157 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.963082+0000", 2024-04-25T22:42:13.157 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.10576403600000001, 2024-04-25T22:42:13.157 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035366902999999998, 2024-04-25T22:42:13.157 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:13.157 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:13.157 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:13.157 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:13.157 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:13.157 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:13.157 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10915 2024-04-25T22:42:13.157 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.158 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:13.158 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.158 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:13.158 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963082+0000", 2024-04-25T22:42:13.158 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.158 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.158 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.158 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:13.158 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963082+0000", 2024-04-25T22:42:13.158 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.158 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.158 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.158 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:13.158 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963084+0000", 2024-04-25T22:42:13.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1100000000000001e-06 2024-04-25T22:42:13.159 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:13.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.968222+0000", 2024-04-25T22:42:13.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0051377410000000004 2024-04-25T22:42:13.159 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:13.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.968253+0000", 2024-04-25T22:42:13.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0580000000000002e-05 2024-04-25T22:42:13.159 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:13.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.968268+0000", 2024-04-25T22:42:13.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5758999999999999e-05 2024-04-25T22:42:13.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.160 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.160 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.968371+0000", 2024-04-25T22:42:13.160 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010259000000000001 2024-04-25T22:42:13.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.160 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:13.160 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.968544+0000", 2024-04-25T22:42:13.160 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017335500000000001 2024-04-25T22:42:13.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.160 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:13.160 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998194+0000", 2024-04-25T22:42:13.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029649825000000001 2024-04-25T22:42:13.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:13.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998336+0000", 2024-04-25T22:42:13.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000142294 2024-04-25T22:42:13.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:13.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998449+0000", 2024-04-25T22:42:13.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000112649 2024-04-25T22:42:13.161 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.161 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.161 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.162 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10919 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:13.162 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:13.162 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.094665314, 2024-04-25T22:42:13.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044010552000000001, 2024-04-25T22:42:13.162 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:13.162 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:13.162 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:13.162 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:13.162 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:13.162 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:13.162 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10919 2024-04-25T22:42:13.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.163 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:13.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.163 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:13.163 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:13.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.163 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.163 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:13.163 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:13.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.163 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.163 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:13.163 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:13.164 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8100000000000003e-07 2024-04-25T22:42:13.164 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.164 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:13.164 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980221+0000", 2024-04-25T22:42:13.164 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060397230000000003 2024-04-25T22:42:13.164 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.164 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:13.164 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980242+0000", 2024-04-25T22:42:13.164 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1373e-05 2024-04-25T22:42:13.164 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.164 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:13.164 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980252+0000", 2024-04-25T22:42:13.164 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9990000000000003e-06 2024-04-25T22:42:13.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981303+0000", 2024-04-25T22:42:13.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010501670000000001 2024-04-25T22:42:13.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:13.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981444+0000", 2024-04-25T22:42:13.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014123799999999999 2024-04-25T22:42:13.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:13.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981585+0000", 2024-04-25T22:42:13.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014071999999999999 2024-04-25T22:42:13.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:13.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003640+0000", 2024-04-25T22:42:13.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022055113000000001 2024-04-25T22:42:13.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:13.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018070+0000", 2024-04-25T22:42:13.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014430877 2024-04-25T22:42:13.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:13.167 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018138+0000", 2024-04-25T22:42:13.167 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7743000000000005e-05 2024-04-25T22:42:13.167 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.167 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:13.167 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018191+0000", 2024-04-25T22:42:13.167 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3118000000000002e-05 2024-04-25T22:42:13.167 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.167 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.167 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.167 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.167 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10930 4.28 4:177ac060:::100000030dc.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:13.167 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.994384+0000", 2024-04-25T22:42:13.167 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.074461911000000006, 2024-04-25T22:42:13.167 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033055212, 2024-04-25T22:42:13.168 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:13.168 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:13.168 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:13.168 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:13.168 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:13.168 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:13.168 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10930 2024-04-25T22:42:13.168 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.168 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:13.168 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.168 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:13.168 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.994384+0000", 2024-04-25T22:42:13.168 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.168 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.168 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:13.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.994384+0000", 2024-04-25T22:42:13.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:13.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.994386+0000", 2024-04-25T22:42:13.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.57e-06 2024-04-25T22:42:13.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:13.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.001109+0000", 2024-04-25T22:42:13.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067230190000000002 2024-04-25T22:42:13.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:13.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.001126+0000", 2024-04-25T22:42:13.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7073999999999999e-05 2024-04-25T22:42:13.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:13.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.001135+0000", 2024-04-25T22:42:13.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5440000000000004e-06 2024-04-25T22:42:13.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.001216+0000", 2024-04-25T22:42:13.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0333999999999994e-05 2024-04-25T22:42:13.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:13.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.001320+0000", 2024-04-25T22:42:13.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000104633 2024-04-25T22:42:13.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:13.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.027106+0000", 2024-04-25T22:42:13.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025785408999999999 2024-04-25T22:42:13.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:13.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.027352+0000", 2024-04-25T22:42:13.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00024583999999999999 2024-04-25T22:42:13.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:13.172 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.027439+0000", 2024-04-25T22:42:13.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7788999999999996e-05 2024-04-25T22:42:13.172 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.172 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.172 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.172 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.172 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.172 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:10927 4.3a e64/17 4:5ea9d1a5:::100000030c8.00000001:head v 64'174, mlcod=63'172)", 2024-04-25T22:42:13.172 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.995437+0000", 2024-04-25T22:42:13.172 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.073409524000000004, 2024-04-25T22:42:13.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031085109, 2024-04-25T22:42:13.172 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:13.172 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:13.172 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:13.172 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:13.172 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:13.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.995437+0000", 2024-04-25T22:42:13.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:13.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.995437+0000", 2024-04-25T22:42:13.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:13.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:13.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.995438+0000", 2024-04-25T22:42:13.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.384e-06 2024-04-25T22:42:13.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:13.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003184+0000", 2024-04-25T22:42:13.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077456130000000002 2024-04-25T22:42:13.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:13.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003196+0000", 2024-04-25T22:42:13.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1949e-05 2024-04-25T22:42:13.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:13.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003204+0000", 2024-04-25T22:42:13.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4020000000000002e-06 2024-04-25T22:42:13.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:13.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003271+0000", 2024-04-25T22:42:13.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.6729000000000004e-05 2024-04-25T22:42:13.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:13.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003300+0000", 2024-04-25T22:42:13.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9278999999999999e-05 2024-04-25T22:42:13.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:13.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.026436+0000", 2024-04-25T22:42:13.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023135665 2024-04-25T22:42:13.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:13.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:13.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:13.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.026522+0000", 2024-04-25T22:42:13.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6088000000000007e-05 2024-04-25T22:42:13.175 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.176 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.176 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.176 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:13.176 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:13.176 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:13.178 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:13.183 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:13.176+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:13.188 INFO:tasks.workunit.client.0.smithi057.stdout:9/180: rename d3/d26/d28/d2d/d3e to d3/d26/d28/d3f 0 2024-04-25T22:42:13.189 INFO:tasks.workunit.client.0.smithi057.stdout:1/129: dwrite d7/dd/d16/d18/f21 [0,4194304] 0 2024-04-25T22:42:13.189 INFO:tasks.workunit.client.0.smithi057.stdout:5/120: dwrite d2/d6/f7 [0,4194304] 0 2024-04-25T22:42:13.189 INFO:tasks.workunit.client.0.smithi057.stdout:5/121: link f1 d2/d6/db/f25 0 2024-04-25T22:42:13.189 INFO:tasks.workunit.client.0.smithi057.stdout:5/122: unlink d2/d6/db/f16 0 2024-04-25T22:42:13.189 INFO:tasks.workunit.client.0.smithi057.stdout:5/123: creat d2/d1c/f26 x:0 0 0 2024-04-25T22:42:13.189 INFO:tasks.workunit.client.0.smithi057.stdout:5/124: chown d2/ld 357185 1 2024-04-25T22:42:13.189 INFO:tasks.workunit.client.0.smithi057.stdout:1/130: fsync d7/dd/d16/f1e 0 2024-04-25T22:42:13.190 INFO:tasks.workunit.client.0.smithi057.stdout:1/131: symlink d7/dd/l29 0 2024-04-25T22:42:13.190 INFO:tasks.workunit.client.0.smithi057.stdout:5/125: dread d2/fe [0,4194304] 0 2024-04-25T22:42:13.190 INFO:tasks.workunit.client.0.smithi057.stdout:5/126: rename d2/f4 to d2/d6/db/d1a/f27 0 2024-04-25T22:42:13.190 INFO:tasks.workunit.client.0.smithi057.stdout:5/127: readlink d2/l1e 0 2024-04-25T22:42:13.190 INFO:tasks.workunit.client.0.smithi057.stdout:5/128: readlink l0 0 2024-04-25T22:42:13.190 INFO:tasks.workunit.client.0.smithi057.stdout:5/129: creat d2/d1c/d24/f28 x:0 0 0 2024-04-25T22:42:13.190 INFO:tasks.workunit.client.0.smithi057.stdout:5/130: symlink d2/d6/db/l29 0 2024-04-25T22:42:13.190 INFO:tasks.workunit.client.0.smithi057.stdout:5/131: mkdir d2/d1c/d24/d2a 0 2024-04-25T22:42:13.190 INFO:tasks.workunit.client.0.smithi057.stdout:5/132: write d2/d1c/f26 [188354,59850] 0 2024-04-25T22:42:13.191 INFO:tasks.workunit.client.0.smithi057.stdout:5/133: getdents d2/d6/db/d1a 0 2024-04-25T22:42:13.191 INFO:tasks.workunit.client.0.smithi057.stdout:5/134: creat d2/d6/db/f2b x:0 0 0 2024-04-25T22:42:13.191 INFO:tasks.workunit.client.0.smithi057.stdout:5/135: mkdir d2/d2c 0 2024-04-25T22:42:13.191 INFO:tasks.workunit.client.0.smithi057.stdout:5/136: mknod d2/d6/db/c2d 0 2024-04-25T22:42:13.191 INFO:tasks.workunit.client.0.smithi057.stdout:5/137: write d2/d6/f7 [1184053,39045] 0 2024-04-25T22:42:13.191 INFO:tasks.workunit.client.0.smithi057.stdout:1/132: dwrite d7/dd/f14 [0,4194304] 0 2024-04-25T22:42:13.191 INFO:tasks.workunit.client.0.smithi057.stdout:1/133: read - d7/dd/f28 zero size 2024-04-25T22:42:13.191 INFO:tasks.workunit.client.0.smithi057.stdout:5/138: dwrite d2/d6/db/d1a/f27 [0,4194304] 0 2024-04-25T22:42:13.192 INFO:tasks.workunit.client.0.smithi057.stdout:5/139: creat d2/d2c/f2e x:0 0 0 2024-04-25T22:42:13.192 INFO:tasks.workunit.client.0.smithi057.stdout:1/134: dwrite d7/dd/d16/f10 [0,4194304] 0 2024-04-25T22:42:13.192 INFO:tasks.workunit.client.0.smithi057.stdout:1/135: rename f0 to d7/dd/d16/d18/f2a 0 2024-04-25T22:42:13.192 INFO:tasks.workunit.client.0.smithi057.stdout:5/140: dwrite d2/d6/db/d1a/f27 [4194304,4194304] 0 2024-04-25T22:42:13.192 INFO:tasks.workunit.client.0.smithi057.stdout:1/136: dwrite d7/dd/d16/f10 [4194304,4194304] 0 2024-04-25T22:42:13.192 INFO:tasks.workunit.client.0.smithi057.stdout:5/141: dread d2/d6/f14 [4194304,4194304] 0 2024-04-25T22:42:13.192 INFO:tasks.workunit.client.0.smithi057.stdout:5/142: chown d2/d2c/f2e 7174 1 2024-04-25T22:42:13.192 INFO:tasks.workunit.client.0.smithi057.stdout:5/143: chown d2/fe 43241422 1 2024-04-25T22:42:13.192 INFO:tasks.workunit.client.0.smithi057.stdout:5/144: truncate d2/d6/db/f2b 85330 0 2024-04-25T22:42:13.192 INFO:tasks.workunit.client.0.smithi057.stdout:5/145: rmdir d2/d6/db/d1a 39 2024-04-25T22:42:13.192 INFO:tasks.workunit.client.0.smithi057.stdout:5/146: rename d2/d1c/d24/f28 to d2/d6/db/f2f 0 2024-04-25T22:42:13.192 INFO:tasks.workunit.client.0.smithi057.stdout:5/147: dread - d2/d6/db/f2f zero size 2024-04-25T22:42:13.192 INFO:tasks.workunit.client.0.smithi057.stdout:5/148: chown d2/d6/db/d1a/f27 28 1 2024-04-25T22:42:13.192 INFO:tasks.workunit.client.0.smithi057.stdout:5/149: dread - d2/d6/db/f2f zero size 2024-04-25T22:42:13.192 INFO:tasks.workunit.client.0.smithi057.stdout:5/150: stat d2/d6/f7 0 2024-04-25T22:42:13.193 INFO:tasks.workunit.client.0.smithi057.stdout:5/151: creat d2/d1c/d24/f30 x:0 0 0 2024-04-25T22:42:13.193 INFO:tasks.workunit.client.0.smithi057.stdout:5/152: truncate d2/d6/db/f25 1834488 0 2024-04-25T22:42:13.193 INFO:tasks.workunit.client.0.smithi057.stdout:5/153: dwrite d2/d6/fa [4194304,4194304] 0 2024-04-25T22:42:13.193 INFO:tasks.workunit.client.0.smithi057.stdout:5/154: chown d2/d6/db/f25 25900 1 2024-04-25T22:42:13.193 INFO:tasks.workunit.client.0.smithi057.stdout:5/155: truncate f1 821770 0 2024-04-25T22:42:13.193 INFO:tasks.workunit.client.0.smithi057.stdout:5/156: chown d2/c23 989 1 2024-04-25T22:42:13.193 INFO:tasks.workunit.client.0.smithi057.stdout:5/157: creat d2/f31 x:0 0 0 2024-04-25T22:42:13.193 INFO:tasks.workunit.client.0.smithi057.stdout:5/158: truncate d2/d6/db/f25 589124 0 2024-04-25T22:42:13.193 INFO:tasks.workunit.client.0.smithi057.stdout:5/159: creat d2/d1c/f32 x:0 0 0 2024-04-25T22:42:13.193 INFO:tasks.workunit.client.0.smithi057.stdout:5/160: chown d2/ld 63 1 2024-04-25T22:42:13.193 INFO:tasks.workunit.client.0.smithi057.stdout:5/161: chown d2/d6/l8 224307 1 2024-04-25T22:42:13.193 INFO:tasks.workunit.client.0.smithi057.stdout:5/162: chown d2/d6/f13 1 1 2024-04-25T22:42:13.193 INFO:tasks.workunit.client.0.smithi057.stdout:5/163: readlink d2/lc 0 2024-04-25T22:42:13.193 INFO:tasks.workunit.client.0.smithi057.stdout:5/164: write d2/d6/db/d1a/f22 [2560357,36252] 0 2024-04-25T22:42:13.193 INFO:tasks.workunit.client.0.smithi057.stdout:5/165: dread d2/d6/f7 [0,4194304] 0 2024-04-25T22:42:13.194 INFO:tasks.workunit.client.0.smithi057.stdout:5/166: symlink d2/d1c/d24/l33 0 2024-04-25T22:42:13.194 INFO:tasks.workunit.client.0.smithi057.stdout:5/167: mknod d2/d1c/d24/c34 0 2024-04-25T22:42:13.194 INFO:tasks.workunit.client.0.smithi057.stdout:5/168: fdatasync d2/f12 0 2024-04-25T22:42:13.194 INFO:tasks.workunit.client.0.smithi057.stdout:4/104: sync 2024-04-25T22:42:13.194 INFO:tasks.workunit.client.0.smithi057.stdout:3/110: sync 2024-04-25T22:42:13.194 INFO:tasks.workunit.client.0.smithi057.stdout:0/105: sync 2024-04-25T22:42:13.194 INFO:tasks.workunit.client.0.smithi057.stdout:2/126: sync 2024-04-25T22:42:13.194 INFO:tasks.workunit.client.0.smithi057.stdout:6/105: sync 2024-04-25T22:42:13.194 INFO:tasks.workunit.client.0.smithi057.stdout:4/105: creat d14/f22 x:0 0 0 2024-04-25T22:42:13.194 INFO:tasks.workunit.client.0.smithi057.stdout:3/111: creat d0/d11/f23 x:0 0 0 2024-04-25T22:42:13.194 INFO:tasks.workunit.client.0.smithi057.stdout:0/106: symlink d0/l22 0 2024-04-25T22:42:13.194 INFO:tasks.workunit.client.0.smithi057.stdout:6/106: truncate d2/d9/ff 4870685 0 2024-04-25T22:42:13.194 INFO:tasks.workunit.client.0.smithi057.stdout:3/112: chown d0/d11/f19 11 1 2024-04-25T22:42:13.194 INFO:tasks.workunit.client.0.smithi057.stdout:0/107: chown d0/d5/dd/fe 3 1 2024-04-25T22:42:13.194 INFO:tasks.workunit.client.0.smithi057.stdout:3/113: stat d0/c10 0 2024-04-25T22:42:13.195 INFO:tasks.workunit.client.0.smithi057.stdout:6/107: write d2/f14 [763399,94263] 0 2024-04-25T22:42:13.195 INFO:tasks.workunit.client.0.smithi057.stdout:0/108: write d0/d5/dd/f1d [1028505,46450] 0 2024-04-25T22:42:13.195 INFO:tasks.workunit.client.0.smithi057.stdout:6/108: stat d2/l16 0 2024-04-25T22:42:13.195 INFO:tasks.workunit.client.0.smithi057.stdout:5/169: dread d2/f10 [0,4194304] 0 2024-04-25T22:42:13.195 INFO:tasks.workunit.client.0.smithi057.stdout:2/127: truncate f3 3838229 0 2024-04-25T22:42:13.195 INFO:tasks.workunit.client.0.smithi057.stdout:6/109: mknod d2/d9/d1a/d22/c23 0 2024-04-25T22:42:13.195 INFO:tasks.workunit.client.0.smithi057.stdout:5/170: fdatasync d2/f9 0 2024-04-25T22:42:13.195 INFO:tasks.workunit.client.0.smithi057.stdout:6/110: rename d2/d9 to d2/d9/d24 22 2024-04-25T22:42:13.195 INFO:tasks.workunit.client.0.smithi057.stdout:5/171: chown d2/c3 127142 1 2024-04-25T22:42:13.195 INFO:tasks.workunit.client.0.smithi057.stdout:3/114: dread d0/d11/f12 [0,4194304] 0 2024-04-25T22:42:13.195 INFO:tasks.workunit.client.0.smithi057.stdout:5/172: unlink d2/d1c/f32 0 2024-04-25T22:42:13.195 INFO:tasks.workunit.client.0.smithi057.stdout:4/106: dwrite d14/f1a [0,4194304] 0 2024-04-25T22:42:13.195 INFO:tasks.workunit.client.0.smithi057.stdout:6/111: link d2/d9/ce d2/d9/d1a/c25 0 2024-04-25T22:42:13.195 INFO:tasks.workunit.client.0.smithi057.stdout:4/107: dread - d14/f22 zero size 2024-04-25T22:42:13.196 INFO:tasks.workunit.client.0.smithi057.stdout:0/109: read d0/d5/dd/f1d [355119,128144] 0 2024-04-25T22:42:13.196 INFO:tasks.workunit.client.0.smithi057.stdout:4/108: creat d14/f23 x:0 0 0 2024-04-25T22:42:13.196 INFO:tasks.workunit.client.0.smithi057.stdout:5/173: link d2/d6/db/f2f d2/d6/db/d1a/f35 0 2024-04-25T22:42:13.196 INFO:tasks.workunit.client.0.smithi057.stdout:0/110: creat d0/d5/f23 x:0 0 0 2024-04-25T22:42:13.196 INFO:tasks.workunit.client.0.smithi057.stdout:5/174: read d2/f9 [986653,14611] 0 2024-04-25T22:42:13.196 INFO:tasks.workunit.client.0.smithi057.stdout:4/109: mknod d14/c24 0 2024-04-25T22:42:13.196 INFO:tasks.workunit.client.0.smithi057.stdout:6/112: getdents d2/d19 0 2024-04-25T22:42:13.196 INFO:tasks.workunit.client.0.smithi057.stdout:4/110: unlink l10 0 2024-04-25T22:42:13.196 INFO:tasks.workunit.client.0.smithi057.stdout:6/113: chown d2/f1c 1535280908 1 2024-04-25T22:42:13.196 INFO:tasks.workunit.client.0.smithi057.stdout:5/175: creat d2/d2c/f36 x:0 0 0 2024-04-25T22:42:13.196 INFO:tasks.workunit.client.0.smithi057.stdout:4/111: creat d14/f25 x:0 0 0 2024-04-25T22:42:13.196 INFO:tasks.workunit.client.0.smithi057.stdout:6/114: truncate d2/f17 487064 0 2024-04-25T22:42:13.196 INFO:tasks.workunit.client.0.smithi057.stdout:4/112: write ff [985225,103398] 0 2024-04-25T22:42:13.196 INFO:tasks.workunit.client.0.smithi057.stdout:3/115: dread d0/d4/fd [0,4194304] 0 2024-04-25T22:42:13.196 INFO:tasks.workunit.client.0.smithi057.stdout:6/115: unlink d2/fb 0 2024-04-25T22:42:13.196 INFO:tasks.workunit.client.0.smithi057.stdout:5/176: dread d2/f9 [0,4194304] 0 2024-04-25T22:42:13.196 INFO:tasks.workunit.client.0.smithi057.stdout:4/113: creat d14/f26 x:0 0 0 2024-04-25T22:42:13.197 INFO:tasks.workunit.client.0.smithi057.stdout:6/116: truncate d2/f1c 897998 0 2024-04-25T22:42:13.197 INFO:tasks.workunit.client.0.smithi057.stdout:5/177: stat d2/d6/db/f2b 0 2024-04-25T22:42:13.197 INFO:tasks.workunit.client.0.smithi057.stdout:6/117: truncate d2/d19/f1e 2335640 0 2024-04-25T22:42:13.197 INFO:tasks.workunit.client.0.smithi057.stdout:5/178: symlink d2/d6/db/l37 0 2024-04-25T22:42:13.197 INFO:tasks.workunit.client.0.smithi057.stdout:6/118: mkdir d2/d19/d26 0 2024-04-25T22:42:13.197 INFO:tasks.workunit.client.0.smithi057.stdout:5/179: write d2/d2c/f36 [194375,86268] 0 2024-04-25T22:42:13.197 INFO:tasks.workunit.client.0.smithi057.stdout:5/180: chown d2/d6 33 1 2024-04-25T22:42:13.197 INFO:tasks.workunit.client.0.smithi057.stdout:6/119: symlink d2/d9/l27 0 2024-04-25T22:42:13.197 INFO:tasks.workunit.client.0.smithi057.stdout:5/181: chown d2/f10 47 1 2024-04-25T22:42:13.198 INFO:tasks.workunit.client.0.smithi057.stdout:3/116: dwrite d0/fe [0,4194304] 0 2024-04-25T22:42:13.198 INFO:tasks.workunit.client.0.smithi057.stdout:3/117: write d0/d11/f1c [465421,36858] 0 2024-04-25T22:42:13.198 INFO:tasks.workunit.client.0.smithi057.stdout:3/118: write d0/d11/f19 [3800306,124594] 0 2024-04-25T22:42:13.198 INFO:tasks.workunit.client.0.smithi057.stdout:3/119: dwrite d0/d4/d7/f1d [0,4194304] 0 2024-04-25T22:42:13.198 INFO:tasks.workunit.client.0.smithi057.stdout:8/102: sync 2024-04-25T22:42:13.198 INFO:tasks.workunit.client.0.smithi057.stdout:3/120: link d0/fa d0/d4/d7/f24 0 2024-04-25T22:42:13.198 INFO:tasks.workunit.client.0.smithi057.stdout:6/120: fsync d2/d9/ff 0 2024-04-25T22:42:13.199 INFO:tasks.workunit.client.0.smithi057.stdout:8/103: dread - d4/d5/f23 zero size 2024-04-25T22:42:13.199 INFO:tasks.workunit.client.0.smithi057.stdout:2/128: truncate fe 1301215 0 2024-04-25T22:42:13.199 INFO:tasks.workunit.client.0.smithi057.stdout:3/121: link d0/f6 d0/d4/f25 0 2024-04-25T22:42:13.199 INFO:tasks.workunit.client.0.smithi057.stdout:6/121: creat d2/d9/d1a/f28 x:0 0 0 2024-04-25T22:42:13.199 INFO:tasks.workunit.client.0.smithi057.stdout:8/104: chown c2 29 1 2024-04-25T22:42:13.199 INFO:tasks.workunit.client.0.smithi057.stdout:2/129: symlink d1f/d21/l23 0 2024-04-25T22:42:13.199 INFO:tasks.workunit.client.0.smithi057.stdout:3/122: rmdir d0/d4 39 2024-04-25T22:42:13.199 INFO:tasks.workunit.client.0.smithi057.stdout:8/105: dread - d4/d5/d17/d19/f26 zero size 2024-04-25T22:42:13.199 INFO:tasks.workunit.client.0.smithi057.stdout:3/123: stat d0/d4 0 2024-04-25T22:42:13.199 INFO:tasks.workunit.client.0.smithi057.stdout:8/106: chown d4/d5/d17/l1a 9043 1 2024-04-25T22:42:13.199 INFO:tasks.workunit.client.0.smithi057.stdout:2/130: symlink d1f/d21/l24 0 2024-04-25T22:42:13.199 INFO:tasks.workunit.client.0.smithi057.stdout:4/114: getdents d14 0 2024-04-25T22:42:13.199 INFO:tasks.workunit.client.0.smithi057.stdout:4/115: fsync d14/f16 0 2024-04-25T22:42:13.202 INFO:tasks.workunit.client.0.smithi057.stdout:4/116: fsync d14/f26 0 2024-04-25T22:42:13.202 INFO:tasks.workunit.client.0.smithi057.stdout:3/124: dread d0/d11/f19 [4194304,4194304] 0 2024-04-25T22:42:13.202 INFO:tasks.workunit.client.0.smithi057.stdout:6/122: dwrite d2/d9/f18 [4194304,4194304] 0 2024-04-25T22:42:13.202 INFO:tasks.workunit.client.0.smithi057.stdout:4/117: write fc [3414274,39665] 0 2024-04-25T22:42:13.202 INFO:tasks.workunit.client.0.smithi057.stdout:8/107: dread d4/db/dd/f18 [0,4194304] 0 2024-04-25T22:42:13.202 INFO:tasks.workunit.client.0.smithi057.stdout:4/118: chown d14/l1e 953 1 2024-04-25T22:42:13.202 INFO:tasks.workunit.client.0.smithi057.stdout:2/131: dwrite f15 [4194304,4194304] 0 2024-04-25T22:42:13.202 INFO:tasks.workunit.client.0.smithi057.stdout:8/108: readlink d4/db/dd/l1f 0 2024-04-25T22:42:13.202 INFO:tasks.workunit.client.0.smithi057.stdout:4/119: unlink d14/c21 0 2024-04-25T22:42:13.202 INFO:tasks.workunit.client.0.smithi057.stdout:2/132: creat d1f/d21/f25 x:0 0 0 2024-04-25T22:42:13.202 INFO:tasks.workunit.client.0.smithi057.stdout:2/133: fdatasync f1b 0 2024-04-25T22:42:13.202 INFO:tasks.workunit.client.0.smithi057.stdout:4/120: creat d14/f27 x:0 0 0 2024-04-25T22:42:13.203 INFO:tasks.workunit.client.0.smithi057.stdout:4/121: creat d14/f28 x:0 0 0 2024-04-25T22:42:13.203 INFO:tasks.workunit.client.0.smithi057.stdout:5/182: dwrite d2/d6/db/f25 [0,4194304] 0 2024-04-25T22:42:13.203 INFO:tasks.workunit.client.0.smithi057.stdout:4/122: read - d14/f23 zero size 2024-04-25T22:42:13.203 INFO:tasks.workunit.client.0.smithi057.stdout:5/183: readlink d2/l1e 0 2024-04-25T22:42:13.203 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:13.203 INFO:tasks.workunit.client.0.smithi057.stdout:4/123: chown la 153241014 1 2024-04-25T22:42:13.204 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:13.204 INFO:tasks.workunit.client.0.smithi057.stdout:5/184: write d2/d1c/f26 [741238,83838] 0 2024-04-25T22:42:13.204 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:13.205 INFO:tasks.workunit.client.0.smithi057.stdout:3/125: truncate d0/d11/f1c 457045 0 2024-04-25T22:42:13.205 INFO:tasks.workunit.client.0.smithi057.stdout:5/185: write d2/d1c/f1f [237295,47655] 0 2024-04-25T22:42:13.205 INFO:tasks.workunit.client.0.smithi057.stdout:3/126: mkdir d0/d4/d7/d26 0 2024-04-25T22:42:13.205 INFO:tasks.workunit.client.0.smithi057.stdout:2/134: getdents d1f/d21 0 2024-04-25T22:42:13.206 INFO:tasks.workunit.client.0.smithi057.stdout:3/127: fdatasync d0/f6 0 2024-04-25T22:42:13.206 INFO:tasks.workunit.client.0.smithi057.stdout:5/186: chown d2/d6/db/l37 23 1 2024-04-25T22:42:13.206 INFO:tasks.workunit.client.0.smithi057.stdout:2/135: write f9 [678032,3049] 0 2024-04-25T22:42:13.206 INFO:tasks.workunit.client.0.smithi057.stdout:8/109: dwrite d4/db/dd/f20 [0,4194304] 0 2024-04-25T22:42:13.206 INFO:tasks.workunit.client.0.smithi057.stdout:2/136: unlink l18 0 2024-04-25T22:42:13.206 INFO:tasks.workunit.client.0.smithi057.stdout:2/137: write f9 [244523,117520] 0 2024-04-25T22:42:13.207 INFO:tasks.workunit.client.0.smithi057.stdout:8/110: truncate d4/db/dd/f18 1522171 0 2024-04-25T22:42:13.207 INFO:tasks.workunit.client.0.smithi057.stdout:5/187: rename d2/d1c/d24/f30 to d2/d6/db/f38 0 2024-04-25T22:42:13.208 INFO:tasks.workunit.client.0.smithi057.stdout:0/111: dread d0/d3/f7 [0,4194304] 0 2024-04-25T22:42:13.208 INFO:tasks.workunit.client.0.smithi057.stdout:2/138: fsync d1f/d21/f22 0 2024-04-25T22:42:13.209 INFO:tasks.workunit.client.0.smithi057.stdout:0/112: rmdir d0/d5 39 2024-04-25T22:42:13.210 INFO:tasks.workunit.client.0.smithi057.stdout:6/123: dread d2/f14 [0,4194304] 0 2024-04-25T22:42:13.211 INFO:tasks.workunit.client.0.smithi057.stdout:8/111: creat d4/db/dd/df/d22/f27 x:0 0 0 2024-04-25T22:42:13.211 INFO:tasks.workunit.client.0.smithi057.stdout:0/113: mknod d0/c24 0 2024-04-25T22:42:13.212 INFO:tasks.workunit.client.0.smithi057.stdout:4/124: dwrite d14/f23 [0,4194304] 0 2024-04-25T22:42:13.212 INFO:tasks.workunit.client.0.smithi057.stdout:8/112: symlink d4/d5/l28 0 2024-04-25T22:42:13.214 INFO:tasks.workunit.client.0.smithi057.stdout:3/128: dwrite d0/f1b [0,4194304] 0 2024-04-25T22:42:13.215 INFO:tasks.workunit.client.0.smithi057.stdout:6/124: creat d2/d9/d1a/d22/f29 x:0 0 0 2024-04-25T22:42:13.216 INFO:tasks.workunit.client.0.smithi057.stdout:8/113: symlink d4/d5/d17/l29 0 2024-04-25T22:42:13.217 INFO:tasks.workunit.client.0.smithi057.stdout:4/125: link d14/c1b d14/c29 0 2024-04-25T22:42:13.217 INFO:tasks.workunit.client.0.smithi057.stdout:6/125: creat d2/d9/f2a x:0 0 0 2024-04-25T22:42:13.217 INFO:tasks.workunit.client.0.smithi057.stdout:3/129: truncate d0/f6 43677 0 2024-04-25T22:42:13.219 INFO:tasks.workunit.client.0.smithi057.stdout:8/114: creat d4/d5/d21/f2a x:0 0 0 2024-04-25T22:42:13.219 INFO:tasks.workunit.client.0.smithi057.stdout:4/126: unlink f4 0 2024-04-25T22:42:13.219 INFO:tasks.workunit.client.0.smithi057.stdout:3/130: rmdir d0/d4 39 2024-04-25T22:42:13.219 INFO:tasks.workunit.client.0.smithi057.stdout:6/126: read - d2/d9/d1a/d22/f29 zero size 2024-04-25T22:42:13.221 INFO:tasks.workunit.client.0.smithi057.stdout:2/139: dwrite d1f/d21/f25 [0,4194304] 0 2024-04-25T22:42:13.221 INFO:tasks.workunit.client.0.smithi057.stdout:4/127: symlink d14/l2a 0 2024-04-25T22:42:13.221 INFO:tasks.workunit.client.0.smithi057.stdout:8/115: creat d4/db/dd/f2b x:0 0 0 2024-04-25T22:42:13.221 INFO:tasks.workunit.client.0.smithi057.stdout:3/131: mkdir d0/d11/d27 0 2024-04-25T22:42:13.221 INFO:tasks.workunit.client.0.smithi057.stdout:2/140: mkdir d1f/d21/d26 0 2024-04-25T22:42:13.221 INFO:tasks.workunit.client.0.smithi057.stdout:4/128: symlink d14/l2b 0 2024-04-25T22:42:13.221 INFO:tasks.workunit.client.0.smithi057.stdout:3/132: chown d0/d11/c18 676922 1 2024-04-25T22:42:13.221 INFO:tasks.workunit.client.0.smithi057.stdout:4/129: stat d14/f27 0 2024-04-25T22:42:13.221 INFO:tasks.workunit.client.0.smithi057.stdout:8/116: mknod d4/c2c 0 2024-04-25T22:42:13.222 INFO:tasks.workunit.client.0.smithi057.stdout:6/127: rename d2/d9/f18 to d2/f2b 0 2024-04-25T22:42:13.223 INFO:tasks.workunit.client.0.smithi057.stdout:6/128: mknod d2/c2c 0 2024-04-25T22:42:13.223 INFO:tasks.workunit.client.0.smithi057.stdout:0/114: dwrite d0/f9 [0,4194304] 0 2024-04-25T22:42:13.224 INFO:tasks.workunit.client.0.smithi057.stdout:6/129: creat d2/d19/d26/f2d x:0 0 0 2024-04-25T22:42:13.224 INFO:tasks.workunit.client.0.smithi057.stdout:6/130: chown d2/d9/ff 951701176 1 2024-04-25T22:42:13.226 INFO:tasks.workunit.client.0.smithi057.stdout:0/115: rename d0/d3/d6/d14/c16 to d0/d3/c25 0 2024-04-25T22:42:13.226 INFO:tasks.workunit.client.0.smithi057.stdout:3/133: dread d0/f1b [0,4194304] 0 2024-04-25T22:42:13.227 INFO:tasks.workunit.client.0.smithi057.stdout:0/116: rmdir d0/d5/dd 39 2024-04-25T22:42:13.228 INFO:tasks.workunit.client.0.smithi057.stdout:3/134: symlink d0/d11/d27/l28 0 2024-04-25T22:42:13.228 INFO:tasks.workunit.client.0.smithi057.stdout:4/130: read f9 [1137180,73498] 0 2024-04-25T22:42:13.229 INFO:tasks.workunit.client.0.smithi057.stdout:0/117: write d0/d5/ff [3320922,54655] 0 2024-04-25T22:42:13.229 INFO:tasks.workunit.client.0.smithi057.stdout:8/117: dwrite d4/db/dd/df/f1e [0,4194304] 0 2024-04-25T22:42:13.230 INFO:tasks.workunit.client.0.smithi057.stdout:4/131: write d14/f26 [555145,35980] 0 2024-04-25T22:42:13.230 INFO:tasks.workunit.client.0.smithi057.stdout:3/135: creat d0/d11/d27/f29 x:0 0 0 2024-04-25T22:42:13.231 INFO:tasks.workunit.client.0.smithi057.stdout:0/118: fsync d0/d3/d6/f1b 0 2024-04-25T22:42:13.231 INFO:tasks.workunit.client.0.smithi057.stdout:8/118: fsync d4/db/d12/f1c 0 2024-04-25T22:42:13.231 INFO:tasks.workunit.client.0.smithi057.stdout:2/141: getdents d1f/d21 0 2024-04-25T22:42:13.232 INFO:tasks.workunit.client.0.smithi057.stdout:4/132: rename fe to d14/f2c 0 2024-04-25T22:42:13.233 INFO:tasks.workunit.client.0.smithi057.stdout:8/119: symlink d4/d5/d17/l2d 0 2024-04-25T22:42:13.233 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:13.233 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:13.234 INFO:tasks.workunit.client.0.smithi057.stdout:2/142: mknod d1f/d21/d26/c27 0 2024-04-25T22:42:13.234 INFO:tasks.workunit.client.0.smithi057.stdout:3/136: symlink d0/d4/d7/d26/l2a 0 2024-04-25T22:42:13.234 INFO:tasks.workunit.client.0.smithi057.stdout:6/131: dwrite d2/f17 [0,4194304] 0 2024-04-25T22:42:13.234 INFO:tasks.workunit.client.0.smithi057.stdout:2/143: readlink l1 0 2024-04-25T22:42:13.234 INFO:tasks.workunit.client.0.smithi057.stdout:3/137: fsync d0/d11/f1e 0 2024-04-25T22:42:13.235 INFO:tasks.workunit.client.0.smithi057.stdout:3/138: chown d0/d11/f12 12820 1 2024-04-25T22:42:13.235 INFO:tasks.workunit.client.0.smithi057.stdout:4/133: rename l11 to d14/l2d 0 2024-04-25T22:42:13.235 INFO:tasks.workunit.client.0.smithi057.stdout:6/132: mknod d2/d9/d1a/c2e 0 2024-04-25T22:42:13.235 INFO:tasks.workunit.client.0.smithi057.stdout:6/133: chown d2/f2b 3866419 1 2024-04-25T22:42:13.235 INFO:tasks.workunit.client.0.smithi057.stdout:4/134: write d14/f26 [265685,105887] 0 2024-04-25T22:42:13.236 INFO:tasks.workunit.client.0.smithi057.stdout:3/139: creat d0/d4/d7/d22/f2b x:0 0 0 2024-04-25T22:42:13.236 INFO:tasks.workunit.client.0.smithi057.stdout:6/134: creat d2/d19/d26/f2f x:0 0 0 2024-04-25T22:42:13.237 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:13.237 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:13.238 INFO:tasks.workunit.client.0.smithi057.stdout:6/135: rename d2/c5 to d2/d9/d1a/c30 0 2024-04-25T22:42:13.239 INFO:tasks.workunit.client.0.smithi057.stdout:6/136: mkdir d2/d9/d1a/d22/d31 0 2024-04-25T22:42:13.240 INFO:tasks.workunit.client.0.smithi057.stdout:6/137: readlink d2/l10 0 2024-04-25T22:42:13.240 INFO:tasks.workunit.client.0.smithi057.stdout:8/120: dwrite d4/db/dd/f1b [0,4194304] 0 2024-04-25T22:42:13.241 INFO:tasks.workunit.client.0.smithi057.stdout:6/138: write d2/d19/d26/f2d [692816,43948] 0 2024-04-25T22:42:13.242 INFO:tasks.workunit.client.0.smithi057.stdout:8/121: rename c2 to d4/db/d12/c2e 0 2024-04-25T22:42:13.246 INFO:tasks.workunit.client.0.smithi057.stdout:4/135: getdents d14 0 2024-04-25T22:42:13.246 INFO:tasks.workunit.client.0.smithi057.stdout:4/136: getdents d14 0 2024-04-25T22:42:13.247 INFO:tasks.workunit.client.0.smithi057.stdout:4/137: unlink d14/f2c 0 2024-04-25T22:42:13.247 INFO:tasks.workunit.client.0.smithi057.stdout:4/138: symlink d14/l2e 0 2024-04-25T22:42:13.248 INFO:tasks.workunit.client.0.smithi057.stdout:3/140: dread d0/d4/f25 [0,4194304] 0 2024-04-25T22:42:13.249 INFO:tasks.workunit.client.0.smithi057.stdout:2/144: read fb [3038976,32475] 0 2024-04-25T22:42:13.249 INFO:tasks.workunit.client.0.smithi057.stdout:2/145: symlink d1f/l28 0 2024-04-25T22:42:13.250 INFO:tasks.workunit.client.0.smithi057.stdout:2/146: chown f16 6150 1 2024-04-25T22:42:13.250 INFO:tasks.workunit.client.0.smithi057.stdout:8/122: read d4/f10 [6977076,112311] 0 2024-04-25T22:42:13.250 INFO:tasks.workunit.client.0.smithi057.stdout:2/147: creat d1f/d21/d26/f29 x:0 0 0 2024-04-25T22:42:13.250 INFO:tasks.workunit.client.0.smithi057.stdout:8/123: mkdir d4/d5/d2f 0 2024-04-25T22:42:13.251 INFO:tasks.workunit.client.0.smithi057.stdout:2/148: creat d1f/f2a x:0 0 0 2024-04-25T22:42:13.251 INFO:tasks.workunit.client.0.smithi057.stdout:8/124: write d4/f10 [6722782,71777] 0 2024-04-25T22:42:13.251 INFO:tasks.workunit.client.0.smithi057.stdout:2/149: mknod d1f/c2b 0 2024-04-25T22:42:13.252 INFO:tasks.workunit.client.0.smithi057.stdout:2/150: truncate fe 92787 0 2024-04-25T22:42:13.252 INFO:tasks.workunit.client.0.smithi057.stdout:8/125: link d4/d5/f7 d4/d5/d17/d19/f30 0 2024-04-25T22:42:13.256 INFO:tasks.workunit.client.0.smithi057.stdout:4/139: getdents d14 0 2024-04-25T22:42:13.256 INFO:tasks.workunit.client.0.smithi057.stdout:4/140: dread - d14/f25 zero size 2024-04-25T22:42:13.257 INFO:tasks.workunit.client.0.smithi057.stdout:2/151: dwrite f15 [4194304,4194304] 0 2024-04-25T22:42:13.257 INFO:tasks.workunit.client.0.smithi057.stdout:6/139: dread d2/f4 [0,4194304] 0 2024-04-25T22:42:13.257 INFO:tasks.workunit.client.0.smithi057.stdout:4/141: mkdir d14/d2f 0 2024-04-25T22:42:13.258 INFO:tasks.workunit.client.0.smithi057.stdout:2/152: creat d1f/d21/d26/f2c x:0 0 0 2024-04-25T22:42:13.258 INFO:tasks.workunit.client.0.smithi057.stdout:4/142: truncate d14/f23 4261693 0 2024-04-25T22:42:13.258 INFO:tasks.workunit.client.0.smithi057.stdout:2/153: stat d1f/d21/f22 0 2024-04-25T22:42:13.259 INFO:tasks.workunit.client.0.smithi057.stdout:4/143: write d14/f26 [554922,84219] 0 2024-04-25T22:42:13.259 INFO:tasks.workunit.client.0.smithi057.stdout:2/154: chown l1c 49053463 1 2024-04-25T22:42:13.259 INFO:tasks.workunit.client.0.smithi057.stdout:2/155: chown f3 6775 1 2024-04-25T22:42:13.262 INFO:tasks.workunit.client.0.smithi057.stdout:6/140: dread d2/f1c [0,4194304] 0 2024-04-25T22:42:13.262 INFO:tasks.workunit.client.0.smithi057.stdout:2/156: mkdir d1f/d21/d2d 0 2024-04-25T22:42:13.262 INFO:tasks.workunit.client.0.smithi057.stdout:6/141: chown d2/f17 497320676 1 2024-04-25T22:42:13.262 INFO:tasks.workunit.client.0.smithi057.stdout:3/141: write d0/d4/d7/f24 [3303856,117141] 0 2024-04-25T22:42:13.262 INFO:tasks.workunit.client.0.smithi057.stdout:2/157: write f11 [3405404,86429] 0 2024-04-25T22:42:13.262 INFO:tasks.workunit.client.0.smithi057.stdout:6/142: creat d2/f32 x:0 0 0 2024-04-25T22:42:13.263 INFO:tasks.workunit.client.0.smithi057.stdout:3/142: creat d0/d4/d7/d26/f2c x:0 0 0 2024-04-25T22:42:13.263 INFO:tasks.workunit.client.0.smithi057.stdout:2/158: rename f15 to d1f/d21/f2e 0 2024-04-25T22:42:13.263 INFO:tasks.workunit.client.0.smithi057.stdout:6/143: dread d2/f14 [0,4194304] 0 2024-04-25T22:42:13.264 INFO:tasks.workunit.client.0.smithi057.stdout:3/143: creat d0/d4/f2d x:0 0 0 2024-04-25T22:42:13.265 INFO:tasks.workunit.client.0.smithi057.stdout:6/144: write d2/d19/d26/f2d [1101561,73177] 0 2024-04-25T22:42:13.265 INFO:tasks.workunit.client.0.smithi057.stdout:4/144: dwrite d14/f25 [0,4194304] 0 2024-04-25T22:42:13.266 INFO:tasks.workunit.client.0.smithi057.stdout:8/126: dwrite d4/f25 [4194304,4194304] 0 2024-04-25T22:42:13.266 INFO:tasks.workunit.client.0.smithi057.stdout:3/144: truncate d0/d11/f1e 374277 0 2024-04-25T22:42:13.267 INFO:tasks.workunit.client.0.smithi057.stdout:4/145: creat d14/f30 x:0 0 0 2024-04-25T22:42:13.267 INFO:tasks.workunit.client.0.smithi057.stdout:6/145: write d2/d9/d1a/f28 [632402,20744] 0 2024-04-25T22:42:13.267 INFO:tasks.workunit.client.0.smithi057.stdout:8/127: fdatasync d4/db/d12/f1d 0 2024-04-25T22:42:13.267 INFO:tasks.workunit.client.0.smithi057.stdout:3/145: symlink d0/d4/d7/l2e 0 2024-04-25T22:42:13.267 INFO:tasks.workunit.client.0.smithi057.stdout:4/146: mkdir d14/d31 0 2024-04-25T22:42:13.268 INFO:tasks.workunit.client.0.smithi057.stdout:6/146: fdatasync d2/f2b 0 2024-04-25T22:42:13.268 INFO:tasks.workunit.client.0.smithi057.stdout:4/147: fsync d14/f20 0 2024-04-25T22:42:13.268 INFO:tasks.workunit.client.0.smithi057.stdout:8/128: mkdir d4/d5/d17/d19/d31 0 2024-04-25T22:42:13.269 INFO:tasks.workunit.client.0.smithi057.stdout:3/146: link d0/fa d0/d4/d7/f2f 0 2024-04-25T22:42:13.270 INFO:tasks.workunit.client.0.smithi057.stdout:8/129: getdents d4/d5/d17 0 2024-04-25T22:42:13.270 INFO:tasks.workunit.client.0.smithi057.stdout:8/130: creat d4/f32 x:0 0 0 2024-04-25T22:42:13.271 INFO:tasks.workunit.client.0.smithi057.stdout:3/147: mkdir d0/d11/d27/d30 0 2024-04-25T22:42:13.271 INFO:tasks.workunit.client.0.smithi057.stdout:8/131: creat d4/d5/f33 x:0 0 0 2024-04-25T22:42:13.272 INFO:tasks.workunit.client.0.smithi057.stdout:8/132: read - d4/db/dd/df/d22/f27 zero size 2024-04-25T22:42:13.272 INFO:tasks.workunit.client.0.smithi057.stdout:6/147: dread d2/f17 [0,4194304] 0 2024-04-25T22:42:13.274 INFO:tasks.workunit.client.0.smithi057.stdout:3/148: dread d0/d4/d7/f2f [0,4194304] 0 2024-04-25T22:42:13.275 INFO:tasks.workunit.client.0.smithi057.stdout:4/148: write f9 [1021597,11019] 0 2024-04-25T22:42:13.275 INFO:tasks.workunit.client.0.smithi057.stdout:6/148: read d2/f11 [2178524,106873] 0 2024-04-25T22:42:13.276 INFO:tasks.workunit.client.0.smithi057.stdout:4/149: rename la to d14/d2f/l32 0 2024-04-25T22:42:13.276 INFO:tasks.workunit.client.0.smithi057.stdout:4/150: readlink d14/l2e 0 2024-04-25T22:42:13.277 INFO:tasks.workunit.client.0.smithi057.stdout:7/131: sync 2024-04-25T22:42:13.277 INFO:tasks.workunit.client.0.smithi057.stdout:4/151: chown d14/f28 16578237 1 2024-04-25T22:42:13.277 INFO:tasks.workunit.client.0.smithi057.stdout:1/137: sync 2024-04-25T22:42:13.277 INFO:tasks.workunit.client.0.smithi057.stdout:9/181: sync 2024-04-25T22:42:13.277 INFO:tasks.workunit.client.0.smithi057.stdout:5/188: sync 2024-04-25T22:42:13.277 INFO:tasks.workunit.client.0.smithi057.stdout:0/119: sync 2024-04-25T22:42:13.278 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:13.276+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:13.278 INFO:tasks.workunit.client.0.smithi057.stdout:0/120: dread - d0/d3/f15 zero size 2024-04-25T22:42:13.278 INFO:tasks.workunit.client.0.smithi057.stdout:7/132: truncate d6/f16 8620830 0 2024-04-25T22:42:13.279 INFO:tasks.workunit.client.0.smithi057.stdout:5/189: write d2/f12 [851724,105222] 0 2024-04-25T22:42:13.279 INFO:tasks.workunit.client.0.smithi057.stdout:1/138: mknod d7/dd/d16/d24/c2b 0 2024-04-25T22:42:13.280 INFO:tasks.workunit.client.0.smithi057.stdout:9/182: creat d3/d26/d28/d2d/f40 x:0 0 0 2024-04-25T22:42:13.280 INFO:tasks.workunit.client.0.smithi057.stdout:8/133: dwrite d4/db/dd/f20 [0,4194304] 0 2024-04-25T22:42:13.280 INFO:tasks.workunit.client.0.smithi057.stdout:7/133: write d6/f1a [937544,115979] 0 2024-04-25T22:42:13.280 INFO:tasks.workunit.client.0.smithi057.stdout:4/152: rmdir d14/d31 0 2024-04-25T22:42:13.282 INFO:tasks.workunit.client.0.smithi057.stdout:7/134: write d6/d28/f2c [970530,88066] 0 2024-04-25T22:42:13.283 INFO:tasks.workunit.client.0.smithi057.stdout:3/149: dread d0/fa [0,4194304] 0 2024-04-25T22:42:13.284 INFO:tasks.workunit.client.0.smithi057.stdout:0/121: getdents d0/d3/d6/d14 0 2024-04-25T22:42:13.285 INFO:tasks.workunit.client.0.smithi057.stdout:6/149: dwrite d2/f2b [0,4194304] 0 2024-04-25T22:42:13.285 INFO:tasks.workunit.client.0.smithi057.stdout:7/135: link d6/d1b/d1d/f2a d6/d1b/f2d 0 2024-04-25T22:42:13.286 INFO:tasks.workunit.client.0.smithi057.stdout:3/150: creat d0/d4/d7/d26/f31 x:0 0 0 2024-04-25T22:42:13.289 INFO:tasks.workunit.client.0.smithi057.stdout:0/122: write d0/d5/dd/fe [3846323,48539] 0 2024-04-25T22:42:13.289 INFO:tasks.workunit.client.0.smithi057.stdout:9/183: dread d3/f9 [0,4194304] 0 2024-04-25T22:42:13.290 INFO:tasks.workunit.client.0.smithi057.stdout:3/151: symlink d0/l32 0 2024-04-25T22:42:13.291 INFO:tasks.workunit.client.0.smithi057.stdout:4/153: rename d14/d2f/l32 to d14/l33 0 2024-04-25T22:42:13.291 INFO:tasks.workunit.client.0.smithi057.stdout:0/123: fsync d0/d5/ff 0 2024-04-25T22:42:13.291 INFO:tasks.workunit.client.0.smithi057.stdout:1/139: dread d7/dd/d16/d24/f25 [0,4194304] 0 2024-04-25T22:42:13.291 INFO:tasks.workunit.client.0.smithi057.stdout:5/190: dwrite d2/f12 [0,4194304] 0 2024-04-25T22:42:13.292 INFO:tasks.workunit.client.0.smithi057.stdout:9/184: creat d3/d26/f41 x:0 0 0 2024-04-25T22:42:13.292 INFO:tasks.workunit.client.0.smithi057.stdout:8/134: rename d4/db/dd/df/f1e to d4/db/f34 0 2024-04-25T22:42:13.293 INFO:tasks.workunit.client.0.smithi057.stdout:4/154: mknod d14/d2f/c34 0 2024-04-25T22:42:13.293 INFO:tasks.workunit.client.0.smithi057.stdout:5/191: write d2/f10 [2122403,35335] 0 2024-04-25T22:42:13.293 INFO:tasks.workunit.client.0.smithi057.stdout:8/135: readlink d4/d5/l28 0 2024-04-25T22:42:13.293 INFO:tasks.workunit.client.0.smithi057.stdout:4/155: rmdir d14/d2f 39 2024-04-25T22:42:13.293 INFO:tasks.workunit.client.0.smithi057.stdout:9/185: write d3/f1a [888197,3035] 0 2024-04-25T22:42:13.293 INFO:tasks.workunit.client.0.smithi057.stdout:5/192: fdatasync d2/d2c/f36 0 2024-04-25T22:42:13.294 INFO:tasks.workunit.client.0.smithi057.stdout:3/152: rename d0/d4/d7/f1d to d0/f33 0 2024-04-25T22:42:13.294 INFO:tasks.workunit.client.0.smithi057.stdout:8/136: unlink c3 0 2024-04-25T22:42:13.294 INFO:tasks.workunit.client.0.smithi057.stdout:9/186: rmdir d3 39 2024-04-25T22:42:13.294 INFO:tasks.workunit.client.0.smithi057.stdout:4/156: stat d14/c1b 0 2024-04-25T22:42:13.295 INFO:tasks.workunit.client.0.smithi057.stdout:1/140: rename d7/dd/d16/d18/c1c to d7/dd/d26/c2c 0 2024-04-25T22:42:13.295 INFO:tasks.workunit.client.0.smithi057.stdout:5/193: dread - d2/d6/db/d1a/f35 zero size 2024-04-25T22:42:13.295 INFO:tasks.workunit.client.0.smithi057.stdout:9/187: chown d3/d26/l2f 112568253 1 2024-04-25T22:42:13.296 INFO:tasks.workunit.client.0.smithi057.stdout:3/153: mkdir d0/d4/d34 0 2024-04-25T22:42:13.296 INFO:tasks.workunit.client.0.smithi057.stdout:8/137: mkdir d4/d5/d17/d19/d35 0 2024-04-25T22:42:13.296 INFO:tasks.workunit.client.0.smithi057.stdout:1/141: truncate d7/dd/f28 352446 0 2024-04-25T22:42:13.297 INFO:tasks.workunit.client.0.smithi057.stdout:6/150: read d2/d9/d1a/f28 [273521,108071] 0 2024-04-25T22:42:13.297 INFO:tasks.workunit.client.0.smithi057.stdout:3/154: chown d0/d11/c18 895846 1 2024-04-25T22:42:13.298 INFO:tasks.workunit.client.0.smithi057.stdout:8/138: creat d4/db/d12/f36 x:0 0 0 2024-04-25T22:42:13.298 INFO:tasks.workunit.client.0.smithi057.stdout:5/194: link d2/c3 d2/d1c/d24/c39 0 2024-04-25T22:42:13.298 INFO:tasks.workunit.client.0.smithi057.stdout:1/142: mknod d7/dd/c2d 0 2024-04-25T22:42:13.298 INFO:tasks.workunit.client.0.smithi057.stdout:2/159: dread f3 [0,4194304] 0 2024-04-25T22:42:13.298 INFO:tasks.workunit.client.0.smithi057.stdout:6/151: readlink d2/l16 0 2024-04-25T22:42:13.299 INFO:tasks.workunit.client.0.smithi057.stdout:8/139: fsync d4/d5/d17/d19/f26 0 2024-04-25T22:42:13.299 INFO:tasks.workunit.client.0.smithi057.stdout:3/155: symlink d0/d4/d7/d22/l35 0 2024-04-25T22:42:13.299 INFO:tasks.workunit.client.0.smithi057.stdout:0/124: dwrite d0/d3/d6/f1b [0,4194304] 0 2024-04-25T22:42:13.299 INFO:tasks.workunit.client.0.smithi057.stdout:5/195: mkdir d2/d6/db/d1a/d3a 0 2024-04-25T22:42:13.300 INFO:tasks.workunit.client.0.smithi057.stdout:3/156: write d0/d4/f21 [837216,90082] 0 2024-04-25T22:42:13.300 INFO:tasks.workunit.client.0.smithi057.stdout:1/143: creat d7/dd/d16/d24/f2e x:0 0 0 2024-04-25T22:42:13.301 INFO:tasks.workunit.client.0.smithi057.stdout:1/144: chown d7/dd/d16/d18 310 1 2024-04-25T22:42:13.302 INFO:tasks.workunit.client.0.smithi057.stdout:0/125: stat d0/d3/d6/d14/c1f 0 2024-04-25T22:42:13.303 INFO:tasks.workunit.client.0.smithi057.stdout:7/136: truncate d6/f16 807938 0 2024-04-25T22:42:13.305 INFO:tasks.workunit.client.0.smithi057.stdout:4/157: getdents d14 0 2024-04-25T22:42:13.305 INFO:tasks.workunit.client.0.smithi057.stdout:5/196: rename d2/d1c/d24/c39 to d2/d1c/d24/c3b 0 2024-04-25T22:42:13.305 INFO:tasks.workunit.client.0.smithi057.stdout:8/140: link d4/db/d12/c2e d4/d5/d17/d19/d35/c37 0 2024-04-25T22:42:13.307 INFO:tasks.workunit.client.0.smithi057.stdout:2/160: dwrite d1f/d21/f22 [0,4194304] 0 2024-04-25T22:42:13.307 INFO:tasks.workunit.client.0.smithi057.stdout:1/145: dread d7/dd/d16/d18/f21 [0,4194304] 0 2024-04-25T22:42:13.307 INFO:tasks.workunit.client.0.smithi057.stdout:0/126: getdents d0/d5 0 2024-04-25T22:42:13.307 INFO:tasks.workunit.client.0.smithi057.stdout:2/161: chown c17 0 1 2024-04-25T22:42:13.308 INFO:tasks.workunit.client.0.smithi057.stdout:1/146: rmdir d7/dd/d16 39 2024-04-25T22:42:13.308 INFO:tasks.workunit.client.0.smithi057.stdout:2/162: chown f1d 27 1 2024-04-25T22:42:13.308 INFO:tasks.workunit.client.0.smithi057.stdout:5/197: symlink d2/d6/db/d1a/d3a/l3c 0 2024-04-25T22:42:13.309 INFO:tasks.workunit.client.0.smithi057.stdout:8/141: rename d4/d5/la to d4/db/dd/df/l38 0 2024-04-25T22:42:13.310 INFO:tasks.workunit.client.0.smithi057.stdout:2/163: read d1f/d21/f25 [1943731,116468] 0 2024-04-25T22:42:13.310 INFO:tasks.workunit.client.0.smithi057.stdout:0/127: link d0/d5/c1a d0/d3/d6/d14/c26 0 2024-04-25T22:42:13.310 INFO:tasks.workunit.client.0.smithi057.stdout:8/142: unlink d4/db/dd/f1b 0 2024-04-25T22:42:13.310 INFO:tasks.workunit.client.0.smithi057.stdout:2/164: chown d1f/d21/l23 186750 1 2024-04-25T22:42:13.311 INFO:tasks.workunit.client.0.smithi057.stdout:8/143: creat d4/d5/f39 x:0 0 0 2024-04-25T22:42:13.311 INFO:tasks.workunit.client.0.smithi057.stdout:5/198: readlink d2/d1c/d24/l33 0 2024-04-25T22:42:13.311 INFO:tasks.workunit.client.0.smithi057.stdout:1/147: unlink d7/dd/d16/d18/f21 0 2024-04-25T22:42:13.312 INFO:tasks.workunit.client.0.smithi057.stdout:1/148: chown d7/dd/c2d 1943806 1 2024-04-25T22:42:13.313 INFO:tasks.workunit.client.0.smithi057.stdout:2/165: chown d1f/d21/d26/f29 16461 1 2024-04-25T22:42:13.313 INFO:tasks.workunit.client.0.smithi057.stdout:4/158: dwrite d14/f23 [0,4194304] 0 2024-04-25T22:42:13.313 INFO:tasks.workunit.client.0.smithi057.stdout:5/199: chown d2/d6/db/d1a/d3a/l3c 176 1 2024-04-25T22:42:13.313 INFO:tasks.workunit.client.0.smithi057.stdout:3/157: dread d0/d11/f1c [0,4194304] 0 2024-04-25T22:42:13.314 INFO:tasks.workunit.client.0.smithi057.stdout:2/166: mknod d1f/d21/c2f 0 2024-04-25T22:42:13.314 INFO:tasks.workunit.client.0.smithi057.stdout:4/159: symlink d14/l35 0 2024-04-25T22:42:13.314 INFO:tasks.workunit.client.0.smithi057.stdout:8/144: mkdir d4/db/dd/d3a 0 2024-04-25T22:42:13.315 INFO:tasks.workunit.client.0.smithi057.stdout:3/158: creat d0/d11/f36 x:0 0 0 2024-04-25T22:42:13.315 INFO:tasks.workunit.client.0.smithi057.stdout:8/145: dread - d4/db/dd/f2b zero size 2024-04-25T22:42:13.316 INFO:tasks.workunit.client.0.smithi057.stdout:8/146: chown d4/db/dd/f20 2317840 1 2024-04-25T22:42:13.316 INFO:tasks.workunit.client.0.smithi057.stdout:0/128: link d0/d5/l1e d0/d3/l27 0 2024-04-25T22:42:13.317 INFO:tasks.workunit.client.0.smithi057.stdout:5/200: rename d2/d1c/d24/d2a to d2/d1c/d24/d3d 0 2024-04-25T22:42:13.317 INFO:tasks.workunit.client.0.smithi057.stdout:3/159: rmdir d0/d4/d7/d22 39 2024-04-25T22:42:13.318 INFO:tasks.workunit.client.0.smithi057.stdout:0/129: chown d0/f17 710135 1 2024-04-25T22:42:13.319 INFO:tasks.workunit.client.0.smithi057.stdout:3/160: readlink d0/d11/d27/l28 0 2024-04-25T22:42:13.319 INFO:tasks.workunit.client.0.smithi057.stdout:4/160: symlink d14/d2f/l36 0 2024-04-25T22:42:13.320 INFO:tasks.workunit.client.0.smithi057.stdout:8/147: creat d4/d5/d17/d19/d35/f3b x:0 0 0 2024-04-25T22:42:13.320 INFO:tasks.workunit.client.0.smithi057.stdout:1/149: dwrite d7/dd/d16/d24/f2e [0,4194304] 0 2024-04-25T22:42:13.321 INFO:tasks.workunit.client.0.smithi057.stdout:0/130: creat d0/d3/d6/d14/f28 x:0 0 0 2024-04-25T22:42:13.321 INFO:tasks.workunit.client.0.smithi057.stdout:4/161: symlink d14/d2f/l37 0 2024-04-25T22:42:13.321 INFO:tasks.workunit.client.0.smithi057.stdout:3/161: mkdir d0/d37 0 2024-04-25T22:42:13.321 INFO:tasks.workunit.client.0.smithi057.stdout:5/201: write d2/d6/db/f38 [246536,96210] 0 2024-04-25T22:42:13.322 INFO:tasks.workunit.client.0.smithi057.stdout:8/148: chown d4/db/dd/l1f 3 1 2024-04-25T22:42:13.323 INFO:tasks.workunit.client.0.smithi057.stdout:0/131: mkdir d0/d3/d6/d29 0 2024-04-25T22:42:13.323 INFO:tasks.workunit.client.0.smithi057.stdout:1/150: dread d7/dd/f28 [0,4194304] 0 2024-04-25T22:42:13.323 INFO:tasks.workunit.client.0.smithi057.stdout:5/202: creat d2/d6/f3e x:0 0 0 2024-04-25T22:42:13.323 INFO:tasks.workunit.client.0.smithi057.stdout:2/167: dwrite f11 [0,4194304] 0 2024-04-25T22:42:13.324 INFO:tasks.workunit.client.0.smithi057.stdout:3/162: write d0/d11/f1e [667372,108114] 0 2024-04-25T22:42:13.324 INFO:tasks.workunit.client.0.smithi057.stdout:5/203: stat f1 0 2024-04-25T22:42:13.324 INFO:tasks.workunit.client.0.smithi057.stdout:8/149: dread - d4/f32 zero size 2024-04-25T22:42:13.324 INFO:tasks.workunit.client.0.smithi057.stdout:2/168: chown d1f/d21 66092 1 2024-04-25T22:42:13.324 INFO:tasks.workunit.client.0.smithi057.stdout:5/204: dread - d2/d2c/f2e zero size 2024-04-25T22:42:13.324 INFO:tasks.workunit.client.0.smithi057.stdout:2/169: write f1d [629162,57641] 0 2024-04-25T22:42:13.325 INFO:tasks.workunit.client.0.smithi057.stdout:1/151: symlink d7/dd/d16/d18/l2f 0 2024-04-25T22:42:13.325 INFO:tasks.workunit.client.0.smithi057.stdout:0/132: creat d0/d3/d6/d29/f2a x:0 0 0 2024-04-25T22:42:13.325 INFO:tasks.workunit.client.0.smithi057.stdout:3/163: symlink d0/l38 0 2024-04-25T22:42:13.325 INFO:tasks.workunit.client.0.smithi057.stdout:8/150: stat d4/d5/d17/l1a 0 2024-04-25T22:42:13.326 INFO:tasks.workunit.client.0.smithi057.stdout:0/133: write d0/f9 [2917059,85608] 0 2024-04-25T22:42:13.327 INFO:tasks.workunit.client.0.smithi057.stdout:5/205: symlink d2/d6/db/l3f 0 2024-04-25T22:42:13.327 INFO:tasks.workunit.client.0.smithi057.stdout:8/151: rmdir d4/db/dd/df/d22 39 2024-04-25T22:42:13.327 INFO:tasks.workunit.client.0.smithi057.stdout:3/164: symlink d0/d4/d7/d22/l39 0 2024-04-25T22:42:13.329 INFO:tasks.workunit.client.0.smithi057.stdout:1/152: rename d7/dd/d16/d24/f25 to d7/dd/f30 0 2024-04-25T22:42:13.329 INFO:tasks.workunit.client.0.smithi057.stdout:3/165: creat d0/d11/d27/f3a x:0 0 0 2024-04-25T22:42:13.329 INFO:tasks.workunit.client.0.smithi057.stdout:9/188: dread d3/f12 [0,4194304] 0 2024-04-25T22:42:13.329 INFO:tasks.workunit.client.0.smithi057.stdout:3/166: creat d0/d11/f3b x:0 0 0 2024-04-25T22:42:13.330 INFO:tasks.workunit.client.0.smithi057.stdout:0/134: rename d0/d3/d6/d14/f28 to d0/f2b 0 2024-04-25T22:42:13.330 INFO:tasks.workunit.client.0.smithi057.stdout:9/189: dread - d3/d26/d28/f37 zero size 2024-04-25T22:42:13.330 INFO:tasks.workunit.client.0.smithi057.stdout:8/152: link d4/db/f34 d4/db/dd/d3a/f3c 0 2024-04-25T22:42:13.331 INFO:tasks.workunit.client.0.smithi057.stdout:3/167: write d0/f1b [1438273,36387] 0 2024-04-25T22:42:13.331 INFO:tasks.workunit.client.0.smithi057.stdout:9/190: chown d3/d26 13811525 1 2024-04-25T22:42:13.331 INFO:tasks.workunit.client.0.smithi057.stdout:0/135: mknod d0/d3/d6/d29/c2c 0 2024-04-25T22:42:13.331 INFO:tasks.workunit.client.0.smithi057.stdout:8/153: mkdir d4/db/dd/df/d3d 0 2024-04-25T22:42:13.332 INFO:tasks.workunit.client.0.smithi057.stdout:3/168: mkdir d0/d4/d34/d3c 0 2024-04-25T22:42:13.332 INFO:tasks.workunit.client.0.smithi057.stdout:9/191: write d3/d26/d28/f37 [723333,117271] 0 2024-04-25T22:42:13.332 INFO:tasks.workunit.client.0.smithi057.stdout:8/154: fdatasync d4/db/dd/fe 0 2024-04-25T22:42:13.333 INFO:tasks.workunit.client.0.smithi057.stdout:8/155: creat d4/db/d12/f3e x:0 0 0 2024-04-25T22:42:13.333 INFO:tasks.workunit.client.0.smithi057.stdout:3/169: mkdir d0/d4/d7/d26/d3d 0 2024-04-25T22:42:13.335 INFO:tasks.workunit.client.0.smithi057.stdout:0/136: dread d0/d3/f7 [0,4194304] 0 2024-04-25T22:42:13.336 INFO:tasks.workunit.client.0.smithi057.stdout:5/206: dwrite d2/d6/db/d1a/f35 [0,4194304] 0 2024-04-25T22:42:13.337 INFO:tasks.workunit.client.0.smithi057.stdout:1/153: dwrite d7/dd/d16/d18/f2a [0,4194304] 0 2024-04-25T22:42:13.340 INFO:tasks.workunit.client.0.smithi057.stdout:9/192: fsync d3/d26/d28/f37 0 2024-04-25T22:42:13.344 INFO:tasks.workunit.client.0.smithi057.stdout:0/137: dwrite d0/d3/fc [0,4194304] 0 2024-04-25T22:42:13.345 INFO:tasks.workunit.client.0.smithi057.stdout:9/193: getdents d3/d26/d28 0 2024-04-25T22:42:13.346 INFO:tasks.workunit.client.0.smithi057.stdout:6/152: dread d2/d9/ff [0,4194304] 0 2024-04-25T22:42:13.347 INFO:tasks.workunit.client.0.smithi057.stdout:1/154: dwrite d7/dd/d16/d18/f23 [0,4194304] 0 2024-04-25T22:42:13.347 INFO:tasks.workunit.client.0.smithi057.stdout:5/207: dwrite d2/d1c/f1f [0,4194304] 0 2024-04-25T22:42:13.347 INFO:tasks.workunit.client.0.smithi057.stdout:0/138: truncate d0/d5/f23 292595 0 2024-04-25T22:42:13.348 INFO:tasks.workunit.client.0.smithi057.stdout:9/194: write d3/f12 [5541517,38588] 0 2024-04-25T22:42:13.348 INFO:tasks.workunit.client.0.smithi057.stdout:5/208: symlink d2/d1c/l40 0 2024-04-25T22:42:13.349 INFO:tasks.workunit.client.0.smithi057.stdout:5/209: unlink d2/f12 0 2024-04-25T22:42:13.350 INFO:tasks.workunit.client.0.smithi057.stdout:5/210: mknod d2/d1c/c41 0 2024-04-25T22:42:13.350 INFO:tasks.workunit.client.0.smithi057.stdout:2/170: dread f1d [0,4194304] 0 2024-04-25T22:42:13.350 INFO:tasks.workunit.client.0.smithi057.stdout:5/211: rmdir d2/d6/db 39 2024-04-25T22:42:13.351 INFO:tasks.workunit.client.0.smithi057.stdout:6/153: dread d2/f2b [0,4194304] 0 2024-04-25T22:42:13.353 INFO:tasks.workunit.client.0.smithi057.stdout:2/171: mkdir d1f/d21/d26/d30 0 2024-04-25T22:42:13.353 INFO:tasks.workunit.client.0.smithi057.stdout:0/139: creat d0/f2d x:0 0 0 2024-04-25T22:42:13.353 INFO:tasks.workunit.client.0.smithi057.stdout:5/212: mkdir d2/d1c/d42 0 2024-04-25T22:42:13.353 INFO:tasks.workunit.client.0.smithi057.stdout:6/154: creat d2/d9/d1a/d22/d31/f33 x:0 0 0 2024-04-25T22:42:13.362 INFO:tasks.workunit.client.0.smithi057.stdout:5/213: dwrite d2/f10 [0,4194304] 0 2024-04-25T22:42:13.363 INFO:tasks.workunit.client.0.smithi057.stdout:9/195: dwrite d3/f1f [0,4194304] 0 2024-04-25T22:42:13.363 INFO:tasks.workunit.client.0.smithi057.stdout:0/140: dwrite d0/f2b [0,4194304] 0 2024-04-25T22:42:13.364 INFO:tasks.workunit.client.0.smithi057.stdout:1/155: dwrite d7/dd/f28 [0,4194304] 0 2024-04-25T22:42:13.364 INFO:tasks.workunit.client.0.smithi057.stdout:0/141: dread - d0/f2d zero size 2024-04-25T22:42:13.365 INFO:tasks.workunit.client.0.smithi057.stdout:6/155: dwrite d2/f14 [0,4194304] 0 2024-04-25T22:42:13.365 INFO:tasks.workunit.client.0.smithi057.stdout:5/214: chown f1 5825635 1 2024-04-25T22:42:13.365 INFO:tasks.workunit.client.0.smithi057.stdout:0/142: chown d0/d3/f7 63880647 1 2024-04-25T22:42:13.365 INFO:tasks.workunit.client.0.smithi057.stdout:0/143: read - d0/f2d zero size 2024-04-25T22:42:13.367 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:13.367 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:13.367 INFO:tasks.workunit.client.0.smithi057.stdout:1/156: mkdir d7/dd/d16/d18/d31 0 2024-04-25T22:42:13.367 INFO:tasks.workunit.client.0.smithi057.stdout:5/215: creat d2/d1c/d24/f43 x:0 0 0 2024-04-25T22:42:13.368 INFO:tasks.workunit.client.0.smithi057.stdout:5/216: read d2/d6/db/f17 [1642958,43633] 0 2024-04-25T22:42:13.369 INFO:tasks.workunit.client.0.smithi057.stdout:5/217: write d2/d6/f13 [255746,48891] 0 2024-04-25T22:42:13.370 INFO:tasks.workunit.client.0.smithi057.stdout:6/156: dread d2/d9/ff [0,4194304] 0 2024-04-25T22:42:13.370 INFO:tasks.workunit.client.0.smithi057.stdout:6/157: write d2/f2b [8655485,82284] 0 2024-04-25T22:42:13.373 INFO:tasks.workunit.client.0.smithi057.stdout:1/157: dwrite d7/dd/d16/d24/f2e [0,4194304] 0 2024-04-25T22:42:13.374 INFO:tasks.workunit.client.0.smithi057.stdout:5/218: dread f1 [0,4194304] 0 2024-04-25T22:42:13.375 INFO:tasks.workunit.client.0.smithi057.stdout:1/158: symlink d7/dd/d16/l32 0 2024-04-25T22:42:13.377 INFO:tasks.workunit.client.0.smithi057.stdout:5/219: fdatasync d2/d6/db/f2f 0 2024-04-25T22:42:13.378 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:13.376+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:13.379 INFO:tasks.workunit.client.0.smithi057.stdout:5/220: mknod d2/c44 0 2024-04-25T22:42:13.380 INFO:tasks.workunit.client.0.smithi057.stdout:1/159: dread d7/dd/f28 [0,4194304] 0 2024-04-25T22:42:13.382 INFO:tasks.workunit.client.0.smithi057.stdout:9/196: dwrite d3/d26/d28/d2d/f3d [0,4194304] 0 2024-04-25T22:42:13.382 INFO:tasks.workunit.client.0.smithi057.stdout:9/197: write d3/d26/f2b [1012335,72916] 0 2024-04-25T22:42:13.383 INFO:tasks.workunit.client.0.smithi057.stdout:9/198: unlink d3/f2a 0 2024-04-25T22:42:13.384 INFO:tasks.workunit.client.0.smithi057.stdout:9/199: write d3/f12 [9909643,121564] 0 2024-04-25T22:42:13.384 INFO:tasks.workunit.client.0.smithi057.stdout:9/200: chown d3/d26 3076688 1 2024-04-25T22:42:13.385 INFO:tasks.workunit.client.0.smithi057.stdout:1/160: dread d7/dd/d16/d18/f2a [0,4194304] 0 2024-04-25T22:42:13.385 INFO:tasks.workunit.client.0.smithi057.stdout:9/201: rmdir d3/d26/d28/d3f 0 2024-04-25T22:42:13.386 INFO:tasks.workunit.client.0.smithi057.stdout:9/202: write d3/d26/d28/d39/f3a [314547,67017] 0 2024-04-25T22:42:13.389 INFO:tasks.workunit.client.0.smithi057.stdout:6/158: fdatasync d2/f2b 0 2024-04-25T22:42:13.389 INFO:tasks.workunit.client.0.smithi057.stdout:6/159: fsync d2/d9/ff 0 2024-04-25T22:42:13.392 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:13.393 INFO:tasks.workunit.client.0.smithi057.stdout:9/203: read d3/f20 [766006,25973] 0 2024-04-25T22:42:13.394 INFO:tasks.workunit.client.0.smithi057.stdout:1/161: dread d7/dd/d16/d18/f2a [4194304,4194304] 0 2024-04-25T22:42:13.394 INFO:tasks.workunit.client.0.smithi057.stdout:9/204: rename d3/d26 to d3/d34/d42 0 2024-04-25T22:42:13.394 INFO:tasks.workunit.client.0.smithi057.stdout:1/162: rename d7/dd to d7/dd/d26/d33 22 2024-04-25T22:42:13.395 INFO:tasks.workunit.client.0.smithi057.stdout:1/163: read d7/dd/f28 [3060378,1958] 0 2024-04-25T22:42:13.399 INFO:tasks.workunit.client.0.smithi057.stdout:9/205: dwrite d3/f1f [4194304,4194304] 0 2024-04-25T22:42:13.400 INFO:tasks.workunit.client.0.smithi057.stdout:9/206: chown d3/f32 1 1 2024-04-25T22:42:13.401 INFO:tasks.workunit.client.0.smithi057.stdout:9/207: rmdir d3/d34/d42/d28 39 2024-04-25T22:42:13.401 INFO:tasks.workunit.client.0.smithi057.stdout:1/164: dwrite d7/dd/f14 [4194304,4194304] 0 2024-04-25T22:42:13.402 INFO:tasks.workunit.client.0.smithi057.stdout:9/208: rename d3/f13 to d3/d34/f43 0 2024-04-25T22:42:13.402 INFO:tasks.workunit.client.0.smithi057.stdout:1/165: fsync d7/dd/d16/d18/f2a 0 2024-04-25T22:42:13.403 INFO:tasks.workunit.client.0.smithi057.stdout:9/209: mknod d3/d34/d42/d28/d39/c44 0 2024-04-25T22:42:13.404 INFO:tasks.workunit.client.0.smithi057.stdout:9/210: chown d3/d34/d42/d28/d2d/f40 902473854 1 2024-04-25T22:42:13.405 INFO:tasks.workunit.client.0.smithi057.stdout:9/211: symlink d3/d34/d42/d28/d39/l45 0 2024-04-25T22:42:13.406 INFO:tasks.workunit.client.0.smithi057.stdout:9/212: creat d3/d34/d42/d28/d39/f46 x:0 0 0 2024-04-25T22:42:13.406 INFO:tasks.workunit.client.0.smithi057.stdout:1/166: dread d7/dd/f30 [0,4194304] 0 2024-04-25T22:42:13.407 INFO:tasks.workunit.client.0.smithi057.stdout:1/167: link d7/dd/d16/f1e d7/dd/d16/d18/f34 0 2024-04-25T22:42:13.410 INFO:tasks.workunit.client.0.smithi057.stdout:1/168: dread d7/dd/f28 [0,4194304] 0 2024-04-25T22:42:13.413 INFO:tasks.workunit.client.0.smithi057.stdout:2/172: dread f8 [0,4194304] 0 2024-04-25T22:42:13.413 INFO:tasks.workunit.client.0.smithi057.stdout:9/213: dread d3/d34/d42/d28/f37 [0,4194304] 0 2024-04-25T22:42:13.414 INFO:tasks.workunit.client.0.smithi057.stdout:2/173: truncate f6 1752855 0 2024-04-25T22:42:13.414 INFO:tasks.workunit.client.0.smithi057.stdout:9/214: rename d3/d34/l38 to d3/d34/d42/d28/d39/l47 0 2024-04-25T22:42:13.414 INFO:tasks.workunit.client.0.smithi057.stdout:2/174: creat d1f/d21/d26/f31 x:0 0 0 2024-04-25T22:42:13.415 INFO:tasks.workunit.client.0.smithi057.stdout:1/169: truncate d7/dd/f28 3935008 0 2024-04-25T22:42:13.415 INFO:tasks.workunit.client.0.smithi057.stdout:2/175: mknod d1f/d21/c32 0 2024-04-25T22:42:13.415 INFO:tasks.workunit.client.0.smithi057.stdout:1/170: rename d7/dd/f30 to d7/dd/d26/f35 0 2024-04-25T22:42:13.417 INFO:tasks.workunit.client.0.smithi057.stdout:2/176: getdents d1f/d21 0 2024-04-25T22:42:13.418 INFO:tasks.workunit.client.0.smithi057.stdout:2/177: fsync d1f/d21/d26/f2c 0 2024-04-25T22:42:13.418 INFO:tasks.workunit.client.0.smithi057.stdout:1/171: read f6 [186242,62845] 0 2024-04-25T22:42:13.418 INFO:tasks.workunit.client.0.smithi057.stdout:0/144: dread d0/d5/ff [0,4194304] 0 2024-04-25T22:42:13.418 INFO:tasks.workunit.client.0.smithi057.stdout:2/178: chown l19 4949 1 2024-04-25T22:42:13.418 INFO:tasks.workunit.client.0.smithi057.stdout:2/179: rename d1f/d21/d2d to d1f/d21/d33 0 2024-04-25T22:42:13.419 INFO:tasks.workunit.client.0.smithi057.stdout:1/172: getdents d7/dd/d26 0 2024-04-25T22:42:13.419 INFO:tasks.workunit.client.0.smithi057.stdout:1/173: creat d7/dd/d16/f36 x:0 0 0 2024-04-25T22:42:13.419 INFO:tasks.workunit.client.0.smithi057.stdout:2/180: write d1f/d21/f25 [3412340,71734] 0 2024-04-25T22:42:13.420 INFO:tasks.workunit.client.0.smithi057.stdout:1/174: symlink d7/dd/d26/l37 0 2024-04-25T22:42:13.421 INFO:tasks.workunit.client.0.smithi057.stdout:1/175: creat d7/dd/d16/d24/f38 x:0 0 0 2024-04-25T22:42:13.422 INFO:tasks.workunit.client.0.smithi057.stdout:2/181: dread f8 [0,4194304] 0 2024-04-25T22:42:13.422 INFO:tasks.workunit.client.0.smithi057.stdout:2/182: fsync f6 0 2024-04-25T22:42:13.423 INFO:tasks.workunit.client.0.smithi057.stdout:2/183: mkdir d1f/d34 0 2024-04-25T22:42:13.423 INFO:tasks.workunit.client.0.smithi057.stdout:0/145: dwrite d0/f2d [0,4194304] 0 2024-04-25T22:42:13.424 INFO:tasks.workunit.client.0.smithi057.stdout:2/184: symlink d1f/d21/d26/l35 0 2024-04-25T22:42:13.424 INFO:tasks.workunit.client.0.smithi057.stdout:2/185: unlink d1f/d21/c32 0 2024-04-25T22:42:13.425 INFO:tasks.workunit.client.0.smithi057.stdout:0/146: symlink d0/l2e 0 2024-04-25T22:42:13.425 INFO:tasks.workunit.client.0.smithi057.stdout:2/186: unlink fb 0 2024-04-25T22:42:13.425 INFO:tasks.workunit.client.0.smithi057.stdout:1/176: truncate d7/dd/d16/d18/f1d 2457439 0 2024-04-25T22:42:13.425 INFO:tasks.workunit.client.0.smithi057.stdout:2/187: mkdir d1f/d36 0 2024-04-25T22:42:13.430 INFO:tasks.workunit.client.0.smithi057.stdout:2/188: dread d1f/d21/f25 [0,4194304] 0 2024-04-25T22:42:13.434 INFO:tasks.workunit.client.0.smithi057.stdout:0/147: dwrite d0/f2d [0,4194304] 0 2024-04-25T22:42:13.434 INFO:tasks.workunit.client.0.smithi057.stdout:1/177: dwrite d7/dd/d16/f1e [0,4194304] 0 2024-04-25T22:42:13.435 INFO:tasks.workunit.client.0.smithi057.stdout:1/178: stat d7/dd/d26/l37 0 2024-04-25T22:42:13.436 INFO:tasks.workunit.client.0.smithi057.stdout:2/189: rename d1f/d21/d26/f2c to d1f/d21/f37 0 2024-04-25T22:42:13.436 INFO:tasks.workunit.client.0.smithi057.stdout:0/148: creat d0/d3/f2f x:0 0 0 2024-04-25T22:42:13.437 INFO:tasks.workunit.client.0.smithi057.stdout:1/179: fdatasync d7/dd/f28 0 2024-04-25T22:42:13.437 INFO:tasks.workunit.client.0.smithi057.stdout:0/149: chown d0/d3/d6/d14/c1f 234654179 1 2024-04-25T22:42:13.440 INFO:tasks.workunit.client.0.smithi057.stdout:0/150: rename d0/d5/dd/fe to d0/f30 0 2024-04-25T22:42:13.440 INFO:tasks.workunit.client.0.smithi057.stdout:0/151: truncate d0/d5/ff 5109408 0 2024-04-25T22:42:13.443 INFO:tasks.workunit.client.0.smithi057.stdout:2/190: dwrite d1f/d21/d26/f31 [0,4194304] 0 2024-04-25T22:42:13.443 INFO:tasks.workunit.client.0.smithi057.stdout:2/191: rename d1f to d1f/d21/d33/d38 22 2024-04-25T22:42:13.445 INFO:tasks.workunit.client.0.smithi057.stdout:2/192: unlink d1f/d21/d26/c27 0 2024-04-25T22:42:13.446 INFO:tasks.workunit.client.0.smithi057.stdout:2/193: creat d1f/d34/f39 x:0 0 0 2024-04-25T22:42:13.446 INFO:tasks.workunit.client.0.smithi057.stdout:2/194: truncate fe 200770 0 2024-04-25T22:42:13.447 INFO:tasks.workunit.client.0.smithi057.stdout:2/195: link d1f/f2a d1f/d21/d26/f3a 0 2024-04-25T22:42:13.448 INFO:tasks.workunit.client.0.smithi057.stdout:2/196: chown lf 380117 1 2024-04-25T22:42:13.451 INFO:tasks.workunit.client.0.smithi057.stdout:2/197: creat d1f/d21/d26/d30/f3b x:0 0 0 2024-04-25T22:42:13.452 INFO:tasks.workunit.client.0.smithi057.stdout:2/198: symlink d1f/l3c 0 2024-04-25T22:42:13.453 INFO:tasks.workunit.client.0.smithi057.stdout:2/199: creat d1f/d34/f3d x:0 0 0 2024-04-25T22:42:13.456 INFO:tasks.workunit.client.0.smithi057.stdout:1/180: write d7/dd/d26/f35 [1238385,113437] 0 2024-04-25T22:42:13.460 INFO:tasks.workunit.client.0.smithi057.stdout:2/200: dwrite fe [0,4194304] 0 2024-04-25T22:42:13.466 INFO:tasks.workunit.client.0.smithi057.stdout:2/201: dwrite d1f/f20 [0,4194304] 0 2024-04-25T22:42:13.467 INFO:tasks.workunit.client.0.smithi057.stdout:2/202: dread f1d [0,4194304] 0 2024-04-25T22:42:13.468 INFO:tasks.workunit.client.0.smithi057.stdout:7/137: sync 2024-04-25T22:42:13.468 INFO:tasks.workunit.client.0.smithi057.stdout:8/156: sync 2024-04-25T22:42:13.468 INFO:tasks.workunit.client.0.smithi057.stdout:2/203: creat d1f/d21/f3e x:0 0 0 2024-04-25T22:42:13.468 INFO:tasks.workunit.client.0.smithi057.stdout:3/170: sync 2024-04-25T22:42:13.468 INFO:tasks.workunit.client.0.smithi057.stdout:4/162: sync 2024-04-25T22:42:13.468 INFO:tasks.workunit.client.0.smithi057.stdout:8/157: fsync d4/d5/f33 0 2024-04-25T22:42:13.468 INFO:tasks.workunit.client.0.smithi057.stdout:2/204: fdatasync f6 0 2024-04-25T22:42:13.469 INFO:tasks.workunit.client.0.smithi057.stdout:3/171: chown d0/d11/f3b 9246 1 2024-04-25T22:42:13.469 INFO:tasks.workunit.client.0.smithi057.stdout:7/138: creat d6/d1b/f2e x:0 0 0 2024-04-25T22:42:13.469 INFO:tasks.workunit.client.0.smithi057.stdout:3/172: write d0/d4/d7/d26/f31 [717377,6836] 0 2024-04-25T22:42:13.469 INFO:tasks.workunit.client.0.smithi057.stdout:8/158: creat d4/db/dd/df/d22/f3f x:0 0 0 2024-04-25T22:42:13.470 INFO:tasks.workunit.client.0.smithi057.stdout:2/205: rename d1f/d21/d26/l35 to d1f/d21/l3f 0 2024-04-25T22:42:13.470 INFO:tasks.workunit.client.0.smithi057.stdout:8/159: dread - d4/db/d12/f1c zero size 2024-04-25T22:42:13.470 INFO:tasks.workunit.client.0.smithi057.stdout:2/206: unlink d1f/l3c 0 2024-04-25T22:42:13.470 INFO:tasks.workunit.client.0.smithi057.stdout:3/173: mknod d0/c3e 0 2024-04-25T22:42:13.470 INFO:tasks.workunit.client.0.smithi057.stdout:7/139: link d6/d1b/d1d/l1e d6/d1b/l2f 0 2024-04-25T22:42:13.471 INFO:tasks.workunit.client.0.smithi057.stdout:8/160: mknod d4/d5/d17/c40 0 2024-04-25T22:42:13.471 INFO:tasks.workunit.client.0.smithi057.stdout:2/207: creat d1f/d21/d33/f40 x:0 0 0 2024-04-25T22:42:13.471 INFO:tasks.workunit.client.0.smithi057.stdout:7/140: mkdir d6/d1b/d30 0 2024-04-25T22:42:13.473 INFO:tasks.workunit.client.0.smithi057.stdout:8/161: rename d4/db/dd/fe to d4/d5/d2f/f41 0 2024-04-25T22:42:13.474 INFO:tasks.workunit.client.0.smithi057.stdout:8/162: creat d4/db/f42 x:0 0 0 2024-04-25T22:42:13.474 INFO:tasks.workunit.client.0.smithi057.stdout:4/163: dwrite ff [0,4194304] 0 2024-04-25T22:42:13.475 INFO:tasks.workunit.client.0.smithi057.stdout:3/174: dread d0/d4/f9 [0,4194304] 0 2024-04-25T22:42:13.476 INFO:tasks.workunit.client.0.smithi057.stdout:4/164: chown d14/f26 0 1 2024-04-25T22:42:13.477 INFO:tasks.workunit.client.0.smithi057.stdout:3/175: creat d0/d4/d7/d26/f3f x:0 0 0 2024-04-25T22:42:13.477 INFO:tasks.workunit.client.0.smithi057.stdout:4/165: creat d14/d2f/f38 x:0 0 0 2024-04-25T22:42:13.478 INFO:tasks.workunit.client.0.smithi057.stdout:3/176: unlink d0/d11/f1f 0 2024-04-25T22:42:13.478 INFO:tasks.workunit.client.0.smithi057.stdout:2/208: getdents d1f 0 2024-04-25T22:42:13.478 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:13.471+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:13.479 INFO:tasks.workunit.client.0.smithi057.stdout:7/141: dwrite d6/fb [0,4194304] 0 2024-04-25T22:42:13.479 INFO:tasks.workunit.client.0.smithi057.stdout:3/177: chown d0/d11/d27 23191044 1 2024-04-25T22:42:13.479 INFO:tasks.workunit.client.0.smithi057.stdout:2/209: chown d1f/d21/d26/f31 14144591 1 2024-04-25T22:42:13.479 INFO:tasks.workunit.client.0.smithi057.stdout:7/142: chown d6/fb 829207839 1 2024-04-25T22:42:13.479 INFO:tasks.workunit.client.0.smithi057.stdout:3/178: dread - d0/d11/d27/f29 zero size 2024-04-25T22:42:13.480 INFO:tasks.workunit.client.0.smithi057.stdout:7/143: rmdir d6/d28 39 2024-04-25T22:42:13.480 INFO:tasks.workunit.client.0.smithi057.stdout:2/210: rename d1f/c2b to d1f/d21/d33/c41 0 2024-04-25T22:42:13.484 INFO:tasks.workunit.client.0.smithi057.stdout:2/211: write f3 [2231479,118026] 0 2024-04-25T22:42:13.485 INFO:tasks.workunit.client.0.smithi057.stdout:2/212: creat d1f/f42 x:0 0 0 2024-04-25T22:42:13.485 INFO:tasks.workunit.client.0.smithi057.stdout:4/166: read d14/f17 [3311523,103683] 0 2024-04-25T22:42:13.485 INFO:tasks.workunit.client.0.smithi057.stdout:2/213: write d1f/d34/f3d [621558,85164] 0 2024-04-25T22:42:13.486 INFO:tasks.workunit.client.0.smithi057.stdout:4/167: rmdir d14/d2f 39 2024-04-25T22:42:13.486 INFO:tasks.workunit.client.0.smithi057.stdout:2/214: chown d1f/d21/d26/f3a 67373 1 2024-04-25T22:42:13.487 INFO:tasks.workunit.client.0.smithi057.stdout:2/215: fsync d1f/d21/f22 0 2024-04-25T22:42:13.487 INFO:tasks.workunit.client.0.smithi057.stdout:7/144: dwrite d6/f26 [0,4194304] 0 2024-04-25T22:42:13.487 INFO:tasks.workunit.client.0.smithi057.stdout:4/168: rename d14/f26 to d14/f39 0 2024-04-25T22:42:13.489 INFO:tasks.workunit.client.0.smithi057.stdout:7/145: creat d6/d1b/f31 x:0 0 0 2024-04-25T22:42:13.489 INFO:tasks.workunit.client.0.smithi057.stdout:4/169: write d14/f16 [325392,126677] 0 2024-04-25T22:42:13.489 INFO:tasks.workunit.client.0.smithi057.stdout:7/146: mkdir d6/d32 0 2024-04-25T22:42:13.491 INFO:tasks.workunit.client.0.smithi057.stdout:4/170: link d14/f16 d14/d2f/f3a 0 2024-04-25T22:42:13.492 INFO:tasks.workunit.client.0.smithi057.stdout:7/147: write f1 [1723533,46186] 0 2024-04-25T22:42:13.493 INFO:tasks.workunit.client.0.smithi057.stdout:2/216: dread f9 [0,4194304] 0 2024-04-25T22:42:13.493 INFO:tasks.workunit.client.0.smithi057.stdout:7/148: rename d6/fa to d6/d28/f33 0 2024-04-25T22:42:13.494 INFO:tasks.workunit.client.0.smithi057.stdout:2/217: symlink d1f/d21/d26/l43 0 2024-04-25T22:42:13.494 INFO:tasks.workunit.client.0.smithi057.stdout:2/218: creat d1f/d34/f44 x:0 0 0 2024-04-25T22:42:13.494 INFO:tasks.workunit.client.0.smithi057.stdout:7/149: symlink d6/d1b/d1d/l34 0 2024-04-25T22:42:13.495 INFO:tasks.workunit.client.0.smithi057.stdout:7/150: truncate f1 2105747 0 2024-04-25T22:42:13.495 INFO:tasks.workunit.client.0.smithi057.stdout:2/219: link d1f/d21/f3e d1f/d21/f45 0 2024-04-25T22:42:13.496 INFO:tasks.workunit.client.0.smithi057.stdout:2/220: creat d1f/d21/f46 x:0 0 0 2024-04-25T22:42:13.496 INFO:tasks.workunit.client.0.smithi057.stdout:2/221: write d1f/d34/f39 [635006,28012] 0 2024-04-25T22:42:13.496 INFO:tasks.workunit.client.0.smithi057.stdout:4/171: dread d14/f39 [0,4194304] 0 2024-04-25T22:42:13.497 INFO:tasks.workunit.client.0.smithi057.stdout:2/222: mknod d1f/d21/d26/c47 0 2024-04-25T22:42:13.497 INFO:tasks.workunit.client.0.smithi057.stdout:2/223: stat c17 0 2024-04-25T22:42:13.497 INFO:tasks.workunit.client.0.smithi057.stdout:4/172: creat d14/f3b x:0 0 0 2024-04-25T22:42:13.497 INFO:tasks.workunit.client.0.smithi057.stdout:4/173: chown d14/f17 1758442 1 2024-04-25T22:42:13.498 INFO:tasks.workunit.client.0.smithi057.stdout:2/224: write d1f/d34/f3d [1138472,96292] 0 2024-04-25T22:42:13.498 INFO:tasks.workunit.client.0.smithi057.stdout:4/174: fdatasync d14/f17 0 2024-04-25T22:42:13.498 INFO:tasks.workunit.client.0.smithi057.stdout:2/225: chown f8 1453914 1 2024-04-25T22:42:13.498 INFO:tasks.workunit.client.0.smithi057.stdout:4/175: mkdir d14/d3c 0 2024-04-25T22:42:13.499 INFO:tasks.workunit.client.0.smithi057.stdout:2/226: rename l13 to d1f/d21/d26/d30/l48 0 2024-04-25T22:42:13.499 INFO:tasks.workunit.client.0.smithi057.stdout:7/151: read d6/d1b/d1d/f2a [20665,6119] 0 2024-04-25T22:42:13.499 INFO:tasks.workunit.client.0.smithi057.stdout:2/227: creat d1f/d21/d26/d30/f49 x:0 0 0 2024-04-25T22:42:13.500 INFO:tasks.workunit.client.0.smithi057.stdout:2/228: write d1f/f20 [2478913,122899] 0 2024-04-25T22:42:13.501 INFO:tasks.workunit.client.0.smithi057.stdout:1/181: sync 2024-04-25T22:42:13.501 INFO:tasks.workunit.client.0.smithi057.stdout:9/215: sync 2024-04-25T22:42:13.502 INFO:tasks.workunit.client.0.smithi057.stdout:0/152: sync 2024-04-25T22:42:13.502 INFO:tasks.workunit.client.0.smithi057.stdout:5/221: sync 2024-04-25T22:42:13.502 INFO:tasks.workunit.client.0.smithi057.stdout:6/160: sync 2024-04-25T22:42:13.502 INFO:tasks.workunit.client.0.smithi057.stdout:3/179: sync 2024-04-25T22:42:13.502 INFO:tasks.workunit.client.0.smithi057.stdout:0/153: stat d0/d5/c1a 0 2024-04-25T22:42:13.503 INFO:tasks.workunit.client.0.smithi057.stdout:5/222: write d2/d1c/f26 [363938,90942] 0 2024-04-25T22:42:13.503 INFO:tasks.workunit.client.0.smithi057.stdout:1/182: creat d7/dd/d16/d18/f39 x:0 0 0 2024-04-25T22:42:13.504 INFO:tasks.workunit.client.0.smithi057.stdout:3/180: truncate d0/d11/f1c 523195 0 2024-04-25T22:42:13.504 INFO:tasks.workunit.client.0.smithi057.stdout:6/161: getdents d2/d19/d26 0 2024-04-25T22:42:13.505 INFO:tasks.workunit.client.0.smithi057.stdout:1/183: chown d7/dd/d16/d18/d31 69813798 1 2024-04-25T22:42:13.506 INFO:tasks.workunit.client.0.smithi057.stdout:4/176: dwrite fc [0,4194304] 0 2024-04-25T22:42:13.506 INFO:tasks.workunit.client.0.smithi057.stdout:0/154: dread d0/d5/f23 [0,4194304] 0 2024-04-25T22:42:13.506 INFO:tasks.workunit.client.0.smithi057.stdout:5/223: link d2/lc d2/d6/db/l45 0 2024-04-25T22:42:13.507 INFO:tasks.workunit.client.0.smithi057.stdout:6/162: mknod d2/d19/c34 0 2024-04-25T22:42:13.508 INFO:tasks.workunit.client.0.smithi057.stdout:4/177: dread - d14/f28 zero size 2024-04-25T22:42:13.509 INFO:tasks.workunit.client.0.smithi057.stdout:2/229: dwrite d1f/d21/d26/f31 [0,4194304] 0 2024-04-25T22:42:13.510 INFO:tasks.workunit.client.0.smithi057.stdout:7/152: write d6/d1b/f22 [596448,77043] 0 2024-04-25T22:42:13.510 INFO:tasks.workunit.client.0.smithi057.stdout:1/184: creat d7/dd/d16/d24/f3a x:0 0 0 2024-04-25T22:42:13.510 INFO:tasks.workunit.client.0.smithi057.stdout:6/163: symlink d2/d9/l35 0 2024-04-25T22:42:13.513 INFO:tasks.workunit.client.0.smithi057.stdout:3/181: getdents d0/d11/d27 0 2024-04-25T22:42:13.513 INFO:tasks.workunit.client.0.smithi057.stdout:4/178: mkdir d14/d3d 0 2024-04-25T22:42:13.513 INFO:tasks.workunit.client.0.smithi057.stdout:6/164: unlink d2/d9/d1a/f28 0 2024-04-25T22:42:13.514 INFO:tasks.workunit.client.0.smithi057.stdout:2/230: getdents d1f/d21 0 2024-04-25T22:42:13.514 INFO:tasks.workunit.client.0.smithi057.stdout:5/224: dread d2/d2c/f36 [0,4194304] 0 2024-04-25T22:42:13.515 INFO:tasks.workunit.client.0.smithi057.stdout:0/155: dwrite d0/d5/ff [0,4194304] 0 2024-04-25T22:42:13.515 INFO:tasks.workunit.client.0.smithi057.stdout:3/182: write d0/d4/d7/f2f [1343747,45021] 0 2024-04-25T22:42:13.515 INFO:tasks.workunit.client.0.smithi057.stdout:4/179: symlink d14/d3c/l3e 0 2024-04-25T22:42:13.516 INFO:tasks.workunit.client.0.smithi057.stdout:2/231: rmdir d1f/d21/d33 39 2024-04-25T22:42:13.517 INFO:tasks.workunit.client.0.smithi057.stdout:6/165: truncate d2/d9/f2a 4242 0 2024-04-25T22:42:13.517 INFO:tasks.workunit.client.0.smithi057.stdout:6/166: unlink d2/f17 0 2024-04-25T22:42:13.518 INFO:tasks.workunit.client.0.smithi057.stdout:4/180: truncate d14/f17 1372019 0 2024-04-25T22:42:13.518 INFO:tasks.workunit.client.0.smithi057.stdout:7/153: dread d6/f20 [0,4194304] 0 2024-04-25T22:42:13.519 INFO:tasks.workunit.client.0.smithi057.stdout:6/167: mknod d2/d9/c36 0 2024-04-25T22:42:13.520 INFO:tasks.workunit.client.0.smithi057.stdout:4/181: rename d14/c1d to d14/d3c/c3f 0 2024-04-25T22:42:13.520 INFO:tasks.workunit.client.0.smithi057.stdout:1/185: dwrite d7/dd/f28 [0,4194304] 0 2024-04-25T22:42:13.520 INFO:tasks.workunit.client.0.smithi057.stdout:7/154: mknod d6/d1b/d30/c35 0 2024-04-25T22:42:13.522 INFO:tasks.workunit.client.0.smithi057.stdout:1/186: chown d7/dd/d26/f35 175 1 2024-04-25T22:42:13.522 INFO:tasks.workunit.client.0.smithi057.stdout:2/232: write d1f/d21/f45 [736142,99948] 0 2024-04-25T22:42:13.523 INFO:tasks.workunit.client.0.smithi057.stdout:7/155: fdatasync d6/d1b/f31 0 2024-04-25T22:42:13.524 INFO:tasks.workunit.client.0.smithi057.stdout:5/225: dwrite d2/d2c/f2e [0,4194304] 0 2024-04-25T22:42:13.524 INFO:tasks.workunit.client.0.smithi057.stdout:3/183: truncate d0/d4/fd 3791408 0 2024-04-25T22:42:13.525 INFO:tasks.workunit.client.0.smithi057.stdout:1/187: truncate d7/dd/d26/f35 2690023 0 2024-04-25T22:42:13.525 INFO:tasks.workunit.client.0.smithi057.stdout:2/233: rename d1f/d21/d26/d30 to d1f/d4a 0 2024-04-25T22:42:13.526 INFO:tasks.workunit.client.0.smithi057.stdout:5/226: chown d2/d6/f13 3191 1 2024-04-25T22:42:13.526 INFO:tasks.workunit.client.0.smithi057.stdout:8/163: sync 2024-04-25T22:42:13.526 INFO:tasks.workunit.client.0.smithi057.stdout:6/168: sync 2024-04-25T22:42:13.526 INFO:tasks.workunit.client.0.smithi057.stdout:9/216: sync 2024-04-25T22:42:13.527 INFO:tasks.workunit.client.0.smithi057.stdout:0/156: dwrite d0/d3/d6/d29/f2a [0,4194304] 0 2024-04-25T22:42:13.530 INFO:tasks.workunit.client.0.smithi057.stdout:2/234: rename d1f/d21/d26/f31 to d1f/d4a/f4b 0 2024-04-25T22:42:13.530 INFO:tasks.workunit.client.0.smithi057.stdout:5/227: rename d2/d6/db/d1a to d2/d1c/d46 0 2024-04-25T22:42:13.530 INFO:tasks.workunit.client.0.smithi057.stdout:5/228: sync 2024-04-25T22:42:13.531 INFO:tasks.workunit.client.0.smithi057.stdout:2/235: symlink d1f/d36/l4c 0 2024-04-25T22:42:13.532 INFO:tasks.workunit.client.0.smithi057.stdout:8/164: dread - d4/db/dd/df/d22/f27 zero size 2024-04-25T22:42:13.532 INFO:tasks.workunit.client.0.smithi057.stdout:2/236: rmdir d1f 39 2024-04-25T22:42:13.533 INFO:tasks.workunit.client.0.smithi057.stdout:5/229: unlink d2/d1c/c41 0 2024-04-25T22:42:13.533 INFO:tasks.workunit.client.0.smithi057.stdout:4/182: dwrite d14/f22 [0,4194304] 0 2024-04-25T22:42:13.534 INFO:tasks.workunit.client.0.smithi057.stdout:2/237: write d1f/d34/f3d [1065319,80819] 0 2024-04-25T22:42:13.535 INFO:tasks.workunit.client.0.smithi057.stdout:3/184: dwrite d0/fe [0,4194304] 0 2024-04-25T22:42:13.535 INFO:tasks.workunit.client.0.smithi057.stdout:4/183: rename d14/f17 to d14/d3d/f40 0 2024-04-25T22:42:13.535 INFO:tasks.workunit.client.0.smithi057.stdout:8/165: unlink d4/d5/l28 0 2024-04-25T22:42:13.536 INFO:tasks.workunit.client.0.smithi057.stdout:2/238: mkdir d1f/d4a/d4d 0 2024-04-25T22:42:13.536 INFO:tasks.workunit.client.0.smithi057.stdout:3/185: unlink d0/d11/c15 0 2024-04-25T22:42:13.537 INFO:tasks.workunit.client.0.smithi057.stdout:9/217: dwrite d3/f24 [0,4194304] 0 2024-04-25T22:42:13.537 INFO:tasks.workunit.client.0.smithi057.stdout:4/184: chown l7 12689532 1 2024-04-25T22:42:13.537 INFO:tasks.workunit.client.0.smithi057.stdout:1/188: dread d7/dd/d26/f35 [0,4194304] 0 2024-04-25T22:42:13.539 INFO:tasks.workunit.client.0.smithi057.stdout:9/218: read d3/d34/d42/d28/f37 [839392,59780] 0 2024-04-25T22:42:13.539 INFO:tasks.workunit.client.0.smithi057.stdout:3/186: symlink d0/d11/d27/d30/l40 0 2024-04-25T22:42:13.539 INFO:tasks.workunit.client.0.smithi057.stdout:3/187: sync 2024-04-25T22:42:13.540 INFO:tasks.workunit.client.0.smithi057.stdout:1/189: dread - d7/dd/d16/f36 zero size 2024-04-25T22:42:13.540 INFO:tasks.workunit.client.0.smithi057.stdout:4/185: link d14/c29 d14/d2f/c41 0 2024-04-25T22:42:13.541 INFO:tasks.workunit.client.0.smithi057.stdout:9/219: chown d3/d34/d42/l2f 513 1 2024-04-25T22:42:13.541 INFO:tasks.workunit.client.0.smithi057.stdout:3/188: write d0/fa [1757434,56470] 0 2024-04-25T22:42:13.542 INFO:tasks.workunit.client.0.smithi057.stdout:5/230: dwrite d2/f31 [0,4194304] 0 2024-04-25T22:42:13.544 INFO:tasks.workunit.client.0.smithi057.stdout:4/186: dread - d14/f27 zero size 2024-04-25T22:42:13.546 INFO:tasks.workunit.client.0.smithi057.stdout:5/231: readlink d2/d6/db/l45 0 2024-04-25T22:42:13.546 INFO:tasks.workunit.client.0.smithi057.stdout:2/239: getdents d1f/d21/d26 0 2024-04-25T22:42:13.546 INFO:tasks.workunit.client.0.smithi057.stdout:4/187: dread - d14/d2f/f38 zero size 2024-04-25T22:42:13.546 INFO:tasks.workunit.client.0.smithi057.stdout:3/189: mknod d0/d11/c41 0 2024-04-25T22:42:13.547 INFO:tasks.workunit.client.0.smithi057.stdout:0/157: write d0/d5/f23 [1059150,27016] 0 2024-04-25T22:42:13.548 INFO:tasks.workunit.client.0.smithi057.stdout:8/166: dwrite d4/db/dd/df/d22/f3f [0,4194304] 0 2024-04-25T22:42:13.548 INFO:tasks.workunit.client.0.smithi057.stdout:2/240: fdatasync f9 0 2024-04-25T22:42:13.549 INFO:tasks.workunit.client.0.smithi057.stdout:5/232: write d2/f9 [553098,103133] 0 2024-04-25T22:42:13.551 INFO:tasks.workunit.client.0.smithi057.stdout:3/190: mknod d0/d4/c42 0 2024-04-25T22:42:13.551 INFO:tasks.workunit.client.0.smithi057.stdout:9/220: dwrite d3/f14 [0,4194304] 0 2024-04-25T22:42:13.552 INFO:tasks.workunit.client.0.smithi057.stdout:2/241: getdents d1f/d21/d26 0 2024-04-25T22:42:13.552 INFO:tasks.workunit.client.0.smithi057.stdout:5/233: mkdir d2/d47 0 2024-04-25T22:42:13.553 INFO:tasks.workunit.client.0.smithi057.stdout:8/167: creat d4/f43 x:0 0 0 2024-04-25T22:42:13.553 INFO:tasks.workunit.client.0.smithi057.stdout:0/158: link d0/l18 d0/d3/d6/l31 0 2024-04-25T22:42:13.553 INFO:tasks.workunit.client.0.smithi057.stdout:9/221: symlink d3/d34/d42/d28/d2d/l48 0 2024-04-25T22:42:13.554 INFO:tasks.workunit.client.0.smithi057.stdout:1/190: dwrite d7/dd/f28 [0,4194304] 0 2024-04-25T22:42:13.554 INFO:tasks.workunit.client.0.smithi057.stdout:8/168: dread - d4/d5/f23 zero size 2024-04-25T22:42:13.555 INFO:tasks.workunit.client.0.smithi057.stdout:2/242: write d1f/d21/d33/f40 [437911,33230] 0 2024-04-25T22:42:13.555 INFO:tasks.workunit.client.0.smithi057.stdout:3/191: rename d0/d4/d7/f24 to d0/d4/d7/d26/f43 0 2024-04-25T22:42:13.555 INFO:tasks.workunit.client.0.smithi057.stdout:5/234: creat d2/d1c/f48 x:0 0 0 2024-04-25T22:42:13.555 INFO:tasks.workunit.client.0.smithi057.stdout:2/243: dread - d1f/d34/f44 zero size 2024-04-25T22:42:13.557 INFO:tasks.workunit.client.0.smithi057.stdout:1/191: mknod d7/c3b 0 2024-04-25T22:42:13.557 INFO:tasks.workunit.client.0.smithi057.stdout:2/244: creat d1f/d21/d26/f4e x:0 0 0 2024-04-25T22:42:13.557 INFO:tasks.workunit.client.0.smithi057.stdout:8/169: creat d4/db/dd/df/d3d/f44 x:0 0 0 2024-04-25T22:42:13.557 INFO:tasks.workunit.client.0.smithi057.stdout:2/245: rmdir d1f/d36 39 2024-04-25T22:42:13.558 INFO:tasks.workunit.client.0.smithi057.stdout:1/192: mknod d7/dd/d26/c3c 0 2024-04-25T22:42:13.558 INFO:tasks.workunit.client.0.smithi057.stdout:2/246: stat d1f/d21/f2e 0 2024-04-25T22:42:13.559 INFO:tasks.workunit.client.0.smithi057.stdout:8/170: dread - d4/d5/d17/d19/f26 zero size 2024-04-25T22:42:13.565 INFO:tasks.workunit.client.0.smithi057.stdout:3/192: dwrite d0/d11/f36 [0,4194304] 0 2024-04-25T22:42:13.565 INFO:tasks.workunit.client.0.smithi057.stdout:0/159: dwrite d0/f17 [4194304,4194304] 0 2024-04-25T22:42:13.565 INFO:tasks.workunit.client.0.smithi057.stdout:4/188: getdents d14/d3d 0 2024-04-25T22:42:13.571 INFO:tasks.workunit.client.0.smithi057.stdout:1/193: rename d7/dd/f28 to d7/dd/d16/d18/f3d 0 2024-04-25T22:42:13.572 INFO:tasks.workunit.client.0.smithi057.stdout:4/189: chown d14/l2d 24 1 2024-04-25T22:42:13.573 INFO:tasks.workunit.client.0.smithi057.stdout:7/156: dread d6/f16 [0,4194304] 0 2024-04-25T22:42:13.573 INFO:tasks.workunit.client.0.smithi057.stdout:6/169: dread d2/d19/f1e [0,4194304] 0 2024-04-25T22:42:13.574 INFO:tasks.workunit.client.0.smithi057.stdout:4/190: chown d14/f16 56 1 2024-04-25T22:42:13.575 INFO:tasks.workunit.client.0.smithi057.stdout:9/222: dwrite d3/f24 [4194304,4194304] 0 2024-04-25T22:42:13.575 INFO:tasks.workunit.client.0.smithi057.stdout:6/170: readlink d2/l10 0 2024-04-25T22:42:13.576 INFO:tasks.workunit.client.0.smithi057.stdout:2/247: dwrite d1f/d21/f45 [0,4194304] 0 2024-04-25T22:42:13.576 INFO:tasks.workunit.client.0.smithi057.stdout:8/171: dwrite d4/db/fc [0,4194304] 0 2024-04-25T22:42:13.576 INFO:tasks.workunit.client.0.smithi057.stdout:1/194: write d7/dd/d16/d18/f2a [4983138,48517] 0 2024-04-25T22:42:13.576 INFO:tasks.workunit.client.0.smithi057.stdout:5/235: dwrite d2/d6/f7 [0,4194304] 0 2024-04-25T22:42:13.579 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:13.575+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:13.582 INFO:tasks.workunit.client.0.smithi057.stdout:6/171: chown d2/d9/c1b 42981372 1 2024-04-25T22:42:13.582 INFO:tasks.workunit.client.0.smithi057.stdout:9/223: stat d3/d34/d42/d28/d2d/l48 0 2024-04-25T22:42:13.582 INFO:tasks.workunit.client.0.smithi057.stdout:7/157: getdents d6/d32 0 2024-04-25T22:42:13.583 INFO:tasks.workunit.client.0.smithi057.stdout:3/193: dread d0/d4/d7/f2f [0,4194304] 0 2024-04-25T22:42:13.583 INFO:tasks.workunit.client.0.smithi057.stdout:6/172: mknod d2/d9/c37 0 2024-04-25T22:42:13.583 INFO:tasks.workunit.client.0.smithi057.stdout:5/236: write d2/d6/fa [6407417,20039] 0 2024-04-25T22:42:13.583 INFO:tasks.workunit.client.0.smithi057.stdout:9/224: mkdir d3/d34/d49 0 2024-04-25T22:42:13.583 INFO:tasks.workunit.client.0.smithi057.stdout:8/172: rmdir d4/d5/d17/d19/d31 0 2024-04-25T22:42:13.583 INFO:tasks.workunit.client.0.smithi057.stdout:6/173: dread - d2/f32 zero size 2024-04-25T22:42:13.584 INFO:tasks.workunit.client.0.smithi057.stdout:6/174: chown d2/d19/d26 986 1 2024-04-25T22:42:13.584 INFO:tasks.workunit.client.0.smithi057.stdout:9/225: mknod d3/d34/d42/c4a 0 2024-04-25T22:42:13.585 INFO:tasks.workunit.client.0.smithi057.stdout:8/173: chown d4/d5/d17/l1a 9876314 1 2024-04-25T22:42:13.585 INFO:tasks.workunit.client.0.smithi057.stdout:4/191: dwrite d14/f39 [0,4194304] 0 2024-04-25T22:42:13.585 INFO:tasks.workunit.client.0.smithi057.stdout:3/194: chown d0/d11/f1e 37943 1 2024-04-25T22:42:13.587 INFO:tasks.workunit.client.0.smithi057.stdout:7/158: rename d6/d1b/f2e to d6/d1b/d30/f36 0 2024-04-25T22:42:13.587 INFO:tasks.workunit.client.0.smithi057.stdout:9/226: truncate d3/d34/d42/f41 43756 0 2024-04-25T22:42:13.587 INFO:tasks.workunit.client.0.smithi057.stdout:8/174: fdatasync d4/db/dd/f18 0 2024-04-25T22:42:13.588 INFO:tasks.workunit.client.0.smithi057.stdout:1/195: dread d7/dd/d16/d18/f3d [0,4194304] 0 2024-04-25T22:42:13.588 INFO:tasks.workunit.client.0.smithi057.stdout:4/192: fdatasync d14/f20 0 2024-04-25T22:42:13.589 INFO:tasks.workunit.client.0.smithi057.stdout:7/159: write d6/f26 [792592,16493] 0 2024-04-25T22:42:13.589 INFO:tasks.workunit.client.0.smithi057.stdout:3/195: link d0/c3e d0/d4/d34/d3c/c44 0 2024-04-25T22:42:13.590 INFO:tasks.workunit.client.0.smithi057.stdout:1/196: read d7/dd/d16/f1e [2365458,47307] 0 2024-04-25T22:42:13.590 INFO:tasks.workunit.client.0.smithi057.stdout:8/175: truncate d4/db/dd/f2b 939096 0 2024-04-25T22:42:13.592 INFO:tasks.workunit.client.0.smithi057.stdout:8/176: chown d4/f25 4312960 1 2024-04-25T22:42:13.592 INFO:tasks.workunit.client.0.smithi057.stdout:7/160: read d6/d28/f33 [1815,126979] 0 2024-04-25T22:42:13.592 INFO:tasks.workunit.client.0.smithi057.stdout:3/196: write d0/d4/d7/f2f [3906863,113249] 0 2024-04-25T22:42:13.593 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:13.594 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:13.594 INFO:tasks.workunit.client.0.smithi057.stdout:8/177: mknod d4/d5/c45 0 2024-04-25T22:42:13.594 INFO:tasks.workunit.client.0.smithi057.stdout:5/237: dwrite d2/d6/db/f2b [0,4194304] 0 2024-04-25T22:42:13.594 INFO:tasks.workunit.client.0.smithi057.stdout:7/161: fdatasync f1 0 2024-04-25T22:42:13.594 INFO:tasks.workunit.client.0.smithi057.stdout:1/197: rename d7/dd/d16/f10 to d7/dd/d26/f3e 0 2024-04-25T22:42:13.594 INFO:tasks.workunit.client.0.smithi057.stdout:3/197: mknod d0/d4/d7/d26/c45 0 2024-04-25T22:42:13.595 INFO:tasks.workunit.client.0.smithi057.stdout:5/238: fsync d2/f9 0 2024-04-25T22:42:13.595 INFO:tasks.workunit.client.0.smithi057.stdout:6/175: dwrite d2/d19/d26/f2f [0,4194304] 0 2024-04-25T22:42:13.595 INFO:tasks.workunit.client.0.smithi057.stdout:5/239: readlink d2/ld 0 2024-04-25T22:42:13.595 INFO:tasks.workunit.client.0.smithi057.stdout:7/162: mknod d6/d1b/d1d/c37 0 2024-04-25T22:42:13.596 INFO:tasks.workunit.client.0.smithi057.stdout:1/198: rename f6 to d7/dd/d16/f3f 0 2024-04-25T22:42:13.596 INFO:tasks.workunit.client.0.smithi057.stdout:5/240: readlink d2/d1c/l40 0 2024-04-25T22:42:13.596 INFO:tasks.workunit.client.0.smithi057.stdout:6/176: unlink d2/l6 0 2024-04-25T22:42:13.596 INFO:tasks.workunit.client.0.smithi057.stdout:5/241: chown d2/d2c 330 1 2024-04-25T22:42:13.596 INFO:tasks.workunit.client.0.smithi057.stdout:8/178: rename d4/db/d12/f1d to d4/db/dd/df/d22/f46 0 2024-04-25T22:42:13.597 INFO:tasks.workunit.client.0.smithi057.stdout:6/177: truncate d2/f32 814441 0 2024-04-25T22:42:13.597 INFO:tasks.workunit.client.0.smithi057.stdout:6/178: rmdir d2 39 2024-04-25T22:42:13.598 INFO:tasks.workunit.client.0.smithi057.stdout:8/179: rename d4/d5/d17/c40 to d4/d5/d17/c47 0 2024-04-25T22:42:13.599 INFO:tasks.workunit.client.0.smithi057.stdout:8/180: read - d4/d5/f23 zero size 2024-04-25T22:42:13.599 INFO:tasks.workunit.client.0.smithi057.stdout:6/179: creat d2/d19/d20/f38 x:0 0 0 2024-04-25T22:42:13.601 INFO:tasks.workunit.client.0.smithi057.stdout:9/227: truncate d3/f1e 2656994 0 2024-04-25T22:42:13.601 INFO:tasks.workunit.client.0.smithi057.stdout:3/198: rename d0/d11/d27 to d0/d4/d7/d46 0 2024-04-25T22:42:13.602 INFO:tasks.workunit.client.0.smithi057.stdout:1/199: dread d7/dd/d16/d18/f2a [0,4194304] 0 2024-04-25T22:42:13.603 INFO:tasks.workunit.client.0.smithi057.stdout:6/180: chown d2/d9/ce 1000 0 2024-04-25T22:42:13.604 INFO:tasks.workunit.client.0.smithi057.stdout:6/181: fdatasync d2/f11 0 2024-04-25T22:42:13.604 INFO:tasks.workunit.client.0.smithi057.stdout:9/228: symlink d3/l4b 0 2024-04-25T22:42:13.604 INFO:tasks.workunit.client.0.smithi057.stdout:1/200: fdatasync d7/dd/d16/d24/f38 0 2024-04-25T22:42:13.604 INFO:tasks.workunit.client.0.smithi057.stdout:7/163: dwrite d6/f26 [0,4194304] 0 2024-04-25T22:42:13.605 INFO:tasks.workunit.client.0.smithi057.stdout:2/248: dwrite d1f/d21/d26/f3a [0,4194304] 0 2024-04-25T22:42:13.605 INFO:tasks.workunit.client.0.smithi057.stdout:6/182: fdatasync d2/f32 0 2024-04-25T22:42:13.606 INFO:tasks.workunit.client.0.smithi057.stdout:3/199: creat d0/d4/d34/f47 x:0 0 0 2024-04-25T22:42:13.608 INFO:tasks.workunit.client.0.smithi057.stdout:2/249: dread f9 [0,4194304] 0 2024-04-25T22:42:13.608 INFO:tasks.workunit.client.0.smithi057.stdout:1/201: truncate d7/dd/d16/d24/f38 949687 0 2024-04-25T22:42:13.609 INFO:tasks.workunit.client.0.smithi057.stdout:7/164: rename d6/l12 to d6/d1b/l38 0 2024-04-25T22:42:13.610 INFO:tasks.workunit.client.0.smithi057.stdout:1/202: readlink d7/dd/d16/d18/l1b 0 2024-04-25T22:42:13.610 INFO:tasks.workunit.client.0.smithi057.stdout:2/250: write d1f/d21/f45 [2744724,8007] 0 2024-04-25T22:42:13.611 INFO:tasks.workunit.client.0.smithi057.stdout:3/200: rename d0/d4/d7/l20 to d0/d4/d34/l48 0 2024-04-25T22:42:13.612 INFO:tasks.workunit.client.0.smithi057.stdout:8/181: dwrite d4/db/dd/f20 [4194304,4194304] 0 2024-04-25T22:42:13.612 INFO:tasks.workunit.client.0.smithi057.stdout:7/165: dread d6/f20 [0,4194304] 0 2024-04-25T22:42:13.612 INFO:tasks.workunit.client.0.smithi057.stdout:4/193: dread d14/f16 [0,4194304] 0 2024-04-25T22:42:13.614 INFO:tasks.workunit.client.0.smithi057.stdout:0/160: dread d0/f9 [0,4194304] 0 2024-04-25T22:42:13.614 INFO:tasks.workunit.client.0.smithi057.stdout:4/194: dread - d14/f28 zero size 2024-04-25T22:42:13.614 INFO:tasks.workunit.client.0.smithi057.stdout:7/166: rmdir d6/d32 0 2024-04-25T22:42:13.615 INFO:tasks.workunit.client.0.smithi057.stdout:9/229: dwrite d3/d34/d42/f2b [4194304,4194304] 0 2024-04-25T22:42:13.615 INFO:tasks.workunit.client.0.smithi057.stdout:7/167: rmdir d6/d28 39 2024-04-25T22:42:13.615 INFO:tasks.workunit.client.0.smithi057.stdout:3/201: write d0/d4/d7/d22/f2b [993349,68692] 0 2024-04-25T22:42:13.617 INFO:tasks.workunit.client.0.smithi057.stdout:4/195: write d14/f1c [730712,18569] 0 2024-04-25T22:42:13.617 INFO:tasks.workunit.client.0.smithi057.stdout:0/161: creat d0/d5/f32 x:0 0 0 2024-04-25T22:42:13.618 INFO:tasks.workunit.client.0.smithi057.stdout:3/202: symlink d0/l49 0 2024-04-25T22:42:13.619 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:13.619 INFO:tasks.workunit.client.0.smithi057.stdout:7/168: mkdir d6/d1b/d1d/d39 0 2024-04-25T22:42:13.620 INFO:tasks.workunit.client.0.smithi057.stdout:7/169: chown d6/f15 189498 1 2024-04-25T22:42:13.620 INFO:tasks.workunit.client.0.smithi057.stdout:6/183: mknod d2/d9/c39 0 2024-04-25T22:42:13.621 INFO:tasks.workunit.client.0.smithi057.stdout:1/203: dread d7/dd/d16/d18/f34 [0,4194304] 0 2024-04-25T22:42:13.621 INFO:tasks.workunit.client.0.smithi057.stdout:4/196: write d14/f23 [3508522,60428] 0 2024-04-25T22:42:13.622 INFO:tasks.workunit.client.0.smithi057.stdout:4/197: unlink d14/f27 0 2024-04-25T22:42:13.622 INFO:tasks.workunit.client.0.smithi057.stdout:2/251: dwrite d1f/d21/d26/f4e [0,4194304] 0 2024-04-25T22:42:13.623 INFO:tasks.workunit.client.0.smithi057.stdout:8/182: dwrite d4/db/f42 [0,4194304] 0 2024-04-25T22:42:13.624 INFO:tasks.workunit.client.0.smithi057.stdout:1/204: fsync d7/dd/d16/d24/f3a 0 2024-04-25T22:42:13.624 INFO:tasks.workunit.client.0.smithi057.stdout:0/162: link d0/d3/d6/l31 d0/d3/d6/d14/l33 0 2024-04-25T22:42:13.624 INFO:tasks.workunit.client.0.smithi057.stdout:4/198: fsync f9 0 2024-04-25T22:42:13.625 INFO:tasks.workunit.client.0.smithi057.stdout:2/252: dread f1d [0,4194304] 0 2024-04-25T22:42:13.625 INFO:tasks.workunit.client.0.smithi057.stdout:1/205: mkdir d7/dd/d40 0 2024-04-25T22:42:13.625 INFO:tasks.workunit.client.0.smithi057.stdout:6/184: creat d2/d9/d1a/d22/d31/f3a x:0 0 0 2024-04-25T22:42:13.627 INFO:tasks.workunit.client.0.smithi057.stdout:9/230: dwrite d3/d34/d42/d28/d2d/f3d [0,4194304] 0 2024-04-25T22:42:13.627 INFO:tasks.workunit.client.0.smithi057.stdout:6/185: creat d2/d19/d20/f3b x:0 0 0 2024-04-25T22:42:13.627 INFO:tasks.workunit.client.0.smithi057.stdout:8/183: truncate d4/db/dd/d3a/f3c 78906 0 2024-04-25T22:42:13.628 INFO:tasks.workunit.client.0.smithi057.stdout:1/206: truncate d7/dd/d16/f3f 1812219 0 2024-04-25T22:42:13.628 INFO:tasks.workunit.client.0.smithi057.stdout:2/253: creat d1f/d36/f4f x:0 0 0 2024-04-25T22:42:13.628 INFO:tasks.workunit.client.0.smithi057.stdout:8/184: mkdir d4/d5/d48 0 2024-04-25T22:42:13.629 INFO:tasks.workunit.client.0.smithi057.stdout:1/207: mkdir d7/dd/d40/d41 0 2024-04-25T22:42:13.629 INFO:tasks.workunit.client.0.smithi057.stdout:6/186: getdents d2 0 2024-04-25T22:42:13.630 INFO:tasks.workunit.client.0.smithi057.stdout:8/185: truncate d4/f43 88082 0 2024-04-25T22:42:13.630 INFO:tasks.workunit.client.0.smithi057.stdout:2/254: truncate d1f/d21/d26/f3a 4345507 0 2024-04-25T22:42:13.632 INFO:tasks.workunit.client.0.smithi057.stdout:9/231: write d3/f1e [3564838,52637] 0 2024-04-25T22:42:13.632 INFO:tasks.workunit.client.0.smithi057.stdout:8/186: chown d4/db/dd/df/d22/f3f 511224391 1 2024-04-25T22:42:13.633 INFO:tasks.workunit.client.0.smithi057.stdout:4/199: dwrite d14/f25 [0,4194304] 0 2024-04-25T22:42:13.634 INFO:tasks.workunit.client.0.smithi057.stdout:8/187: creat d4/f49 x:0 0 0 2024-04-25T22:42:13.635 INFO:tasks.workunit.client.0.smithi057.stdout:3/203: dwrite d0/d11/f1c [0,4194304] 0 2024-04-25T22:42:13.636 INFO:tasks.workunit.client.0.smithi057.stdout:4/200: rename d14/f1a to d14/d3c/f42 0 2024-04-25T22:42:13.636 INFO:tasks.workunit.client.0.smithi057.stdout:4/201: chown d14/d3c/f42 0 1 2024-04-25T22:42:13.637 INFO:tasks.workunit.client.0.smithi057.stdout:3/204: rmdir d0/d37 0 2024-04-25T22:42:13.638 INFO:tasks.workunit.client.0.smithi057.stdout:6/187: read d2/d9/f2a [3054,87462] 0 2024-04-25T22:42:13.638 INFO:tasks.workunit.client.0.smithi057.stdout:3/205: rename d0/d4/d7/d26/d3d to d0/d4/d4a 0 2024-04-25T22:42:13.639 INFO:tasks.workunit.client.0.smithi057.stdout:3/206: creat d0/d4/d34/f4b x:0 0 0 2024-04-25T22:42:13.641 INFO:tasks.workunit.client.0.smithi057.stdout:6/188: truncate d2/d9/f2a 565531 0 2024-04-25T22:42:13.641 INFO:tasks.workunit.client.0.smithi057.stdout:3/207: rename d0/d4/d7/d26/f2c to d0/d4/d4a/f4c 0 2024-04-25T22:42:13.641 INFO:tasks.workunit.client.0.smithi057.stdout:6/189: fsync d2/f1c 0 2024-04-25T22:42:13.642 INFO:tasks.workunit.client.0.smithi057.stdout:6/190: fsync d2/f1c 0 2024-04-25T22:42:13.643 INFO:tasks.workunit.client.0.smithi057.stdout:7/170: sync 2024-04-25T22:42:13.643 INFO:tasks.workunit.client.0.smithi057.stdout:0/163: sync 2024-04-25T22:42:13.643 INFO:tasks.workunit.client.0.smithi057.stdout:7/171: chown d6/f26 614720 1 2024-04-25T22:42:13.644 INFO:tasks.workunit.client.0.smithi057.stdout:0/164: mknod d0/d3/d6/c34 0 2024-04-25T22:42:13.644 INFO:tasks.workunit.client.0.smithi057.stdout:4/202: dwrite d14/f3b [0,4194304] 0 2024-04-25T22:42:13.645 INFO:tasks.workunit.client.0.smithi057.stdout:0/165: creat d0/d5/dd/f35 x:0 0 0 2024-04-25T22:42:13.646 INFO:tasks.workunit.client.0.smithi057.stdout:7/172: getdents d6/d1b/d30 0 2024-04-25T22:42:13.648 INFO:tasks.workunit.client.0.smithi057.stdout:7/173: creat d6/f3a x:0 0 0 2024-04-25T22:42:13.649 INFO:tasks.workunit.client.0.smithi057.stdout:1/208: truncate d7/dd/d16/d18/f23 774553 0 2024-04-25T22:42:13.649 INFO:tasks.workunit.client.0.smithi057.stdout:3/208: dwrite d0/d11/f1c [0,4194304] 0 2024-04-25T22:42:13.650 INFO:tasks.workunit.client.0.smithi057.stdout:7/174: symlink d6/d1b/l3b 0 2024-04-25T22:42:13.650 INFO:tasks.workunit.client.0.smithi057.stdout:2/255: truncate d1f/d34/f39 198994 0 2024-04-25T22:42:13.650 INFO:tasks.workunit.client.0.smithi057.stdout:1/209: creat d7/f42 x:0 0 0 2024-04-25T22:42:13.651 INFO:tasks.workunit.client.0.smithi057.stdout:3/209: rmdir d0/d4/d34/d3c 39 2024-04-25T22:42:13.652 INFO:tasks.workunit.client.0.smithi057.stdout:8/188: truncate d4/f10 7143292 0 2024-04-25T22:42:13.652 INFO:tasks.workunit.client.0.smithi057.stdout:4/203: dwrite d14/f3b [0,4194304] 0 2024-04-25T22:42:13.653 INFO:tasks.workunit.client.0.smithi057.stdout:4/204: chown d14/f28 4660132 1 2024-04-25T22:42:13.653 INFO:tasks.workunit.client.0.smithi057.stdout:6/191: dread d2/f32 [0,4194304] 0 2024-04-25T22:42:13.653 INFO:tasks.workunit.client.0.smithi057.stdout:2/256: mkdir d1f/d34/d50 0 2024-04-25T22:42:13.654 INFO:tasks.workunit.client.0.smithi057.stdout:1/210: mknod d7/dd/d26/c43 0 2024-04-25T22:42:13.654 INFO:tasks.workunit.client.0.smithi057.stdout:8/189: mknod d4/d5/d21/c4a 0 2024-04-25T22:42:13.654 INFO:tasks.workunit.client.0.smithi057.stdout:6/192: rmdir d2/d19/d26 39 2024-04-25T22:42:13.654 INFO:tasks.workunit.client.0.smithi057.stdout:7/175: creat d6/d1b/f3c x:0 0 0 2024-04-25T22:42:13.655 INFO:tasks.workunit.client.0.smithi057.stdout:3/210: truncate d0/d4/d34/f4b 286497 0 2024-04-25T22:42:13.655 INFO:tasks.workunit.client.0.smithi057.stdout:2/257: readlink d1f/d21/d26/l43 0 2024-04-25T22:42:13.655 INFO:tasks.workunit.client.0.smithi057.stdout:8/190: mknod d4/d5/d21/c4b 0 2024-04-25T22:42:13.655 INFO:tasks.workunit.client.0.smithi057.stdout:1/211: creat d7/dd/d16/d18/d31/f44 x:0 0 0 2024-04-25T22:42:13.657 INFO:tasks.workunit.client.0.smithi057.stdout:1/212: mkdir d7/dd/d40/d41/d45 0 2024-04-25T22:42:13.657 INFO:tasks.workunit.client.0.smithi057.stdout:8/191: link d4/d5/d17/d19/f30 d4/d5/d21/f4c 0 2024-04-25T22:42:13.657 INFO:tasks.workunit.client.0.smithi057.stdout:2/258: getdents d1f/d36 0 2024-04-25T22:42:13.658 INFO:tasks.workunit.client.0.smithi057.stdout:8/192: write d4/db/dd/f20 [8159363,10632] 0 2024-04-25T22:42:13.658 INFO:tasks.workunit.client.0.smithi057.stdout:2/259: truncate d1f/d21/f46 526675 0 2024-04-25T22:42:13.659 INFO:tasks.workunit.client.0.smithi057.stdout:2/260: dread - d1f/d4a/f3b zero size 2024-04-25T22:42:13.659 INFO:tasks.workunit.client.0.smithi057.stdout:3/211: truncate d0/d4/d7/f2f 1220639 0 2024-04-25T22:42:13.659 INFO:tasks.workunit.client.0.smithi057.stdout:8/193: creat d4/d5/f4d x:0 0 0 2024-04-25T22:42:13.660 INFO:tasks.workunit.client.0.smithi057.stdout:2/261: chown d1f/d4a/f4b 1942 1 2024-04-25T22:42:13.660 INFO:tasks.workunit.client.0.smithi057.stdout:3/212: write d0/d4/f2d [547993,44474] 0 2024-04-25T22:42:13.660 INFO:tasks.workunit.client.0.smithi057.stdout:2/262: symlink d1f/l51 0 2024-04-25T22:42:13.661 INFO:tasks.workunit.client.0.smithi057.stdout:8/194: chown d4/d5/d17/l2d 294380 1 2024-04-25T22:42:13.661 INFO:tasks.workunit.client.0.smithi057.stdout:2/263: dread - d1f/d21/d26/f29 zero size 2024-04-25T22:42:13.661 INFO:tasks.workunit.client.0.smithi057.stdout:3/213: truncate d0/f6 989848 0 2024-04-25T22:42:13.661 INFO:tasks.workunit.client.0.smithi057.stdout:8/195: creat d4/db/d12/f4e x:0 0 0 2024-04-25T22:42:13.662 INFO:tasks.workunit.client.0.smithi057.stdout:2/264: creat d1f/d34/f52 x:0 0 0 2024-04-25T22:42:13.663 INFO:tasks.workunit.client.0.smithi057.stdout:3/214: mknod d0/d11/c4d 0 2024-04-25T22:42:13.663 INFO:tasks.workunit.client.0.smithi057.stdout:8/196: write d4/db/dd/f18 [1862100,103695] 0 2024-04-25T22:42:13.663 INFO:tasks.workunit.client.0.smithi057.stdout:2/265: rename f3 to d1f/d34/d50/f53 0 2024-04-25T22:42:13.663 INFO:tasks.workunit.client.0.smithi057.stdout:0/166: sync 2024-04-25T22:42:13.664 INFO:tasks.workunit.client.0.smithi057.stdout:7/176: sync 2024-04-25T22:42:13.665 INFO:tasks.workunit.client.0.smithi057.stdout:5/242: dread d2/d1c/d46/f27 [0,4194304] 0 2024-04-25T22:42:13.665 INFO:tasks.workunit.client.0.smithi057.stdout:1/213: dwrite d7/f42 [0,4194304] 0 2024-04-25T22:42:13.665 INFO:tasks.workunit.client.0.smithi057.stdout:6/193: dread d2/f4 [0,4194304] 0 2024-04-25T22:42:13.666 INFO:tasks.workunit.client.0.smithi057.stdout:2/266: truncate d1f/d21/f3e 4653343 0 2024-04-25T22:42:13.666 INFO:tasks.workunit.client.0.smithi057.stdout:7/177: rmdir d6/d1b/d1d/d39 0 2024-04-25T22:42:13.666 INFO:tasks.workunit.client.0.smithi057.stdout:0/167: rename d0/d5/c1a to d0/d5/dd/c36 0 2024-04-25T22:42:13.667 INFO:tasks.workunit.client.0.smithi057.stdout:5/243: symlink d2/d1c/l49 0 2024-04-25T22:42:13.667 INFO:tasks.workunit.client.0.smithi057.stdout:0/168: fsync d0/f2b 0 2024-04-25T22:42:13.667 INFO:tasks.workunit.client.0.smithi057.stdout:1/214: creat d7/dd/f46 x:0 0 0 2024-04-25T22:42:13.668 INFO:tasks.workunit.client.0.smithi057.stdout:2/267: mkdir d1f/d36/d54 0 2024-04-25T22:42:13.668 INFO:tasks.workunit.client.0.smithi057.stdout:5/244: mknod d2/d1c/d24/d3d/c4a 0 2024-04-25T22:42:13.668 INFO:tasks.workunit.client.0.smithi057.stdout:6/194: symlink d2/d19/l3c 0 2024-04-25T22:42:13.669 INFO:tasks.workunit.client.0.smithi057.stdout:0/169: creat d0/d5/dd/f37 x:0 0 0 2024-04-25T22:42:13.669 INFO:tasks.workunit.client.0.smithi057.stdout:0/170: dread - d0/d3/f1c zero size 2024-04-25T22:42:13.669 INFO:tasks.workunit.client.0.smithi057.stdout:2/268: getdents d1f/d4a/d4d 0 2024-04-25T22:42:13.670 INFO:tasks.workunit.client.0.smithi057.stdout:5/245: creat d2/d1c/d42/f4b x:0 0 0 2024-04-25T22:42:13.670 INFO:tasks.workunit.client.0.smithi057.stdout:0/171: fdatasync d0/d3/d6/f1b 0 2024-04-25T22:42:13.672 INFO:tasks.workunit.client.0.smithi057.stdout:8/197: fsync d4/d5/f4d 0 2024-04-25T22:42:13.673 INFO:tasks.workunit.client.0.smithi057.stdout:7/178: dread d6/f14 [0,4194304] 0 2024-04-25T22:42:13.673 INFO:tasks.workunit.client.0.smithi057.stdout:0/172: unlink d0/d3/d6/d29/f2a 0 2024-04-25T22:42:13.676 INFO:tasks.workunit.client.0.smithi057.stdout:3/215: dwrite d0/d4/f9 [0,4194304] 0 2024-04-25T22:42:13.676 INFO:tasks.workunit.client.0.smithi057.stdout:0/173: mkdir d0/d3/d6/d14/d38 0 2024-04-25T22:42:13.679 INFO:tasks.workunit.client.0.smithi057.stdout:0/174: write d0/f30 [3455745,9399] 0 2024-04-25T22:42:13.679 INFO:tasks.workunit.client.0.smithi057.stdout:3/216: creat d0/d4/d7/d26/f4e x:0 0 0 2024-04-25T22:42:13.679 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:13.675+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:13.679 INFO:tasks.workunit.client.0.smithi057.stdout:2/269: dread d1f/d21/d33/f40 [0,4194304] 0 2024-04-25T22:42:13.680 INFO:tasks.workunit.client.0.smithi057.stdout:5/246: dread d2/d6/f7 [0,4194304] 0 2024-04-25T22:42:13.680 INFO:tasks.workunit.client.0.smithi057.stdout:6/195: dwrite d2/d19/d26/f2d [0,4194304] 0 2024-04-25T22:42:13.681 INFO:tasks.workunit.client.0.smithi057.stdout:3/217: dread - d0/d4/d7/d46/f29 zero size 2024-04-25T22:42:13.681 INFO:tasks.workunit.client.0.smithi057.stdout:0/175: mkdir d0/d3/d6/d14/d39 0 2024-04-25T22:42:13.681 INFO:tasks.workunit.client.0.smithi057.stdout:1/215: dwrite d7/dd/f14 [0,4194304] 0 2024-04-25T22:42:13.682 INFO:tasks.workunit.client.0.smithi057.stdout:1/216: sync 2024-04-25T22:42:13.683 INFO:tasks.workunit.client.0.smithi057.stdout:0/176: chown d0/l2e 2829 1 2024-04-25T22:42:13.683 INFO:tasks.workunit.client.0.smithi057.stdout:0/177: sync 2024-04-25T22:42:13.683 INFO:tasks.workunit.client.0.smithi057.stdout:0/178: sync 2024-04-25T22:42:13.684 INFO:tasks.workunit.client.0.smithi057.stdout:6/196: creat d2/d19/f3d x:0 0 0 2024-04-25T22:42:13.684 INFO:tasks.workunit.client.0.smithi057.stdout:3/218: mknod d0/d4/c4f 0 2024-04-25T22:42:13.684 INFO:tasks.workunit.client.0.smithi057.stdout:7/179: dwrite d6/f21 [0,4194304] 0 2024-04-25T22:42:13.685 INFO:tasks.workunit.client.0.smithi057.stdout:0/179: mkdir d0/d3/d3a 0 2024-04-25T22:42:13.685 INFO:tasks.workunit.client.0.smithi057.stdout:9/232: dread d3/f12 [0,4194304] 0 2024-04-25T22:42:13.685 INFO:tasks.workunit.client.0.smithi057.stdout:6/197: truncate d2/d19/d20/f38 843490 0 2024-04-25T22:42:13.686 INFO:tasks.workunit.client.0.smithi057.stdout:6/198: getdents d2/d19/d26 0 2024-04-25T22:42:13.687 INFO:tasks.workunit.client.0.smithi057.stdout:6/199: chown d2/d9/d1a/c2e 6686411 1 2024-04-25T22:42:13.687 INFO:tasks.workunit.client.0.smithi057.stdout:9/233: chown d3/d34 28820699 1 2024-04-25T22:42:13.688 INFO:tasks.workunit.client.0.smithi057.stdout:6/200: write d2/d19/f1e [2005352,48658] 0 2024-04-25T22:42:13.688 INFO:tasks.workunit.client.0.smithi057.stdout:0/180: write d0/d3/f2f [277052,28028] 0 2024-04-25T22:42:13.689 INFO:tasks.workunit.client.0.smithi057.stdout:9/234: getdents d3/d34/d42/d28/d39 0 2024-04-25T22:42:13.690 INFO:tasks.workunit.client.0.smithi057.stdout:6/201: getdents d2/d9/d1a/d22 0 2024-04-25T22:42:13.691 INFO:tasks.workunit.client.0.smithi057.stdout:1/217: truncate d7/dd/d16/d24/f38 885096 0 2024-04-25T22:42:13.691 INFO:tasks.workunit.client.0.smithi057.stdout:7/180: write d6/d28/f33 [365921,83017] 0 2024-04-25T22:42:13.691 INFO:tasks.workunit.client.0.smithi057.stdout:1/218: sync 2024-04-25T22:42:13.691 INFO:tasks.workunit.client.0.smithi057.stdout:6/202: mkdir d2/d9/d1a/d22/d3e 0 2024-04-25T22:42:13.691 INFO:tasks.workunit.client.0.smithi057.stdout:9/235: dread - d3/d34/d42/d28/d2d/f40 zero size 2024-04-25T22:42:13.693 INFO:tasks.workunit.client.0.smithi057.stdout:6/203: fsync d2/d19/d20/f3b 0 2024-04-25T22:42:13.693 INFO:tasks.workunit.client.0.smithi057.stdout:3/219: dwrite d0/d4/d7/d26/f31 [0,4194304] 0 2024-04-25T22:42:13.693 INFO:tasks.workunit.client.0.smithi057.stdout:6/204: sync 2024-04-25T22:42:13.693 INFO:tasks.workunit.client.0.smithi057.stdout:3/220: stat d0/f33 0 2024-04-25T22:42:13.693 INFO:tasks.workunit.client.0.smithi057.stdout:1/219: truncate d7/dd/d16/d24/f22 740382 0 2024-04-25T22:42:13.694 INFO:tasks.workunit.client.0.smithi057.stdout:4/205: dread ff [4194304,4194304] 0 2024-04-25T22:42:13.694 INFO:tasks.workunit.client.0.smithi057.stdout:6/205: creat d2/d9/d1a/d22/d31/f3f x:0 0 0 2024-04-25T22:42:13.695 INFO:tasks.workunit.client.0.smithi057.stdout:6/206: dread d2/f4 [0,4194304] 0 2024-04-25T22:42:13.697 INFO:tasks.workunit.client.0.smithi057.stdout:3/221: fsync d0/f6 0 2024-04-25T22:42:13.697 INFO:tasks.workunit.client.0.smithi057.stdout:1/220: fdatasync d7/dd/d16/d24/f38 0 2024-04-25T22:42:13.698 INFO:tasks.workunit.client.0.smithi057.stdout:0/181: read d0/d3/f7 [1370166,63537] 0 2024-04-25T22:42:13.698 INFO:tasks.workunit.client.0.smithi057.stdout:6/207: getdents d2/d9 0 2024-04-25T22:42:13.699 INFO:tasks.workunit.client.0.smithi057.stdout:3/222: symlink d0/l50 0 2024-04-25T22:42:13.699 INFO:tasks.workunit.client.0.smithi057.stdout:7/181: dwrite d6/fb [0,4194304] 0 2024-04-25T22:42:13.699 INFO:tasks.workunit.client.0.smithi057.stdout:0/182: mkdir d0/d3/d3a/d3b 0 2024-04-25T22:42:13.700 INFO:tasks.workunit.client.0.smithi057.stdout:1/221: rename d7/dd/d16/d18/f1d to d7/dd/d26/f47 0 2024-04-25T22:42:13.700 INFO:tasks.workunit.client.0.smithi057.stdout:6/208: truncate d2/f1c 701530 0 2024-04-25T22:42:13.700 INFO:tasks.workunit.client.0.smithi057.stdout:3/223: dread - d0/d4/d7/d26/f3f zero size 2024-04-25T22:42:13.702 INFO:tasks.workunit.client.0.smithi057.stdout:4/206: dwrite f9 [0,4194304] 0 2024-04-25T22:42:13.702 INFO:tasks.workunit.client.0.smithi057.stdout:1/222: unlink d7/dd/d26/c2c 0 2024-04-25T22:42:13.702 INFO:tasks.workunit.client.0.smithi057.stdout:0/183: write d0/d5/f23 [1879248,11627] 0 2024-04-25T22:42:13.702 INFO:tasks.workunit.client.0.smithi057.stdout:6/209: creat d2/f40 x:0 0 0 2024-04-25T22:42:13.702 INFO:tasks.workunit.client.0.smithi057.stdout:4/207: readlink d14/l35 0 2024-04-25T22:42:13.702 INFO:tasks.workunit.client.0.smithi057.stdout:3/224: readlink d0/d4/d7/l2e 0 2024-04-25T22:42:13.702 INFO:tasks.workunit.client.0.smithi057.stdout:0/184: truncate d0/d3/f15 109023 0 2024-04-25T22:42:13.703 INFO:tasks.workunit.client.0.smithi057.stdout:6/210: mknod d2/d19/d20/c41 0 2024-04-25T22:42:13.703 INFO:tasks.workunit.client.0.smithi057.stdout:4/208: symlink d14/d2f/l43 0 2024-04-25T22:42:13.704 INFO:tasks.workunit.client.0.smithi057.stdout:4/209: fsync d14/f22 0 2024-04-25T22:42:13.704 INFO:tasks.workunit.client.0.smithi057.stdout:3/225: creat d0/d4/d7/d22/f51 x:0 0 0 2024-04-25T22:42:13.705 INFO:tasks.workunit.client.0.smithi057.stdout:0/185: rename d0/c13 to d0/d3/d6/d14/c3c 0 2024-04-25T22:42:13.705 INFO:tasks.workunit.client.0.smithi057.stdout:3/226: fsync d0/f6 0 2024-04-25T22:42:13.706 INFO:tasks.workunit.client.0.smithi057.stdout:0/186: chown d0/l2e 317366902 1 2024-04-25T22:42:13.707 INFO:tasks.workunit.client.0.smithi057.stdout:3/227: dread - d0/d4/d7/d22/f51 zero size 2024-04-25T22:42:13.707 INFO:tasks.workunit.client.0.smithi057.stdout:0/187: unlink d0/d3/f7 0 2024-04-25T22:42:13.708 INFO:tasks.workunit.client.0.smithi057.stdout:7/182: dwrite d6/f14 [0,4194304] 0 2024-04-25T22:42:13.708 INFO:tasks.workunit.client.0.smithi057.stdout:2/270: dread f0 [0,4194304] 0 2024-04-25T22:42:13.709 INFO:tasks.workunit.client.0.smithi057.stdout:0/188: chown d0/d3/fc 41301019 1 2024-04-25T22:42:13.710 INFO:tasks.workunit.client.0.smithi057.stdout:7/183: creat d6/d1b/d1d/f3d x:0 0 0 2024-04-25T22:42:13.710 INFO:tasks.workunit.client.0.smithi057.stdout:3/228: write d0/d11/f1e [1073311,30890] 0 2024-04-25T22:42:13.710 INFO:tasks.workunit.client.0.smithi057.stdout:6/211: dwrite d2/d19/d26/f2d [0,4194304] 0 2024-04-25T22:42:13.711 INFO:tasks.workunit.client.0.smithi057.stdout:3/229: mkdir d0/d4/d34/d3c/d52 0 2024-04-25T22:42:13.711 INFO:tasks.workunit.client.0.smithi057.stdout:7/184: link d6/f21 d6/d1b/d30/f3e 0 2024-04-25T22:42:13.712 INFO:tasks.workunit.client.0.smithi057.stdout:6/212: dread d2/f4 [0,4194304] 0 2024-04-25T22:42:13.713 INFO:tasks.workunit.client.0.smithi057.stdout:3/230: mkdir d0/d4/d34/d3c/d53 0 2024-04-25T22:42:13.713 INFO:tasks.workunit.client.0.smithi057.stdout:3/231: sync 2024-04-25T22:42:13.713 INFO:tasks.workunit.client.0.smithi057.stdout:7/185: write d6/f27 [2780495,97553] 0 2024-04-25T22:42:13.714 INFO:tasks.workunit.client.0.smithi057.stdout:2/271: dread d1f/f2a [0,4194304] 0 2024-04-25T22:42:13.714 INFO:tasks.workunit.client.0.smithi057.stdout:6/213: creat d2/d9/d1a/f42 x:0 0 0 2024-04-25T22:42:13.715 INFO:tasks.workunit.client.0.smithi057.stdout:7/186: symlink d6/d1b/d30/l3f 0 2024-04-25T22:42:13.715 INFO:tasks.workunit.client.0.smithi057.stdout:1/223: write d7/dd/d16/d24/f38 [1096275,21330] 0 2024-04-25T22:42:13.715 INFO:tasks.workunit.client.0.smithi057.stdout:2/272: rename ca to d1f/d21/d26/c55 0 2024-04-25T22:42:13.715 INFO:tasks.workunit.client.0.smithi057.stdout:3/232: write d0/d4/d4a/f4c [975193,8625] 0 2024-04-25T22:42:13.716 INFO:tasks.workunit.client.0.smithi057.stdout:7/187: rmdir d6/d1b/d30 39 2024-04-25T22:42:13.716 INFO:tasks.workunit.client.0.smithi057.stdout:0/189: dwrite d0/d3/f15 [0,4194304] 0 2024-04-25T22:42:13.716 INFO:tasks.workunit.client.0.smithi057.stdout:4/210: truncate d14/f23 1301336 0 2024-04-25T22:42:13.717 INFO:tasks.workunit.client.0.smithi057.stdout:2/273: symlink d1f/d21/d26/l56 0 2024-04-25T22:42:13.717 INFO:tasks.workunit.client.0.smithi057.stdout:3/233: fsync d0/d4/f25 0 2024-04-25T22:42:13.717 INFO:tasks.workunit.client.0.smithi057.stdout:6/214: truncate d2/d9/d1a/d22/d31/f33 71422 0 2024-04-25T22:42:13.717 INFO:tasks.workunit.client.0.smithi057.stdout:3/234: sync 2024-04-25T22:42:13.718 INFO:tasks.workunit.client.0.smithi057.stdout:4/211: mkdir d14/d3c/d44 0 2024-04-25T22:42:13.718 INFO:tasks.workunit.client.0.smithi057.stdout:0/190: write d0/d3/d6/f1b [2368788,90121] 0 2024-04-25T22:42:13.718 INFO:tasks.workunit.client.0.smithi057.stdout:2/274: creat d1f/d34/f57 x:0 0 0 2024-04-25T22:42:13.720 INFO:tasks.workunit.client.0.smithi057.stdout:0/191: chown d0/d5/dd 38 1 2024-04-25T22:42:13.720 INFO:tasks.workunit.client.0.smithi057.stdout:9/236: read d3/d34/d42/d28/d39/f3a [309622,128829] 0 2024-04-25T22:42:13.720 INFO:tasks.workunit.client.0.smithi057.stdout:2/275: creat d1f/f58 x:0 0 0 2024-04-25T22:42:13.720 INFO:tasks.workunit.client.0.smithi057.stdout:6/215: creat d2/d19/f43 x:0 0 0 2024-04-25T22:42:13.720 INFO:tasks.workunit.client.0.smithi057.stdout:0/192: mknod d0/d3/d3a/c3d 0 2024-04-25T22:42:13.721 INFO:tasks.workunit.client.0.smithi057.stdout:2/276: read d1f/d21/f3e [1956107,98150] 0 2024-04-25T22:42:13.721 INFO:tasks.workunit.client.0.smithi057.stdout:9/237: rmdir d3/d34/d49 0 2024-04-25T22:42:13.722 INFO:tasks.workunit.client.0.smithi057.stdout:0/193: symlink d0/d5/dd/l3e 0 2024-04-25T22:42:13.722 INFO:tasks.workunit.client.0.smithi057.stdout:6/216: chown d2/d9/c1b 0 1 2024-04-25T22:42:13.722 INFO:tasks.workunit.client.0.smithi057.stdout:9/238: stat d3/f23 0 2024-04-25T22:42:13.724 INFO:tasks.workunit.client.0.smithi057.stdout:2/277: mknod d1f/d21/d33/c59 0 2024-04-25T22:42:13.725 INFO:tasks.workunit.client.0.smithi057.stdout:6/217: rmdir d2/d9/d1a/d22/d3e 0 2024-04-25T22:42:13.725 INFO:tasks.workunit.client.0.smithi057.stdout:7/188: dwrite d6/f16 [0,4194304] 0 2024-04-25T22:42:13.727 INFO:tasks.workunit.client.0.smithi057.stdout:6/218: chown d2/d9/ce 57285 1 2024-04-25T22:42:13.727 INFO:tasks.workunit.client.0.smithi057.stdout:2/278: getdents d1f/d36 0 2024-04-25T22:42:13.727 INFO:tasks.workunit.client.0.smithi057.stdout:6/219: stat d2/f4 0 2024-04-25T22:42:13.727 INFO:tasks.workunit.client.0.smithi057.stdout:4/212: dwrite d14/f3b [0,4194304] 0 2024-04-25T22:42:13.728 INFO:tasks.workunit.client.0.smithi057.stdout:6/220: chown d2/d19/f43 559590 1 2024-04-25T22:42:13.729 INFO:tasks.workunit.client.0.smithi057.stdout:2/279: rename d1f/d21/d33/f40 to d1f/d21/d33/f5a 0 2024-04-25T22:42:13.729 INFO:tasks.workunit.client.0.smithi057.stdout:3/235: dwrite d0/d11/f36 [4194304,4194304] 0 2024-04-25T22:42:13.729 INFO:tasks.workunit.client.0.smithi057.stdout:4/213: symlink d14/d3c/d44/l45 0 2024-04-25T22:42:13.730 INFO:tasks.workunit.client.0.smithi057.stdout:6/221: write d2/d19/f1e [200652,107849] 0 2024-04-25T22:42:13.731 INFO:tasks.workunit.client.0.smithi057.stdout:3/236: rmdir d0/d4/d34/d3c 39 2024-04-25T22:42:13.733 INFO:tasks.workunit.client.0.smithi057.stdout:4/214: rmdir d14/d3c 39 2024-04-25T22:42:13.734 INFO:tasks.workunit.client.0.smithi057.stdout:9/239: dwrite d3/d34/d42/d28/d2d/f40 [0,4194304] 0 2024-04-25T22:42:13.735 INFO:tasks.workunit.client.0.smithi057.stdout:7/189: dwrite d6/d28/f2c [0,4194304] 0 2024-04-25T22:42:13.737 INFO:tasks.workunit.client.0.smithi057.stdout:7/190: symlink d6/l40 0 2024-04-25T22:42:13.738 INFO:tasks.workunit.client.0.smithi057.stdout:9/240: link d3/c17 d3/d34/d42/d28/d39/c4c 0 2024-04-25T22:42:13.739 INFO:tasks.workunit.client.0.smithi057.stdout:2/280: dwrite d1f/d21/f37 [0,4194304] 0 2024-04-25T22:42:13.739 INFO:tasks.workunit.client.0.smithi057.stdout:9/241: rmdir d3 39 2024-04-25T22:42:13.739 INFO:tasks.workunit.client.0.smithi057.stdout:7/191: link d6/d1b/f2d d6/d28/f41 0 2024-04-25T22:42:13.740 INFO:tasks.workunit.client.0.smithi057.stdout:2/281: stat d1f/d21/d33 0 2024-04-25T22:42:13.741 INFO:tasks.workunit.client.0.smithi057.stdout:3/237: dwrite d0/d11/f3b [0,4194304] 0 2024-04-25T22:42:13.741 INFO:tasks.workunit.client.0.smithi057.stdout:9/242: write d3/f12 [1056767,9838] 0 2024-04-25T22:42:13.741 INFO:tasks.workunit.client.0.smithi057.stdout:3/238: stat d0/d4/d4a 0 2024-04-25T22:42:13.742 INFO:tasks.workunit.client.0.smithi057.stdout:2/282: mknod d1f/d21/c5b 0 2024-04-25T22:42:13.743 INFO:tasks.workunit.client.0.smithi057.stdout:9/243: symlink d3/d34/d42/d28/d2d/l4d 0 2024-04-25T22:42:13.743 INFO:tasks.workunit.client.0.smithi057.stdout:3/239: creat d0/d4/d34/d3c/d53/f54 x:0 0 0 2024-04-25T22:42:13.744 INFO:tasks.workunit.client.0.smithi057.stdout:3/240: rmdir d0/d4/d34 39 2024-04-25T22:42:13.746 INFO:tasks.workunit.client.0.smithi057.stdout:8/198: dread d4/db/dd/df/f13 [0,4194304] 0 2024-04-25T22:42:13.746 INFO:tasks.workunit.client.0.smithi057.stdout:3/241: creat d0/d4/d7/d22/f55 x:0 0 0 2024-04-25T22:42:13.747 INFO:tasks.workunit.client.0.smithi057.stdout:8/199: fsync d4/db/d12/f36 0 2024-04-25T22:42:13.748 INFO:tasks.workunit.client.0.smithi057.stdout:7/192: dwrite d6/f15 [0,4194304] 0 2024-04-25T22:42:13.749 INFO:tasks.workunit.client.0.smithi057.stdout:8/200: rename d4/d5/f39 to d4/f4f 0 2024-04-25T22:42:13.749 INFO:tasks.workunit.client.0.smithi057.stdout:2/283: dwrite d1f/d4a/f3b [0,4194304] 0 2024-04-25T22:42:13.750 INFO:tasks.workunit.client.0.smithi057.stdout:8/201: readlink d4/d5/d17/l2d 0 2024-04-25T22:42:13.751 INFO:tasks.workunit.client.0.smithi057.stdout:3/242: rename d0/d4/d7/d22/f51 to d0/d4/d7/d26/f56 0 2024-04-25T22:42:13.751 INFO:tasks.workunit.client.0.smithi057.stdout:2/284: mkdir d1f/d21/d26/d5c 0 2024-04-25T22:42:13.751 INFO:tasks.workunit.client.0.smithi057.stdout:8/202: symlink d4/db/d12/l50 0 2024-04-25T22:42:13.753 INFO:tasks.workunit.client.0.smithi057.stdout:7/193: dread d6/f15 [0,4194304] 0 2024-04-25T22:42:13.753 INFO:tasks.workunit.client.0.smithi057.stdout:3/243: truncate d0/d4/d7/d26/f43 1258181 0 2024-04-25T22:42:13.753 INFO:tasks.workunit.client.0.smithi057.stdout:7/194: creat d6/d28/f42 x:0 0 0 2024-04-25T22:42:13.755 INFO:tasks.workunit.client.0.smithi057.stdout:5/247: dread d2/d1c/f1f [0,4194304] 0 2024-04-25T22:42:13.756 INFO:tasks.workunit.client.0.smithi057.stdout:6/222: write d2/d9/f2a [58642,27553] 0 2024-04-25T22:42:13.756 INFO:tasks.workunit.client.0.smithi057.stdout:5/248: truncate d2/d2c/f36 703869 0 2024-04-25T22:42:13.758 INFO:tasks.workunit.client.0.smithi057.stdout:6/223: mknod d2/d9/d1a/c44 0 2024-04-25T22:42:13.758 INFO:tasks.workunit.client.0.smithi057.stdout:8/203: creat d4/d5/d17/d19/f51 x:0 0 0 2024-04-25T22:42:13.758 INFO:tasks.workunit.client.0.smithi057.stdout:5/249: creat d2/d1c/d24/f4c x:0 0 0 2024-04-25T22:42:13.758 INFO:tasks.workunit.client.0.smithi057.stdout:2/285: dwrite d1f/f58 [0,4194304] 0 2024-04-25T22:42:13.759 INFO:tasks.workunit.client.0.smithi057.stdout:2/286: read d1f/d21/f37 [1437533,71536] 0 2024-04-25T22:42:13.761 INFO:tasks.workunit.client.0.smithi057.stdout:4/215: truncate d14/f25 3656422 0 2024-04-25T22:42:13.763 INFO:tasks.workunit.client.0.smithi057.stdout:4/216: stat d14 0 2024-04-25T22:42:13.763 INFO:tasks.workunit.client.0.smithi057.stdout:6/224: link d2/d9/d1a/d22/f29 d2/d19/d20/f45 0 2024-04-25T22:42:13.763 INFO:tasks.workunit.client.0.smithi057.stdout:7/195: dwrite d6/d28/f33 [0,4194304] 0 2024-04-25T22:42:13.763 INFO:tasks.workunit.client.0.smithi057.stdout:1/224: dread d7/dd/d16/f3f [0,4194304] 0 2024-04-25T22:42:13.763 INFO:tasks.workunit.client.0.smithi057.stdout:5/250: link d2/d6/db/l3f d2/d2c/l4d 0 2024-04-25T22:42:13.763 INFO:tasks.workunit.client.0.smithi057.stdout:2/287: link d1f/d21/d26/l56 d1f/d4a/l5d 0 2024-04-25T22:42:13.763 INFO:tasks.workunit.client.0.smithi057.stdout:4/217: write d14/f3b [1718624,47354] 0 2024-04-25T22:42:13.764 INFO:tasks.workunit.client.0.smithi057.stdout:7/196: read - d6/d1b/f3c zero size 2024-04-25T22:42:13.764 INFO:tasks.workunit.client.0.smithi057.stdout:5/251: fdatasync d2/d2c/f36 0 2024-04-25T22:42:13.764 INFO:tasks.workunit.client.0.smithi057.stdout:5/252: read - d2/d1c/d24/f43 zero size 2024-04-25T22:42:13.765 INFO:tasks.workunit.client.0.smithi057.stdout:1/225: creat d7/dd/d40/d41/d45/f48 x:0 0 0 2024-04-25T22:42:13.766 INFO:tasks.workunit.client.0.smithi057.stdout:6/225: link d2/f40 d2/d9/d1a/f46 0 2024-04-25T22:42:13.767 INFO:tasks.workunit.client.0.smithi057.stdout:5/253: rename d2/d6/f7 to d2/d2c/f4e 0 2024-04-25T22:42:13.768 INFO:tasks.workunit.client.0.smithi057.stdout:6/226: readlink d2/d19/l3c 0 2024-04-25T22:42:13.768 INFO:tasks.workunit.client.0.smithi057.stdout:8/204: dwrite d4/d5/d17/d19/f26 [0,4194304] 0 2024-04-25T22:42:13.770 INFO:tasks.workunit.client.0.smithi057.stdout:1/226: dread d7/dd/d16/f3f [0,4194304] 0 2024-04-25T22:42:13.770 INFO:tasks.workunit.client.0.smithi057.stdout:8/205: creat d4/f52 x:0 0 0 2024-04-25T22:42:13.770 INFO:tasks.workunit.client.0.smithi057.stdout:8/206: fdatasync d4/d5/d21/f2a 0 2024-04-25T22:42:13.771 INFO:tasks.workunit.client.0.smithi057.stdout:1/227: mkdir d7/dd/d16/d18/d49 0 2024-04-25T22:42:13.771 INFO:tasks.workunit.client.0.smithi057.stdout:8/207: fdatasync d4/db/d12/f1c 0 2024-04-25T22:42:13.771 INFO:tasks.workunit.client.0.smithi057.stdout:6/227: link d2/d19/l3c d2/d9/d1a/d22/d31/l47 0 2024-04-25T22:42:13.772 INFO:tasks.workunit.client.0.smithi057.stdout:3/244: dread d0/d11/f12 [0,4194304] 0 2024-04-25T22:42:13.773 INFO:tasks.workunit.client.0.smithi057.stdout:8/208: creat d4/db/dd/df/f53 x:0 0 0 2024-04-25T22:42:13.773 INFO:tasks.workunit.client.0.smithi057.stdout:3/245: fsync d0/d4/f21 0 2024-04-25T22:42:13.773 INFO:tasks.workunit.client.0.smithi057.stdout:1/228: link d7/dd/d16/c1f d7/dd/d40/d41/d45/c4a 0 2024-04-25T22:42:13.773 INFO:tasks.workunit.client.0.smithi057.stdout:6/228: sync 2024-04-25T22:42:13.773 INFO:tasks.workunit.client.0.smithi057.stdout:3/246: creat d0/d4/f57 x:0 0 0 2024-04-25T22:42:13.774 INFO:tasks.workunit.client.0.smithi057.stdout:8/209: truncate d4/d5/f7 1504832 0 2024-04-25T22:42:13.774 INFO:tasks.workunit.client.0.smithi057.stdout:1/229: creat d7/dd/d40/d41/f4b x:0 0 0 2024-04-25T22:42:13.778 INFO:tasks.workunit.client.0.smithi057.stdout:3/247: mknod d0/d4/d34/d3c/d53/c58 0 2024-04-25T22:42:13.778 INFO:tasks.workunit.client.0.smithi057.stdout:7/197: write d6/d28/f41 [1366381,41849] 0 2024-04-25T22:42:13.778 INFO:tasks.workunit.client.0.smithi057.stdout:8/210: creat d4/d5/d17/d19/f54 x:0 0 0 2024-04-25T22:42:13.778 INFO:tasks.workunit.client.0.smithi057.stdout:5/254: truncate d2/d6/db/f25 1369511 0 2024-04-25T22:42:13.779 INFO:tasks.workunit.client.0.smithi057.stdout:1/230: readlink d7/dd/d16/d18/l2f 0 2024-04-25T22:42:13.779 INFO:tasks.workunit.client.0.smithi057.stdout:6/229: truncate d2/d9/d1a/d22/d31/f3a 513078 0 2024-04-25T22:42:13.779 INFO:tasks.workunit.client.0.smithi057.stdout:7/198: creat d6/d1b/d30/f43 x:0 0 0 2024-04-25T22:42:13.779 INFO:tasks.workunit.client.0.smithi057.stdout:2/288: dwrite d1f/d21/f3e [4194304,4194304] 0 2024-04-25T22:42:13.779 INFO:tasks.workunit.client.0.smithi057.stdout:8/211: truncate d4/f43 859323 0 2024-04-25T22:42:13.780 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:13.776+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:13.781 INFO:tasks.workunit.client.0.smithi057.stdout:7/199: truncate d6/f27 3729963 0 2024-04-25T22:42:13.782 INFO:tasks.workunit.client.0.smithi057.stdout:6/230: creat d2/d19/d20/f48 x:0 0 0 2024-04-25T22:42:13.783 INFO:tasks.workunit.client.0.smithi057.stdout:4/218: dwrite d14/f25 [0,4194304] 0 2024-04-25T22:42:13.783 INFO:tasks.workunit.client.0.smithi057.stdout:7/200: fsync d6/d28/f33 0 2024-04-25T22:42:13.784 INFO:tasks.workunit.client.0.smithi057.stdout:6/231: mkdir d2/d19/d49 0 2024-04-25T22:42:13.785 INFO:tasks.workunit.client.0.smithi057.stdout:7/201: symlink d6/l44 0 2024-04-25T22:42:13.785 INFO:tasks.workunit.client.0.smithi057.stdout:3/248: dwrite d0/d4/d7/d22/f55 [0,4194304] 0 2024-04-25T22:42:13.786 INFO:tasks.workunit.client.0.smithi057.stdout:6/232: mkdir d2/d19/d26/d4a 0 2024-04-25T22:42:13.786 INFO:tasks.workunit.client.0.smithi057.stdout:7/202: write d6/d28/f33 [866161,8940] 0 2024-04-25T22:42:13.787 INFO:tasks.workunit.client.0.smithi057.stdout:4/219: link d14/d3d/f40 d14/d3c/d44/f46 0 2024-04-25T22:42:13.788 INFO:tasks.workunit.client.0.smithi057.stdout:4/220: write d14/d3c/f42 [3227901,94811] 0 2024-04-25T22:42:13.789 INFO:tasks.workunit.client.0.smithi057.stdout:2/289: truncate d1f/d34/d50/f53 2170272 0 2024-04-25T22:42:13.789 INFO:tasks.workunit.client.0.smithi057.stdout:1/231: dwrite d7/dd/d16/d18/f39 [0,4194304] 0 2024-04-25T22:42:13.790 INFO:tasks.workunit.client.0.smithi057.stdout:1/232: fdatasync d7/f42 0 2024-04-25T22:42:13.790 INFO:tasks.workunit.client.0.smithi057.stdout:2/290: rename lf to d1f/d21/d26/d5c/l5e 0 2024-04-25T22:42:13.791 INFO:tasks.workunit.client.0.smithi057.stdout:4/221: readlink d14/d3c/d44/l45 0 2024-04-25T22:42:13.791 INFO:tasks.workunit.client.0.smithi057.stdout:4/222: chown d14/f20 83916068 1 2024-04-25T22:42:13.792 INFO:tasks.workunit.client.0.smithi057.stdout:2/291: write d1f/d36/f4f [260939,5329] 0 2024-04-25T22:42:13.793 INFO:tasks.workunit.client.0.smithi057.stdout:0/194: dread d0/f2b [0,4194304] 0 2024-04-25T22:42:13.796 INFO:tasks.workunit.client.0.smithi057.stdout:6/233: dwrite d2/d9/f2a [0,4194304] 0 2024-04-25T22:42:13.796 INFO:tasks.workunit.client.0.smithi057.stdout:4/223: mkdir d14/d47 0 2024-04-25T22:42:13.796 INFO:tasks.workunit.client.0.smithi057.stdout:2/292: rename d1f/f20 to d1f/d36/d54/f5f 0 2024-04-25T22:42:13.796 INFO:tasks.workunit.client.0.smithi057.stdout:6/234: chown d2/f4 25 1 2024-04-25T22:42:13.796 INFO:tasks.workunit.client.0.smithi057.stdout:2/293: mkdir d1f/d36/d60 0 2024-04-25T22:42:13.797 INFO:tasks.workunit.client.0.smithi057.stdout:2/294: creat d1f/d21/d33/f61 x:0 0 0 2024-04-25T22:42:13.797 INFO:tasks.workunit.client.0.smithi057.stdout:6/235: getdents d2/d9/d1a 0 2024-04-25T22:42:13.799 INFO:tasks.workunit.client.0.smithi057.stdout:6/236: fsync d2/d19/d26/f2d 0 2024-04-25T22:42:13.800 INFO:tasks.workunit.client.0.smithi057.stdout:1/233: dwrite d7/dd/d16/d24/f22 [0,4194304] 0 2024-04-25T22:42:13.801 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:13.801 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:13.802 INFO:tasks.workunit.client.0.smithi057.stdout:0/195: dwrite d0/d3/f15 [0,4194304] 0 2024-04-25T22:42:13.803 INFO:tasks.workunit.client.0.smithi057.stdout:6/237: write d2/d9/f2a [2732945,64042] 0 2024-04-25T22:42:13.804 INFO:tasks.workunit.client.0.smithi057.stdout:1/234: rename d7/c3b to d7/dd/d16/d18/c4c 0 2024-04-25T22:42:13.804 INFO:tasks.workunit.client.0.smithi057.stdout:2/295: dread d1f/d21/f3e [0,4194304] 0 2024-04-25T22:42:13.805 INFO:tasks.workunit.client.0.smithi057.stdout:4/224: write d14/d3d/f40 [782405,73227] 0 2024-04-25T22:42:13.807 INFO:tasks.workunit.client.0.smithi057.stdout:1/235: getdents d7/dd/d40 0 2024-04-25T22:42:13.807 INFO:tasks.workunit.client.0.smithi057.stdout:4/225: chown d14/c1f 128078 1 2024-04-25T22:42:13.807 INFO:tasks.workunit.client.0.smithi057.stdout:4/226: chown d14/d47 1 1 2024-04-25T22:42:13.809 INFO:tasks.workunit.client.0.smithi057.stdout:6/238: dwrite d2/d19/d20/f3b [0,4194304] 0 2024-04-25T22:42:13.811 INFO:tasks.workunit.client.0.smithi057.stdout:4/227: rename d14/c29 to d14/d3c/d44/c48 0 2024-04-25T22:42:13.811 INFO:tasks.workunit.client.0.smithi057.stdout:4/228: chown d14/f39 5 1 2024-04-25T22:42:13.815 INFO:tasks.workunit.client.0.smithi057.stdout:2/296: fdatasync d1f/d21/f3e 0 2024-04-25T22:42:13.815 INFO:tasks.workunit.client.0.smithi057.stdout:2/297: write f9 [616467,56070] 0 2024-04-25T22:42:13.816 INFO:tasks.workunit.client.0.smithi057.stdout:0/196: read d0/d5/f23 [1319784,130213] 0 2024-04-25T22:42:13.817 INFO:tasks.workunit.client.0.smithi057.stdout:7/203: truncate f1 2353883 0 2024-04-25T22:42:13.817 INFO:tasks.workunit.client.0.smithi057.stdout:0/197: write d0/f2d [2604116,97243] 0 2024-04-25T22:42:13.817 INFO:tasks.workunit.client.0.smithi057.stdout:2/298: rename d1f/d34/f39 to d1f/d21/f62 0 2024-04-25T22:42:13.818 INFO:tasks.workunit.client.0.smithi057.stdout:7/204: unlink d6/f1a 0 2024-04-25T22:42:13.818 INFO:tasks.workunit.client.0.smithi057.stdout:2/299: write d1f/f42 [966196,96297] 0 2024-04-25T22:42:13.818 INFO:tasks.workunit.client.0.smithi057.stdout:0/198: rmdir d0/d3/d6/d14 39 2024-04-25T22:42:13.822 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:13.824 INFO:tasks.workunit.client.0.smithi057.stdout:9/244: dread d3/f20 [0,4194304] 0 2024-04-25T22:42:13.829 INFO:tasks.workunit.client.0.smithi057.stdout:1/236: truncate d7/dd/d26/f3e 3869492 0 2024-04-25T22:42:13.830 INFO:tasks.workunit.client.0.smithi057.stdout:1/237: write d7/f42 [2930988,9834] 0 2024-04-25T22:42:13.830 INFO:tasks.workunit.client.0.smithi057.stdout:9/245: dwrite d3/f29 [0,4194304] 0 2024-04-25T22:42:13.830 INFO:tasks.workunit.client.0.smithi057.stdout:1/238: chown c3 844 1 2024-04-25T22:42:13.831 INFO:tasks.workunit.client.0.smithi057.stdout:1/239: write d7/dd/d16/d18/f2a [1324375,799] 0 2024-04-25T22:42:13.832 INFO:tasks.workunit.client.0.smithi057.stdout:9/246: dread d3/d34/d42/f41 [0,4194304] 0 2024-04-25T22:42:13.832 INFO:tasks.workunit.client.0.smithi057.stdout:1/240: readlink d7/dd/d16/lf 0 2024-04-25T22:42:13.833 INFO:tasks.workunit.client.0.smithi057.stdout:1/241: readlink d7/dd/d16/d18/l1b 0 2024-04-25T22:42:13.833 INFO:tasks.workunit.client.0.smithi057.stdout:7/205: read d6/d1b/d1d/f2a [292792,66242] 0 2024-04-25T22:42:13.834 INFO:tasks.workunit.client.0.smithi057.stdout:1/242: rename d7/dd/c20 to d7/dd/d16/d18/d49/c4d 0 2024-04-25T22:42:13.834 INFO:tasks.workunit.client.0.smithi057.stdout:1/243: unlink d7/dd/d16/d24/f22 0 2024-04-25T22:42:13.835 INFO:tasks.workunit.client.0.smithi057.stdout:1/244: read - d7/dd/d16/d24/f3a zero size 2024-04-25T22:42:13.836 INFO:tasks.workunit.client.0.smithi057.stdout:1/245: mkdir d7/d4e 0 2024-04-25T22:42:13.839 INFO:tasks.workunit.client.0.smithi057.stdout:6/239: write d2/d9/d1a/d22/f29 [304646,96163] 0 2024-04-25T22:42:13.839 INFO:tasks.workunit.client.0.smithi057.stdout:0/199: truncate d0/d3/d6/f1b 2434305 0 2024-04-25T22:42:13.840 INFO:tasks.workunit.client.0.smithi057.stdout:0/200: chown d0/f30 1 1 2024-04-25T22:42:13.840 INFO:tasks.workunit.client.0.smithi057.stdout:8/212: dread d4/d5/d2f/f41 [4194304,4194304] 0 2024-04-25T22:42:13.840 INFO:tasks.workunit.client.0.smithi057.stdout:6/240: mknod d2/d19/d49/c4b 0 2024-04-25T22:42:13.841 INFO:tasks.workunit.client.0.smithi057.stdout:0/201: write d0/d5/ff [6194770,104630] 0 2024-04-25T22:42:13.841 INFO:tasks.workunit.client.0.smithi057.stdout:8/213: unlink d4/c8 0 2024-04-25T22:42:13.841 INFO:tasks.workunit.client.0.smithi057.stdout:6/241: creat d2/d9/f4c x:0 0 0 2024-04-25T22:42:13.842 INFO:tasks.workunit.client.0.smithi057.stdout:0/202: truncate d0/f30 4996599 0 2024-04-25T22:42:13.842 INFO:tasks.workunit.client.0.smithi057.stdout:8/214: fdatasync d4/db/f42 0 2024-04-25T22:42:13.842 INFO:tasks.workunit.client.0.smithi057.stdout:1/246: dwrite d7/dd/d16/f36 [0,4194304] 0 2024-04-25T22:42:13.843 INFO:tasks.workunit.client.0.smithi057.stdout:1/247: write d7/dd/f46 [115829,35938] 0 2024-04-25T22:42:13.845 INFO:tasks.workunit.client.0.smithi057.stdout:2/300: dread d1f/d34/f3d [0,4194304] 0 2024-04-25T22:42:13.845 INFO:tasks.workunit.client.0.smithi057.stdout:4/229: dread d14/f23 [0,4194304] 0 2024-04-25T22:42:13.845 INFO:tasks.workunit.client.0.smithi057.stdout:0/203: symlink d0/d3/l3f 0 2024-04-25T22:42:13.846 INFO:tasks.workunit.client.0.smithi057.stdout:1/248: rename d7/dd/d16/f3f to d7/dd/d16/d24/f4f 0 2024-04-25T22:42:13.848 INFO:tasks.workunit.client.0.smithi057.stdout:2/301: mkdir d1f/d21/d26/d63 0 2024-04-25T22:42:13.849 INFO:tasks.workunit.client.0.smithi057.stdout:0/204: creat d0/d3/d3a/f40 x:0 0 0 2024-04-25T22:42:13.851 INFO:tasks.workunit.client.0.smithi057.stdout:6/242: dwrite d2/d9/d1a/d22/d31/f33 [0,4194304] 0 2024-04-25T22:42:13.852 INFO:tasks.workunit.client.0.smithi057.stdout:2/302: creat d1f/d4a/d4d/f64 x:0 0 0 2024-04-25T22:42:13.852 INFO:tasks.workunit.client.0.smithi057.stdout:8/215: dwrite d4/db/f42 [0,4194304] 0 2024-04-25T22:42:13.853 INFO:tasks.workunit.client.0.smithi057.stdout:6/243: fdatasync d2/d19/d20/f48 0 2024-04-25T22:42:13.854 INFO:tasks.workunit.client.0.smithi057.stdout:1/249: read d7/dd/d26/f47 [2265453,31509] 0 2024-04-25T22:42:13.855 INFO:tasks.workunit.client.0.smithi057.stdout:7/206: dwrite d6/f15 [0,4194304] 0 2024-04-25T22:42:13.855 INFO:tasks.workunit.client.0.smithi057.stdout:2/303: fdatasync d1f/d21/f37 0 2024-04-25T22:42:13.857 INFO:tasks.workunit.client.0.smithi057.stdout:8/216: rename d4/d5/d17/d19/f51 to d4/d5/d48/f55 0 2024-04-25T22:42:13.858 INFO:tasks.workunit.client.0.smithi057.stdout:6/244: dread - d2/d9/d1a/d22/d31/f3f zero size 2024-04-25T22:42:13.858 INFO:tasks.workunit.client.0.smithi057.stdout:4/230: dwrite d14/d3c/d44/f46 [0,4194304] 0 2024-04-25T22:42:13.858 INFO:tasks.workunit.client.0.smithi057.stdout:2/304: rmdir d1f/d21/d33 39 2024-04-25T22:42:13.858 INFO:tasks.workunit.client.0.smithi057.stdout:3/249: dread d0/f33 [0,4194304] 0 2024-04-25T22:42:13.860 INFO:tasks.workunit.client.0.smithi057.stdout:6/245: mknod d2/d9/d1a/c4d 0 2024-04-25T22:42:13.860 INFO:tasks.workunit.client.0.smithi057.stdout:4/231: mknod d14/d2f/c49 0 2024-04-25T22:42:13.860 INFO:tasks.workunit.client.0.smithi057.stdout:8/217: chown d4/d5/d2f/f41 170022 1 2024-04-25T22:42:13.861 INFO:tasks.workunit.client.0.smithi057.stdout:3/250: creat d0/d4/d7/d22/f59 x:0 0 0 2024-04-25T22:42:13.861 INFO:tasks.workunit.client.0.smithi057.stdout:4/232: readlink d14/d2f/l37 0 2024-04-25T22:42:13.861 INFO:tasks.workunit.client.0.smithi057.stdout:0/205: dwrite d0/d5/dd/f35 [0,4194304] 0 2024-04-25T22:42:13.861 INFO:tasks.workunit.client.0.smithi057.stdout:4/233: dread - d14/d2f/f38 zero size 2024-04-25T22:42:13.861 INFO:tasks.workunit.client.0.smithi057.stdout:7/207: mknod d6/c45 0 2024-04-25T22:42:13.861 INFO:tasks.workunit.client.0.smithi057.stdout:8/218: creat d4/db/dd/df/d22/f56 x:0 0 0 2024-04-25T22:42:13.861 INFO:tasks.workunit.client.0.smithi057.stdout:4/234: rename d14/d2f/f3a to d14/d2f/f4a 0 2024-04-25T22:42:13.861 INFO:tasks.workunit.client.0.smithi057.stdout:0/206: mknod d0/d3/d6/d14/d38/c41 0 2024-04-25T22:42:13.862 INFO:tasks.workunit.client.0.smithi057.stdout:0/207: read d0/d5/dd/f1d [438318,40115] 0 2024-04-25T22:42:13.863 INFO:tasks.workunit.client.0.smithi057.stdout:0/208: rename d0/d5/dd to d0/d3/d6/d29/d42 0 2024-04-25T22:42:13.865 INFO:tasks.workunit.client.0.smithi057.stdout:2/305: dwrite f1b [0,4194304] 0 2024-04-25T22:42:13.865 INFO:tasks.workunit.client.0.smithi057.stdout:0/209: chown d0/d3/d6/d29/c2c 156927948 1 2024-04-25T22:42:13.866 INFO:tasks.workunit.client.0.smithi057.stdout:2/306: chown d1f/d21/d33/f5a 1637 1 2024-04-25T22:42:13.866 INFO:tasks.workunit.client.0.smithi057.stdout:0/210: mkdir d0/d3/d6/d14/d38/d43 0 2024-04-25T22:42:13.867 INFO:tasks.workunit.client.0.smithi057.stdout:2/307: symlink d1f/d36/d54/l65 0 2024-04-25T22:42:13.867 INFO:tasks.workunit.client.0.smithi057.stdout:1/250: write d7/dd/d16/d18/f23 [1202181,108560] 0 2024-04-25T22:42:13.868 INFO:tasks.workunit.client.0.smithi057.stdout:2/308: write d1f/f42 [1890061,89077] 0 2024-04-25T22:42:13.869 INFO:tasks.workunit.client.0.smithi057.stdout:2/309: symlink d1f/d36/l66 0 2024-04-25T22:42:13.869 INFO:tasks.workunit.client.0.smithi057.stdout:1/251: chown d7/dd/d16/f36 13869 1 2024-04-25T22:42:13.871 INFO:tasks.workunit.client.0.smithi057.stdout:2/310: creat d1f/d21/d26/f67 x:0 0 0 2024-04-25T22:42:13.872 INFO:tasks.workunit.client.0.smithi057.stdout:4/235: dwrite d14/f16 [0,4194304] 0 2024-04-25T22:42:13.872 INFO:tasks.workunit.client.0.smithi057.stdout:1/252: creat d7/dd/d26/f50 x:0 0 0 2024-04-25T22:42:13.873 INFO:tasks.workunit.client.0.smithi057.stdout:8/219: truncate d4/db/dd/f20 583212 0 2024-04-25T22:42:13.873 INFO:tasks.workunit.client.0.smithi057.stdout:4/236: truncate d14/f1c 1066752 0 2024-04-25T22:42:13.874 INFO:tasks.workunit.client.0.smithi057.stdout:0/211: dwrite d0/f17 [0,4194304] 0 2024-04-25T22:42:13.874 INFO:tasks.workunit.client.0.smithi057.stdout:8/220: creat d4/d5/d17/d19/f57 x:0 0 0 2024-04-25T22:42:13.874 INFO:tasks.workunit.client.0.smithi057.stdout:0/212: fdatasync d0/d3/f1c 0 2024-04-25T22:42:13.875 INFO:tasks.workunit.client.0.smithi057.stdout:4/237: truncate d14/d3c/d44/f46 4873101 0 2024-04-25T22:42:13.877 INFO:tasks.workunit.client.0.smithi057.stdout:6/246: dwrite d2/f1c [0,4194304] 0 2024-04-25T22:42:13.878 INFO:tasks.workunit.client.0.smithi057.stdout:6/247: chown d2/f11 3 1 2024-04-25T22:42:13.879 INFO:tasks.workunit.client.0.smithi057.stdout:0/213: mknod d0/c44 0 2024-04-25T22:42:13.880 INFO:tasks.workunit.client.0.smithi057.stdout:0/214: readlink d0/d3/l27 0 2024-04-25T22:42:13.880 INFO:tasks.workunit.client.0.smithi057.stdout:4/238: link d14/d2f/l36 d14/d3c/d44/l4b 0 2024-04-25T22:42:13.880 INFO:tasks.workunit.client.0.smithi057.stdout:1/253: dwrite d7/dd/d16/d24/f3a [0,4194304] 0 2024-04-25T22:42:13.881 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:13.875+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:13.882 INFO:tasks.workunit.client.0.smithi057.stdout:4/239: write d14/d2f/f38 [634542,63087] 0 2024-04-25T22:42:13.882 INFO:tasks.workunit.client.0.smithi057.stdout:0/215: creat d0/d3/d6/f45 x:0 0 0 2024-04-25T22:42:13.882 INFO:tasks.workunit.client.0.smithi057.stdout:1/254: stat d7/dd/d16/d18/f34 0 2024-04-25T22:42:13.883 INFO:tasks.workunit.client.0.smithi057.stdout:0/216: chown d0/d3/d6 591 1 2024-04-25T22:42:13.884 INFO:tasks.workunit.client.0.smithi057.stdout:0/217: rename d0/d3/d6/d14/d38 to d0/d3/d6/d29/d42/d46 0 2024-04-25T22:42:13.887 INFO:tasks.workunit.client.0.smithi057.stdout:0/218: rename d0/d3/c25 to d0/d5/c47 0 2024-04-25T22:42:13.887 INFO:tasks.workunit.client.0.smithi057.stdout:5/255: sync 2024-04-25T22:42:13.888 INFO:tasks.workunit.client.0.smithi057.stdout:6/248: dwrite d2/d19/f3d [0,4194304] 0 2024-04-25T22:42:13.888 INFO:tasks.workunit.client.0.smithi057.stdout:9/247: dread d3/f1e [0,4194304] 0 2024-04-25T22:42:13.888 INFO:tasks.workunit.client.0.smithi057.stdout:6/249: read d2/f4 [508023,108461] 0 2024-04-25T22:42:13.889 INFO:tasks.workunit.client.0.smithi057.stdout:0/219: creat d0/d3/d6/d29/d42/d46/d43/f48 x:0 0 0 2024-04-25T22:42:13.890 INFO:tasks.workunit.client.0.smithi057.stdout:9/248: write d3/d34/d42/d28/f37 [1143385,129524] 0 2024-04-25T22:42:13.891 INFO:tasks.workunit.client.0.smithi057.stdout:6/250: dread - d2/d9/f4c zero size 2024-04-25T22:42:13.891 INFO:tasks.workunit.client.0.smithi057.stdout:9/249: link d3/ff d3/f4e 0 2024-04-25T22:42:13.892 INFO:tasks.workunit.client.0.smithi057.stdout:9/250: write d3/d34/d42/d28/d39/f46 [551852,26873] 0 2024-04-25T22:42:13.893 INFO:tasks.workunit.client.0.smithi057.stdout:6/251: creat d2/d9/d1a/f4e x:0 0 0 2024-04-25T22:42:13.898 INFO:tasks.workunit.client.0.smithi057.stdout:9/251: dwrite d3/f12 [0,4194304] 0 2024-04-25T22:42:13.899 INFO:tasks.workunit.client.0.smithi057.stdout:9/252: write d3/f12 [10138605,45958] 0 2024-04-25T22:42:13.905 INFO:tasks.workunit.client.0.smithi057.stdout:3/251: dread d0/d4/f2d [0,4194304] 0 2024-04-25T22:42:13.906 INFO:tasks.workunit.client.0.smithi057.stdout:9/253: dwrite d3/d34/d42/d28/d39/f3a [0,4194304] 0 2024-04-25T22:42:13.906 INFO:tasks.workunit.client.0.smithi057.stdout:3/252: chown d0/d4/f2d 65 1 2024-04-25T22:42:13.907 INFO:tasks.workunit.client.0.smithi057.stdout:9/254: write d3/f9 [714116,62773] 0 2024-04-25T22:42:13.908 INFO:tasks.workunit.client.0.smithi057.stdout:9/255: readlink d3/d34/d42/d28/d2d/l4d 0 2024-04-25T22:42:13.908 INFO:tasks.workunit.client.0.smithi057.stdout:2/311: truncate f9 467810 0 2024-04-25T22:42:13.908 INFO:tasks.workunit.client.0.smithi057.stdout:3/253: dread d0/d4/d7/d26/f43 [0,4194304] 0 2024-04-25T22:42:13.908 INFO:tasks.workunit.client.0.smithi057.stdout:2/312: write f1d [822290,88700] 0 2024-04-25T22:42:13.909 INFO:tasks.workunit.client.0.smithi057.stdout:9/256: link d3/f20 d3/f4f 0 2024-04-25T22:42:13.909 INFO:tasks.workunit.client.0.smithi057.stdout:8/221: truncate d4/f25 2949518 0 2024-04-25T22:42:13.909 INFO:tasks.workunit.client.0.smithi057.stdout:3/254: creat d0/d4/d7/d46/d30/f5a x:0 0 0 2024-04-25T22:42:13.910 INFO:tasks.workunit.client.0.smithi057.stdout:2/313: mknod d1f/d21/c68 0 2024-04-25T22:42:13.910 INFO:tasks.workunit.client.0.smithi057.stdout:4/240: write d14/f23 [984348,99746] 0 2024-04-25T22:42:13.910 INFO:tasks.workunit.client.0.smithi057.stdout:0/220: rename d0/d3/d6/d29/d42/d46/d43 to d0/d49 0 2024-04-25T22:42:13.911 INFO:tasks.workunit.client.0.smithi057.stdout:8/222: chown d4/d5/f4d 32780392 1 2024-04-25T22:42:13.911 INFO:tasks.workunit.client.0.smithi057.stdout:6/252: write d2/f40 [691892,72975] 0 2024-04-25T22:42:13.911 INFO:tasks.workunit.client.0.smithi057.stdout:0/221: chown d0/d3/l11 11 1 2024-04-25T22:42:13.912 INFO:tasks.workunit.client.0.smithi057.stdout:4/241: chown d14/l15 1521395139 1 2024-04-25T22:42:13.912 INFO:tasks.workunit.client.0.smithi057.stdout:6/253: mkdir d2/d19/d26/d4f 0 2024-04-25T22:42:13.912 INFO:tasks.workunit.client.0.smithi057.stdout:8/223: creat d4/d5/d2f/f58 x:0 0 0 2024-04-25T22:42:13.913 INFO:tasks.workunit.client.0.smithi057.stdout:8/224: read - d4/f4f zero size 2024-04-25T22:42:13.913 INFO:tasks.workunit.client.0.smithi057.stdout:4/242: mkdir d14/d2f/d4c 0 2024-04-25T22:42:13.913 INFO:tasks.workunit.client.0.smithi057.stdout:3/255: truncate d0/d4/d7/d26/f56 731353 0 2024-04-25T22:42:13.914 INFO:tasks.workunit.client.0.smithi057.stdout:6/254: write d2/d19/f43 [634437,66920] 0 2024-04-25T22:42:13.914 INFO:tasks.workunit.client.0.smithi057.stdout:0/222: write d0/d3/d6/f45 [786092,105747] 0 2024-04-25T22:42:13.915 INFO:tasks.workunit.client.0.smithi057.stdout:2/314: rename d1f/d21/d26/l56 to d1f/d36/l69 0 2024-04-25T22:42:13.915 INFO:tasks.workunit.client.0.smithi057.stdout:1/255: dwrite d7/dd/d16/d24/f3a [4194304,4194304] 0 2024-04-25T22:42:13.915 INFO:tasks.workunit.client.0.smithi057.stdout:4/243: symlink d14/d3d/l4d 0 2024-04-25T22:42:13.916 INFO:tasks.workunit.client.0.smithi057.stdout:3/256: mkdir d0/d5b 0 2024-04-25T22:42:13.916 INFO:tasks.workunit.client.0.smithi057.stdout:6/255: write d2/d19/d20/f38 [149036,115120] 0 2024-04-25T22:42:13.917 INFO:tasks.workunit.client.0.smithi057.stdout:1/256: dread - d7/dd/d40/d41/f4b zero size 2024-04-25T22:42:13.917 INFO:tasks.workunit.client.0.smithi057.stdout:8/225: truncate d4/d5/d21/f4c 303770 0 2024-04-25T22:42:13.917 INFO:tasks.workunit.client.0.smithi057.stdout:6/256: rename d2/d9 to d2/d19/d50 0 2024-04-25T22:42:13.918 INFO:tasks.workunit.client.0.smithi057.stdout:6/257: chown c1 1374166 1 2024-04-25T22:42:13.919 INFO:tasks.workunit.client.0.smithi057.stdout:0/223: write d0/d3/d6/f45 [474475,70415] 0 2024-04-25T22:42:13.920 INFO:tasks.workunit.client.0.smithi057.stdout:3/257: creat d0/d4/d34/d3c/f5c x:0 0 0 2024-04-25T22:42:13.920 INFO:tasks.workunit.client.0.smithi057.stdout:9/257: dwrite d3/d34/d42/d28/f3b [0,4194304] 0 2024-04-25T22:42:13.921 INFO:tasks.workunit.client.0.smithi057.stdout:5/256: dread d2/d6/db/f25 [0,4194304] 0 2024-04-25T22:42:13.921 INFO:tasks.workunit.client.0.smithi057.stdout:6/258: chown d2/d19/d50/c39 0 1 2024-04-25T22:42:13.924 INFO:tasks.workunit.client.0.smithi057.stdout:5/257: mkdir d2/d6/d4f 0 2024-04-25T22:42:13.925 INFO:tasks.workunit.client.0.smithi057.stdout:3/258: unlink d0/d4/d7/d46/d30/l40 0 2024-04-25T22:42:13.925 INFO:tasks.workunit.client.0.smithi057.stdout:9/258: rmdir d3/d34/d42/d28/d2d 39 2024-04-25T22:42:13.925 INFO:tasks.workunit.client.0.smithi057.stdout:4/244: dread ff [4194304,4194304] 0 2024-04-25T22:42:13.925 INFO:tasks.workunit.client.0.smithi057.stdout:5/258: fsync d2/d1c/d24/f4c 0 2024-04-25T22:42:13.927 INFO:tasks.workunit.client.0.smithi057.stdout:9/259: creat d3/d34/f50 x:0 0 0 2024-04-25T22:42:13.928 INFO:tasks.workunit.client.0.smithi057.stdout:7/208: dread d6/d1b/d1d/f2a [0,4194304] 0 2024-04-25T22:42:13.928 INFO:tasks.workunit.client.0.smithi057.stdout:5/259: chown d2/d1c/d24/d3d 241756 1 2024-04-25T22:42:13.931 INFO:tasks.workunit.client.0.smithi057.stdout:8/226: truncate d4/d5/d21/f4c 896705 0 2024-04-25T22:42:13.931 INFO:tasks.workunit.client.0.smithi057.stdout:7/209: mkdir d6/d1b/d30/d46 0 2024-04-25T22:42:13.931 INFO:tasks.workunit.client.0.smithi057.stdout:2/315: dwrite d1f/d4a/f3b [0,4194304] 0 2024-04-25T22:42:13.934 INFO:tasks.workunit.client.0.smithi057.stdout:1/257: dwrite d7/dd/d16/d24/f3a [4194304,4194304] 0 2024-04-25T22:42:13.934 INFO:tasks.workunit.client.0.smithi057.stdout:9/260: creat d3/d34/d42/d28/f51 x:0 0 0 2024-04-25T22:42:13.934 INFO:tasks.workunit.client.0.smithi057.stdout:6/259: dwrite d2/d19/d50/f2a [0,4194304] 0 2024-04-25T22:42:13.934 INFO:tasks.workunit.client.0.smithi057.stdout:0/224: dwrite d0/d49/f48 [0,4194304] 0 2024-04-25T22:42:13.934 INFO:tasks.workunit.client.0.smithi057.stdout:3/259: write d0/fa [456902,23905] 0 2024-04-25T22:42:13.935 INFO:tasks.workunit.client.0.smithi057.stdout:1/258: read - d7/dd/d26/f50 zero size 2024-04-25T22:42:13.936 INFO:tasks.workunit.client.0.smithi057.stdout:6/260: write d2/d19/d50/d1a/d22/d31/f3f [291865,128433] 0 2024-04-25T22:42:13.938 INFO:tasks.workunit.client.0.smithi057.stdout:3/260: mknod d0/d4/d7/d22/c5d 0 2024-04-25T22:42:13.938 INFO:tasks.workunit.client.0.smithi057.stdout:7/210: rename d6/d1b/d30/f3e to d6/d1b/d1d/f47 0 2024-04-25T22:42:13.939 INFO:tasks.workunit.client.0.smithi057.stdout:9/261: fdatasync d3/d34/d42/d28/d39/f46 0 2024-04-25T22:42:13.939 INFO:tasks.workunit.client.0.smithi057.stdout:4/245: dwrite d14/d3d/f40 [0,4194304] 0 2024-04-25T22:42:13.940 INFO:tasks.workunit.client.0.smithi057.stdout:9/262: dread - d3/f32 zero size 2024-04-25T22:42:13.940 INFO:tasks.workunit.client.0.smithi057.stdout:1/259: creat d7/dd/d40/f51 x:0 0 0 2024-04-25T22:42:13.941 INFO:tasks.workunit.client.0.smithi057.stdout:7/211: creat d6/f48 x:0 0 0 2024-04-25T22:42:13.941 INFO:tasks.workunit.client.0.smithi057.stdout:5/260: dwrite d2/d6/db/f2f [0,4194304] 0 2024-04-25T22:42:13.942 INFO:tasks.workunit.client.0.smithi057.stdout:7/212: write d6/d28/f42 [927246,36397] 0 2024-04-25T22:42:13.942 INFO:tasks.workunit.client.0.smithi057.stdout:0/225: read d0/d3/d6/f45 [235675,21676] 0 2024-04-25T22:42:13.942 INFO:tasks.workunit.client.0.smithi057.stdout:3/261: truncate d0/d4/d7/d22/f2b 1554841 0 2024-04-25T22:42:13.943 INFO:tasks.workunit.client.0.smithi057.stdout:4/246: dread d14/f23 [0,4194304] 0 2024-04-25T22:42:13.944 INFO:tasks.workunit.client.0.smithi057.stdout:1/260: symlink d7/dd/d16/d18/d49/l52 0 2024-04-25T22:42:13.944 INFO:tasks.workunit.client.0.smithi057.stdout:5/261: mkdir d2/d1c/d24/d3d/d50 0 2024-04-25T22:42:13.944 INFO:tasks.workunit.client.0.smithi057.stdout:7/213: chown d6/d1b/d1d/f47 5532945 1 2024-04-25T22:42:13.944 INFO:tasks.workunit.client.0.smithi057.stdout:0/226: chown d0/d3/f1c 70057 1 2024-04-25T22:42:13.945 INFO:tasks.workunit.client.0.smithi057.stdout:7/214: write f1 [3611856,76511] 0 2024-04-25T22:42:13.946 INFO:tasks.workunit.client.0.smithi057.stdout:2/316: dread d1f/d21/d26/f3a [0,4194304] 0 2024-04-25T22:42:13.949 INFO:tasks.workunit.client.0.smithi057.stdout:0/227: truncate d0/f2b 2666660 0 2024-04-25T22:42:13.949 INFO:tasks.workunit.client.0.smithi057.stdout:6/261: read d2/d19/d50/d1a/d22/d31/f3a [498102,124732] 0 2024-04-25T22:42:13.949 INFO:tasks.workunit.client.0.smithi057.stdout:2/317: mknod d1f/c6a 0 2024-04-25T22:42:13.950 INFO:tasks.workunit.client.0.smithi057.stdout:9/263: dread d3/d34/d42/d28/d39/f3a [0,4194304] 0 2024-04-25T22:42:13.950 INFO:tasks.workunit.client.0.smithi057.stdout:4/247: creat d14/f4e x:0 0 0 2024-04-25T22:42:13.950 INFO:tasks.workunit.client.0.smithi057.stdout:7/215: getdents d6/d28 0 2024-04-25T22:42:13.951 INFO:tasks.workunit.client.0.smithi057.stdout:2/318: creat d1f/d21/d26/f6b x:0 0 0 2024-04-25T22:42:13.952 INFO:tasks.workunit.client.0.smithi057.stdout:0/228: truncate d0/d3/d6/d29/d42/f37 226588 0 2024-04-25T22:42:13.952 INFO:tasks.workunit.client.0.smithi057.stdout:4/248: dread d14/f23 [0,4194304] 0 2024-04-25T22:42:13.953 INFO:tasks.workunit.client.0.smithi057.stdout:3/262: dwrite d0/d4/d7/d26/f31 [0,4194304] 0 2024-04-25T22:42:13.953 INFO:tasks.workunit.client.0.smithi057.stdout:1/261: dwrite d7/dd/d40/f51 [0,4194304] 0 2024-04-25T22:42:13.954 INFO:tasks.workunit.client.0.smithi057.stdout:0/229: write d0/d3/f15 [4564905,36240] 0 2024-04-25T22:42:13.954 INFO:tasks.workunit.client.0.smithi057.stdout:9/264: fdatasync d3/d34/d42/d28/d2d/f3d 0 2024-04-25T22:42:13.955 INFO:tasks.workunit.client.0.smithi057.stdout:2/319: mknod d1f/d21/c6c 0 2024-04-25T22:42:13.955 INFO:tasks.workunit.client.0.smithi057.stdout:6/262: link d2/d19/d50/d1a/c44 d2/d19/d49/c51 0 2024-04-25T22:42:13.955 INFO:tasks.workunit.client.0.smithi057.stdout:4/249: write d14/f23 [1059830,85740] 0 2024-04-25T22:42:13.955 INFO:tasks.workunit.client.0.smithi057.stdout:9/265: rmdir d3/d34 39 2024-04-25T22:42:13.956 INFO:tasks.workunit.client.0.smithi057.stdout:0/230: rename d0/d3/d6 to d0/d3/d6/d4a 22 2024-04-25T22:42:13.956 INFO:tasks.workunit.client.0.smithi057.stdout:1/262: creat d7/dd/d16/d18/d49/f53 x:0 0 0 2024-04-25T22:42:13.957 INFO:tasks.workunit.client.0.smithi057.stdout:2/320: truncate d1f/d21/f37 5051413 0 2024-04-25T22:42:13.957 INFO:tasks.workunit.client.0.smithi057.stdout:6/263: creat d2/d19/d50/d1a/f52 x:0 0 0 2024-04-25T22:42:13.957 INFO:tasks.workunit.client.0.smithi057.stdout:4/250: truncate d14/f20 838274 0 2024-04-25T22:42:13.958 INFO:tasks.workunit.client.0.smithi057.stdout:0/231: chown d0/d5/c47 857914 1 2024-04-25T22:42:13.958 INFO:tasks.workunit.client.0.smithi057.stdout:9/266: creat d3/d34/d42/f52 x:0 0 0 2024-04-25T22:42:13.958 INFO:tasks.workunit.client.0.smithi057.stdout:2/321: chown d1f/d21/f37 755653 1 2024-04-25T22:42:13.958 INFO:tasks.workunit.client.0.smithi057.stdout:1/263: creat d7/dd/d16/d24/f54 x:0 0 0 2024-04-25T22:42:13.959 INFO:tasks.workunit.client.0.smithi057.stdout:7/216: dwrite d6/d28/f33 [0,4194304] 0 2024-04-25T22:42:13.959 INFO:tasks.workunit.client.0.smithi057.stdout:6/264: write d2/f14 [4824299,130832] 0 2024-04-25T22:42:13.959 INFO:tasks.workunit.client.0.smithi057.stdout:4/251: chown d14/d2f/l36 1035 1 2024-04-25T22:42:13.959 INFO:tasks.workunit.client.0.smithi057.stdout:9/267: chown d3/f1a 104227162 1 2024-04-25T22:42:13.961 INFO:tasks.workunit.client.0.smithi057.stdout:6/265: fdatasync d2/f2b 0 2024-04-25T22:42:13.961 INFO:tasks.workunit.client.0.smithi057.stdout:0/232: write d0/d3/d6/d29/d42/f37 [1009937,83582] 0 2024-04-25T22:42:13.961 INFO:tasks.workunit.client.0.smithi057.stdout:2/322: creat d1f/d21/d26/d63/f6d x:0 0 0 2024-04-25T22:42:13.961 INFO:tasks.workunit.client.0.smithi057.stdout:4/252: chown d14/f28 11 1 2024-04-25T22:42:13.962 INFO:tasks.workunit.client.0.smithi057.stdout:7/217: creat d6/d1b/d30/d46/f49 x:0 0 0 2024-04-25T22:42:13.962 INFO:tasks.workunit.client.0.smithi057.stdout:7/218: fdatasync d6/f48 0 2024-04-25T22:42:13.962 INFO:tasks.workunit.client.0.smithi057.stdout:2/323: unlink d1f/d21/d26/d63/f6d 0 2024-04-25T22:42:13.962 INFO:tasks.workunit.client.0.smithi057.stdout:4/253: write d14/f30 [403566,783] 0 2024-04-25T22:42:13.962 INFO:tasks.workunit.client.0.smithi057.stdout:6/266: truncate d2/f11 977845 0 2024-04-25T22:42:13.963 INFO:tasks.workunit.client.0.smithi057.stdout:6/267: write d2/d19/d50/f4c [410545,18681] 0 2024-04-25T22:42:13.964 INFO:tasks.workunit.client.0.smithi057.stdout:9/268: rename d3/l6 to d3/d34/d42/d28/d2d/l53 0 2024-04-25T22:42:13.964 INFO:tasks.workunit.client.0.smithi057.stdout:0/233: mknod d0/d3/d3a/d3b/c4b 0 2024-04-25T22:42:13.964 INFO:tasks.workunit.client.0.smithi057.stdout:6/268: fsync d2/d19/d50/d1a/d22/d31/f3f 0 2024-04-25T22:42:13.966 INFO:tasks.workunit.client.0.smithi057.stdout:9/269: dread - d3/d34/d42/d28/f51 zero size 2024-04-25T22:42:13.966 INFO:tasks.workunit.client.0.smithi057.stdout:3/263: truncate d0/d11/f3b 1902594 0 2024-04-25T22:42:13.967 INFO:tasks.workunit.client.0.smithi057.stdout:0/234: symlink d0/d3/d6/d14/d39/l4c 0 2024-04-25T22:42:13.967 INFO:tasks.workunit.client.0.smithi057.stdout:1/264: dwrite d7/dd/d16/d24/f4f [0,4194304] 0 2024-04-25T22:42:13.968 INFO:tasks.workunit.client.0.smithi057.stdout:6/269: rename d2/d19/d50/f2a to d2/d19/d50/d1a/d22/f53 0 2024-04-25T22:42:13.968 INFO:tasks.workunit.client.0.smithi057.stdout:9/270: truncate d3/f23 260051 0 2024-04-25T22:42:13.969 INFO:tasks.workunit.client.0.smithi057.stdout:9/271: chown d3/c1d 939 1 2024-04-25T22:42:13.969 INFO:tasks.workunit.client.0.smithi057.stdout:1/265: mknod d7/dd/d40/d41/c55 0 2024-04-25T22:42:13.969 INFO:tasks.workunit.client.0.smithi057.stdout:0/235: getdents d0/d3/d3a 0 2024-04-25T22:42:13.970 INFO:tasks.workunit.client.0.smithi057.stdout:2/324: dwrite d1f/f42 [0,4194304] 0 2024-04-25T22:42:13.971 INFO:tasks.workunit.client.0.smithi057.stdout:9/272: mkdir d3/d34/d42/d28/d39/d54 0 2024-04-25T22:42:13.972 INFO:tasks.workunit.client.0.smithi057.stdout:6/270: dread d2/d19/d20/f38 [0,4194304] 0 2024-04-25T22:42:13.972 INFO:tasks.workunit.client.0.smithi057.stdout:2/325: rename d1f/d21/f22 to d1f/d21/d33/f6e 0 2024-04-25T22:42:13.972 INFO:tasks.workunit.client.0.smithi057.stdout:9/273: creat d3/d34/d42/d28/f55 x:0 0 0 2024-04-25T22:42:13.973 INFO:tasks.workunit.client.0.smithi057.stdout:2/326: mknod d1f/d21/d26/d63/c6f 0 2024-04-25T22:42:13.974 INFO:tasks.workunit.client.0.smithi057.stdout:2/327: write d1f/d34/f57 [53229,88085] 0 2024-04-25T22:42:13.974 INFO:tasks.workunit.client.0.smithi057.stdout:4/254: fdatasync d14/f30 0 2024-04-25T22:42:13.975 INFO:tasks.workunit.client.0.smithi057.stdout:0/236: dread d0/d3/f15 [0,4194304] 0 2024-04-25T22:42:13.976 INFO:tasks.workunit.client.0.smithi057.stdout:0/237: rename d0/d3/d6/d29/d42 to d0/d3/d4d 0 2024-04-25T22:42:13.977 INFO:tasks.workunit.client.0.smithi057.stdout:4/255: read d14/f20 [572942,61639] 0 2024-04-25T22:42:13.978 INFO:tasks.workunit.client.0.smithi057.stdout:0/238: getdents d0/d5 0 2024-04-25T22:42:13.978 INFO:tasks.workunit.client.0.smithi057.stdout:4/256: symlink d14/d47/l4f 0 2024-04-25T22:42:13.979 INFO:tasks.workunit.client.0.smithi057.stdout:0/239: fdatasync d0/d3/d6/f1b 0 2024-04-25T22:42:13.979 INFO:tasks.workunit.client.0.smithi057.stdout:9/274: dwrite d3/d34/f50 [0,4194304] 0 2024-04-25T22:42:13.979 INFO:tasks.workunit.client.0.smithi057.stdout:4/257: symlink d14/l50 0 2024-04-25T22:42:13.980 INFO:tasks.workunit.client.0.smithi057.stdout:0/240: creat d0/d49/f4e x:0 0 0 2024-04-25T22:42:13.980 INFO:tasks.workunit.client.0.smithi057.stdout:9/275: write d3/f14 [3293802,38360] 0 2024-04-25T22:42:13.980 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:13.975+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:13.981 INFO:tasks.workunit.client.0.smithi057.stdout:0/241: rename d0/d5/ff to d0/d3/d3a/f4f 0 2024-04-25T22:42:13.981 INFO:tasks.workunit.client.0.smithi057.stdout:9/276: fdatasync d3/d34/d42/d28/f51 0 2024-04-25T22:42:13.981 INFO:tasks.workunit.client.0.smithi057.stdout:0/242: rmdir d0/d3 39 2024-04-25T22:42:13.981 INFO:tasks.workunit.client.0.smithi057.stdout:9/277: creat d3/f56 x:0 0 0 2024-04-25T22:42:13.982 INFO:tasks.workunit.client.0.smithi057.stdout:0/243: rename d0/d3/d6/c34 to d0/d3/d4d/c50 0 2024-04-25T22:42:13.984 INFO:tasks.workunit.client.0.smithi057.stdout:0/244: chown d0/d3/d6/d29/c2c 1012858649 1 2024-04-25T22:42:13.984 INFO:tasks.workunit.client.0.smithi057.stdout:0/245: chown d0/d49 120 1 2024-04-25T22:42:13.984 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:13.984 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:13.985 INFO:tasks.workunit.client.0.smithi057.stdout:0/246: chown d0/f17 0 1 2024-04-25T22:42:13.986 INFO:tasks.workunit.client.0.smithi057.stdout:0/247: fdatasync d0/d3/f15 0 2024-04-25T22:42:13.986 INFO:tasks.workunit.client.0.smithi057.stdout:6/271: write d2/d19/d50/d1a/d22/d31/f3a [1061350,117307] 0 2024-04-25T22:42:13.987 INFO:tasks.workunit.client.0.smithi057.stdout:4/258: dwrite ff [0,4194304] 0 2024-04-25T22:42:13.987 INFO:tasks.workunit.client.0.smithi057.stdout:6/272: chown d2/f2b 381 1 2024-04-25T22:42:13.988 INFO:tasks.workunit.client.0.smithi057.stdout:4/259: creat d14/d47/f51 x:0 0 0 2024-04-25T22:42:13.988 INFO:tasks.workunit.client.0.smithi057.stdout:8/227: dread d4/db/dd/df/d22/f3f [0,4194304] 0 2024-04-25T22:42:13.988 INFO:tasks.workunit.client.0.smithi057.stdout:6/273: write d2/d19/f1e [1363649,123116] 0 2024-04-25T22:42:13.989 INFO:tasks.workunit.client.0.smithi057.stdout:8/228: chown d4/d5/d17/l2d 710 1 2024-04-25T22:42:13.990 INFO:tasks.workunit.client.0.smithi057.stdout:1/266: dwrite d7/dd/d26/f47 [0,4194304] 0 2024-04-25T22:42:13.991 INFO:tasks.workunit.client.0.smithi057.stdout:6/274: creat d2/d19/d49/f54 x:0 0 0 2024-04-25T22:42:13.991 INFO:tasks.workunit.client.0.smithi057.stdout:0/248: rmdir d0/d3/d4d 39 2024-04-25T22:42:13.992 INFO:tasks.workunit.client.0.smithi057.stdout:0/249: rmdir d0/d3/d3a 39 2024-04-25T22:42:13.992 INFO:tasks.workunit.client.0.smithi057.stdout:6/275: rmdir d2/d19/d26/d4a 0 2024-04-25T22:42:13.994 INFO:tasks.workunit.client.0.smithi057.stdout:9/278: truncate d3/d34/f50 3091501 0 2024-04-25T22:42:13.995 INFO:tasks.workunit.client.0.smithi057.stdout:2/328: dwrite d1f/d21/d26/f3a [4194304,4194304] 0 2024-04-25T22:42:13.996 INFO:tasks.workunit.client.0.smithi057.stdout:9/279: chown d3/c1d 243667 1 2024-04-25T22:42:13.997 INFO:tasks.workunit.client.0.smithi057.stdout:4/260: dwrite ff [0,4194304] 0 2024-04-25T22:42:13.998 INFO:tasks.workunit.client.0.smithi057.stdout:9/280: chown d3/f4f 65951149 1 2024-04-25T22:42:13.999 INFO:tasks.workunit.client.0.smithi057.stdout:2/329: rename d1f/d34/f44 to d1f/d21/d26/f70 0 2024-04-25T22:42:13.999 INFO:tasks.workunit.client.0.smithi057.stdout:8/229: dread d4/d5/f15 [0,4194304] 0 2024-04-25T22:42:14.000 INFO:tasks.workunit.client.0.smithi057.stdout:6/276: dread d2/d19/d50/f4c [0,4194304] 0 2024-04-25T22:42:14.000 INFO:tasks.workunit.client.0.smithi057.stdout:0/250: dwrite d0/d3/f15 [0,4194304] 0 2024-04-25T22:42:14.001 INFO:tasks.workunit.client.0.smithi057.stdout:2/330: rmdir d1f/d21/d26/d63 39 2024-04-25T22:42:14.001 INFO:tasks.workunit.client.0.smithi057.stdout:8/230: dread - d4/d5/d21/f2a zero size 2024-04-25T22:42:14.002 INFO:tasks.workunit.client.0.smithi057.stdout:6/277: creat d2/d19/d50/d1a/f55 x:0 0 0 2024-04-25T22:42:14.002 INFO:tasks.workunit.client.0.smithi057.stdout:0/251: symlink d0/d3/d4d/l51 0 2024-04-25T22:42:14.003 INFO:tasks.workunit.client.0.smithi057.stdout:8/231: fsync d4/d5/d2f/f41 0 2024-04-25T22:42:14.003 INFO:tasks.workunit.client.0.smithi057.stdout:6/278: dread - d2/d19/d50/d1a/f4e zero size 2024-04-25T22:42:14.003 INFO:tasks.workunit.client.0.smithi057.stdout:2/331: creat d1f/d21/d26/f71 x:0 0 0 2024-04-25T22:42:14.003 INFO:tasks.workunit.client.0.smithi057.stdout:4/261: dread d14/f25 [0,4194304] 0 2024-04-25T22:42:14.003 INFO:tasks.workunit.client.0.smithi057.stdout:6/279: chown d2/d19/d26/f2f 66 1 2024-04-25T22:42:14.004 INFO:tasks.workunit.client.0.smithi057.stdout:8/232: chown d4/db/dd/df/d22/f46 2 1 2024-04-25T22:42:14.005 INFO:tasks.workunit.client.0.smithi057.stdout:0/252: getdents d0 0 2024-04-25T22:42:14.005 INFO:tasks.workunit.client.0.smithi057.stdout:6/280: link d2/d19/d50/d1a/f52 d2/d19/d26/d4f/f56 0 2024-04-25T22:42:14.005 INFO:tasks.workunit.client.0.smithi057.stdout:4/262: creat d14/d2f/f52 x:0 0 0 2024-04-25T22:42:14.005 INFO:tasks.workunit.client.0.smithi057.stdout:8/233: creat d4/db/dd/df/d22/f59 x:0 0 0 2024-04-25T22:42:14.006 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:14.007 INFO:tasks.workunit.client.0.smithi057.stdout:6/281: dread - d2/d19/d50/d1a/f42 zero size 2024-04-25T22:42:14.007 INFO:tasks.workunit.client.0.smithi057.stdout:6/282: stat d2/f1c 0 2024-04-25T22:42:14.010 INFO:tasks.workunit.client.0.smithi057.stdout:0/253: dwrite d0/f2d [4194304,4194304] 0 2024-04-25T22:42:14.010 INFO:tasks.workunit.client.0.smithi057.stdout:5/262: sync 2024-04-25T22:42:14.010 INFO:tasks.workunit.client.0.smithi057.stdout:7/219: sync 2024-04-25T22:42:14.011 INFO:tasks.workunit.client.0.smithi057.stdout:0/254: mknod d0/d3/d6/c52 0 2024-04-25T22:42:14.011 INFO:tasks.workunit.client.0.smithi057.stdout:7/220: symlink d6/d28/l4a 0 2024-04-25T22:42:14.011 INFO:tasks.workunit.client.0.smithi057.stdout:0/255: write d0/d3/f1c [312230,68931] 0 2024-04-25T22:42:14.012 INFO:tasks.workunit.client.0.smithi057.stdout:7/221: truncate d6/d1b/d1d/f2a 3228349 0 2024-04-25T22:42:14.012 INFO:tasks.workunit.client.0.smithi057.stdout:0/256: write d0/d3/f2f [325123,24957] 0 2024-04-25T22:42:14.013 INFO:tasks.workunit.client.0.smithi057.stdout:7/222: fdatasync d6/f27 0 2024-04-25T22:42:14.013 INFO:tasks.workunit.client.0.smithi057.stdout:0/257: mkdir d0/d5/d53 0 2024-04-25T22:42:14.014 INFO:tasks.workunit.client.0.smithi057.stdout:0/258: symlink d0/d5/l54 0 2024-04-25T22:42:14.014 INFO:tasks.workunit.client.0.smithi057.stdout:7/223: creat d6/f4b x:0 0 0 2024-04-25T22:42:14.014 INFO:tasks.workunit.client.0.smithi057.stdout:7/224: fdatasync f1 0 2024-04-25T22:42:14.015 INFO:tasks.workunit.client.0.smithi057.stdout:0/259: mknod d0/d3/d3a/d3b/c55 0 2024-04-25T22:42:14.015 INFO:tasks.workunit.client.0.smithi057.stdout:7/225: mknod d6/d1b/c4c 0 2024-04-25T22:42:14.016 INFO:tasks.workunit.client.0.smithi057.stdout:0/260: creat d0/d3/d6/d14/d39/f56 x:0 0 0 2024-04-25T22:42:14.016 INFO:tasks.workunit.client.0.smithi057.stdout:7/226: symlink d6/d1b/d1d/l4d 0 2024-04-25T22:42:14.016 INFO:tasks.workunit.client.0.smithi057.stdout:5/263: dwrite d2/d1c/f48 [0,4194304] 0 2024-04-25T22:42:14.017 INFO:tasks.workunit.client.0.smithi057.stdout:7/227: write f1 [5209788,103858] 0 2024-04-25T22:42:14.017 INFO:tasks.workunit.client.0.smithi057.stdout:0/261: write d0/d49/f48 [2741752,69381] 0 2024-04-25T22:42:14.017 INFO:tasks.workunit.client.0.smithi057.stdout:7/228: stat d6/l44 0 2024-04-25T22:42:14.019 INFO:tasks.workunit.client.0.smithi057.stdout:6/283: dread d2/d19/d50/d1a/d22/d31/f3f [0,4194304] 0 2024-04-25T22:42:14.020 INFO:tasks.workunit.client.0.smithi057.stdout:1/267: truncate d7/dd/d16/d18/f23 1176086 0 2024-04-25T22:42:14.021 INFO:tasks.workunit.client.0.smithi057.stdout:1/268: write d7/dd/d16/f36 [19988,78659] 0 2024-04-25T22:42:14.022 INFO:tasks.workunit.client.0.smithi057.stdout:1/269: dread - d7/dd/d16/d18/d31/f44 zero size 2024-04-25T22:42:14.023 INFO:tasks.workunit.client.0.smithi057.stdout:1/270: symlink d7/d4e/l56 0 2024-04-25T22:42:14.024 INFO:tasks.workunit.client.0.smithi057.stdout:1/271: fsync d7/dd/d16/d18/f2a 0 2024-04-25T22:42:14.024 INFO:tasks.workunit.client.0.smithi057.stdout:0/262: dwrite d0/d3/d6/f45 [0,4194304] 0 2024-04-25T22:42:14.027 INFO:tasks.workunit.client.0.smithi057.stdout:6/284: dwrite d2/d19/d50/f4c [0,4194304] 0 2024-04-25T22:42:14.028 INFO:tasks.workunit.client.0.smithi057.stdout:6/285: chown d2/d19/d20/f45 1 1 2024-04-25T22:42:14.029 INFO:tasks.workunit.client.0.smithi057.stdout:6/286: mknod d2/d19/d50/c57 0 2024-04-25T22:42:14.030 INFO:tasks.workunit.client.0.smithi057.stdout:6/287: mknod d2/d19/d50/d1a/c58 0 2024-04-25T22:42:14.031 INFO:tasks.workunit.client.0.smithi057.stdout:0/263: dwrite d0/d3/d6/d14/d39/f56 [0,4194304] 0 2024-04-25T22:42:14.031 INFO:tasks.workunit.client.0.smithi057.stdout:0/264: mknod d0/d3/d6/d14/c57 0 2024-04-25T22:42:14.033 INFO:tasks.workunit.client.0.smithi057.stdout:0/265: rmdir d0/d3/d3a/d3b 39 2024-04-25T22:42:14.033 INFO:tasks.workunit.client.0.smithi057.stdout:0/266: write d0/d49/f4e [119620,75186] 0 2024-04-25T22:42:14.034 INFO:tasks.workunit.client.0.smithi057.stdout:0/267: write d0/f30 [2154684,43516] 0 2024-04-25T22:42:14.036 INFO:tasks.workunit.client.0.smithi057.stdout:6/288: dwrite d2/d19/d50/d1a/f42 [0,4194304] 0 2024-04-25T22:42:14.038 INFO:tasks.workunit.client.0.smithi057.stdout:6/289: truncate d2/d19/d26/f2d 3375069 0 2024-04-25T22:42:14.039 INFO:tasks.workunit.client.0.smithi057.stdout:7/229: rename d6/d1b to d6/d28/d4e 0 2024-04-25T22:42:14.039 INFO:tasks.workunit.client.0.smithi057.stdout:6/290: dread - d2/d19/d26/d4f/f56 zero size 2024-04-25T22:42:14.039 INFO:tasks.workunit.client.0.smithi057.stdout:7/230: chown d6/d28/d4e 515613 1 2024-04-25T22:42:14.040 INFO:tasks.workunit.client.0.smithi057.stdout:6/291: write d2/d19/f43 [705119,64163] 0 2024-04-25T22:42:14.041 INFO:tasks.workunit.client.0.smithi057.stdout:7/231: mknod d6/d28/d4e/d1d/c4f 0 2024-04-25T22:42:14.041 INFO:tasks.workunit.client.0.smithi057.stdout:0/268: rename d0/d3/d3a/c3d to d0/d3/c58 0 2024-04-25T22:42:14.041 INFO:tasks.workunit.client.0.smithi057.stdout:6/292: chown d2/d19/d50/d1a 357080536 1 2024-04-25T22:42:14.042 INFO:tasks.workunit.client.0.smithi057.stdout:8/234: sync 2024-04-25T22:42:14.042 INFO:tasks.workunit.client.0.smithi057.stdout:4/263: sync 2024-04-25T22:42:14.042 INFO:tasks.workunit.client.0.smithi057.stdout:3/264: sync 2024-04-25T22:42:14.043 INFO:tasks.workunit.client.0.smithi057.stdout:5/264: dwrite d2/d6/db/f25 [0,4194304] 0 2024-04-25T22:42:14.043 INFO:tasks.workunit.client.0.smithi057.stdout:3/265: dread - d0/d4/f57 zero size 2024-04-25T22:42:14.044 INFO:tasks.workunit.client.0.smithi057.stdout:0/269: creat d0/d3/d6/f59 x:0 0 0 2024-04-25T22:42:14.044 INFO:tasks.workunit.client.0.smithi057.stdout:9/281: dread d3/f1f [4194304,4194304] 0 2024-04-25T22:42:14.046 INFO:tasks.workunit.client.0.smithi057.stdout:5/265: rename d2/c23 to d2/c51 0 2024-04-25T22:42:14.046 INFO:tasks.workunit.client.0.smithi057.stdout:0/270: creat d0/d3/d4d/d46/f5a x:0 0 0 2024-04-25T22:42:14.046 INFO:tasks.workunit.client.0.smithi057.stdout:3/266: rmdir d0/d4/d34/d3c/d52 0 2024-04-25T22:42:14.046 INFO:tasks.workunit.client.0.smithi057.stdout:9/282: mknod d3/d34/d42/d28/d39/d54/c57 0 2024-04-25T22:42:14.047 INFO:tasks.workunit.client.0.smithi057.stdout:5/266: dread - d2/d1c/d42/f4b zero size 2024-04-25T22:42:14.048 INFO:tasks.workunit.client.0.smithi057.stdout:5/267: unlink d2/d1c/d46/d3a/l3c 0 2024-04-25T22:42:14.048 INFO:tasks.workunit.client.0.smithi057.stdout:9/283: chown d3/d34/d42/d28/d2d/f40 60457 1 2024-04-25T22:42:14.048 INFO:tasks.workunit.client.0.smithi057.stdout:3/267: fdatasync d0/d4/f2d 0 2024-04-25T22:42:14.048 INFO:tasks.workunit.client.0.smithi057.stdout:2/332: dread d1f/d4a/f4b [0,4194304] 0 2024-04-25T22:42:14.048 INFO:tasks.workunit.client.0.smithi057.stdout:1/272: dread d7/dd/d16/d24/f38 [0,4194304] 0 2024-04-25T22:42:14.049 INFO:tasks.workunit.client.0.smithi057.stdout:9/284: creat d3/f58 x:0 0 0 2024-04-25T22:42:14.049 INFO:tasks.workunit.client.0.smithi057.stdout:2/333: creat d1f/d4a/d4d/f72 x:0 0 0 2024-04-25T22:42:14.049 INFO:tasks.workunit.client.0.smithi057.stdout:1/273: symlink d7/dd/d40/d41/d45/l57 0 2024-04-25T22:42:14.049 INFO:tasks.workunit.client.0.smithi057.stdout:9/285: truncate d3/f20 6909336 0 2024-04-25T22:42:14.050 INFO:tasks.workunit.client.0.smithi057.stdout:2/334: creat d1f/d34/f73 x:0 0 0 2024-04-25T22:42:14.050 INFO:tasks.workunit.client.0.smithi057.stdout:9/286: chown d3/f1e 4 1 2024-04-25T22:42:14.050 INFO:tasks.workunit.client.0.smithi057.stdout:1/274: chown d7/dd/d16/d24/f54 319 1 2024-04-25T22:42:14.051 INFO:tasks.workunit.client.0.smithi057.stdout:1/275: symlink d7/dd/d40/l58 0 2024-04-25T22:42:14.051 INFO:tasks.workunit.client.0.smithi057.stdout:3/268: dread d0/d4/f25 [0,4194304] 0 2024-04-25T22:42:14.052 INFO:tasks.workunit.client.0.smithi057.stdout:9/287: readlink d3/d34/d42/d28/d2d/l3c 0 2024-04-25T22:42:14.053 INFO:tasks.workunit.client.0.smithi057.stdout:3/269: symlink d0/l5e 0 2024-04-25T22:42:14.053 INFO:tasks.workunit.client.0.smithi057.stdout:1/276: mknod d7/dd/d16/c59 0 2024-04-25T22:42:14.053 INFO:tasks.workunit.client.0.smithi057.stdout:1/277: mknod d7/dd/d16/d18/c5a 0 2024-04-25T22:42:14.055 INFO:tasks.workunit.client.0.smithi057.stdout:0/271: getdents d0/d3/d3a 0 2024-04-25T22:42:14.055 INFO:tasks.workunit.client.0.smithi057.stdout:5/268: dwrite d2/d6/db/f38 [0,4194304] 0 2024-04-25T22:42:14.056 INFO:tasks.workunit.client.0.smithi057.stdout:0/272: readlink d0/d3/d6/l10 0 2024-04-25T22:42:14.056 INFO:tasks.workunit.client.0.smithi057.stdout:2/335: dread d1f/d21/d26/f3a [4194304,4194304] 0 2024-04-25T22:42:14.056 INFO:tasks.workunit.client.0.smithi057.stdout:1/278: write d7/dd/d16/d18/f39 [4305536,108874] 0 2024-04-25T22:42:14.057 INFO:tasks.workunit.client.0.smithi057.stdout:5/269: symlink d2/d2c/l52 0 2024-04-25T22:42:14.057 INFO:tasks.workunit.client.0.smithi057.stdout:2/336: truncate f0 5122501 0 2024-04-25T22:42:14.057 INFO:tasks.workunit.client.0.smithi057.stdout:1/279: chown d7/dd/d16/d18/d31 3143 1 2024-04-25T22:42:14.058 INFO:tasks.workunit.client.0.smithi057.stdout:2/337: symlink d1f/d34/d50/l74 0 2024-04-25T22:42:14.059 INFO:tasks.workunit.client.0.smithi057.stdout:2/338: chown f0 147561942 1 2024-04-25T22:42:14.060 INFO:tasks.workunit.client.0.smithi057.stdout:8/235: write d4/d5/f7 [571568,82012] 0 2024-04-25T22:42:14.060 INFO:tasks.workunit.client.0.smithi057.stdout:1/280: truncate d7/dd/d16/d24/f38 1282664 0 2024-04-25T22:42:14.061 INFO:tasks.workunit.client.0.smithi057.stdout:5/270: read d2/d2c/f2e [3472514,8709] 0 2024-04-25T22:42:14.061 INFO:tasks.workunit.client.0.smithi057.stdout:9/288: fsync d3/f58 0 2024-04-25T22:42:14.062 INFO:tasks.workunit.client.0.smithi057.stdout:9/289: readlink l2 0 2024-04-25T22:42:14.062 INFO:tasks.workunit.client.0.smithi057.stdout:3/270: dwrite d0/d11/f23 [0,4194304] 0 2024-04-25T22:42:14.063 INFO:tasks.workunit.client.0.smithi057.stdout:7/232: dwrite d6/d28/f2c [4194304,4194304] 0 2024-04-25T22:42:14.063 INFO:tasks.workunit.client.0.smithi057.stdout:8/236: creat d4/d5/d17/d19/d35/f5a x:0 0 0 2024-04-25T22:42:14.063 INFO:tasks.workunit.client.0.smithi057.stdout:9/290: rmdir d3/d34 39 2024-04-25T22:42:14.064 INFO:tasks.workunit.client.0.smithi057.stdout:7/233: write f2 [440529,66627] 0 2024-04-25T22:42:14.065 INFO:tasks.workunit.client.0.smithi057.stdout:5/271: creat d2/f53 x:0 0 0 2024-04-25T22:42:14.066 INFO:tasks.workunit.client.0.smithi057.stdout:5/272: mkdir d2/d1c/d42/d54 0 2024-04-25T22:42:14.066 INFO:tasks.workunit.client.0.smithi057.stdout:0/273: dwrite d0/d3/f15 [0,4194304] 0 2024-04-25T22:42:14.067 INFO:tasks.workunit.client.0.smithi057.stdout:5/273: readlink d2/d1c/l49 0 2024-04-25T22:42:14.068 INFO:tasks.workunit.client.0.smithi057.stdout:8/237: getdents d4/d5/d17 0 2024-04-25T22:42:14.068 INFO:tasks.workunit.client.0.smithi057.stdout:7/234: link d6/ce d6/d28/d4e/d1d/c50 0 2024-04-25T22:42:14.068 INFO:tasks.workunit.client.0.smithi057.stdout:3/271: dread d0/d4/d7/f2f [0,4194304] 0 2024-04-25T22:42:14.068 INFO:tasks.workunit.client.0.smithi057.stdout:9/291: write d3/d34/d42/d28/d39/f3a [2866800,2014] 0 2024-04-25T22:42:14.068 INFO:tasks.workunit.client.0.smithi057.stdout:5/274: creat d2/d1c/f55 x:0 0 0 2024-04-25T22:42:14.069 INFO:tasks.workunit.client.0.smithi057.stdout:0/274: getdents d0/d49 0 2024-04-25T22:42:14.069 INFO:tasks.workunit.client.0.smithi057.stdout:7/235: write d6/f4b [324869,75109] 0 2024-04-25T22:42:14.069 INFO:tasks.workunit.client.0.smithi057.stdout:8/238: rename d4/db/dd/df/d22 to d4/d5/d48/d5b 0 2024-04-25T22:42:14.070 INFO:tasks.workunit.client.0.smithi057.stdout:0/275: write d0/d3/d6/f45 [1668716,45627] 0 2024-04-25T22:42:14.070 INFO:tasks.workunit.client.0.smithi057.stdout:5/275: creat d2/d1c/d24/d3d/f56 x:0 0 0 2024-04-25T22:42:14.071 INFO:tasks.workunit.client.0.smithi057.stdout:3/272: rmdir d0/d4/d7/d22 39 2024-04-25T22:42:14.071 INFO:tasks.workunit.client.0.smithi057.stdout:7/236: mkdir d6/d28/d4e/d1d/d51 0 2024-04-25T22:42:14.071 INFO:tasks.workunit.client.0.smithi057.stdout:3/273: sync 2024-04-25T22:42:14.071 INFO:tasks.workunit.client.0.smithi057.stdout:0/276: readlink d0/d3/d4d/l51 0 2024-04-25T22:42:14.071 INFO:tasks.workunit.client.0.smithi057.stdout:7/237: stat d6/d28/d4e/d1d/l24 0 2024-04-25T22:42:14.072 INFO:tasks.workunit.client.0.smithi057.stdout:5/276: creat d2/d2c/f57 x:0 0 0 2024-04-25T22:42:14.072 INFO:tasks.workunit.client.0.smithi057.stdout:3/274: symlink d0/d4/d4a/l5f 0 2024-04-25T22:42:14.072 INFO:tasks.workunit.client.0.smithi057.stdout:8/239: rename d4/db/dd/df/d3d to d4/db/dd/d3a/d5c 0 2024-04-25T22:42:14.073 INFO:tasks.workunit.client.0.smithi057.stdout:0/277: unlink d0/d3/d4d/d46/f5a 0 2024-04-25T22:42:14.073 INFO:tasks.workunit.client.0.smithi057.stdout:5/277: write d2/d1c/d24/f43 [644340,29823] 0 2024-04-25T22:42:14.073 INFO:tasks.workunit.client.0.smithi057.stdout:3/275: symlink d0/d4/d34/d3c/d53/l60 0 2024-04-25T22:42:14.073 INFO:tasks.workunit.client.0.smithi057.stdout:7/238: rename f2 to d6/f52 0 2024-04-25T22:42:14.073 INFO:tasks.workunit.client.0.smithi057.stdout:3/276: dread - d0/d4/d34/d3c/f5c zero size 2024-04-25T22:42:14.073 INFO:tasks.workunit.client.0.smithi057.stdout:0/278: symlink d0/d3/d3a/d3b/l5b 0 2024-04-25T22:42:14.074 INFO:tasks.workunit.client.0.smithi057.stdout:5/278: creat d2/d6/f58 x:0 0 0 2024-04-25T22:42:14.074 INFO:tasks.workunit.client.0.smithi057.stdout:7/239: rename d6/d28/d4e/d1d/c1f to d6/c53 0 2024-04-25T22:42:14.075 INFO:tasks.workunit.client.0.smithi057.stdout:3/277: fsync d0/d4/d4a/f4c 0 2024-04-25T22:42:14.075 INFO:tasks.workunit.client.0.smithi057.stdout:3/278: fsync d0/d4/d34/d3c/d53/f54 0 2024-04-25T22:42:14.075 INFO:tasks.workunit.client.0.smithi057.stdout:7/240: creat d6/f54 x:0 0 0 2024-04-25T22:42:14.076 INFO:tasks.workunit.client.0.smithi057.stdout:2/339: truncate d1f/d21/f25 1002053 0 2024-04-25T22:42:14.077 INFO:tasks.workunit.client.0.smithi057.stdout:2/340: rmdir d1f/d34/d50 39 2024-04-25T22:42:14.078 INFO:tasks.workunit.client.0.smithi057.stdout:2/341: chown d1f/d4a/l48 102 1 2024-04-25T22:42:14.081 INFO:tasks.workunit.client.0.smithi057.stdout:3/279: dwrite d0/d4/d7/d26/f31 [0,4194304] 0 2024-04-25T22:42:14.081 INFO:tasks.workunit.client.0.smithi057.stdout:5/279: read d2/f9 [972621,121162] 0 2024-04-25T22:42:14.081 INFO:tasks.workunit.client.0.smithi057.stdout:4/264: dread d14/f39 [0,4194304] 0 2024-04-25T22:42:14.081 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:14.080+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:14.082 INFO:tasks.workunit.client.0.smithi057.stdout:4/265: mknod d14/d3d/c53 0 2024-04-25T22:42:14.083 INFO:tasks.workunit.client.0.smithi057.stdout:5/280: truncate d2/d2c/f36 600128 0 2024-04-25T22:42:14.083 INFO:tasks.workunit.client.0.smithi057.stdout:4/266: write d14/f28 [180779,97980] 0 2024-04-25T22:42:14.085 INFO:tasks.workunit.client.0.smithi057.stdout:0/279: dread d0/d3/f2f [0,4194304] 0 2024-04-25T22:42:14.085 INFO:tasks.workunit.client.0.smithi057.stdout:6/293: dread d2/d19/d26/f2f [0,4194304] 0 2024-04-25T22:42:14.085 INFO:tasks.workunit.client.0.smithi057.stdout:4/267: readlink d14/d3c/l3e 0 2024-04-25T22:42:14.085 INFO:tasks.workunit.client.0.smithi057.stdout:0/280: symlink d0/d3/d3a/d3b/l5c 0 2024-04-25T22:42:14.085 INFO:tasks.workunit.client.0.smithi057.stdout:4/268: truncate d14/f28 357582 0 2024-04-25T22:42:14.085 INFO:tasks.workunit.client.0.smithi057.stdout:6/294: readlink d2/d19/d50/d1a/d22/d31/l47 0 2024-04-25T22:42:14.085 INFO:tasks.workunit.client.0.smithi057.stdout:6/295: chown d2/d19/d50/d1a/d22/c23 1 1 2024-04-25T22:42:14.086 INFO:tasks.workunit.client.0.smithi057.stdout:9/292: write d3/d34/d42/f41 [609225,105914] 0 2024-04-25T22:42:14.086 INFO:tasks.workunit.client.0.smithi057.stdout:6/296: stat d2/d19/d50/d1a/c2e 0 2024-04-25T22:42:14.086 INFO:tasks.workunit.client.0.smithi057.stdout:3/280: fdatasync d0/d11/f23 0 2024-04-25T22:42:14.087 INFO:tasks.workunit.client.0.smithi057.stdout:4/269: getdents d14/d47 0 2024-04-25T22:42:14.087 INFO:tasks.workunit.client.0.smithi057.stdout:6/297: stat d2/d19/d26/d4f/f56 0 2024-04-25T22:42:14.087 INFO:tasks.workunit.client.0.smithi057.stdout:8/240: getdents d4/db/dd/d3a 0 2024-04-25T22:42:14.087 INFO:tasks.workunit.client.0.smithi057.stdout:3/281: write d0/d4/f21 [1911018,62574] 0 2024-04-25T22:42:14.087 INFO:tasks.workunit.client.0.smithi057.stdout:9/293: write d3/f9 [3870762,121422] 0 2024-04-25T22:42:14.088 INFO:tasks.workunit.client.0.smithi057.stdout:7/241: truncate d6/d28/d4e/f22 235967 0 2024-04-25T22:42:14.088 INFO:tasks.workunit.client.0.smithi057.stdout:8/241: write d4/db/dd/df/f53 [68533,54703] 0 2024-04-25T22:42:14.088 INFO:tasks.workunit.client.0.smithi057.stdout:0/281: dread d0/f30 [4194304,4194304] 0 2024-04-25T22:42:14.089 INFO:tasks.workunit.client.0.smithi057.stdout:6/298: write d2/d19/d50/d1a/f42 [415899,29321] 0 2024-04-25T22:42:14.089 INFO:tasks.workunit.client.0.smithi057.stdout:9/294: symlink d3/l59 0 2024-04-25T22:42:14.090 INFO:tasks.workunit.client.0.smithi057.stdout:8/242: chown d4/d5/d17 94483609 1 2024-04-25T22:42:14.090 INFO:tasks.workunit.client.0.smithi057.stdout:7/242: mknod d6/d28/d4e/d1d/c55 0 2024-04-25T22:42:14.090 INFO:tasks.workunit.client.0.smithi057.stdout:6/299: mkdir d2/d59 0 2024-04-25T22:42:14.090 INFO:tasks.workunit.client.0.smithi057.stdout:2/342: truncate d1f/d36/d54/f5f 2603535 0 2024-04-25T22:42:14.090 INFO:tasks.workunit.client.0.smithi057.stdout:0/282: mknod d0/d3/d6/d14/d39/c5d 0 2024-04-25T22:42:14.091 INFO:tasks.workunit.client.0.smithi057.stdout:9/295: symlink d3/d34/d42/l5a 0 2024-04-25T22:42:14.091 INFO:tasks.workunit.client.0.smithi057.stdout:7/243: dread - d6/d28/d4e/d30/f36 zero size 2024-04-25T22:42:14.091 INFO:tasks.workunit.client.0.smithi057.stdout:2/343: mknod d1f/c75 0 2024-04-25T22:42:14.092 INFO:tasks.workunit.client.0.smithi057.stdout:6/300: truncate d2/f11 249789 0 2024-04-25T22:42:14.092 INFO:tasks.workunit.client.0.smithi057.stdout:7/244: fsync d6/d28/d4e/f31 0 2024-04-25T22:42:14.092 INFO:tasks.workunit.client.0.smithi057.stdout:0/283: getdents d0/d5/d53 0 2024-04-25T22:42:14.092 INFO:tasks.workunit.client.0.smithi057.stdout:8/243: rename d4/d5/d17/d19/d35/f3b to d4/d5/d48/d5b/f5d 0 2024-04-25T22:42:14.092 INFO:tasks.workunit.client.0.smithi057.stdout:2/344: rmdir d1f/d4a 39 2024-04-25T22:42:14.093 INFO:tasks.workunit.client.0.smithi057.stdout:7/245: creat d6/d28/d4e/d30/f56 x:0 0 0 2024-04-25T22:42:14.093 INFO:tasks.workunit.client.0.smithi057.stdout:2/345: link d1f/d21/f46 d1f/f76 0 2024-04-25T22:42:14.094 INFO:tasks.workunit.client.0.smithi057.stdout:8/244: link d4/d5/f33 d4/f5e 0 2024-04-25T22:42:14.095 INFO:tasks.workunit.client.0.smithi057.stdout:4/270: dwrite d14/d2f/f38 [0,4194304] 0 2024-04-25T22:42:14.095 INFO:tasks.workunit.client.0.smithi057.stdout:7/246: chown d6/d28/d4e/l38 28518692 1 2024-04-25T22:42:14.096 INFO:tasks.workunit.client.0.smithi057.stdout:5/281: truncate d2/d1c/d46/f22 4073843 0 2024-04-25T22:42:14.096 INFO:tasks.workunit.client.0.smithi057.stdout:2/346: rename d1f/d21/d26/f67 to d1f/d34/f77 0 2024-04-25T22:42:14.097 INFO:tasks.workunit.client.0.smithi057.stdout:4/271: creat d14/d2f/f54 x:0 0 0 2024-04-25T22:42:14.097 INFO:tasks.workunit.client.0.smithi057.stdout:7/247: unlink d6/d28/d4e/d1d/c4f 0 2024-04-25T22:42:14.099 INFO:tasks.workunit.client.0.smithi057.stdout:8/245: truncate d4/d5/f33 792786 0 2024-04-25T22:42:14.099 INFO:tasks.workunit.client.0.smithi057.stdout:7/248: readlink d6/d28/d4e/l3b 0 2024-04-25T22:42:14.100 INFO:tasks.workunit.client.0.smithi057.stdout:9/296: dwrite d3/f14 [0,4194304] 0 2024-04-25T22:42:14.100 INFO:tasks.workunit.client.0.smithi057.stdout:2/347: creat d1f/d21/f78 x:0 0 0 2024-04-25T22:42:14.100 INFO:tasks.workunit.client.0.smithi057.stdout:8/246: creat d4/d5/d2f/f5f x:0 0 0 2024-04-25T22:42:14.102 INFO:tasks.workunit.client.0.smithi057.stdout:0/284: dwrite d0/d3/d6/d14/d39/f56 [0,4194304] 0 2024-04-25T22:42:14.102 INFO:tasks.workunit.client.0.smithi057.stdout:9/297: creat d3/d34/f5b x:0 0 0 2024-04-25T22:42:14.102 INFO:tasks.workunit.client.0.smithi057.stdout:8/247: dread - d4/db/d12/f3e zero size 2024-04-25T22:42:14.104 INFO:tasks.workunit.client.0.smithi057.stdout:7/249: symlink d6/d28/d4e/d30/d46/l57 0 2024-04-25T22:42:14.105 INFO:tasks.workunit.client.0.smithi057.stdout:0/285: dread - d0/d3/d3a/f40 zero size 2024-04-25T22:42:14.105 INFO:tasks.workunit.client.0.smithi057.stdout:8/248: creat d4/d5/d21/f60 x:0 0 0 2024-04-25T22:42:14.105 INFO:tasks.workunit.client.0.smithi057.stdout:9/298: creat d3/d34/d42/d28/d2d/f5c x:0 0 0 2024-04-25T22:42:14.106 INFO:tasks.workunit.client.0.smithi057.stdout:8/249: fsync d4/f52 0 2024-04-25T22:42:14.107 INFO:tasks.workunit.client.0.smithi057.stdout:5/282: dwrite d2/d2c/f2e [0,4194304] 0 2024-04-25T22:42:14.108 INFO:tasks.workunit.client.0.smithi057.stdout:4/272: dwrite f9 [0,4194304] 0 2024-04-25T22:42:14.108 INFO:tasks.workunit.client.0.smithi057.stdout:7/250: getdents d6/d28 0 2024-04-25T22:42:14.110 INFO:tasks.workunit.client.0.smithi057.stdout:4/273: write ff [3142515,104710] 0 2024-04-25T22:42:14.110 INFO:tasks.workunit.client.0.smithi057.stdout:8/250: symlink d4/d5/d48/d5b/l61 0 2024-04-25T22:42:14.112 INFO:tasks.workunit.client.0.smithi057.stdout:5/283: mknod d2/d1c/d42/c59 0 2024-04-25T22:42:14.112 INFO:tasks.workunit.client.0.smithi057.stdout:4/274: creat d14/d3c/f55 x:0 0 0 2024-04-25T22:42:14.112 INFO:tasks.workunit.client.0.smithi057.stdout:2/348: truncate d1f/d21/f37 4738686 0 2024-04-25T22:42:14.112 INFO:tasks.workunit.client.0.smithi057.stdout:9/299: rename d3/f56 to d3/d34/d42/d28/f5d 0 2024-04-25T22:42:14.112 INFO:tasks.workunit.client.0.smithi057.stdout:7/251: link d6/d28/d4e/d1d/l24 d6/d28/d4e/d1d/l58 0 2024-04-25T22:42:14.113 INFO:tasks.workunit.client.0.smithi057.stdout:6/301: dwrite d2/f11 [0,4194304] 0 2024-04-25T22:42:14.113 INFO:tasks.workunit.client.0.smithi057.stdout:2/349: write f0 [3701913,12504] 0 2024-04-25T22:42:14.113 INFO:tasks.workunit.client.0.smithi057.stdout:7/252: mkdir d6/d28/d4e/d1d/d59 0 2024-04-25T22:42:14.114 INFO:tasks.workunit.client.0.smithi057.stdout:7/253: rmdir d6/d28/d4e/d1d 39 2024-04-25T22:42:14.116 INFO:tasks.workunit.client.0.smithi057.stdout:6/302: symlink d2/d59/l5a 0 2024-04-25T22:42:14.117 INFO:tasks.workunit.client.0.smithi057.stdout:7/254: creat d6/d28/d4e/d30/f5a x:0 0 0 2024-04-25T22:42:14.117 INFO:tasks.workunit.client.0.smithi057.stdout:4/275: link d14/l19 d14/d3c/d44/l56 0 2024-04-25T22:42:14.118 INFO:tasks.workunit.client.0.smithi057.stdout:4/276: chown d14/d3c/d44 18003986 1 2024-04-25T22:42:14.120 INFO:tasks.workunit.client.0.smithi057.stdout:5/284: dwrite d2/d6/db/f2f [0,4194304] 0 2024-04-25T22:42:14.120 INFO:tasks.workunit.client.0.smithi057.stdout:7/255: rename d6/d28/d4e/d1d/f3d to d6/d28/f5b 0 2024-04-25T22:42:14.120 INFO:tasks.workunit.client.0.smithi057.stdout:6/303: getdents d2/d19/d50/d1a/d22/d31 0 2024-04-25T22:42:14.121 INFO:tasks.workunit.client.0.smithi057.stdout:9/300: dwrite d3/ff [0,4194304] 0 2024-04-25T22:42:14.122 INFO:tasks.workunit.client.0.smithi057.stdout:6/304: write d2/d19/f43 [1429005,7856] 0 2024-04-25T22:42:14.122 INFO:tasks.workunit.client.0.smithi057.stdout:5/285: mknod d2/d1c/d24/d3d/c5a 0 2024-04-25T22:42:14.122 INFO:tasks.workunit.client.0.smithi057.stdout:7/256: mknod d6/d28/d4e/d30/d46/c5c 0 2024-04-25T22:42:14.123 INFO:tasks.workunit.client.0.smithi057.stdout:5/286: mkdir d2/d1c/d5b 0 2024-04-25T22:42:14.123 INFO:tasks.workunit.client.0.smithi057.stdout:9/301: mkdir d3/d34/d42/d5e 0 2024-04-25T22:42:14.123 INFO:tasks.workunit.client.0.smithi057.stdout:8/251: dwrite d4/d5/d21/f60 [0,4194304] 0 2024-04-25T22:42:14.124 INFO:tasks.workunit.client.0.smithi057.stdout:5/287: creat d2/d2c/f5c x:0 0 0 2024-04-25T22:42:14.125 INFO:tasks.workunit.client.0.smithi057.stdout:6/305: sync 2024-04-25T22:42:14.125 INFO:tasks.workunit.client.0.smithi057.stdout:5/288: unlink d2/ld 0 2024-04-25T22:42:14.125 INFO:tasks.workunit.client.0.smithi057.stdout:9/302: link d3/d34/d42/f2b d3/f5f 0 2024-04-25T22:42:14.126 INFO:tasks.workunit.client.0.smithi057.stdout:5/289: link d2/d6/db/f2b d2/d2c/f5d 0 2024-04-25T22:42:14.127 INFO:tasks.workunit.client.0.smithi057.stdout:5/290: chown d2/d6/db/l18 191583 1 2024-04-25T22:42:14.129 INFO:tasks.workunit.client.0.smithi057.stdout:7/257: dwrite d6/f4b [0,4194304] 0 2024-04-25T22:42:14.131 INFO:tasks.workunit.client.0.smithi057.stdout:7/258: readlink d6/l40 0 2024-04-25T22:42:14.131 INFO:tasks.workunit.client.0.smithi057.stdout:7/259: write d6/d28/f2c [6582195,3868] 0 2024-04-25T22:42:14.132 INFO:tasks.workunit.client.0.smithi057.stdout:0/286: truncate d0/d3/d6/f45 1022298 0 2024-04-25T22:42:14.133 INFO:tasks.workunit.client.0.smithi057.stdout:7/260: mkdir d6/d28/d4e/d1d/d5d 0 2024-04-25T22:42:14.135 INFO:tasks.workunit.client.0.smithi057.stdout:5/291: dwrite d2/d6/db/f17 [0,4194304] 0 2024-04-25T22:42:14.135 INFO:tasks.workunit.client.0.smithi057.stdout:5/292: fsync f1 0 2024-04-25T22:42:14.136 INFO:tasks.workunit.client.0.smithi057.stdout:5/293: rename d2/d1c/d42/c59 to d2/d6/c5e 0 2024-04-25T22:42:14.139 INFO:tasks.workunit.client.0.smithi057.stdout:7/261: dwrite d6/f48 [0,4194304] 0 2024-04-25T22:42:14.140 INFO:tasks.workunit.client.0.smithi057.stdout:7/262: unlink d6/d28/d4e/l3b 0 2024-04-25T22:42:14.143 INFO:tasks.workunit.client.0.smithi057.stdout:5/294: dwrite d2/d6/f58 [0,4194304] 0 2024-04-25T22:42:14.143 INFO:tasks.workunit.client.0.smithi057.stdout:9/303: fsync d3/d34/d42/d28/f5d 0 2024-04-25T22:42:14.144 INFO:tasks.workunit.client.0.smithi057.stdout:5/295: unlink d2/d6/f13 0 2024-04-25T22:42:14.144 INFO:tasks.workunit.client.0.smithi057.stdout:6/306: getdents d2/d59 0 2024-04-25T22:42:14.144 INFO:tasks.workunit.client.0.smithi057.stdout:8/252: dread d4/db/dd/d3a/f3c [0,4194304] 0 2024-04-25T22:42:14.146 INFO:tasks.workunit.client.0.smithi057.stdout:8/253: creat d4/db/dd/df/f62 x:0 0 0 2024-04-25T22:42:14.147 INFO:tasks.workunit.client.0.smithi057.stdout:8/254: read - d4/db/d12/f4e zero size 2024-04-25T22:42:14.148 INFO:tasks.workunit.client.0.smithi057.stdout:8/255: mknod d4/d5/d17/d19/c63 0 2024-04-25T22:42:14.149 INFO:tasks.workunit.client.0.smithi057.stdout:5/296: dread d2/d6/db/f2f [0,4194304] 0 2024-04-25T22:42:14.150 INFO:tasks.workunit.client.0.smithi057.stdout:6/307: dwrite d2/f1c [0,4194304] 0 2024-04-25T22:42:14.151 INFO:tasks.workunit.client.0.smithi057.stdout:5/297: link l0 d2/d1c/d46/l5f 0 2024-04-25T22:42:14.152 INFO:tasks.workunit.client.0.smithi057.stdout:6/308: write d2/d19/d50/f4c [2745949,1494] 0 2024-04-25T22:42:14.154 INFO:tasks.workunit.client.0.smithi057.stdout:3/282: dread d0/d11/f36 [4194304,4194304] 0 2024-04-25T22:42:14.155 INFO:tasks.workunit.client.0.smithi057.stdout:2/350: dwrite d1f/d21/f37 [4194304,4194304] 0 2024-04-25T22:42:14.157 INFO:tasks.workunit.client.0.smithi057.stdout:2/351: write d1f/d34/f77 [244087,108842] 0 2024-04-25T22:42:14.158 INFO:tasks.workunit.client.0.smithi057.stdout:1/281: dread d7/dd/d16/d18/f3d [0,4194304] 0 2024-04-25T22:42:14.159 INFO:tasks.workunit.client.0.smithi057.stdout:6/309: dwrite d2/f1c [0,4194304] 0 2024-04-25T22:42:14.159 INFO:tasks.workunit.client.0.smithi057.stdout:1/282: fsync d7/dd/d16/f1e 0 2024-04-25T22:42:14.160 INFO:tasks.workunit.client.0.smithi057.stdout:6/310: chown d2/d19/d50/d1a/f55 365192 1 2024-04-25T22:42:14.160 INFO:tasks.workunit.client.0.smithi057.stdout:1/283: creat d7/dd/d40/d41/d45/f5b x:0 0 0 2024-04-25T22:42:14.161 INFO:tasks.workunit.client.0.smithi057.stdout:6/311: write d2/d19/d50/d1a/d22/d31/f3a [1583047,85046] 0 2024-04-25T22:42:14.161 INFO:tasks.workunit.client.0.smithi057.stdout:1/284: write d7/dd/f14 [4997243,98576] 0 2024-04-25T22:42:14.162 INFO:tasks.workunit.client.0.smithi057.stdout:1/285: fsync d7/dd/d16/d24/f4f 0 2024-04-25T22:42:14.162 INFO:tasks.workunit.client.0.smithi057.stdout:6/312: rmdir d2/d19/d26/d4f 39 2024-04-25T22:42:14.163 INFO:tasks.workunit.client.0.smithi057.stdout:1/286: stat d7/dd/d16/d18/d31 0 2024-04-25T22:42:14.163 INFO:tasks.workunit.client.0.smithi057.stdout:1/287: chown d7/dd/l29 8761 1 2024-04-25T22:42:14.163 INFO:tasks.workunit.client.0.smithi057.stdout:6/313: mknod d2/d19/d50/d1a/d22/c5b 0 2024-04-25T22:42:14.164 INFO:tasks.workunit.client.0.smithi057.stdout:1/288: dread - d7/dd/d40/d41/f4b zero size 2024-04-25T22:42:14.164 INFO:tasks.workunit.client.0.smithi057.stdout:6/314: rename d2/d19/d26/f2f to d2/d19/d50/d1a/d22/f5c 0 2024-04-25T22:42:14.165 INFO:tasks.workunit.client.0.smithi057.stdout:6/315: write d2/f40 [1539396,92785] 0 2024-04-25T22:42:14.165 INFO:tasks.workunit.client.0.smithi057.stdout:6/316: symlink d2/d59/l5d 0 2024-04-25T22:42:14.166 INFO:tasks.workunit.client.0.smithi057.stdout:6/317: dread - d2/d19/d50/d1a/f55 zero size 2024-04-25T22:42:14.166 INFO:tasks.workunit.client.0.smithi057.stdout:9/304: dread d3/f4e [8388608,4194304] 0 2024-04-25T22:42:14.167 INFO:tasks.workunit.client.0.smithi057.stdout:9/305: rmdir d3 39 2024-04-25T22:42:14.167 INFO:tasks.workunit.client.0.smithi057.stdout:9/306: stat d3/l25 0 2024-04-25T22:42:14.167 INFO:tasks.workunit.client.0.smithi057.stdout:9/307: chown l2 64161 1 2024-04-25T22:42:14.167 INFO:tasks.workunit.client.0.smithi057.stdout:8/256: truncate d4/f43 667513 0 2024-04-25T22:42:14.168 INFO:tasks.workunit.client.0.smithi057.stdout:8/257: mknod d4/d5/d17/d19/c64 0 2024-04-25T22:42:14.168 INFO:tasks.workunit.client.0.smithi057.stdout:9/308: rename d3/d34/d42/d28/d39/c44 to d3/c60 0 2024-04-25T22:42:14.168 INFO:tasks.workunit.client.0.smithi057.stdout:8/258: readlink d4/d5/d17/l1a 0 2024-04-25T22:42:14.169 INFO:tasks.workunit.client.0.smithi057.stdout:9/309: chown d3/l15 0 1 2024-04-25T22:42:14.169 INFO:tasks.workunit.client.0.smithi057.stdout:9/310: symlink d3/d34/d42/l61 0 2024-04-25T22:42:14.170 INFO:tasks.workunit.client.0.smithi057.stdout:8/259: rename d4/db/dd/df/l38 to d4/d5/l65 0 2024-04-25T22:42:14.170 INFO:tasks.workunit.client.0.smithi057.stdout:9/311: rmdir d3 39 2024-04-25T22:42:14.170 INFO:tasks.workunit.client.0.smithi057.stdout:4/277: dread d14/f28 [0,4194304] 0 2024-04-25T22:42:14.170 INFO:tasks.workunit.client.0.smithi057.stdout:8/260: creat d4/db/dd/d3a/f66 x:0 0 0 2024-04-25T22:42:14.171 INFO:tasks.workunit.client.0.smithi057.stdout:4/278: creat d14/d2f/f57 x:0 0 0 2024-04-25T22:42:14.171 INFO:tasks.workunit.client.0.smithi057.stdout:9/312: mkdir d3/d34/d42/d28/d62 0 2024-04-25T22:42:14.171 INFO:tasks.workunit.client.0.smithi057.stdout:4/279: fdatasync d14/d3c/f55 0 2024-04-25T22:42:14.172 INFO:tasks.workunit.client.0.smithi057.stdout:4/280: truncate d14/f20 1006634 0 2024-04-25T22:42:14.173 INFO:tasks.workunit.client.0.smithi057.stdout:4/281: rename d14/l50 to d14/d2f/l58 0 2024-04-25T22:42:14.173 INFO:tasks.workunit.client.0.smithi057.stdout:4/282: creat d14/d47/f59 x:0 0 0 2024-04-25T22:42:14.174 INFO:tasks.workunit.client.0.smithi057.stdout:4/283: write d14/d2f/f38 [3232103,68596] 0 2024-04-25T22:42:14.174 INFO:tasks.workunit.client.0.smithi057.stdout:4/284: chown d14/d47/f59 179 1 2024-04-25T22:42:14.175 INFO:tasks.workunit.client.0.smithi057.stdout:4/285: mkdir d14/d5a 0 2024-04-25T22:42:14.176 INFO:tasks.workunit.client.0.smithi057.stdout:4/286: mkdir d14/d2f/d4c/d5b 0 2024-04-25T22:42:14.176 INFO:tasks.workunit.client.0.smithi057.stdout:3/283: sync 2024-04-25T22:42:14.176 INFO:tasks.workunit.client.0.smithi057.stdout:9/313: sync 2024-04-25T22:42:14.177 INFO:tasks.workunit.client.0.smithi057.stdout:4/287: mknod d14/d2f/d4c/c5c 0 2024-04-25T22:42:14.177 INFO:tasks.workunit.client.0.smithi057.stdout:9/314: chown d3/f32 14326091 1 2024-04-25T22:42:14.178 INFO:tasks.workunit.client.0.smithi057.stdout:7/263: fdatasync d6/f48 0 2024-04-25T22:42:14.179 INFO:tasks.workunit.client.0.smithi057.stdout:3/284: rename d0/d4/d7/d26/f31 to d0/f61 0 2024-04-25T22:42:14.179 INFO:tasks.workunit.client.0.smithi057.stdout:9/315: link d3/d34/d42/d28/d39/l45 d3/l63 0 2024-04-25T22:42:14.180 INFO:tasks.workunit.client.0.smithi057.stdout:7/264: creat d6/d28/d4e/d1d/d5d/f5e x:0 0 0 2024-04-25T22:42:14.180 INFO:tasks.workunit.client.0.smithi057.stdout:9/316: creat d3/f64 x:0 0 0 2024-04-25T22:42:14.181 INFO:tasks.workunit.client.0.smithi057.stdout:7/265: dread - d6/d28/d4e/f3c zero size 2024-04-25T22:42:14.181 INFO:tasks.workunit.client.0.smithi057.stdout:3/285: getdents d0/d4/d7/d22 0 2024-04-25T22:42:14.181 INFO:tasks.workunit.client.0.smithi057.stdout:9/317: chown d3/f4e 40320895 1 2024-04-25T22:42:14.181 INFO:tasks.workunit.client.0.smithi057.stdout:3/286: creat d0/f62 x:0 0 0 2024-04-25T22:42:14.182 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:14.175+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:14.182 INFO:tasks.workunit.client.0.smithi057.stdout:3/287: unlink d0/d4/d7/d26/f3f 0 2024-04-25T22:42:14.182 INFO:tasks.workunit.client.0.smithi057.stdout:6/318: dread d2/d19/f1e [0,4194304] 0 2024-04-25T22:42:14.183 INFO:tasks.workunit.client.0.smithi057.stdout:6/319: unlink d2/d19/d50/c39 0 2024-04-25T22:42:14.184 INFO:tasks.workunit.client.0.smithi057.stdout:8/261: sync 2024-04-25T22:42:14.184 INFO:tasks.workunit.client.0.smithi057.stdout:7/266: dread d6/d28/f33 [0,4194304] 0 2024-04-25T22:42:14.184 INFO:tasks.workunit.client.0.smithi057.stdout:6/320: getdents d2 0 2024-04-25T22:42:14.185 INFO:tasks.workunit.client.0.smithi057.stdout:8/262: creat d4/db/dd/f67 x:0 0 0 2024-04-25T22:42:14.186 INFO:tasks.workunit.client.0.smithi057.stdout:6/321: mkdir d2/d19/d50/d1a/d22/d5e 0 2024-04-25T22:42:14.187 INFO:tasks.workunit.client.0.smithi057.stdout:8/263: rename d4/db/dd/df/f53 to d4/d5/d48/f68 0 2024-04-25T22:42:14.187 INFO:tasks.workunit.client.0.smithi057.stdout:6/322: creat d2/d19/d50/d1a/d22/d31/f5f x:0 0 0 2024-04-25T22:42:14.187 INFO:tasks.workunit.client.0.smithi057.stdout:0/287: dread d0/d3/f4 [0,4194304] 0 2024-04-25T22:42:14.188 INFO:tasks.workunit.client.0.smithi057.stdout:8/264: mknod d4/d5/d21/c69 0 2024-04-25T22:42:14.188 INFO:tasks.workunit.client.0.smithi057.stdout:0/288: rmdir d0/d5 39 2024-04-25T22:42:14.188 INFO:tasks.workunit.client.0.smithi057.stdout:6/323: read d2/d19/d50/d1a/d22/f29 [314958,32571] 0 2024-04-25T22:42:14.189 INFO:tasks.workunit.client.0.smithi057.stdout:0/289: stat d0/d3/d6/d14/c1f 0 2024-04-25T22:42:14.190 INFO:tasks.workunit.client.0.smithi057.stdout:8/265: symlink d4/d5/d48/l6a 0 2024-04-25T22:42:14.190 INFO:tasks.workunit.client.0.smithi057.stdout:2/352: dread d1f/d21/d26/f4e [0,4194304] 0 2024-04-25T22:42:14.190 INFO:tasks.workunit.client.0.smithi057.stdout:4/288: truncate d14/d2f/f4a 3421838 0 2024-04-25T22:42:14.191 INFO:tasks.workunit.client.0.smithi057.stdout:0/290: mknod d0/d3/d4d/c5e 0 2024-04-25T22:42:14.191 INFO:tasks.workunit.client.0.smithi057.stdout:3/288: truncate d0/f33 1089065 0 2024-04-25T22:42:14.192 INFO:tasks.workunit.client.0.smithi057.stdout:4/289: write d14/f25 [1435556,62698] 0 2024-04-25T22:42:14.192 INFO:tasks.workunit.client.0.smithi057.stdout:8/266: read - d4/d5/d48/d5b/f56 zero size 2024-04-25T22:42:14.193 INFO:tasks.workunit.client.0.smithi057.stdout:2/353: write d1f/d21/f2e [9143914,12619] 0 2024-04-25T22:42:14.193 INFO:tasks.workunit.client.0.smithi057.stdout:7/267: dwrite d6/f16 [4194304,4194304] 0 2024-04-25T22:42:14.193 INFO:tasks.workunit.client.0.smithi057.stdout:3/289: unlink d0/d4/f21 0 2024-04-25T22:42:14.194 INFO:tasks.workunit.client.0.smithi057.stdout:0/291: getdents d0/d5/d53 0 2024-04-25T22:42:14.196 INFO:tasks.workunit.client.0.smithi057.stdout:2/354: symlink d1f/d34/l79 0 2024-04-25T22:42:14.196 INFO:tasks.workunit.client.0.smithi057.stdout:3/290: truncate d0/d4/d7/d46/f3a 822843 0 2024-04-25T22:42:14.196 INFO:tasks.workunit.client.0.smithi057.stdout:2/355: chown d1f/d34/f52 83 1 2024-04-25T22:42:14.197 INFO:tasks.workunit.client.0.smithi057.stdout:6/324: dwrite d2/d19/d20/f3b [0,4194304] 0 2024-04-25T22:42:14.197 INFO:tasks.workunit.client.0.smithi057.stdout:0/292: mkdir d0/d3/d6/d5f 0 2024-04-25T22:42:14.197 INFO:tasks.workunit.client.0.smithi057.stdout:4/290: creat d14/f5d x:0 0 0 2024-04-25T22:42:14.198 INFO:tasks.workunit.client.0.smithi057.stdout:0/293: fdatasync d0/f17 0 2024-04-25T22:42:14.200 INFO:tasks.workunit.client.0.smithi057.stdout:4/291: getdents d14/d3c/d44 0 2024-04-25T22:42:14.200 INFO:tasks.workunit.client.0.smithi057.stdout:0/294: rename d0/d3/d4d/l3e to d0/d3/d6/d14/l60 0 2024-04-25T22:42:14.201 INFO:tasks.workunit.client.0.smithi057.stdout:8/267: dwrite d4/d5/f4d [0,4194304] 0 2024-04-25T22:42:14.201 INFO:tasks.workunit.client.0.smithi057.stdout:7/268: dwrite d6/f52 [0,4194304] 0 2024-04-25T22:42:14.202 INFO:tasks.workunit.client.0.smithi057.stdout:2/356: write f6 [190112,45093] 0 2024-04-25T22:42:14.202 INFO:tasks.workunit.client.0.smithi057.stdout:4/292: mkdir d14/d47/d5e 0 2024-04-25T22:42:14.202 INFO:tasks.workunit.client.0.smithi057.stdout:0/295: chown d0/d5/c47 0 1 2024-04-25T22:42:14.203 INFO:tasks.workunit.client.0.smithi057.stdout:4/293: rmdir d14/d2f/d4c 39 2024-04-25T22:42:14.205 INFO:tasks.workunit.client.0.smithi057.stdout:0/296: creat d0/d5/d53/f61 x:0 0 0 2024-04-25T22:42:14.205 INFO:tasks.workunit.client.0.smithi057.stdout:1/289: dread d7/dd/d16/d24/f2e [0,4194304] 0 2024-04-25T22:42:14.205 INFO:tasks.workunit.client.0.smithi057.stdout:2/357: write d1f/d21/d33/f5a [531721,41316] 0 2024-04-25T22:42:14.205 INFO:tasks.workunit.client.0.smithi057.stdout:8/268: truncate d4/db/d12/f1c 904942 0 2024-04-25T22:42:14.205 INFO:tasks.workunit.client.0.smithi057.stdout:4/294: rmdir d14/d2f 39 2024-04-25T22:42:14.205 INFO:tasks.workunit.client.0.smithi057.stdout:7/269: getdents d6/d28/d4e/d1d/d5d 0 2024-04-25T22:42:14.206 INFO:tasks.workunit.client.0.smithi057.stdout:6/325: dwrite d2/f40 [0,4194304] 0 2024-04-25T22:42:14.206 INFO:tasks.workunit.client.0.smithi057.stdout:1/290: creat d7/d4e/f5c x:0 0 0 2024-04-25T22:42:14.206 INFO:tasks.workunit.client.0.smithi057.stdout:6/326: stat d2/d19/f3d 0 2024-04-25T22:42:14.206 INFO:tasks.workunit.client.0.smithi057.stdout:0/297: write d0/d3/d3a/f40 [281117,96245] 0 2024-04-25T22:42:14.207 INFO:tasks.workunit.client.0.smithi057.stdout:4/295: mkdir d14/d47/d5e/d5f 0 2024-04-25T22:42:14.207 INFO:tasks.workunit.client.0.smithi057.stdout:6/327: creat d2/d19/d26/d4f/f60 x:0 0 0 2024-04-25T22:42:14.210 INFO:tasks.workunit.client.0.smithi057.stdout:6/328: mkdir d2/d19/d20/d61 0 2024-04-25T22:42:14.211 INFO:tasks.workunit.client.0.smithi057.stdout:0/298: rename d0/d3/d6/d14/l33 to d0/d49/l62 0 2024-04-25T22:42:14.211 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:14.212 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:14.212 INFO:tasks.workunit.client.0.smithi057.stdout:0/299: symlink d0/d3/d6/d14/l63 0 2024-04-25T22:42:14.212 INFO:tasks.workunit.client.0.smithi057.stdout:6/329: mkdir d2/d19/d49/d62 0 2024-04-25T22:42:14.213 INFO:tasks.workunit.client.0.smithi057.stdout:2/358: dread d1f/d4a/f4b [0,4194304] 0 2024-04-25T22:42:14.213 INFO:tasks.workunit.client.0.smithi057.stdout:4/296: dread d14/d2f/f38 [0,4194304] 0 2024-04-25T22:42:14.214 INFO:tasks.workunit.client.0.smithi057.stdout:1/291: dwrite d7/f42 [0,4194304] 0 2024-04-25T22:42:14.214 INFO:tasks.workunit.client.0.smithi057.stdout:0/300: unlink d0/d5/f23 0 2024-04-25T22:42:14.214 INFO:tasks.workunit.client.0.smithi057.stdout:8/269: dwrite d4/db/dd/d3a/d5c/f44 [0,4194304] 0 2024-04-25T22:42:14.215 INFO:tasks.workunit.client.0.smithi057.stdout:4/297: mknod d14/d3d/c60 0 2024-04-25T22:42:14.215 INFO:tasks.workunit.client.0.smithi057.stdout:8/270: stat d4/d5/d17/d19/c64 0 2024-04-25T22:42:14.215 INFO:tasks.workunit.client.0.smithi057.stdout:4/298: readlink d14/d3c/l3e 0 2024-04-25T22:42:14.215 INFO:tasks.workunit.client.0.smithi057.stdout:0/301: symlink d0/d3/d6/d14/l64 0 2024-04-25T22:42:14.216 INFO:tasks.workunit.client.0.smithi057.stdout:6/330: write d2/d19/d50/d1a/d22/f53 [1085387,96891] 0 2024-04-25T22:42:14.217 INFO:tasks.workunit.client.0.smithi057.stdout:0/302: write d0/d49/f4e [264750,49510] 0 2024-04-25T22:42:14.218 INFO:tasks.workunit.client.0.smithi057.stdout:6/331: getdents d2/d19/d50/d1a 0 2024-04-25T22:42:14.218 INFO:tasks.workunit.client.0.smithi057.stdout:9/318: sync 2024-04-25T22:42:14.219 INFO:tasks.workunit.client.0.smithi057.stdout:4/299: creat d14/f61 x:0 0 0 2024-04-25T22:42:14.219 INFO:tasks.workunit.client.0.smithi057.stdout:6/332: stat d2/d19/d26/d4f 0 2024-04-25T22:42:14.220 INFO:tasks.workunit.client.0.smithi057.stdout:6/333: stat d2/f14 0 2024-04-25T22:42:14.220 INFO:tasks.workunit.client.0.smithi057.stdout:0/303: mknod d0/d3/d6/d14/d39/c65 0 2024-04-25T22:42:14.220 INFO:tasks.workunit.client.0.smithi057.stdout:4/300: mkdir d14/d47/d62 0 2024-04-25T22:42:14.221 INFO:tasks.workunit.client.0.smithi057.stdout:6/334: write d2/d19/f43 [2090113,115526] 0 2024-04-25T22:42:14.221 INFO:tasks.workunit.client.0.smithi057.stdout:4/301: chown d14/l35 16362554 1 2024-04-25T22:42:14.221 INFO:tasks.workunit.client.0.smithi057.stdout:9/319: mkdir d3/d34/d42/d28/d65 0 2024-04-25T22:42:14.222 INFO:tasks.workunit.client.0.smithi057.stdout:0/304: creat d0/f66 x:0 0 0 2024-04-25T22:42:14.223 INFO:tasks.workunit.client.0.smithi057.stdout:5/298: dread d2/d6/fa [4194304,4194304] 0 2024-04-25T22:42:14.223 INFO:tasks.workunit.client.0.smithi057.stdout:4/302: write d14/f39 [3116952,93138] 0 2024-04-25T22:42:14.224 INFO:tasks.workunit.client.0.smithi057.stdout:8/271: dwrite d4/db/dd/df/f62 [0,4194304] 0 2024-04-25T22:42:14.224 INFO:tasks.workunit.client.0.smithi057.stdout:6/335: mkdir d2/d19/d26/d63 0 2024-04-25T22:42:14.224 INFO:tasks.workunit.client.0.smithi057.stdout:9/320: creat d3/f66 x:0 0 0 2024-04-25T22:42:14.224 INFO:tasks.workunit.client.0.smithi057.stdout:4/303: stat lb 0 2024-04-25T22:42:14.224 INFO:tasks.workunit.client.0.smithi057.stdout:0/305: creat d0/d5/d53/f67 x:0 0 0 2024-04-25T22:42:14.225 INFO:tasks.workunit.client.0.smithi057.stdout:6/336: readlink d2/d19/d50/l27 0 2024-04-25T22:42:14.226 INFO:tasks.workunit.client.0.smithi057.stdout:5/299: unlink d2/d6/cf 0 2024-04-25T22:42:14.227 INFO:tasks.workunit.client.0.smithi057.stdout:4/304: symlink d14/d2f/l63 0 2024-04-25T22:42:14.228 INFO:tasks.workunit.client.0.smithi057.stdout:0/306: creat d0/d3/f68 x:0 0 0 2024-04-25T22:42:14.228 INFO:tasks.workunit.client.0.smithi057.stdout:9/321: mkdir d3/d34/d42/d28/d62/d67 0 2024-04-25T22:42:14.229 INFO:tasks.workunit.client.0.smithi057.stdout:9/322: readlink d3/l63 0 2024-04-25T22:42:14.230 INFO:tasks.workunit.client.0.smithi057.stdout:4/305: link d14/f30 d14/d5a/f64 0 2024-04-25T22:42:14.231 INFO:tasks.workunit.client.0.smithi057.stdout:7/270: dwrite d6/d28/d4e/f22 [0,4194304] 0 2024-04-25T22:42:14.231 INFO:tasks.workunit.client.0.smithi057.stdout:0/307: write d0/d3/d3a/f4f [7470106,33020] 0 2024-04-25T22:42:14.232 INFO:tasks.workunit.client.0.smithi057.stdout:4/306: write d14/d3d/f40 [4565295,121044] 0 2024-04-25T22:42:14.232 INFO:tasks.workunit.client.0.smithi057.stdout:7/271: fdatasync f1 0 2024-04-25T22:42:14.235 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:14.236 INFO:tasks.workunit.client.0.smithi057.stdout:3/291: sync 2024-04-25T22:42:14.236 INFO:tasks.workunit.client.0.smithi057.stdout:6/337: dwrite d2/f32 [0,4194304] 0 2024-04-25T22:42:14.236 INFO:tasks.workunit.client.0.smithi057.stdout:8/272: dwrite d4/d5/d17/d19/f30 [0,4194304] 0 2024-04-25T22:42:14.236 INFO:tasks.workunit.client.0.smithi057.stdout:5/300: dwrite d2/d2c/f5c [0,4194304] 0 2024-04-25T22:42:14.237 INFO:tasks.workunit.client.0.smithi057.stdout:7/272: write d6/f21 [4578766,120692] 0 2024-04-25T22:42:14.237 INFO:tasks.workunit.client.0.smithi057.stdout:6/338: creat d2/f64 x:0 0 0 2024-04-25T22:42:14.237 INFO:tasks.workunit.client.0.smithi057.stdout:0/308: truncate d0/d3/d6/f45 497336 0 2024-04-25T22:42:14.238 INFO:tasks.workunit.client.0.smithi057.stdout:3/292: write d0/d4/d7/f2f [2271749,80479] 0 2024-04-25T22:42:14.238 INFO:tasks.workunit.client.0.smithi057.stdout:5/301: mkdir d2/d47/d60 0 2024-04-25T22:42:14.238 INFO:tasks.workunit.client.0.smithi057.stdout:4/307: rename d14/d3d/c53 to d14/d3c/d44/c65 0 2024-04-25T22:42:14.238 INFO:tasks.workunit.client.0.smithi057.stdout:7/273: write d6/d28/d4e/d30/f36 [729518,8611] 0 2024-04-25T22:42:14.239 INFO:tasks.workunit.client.0.smithi057.stdout:2/359: dwrite f9 [0,4194304] 0 2024-04-25T22:42:14.240 INFO:tasks.workunit.client.0.smithi057.stdout:8/273: rename d4/db/d12/f36 to d4/d5/d48/d5b/f6b 0 2024-04-25T22:42:14.240 INFO:tasks.workunit.client.0.smithi057.stdout:0/309: rmdir d0/d3/d6/d5f 0 2024-04-25T22:42:14.241 INFO:tasks.workunit.client.0.smithi057.stdout:3/293: creat d0/d4/d7/d26/f63 x:0 0 0 2024-04-25T22:42:14.241 INFO:tasks.workunit.client.0.smithi057.stdout:2/360: creat d1f/d36/d54/f7a x:0 0 0 2024-04-25T22:42:14.241 INFO:tasks.workunit.client.0.smithi057.stdout:5/302: rename d2/d1c/d24/l33 to d2/d47/l61 0 2024-04-25T22:42:14.242 INFO:tasks.workunit.client.0.smithi057.stdout:3/294: read d0/d11/f19 [300161,16707] 0 2024-04-25T22:42:14.242 INFO:tasks.workunit.client.0.smithi057.stdout:0/310: rmdir d0 39 2024-04-25T22:42:14.244 INFO:tasks.workunit.client.0.smithi057.stdout:8/274: dread - d4/d5/d48/d5b/f59 zero size 2024-04-25T22:42:14.244 INFO:tasks.workunit.client.0.smithi057.stdout:6/339: sync 2024-04-25T22:42:14.244 INFO:tasks.workunit.client.0.smithi057.stdout:2/361: rename d1f/d4a/f49 to d1f/d36/f7b 0 2024-04-25T22:42:14.245 INFO:tasks.workunit.client.0.smithi057.stdout:4/308: dread d14/d2f/f38 [0,4194304] 0 2024-04-25T22:42:14.245 INFO:tasks.workunit.client.0.smithi057.stdout:3/295: stat d0/d4/d7/d22/f59 0 2024-04-25T22:42:14.245 INFO:tasks.workunit.client.0.smithi057.stdout:3/296: dread - d0/d4/d34/d3c/d53/f54 zero size 2024-04-25T22:42:14.245 INFO:tasks.workunit.client.0.smithi057.stdout:8/275: creat d4/d5/d21/f6c x:0 0 0 2024-04-25T22:42:14.246 INFO:tasks.workunit.client.0.smithi057.stdout:6/340: write d2/f4 [1196035,44585] 0 2024-04-25T22:42:14.247 INFO:tasks.workunit.client.0.smithi057.stdout:0/311: creat d0/d5/d53/f69 x:0 0 0 2024-04-25T22:42:14.247 INFO:tasks.workunit.client.0.smithi057.stdout:6/341: unlink d2/d19/d20/f38 0 2024-04-25T22:42:14.248 INFO:tasks.workunit.client.0.smithi057.stdout:4/309: creat d14/d2f/f66 x:0 0 0 2024-04-25T22:42:14.248 INFO:tasks.workunit.client.0.smithi057.stdout:8/276: dread - d4/f52 zero size 2024-04-25T22:42:14.249 INFO:tasks.workunit.client.0.smithi057.stdout:3/297: creat d0/d4/d34/f64 x:0 0 0 2024-04-25T22:42:14.249 INFO:tasks.workunit.client.0.smithi057.stdout:2/362: dread d1f/d34/f57 [0,4194304] 0 2024-04-25T22:42:14.249 INFO:tasks.workunit.client.0.smithi057.stdout:2/363: sync 2024-04-25T22:42:14.249 INFO:tasks.workunit.client.0.smithi057.stdout:0/312: fsync d0/f9 0 2024-04-25T22:42:14.250 INFO:tasks.workunit.client.0.smithi057.stdout:2/364: sync 2024-04-25T22:42:14.250 INFO:tasks.workunit.client.0.smithi057.stdout:6/342: dread - d2/d19/d50/d1a/f52 zero size 2024-04-25T22:42:14.250 INFO:tasks.workunit.client.0.smithi057.stdout:4/310: rmdir d14/d3c/d44 39 2024-04-25T22:42:14.251 INFO:tasks.workunit.client.0.smithi057.stdout:3/298: truncate d0/fe 4972784 0 2024-04-25T22:42:14.251 INFO:tasks.workunit.client.0.smithi057.stdout:9/323: dwrite d3/f20 [0,4194304] 0 2024-04-25T22:42:14.251 INFO:tasks.workunit.client.0.smithi057.stdout:5/303: dwrite d2/d1c/d46/f27 [0,4194304] 0 2024-04-25T22:42:14.252 INFO:tasks.workunit.client.0.smithi057.stdout:4/311: truncate d14/d2f/f54 628819 0 2024-04-25T22:42:14.252 INFO:tasks.workunit.client.0.smithi057.stdout:9/324: dread - d3/f58 zero size 2024-04-25T22:42:14.252 INFO:tasks.workunit.client.0.smithi057.stdout:6/343: symlink d2/d19/d49/l65 0 2024-04-25T22:42:14.252 INFO:tasks.workunit.client.0.smithi057.stdout:5/304: chown d2/d6/db/f25 52253 1 2024-04-25T22:42:14.252 INFO:tasks.workunit.client.0.smithi057.stdout:6/344: dread - d2/d19/d50/d1a/f4e zero size 2024-04-25T22:42:14.253 INFO:tasks.workunit.client.0.smithi057.stdout:5/305: rmdir d2/d6/db 39 2024-04-25T22:42:14.254 INFO:tasks.workunit.client.0.smithi057.stdout:9/325: creat d3/d34/d42/d28/f68 x:0 0 0 2024-04-25T22:42:14.254 INFO:tasks.workunit.client.0.smithi057.stdout:2/365: creat d1f/d21/d33/f7c x:0 0 0 2024-04-25T22:42:14.255 INFO:tasks.workunit.client.0.smithi057.stdout:2/366: chown d1f/d21/l24 0 1 2024-04-25T22:42:14.257 INFO:tasks.workunit.client.0.smithi057.stdout:2/367: creat d1f/d34/f7d x:0 0 0 2024-04-25T22:42:14.259 INFO:tasks.workunit.client.0.smithi057.stdout:8/277: dwrite d4/d5/f7 [0,4194304] 0 2024-04-25T22:42:14.260 INFO:tasks.workunit.client.0.smithi057.stdout:8/278: symlink d4/d5/d21/l6d 0 2024-04-25T22:42:14.260 INFO:tasks.workunit.client.0.smithi057.stdout:5/306: dwrite d2/d2c/f5c [0,4194304] 0 2024-04-25T22:42:14.261 INFO:tasks.workunit.client.0.smithi057.stdout:8/279: link d4/d5/d17/d19/f57 d4/db/d12/f6e 0 2024-04-25T22:42:14.263 INFO:tasks.workunit.client.0.smithi057.stdout:0/313: write d0/f2b [2368360,59284] 0 2024-04-25T22:42:14.264 INFO:tasks.workunit.client.0.smithi057.stdout:0/314: symlink d0/d3/d3a/l6a 0 2024-04-25T22:42:14.265 INFO:tasks.workunit.client.0.smithi057.stdout:0/315: read - d0/d5/d53/f69 zero size 2024-04-25T22:42:14.265 INFO:tasks.workunit.client.0.smithi057.stdout:4/312: write d14/d2f/f4a [3237851,54878] 0 2024-04-25T22:42:14.266 INFO:tasks.workunit.client.0.smithi057.stdout:0/316: sync 2024-04-25T22:42:14.266 INFO:tasks.workunit.client.0.smithi057.stdout:0/317: creat d0/d49/f6b x:0 0 0 2024-04-25T22:42:14.266 INFO:tasks.workunit.client.0.smithi057.stdout:4/313: mkdir d14/d5a/d67 0 2024-04-25T22:42:14.267 INFO:tasks.workunit.client.0.smithi057.stdout:0/318: chown d0/d3/d6/f59 1138185 1 2024-04-25T22:42:14.267 INFO:tasks.workunit.client.0.smithi057.stdout:0/319: fsync d0/d5/d53/f61 0 2024-04-25T22:42:14.267 INFO:tasks.workunit.client.0.smithi057.stdout:5/307: dwrite d2/d6/f14 [0,4194304] 0 2024-04-25T22:42:14.269 INFO:tasks.workunit.client.0.smithi057.stdout:3/299: dread d0/d4/d7/d26/f56 [0,4194304] 0 2024-04-25T22:42:14.269 INFO:tasks.workunit.client.0.smithi057.stdout:4/314: symlink d14/d2f/d4c/d5b/l68 0 2024-04-25T22:42:14.270 INFO:tasks.workunit.client.0.smithi057.stdout:4/315: rmdir d14/d5a 39 2024-04-25T22:42:14.272 INFO:tasks.workunit.client.0.smithi057.stdout:4/316: unlink d14/d2f/l37 0 2024-04-25T22:42:14.273 INFO:tasks.workunit.client.0.smithi057.stdout:6/345: dwrite d2/d19/d26/f2d [0,4194304] 0 2024-04-25T22:42:14.273 INFO:tasks.workunit.client.0.smithi057.stdout:5/308: truncate d2/d2c/f36 1470173 0 2024-04-25T22:42:14.274 INFO:tasks.workunit.client.0.smithi057.stdout:0/320: link d0/d3/d6/d14/d39/f56 d0/d3/d6/d29/f6c 0 2024-04-25T22:42:14.274 INFO:tasks.workunit.client.0.smithi057.stdout:4/317: mknod d14/d47/d5e/c69 0 2024-04-25T22:42:14.276 INFO:tasks.workunit.client.0.smithi057.stdout:3/300: fsync d0/fa 0 2024-04-25T22:42:14.276 INFO:tasks.workunit.client.0.smithi057.stdout:0/321: unlink d0/d49/f4e 0 2024-04-25T22:42:14.276 INFO:tasks.workunit.client.0.smithi057.stdout:5/309: creat d2/d6/f62 x:0 0 0 2024-04-25T22:42:14.276 INFO:tasks.workunit.client.0.smithi057.stdout:9/326: dwrite d3/d34/d42/f2b [0,4194304] 0 2024-04-25T22:42:14.277 INFO:tasks.workunit.client.0.smithi057.stdout:5/310: chown d2/d1c/f55 0 1 2024-04-25T22:42:14.277 INFO:tasks.workunit.client.0.smithi057.stdout:0/322: write d0/d3/d4d/f1d [2066411,72140] 0 2024-04-25T22:42:14.280 INFO:tasks.workunit.client.0.smithi057.stdout:6/346: dread d2/f1c [0,4194304] 0 2024-04-25T22:42:14.280 INFO:tasks.workunit.client.0.smithi057.stdout:5/311: dread - d2/d1c/d24/d3d/f56 zero size 2024-04-25T22:42:14.280 INFO:tasks.workunit.client.0.smithi057.stdout:9/327: mknod d3/d34/d42/d28/d39/d54/c69 0 2024-04-25T22:42:14.280 INFO:tasks.workunit.client.0.smithi057.stdout:6/347: sync 2024-04-25T22:42:14.280 INFO:tasks.workunit.client.0.smithi057.stdout:8/280: dwrite d4/f25 [0,4194304] 0 2024-04-25T22:42:14.281 INFO:tasks.workunit.client.0.smithi057.stdout:0/323: getdents d0/d3/d4d/d46 0 2024-04-25T22:42:14.281 INFO:tasks.workunit.client.0.smithi057.stdout:5/312: creat d2/d1c/f63 x:0 0 0 2024-04-25T22:42:14.282 INFO:tasks.workunit.client.0.smithi057.stdout:5/313: chown d2/d6/d4f 1930023 1 2024-04-25T22:42:14.282 INFO:tasks.workunit.client.0.smithi057.stdout:9/328: write d3/d34/d42/f2b [59551,100533] 0 2024-04-25T22:42:14.282 INFO:tasks.workunit.client.0.smithi057.stdout:0/324: rmdir d0/d49 39 2024-04-25T22:42:14.284 INFO:tasks.workunit.client.0.smithi057.stdout:4/318: dwrite d14/f28 [0,4194304] 0 2024-04-25T22:42:14.284 INFO:tasks.workunit.client.0.smithi057.stdout:0/325: unlink d0/f17 0 2024-04-25T22:42:14.285 INFO:tasks.workunit.client.0.smithi057.stdout:5/314: rmdir d2/d1c/d5b 0 2024-04-25T22:42:14.285 INFO:tasks.workunit.client.0.smithi057.stdout:8/281: rename d4/d5/d17/d19/d35/c37 to d4/db/d12/c6f 0 2024-04-25T22:42:14.285 INFO:tasks.workunit.client.0.smithi057.stdout:0/326: chown d0/d3/d4d/c5e 282290689 1 2024-04-25T22:42:14.285 INFO:tasks.workunit.client.0.smithi057.stdout:7/274: dread d6/fb [0,4194304] 0 2024-04-25T22:42:14.286 INFO:tasks.workunit.client.0.smithi057.stdout:5/315: readlink d2/d6/db/l37 0 2024-04-25T22:42:14.286 INFO:tasks.workunit.client.0.smithi057.stdout:4/319: rename d14/f5d to d14/d47/d62/f6a 0 2024-04-25T22:42:14.288 INFO:tasks.workunit.client.0.smithi057.stdout:8/282: mknod d4/db/dd/d3a/d5c/c70 0 2024-04-25T22:42:14.288 INFO:tasks.workunit.client.0.smithi057.stdout:0/327: mkdir d0/d49/d6d 0 2024-04-25T22:42:14.288 INFO:tasks.workunit.client.0.smithi057.stdout:7/275: mkdir d6/d28/d4e/d1d/d51/d5f 0 2024-04-25T22:42:14.288 INFO:tasks.workunit.client.0.smithi057.stdout:5/316: link d2/d2c/f5c d2/d6/f64 0 2024-04-25T22:42:14.288 INFO:tasks.workunit.client.0.smithi057.stdout:0/328: symlink d0/d3/d6/d14/d39/l6e 0 2024-04-25T22:42:14.289 INFO:tasks.workunit.client.0.smithi057.stdout:7/276: mkdir d6/d28/d4e/d30/d60 0 2024-04-25T22:42:14.289 INFO:tasks.workunit.client.0.smithi057.stdout:5/317: rename d2/d1c/f55 to d2/d1c/d46/d3a/f65 0 2024-04-25T22:42:14.291 INFO:tasks.workunit.client.0.smithi057.stdout:0/329: symlink d0/d3/d3a/d3b/l6f 0 2024-04-25T22:42:14.291 INFO:tasks.workunit.client.0.smithi057.stdout:1/292: dread d7/dd/d16/d18/f23 [0,4194304] 0 2024-04-25T22:42:14.291 INFO:tasks.workunit.client.0.smithi057.stdout:0/330: sync 2024-04-25T22:42:14.291 INFO:tasks.workunit.client.0.smithi057.stdout:7/277: getdents d6/d28/d4e/d1d/d59 0 2024-04-25T22:42:14.291 INFO:tasks.workunit.client.0.smithi057.stdout:8/283: mkdir d4/db/dd/d3a/d71 0 2024-04-25T22:42:14.291 INFO:tasks.workunit.client.0.smithi057.stdout:7/278: stat d6/d28/d4e/f22 0 2024-04-25T22:42:14.291 INFO:tasks.workunit.client.0.smithi057.stdout:0/331: creat d0/d3/d3a/d3b/f70 x:0 0 0 2024-04-25T22:42:14.291 INFO:tasks.workunit.client.0.smithi057.stdout:1/293: creat d7/dd/d40/d41/d45/f5d x:0 0 0 2024-04-25T22:42:14.292 INFO:tasks.workunit.client.0.smithi057.stdout:8/284: mkdir d4/db/d72 0 2024-04-25T22:42:14.292 INFO:tasks.workunit.client.0.smithi057.stdout:5/318: dread - d2/d1c/d46/d3a/f65 zero size 2024-04-25T22:42:14.292 INFO:tasks.workunit.client.0.smithi057.stdout:0/332: rmdir d0/d3/d4d 39 2024-04-25T22:42:14.293 INFO:tasks.workunit.client.0.smithi057.stdout:1/294: truncate d7/dd/d16/d24/f54 817195 0 2024-04-25T22:42:14.293 INFO:tasks.workunit.client.0.smithi057.stdout:8/285: creat d4/d5/d17/f73 x:0 0 0 2024-04-25T22:42:14.293 INFO:tasks.workunit.client.0.smithi057.stdout:5/319: creat d2/d1c/d46/f66 x:0 0 0 2024-04-25T22:42:14.293 INFO:tasks.workunit.client.0.smithi057.stdout:0/333: unlink d0/d3/d6/d14/d39/l6e 0 2024-04-25T22:42:14.293 INFO:tasks.workunit.client.0.smithi057.stdout:8/286: dread - d4/d5/d17/d19/d35/f5a zero size 2024-04-25T22:42:14.294 INFO:tasks.workunit.client.0.smithi057.stdout:1/295: write d7/dd/d16/d24/f54 [1662396,85563] 0 2024-04-25T22:42:14.294 INFO:tasks.workunit.client.0.smithi057.stdout:8/287: chown d4/d5/d21/f2a 29 1 2024-04-25T22:42:14.294 INFO:tasks.workunit.client.0.smithi057.stdout:1/296: write d7/dd/d16/d18/f2a [5798079,67859] 0 2024-04-25T22:42:14.295 INFO:tasks.workunit.client.0.smithi057.stdout:8/288: unlink d4/d5/d48/d5b/f3f 0 2024-04-25T22:42:14.295 INFO:tasks.workunit.client.0.smithi057.stdout:1/297: symlink d7/dd/d16/d18/d49/l5e 0 2024-04-25T22:42:14.296 INFO:tasks.workunit.client.0.smithi057.stdout:8/289: chown d4/d5/d17/c47 3707655 1 2024-04-25T22:42:14.296 INFO:tasks.workunit.client.0.smithi057.stdout:7/279: read d6/f21 [3528519,38643] 0 2024-04-25T22:42:14.297 INFO:tasks.workunit.client.0.smithi057.stdout:1/298: mknod d7/dd/c5f 0 2024-04-25T22:42:14.298 INFO:tasks.workunit.client.0.smithi057.stdout:1/299: fdatasync d7/dd/d16/f1e 0 2024-04-25T22:42:14.298 INFO:tasks.workunit.client.0.smithi057.stdout:8/290: creat d4/db/dd/d3a/f74 x:0 0 0 2024-04-25T22:42:14.300 INFO:tasks.workunit.client.0.smithi057.stdout:1/300: fdatasync d7/dd/d26/f50 0 2024-04-25T22:42:14.300 INFO:tasks.workunit.client.0.smithi057.stdout:5/320: dwrite d2/d6/f14 [0,4194304] 0 2024-04-25T22:42:14.301 INFO:tasks.workunit.client.0.smithi057.stdout:0/334: dwrite d0/d5/d53/f61 [0,4194304] 0 2024-04-25T22:42:14.301 INFO:tasks.workunit.client.0.smithi057.stdout:5/321: fdatasync d2/d6/f58 0 2024-04-25T22:42:14.302 INFO:tasks.workunit.client.0.smithi057.stdout:0/335: fdatasync d0/f9 0 2024-04-25T22:42:14.302 INFO:tasks.workunit.client.0.smithi057.stdout:8/291: link d4/d5/d21/l6d d4/db/dd/l75 0 2024-04-25T22:42:14.303 INFO:tasks.workunit.client.0.smithi057.stdout:5/322: rmdir d2/d6/d4f 0 2024-04-25T22:42:14.304 INFO:tasks.workunit.client.0.smithi057.stdout:6/348: dwrite d2/d19/d50/ff [0,4194304] 0 2024-04-25T22:42:14.305 INFO:tasks.workunit.client.0.smithi057.stdout:6/349: chown d2/d19/d26 19 1 2024-04-25T22:42:14.305 INFO:tasks.workunit.client.0.smithi057.stdout:9/329: truncate d3/f9 1605468 0 2024-04-25T22:42:14.306 INFO:tasks.workunit.client.0.smithi057.stdout:9/330: fsync d3/f1a 0 2024-04-25T22:42:14.306 INFO:tasks.workunit.client.0.smithi057.stdout:6/350: fdatasync d2/d19/d20/f45 0 2024-04-25T22:42:14.307 INFO:tasks.workunit.client.0.smithi057.stdout:4/320: truncate d14/f39 822205 0 2024-04-25T22:42:14.308 INFO:tasks.workunit.client.0.smithi057.stdout:4/321: chown d14/d5a/f64 402448 1 2024-04-25T22:42:14.308 INFO:tasks.workunit.client.0.smithi057.stdout:6/351: creat d2/d19/d26/d63/f66 x:0 0 0 2024-04-25T22:42:14.309 INFO:tasks.workunit.client.0.smithi057.stdout:6/352: rename d2/d19/d50/ce to d2/d19/d26/d63/c67 0 2024-04-25T22:42:14.310 INFO:tasks.workunit.client.0.smithi057.stdout:6/353: dread - d2/d19/d20/f48 zero size 2024-04-25T22:42:14.312 INFO:tasks.workunit.client.0.smithi057.stdout:8/292: dwrite d4/d5/d48/d5b/f46 [0,4194304] 0 2024-04-25T22:42:14.314 INFO:tasks.workunit.client.0.smithi057.stdout:7/280: dread d6/d28/d4e/d30/f36 [0,4194304] 0 2024-04-25T22:42:14.315 INFO:tasks.workunit.client.0.smithi057.stdout:2/368: dread d1f/d21/f2e [0,4194304] 0 2024-04-25T22:42:14.315 INFO:tasks.workunit.client.0.smithi057.stdout:7/281: readlink d6/d28/l4a 0 2024-04-25T22:42:14.315 INFO:tasks.workunit.client.0.smithi057.stdout:4/322: read d14/d3c/f42 [382767,126958] 0 2024-04-25T22:42:14.315 INFO:tasks.workunit.client.0.smithi057.stdout:8/293: read d4/db/fc [3248375,27407] 0 2024-04-25T22:42:14.316 INFO:tasks.workunit.client.0.smithi057.stdout:7/282: write f1 [898197,36342] 0 2024-04-25T22:42:14.317 INFO:tasks.workunit.client.0.smithi057.stdout:7/283: dread - d6/d28/f5b zero size 2024-04-25T22:42:14.317 INFO:tasks.workunit.client.0.smithi057.stdout:4/323: rename d14/d2f/f38 to d14/d2f/d4c/d5b/f6b 0 2024-04-25T22:42:14.318 INFO:tasks.workunit.client.0.smithi057.stdout:6/354: dwrite d2/d19/d20/f3b [0,4194304] 0 2024-04-25T22:42:14.319 INFO:tasks.workunit.client.0.smithi057.stdout:7/284: rmdir d6/d28/d4e/d1d/d5d 39 2024-04-25T22:42:14.319 INFO:tasks.workunit.client.0.smithi057.stdout:8/294: write d4/d5/d48/d5b/f56 [996039,112518] 0 2024-04-25T22:42:14.319 INFO:tasks.workunit.client.0.smithi057.stdout:6/355: creat d2/d19/d26/d63/f68 x:0 0 0 2024-04-25T22:42:14.319 INFO:tasks.workunit.client.0.smithi057.stdout:6/356: readlink d2/l16 0 2024-04-25T22:42:14.320 INFO:tasks.workunit.client.0.smithi057.stdout:6/357: chown d2/d19/d20 1008715598 1 2024-04-25T22:42:14.321 INFO:tasks.workunit.client.0.smithi057.stdout:6/358: symlink d2/d19/d50/l69 0 2024-04-25T22:42:14.322 INFO:tasks.workunit.client.0.smithi057.stdout:3/301: dread d0/f1b [0,4194304] 0 2024-04-25T22:42:14.322 INFO:tasks.workunit.client.0.smithi057.stdout:9/331: truncate d3/f4f 6782647 0 2024-04-25T22:42:14.322 INFO:tasks.workunit.client.0.smithi057.stdout:2/369: read d1f/d34/d50/f53 [1246542,116659] 0 2024-04-25T22:42:14.322 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:14.319+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:14.323 INFO:tasks.workunit.client.0.smithi057.stdout:9/332: readlink d3/l30 0 2024-04-25T22:42:14.324 INFO:tasks.workunit.client.0.smithi057.stdout:0/336: dread d0/d49/f48 [0,4194304] 0 2024-04-25T22:42:14.326 INFO:tasks.workunit.client.0.smithi057.stdout:0/337: mkdir d0/d3/d6/d71 0 2024-04-25T22:42:14.326 INFO:tasks.workunit.client.0.smithi057.stdout:7/285: dwrite d6/d28/d4e/f2d [0,4194304] 0 2024-04-25T22:42:14.327 INFO:tasks.workunit.client.0.smithi057.stdout:7/286: fdatasync d6/f15 0 2024-04-25T22:42:14.327 INFO:tasks.workunit.client.0.smithi057.stdout:0/338: creat d0/d3/d6/d14/f72 x:0 0 0 2024-04-25T22:42:14.327 INFO:tasks.workunit.client.0.smithi057.stdout:7/287: fsync d6/f26 0 2024-04-25T22:42:14.328 INFO:tasks.workunit.client.0.smithi057.stdout:7/288: fdatasync d6/f9 0 2024-04-25T22:42:14.328 INFO:tasks.workunit.client.0.smithi057.stdout:0/339: stat d0/d3/d6/d14/d39/c5d 0 2024-04-25T22:42:14.329 INFO:tasks.workunit.client.0.smithi057.stdout:6/359: dwrite d2/d19/d26/d63/f68 [0,4194304] 0 2024-04-25T22:42:14.329 INFO:tasks.workunit.client.0.smithi057.stdout:3/302: read d0/d11/f12 [1560175,21167] 0 2024-04-25T22:42:14.330 INFO:tasks.workunit.client.0.smithi057.stdout:2/370: read d1f/d36/d54/f5f [1912770,41077] 0 2024-04-25T22:42:14.330 INFO:tasks.workunit.client.0.smithi057.stdout:7/289: read - d6/d28/d4e/d30/f5a zero size 2024-04-25T22:42:14.330 INFO:tasks.workunit.client.0.smithi057.stdout:4/324: fsync d14/d2f/d4c/d5b/f6b 0 2024-04-25T22:42:14.331 INFO:tasks.workunit.client.0.smithi057.stdout:0/340: creat d0/d3/d3a/d3b/f73 x:0 0 0 2024-04-25T22:42:14.332 INFO:tasks.workunit.client.0.smithi057.stdout:6/360: write d2/f64 [515358,78690] 0 2024-04-25T22:42:14.332 INFO:tasks.workunit.client.0.smithi057.stdout:4/325: fdatasync d14/f3b 0 2024-04-25T22:42:14.332 INFO:tasks.workunit.client.0.smithi057.stdout:7/290: write d6/fb [49630,84789] 0 2024-04-25T22:42:14.333 INFO:tasks.workunit.client.0.smithi057.stdout:2/371: truncate d1f/d34/f7d 1027306 0 2024-04-25T22:42:14.334 INFO:tasks.workunit.client.0.smithi057.stdout:4/326: stat d14/d3d 0 2024-04-25T22:42:14.334 INFO:tasks.workunit.client.0.smithi057.stdout:3/303: creat d0/d4/d7/d46/d30/f65 x:0 0 0 2024-04-25T22:42:14.334 INFO:tasks.workunit.client.0.smithi057.stdout:6/361: creat d2/d19/d20/f6a x:0 0 0 2024-04-25T22:42:14.334 INFO:tasks.workunit.client.0.smithi057.stdout:2/372: fdatasync f1b 0 2024-04-25T22:42:14.334 INFO:tasks.workunit.client.0.smithi057.stdout:0/341: creat d0/d49/d6d/f74 x:0 0 0 2024-04-25T22:42:14.334 INFO:tasks.workunit.client.0.smithi057.stdout:2/373: mknod d1f/d21/d33/c7e 0 2024-04-25T22:42:14.334 INFO:tasks.workunit.client.0.smithi057.stdout:0/342: write d0/d5/d53/f69 [855742,98497] 0 2024-04-25T22:42:14.334 INFO:tasks.workunit.client.0.smithi057.stdout:7/291: creat d6/d28/d4e/d1d/d59/f61 x:0 0 0 2024-04-25T22:42:14.335 INFO:tasks.workunit.client.0.smithi057.stdout:6/362: link d2/d19/d49/c4b d2/d19/d20/c6b 0 2024-04-25T22:42:14.335 INFO:tasks.workunit.client.0.smithi057.stdout:2/374: truncate d1f/d21/d33/f5a 607635 0 2024-04-25T22:42:14.335 INFO:tasks.workunit.client.0.smithi057.stdout:2/375: chown l1 966743958 1 2024-04-25T22:42:14.336 INFO:tasks.workunit.client.0.smithi057.stdout:6/363: symlink d2/d19/d50/d1a/d22/d31/l6c 0 2024-04-25T22:42:14.336 INFO:tasks.workunit.client.0.smithi057.stdout:0/343: truncate d0/d3/d6/d29/f6c 1456624 0 2024-04-25T22:42:14.336 INFO:tasks.workunit.client.0.smithi057.stdout:6/364: chown c1 4505 1 2024-04-25T22:42:14.336 INFO:tasks.workunit.client.0.smithi057.stdout:2/376: mkdir d1f/d21/d26/d63/d7f 0 2024-04-25T22:42:14.337 INFO:tasks.workunit.client.0.smithi057.stdout:0/344: creat d0/d3/d6/d29/f75 x:0 0 0 2024-04-25T22:42:14.337 INFO:tasks.workunit.client.0.smithi057.stdout:2/377: unlink d1f/d36/l66 0 2024-04-25T22:42:14.337 INFO:tasks.workunit.client.0.smithi057.stdout:6/365: write d2/d19/d50/d1a/f46 [1702078,49919] 0 2024-04-25T22:42:14.338 INFO:tasks.workunit.client.0.smithi057.stdout:0/345: truncate d0/d5/d53/f67 510941 0 2024-04-25T22:42:14.338 INFO:tasks.workunit.client.0.smithi057.stdout:2/378: rename d1f/d21/c68 to d1f/d34/d50/c80 0 2024-04-25T22:42:14.339 INFO:tasks.workunit.client.0.smithi057.stdout:0/346: creat d0/d3/d6/d14/d39/f76 x:0 0 0 2024-04-25T22:42:14.339 INFO:tasks.workunit.client.0.smithi057.stdout:0/347: rmdir d0/d5/d53 39 2024-04-25T22:42:14.341 INFO:tasks.workunit.client.0.smithi057.stdout:0/348: creat d0/d49/f77 x:0 0 0 2024-04-25T22:42:14.341 INFO:tasks.workunit.client.0.smithi057.stdout:8/295: dread d4/d5/d48/d5b/f56 [0,4194304] 0 2024-04-25T22:42:14.341 INFO:tasks.workunit.client.0.smithi057.stdout:7/292: truncate d6/f14 2831710 0 2024-04-25T22:42:14.342 INFO:tasks.workunit.client.0.smithi057.stdout:0/349: fdatasync d0/d3/d3a/d3b/f70 0 2024-04-25T22:42:14.342 INFO:tasks.workunit.client.0.smithi057.stdout:8/296: mkdir d4/db/dd/d3a/d5c/d76 0 2024-04-25T22:42:14.342 INFO:tasks.workunit.client.0.smithi057.stdout:6/366: dread d2/d19/d26/f2d [0,4194304] 0 2024-04-25T22:42:14.342 INFO:tasks.workunit.client.0.smithi057.stdout:7/293: write d6/d28/f33 [1484794,87102] 0 2024-04-25T22:42:14.343 INFO:tasks.workunit.client.0.smithi057.stdout:7/294: fsync d6/f27 0 2024-04-25T22:42:14.344 INFO:tasks.workunit.client.0.smithi057.stdout:6/367: chown d2/d19/d50/d1a/d22/d31/f3a 2 1 2024-04-25T22:42:14.344 INFO:tasks.workunit.client.0.smithi057.stdout:8/297: rename d4/d5/d21/c69 to d4/d5/d2f/c77 0 2024-04-25T22:42:14.344 INFO:tasks.workunit.client.0.smithi057.stdout:2/379: dwrite d1f/f2a [0,4194304] 0 2024-04-25T22:42:14.345 INFO:tasks.workunit.client.0.smithi057.stdout:8/298: mknod d4/d5/d17/d19/d35/c78 0 2024-04-25T22:42:14.346 INFO:tasks.workunit.client.0.smithi057.stdout:2/380: creat d1f/d4a/f81 x:0 0 0 2024-04-25T22:42:14.346 INFO:tasks.workunit.client.0.smithi057.stdout:6/368: getdents d2/d19/d20 0 2024-04-25T22:42:14.347 INFO:tasks.workunit.client.0.smithi057.stdout:8/299: mkdir d4/d5/d17/d19/d79 0 2024-04-25T22:42:14.347 INFO:tasks.workunit.client.0.smithi057.stdout:6/369: write d2/f32 [3767693,36815] 0 2024-04-25T22:42:14.347 INFO:tasks.workunit.client.0.smithi057.stdout:4/327: dread d14/d2f/f54 [0,4194304] 0 2024-04-25T22:42:14.348 INFO:tasks.workunit.client.0.smithi057.stdout:2/381: getdents d1f/d21/d26/d63/d7f 0 2024-04-25T22:42:14.349 INFO:tasks.workunit.client.0.smithi057.stdout:0/350: dwrite d0/f2b [0,4194304] 0 2024-04-25T22:42:14.349 INFO:tasks.workunit.client.0.smithi057.stdout:4/328: write d14/d2f/f57 [234006,72796] 0 2024-04-25T22:42:14.350 INFO:tasks.workunit.client.0.smithi057.stdout:6/370: link d2/d19/d49/f54 d2/d19/d26/d4f/f6d 0 2024-04-25T22:42:14.351 INFO:tasks.workunit.client.0.smithi057.stdout:4/329: symlink d14/d3d/l6c 0 2024-04-25T22:42:14.351 INFO:tasks.workunit.client.0.smithi057.stdout:0/351: chown d0/d3/d3a/d3b/f70 47 1 2024-04-25T22:42:14.351 INFO:tasks.workunit.client.0.smithi057.stdout:5/323: dread d2/d6/db/f2b [0,4194304] 0 2024-04-25T22:42:14.352 INFO:tasks.workunit.client.0.smithi057.stdout:6/371: write d2/d19/d50/d1a/d22/f29 [622386,73011] 0 2024-04-25T22:42:14.353 INFO:tasks.workunit.client.0.smithi057.stdout:0/352: fdatasync d0/d3/d4d/f35 0 2024-04-25T22:42:14.353 INFO:tasks.workunit.client.0.smithi057.stdout:4/330: symlink d14/d2f/d4c/l6d 0 2024-04-25T22:42:14.354 INFO:tasks.workunit.client.0.smithi057.stdout:4/331: rmdir d14/d3d 39 2024-04-25T22:42:14.355 INFO:tasks.workunit.client.0.smithi057.stdout:5/324: creat d2/d1c/d42/d54/f67 x:0 0 0 2024-04-25T22:42:14.355 INFO:tasks.workunit.client.0.smithi057.stdout:7/295: read d6/f19 [2254508,69345] 0 2024-04-25T22:42:14.356 INFO:tasks.workunit.client.0.smithi057.stdout:9/333: write d3/f9 [1517004,30016] 0 2024-04-25T22:42:14.357 INFO:tasks.workunit.client.0.smithi057.stdout:8/300: dwrite d4/db/dd/f67 [0,4194304] 0 2024-04-25T22:42:14.357 INFO:tasks.workunit.client.0.smithi057.stdout:5/325: read d2/d1c/f1f [101062,54985] 0 2024-04-25T22:42:14.358 INFO:tasks.workunit.client.0.smithi057.stdout:1/301: dread d7/dd/d16/d18/f34 [0,4194304] 0 2024-04-25T22:42:14.358 INFO:tasks.workunit.client.0.smithi057.stdout:9/334: creat d3/d34/d42/d5e/f6a x:0 0 0 2024-04-25T22:42:14.359 INFO:tasks.workunit.client.0.smithi057.stdout:2/382: dwrite f8 [0,4194304] 0 2024-04-25T22:42:14.361 INFO:tasks.workunit.client.0.smithi057.stdout:1/302: stat d7/dd/d16/lf 0 2024-04-25T22:42:14.363 INFO:tasks.workunit.client.0.smithi057.stdout:4/332: dwrite d14/d47/f51 [0,4194304] 0 2024-04-25T22:42:14.364 INFO:tasks.workunit.client.0.smithi057.stdout:5/326: dwrite d2/f31 [0,4194304] 0 2024-04-25T22:42:14.364 INFO:tasks.workunit.client.0.smithi057.stdout:9/335: rename d3/f1e to d3/d34/f6b 0 2024-04-25T22:42:14.367 INFO:tasks.workunit.client.0.smithi057.stdout:1/303: creat d7/dd/d40/f60 x:0 0 0 2024-04-25T22:42:14.367 INFO:tasks.workunit.client.0.smithi057.stdout:4/333: symlink d14/d2f/d4c/d5b/l6e 0 2024-04-25T22:42:14.368 INFO:tasks.workunit.client.0.smithi057.stdout:8/301: dwrite d4/d5/d48/d5b/f46 [0,4194304] 0 2024-04-25T22:42:14.368 INFO:tasks.workunit.client.0.smithi057.stdout:7/296: truncate d6/f16 1218612 0 2024-04-25T22:42:14.368 INFO:tasks.workunit.client.0.smithi057.stdout:5/327: creat d2/d47/f68 x:0 0 0 2024-04-25T22:42:14.369 INFO:tasks.workunit.client.0.smithi057.stdout:1/304: write d7/dd/d16/d24/f2e [3357097,22033] 0 2024-04-25T22:42:14.369 INFO:tasks.workunit.client.0.smithi057.stdout:5/328: truncate d2/f53 798002 0 2024-04-25T22:42:14.369 INFO:tasks.workunit.client.0.smithi057.stdout:7/297: mknod d6/d28/d4e/d1d/c62 0 2024-04-25T22:42:14.369 INFO:tasks.workunit.client.0.smithi057.stdout:9/336: creat d3/d34/d42/d28/d2d/f6c x:0 0 0 2024-04-25T22:42:14.369 INFO:tasks.workunit.client.0.smithi057.stdout:1/305: fdatasync d7/dd/d16/d24/f38 0 2024-04-25T22:42:14.370 INFO:tasks.workunit.client.0.smithi057.stdout:8/302: chown d4/d5/d2f/f58 10705270 1 2024-04-25T22:42:14.373 INFO:tasks.workunit.client.0.smithi057.stdout:8/303: symlink d4/db/d12/l7a 0 2024-04-25T22:42:14.374 INFO:tasks.workunit.client.0.smithi057.stdout:8/304: stat d4/d5/d17/d19/f26 0 2024-04-25T22:42:14.374 INFO:tasks.workunit.client.0.smithi057.stdout:2/383: dwrite d1f/d4a/f4b [0,4194304] 0 2024-04-25T22:42:14.374 INFO:tasks.workunit.client.0.smithi057.stdout:7/298: dread d6/f52 [0,4194304] 0 2024-04-25T22:42:14.375 INFO:tasks.workunit.client.0.smithi057.stdout:8/305: rmdir d4/d5/d21 39 2024-04-25T22:42:14.375 INFO:tasks.workunit.client.0.smithi057.stdout:5/329: getdents d2/d1c/d46/d3a 0 2024-04-25T22:42:14.375 INFO:tasks.workunit.client.0.smithi057.stdout:6/372: write d2/d19/d50/d1a/f52 [201440,21832] 0 2024-04-25T22:42:14.375 INFO:tasks.workunit.client.0.smithi057.stdout:2/384: symlink d1f/d36/l82 0 2024-04-25T22:42:14.376 INFO:tasks.workunit.client.0.smithi057.stdout:7/299: stat d6/d28 0 2024-04-25T22:42:14.376 INFO:tasks.workunit.client.0.smithi057.stdout:4/334: truncate d14/f25 4126660 0 2024-04-25T22:42:14.377 INFO:tasks.workunit.client.0.smithi057.stdout:3/304: sync 2024-04-25T22:42:14.377 INFO:tasks.workunit.client.0.smithi057.stdout:8/306: dread - d4/d5/d17/d19/f57 zero size 2024-04-25T22:42:14.377 INFO:tasks.workunit.client.0.smithi057.stdout:2/385: creat d1f/d4a/f83 x:0 0 0 2024-04-25T22:42:14.377 INFO:tasks.workunit.client.0.smithi057.stdout:7/300: unlink d6/d28/d4e/d1d/f47 0 2024-04-25T22:42:14.378 INFO:tasks.workunit.client.0.smithi057.stdout:4/335: write d14/f3b [1297647,102488] 0 2024-04-25T22:42:14.378 INFO:tasks.workunit.client.0.smithi057.stdout:6/373: mknod d2/d19/d50/d1a/c6e 0 2024-04-25T22:42:14.378 INFO:tasks.workunit.client.0.smithi057.stdout:5/330: rename d2/d1c/d42/f4b to d2/d6/f69 0 2024-04-25T22:42:14.379 INFO:tasks.workunit.client.0.smithi057.stdout:2/386: symlink d1f/d34/l84 0 2024-04-25T22:42:14.379 INFO:tasks.workunit.client.0.smithi057.stdout:6/374: creat d2/f6f x:0 0 0 2024-04-25T22:42:14.379 INFO:tasks.workunit.client.0.smithi057.stdout:7/301: write d6/d28/d4e/f2d [1481656,68422] 0 2024-04-25T22:42:14.380 INFO:tasks.workunit.client.0.smithi057.stdout:4/336: mknod d14/d2f/d4c/d5b/c6f 0 2024-04-25T22:42:14.380 INFO:tasks.workunit.client.0.smithi057.stdout:8/307: write d4/d5/d17/d19/f30 [4104173,2974] 0 2024-04-25T22:42:14.380 INFO:tasks.workunit.client.0.smithi057.stdout:1/306: dwrite d7/dd/d16/d24/f4f [4194304,4194304] 0 2024-04-25T22:42:14.381 INFO:tasks.workunit.client.0.smithi057.stdout:1/307: write d7/dd/d26/f47 [5120804,13522] 0 2024-04-25T22:42:14.381 INFO:tasks.workunit.client.0.smithi057.stdout:7/302: mknod d6/c63 0 2024-04-25T22:42:14.382 INFO:tasks.workunit.client.0.smithi057.stdout:1/308: chown d7/dd/l11 17839230 1 2024-04-25T22:42:14.382 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:14.379+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:14.383 INFO:tasks.workunit.client.0.smithi057.stdout:7/303: creat d6/d28/d4e/d30/d60/f64 x:0 0 0 2024-04-25T22:42:14.384 INFO:tasks.workunit.client.0.smithi057.stdout:7/304: mknod d6/d28/d4e/d30/d60/c65 0 2024-04-25T22:42:14.385 INFO:tasks.workunit.client.0.smithi057.stdout:7/305: creat d6/d28/f66 x:0 0 0 2024-04-25T22:42:14.386 INFO:tasks.workunit.client.0.smithi057.stdout:6/375: dwrite d2/d19/d50/d1a/d22/f53 [0,4194304] 0 2024-04-25T22:42:14.387 INFO:tasks.workunit.client.0.smithi057.stdout:6/376: readlink d2/d19/d50/d1a/d22/d31/l6c 0 2024-04-25T22:42:14.388 INFO:tasks.workunit.client.0.smithi057.stdout:6/377: creat d2/d19/d49/d62/f70 x:0 0 0 2024-04-25T22:42:14.388 INFO:tasks.workunit.client.0.smithi057.stdout:6/378: dread - d2/d19/d26/d4f/f60 zero size 2024-04-25T22:42:14.393 INFO:tasks.workunit.client.0.smithi057.stdout:9/337: getdents d3/d34/d42/d28/d2d 0 2024-04-25T22:42:14.396 INFO:tasks.workunit.client.0.smithi057.stdout:3/305: dread d0/fa [0,4194304] 0 2024-04-25T22:42:14.397 INFO:tasks.workunit.client.0.smithi057.stdout:9/338: read d3/ff [4916242,27876] 0 2024-04-25T22:42:14.398 INFO:tasks.workunit.client.0.smithi057.stdout:9/339: rename d3/l63 to d3/l6d 0 2024-04-25T22:42:14.398 INFO:tasks.workunit.client.0.smithi057.stdout:9/340: chown d3/l33 15 1 2024-04-25T22:42:14.403 INFO:tasks.workunit.client.0.smithi057.stdout:9/341: dwrite d3/f4e [0,4194304] 0 2024-04-25T22:42:14.403 INFO:tasks.workunit.client.0.smithi057.stdout:5/331: rename d2/d1c/d42 to d2/d1c/d46/d3a/d6a 0 2024-04-25T22:42:14.404 INFO:tasks.workunit.client.0.smithi057.stdout:1/309: rename d7/dd/d16/d18/d49 to d7/dd/d16/d24/d61 0 2024-04-25T22:42:14.404 INFO:tasks.workunit.client.0.smithi057.stdout:5/332: unlink d2/d6/db/l37 0 2024-04-25T22:42:14.405 INFO:tasks.workunit.client.0.smithi057.stdout:9/342: mkdir d3/d34/d42/d28/d62/d67/d6e 0 2024-04-25T22:42:14.405 INFO:tasks.workunit.client.0.smithi057.stdout:5/333: stat d2/d6/l8 0 2024-04-25T22:42:14.405 INFO:tasks.workunit.client.0.smithi057.stdout:5/334: read - d2/d6/f62 zero size 2024-04-25T22:42:14.405 INFO:tasks.workunit.client.0.smithi057.stdout:9/343: stat d3/d34/d42/d28/d39/f3a 0 2024-04-25T22:42:14.405 INFO:tasks.workunit.client.0.smithi057.stdout:1/310: truncate d7/dd/d16/d18/f34 4259289 0 2024-04-25T22:42:14.405 INFO:tasks.workunit.client.0.smithi057.stdout:9/344: readlink d3/d34/d42/d28/d39/l47 0 2024-04-25T22:42:14.407 INFO:tasks.workunit.client.0.smithi057.stdout:1/311: chown d7/dd/d16/c1f 422232 1 2024-04-25T22:42:14.407 INFO:tasks.workunit.client.0.smithi057.stdout:5/335: rename d2/f9 to d2/d6/f6b 0 2024-04-25T22:42:14.408 INFO:tasks.workunit.client.0.smithi057.stdout:9/345: creat d3/d34/d42/d28/f6f x:0 0 0 2024-04-25T22:42:14.408 INFO:tasks.workunit.client.0.smithi057.stdout:5/336: mknod d2/c6c 0 2024-04-25T22:42:14.408 INFO:tasks.workunit.client.0.smithi057.stdout:9/346: creat d3/f70 x:0 0 0 2024-04-25T22:42:14.409 INFO:tasks.workunit.client.0.smithi057.stdout:5/337: write d2/d6/db/f17 [1299493,121931] 0 2024-04-25T22:42:14.409 INFO:tasks.workunit.client.0.smithi057.stdout:5/338: readlink d2/d1c/l40 0 2024-04-25T22:42:14.409 INFO:tasks.workunit.client.0.smithi057.stdout:9/347: creat d3/d34/d42/d28/d62/d67/f71 x:0 0 0 2024-04-25T22:42:14.410 INFO:tasks.workunit.client.0.smithi057.stdout:9/348: truncate d3/f9 1605931 0 2024-04-25T22:42:14.410 INFO:tasks.workunit.client.0.smithi057.stdout:5/339: dread - d2/d6/f62 zero size 2024-04-25T22:42:14.411 INFO:tasks.workunit.client.0.smithi057.stdout:5/340: creat d2/d47/d60/f6d x:0 0 0 2024-04-25T22:42:14.413 INFO:tasks.workunit.client.0.smithi057.stdout:2/387: truncate f11 3491776 0 2024-04-25T22:42:14.414 INFO:tasks.workunit.client.0.smithi057.stdout:7/306: write d6/f26 [1553720,52507] 0 2024-04-25T22:42:14.414 INFO:tasks.workunit.client.0.smithi057.stdout:2/388: unlink d1f/d4a/d4d/f64 0 2024-04-25T22:42:14.415 INFO:tasks.workunit.client.0.smithi057.stdout:7/307: symlink d6/d28/d4e/d1d/d51/d5f/l67 0 2024-04-25T22:42:14.416 INFO:tasks.workunit.client.0.smithi057.stdout:2/389: rename d1f/d21/d33/f61 to d1f/d34/f85 0 2024-04-25T22:42:14.418 INFO:tasks.workunit.client.0.smithi057.stdout:8/308: dwrite d4/f10 [4194304,4194304] 0 2024-04-25T22:42:14.420 INFO:tasks.workunit.client.0.smithi057.stdout:9/349: fdatasync d3/ff 0 2024-04-25T22:42:14.420 INFO:tasks.workunit.client.0.smithi057.stdout:8/309: mknod d4/db/dd/d3a/d71/c7b 0 2024-04-25T22:42:14.421 INFO:tasks.workunit.client.0.smithi057.stdout:7/308: dread d6/d28/f41 [0,4194304] 0 2024-04-25T22:42:14.421 INFO:tasks.workunit.client.0.smithi057.stdout:8/310: symlink d4/d5/d21/l7c 0 2024-04-25T22:42:14.421 INFO:tasks.workunit.client.0.smithi057.stdout:5/341: dwrite d2/d6/db/f38 [4194304,4194304] 0 2024-04-25T22:42:14.422 INFO:tasks.workunit.client.0.smithi057.stdout:0/353: dread d0/d3/d3a/f4f [4194304,4194304] 0 2024-04-25T22:42:14.423 INFO:tasks.workunit.client.0.smithi057.stdout:8/311: rename d4/d5/f15 to d4/db/d72/f7d 0 2024-04-25T22:42:14.424 INFO:tasks.workunit.client.0.smithi057.stdout:7/309: link d6/f9 d6/d28/d4e/d1d/d51/f68 0 2024-04-25T22:42:14.425 INFO:tasks.workunit.client.0.smithi057.stdout:8/312: fsync d4/d5/d21/f6c 0 2024-04-25T22:42:14.425 INFO:tasks.workunit.client.0.smithi057.stdout:0/354: truncate d0/f66 116378 0 2024-04-25T22:42:14.425 INFO:tasks.workunit.client.0.smithi057.stdout:7/310: creat d6/d28/d4e/d30/d46/f69 x:0 0 0 2024-04-25T22:42:14.425 INFO:tasks.workunit.client.0.smithi057.stdout:0/355: stat d0/d3/fc 0 2024-04-25T22:42:14.426 INFO:tasks.workunit.client.0.smithi057.stdout:8/313: rmdir d4/d5/d17/d19/d79 0 2024-04-25T22:42:14.427 INFO:tasks.workunit.client.0.smithi057.stdout:8/314: creat d4/d5/d48/d5b/f7e x:0 0 0 2024-04-25T22:42:14.427 INFO:tasks.workunit.client.0.smithi057.stdout:0/356: rename d0/d3/d4d/d46 to d0/d3/d6/d78 0 2024-04-25T22:42:14.428 INFO:tasks.workunit.client.0.smithi057.stdout:9/350: dwrite d3/d34/d42/d28/f68 [0,4194304] 0 2024-04-25T22:42:14.429 INFO:tasks.workunit.client.0.smithi057.stdout:8/315: link d4/d5/d48/l6a d4/db/dd/d3a/d5c/d76/l7f 0 2024-04-25T22:42:14.430 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:14.430 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:14.430 INFO:tasks.workunit.client.0.smithi057.stdout:9/351: creat d3/d34/d42/d28/f72 x:0 0 0 2024-04-25T22:42:14.430 INFO:tasks.workunit.client.0.smithi057.stdout:8/316: unlink d4/f25 0 2024-04-25T22:42:14.431 INFO:tasks.workunit.client.0.smithi057.stdout:9/352: truncate d3/f66 7587 0 2024-04-25T22:42:14.436 INFO:tasks.workunit.client.0.smithi057.stdout:4/337: dread ff [0,4194304] 0 2024-04-25T22:42:14.438 INFO:tasks.workunit.client.0.smithi057.stdout:7/311: truncate d6/fb 1973129 0 2024-04-25T22:42:14.438 INFO:tasks.workunit.client.0.smithi057.stdout:9/353: creat d3/d34/f73 x:0 0 0 2024-04-25T22:42:14.439 INFO:tasks.workunit.client.0.smithi057.stdout:8/317: dread d4/d5/d48/d5b/f46 [0,4194304] 0 2024-04-25T22:42:14.439 INFO:tasks.workunit.client.0.smithi057.stdout:9/354: write d3/f29 [5154105,49108] 0 2024-04-25T22:42:14.439 INFO:tasks.workunit.client.0.smithi057.stdout:0/357: dwrite d0/d3/d3a/d3b/f70 [0,4194304] 0 2024-04-25T22:42:14.444 INFO:tasks.workunit.client.0.smithi057.stdout:2/390: sync 2024-04-25T22:42:14.444 INFO:tasks.workunit.client.0.smithi057.stdout:6/379: sync 2024-04-25T22:42:14.444 INFO:tasks.workunit.client.0.smithi057.stdout:2/391: dread - d1f/d34/f85 zero size 2024-04-25T22:42:14.444 INFO:tasks.workunit.client.0.smithi057.stdout:1/312: dread d7/dd/d26/f35 [0,4194304] 0 2024-04-25T22:42:14.445 INFO:tasks.workunit.client.0.smithi057.stdout:1/313: readlink d7/dd/d16/d24/l1a 0 2024-04-25T22:42:14.448 INFO:tasks.workunit.client.0.smithi057.stdout:0/358: creat d0/d3/d6/d29/f79 x:0 0 0 2024-04-25T22:42:14.449 INFO:tasks.workunit.client.0.smithi057.stdout:9/355: creat d3/d34/d42/d28/d62/d67/f74 x:0 0 0 2024-04-25T22:42:14.449 INFO:tasks.workunit.client.0.smithi057.stdout:6/380: mknod d2/d19/d26/d4f/c71 0 2024-04-25T22:42:14.449 INFO:tasks.workunit.client.0.smithi057.stdout:8/318: rename d4/db/dd/l75 to d4/d5/d17/d19/l80 0 2024-04-25T22:42:14.449 INFO:tasks.workunit.client.0.smithi057.stdout:2/392: write d1f/d21/d33/f6e [3590851,113122] 0 2024-04-25T22:42:14.450 INFO:tasks.workunit.client.0.smithi057.stdout:7/312: creat d6/d28/d4e/d1d/d5d/f6a x:0 0 0 2024-04-25T22:42:14.450 INFO:tasks.workunit.client.0.smithi057.stdout:6/381: chown d2/f40 6235381 1 2024-04-25T22:42:14.450 INFO:tasks.workunit.client.0.smithi057.stdout:9/356: chown d3/d34/d42/d28/f55 4678 1 2024-04-25T22:42:14.450 INFO:tasks.workunit.client.0.smithi057.stdout:0/359: chown d0/d3/d6/f1b 201838208 1 2024-04-25T22:42:14.452 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:14.453 INFO:tasks.workunit.client.0.smithi057.stdout:7/313: rename d6/d28/d4e/d1d/l4d to d6/d28/d4e/d1d/d51/l6b 0 2024-04-25T22:42:14.454 INFO:tasks.workunit.client.0.smithi057.stdout:4/338: dread d14/f1c [0,4194304] 0 2024-04-25T22:42:14.454 INFO:tasks.workunit.client.0.smithi057.stdout:9/357: link d3/c1c d3/d34/d42/d28/c75 0 2024-04-25T22:42:14.458 INFO:tasks.workunit.client.0.smithi057.stdout:8/319: dwrite d4/d5/d48/d5b/f7e [0,4194304] 0 2024-04-25T22:42:14.458 INFO:tasks.workunit.client.0.smithi057.stdout:0/360: dwrite d0/d3/f15 [0,4194304] 0 2024-04-25T22:42:14.459 INFO:tasks.workunit.client.0.smithi057.stdout:9/358: read d3/d34/d42/f2b [6460823,87442] 0 2024-04-25T22:42:14.460 INFO:tasks.workunit.client.0.smithi057.stdout:8/320: symlink d4/db/dd/d3a/d5c/l81 0 2024-04-25T22:42:14.462 INFO:tasks.workunit.client.0.smithi057.stdout:6/382: dwrite d2/d19/d50/d1a/d22/d31/f3a [0,4194304] 0 2024-04-25T22:42:14.462 INFO:tasks.workunit.client.0.smithi057.stdout:0/361: fdatasync d0/d5/d53/f69 0 2024-04-25T22:42:14.462 INFO:tasks.workunit.client.0.smithi057.stdout:9/359: chown d3/l25 7 1 2024-04-25T22:42:14.463 INFO:tasks.workunit.client.0.smithi057.stdout:8/321: chown d4/d5/d21/f4c 1299226120 1 2024-04-25T22:42:14.463 INFO:tasks.workunit.client.0.smithi057.stdout:4/339: dwrite fc [0,4194304] 0 2024-04-25T22:42:14.463 INFO:tasks.workunit.client.0.smithi057.stdout:9/360: link d3/f4e d3/d34/d42/d5e/f76 0 2024-04-25T22:42:14.463 INFO:tasks.workunit.client.0.smithi057.stdout:8/322: creat d4/d5/f82 x:0 0 0 2024-04-25T22:42:14.464 INFO:tasks.workunit.client.0.smithi057.stdout:4/340: write d14/f28 [692361,122851] 0 2024-04-25T22:42:14.465 INFO:tasks.workunit.client.0.smithi057.stdout:5/342: dread d2/d1c/d46/f22 [0,4194304] 0 2024-04-25T22:42:14.466 INFO:tasks.workunit.client.0.smithi057.stdout:0/362: link d0/d3/d6/f1b d0/d3/d6/d14/f7a 0 2024-04-25T22:42:14.466 INFO:tasks.workunit.client.0.smithi057.stdout:5/343: write d2/d6/f64 [2866343,127883] 0 2024-04-25T22:42:14.468 INFO:tasks.workunit.client.0.smithi057.stdout:3/306: sync 2024-04-25T22:42:14.468 INFO:tasks.workunit.client.0.smithi057.stdout:2/393: sync 2024-04-25T22:42:14.468 INFO:tasks.workunit.client.0.smithi057.stdout:5/344: readlink d2/d6/db/l29 0 2024-04-25T22:42:14.469 INFO:tasks.workunit.client.0.smithi057.stdout:2/394: chown d1f/d34/f57 1052606252 1 2024-04-25T22:42:14.469 INFO:tasks.workunit.client.0.smithi057.stdout:3/307: stat d0/d4/d34/d3c/d53 0 2024-04-25T22:42:14.470 INFO:tasks.workunit.client.0.smithi057.stdout:5/345: write d2/f10 [579482,32727] 0 2024-04-25T22:42:14.470 INFO:tasks.workunit.client.0.smithi057.stdout:9/361: dwrite d3/f14 [0,4194304] 0 2024-04-25T22:42:14.471 INFO:tasks.workunit.client.0.smithi057.stdout:4/341: read d14/f39 [580020,84566] 0 2024-04-25T22:42:14.471 INFO:tasks.workunit.client.0.smithi057.stdout:2/395: dread - d1f/d21/d33/f7c zero size 2024-04-25T22:42:14.471 INFO:tasks.workunit.client.0.smithi057.stdout:5/346: chown d2/c6c 0 1 2024-04-25T22:42:14.471 INFO:tasks.workunit.client.0.smithi057.stdout:7/314: dread d6/fb [0,4194304] 0 2024-04-25T22:42:14.473 INFO:tasks.workunit.client.0.smithi057.stdout:2/396: write d1f/d4a/d4d/f72 [631055,35416] 0 2024-04-25T22:42:14.473 INFO:tasks.workunit.client.0.smithi057.stdout:5/347: read - d2/d1c/d24/f4c zero size 2024-04-25T22:42:14.473 INFO:tasks.workunit.client.0.smithi057.stdout:5/348: sync 2024-04-25T22:42:14.481 INFO:tasks.workunit.client.0.smithi057.stdout:7/315: rename d6/d28/d4e/d30/c35 to d6/d28/d4e/d1d/d5d/c6c 0 2024-04-25T22:42:14.481 INFO:tasks.workunit.client.0.smithi057.stdout:3/308: creat d0/d4/d4a/f66 x:0 0 0 2024-04-25T22:42:14.481 INFO:tasks.workunit.client.0.smithi057.stdout:5/349: mkdir d2/d47/d6e 0 2024-04-25T22:42:14.482 INFO:tasks.workunit.client.0.smithi057.stdout:4/342: mkdir d14/d5a/d67/d70 0 2024-04-25T22:42:14.482 INFO:tasks.workunit.client.0.smithi057.stdout:9/362: creat d3/d34/d42/d28/d62/d67/d6e/f77 x:0 0 0 2024-04-25T22:42:14.482 INFO:tasks.workunit.client.0.smithi057.stdout:2/397: mkdir d1f/d21/d26/d63/d7f/d86 0 2024-04-25T22:42:14.482 INFO:tasks.workunit.client.0.smithi057.stdout:3/309: dread - d0/d4/d7/d46/f29 zero size 2024-04-25T22:42:14.483 INFO:tasks.workunit.client.0.smithi057.stdout:3/310: stat d0/d4/d7/d26 0 2024-04-25T22:42:14.483 INFO:tasks.workunit.client.0.smithi057.stdout:6/383: truncate d2/f32 1912785 0 2024-04-25T22:42:14.483 INFO:tasks.workunit.client.0.smithi057.stdout:4/343: link d14/d2f/d4c/d5b/f6b d14/d5a/d67/f71 0 2024-04-25T22:42:14.484 INFO:tasks.workunit.client.0.smithi057.stdout:3/311: creat d0/d4/d4a/f67 x:0 0 0 2024-04-25T22:42:14.485 INFO:tasks.workunit.client.0.smithi057.stdout:4/344: symlink d14/d47/d62/l72 0 2024-04-25T22:42:14.485 INFO:tasks.workunit.client.0.smithi057.stdout:9/363: link d3/d34/d42/d28/d39/d54/c57 d3/d34/d42/d28/d62/d67/d6e/c78 0 2024-04-25T22:42:14.485 INFO:tasks.workunit.client.0.smithi057.stdout:6/384: mknod d2/d19/d50/d1a/d22/c72 0 2024-04-25T22:42:14.485 INFO:tasks.workunit.client.0.smithi057.stdout:3/312: symlink d0/d4/d7/d46/d30/l68 0 2024-04-25T22:42:14.486 INFO:tasks.workunit.client.0.smithi057.stdout:6/385: fdatasync d2/d19/d50/d1a/d22/f5c 0 2024-04-25T22:42:14.487 INFO:tasks.workunit.client.0.smithi057.stdout:3/313: dread d0/d4/d34/f4b [0,4194304] 0 2024-04-25T22:42:14.488 INFO:tasks.workunit.client.0.smithi057.stdout:7/316: dwrite d6/f54 [0,4194304] 0 2024-04-25T22:42:14.488 INFO:tasks.workunit.client.0.smithi057.stdout:7/317: sync 2024-04-25T22:42:14.489 INFO:tasks.workunit.client.0.smithi057.stdout:3/314: creat d0/d4/d7/f69 x:0 0 0 2024-04-25T22:42:14.491 INFO:tasks.workunit.client.0.smithi057.stdout:3/315: symlink d0/d5b/l6a 0 2024-04-25T22:42:14.491 INFO:tasks.workunit.client.0.smithi057.stdout:3/316: fsync d0/d11/f19 0 2024-04-25T22:42:14.492 INFO:tasks.workunit.client.0.smithi057.stdout:9/364: dwrite d3/d34/f73 [0,4194304] 0 2024-04-25T22:42:14.492 INFO:tasks.workunit.client.0.smithi057.stdout:3/317: mkdir d0/d6b 0 2024-04-25T22:42:14.493 INFO:tasks.workunit.client.0.smithi057.stdout:9/365: write d3/d34/d42/d28/f3b [1472415,41234] 0 2024-04-25T22:42:14.494 INFO:tasks.workunit.client.0.smithi057.stdout:1/314: dread d7/dd/d16/d24/f3a [4194304,4194304] 0 2024-04-25T22:42:14.494 INFO:tasks.workunit.client.0.smithi057.stdout:3/318: creat d0/f6c x:0 0 0 2024-04-25T22:42:14.494 INFO:tasks.workunit.client.0.smithi057.stdout:5/350: write d2/d2c/f36 [833211,78021] 0 2024-04-25T22:42:14.494 INFO:tasks.workunit.client.0.smithi057.stdout:1/315: mknod d7/dd/d26/c62 0 2024-04-25T22:42:14.495 INFO:tasks.workunit.client.0.smithi057.stdout:5/351: unlink f1 0 2024-04-25T22:42:14.495 INFO:tasks.workunit.client.0.smithi057.stdout:0/363: dread d0/d3/d4d/f1d [0,4194304] 0 2024-04-25T22:42:14.495 INFO:tasks.workunit.client.0.smithi057.stdout:3/319: creat d0/d4/d7/d46/d30/f6d x:0 0 0 2024-04-25T22:42:14.495 INFO:tasks.workunit.client.0.smithi057.stdout:1/316: mkdir d7/dd/d16/d24/d63 0 2024-04-25T22:42:14.496 INFO:tasks.workunit.client.0.smithi057.stdout:0/364: symlink d0/l7b 0 2024-04-25T22:42:14.496 INFO:tasks.workunit.client.0.smithi057.stdout:3/320: chown d0/d4/d34/d3c/d53/c58 61763 1 2024-04-25T22:42:14.497 INFO:tasks.workunit.client.0.smithi057.stdout:5/352: rename d2/d1c/d24/c3b to d2/d1c/d46/d3a/c6f 0 2024-04-25T22:42:14.497 INFO:tasks.workunit.client.0.smithi057.stdout:0/365: readlink d0/d3/d6/l31 0 2024-04-25T22:42:14.497 INFO:tasks.workunit.client.0.smithi057.stdout:3/321: symlink d0/l6e 0 2024-04-25T22:42:14.497 INFO:tasks.workunit.client.0.smithi057.stdout:1/317: rename d7/dd/d26/c62 to d7/dd/d16/d24/c64 0 2024-04-25T22:42:14.498 INFO:tasks.workunit.client.0.smithi057.stdout:0/366: fdatasync d0/d49/d6d/f74 0 2024-04-25T22:42:14.498 INFO:tasks.workunit.client.0.smithi057.stdout:5/353: creat d2/d1c/d46/f70 x:0 0 0 2024-04-25T22:42:14.498 INFO:tasks.workunit.client.0.smithi057.stdout:0/367: readlink d0/l22 0 2024-04-25T22:42:14.498 INFO:tasks.workunit.client.0.smithi057.stdout:9/366: dread d3/d34/d42/d5e/f76 [0,4194304] 0 2024-04-25T22:42:14.499 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:14.495+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:14.499 INFO:tasks.workunit.client.0.smithi057.stdout:2/398: write d1f/d34/d50/f53 [1991364,63612] 0 2024-04-25T22:42:14.499 INFO:tasks.workunit.client.0.smithi057.stdout:1/318: mkdir d7/d65 0 2024-04-25T22:42:14.501 INFO:tasks.workunit.client.0.smithi057.stdout:9/367: unlink d3/l30 0 2024-04-25T22:42:14.501 INFO:tasks.workunit.client.0.smithi057.stdout:2/399: creat d1f/d21/d33/f87 x:0 0 0 2024-04-25T22:42:14.501 INFO:tasks.workunit.client.0.smithi057.stdout:4/345: write d14/f39 [369652,90357] 0 2024-04-25T22:42:14.502 INFO:tasks.workunit.client.0.smithi057.stdout:1/319: creat d7/dd/d16/d24/d63/f66 x:0 0 0 2024-04-25T22:42:14.502 INFO:tasks.workunit.client.0.smithi057.stdout:4/346: sync 2024-04-25T22:42:14.502 INFO:tasks.workunit.client.0.smithi057.stdout:9/368: stat d3/l6d 0 2024-04-25T22:42:14.503 INFO:tasks.workunit.client.0.smithi057.stdout:2/400: mkdir d1f/d4a/d4d/d88 0 2024-04-25T22:42:14.504 INFO:tasks.workunit.client.0.smithi057.stdout:1/320: mknod d7/dd/d16/d24/d61/c67 0 2024-04-25T22:42:14.504 INFO:tasks.workunit.client.0.smithi057.stdout:9/369: symlink d3/d34/d42/d28/d65/l79 0 2024-04-25T22:42:14.505 INFO:tasks.workunit.client.0.smithi057.stdout:3/322: dwrite d0/d11/f12 [0,4194304] 0 2024-04-25T22:42:14.505 INFO:tasks.workunit.client.0.smithi057.stdout:1/321: mknod d7/dd/d16/c68 0 2024-04-25T22:42:14.507 INFO:tasks.workunit.client.0.smithi057.stdout:0/368: dwrite d0/d3/fc [0,4194304] 0 2024-04-25T22:42:14.510 INFO:tasks.workunit.client.0.smithi057.stdout:1/322: symlink d7/d65/l69 0 2024-04-25T22:42:14.510 INFO:tasks.workunit.client.0.smithi057.stdout:6/386: dread d2/f64 [0,4194304] 0 2024-04-25T22:42:14.510 INFO:tasks.workunit.client.0.smithi057.stdout:0/369: read - d0/d3/d6/d14/f72 zero size 2024-04-25T22:42:14.510 INFO:tasks.workunit.client.0.smithi057.stdout:6/387: chown d2/l10 22741 1 2024-04-25T22:42:14.510 INFO:tasks.workunit.client.0.smithi057.stdout:1/323: fdatasync d7/dd/d40/d41/d45/f5b 0 2024-04-25T22:42:14.513 INFO:tasks.workunit.client.0.smithi057.stdout:5/354: dread d2/d1c/f26 [0,4194304] 0 2024-04-25T22:42:14.513 INFO:tasks.workunit.client.0.smithi057.stdout:4/347: dwrite f9 [0,4194304] 0 2024-04-25T22:42:14.513 INFO:tasks.workunit.client.0.smithi057.stdout:6/388: mkdir d2/d73 0 2024-04-25T22:42:14.514 INFO:tasks.workunit.client.0.smithi057.stdout:0/370: symlink d0/d3/d6/d29/l7c 0 2024-04-25T22:42:14.514 INFO:tasks.workunit.client.0.smithi057.stdout:1/324: mkdir d7/d65/d6a 0 2024-04-25T22:42:14.514 INFO:tasks.workunit.client.0.smithi057.stdout:2/401: dread d1f/d21/f2e [0,4194304] 0 2024-04-25T22:42:14.515 INFO:tasks.workunit.client.0.smithi057.stdout:5/355: write d2/d2c/f5c [4291603,15538] 0 2024-04-25T22:42:14.516 INFO:tasks.workunit.client.0.smithi057.stdout:0/371: creat d0/d49/f7d x:0 0 0 2024-04-25T22:42:14.517 INFO:tasks.workunit.client.0.smithi057.stdout:2/402: unlink d1f/d21/d26/f71 0 2024-04-25T22:42:14.517 INFO:tasks.workunit.client.0.smithi057.stdout:1/325: mkdir d7/dd/d40/d41/d6b 0 2024-04-25T22:42:14.517 INFO:tasks.workunit.client.0.smithi057.stdout:6/389: write d2/d19/d20/f48 [833696,73908] 0 2024-04-25T22:42:14.518 INFO:tasks.workunit.client.0.smithi057.stdout:7/318: dwrite d6/f16 [0,4194304] 0 2024-04-25T22:42:14.518 INFO:tasks.workunit.client.0.smithi057.stdout:0/372: unlink d0/d3/d3a/d3b/l5b 0 2024-04-25T22:42:14.518 INFO:tasks.workunit.client.0.smithi057.stdout:4/348: rename d14/d3d/f40 to d14/f73 0 2024-04-25T22:42:14.518 INFO:tasks.workunit.client.0.smithi057.stdout:1/326: chown d7/d4e 1042348 1 2024-04-25T22:42:14.519 INFO:tasks.workunit.client.0.smithi057.stdout:5/356: creat d2/d6/f71 x:0 0 0 2024-04-25T22:42:14.519 INFO:tasks.workunit.client.0.smithi057.stdout:3/323: dwrite d0/d4/d7/d46/f3a [0,4194304] 0 2024-04-25T22:42:14.519 INFO:tasks.workunit.client.0.smithi057.stdout:4/349: fdatasync d14/d3c/f55 0 2024-04-25T22:42:14.520 INFO:tasks.workunit.client.0.smithi057.stdout:2/403: symlink d1f/d34/d50/l89 0 2024-04-25T22:42:14.520 INFO:tasks.workunit.client.0.smithi057.stdout:6/390: write d2/d19/d26/d4f/f60 [134679,71749] 0 2024-04-25T22:42:14.520 INFO:tasks.workunit.client.0.smithi057.stdout:1/327: creat d7/f6c x:0 0 0 2024-04-25T22:42:14.520 INFO:tasks.workunit.client.0.smithi057.stdout:0/373: symlink d0/d3/d4d/l7e 0 2024-04-25T22:42:14.521 INFO:tasks.workunit.client.0.smithi057.stdout:0/374: stat d0/l18 0 2024-04-25T22:42:14.521 INFO:tasks.workunit.client.0.smithi057.stdout:7/319: creat d6/d28/d4e/d1d/d51/f6d x:0 0 0 2024-04-25T22:42:14.523 INFO:tasks.workunit.client.0.smithi057.stdout:1/328: write d7/dd/d16/f1e [996315,2124] 0 2024-04-25T22:42:14.523 INFO:tasks.workunit.client.0.smithi057.stdout:3/324: truncate d0/d4/d7/d26/f4e 449112 0 2024-04-25T22:42:14.523 INFO:tasks.workunit.client.0.smithi057.stdout:0/375: truncate d0/d49/f48 4547040 0 2024-04-25T22:42:14.523 INFO:tasks.workunit.client.0.smithi057.stdout:7/320: symlink d6/l6e 0 2024-04-25T22:42:14.523 INFO:tasks.workunit.client.0.smithi057.stdout:1/329: read d7/dd/d16/d24/f3a [6207023,68059] 0 2024-04-25T22:42:14.524 INFO:tasks.workunit.client.0.smithi057.stdout:1/330: fsync d7/dd/d40/d41/f4b 0 2024-04-25T22:42:14.524 INFO:tasks.workunit.client.0.smithi057.stdout:3/325: creat d0/d4/d7/d46/f6f x:0 0 0 2024-04-25T22:42:14.524 INFO:tasks.workunit.client.0.smithi057.stdout:3/326: stat d0/d4/d7/d22/f55 0 2024-04-25T22:42:14.524 INFO:tasks.workunit.client.0.smithi057.stdout:3/327: chown d0/d4/d7/d22/l35 2506356 1 2024-04-25T22:42:14.524 INFO:tasks.workunit.client.0.smithi057.stdout:0/376: creat d0/d5/f7f x:0 0 0 2024-04-25T22:42:14.525 INFO:tasks.workunit.client.0.smithi057.stdout:1/331: creat d7/d65/d6a/f6d x:0 0 0 2024-04-25T22:42:14.526 INFO:tasks.workunit.client.0.smithi057.stdout:5/357: link d2/d1c/d46/d3a/c6f d2/d6/c72 0 2024-04-25T22:42:14.526 INFO:tasks.workunit.client.0.smithi057.stdout:1/332: creat d7/dd/d40/d41/d6b/f6e x:0 0 0 2024-04-25T22:42:14.527 INFO:tasks.workunit.client.0.smithi057.stdout:1/333: readlink d7/dd/d16/lf 0 2024-04-25T22:42:14.527 INFO:tasks.workunit.client.0.smithi057.stdout:1/334: creat d7/f6f x:0 0 0 2024-04-25T22:42:14.528 INFO:tasks.workunit.client.0.smithi057.stdout:7/321: dwrite d6/d28/f33 [4194304,4194304] 0 2024-04-25T22:42:14.528 INFO:tasks.workunit.client.0.smithi057.stdout:1/335: creat d7/dd/d16/d18/f70 x:0 0 0 2024-04-25T22:42:14.529 INFO:tasks.workunit.client.0.smithi057.stdout:7/322: fdatasync d6/d28/d4e/d1d/d51/f68 0 2024-04-25T22:42:14.529 INFO:tasks.workunit.client.0.smithi057.stdout:7/323: chown d6/d28/d4e/d1d/d59 2 1 2024-04-25T22:42:14.530 INFO:tasks.workunit.client.0.smithi057.stdout:7/324: readlink d6/l6e 0 2024-04-25T22:42:14.530 INFO:tasks.workunit.client.0.smithi057.stdout:7/325: mkdir d6/d28/d4e/d30/d60/d6f 0 2024-04-25T22:42:14.531 INFO:tasks.workunit.client.0.smithi057.stdout:7/326: mknod d6/d28/d4e/d1d/d51/d5f/c70 0 2024-04-25T22:42:14.532 INFO:tasks.workunit.client.0.smithi057.stdout:7/327: creat d6/d28/d4e/d30/d46/f71 x:0 0 0 2024-04-25T22:42:14.532 INFO:tasks.workunit.client.0.smithi057.stdout:7/328: chown d6/c53 79203 1 2024-04-25T22:42:14.533 INFO:tasks.workunit.client.0.smithi057.stdout:7/329: chown d6/d28/d4e/d30/f36 59725 1 2024-04-25T22:42:14.534 INFO:tasks.workunit.client.0.smithi057.stdout:7/330: write d6/f48 [1542458,121648] 0 2024-04-25T22:42:14.534 INFO:tasks.workunit.client.0.smithi057.stdout:7/331: fsync d6/d28/d4e/d30/d46/f69 0 2024-04-25T22:42:14.535 INFO:tasks.workunit.client.0.smithi057.stdout:9/370: dread d3/d34/d42/d28/f37 [0,4194304] 0 2024-04-25T22:42:14.536 INFO:tasks.workunit.client.0.smithi057.stdout:8/323: dread d4/d5/d21/f60 [0,4194304] 0 2024-04-25T22:42:14.537 INFO:tasks.workunit.client.0.smithi057.stdout:6/391: read d2/d19/d50/d1a/f42 [3335861,29431] 0 2024-04-25T22:42:14.537 INFO:tasks.workunit.client.0.smithi057.stdout:8/324: fdatasync d4/db/d72/f7d 0 2024-04-25T22:42:14.537 INFO:tasks.workunit.client.0.smithi057.stdout:6/392: chown d2/f11 154244 1 2024-04-25T22:42:14.538 INFO:tasks.workunit.client.0.smithi057.stdout:8/325: mkdir d4/d5/d17/d19/d35/d83 0 2024-04-25T22:42:14.539 INFO:tasks.workunit.client.0.smithi057.stdout:8/326: link d4/d5/c45 d4/db/d72/c84 0 2024-04-25T22:42:14.542 INFO:tasks.workunit.client.0.smithi057.stdout:3/328: write d0/f33 [971852,124888] 0 2024-04-25T22:42:14.542 INFO:tasks.workunit.client.0.smithi057.stdout:1/336: fsync d7/dd/d40/d41/d6b/f6e 0 2024-04-25T22:42:14.544 INFO:tasks.workunit.client.0.smithi057.stdout:6/393: dwrite d2/d19/d20/f45 [0,4194304] 0 2024-04-25T22:42:14.545 INFO:tasks.workunit.client.0.smithi057.stdout:5/358: write d2/d6/db/f2f [1644385,66513] 0 2024-04-25T22:42:14.545 INFO:tasks.workunit.client.0.smithi057.stdout:1/337: rmdir d7/dd/d16/d24/d61 39 2024-04-25T22:42:14.545 INFO:tasks.workunit.client.0.smithi057.stdout:3/329: write d0/d4/d7/d46/f6f [677488,126947] 0 2024-04-25T22:42:14.546 INFO:tasks.workunit.client.0.smithi057.stdout:5/359: write d2/d2c/f2e [3191832,60070] 0 2024-04-25T22:42:14.547 INFO:tasks.workunit.client.0.smithi057.stdout:6/394: truncate d2/d19/d20/f3b 5101313 0 2024-04-25T22:42:14.547 INFO:tasks.workunit.client.0.smithi057.stdout:1/338: symlink d7/dd/d16/d18/d31/l71 0 2024-04-25T22:42:14.547 INFO:tasks.workunit.client.0.smithi057.stdout:3/330: unlink d0/d4/d4a/f66 0 2024-04-25T22:42:14.548 INFO:tasks.workunit.client.0.smithi057.stdout:8/327: dwrite d4/d5/d48/f55 [0,4194304] 0 2024-04-25T22:42:14.548 INFO:tasks.workunit.client.0.smithi057.stdout:3/331: stat d0/l1a 0 2024-04-25T22:42:14.549 INFO:tasks.workunit.client.0.smithi057.stdout:5/360: write d2/fe [1629873,44563] 0 2024-04-25T22:42:14.549 INFO:tasks.workunit.client.0.smithi057.stdout:8/328: dread - d4/f4f zero size 2024-04-25T22:42:14.549 INFO:tasks.workunit.client.0.smithi057.stdout:6/395: creat d2/d19/d50/d1a/f74 x:0 0 0 2024-04-25T22:42:14.550 INFO:tasks.workunit.client.0.smithi057.stdout:3/332: mkdir d0/d4/d34/d3c/d70 0 2024-04-25T22:42:14.550 INFO:tasks.workunit.client.0.smithi057.stdout:1/339: rename d7/dd/d16/d18/d31/f44 to d7/dd/d40/d41/d45/f72 0 2024-04-25T22:42:14.551 INFO:tasks.workunit.client.0.smithi057.stdout:5/361: dread d2/d1c/f26 [0,4194304] 0 2024-04-25T22:42:14.551 INFO:tasks.workunit.client.0.smithi057.stdout:1/340: fdatasync d7/dd/d26/f50 0 2024-04-25T22:42:14.551 INFO:tasks.workunit.client.0.smithi057.stdout:5/362: read - d2/d1c/f63 zero size 2024-04-25T22:42:14.552 INFO:tasks.workunit.client.0.smithi057.stdout:5/363: sync 2024-04-25T22:42:14.552 INFO:tasks.workunit.client.0.smithi057.stdout:8/329: chown d4/d5/d2f/f5f 242720904 1 2024-04-25T22:42:14.553 INFO:tasks.workunit.client.0.smithi057.stdout:5/364: fsync d2/d6/f14 0 2024-04-25T22:42:14.553 INFO:tasks.workunit.client.0.smithi057.stdout:3/333: creat d0/d4/d4a/f71 x:0 0 0 2024-04-25T22:42:14.553 INFO:tasks.workunit.client.0.smithi057.stdout:1/341: creat d7/dd/d26/f73 x:0 0 0 2024-04-25T22:42:14.553 INFO:tasks.workunit.client.0.smithi057.stdout:8/330: stat d4/db/d12/f4e 0 2024-04-25T22:42:14.553 INFO:tasks.workunit.client.0.smithi057.stdout:3/334: fdatasync d0/d4/d4a/f4c 0 2024-04-25T22:42:14.554 INFO:tasks.workunit.client.0.smithi057.stdout:5/365: creat d2/d1c/d46/f73 x:0 0 0 2024-04-25T22:42:14.554 INFO:tasks.workunit.client.0.smithi057.stdout:8/331: mkdir d4/d85 0 2024-04-25T22:42:14.554 INFO:tasks.workunit.client.0.smithi057.stdout:3/335: mkdir d0/d4/d7/d26/d72 0 2024-04-25T22:42:14.556 INFO:tasks.workunit.client.0.smithi057.stdout:6/396: dwrite d2/f4 [0,4194304] 0 2024-04-25T22:42:14.557 INFO:tasks.workunit.client.0.smithi057.stdout:6/397: truncate d2/d19/d26/d4f/f60 642692 0 2024-04-25T22:42:14.559 INFO:tasks.workunit.client.0.smithi057.stdout:4/350: dread d14/d3c/f42 [0,4194304] 0 2024-04-25T22:42:14.559 INFO:tasks.workunit.client.0.smithi057.stdout:6/398: rename d2/d19/d50/d1a/c30 to d2/d19/d50/c75 0 2024-04-25T22:42:14.559 INFO:tasks.workunit.client.0.smithi057.stdout:4/351: chown d14/d5a 1330792 1 2024-04-25T22:42:14.560 INFO:tasks.workunit.client.0.smithi057.stdout:4/352: symlink d14/d47/l74 0 2024-04-25T22:42:14.561 INFO:tasks.workunit.client.0.smithi057.stdout:6/399: truncate d2/d19/d50/f4c 5015498 0 2024-04-25T22:42:14.561 INFO:tasks.workunit.client.0.smithi057.stdout:4/353: write d14/d2f/f66 [847888,41416] 0 2024-04-25T22:42:14.562 INFO:tasks.workunit.client.0.smithi057.stdout:3/336: dwrite d0/d4/d7/d26/f43 [4194304,4194304] 0 2024-04-25T22:42:14.562 INFO:tasks.workunit.client.0.smithi057.stdout:1/342: dwrite d7/dd/d16/d24/f4f [8388608,4194304] 0 2024-04-25T22:42:14.562 INFO:tasks.workunit.client.0.smithi057.stdout:3/337: write d0/d11/f23 [1968733,106813] 0 2024-04-25T22:42:14.563 INFO:tasks.workunit.client.0.smithi057.stdout:1/343: dread - d7/dd/d16/d24/d61/f53 zero size 2024-04-25T22:42:14.563 INFO:tasks.workunit.client.0.smithi057.stdout:6/400: rename d2/d19/d50/d1a/d22/c23 to d2/d19/d26/d63/c76 0 2024-04-25T22:42:14.563 INFO:tasks.workunit.client.0.smithi057.stdout:3/338: chown d0/d4/d7/d26/l2a 860851729 1 2024-04-25T22:42:14.564 INFO:tasks.workunit.client.0.smithi057.stdout:1/344: write d7/dd/d16/d24/f54 [1896272,103230] 0 2024-04-25T22:42:14.564 INFO:tasks.workunit.client.0.smithi057.stdout:6/401: symlink d2/d19/d26/l77 0 2024-04-25T22:42:14.566 INFO:tasks.workunit.client.0.smithi057.stdout:6/402: link d2/d19/d50/l35 d2/d19/d26/d4f/l78 0 2024-04-25T22:42:14.567 INFO:tasks.workunit.client.0.smithi057.stdout:2/404: dread f1b [0,4194304] 0 2024-04-25T22:42:14.569 INFO:tasks.workunit.client.0.smithi057.stdout:0/377: dread d0/f30 [0,4194304] 0 2024-04-25T22:42:14.569 INFO:tasks.workunit.client.0.smithi057.stdout:3/339: dread d0/d4/d7/d26/f4e [0,4194304] 0 2024-04-25T22:42:14.570 INFO:tasks.workunit.client.0.smithi057.stdout:0/378: creat d0/d3/d6/d14/d39/f80 x:0 0 0 2024-04-25T22:42:14.570 INFO:tasks.workunit.client.0.smithi057.stdout:3/340: rename d0/l32 to d0/d6b/l73 0 2024-04-25T22:42:14.570 INFO:tasks.workunit.client.0.smithi057.stdout:0/379: fdatasync d0/f30 0 2024-04-25T22:42:14.572 INFO:tasks.workunit.client.0.smithi057.stdout:0/380: write d0/d3/d6/d14/d39/f76 [1013317,61429] 0 2024-04-25T22:42:14.573 INFO:tasks.workunit.client.0.smithi057.stdout:6/403: dwrite d2/d19/f1e [0,4194304] 0 2024-04-25T22:42:14.573 INFO:tasks.workunit.client.0.smithi057.stdout:3/341: read d0/d4/d4a/f4c [47316,12085] 0 2024-04-25T22:42:14.574 INFO:tasks.workunit.client.0.smithi057.stdout:0/381: creat d0/d3/d4d/f81 x:0 0 0 2024-04-25T22:42:14.576 INFO:tasks.workunit.client.0.smithi057.stdout:6/404: mkdir d2/d19/d49/d62/d79 0 2024-04-25T22:42:14.576 INFO:tasks.workunit.client.0.smithi057.stdout:7/332: dread d6/f20 [0,4194304] 0 2024-04-25T22:42:14.577 INFO:tasks.workunit.client.0.smithi057.stdout:2/405: dwrite d1f/d21/d33/f5a [0,4194304] 0 2024-04-25T22:42:14.577 INFO:tasks.workunit.client.0.smithi057.stdout:5/366: sync 2024-04-25T22:42:14.577 INFO:tasks.workunit.client.0.smithi057.stdout:4/354: sync 2024-04-25T22:42:14.577 INFO:tasks.workunit.client.0.smithi057.stdout:0/382: getdents d0/d3/d3a 0 2024-04-25T22:42:14.578 INFO:tasks.workunit.client.0.smithi057.stdout:9/371: dread d3/f24 [0,4194304] 0 2024-04-25T22:42:14.578 INFO:tasks.workunit.client.0.smithi057.stdout:5/367: read - d2/d1c/d46/d3a/f65 zero size 2024-04-25T22:42:14.578 INFO:tasks.workunit.client.0.smithi057.stdout:0/383: chown d0/d49/f77 511262 1 2024-04-25T22:42:14.579 INFO:tasks.workunit.client.0.smithi057.stdout:6/405: write d2/d19/f3d [4478605,2885] 0 2024-04-25T22:42:14.579 INFO:tasks.workunit.client.0.smithi057.stdout:5/368: mkdir d2/d1c/d24/d74 0 2024-04-25T22:42:14.579 INFO:tasks.workunit.client.0.smithi057.stdout:2/406: link d1f/d4a/l5d d1f/d36/d60/l8a 0 2024-04-25T22:42:14.581 INFO:tasks.workunit.client.0.smithi057.stdout:7/333: rename d6/d28/d4e/d1d/c50 to d6/d28/d4e/d30/d60/d6f/c72 0 2024-04-25T22:42:14.583 INFO:tasks.workunit.client.0.smithi057.stdout:4/355: rename d14/d3c/f42 to d14/d3c/f75 0 2024-04-25T22:42:14.583 INFO:tasks.workunit.client.0.smithi057.stdout:0/384: rename d0/d3/d6/l10 to d0/d3/d6/d78/l82 0 2024-04-25T22:42:14.583 INFO:tasks.workunit.client.0.smithi057.stdout:4/356: mknod d14/d5a/c76 0 2024-04-25T22:42:14.583 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:14.579+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:14.584 INFO:tasks.workunit.client.0.smithi057.stdout:0/385: mkdir d0/d3/d6/d83 0 2024-04-25T22:42:14.584 INFO:tasks.workunit.client.0.smithi057.stdout:2/407: chown d1f/d34/d50/l74 255 1 2024-04-25T22:42:14.585 INFO:tasks.workunit.client.0.smithi057.stdout:2/408: write d1f/d21/f2e [8143362,114243] 0 2024-04-25T22:42:14.586 INFO:tasks.workunit.client.0.smithi057.stdout:2/409: chown d1f/d34/f85 15 1 2024-04-25T22:42:14.586 INFO:tasks.workunit.client.0.smithi057.stdout:5/369: dwrite d2/d2c/f36 [0,4194304] 0 2024-04-25T22:42:14.586 INFO:tasks.workunit.client.0.smithi057.stdout:5/370: chown d2/d6 2 1 2024-04-25T22:42:14.587 INFO:tasks.workunit.client.0.smithi057.stdout:2/410: mknod d1f/d21/d26/d63/d7f/c8b 0 2024-04-25T22:42:14.589 INFO:tasks.workunit.client.0.smithi057.stdout:8/332: dread d4/d5/f7 [0,4194304] 0 2024-04-25T22:42:14.589 INFO:tasks.workunit.client.0.smithi057.stdout:7/334: dwrite d6/d28/d4e/d30/f56 [0,4194304] 0 2024-04-25T22:42:14.589 INFO:tasks.workunit.client.0.smithi057.stdout:5/371: rename d2/d1c/d46/l5f to d2/d1c/l75 0 2024-04-25T22:42:14.589 INFO:tasks.workunit.client.0.smithi057.stdout:7/335: write d6/f14 [3619749,48067] 0 2024-04-25T22:42:14.590 INFO:tasks.workunit.client.0.smithi057.stdout:2/411: stat d1f/d21/d33/f87 0 2024-04-25T22:42:14.590 INFO:tasks.workunit.client.0.smithi057.stdout:5/372: readlink l0 0 2024-04-25T22:42:14.594 INFO:tasks.workunit.client.0.smithi057.stdout:7/336: mkdir d6/d28/d4e/d30/d46/d73 0 2024-04-25T22:42:14.594 INFO:tasks.workunit.client.0.smithi057.stdout:8/333: rename d4/d5/d2f/c77 to d4/db/c86 0 2024-04-25T22:42:14.594 INFO:tasks.workunit.client.0.smithi057.stdout:7/337: fsync d6/f4b 0 2024-04-25T22:42:14.594 INFO:tasks.workunit.client.0.smithi057.stdout:2/412: rename d1f/d34/d50/c80 to d1f/d21/c8c 0 2024-04-25T22:42:14.594 INFO:tasks.workunit.client.0.smithi057.stdout:0/386: sync 2024-04-25T22:42:14.594 INFO:tasks.workunit.client.0.smithi057.stdout:7/338: unlink d6/d28/d4e/d1d/c37 0 2024-04-25T22:42:14.594 INFO:tasks.workunit.client.0.smithi057.stdout:2/413: creat d1f/d36/d54/f8d x:0 0 0 2024-04-25T22:42:14.595 INFO:tasks.workunit.client.0.smithi057.stdout:0/387: mknod d0/d3/d6/d71/c84 0 2024-04-25T22:42:14.595 INFO:tasks.workunit.client.0.smithi057.stdout:2/414: truncate d1f/f76 426676 0 2024-04-25T22:42:14.595 INFO:tasks.workunit.client.0.smithi057.stdout:7/339: creat d6/f74 x:0 0 0 2024-04-25T22:42:14.596 INFO:tasks.workunit.client.0.smithi057.stdout:0/388: write d0/d5/d53/f69 [1898114,64906] 0 2024-04-25T22:42:14.596 INFO:tasks.workunit.client.0.smithi057.stdout:2/415: write d1f/d21/d26/f4e [4477516,81129] 0 2024-04-25T22:42:14.596 INFO:tasks.workunit.client.0.smithi057.stdout:7/340: dread - d6/d28/d4e/d30/f43 zero size 2024-04-25T22:42:14.597 INFO:tasks.workunit.client.0.smithi057.stdout:2/416: chown c17 219445480 1 2024-04-25T22:42:14.598 INFO:tasks.workunit.client.0.smithi057.stdout:2/417: creat d1f/d21/f8e x:0 0 0 2024-04-25T22:42:14.598 INFO:tasks.workunit.client.0.smithi057.stdout:8/334: dwrite d4/d5/d48/f55 [0,4194304] 0 2024-04-25T22:42:14.599 INFO:tasks.workunit.client.0.smithi057.stdout:8/335: symlink d4/d5/d17/d19/l87 0 2024-04-25T22:42:14.600 INFO:tasks.workunit.client.0.smithi057.stdout:8/336: chown d4/d5/d17/l29 1432694074 1 2024-04-25T22:42:14.601 INFO:tasks.workunit.client.0.smithi057.stdout:8/337: getdents d4/d5/d21 0 2024-04-25T22:42:14.606 INFO:tasks.workunit.client.0.smithi057.stdout:8/338: dwrite d4/db/dd/f2b [0,4194304] 0 2024-04-25T22:42:14.607 INFO:tasks.workunit.client.0.smithi057.stdout:8/339: read - d4/f32 zero size 2024-04-25T22:42:14.607 INFO:tasks.workunit.client.0.smithi057.stdout:1/345: truncate d7/dd/d26/f35 1403813 0 2024-04-25T22:42:14.607 INFO:tasks.workunit.client.0.smithi057.stdout:9/372: truncate d3/ff 2972947 0 2024-04-25T22:42:14.608 INFO:tasks.workunit.client.0.smithi057.stdout:4/357: write d14/f30 [555396,99870] 0 2024-04-25T22:42:14.608 INFO:tasks.workunit.client.0.smithi057.stdout:1/346: chown d7/d65/l69 102 1 2024-04-25T22:42:14.608 INFO:tasks.workunit.client.0.smithi057.stdout:8/340: creat d4/d5/d21/f88 x:0 0 0 2024-04-25T22:42:14.609 INFO:tasks.workunit.client.0.smithi057.stdout:8/341: stat d4/d5/d48/d5b/f56 0 2024-04-25T22:42:14.609 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:14.609 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:14.610 INFO:tasks.workunit.client.0.smithi057.stdout:4/358: rename d14/f73 to d14/d47/d5e/f77 0 2024-04-25T22:42:14.611 INFO:tasks.workunit.client.0.smithi057.stdout:8/342: write d4/d5/d21/f60 [1883868,20941] 0 2024-04-25T22:42:14.611 INFO:tasks.workunit.client.0.smithi057.stdout:6/406: dwrite d2/d19/d26/d4f/f6d [0,4194304] 0 2024-04-25T22:42:14.613 INFO:tasks.workunit.client.0.smithi057.stdout:1/347: getdents d7/dd 0 2024-04-25T22:42:14.613 INFO:tasks.workunit.client.0.smithi057.stdout:4/359: creat d14/d3c/d44/f78 x:0 0 0 2024-04-25T22:42:14.614 INFO:tasks.workunit.client.0.smithi057.stdout:1/348: symlink d7/dd/d40/d41/l74 0 2024-04-25T22:42:14.616 INFO:tasks.workunit.client.0.smithi057.stdout:6/407: dread d2/d19/d20/f45 [0,4194304] 0 2024-04-25T22:42:14.616 INFO:tasks.workunit.client.0.smithi057.stdout:1/349: chown d7/dd/d26/f3e 115555 1 2024-04-25T22:42:14.616 INFO:tasks.workunit.client.0.smithi057.stdout:6/408: mknod d2/d19/d26/d63/c7a 0 2024-04-25T22:42:14.616 INFO:tasks.workunit.client.0.smithi057.stdout:1/350: mkdir d7/dd/d40/d41/d75 0 2024-04-25T22:42:14.617 INFO:tasks.workunit.client.0.smithi057.stdout:7/341: truncate d6/f4b 1155217 0 2024-04-25T22:42:14.617 INFO:tasks.workunit.client.0.smithi057.stdout:6/409: creat d2/d19/d49/d62/f7b x:0 0 0 2024-04-25T22:42:14.618 INFO:tasks.workunit.client.0.smithi057.stdout:1/351: symlink d7/dd/d16/d18/d31/l76 0 2024-04-25T22:42:14.619 INFO:tasks.workunit.client.0.smithi057.stdout:1/352: write d7/dd/d40/d41/d45/f72 [987800,28220] 0 2024-04-25T22:42:14.619 INFO:tasks.workunit.client.0.smithi057.stdout:6/410: truncate d2/d19/d50/d1a/f52 365226 0 2024-04-25T22:42:14.619 INFO:tasks.workunit.client.0.smithi057.stdout:6/411: mknod d2/d19/d26/d4f/c7c 0 2024-04-25T22:42:14.620 INFO:tasks.workunit.client.0.smithi057.stdout:6/412: sync 2024-04-25T22:42:14.620 INFO:tasks.workunit.client.0.smithi057.stdout:1/353: creat d7/dd/d16/d24/f77 x:0 0 0 2024-04-25T22:42:14.620 INFO:tasks.workunit.client.0.smithi057.stdout:1/354: mkdir d7/d65/d78 0 2024-04-25T22:42:14.620 INFO:tasks.workunit.client.0.smithi057.stdout:6/413: dread d2/f64 [0,4194304] 0 2024-04-25T22:42:14.621 INFO:tasks.workunit.client.0.smithi057.stdout:1/355: creat d7/dd/d16/d18/d31/f79 x:0 0 0 2024-04-25T22:42:14.621 INFO:tasks.workunit.client.0.smithi057.stdout:6/414: unlink d2/d19/d50/d1a/c4d 0 2024-04-25T22:42:14.622 INFO:tasks.workunit.client.0.smithi057.stdout:1/356: fsync d7/d65/d6a/f6d 0 2024-04-25T22:42:14.623 INFO:tasks.workunit.client.0.smithi057.stdout:7/342: dwrite d6/d28/f2c [0,4194304] 0 2024-04-25T22:42:14.624 INFO:tasks.workunit.client.0.smithi057.stdout:6/415: link d2/d19/d50/d1a/f52 d2/d19/d26/d63/f7d 0 2024-04-25T22:42:14.624 INFO:tasks.workunit.client.0.smithi057.stdout:1/357: rename d7/dd/l29 to d7/dd/d40/d41/d45/l7a 0 2024-04-25T22:42:14.624 INFO:tasks.workunit.client.0.smithi057.stdout:7/343: mkdir d6/d28/d4e/d75 0 2024-04-25T22:42:14.624 INFO:tasks.workunit.client.0.smithi057.stdout:6/416: creat d2/d19/d49/d62/f7e x:0 0 0 2024-04-25T22:42:14.625 INFO:tasks.workunit.client.0.smithi057.stdout:6/417: mknod d2/d19/d26/c7f 0 2024-04-25T22:42:14.630 INFO:tasks.workunit.client.0.smithi057.stdout:7/344: dwrite d6/d28/d4e/d30/f5a [0,4194304] 0 2024-04-25T22:42:14.631 INFO:tasks.workunit.client.0.smithi057.stdout:0/389: dread d0/d5/d53/f69 [0,4194304] 0 2024-04-25T22:42:14.632 INFO:tasks.workunit.client.0.smithi057.stdout:0/390: stat d0/d3/d6 0 2024-04-25T22:42:14.632 INFO:tasks.workunit.client.0.smithi057.stdout:7/345: mknod d6/d28/d4e/d1d/d5d/c76 0 2024-04-25T22:42:14.632 INFO:tasks.workunit.client.0.smithi057.stdout:6/418: dwrite d2/f2b [0,4194304] 0 2024-04-25T22:42:14.633 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:14.633 INFO:tasks.workunit.client.0.smithi057.stdout:0/391: truncate d0/d49/f77 640648 0 2024-04-25T22:42:14.633 INFO:tasks.workunit.client.0.smithi057.stdout:6/419: creat d2/d19/d49/d62/d79/f80 x:0 0 0 2024-04-25T22:42:14.634 INFO:tasks.workunit.client.0.smithi057.stdout:0/392: getdents d0 0 2024-04-25T22:42:14.634 INFO:tasks.workunit.client.0.smithi057.stdout:6/420: creat d2/d19/d26/f81 x:0 0 0 2024-04-25T22:42:14.635 INFO:tasks.workunit.client.0.smithi057.stdout:0/393: write d0/d5/d53/f69 [785122,81650] 0 2024-04-25T22:42:14.636 INFO:tasks.workunit.client.0.smithi057.stdout:0/394: getdents d0/d3/d6/d14 0 2024-04-25T22:42:14.637 INFO:tasks.workunit.client.0.smithi057.stdout:0/395: link d0/d3/l27 d0/d3/d6/l85 0 2024-04-25T22:42:14.638 INFO:tasks.workunit.client.0.smithi057.stdout:0/396: dread - d0/d3/d6/d29/f79 zero size 2024-04-25T22:42:14.639 INFO:tasks.workunit.client.0.smithi057.stdout:0/397: symlink d0/d5/l86 0 2024-04-25T22:42:14.639 INFO:tasks.workunit.client.0.smithi057.stdout:5/373: dread d2/d1c/d46/f35 [0,4194304] 0 2024-04-25T22:42:14.640 INFO:tasks.workunit.client.0.smithi057.stdout:5/374: mknod d2/d47/d60/c76 0 2024-04-25T22:42:14.640 INFO:tasks.workunit.client.0.smithi057.stdout:5/375: mkdir d2/d1c/d24/d3d/d77 0 2024-04-25T22:42:14.641 INFO:tasks.workunit.client.0.smithi057.stdout:0/398: dread d0/d5/d53/f69 [0,4194304] 0 2024-04-25T22:42:14.641 INFO:tasks.workunit.client.0.smithi057.stdout:0/399: rmdir d0 39 2024-04-25T22:42:14.641 INFO:tasks.workunit.client.0.smithi057.stdout:5/376: read - d2/d1c/d46/f70 zero size 2024-04-25T22:42:14.641 INFO:tasks.workunit.client.0.smithi057.stdout:5/377: fsync d2/f53 0 2024-04-25T22:42:14.642 INFO:tasks.workunit.client.0.smithi057.stdout:0/400: mkdir d0/d3/d4d/d87 0 2024-04-25T22:42:14.642 INFO:tasks.workunit.client.0.smithi057.stdout:5/378: symlink d2/d1c/d24/d3d/l78 0 2024-04-25T22:42:14.643 INFO:tasks.workunit.client.0.smithi057.stdout:0/401: mkdir d0/d3/d88 0 2024-04-25T22:42:14.643 INFO:tasks.workunit.client.0.smithi057.stdout:5/379: mknod d2/d6/c79 0 2024-04-25T22:42:14.643 INFO:tasks.workunit.client.0.smithi057.stdout:0/402: creat d0/d3/d6/d29/f89 x:0 0 0 2024-04-25T22:42:14.643 INFO:tasks.workunit.client.0.smithi057.stdout:5/380: symlink d2/d1c/d24/l7a 0 2024-04-25T22:42:14.644 INFO:tasks.workunit.client.0.smithi057.stdout:5/381: rmdir d2/d47/d60 39 2024-04-25T22:42:14.644 INFO:tasks.workunit.client.0.smithi057.stdout:5/382: mknod d2/d47/d60/c7b 0 2024-04-25T22:42:14.645 INFO:tasks.workunit.client.0.smithi057.stdout:5/383: mknod d2/d6/c7c 0 2024-04-25T22:42:14.645 INFO:tasks.workunit.client.0.smithi057.stdout:5/384: rmdir d2/d1c/d46/d3a/d6a 39 2024-04-25T22:42:14.649 INFO:tasks.workunit.client.0.smithi057.stdout:0/403: dwrite d0/f66 [0,4194304] 0 2024-04-25T22:42:14.650 INFO:tasks.workunit.client.0.smithi057.stdout:0/404: write d0/d49/f77 [889991,109177] 0 2024-04-25T22:42:14.652 INFO:tasks.workunit.client.0.smithi057.stdout:5/385: dwrite d2/d1c/d46/f73 [0,4194304] 0 2024-04-25T22:42:14.652 INFO:tasks.workunit.client.0.smithi057.stdout:0/405: creat d0/d3/d6/d29/f8a x:0 0 0 2024-04-25T22:42:14.653 INFO:tasks.workunit.client.0.smithi057.stdout:5/386: link d2/d1c/d24/f43 d2/d6/db/f7d 0 2024-04-25T22:42:14.653 INFO:tasks.workunit.client.0.smithi057.stdout:0/406: creat d0/d49/d6d/f8b x:0 0 0 2024-04-25T22:42:14.653 INFO:tasks.workunit.client.0.smithi057.stdout:0/407: creat d0/f8c x:0 0 0 2024-04-25T22:42:14.655 INFO:tasks.workunit.client.0.smithi057.stdout:5/387: write d2/d6/f58 [5183525,121920] 0 2024-04-25T22:42:14.656 INFO:tasks.workunit.client.0.smithi057.stdout:5/388: mknod d2/d47/d60/c7e 0 2024-04-25T22:42:14.660 INFO:tasks.workunit.client.0.smithi057.stdout:6/421: sync 2024-04-25T22:42:14.666 INFO:tasks.workunit.client.0.smithi057.stdout:3/342: dread d0/d11/f36 [4194304,4194304] 0 2024-04-25T22:42:14.675 INFO:tasks.workunit.client.0.smithi057.stdout:2/418: truncate d1f/d21/d26/f3a 2493140 0 2024-04-25T22:42:14.675 INFO:tasks.workunit.client.0.smithi057.stdout:2/419: chown d1f/d4a/f81 3450 1 2024-04-25T22:42:14.677 INFO:tasks.workunit.client.0.smithi057.stdout:3/343: dread d0/d4/d7/d22/f2b [0,4194304] 0 2024-04-25T22:42:14.678 INFO:tasks.workunit.client.0.smithi057.stdout:5/389: dread d2/d6/db/f25 [0,4194304] 0 2024-04-25T22:42:14.679 INFO:tasks.workunit.client.0.smithi057.stdout:3/344: truncate d0/d4/d7/d46/f6f 1695267 0 2024-04-25T22:42:14.681 INFO:tasks.workunit.client.0.smithi057.stdout:5/390: creat d2/d1c/d46/d3a/d6a/f7f x:0 0 0 2024-04-25T22:42:14.683 INFO:tasks.workunit.client.0.smithi057.stdout:4/360: dwrite d14/f1c [0,4194304] 0 2024-04-25T22:42:14.683 INFO:tasks.workunit.client.0.smithi057.stdout:2/420: dwrite d1f/d34/f85 [0,4194304] 0 2024-04-25T22:42:14.684 INFO:tasks.workunit.client.0.smithi057.stdout:8/343: dwrite d4/f5e [0,4194304] 0 2024-04-25T22:42:14.684 INFO:tasks.workunit.client.0.smithi057.stdout:4/361: fsync d14/d47/f51 0 2024-04-25T22:42:14.684 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:14.680+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:14.684 INFO:tasks.workunit.client.0.smithi057.stdout:2/421: rename l1c to d1f/d21/d26/d63/d7f/l8f 0 2024-04-25T22:42:14.685 INFO:tasks.workunit.client.0.smithi057.stdout:4/362: symlink d14/d47/d5e/d5f/l79 0 2024-04-25T22:42:14.685 INFO:tasks.workunit.client.0.smithi057.stdout:4/363: symlink d14/d5a/l7a 0 2024-04-25T22:42:14.686 INFO:tasks.workunit.client.0.smithi057.stdout:3/345: dwrite d0/d4/f2d [0,4194304] 0 2024-04-25T22:42:14.686 INFO:tasks.workunit.client.0.smithi057.stdout:4/364: unlink l7 0 2024-04-25T22:42:14.687 INFO:tasks.workunit.client.0.smithi057.stdout:2/422: link d1f/d21/f25 d1f/d34/f90 0 2024-04-25T22:42:14.690 INFO:tasks.workunit.client.0.smithi057.stdout:1/358: creat d7/dd/d40/d41/d6b/f7b x:0 0 0 2024-04-25T22:42:14.691 INFO:tasks.workunit.client.0.smithi057.stdout:6/422: fsync d2/d19/d49/d62/f7e 0 2024-04-25T22:42:14.691 INFO:tasks.workunit.client.0.smithi057.stdout:2/423: dread f1d [0,4194304] 0 2024-04-25T22:42:14.692 INFO:tasks.workunit.client.0.smithi057.stdout:2/424: mknod d1f/d36/d60/c91 0 2024-04-25T22:42:14.693 INFO:tasks.workunit.client.0.smithi057.stdout:2/425: mknod d1f/d36/c92 0 2024-04-25T22:42:14.694 INFO:tasks.workunit.client.0.smithi057.stdout:2/426: link d1f/d21/d26/c55 d1f/d21/d33/c93 0 2024-04-25T22:42:14.695 INFO:tasks.workunit.client.0.smithi057.stdout:2/427: chown d1f/d4a/d4d/f72 3913943 1 2024-04-25T22:42:14.696 INFO:tasks.workunit.client.0.smithi057.stdout:2/428: chown d1f/l28 735697 1 2024-04-25T22:42:14.696 INFO:tasks.workunit.client.0.smithi057.stdout:1/359: dwrite d7/dd/d40/d41/d45/f72 [0,4194304] 0 2024-04-25T22:42:14.697 INFO:tasks.workunit.client.0.smithi057.stdout:2/429: chown d1f/d21/d26/c55 77 1 2024-04-25T22:42:14.698 INFO:tasks.workunit.client.0.smithi057.stdout:1/360: rename d7/dd/d16/l32 to d7/dd/l7c 0 2024-04-25T22:42:14.699 INFO:tasks.workunit.client.0.smithi057.stdout:7/346: write d6/fb [688567,116753] 0 2024-04-25T22:42:14.700 INFO:tasks.workunit.client.0.smithi057.stdout:7/347: creat d6/d28/d4e/d30/d60/d6f/f77 x:0 0 0 2024-04-25T22:42:14.700 INFO:tasks.workunit.client.0.smithi057.stdout:1/361: dread - d7/dd/d40/d41/d45/f5d zero size 2024-04-25T22:42:14.701 INFO:tasks.workunit.client.0.smithi057.stdout:7/348: fdatasync d6/d28/d4e/d1d/d51/f68 0 2024-04-25T22:42:14.701 INFO:tasks.workunit.client.0.smithi057.stdout:1/362: unlink d7/dd/d16/c59 0 2024-04-25T22:42:14.701 INFO:tasks.workunit.client.0.smithi057.stdout:7/349: fsync d6/d28/f42 0 2024-04-25T22:42:14.702 INFO:tasks.workunit.client.0.smithi057.stdout:1/363: dread - d7/dd/d16/d18/d31/f79 zero size 2024-04-25T22:42:14.702 INFO:tasks.workunit.client.0.smithi057.stdout:1/364: chown d7/dd/d16/d24/d63 3937888 1 2024-04-25T22:42:14.706 INFO:tasks.workunit.client.0.smithi057.stdout:7/350: dread d6/d28/d4e/f22 [0,4194304] 0 2024-04-25T22:42:14.706 INFO:tasks.workunit.client.0.smithi057.stdout:3/346: truncate d0/d11/f12 7955530 0 2024-04-25T22:42:14.707 INFO:tasks.workunit.client.0.smithi057.stdout:6/423: truncate d2/d19/d50/d1a/d22/d31/f33 40070 0 2024-04-25T22:42:14.707 INFO:tasks.workunit.client.0.smithi057.stdout:0/408: dread d0/d3/f15 [0,4194304] 0 2024-04-25T22:42:14.708 INFO:tasks.workunit.client.0.smithi057.stdout:2/430: write d1f/d36/d54/f5f [1827161,42871] 0 2024-04-25T22:42:14.709 INFO:tasks.workunit.client.0.smithi057.stdout:7/351: symlink d6/d28/d4e/l78 0 2024-04-25T22:42:14.711 INFO:tasks.workunit.client.0.smithi057.stdout:9/373: dwrite d3/f12 [0,4194304] 0 2024-04-25T22:42:14.711 INFO:tasks.workunit.client.0.smithi057.stdout:5/391: sync 2024-04-25T22:42:14.712 INFO:tasks.workunit.client.0.smithi057.stdout:8/344: dwrite d4/db/dd/d3a/f3c [0,4194304] 0 2024-04-25T22:42:14.712 INFO:tasks.workunit.client.0.smithi057.stdout:2/431: truncate d1f/d21/f25 1025990 0 2024-04-25T22:42:14.712 INFO:tasks.workunit.client.0.smithi057.stdout:1/365: dwrite d7/dd/d16/d18/f70 [0,4194304] 0 2024-04-25T22:42:14.712 INFO:tasks.workunit.client.0.smithi057.stdout:7/352: fdatasync d6/d28/d4e/d30/d60/f64 0 2024-04-25T22:42:14.713 INFO:tasks.workunit.client.0.smithi057.stdout:5/392: dread - d2/d1c/d46/d3a/d6a/f7f zero size 2024-04-25T22:42:14.713 INFO:tasks.workunit.client.0.smithi057.stdout:9/374: write d3/d34/d42/d28/d2d/f40 [44621,50198] 0 2024-04-25T22:42:14.714 INFO:tasks.workunit.client.0.smithi057.stdout:7/353: unlink d6/l40 0 2024-04-25T22:42:14.714 INFO:tasks.workunit.client.0.smithi057.stdout:8/345: unlink d4/d5/d17/d19/l80 0 2024-04-25T22:42:14.715 INFO:tasks.workunit.client.0.smithi057.stdout:2/432: link d1f/d34/f7d d1f/d36/f94 0 2024-04-25T22:42:14.715 INFO:tasks.workunit.client.0.smithi057.stdout:5/393: symlink d2/d47/d60/l80 0 2024-04-25T22:42:14.715 INFO:tasks.workunit.client.0.smithi057.stdout:9/375: stat d3/d34/d42/d28/d39/d54 0 2024-04-25T22:42:14.717 INFO:tasks.workunit.client.0.smithi057.stdout:2/433: chown d1f/d21/f78 2056309 1 2024-04-25T22:42:14.717 INFO:tasks.workunit.client.0.smithi057.stdout:9/376: fdatasync d3/d34/d42/d5e/f6a 0 2024-04-25T22:42:14.717 INFO:tasks.workunit.client.0.smithi057.stdout:5/394: creat d2/d2c/f81 x:0 0 0 2024-04-25T22:42:14.718 INFO:tasks.workunit.client.0.smithi057.stdout:7/354: getdents d6/d28/d4e/d30 0 2024-04-25T22:42:14.718 INFO:tasks.workunit.client.0.smithi057.stdout:0/409: dwrite d0/f9 [0,4194304] 0 2024-04-25T22:42:14.718 INFO:tasks.workunit.client.0.smithi057.stdout:9/377: dread - d3/d34/d42/d28/f51 zero size 2024-04-25T22:42:14.720 INFO:tasks.workunit.client.0.smithi057.stdout:5/395: creat d2/d47/d6e/f82 x:0 0 0 2024-04-25T22:42:14.720 INFO:tasks.workunit.client.0.smithi057.stdout:7/355: read - d6/d28/d4e/d30/d46/f69 zero size 2024-04-25T22:42:14.720 INFO:tasks.workunit.client.0.smithi057.stdout:9/378: write d3/d34/f43 [1695844,51190] 0 2024-04-25T22:42:14.721 INFO:tasks.workunit.client.0.smithi057.stdout:0/410: link d0/d3/d6/f1b d0/d3/d4d/d87/f8d 0 2024-04-25T22:42:14.721 INFO:tasks.workunit.client.0.smithi057.stdout:8/346: dread d4/f5e [0,4194304] 0 2024-04-25T22:42:14.722 INFO:tasks.workunit.client.0.smithi057.stdout:7/356: write d6/d28/d4e/d30/f36 [84707,114310] 0 2024-04-25T22:42:14.722 INFO:tasks.workunit.client.0.smithi057.stdout:9/379: chown d3/f32 5769 1 2024-04-25T22:42:14.723 INFO:tasks.workunit.client.0.smithi057.stdout:0/411: read d0/d3/fc [430390,37871] 0 2024-04-25T22:42:14.723 INFO:tasks.workunit.client.0.smithi057.stdout:8/347: mkdir d4/db/d89 0 2024-04-25T22:42:14.724 INFO:tasks.workunit.client.0.smithi057.stdout:7/357: mknod d6/d28/d4e/c79 0 2024-04-25T22:42:14.724 INFO:tasks.workunit.client.0.smithi057.stdout:8/348: fdatasync d4/d5/d21/f6c 0 2024-04-25T22:42:14.725 INFO:tasks.workunit.client.0.smithi057.stdout:0/412: write d0/d49/f77 [1304377,27320] 0 2024-04-25T22:42:14.725 INFO:tasks.workunit.client.0.smithi057.stdout:9/380: mkdir d3/d34/d42/d28/d2d/d7a 0 2024-04-25T22:42:14.726 INFO:tasks.workunit.client.0.smithi057.stdout:2/434: dwrite d1f/f42 [0,4194304] 0 2024-04-25T22:42:14.727 INFO:tasks.workunit.client.0.smithi057.stdout:8/349: write d4/db/d72/f7d [4244148,122506] 0 2024-04-25T22:42:14.728 INFO:tasks.workunit.client.0.smithi057.stdout:5/396: dwrite d2/d1c/f1f [0,4194304] 0 2024-04-25T22:42:14.728 INFO:tasks.workunit.client.0.smithi057.stdout:2/435: rename d1f/d36/f94 to d1f/d36/d54/f95 0 2024-04-25T22:42:14.729 INFO:tasks.workunit.client.0.smithi057.stdout:8/350: symlink d4/db/d12/l8a 0 2024-04-25T22:42:14.729 INFO:tasks.workunit.client.0.smithi057.stdout:2/436: fdatasync d1f/d36/f4f 0 2024-04-25T22:42:14.729 INFO:tasks.workunit.client.0.smithi057.stdout:8/351: chown d4/d5/d17/l29 40050263 1 2024-04-25T22:42:14.730 INFO:tasks.workunit.client.0.smithi057.stdout:5/397: fsync d2/d6/db/f2f 0 2024-04-25T22:42:14.731 INFO:tasks.workunit.client.0.smithi057.stdout:8/352: creat d4/d5/d48/f8b x:0 0 0 2024-04-25T22:42:14.732 INFO:tasks.workunit.client.0.smithi057.stdout:8/353: dread - d4/d5/d21/f2a zero size 2024-04-25T22:42:14.733 INFO:tasks.workunit.client.0.smithi057.stdout:5/398: mkdir d2/d1c/d24/d3d/d50/d83 0 2024-04-25T22:42:14.735 INFO:tasks.workunit.client.0.smithi057.stdout:5/399: truncate d2/d6/f69 741483 0 2024-04-25T22:42:14.735 INFO:tasks.workunit.client.0.smithi057.stdout:9/381: dwrite d3/d34/d42/d28/d2d/f6c [0,4194304] 0 2024-04-25T22:42:14.735 INFO:tasks.workunit.client.0.smithi057.stdout:3/347: sync 2024-04-25T22:42:14.735 INFO:tasks.workunit.client.0.smithi057.stdout:1/366: sync 2024-04-25T22:42:14.735 INFO:tasks.workunit.client.0.smithi057.stdout:8/354: sync 2024-04-25T22:42:14.735 INFO:tasks.workunit.client.0.smithi057.stdout:3/348: sync 2024-04-25T22:42:14.735 INFO:tasks.workunit.client.0.smithi057.stdout:9/382: write d3/f1f [7231312,48874] 0 2024-04-25T22:42:14.735 INFO:tasks.workunit.client.0.smithi057.stdout:3/349: dread - d0/d4/d34/f47 zero size 2024-04-25T22:42:14.737 INFO:tasks.workunit.client.0.smithi057.stdout:5/400: write d2/d2c/f36 [4255744,114782] 0 2024-04-25T22:42:14.737 INFO:tasks.workunit.client.0.smithi057.stdout:1/367: rename d7/dd/d16/d18/f3d to d7/d4e/f7d 0 2024-04-25T22:42:14.737 INFO:tasks.workunit.client.0.smithi057.stdout:9/383: mknod d3/d34/d42/d28/d2d/d7a/c7b 0 2024-04-25T22:42:14.739 INFO:tasks.workunit.client.0.smithi057.stdout:2/437: dread d1f/d36/d54/f95 [0,4194304] 0 2024-04-25T22:42:14.739 INFO:tasks.workunit.client.0.smithi057.stdout:9/384: write d3/d34/f43 [5778166,14460] 0 2024-04-25T22:42:14.739 INFO:tasks.workunit.client.0.smithi057.stdout:5/401: link d2/d6/db/f17 d2/d1c/d46/f84 0 2024-04-25T22:42:14.739 INFO:tasks.workunit.client.0.smithi057.stdout:5/402: stat d2/d2c/f36 0 2024-04-25T22:42:14.740 INFO:tasks.workunit.client.0.smithi057.stdout:2/438: mkdir d1f/d21/d96 0 2024-04-25T22:42:14.740 INFO:tasks.workunit.client.0.smithi057.stdout:1/368: unlink d7/dd/d26/f3e 0 2024-04-25T22:42:14.740 INFO:tasks.workunit.client.0.smithi057.stdout:0/413: dread d0/d3/d6/d14/d39/f76 [0,4194304] 0 2024-04-25T22:42:14.741 INFO:tasks.workunit.client.0.smithi057.stdout:9/385: mkdir d3/d34/d42/d28/d62/d67/d6e/d7c 0 2024-04-25T22:42:14.741 INFO:tasks.workunit.client.0.smithi057.stdout:5/403: chown d2/d6/f71 3338400 1 2024-04-25T22:42:14.741 INFO:tasks.workunit.client.0.smithi057.stdout:8/355: dread d4/db/f34 [0,4194304] 0 2024-04-25T22:42:14.741 INFO:tasks.workunit.client.0.smithi057.stdout:1/369: chown d7/dd/d16 1845667120 1 2024-04-25T22:42:14.741 INFO:tasks.workunit.client.0.smithi057.stdout:2/439: creat d1f/d36/d60/f97 x:0 0 0 2024-04-25T22:42:14.742 INFO:tasks.workunit.client.0.smithi057.stdout:2/440: readlink d1f/d36/d54/l65 0 2024-04-25T22:42:14.746 INFO:tasks.workunit.client.0.smithi057.stdout:9/386: dread d3/d34/d42/f2b [4194304,4194304] 0 2024-04-25T22:42:14.747 INFO:tasks.workunit.client.0.smithi057.stdout:4/365: dread d14/f23 [0,4194304] 0 2024-04-25T22:42:14.747 INFO:tasks.workunit.client.0.smithi057.stdout:2/441: dread d1f/d21/f2e [4194304,4194304] 0 2024-04-25T22:42:14.748 INFO:tasks.workunit.client.0.smithi057.stdout:7/358: fdatasync d6/d28/d4e/d30/f36 0 2024-04-25T22:42:14.752 INFO:tasks.workunit.client.0.smithi057.stdout:2/442: dread - d1f/d21/d33/f7c zero size 2024-04-25T22:42:14.752 INFO:tasks.workunit.client.0.smithi057.stdout:5/404: dwrite d2/fe [0,4194304] 0 2024-04-25T22:42:14.753 INFO:tasks.workunit.client.0.smithi057.stdout:9/387: creat d3/d34/d42/d28/d62/d67/d6e/f7d x:0 0 0 2024-04-25T22:42:14.753 INFO:tasks.workunit.client.0.smithi057.stdout:1/370: dwrite d7/dd/d40/d41/d45/f5d [0,4194304] 0 2024-04-25T22:42:14.754 INFO:tasks.workunit.client.0.smithi057.stdout:0/414: dwrite d0/d5/d53/f61 [0,4194304] 0 2024-04-25T22:42:14.754 INFO:tasks.workunit.client.0.smithi057.stdout:8/356: dwrite d4/d5/d48/d5b/f56 [0,4194304] 0 2024-04-25T22:42:14.755 INFO:tasks.workunit.client.0.smithi057.stdout:2/443: chown f11 5 1 2024-04-25T22:42:14.755 INFO:tasks.workunit.client.0.smithi057.stdout:1/371: creat d7/dd/d16/f7e x:0 0 0 2024-04-25T22:42:14.756 INFO:tasks.workunit.client.0.smithi057.stdout:5/405: chown d2/d47/d6e/f82 34450 1 2024-04-25T22:42:14.756 INFO:tasks.workunit.client.0.smithi057.stdout:4/366: fdatasync d14/d3c/f75 0 2024-04-25T22:42:14.756 INFO:tasks.workunit.client.0.smithi057.stdout:9/388: stat d3/d34/d42/d28/d62/d67/d6e/f7d 0 2024-04-25T22:42:14.757 INFO:tasks.workunit.client.0.smithi057.stdout:5/406: stat d2/d1c/d46/f70 0 2024-04-25T22:42:14.757 INFO:tasks.workunit.client.0.smithi057.stdout:2/444: mknod d1f/d21/c98 0 2024-04-25T22:42:14.757 INFO:tasks.workunit.client.0.smithi057.stdout:3/350: dwrite d0/d11/f12 [0,4194304] 0 2024-04-25T22:42:14.760 INFO:tasks.workunit.client.0.smithi057.stdout:7/359: dread d6/d28/f33 [4194304,4194304] 0 2024-04-25T22:42:14.760 INFO:tasks.workunit.client.0.smithi057.stdout:3/351: write d0/d4/d34/d3c/f5c [552012,84402] 0 2024-04-25T22:42:14.760 INFO:tasks.workunit.client.0.smithi057.stdout:8/357: mkdir d4/d5/d48/d5b/d8c 0 2024-04-25T22:42:14.761 INFO:tasks.workunit.client.0.smithi057.stdout:2/445: link d1f/d21/l24 d1f/d34/d50/l99 0 2024-04-25T22:42:14.762 INFO:tasks.workunit.client.0.smithi057.stdout:5/407: creat d2/d6/db/f85 x:0 0 0 2024-04-25T22:42:14.763 INFO:tasks.workunit.client.0.smithi057.stdout:3/352: rename d0/d5b/l6a to d0/d4/d7/l74 0 2024-04-25T22:42:14.764 INFO:tasks.workunit.client.0.smithi057.stdout:2/446: write d1f/d36/d60/f97 [127356,6857] 0 2024-04-25T22:42:14.764 INFO:tasks.workunit.client.0.smithi057.stdout:0/415: getdents d0/d3/d6/d29 0 2024-04-25T22:42:14.764 INFO:tasks.workunit.client.0.smithi057.stdout:3/353: write d0/d4/d7/f69 [982726,123255] 0 2024-04-25T22:42:14.766 INFO:tasks.workunit.client.0.smithi057.stdout:0/416: write d0/d3/d6/d29/f75 [320533,4510] 0 2024-04-25T22:42:14.766 INFO:tasks.workunit.client.0.smithi057.stdout:3/354: write d0/d11/f36 [7325928,69421] 0 2024-04-25T22:42:14.766 INFO:tasks.workunit.client.0.smithi057.stdout:4/367: dwrite d14/d3c/d44/f78 [0,4194304] 0 2024-04-25T22:42:14.766 INFO:tasks.workunit.client.0.smithi057.stdout:3/355: stat d0/f6 0 2024-04-25T22:42:14.767 INFO:tasks.workunit.client.0.smithi057.stdout:0/417: write d0/d3/d6/d29/f79 [407792,19372] 0 2024-04-25T22:42:14.768 INFO:tasks.workunit.client.0.smithi057.stdout:4/368: rmdir d14/d47/d5e/d5f 39 2024-04-25T22:42:14.768 INFO:tasks.workunit.client.0.smithi057.stdout:7/360: dwrite d6/d28/f5b [0,4194304] 0 2024-04-25T22:42:14.768 INFO:tasks.workunit.client.0.smithi057.stdout:0/418: write d0/d49/f77 [896854,88581] 0 2024-04-25T22:42:14.769 INFO:tasks.workunit.client.0.smithi057.stdout:0/419: write d0/d5/f32 [796183,105703] 0 2024-04-25T22:42:14.770 INFO:tasks.workunit.client.0.smithi057.stdout:4/369: fdatasync d14/d2f/d4c/d5b/f6b 0 2024-04-25T22:42:14.770 INFO:tasks.workunit.client.0.smithi057.stdout:8/358: truncate d4/d5/d48/d5b/f7e 1622002 0 2024-04-25T22:42:14.770 INFO:tasks.workunit.client.0.smithi057.stdout:0/420: symlink d0/d3/d6/d14/l8e 0 2024-04-25T22:42:14.770 INFO:tasks.workunit.client.0.smithi057.stdout:8/359: write d4/f4f [280446,66474] 0 2024-04-25T22:42:14.771 INFO:tasks.workunit.client.0.smithi057.stdout:4/370: creat d14/d2f/f7b x:0 0 0 2024-04-25T22:42:14.771 INFO:tasks.workunit.client.0.smithi057.stdout:0/421: creat d0/d3/d4d/f8f x:0 0 0 2024-04-25T22:42:14.771 INFO:tasks.workunit.client.0.smithi057.stdout:4/371: stat d14/d3c/l3e 0 2024-04-25T22:42:14.771 INFO:tasks.workunit.client.0.smithi057.stdout:4/372: chown d14/d2f/c49 4 1 2024-04-25T22:42:14.772 INFO:tasks.workunit.client.0.smithi057.stdout:0/422: link d0/d5/d53/f69 d0/d3/d6/f90 0 2024-04-25T22:42:14.773 INFO:tasks.workunit.client.0.smithi057.stdout:0/423: mkdir d0/d3/d4d/d87/d91 0 2024-04-25T22:42:14.774 INFO:tasks.workunit.client.0.smithi057.stdout:0/424: write d0/d3/d6/f90 [497656,109869] 0 2024-04-25T22:42:14.775 INFO:tasks.workunit.client.0.smithi057.stdout:0/425: sync 2024-04-25T22:42:14.776 INFO:tasks.workunit.client.0.smithi057.stdout:3/356: write d0/d11/f19 [1313,93374] 0 2024-04-25T22:42:14.778 INFO:tasks.workunit.client.0.smithi057.stdout:0/426: getdents d0/d3/d3a/d3b 0 2024-04-25T22:42:14.779 INFO:tasks.workunit.client.0.smithi057.stdout:2/447: dwrite d1f/d21/d26/f3a [0,4194304] 0 2024-04-25T22:42:14.779 INFO:tasks.workunit.client.0.smithi057.stdout:4/373: dwrite d14/f28 [0,4194304] 0 2024-04-25T22:42:14.779 INFO:tasks.workunit.client.0.smithi057.stdout:2/448: sync 2024-04-25T22:42:14.779 INFO:tasks.workunit.client.0.smithi057.stdout:3/357: symlink d0/d4/d7/d26/d72/l75 0 2024-04-25T22:42:14.781 INFO:tasks.workunit.client.0.smithi057.stdout:4/374: creat d14/d47/f7c x:0 0 0 2024-04-25T22:42:14.781 INFO:tasks.workunit.client.0.smithi057.stdout:3/358: stat d0/d4/d34/d3c 0 2024-04-25T22:42:14.782 INFO:tasks.workunit.client.0.smithi057.stdout:4/375: write d14/f22 [3040429,43460] 0 2024-04-25T22:42:14.782 INFO:tasks.workunit.client.0.smithi057.stdout:3/359: rename d0/d11/l17 to d0/d4/d34/d3c/l76 0 2024-04-25T22:42:14.783 INFO:tasks.workunit.client.0.smithi057.stdout:2/449: dread - d1f/d21/f78 zero size 2024-04-25T22:42:14.783 INFO:tasks.workunit.client.0.smithi057.stdout:6/424: dread d2/d19/d50/f4c [0,4194304] 0 2024-04-25T22:42:14.783 INFO:tasks.workunit.client.0.smithi057.stdout:4/376: creat d14/d3c/f7d x:0 0 0 2024-04-25T22:42:14.785 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:14.780+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:14.785 INFO:tasks.workunit.client.0.smithi057.stdout:6/425: dread d2/f64 [0,4194304] 0 2024-04-25T22:42:14.785 INFO:tasks.workunit.client.0.smithi057.stdout:7/361: dwrite d6/f4b [0,4194304] 0 2024-04-25T22:42:14.785 INFO:tasks.workunit.client.0.smithi057.stdout:4/377: write d14/d3c/d44/f78 [3750407,111026] 0 2024-04-25T22:42:14.785 INFO:tasks.workunit.client.0.smithi057.stdout:2/450: symlink d1f/d36/l9a 0 2024-04-25T22:42:14.786 INFO:tasks.workunit.client.0.smithi057.stdout:2/451: fdatasync d1f/d36/d54/f95 0 2024-04-25T22:42:14.786 INFO:tasks.workunit.client.0.smithi057.stdout:4/378: symlink d14/d47/l7e 0 2024-04-25T22:42:14.787 INFO:tasks.workunit.client.0.smithi057.stdout:2/452: creat d1f/d4a/f9b x:0 0 0 2024-04-25T22:42:14.787 INFO:tasks.workunit.client.0.smithi057.stdout:4/379: mknod d14/d2f/d4c/c7f 0 2024-04-25T22:42:14.788 INFO:tasks.workunit.client.0.smithi057.stdout:2/453: truncate d1f/d4a/f81 456348 0 2024-04-25T22:42:14.789 INFO:tasks.workunit.client.0.smithi057.stdout:4/380: fsync d14/f16 0 2024-04-25T22:42:14.789 INFO:tasks.workunit.client.0.smithi057.stdout:0/427: dwrite d0/d3/d6/d14/d39/f76 [0,4194304] 0 2024-04-25T22:42:14.789 INFO:tasks.workunit.client.0.smithi057.stdout:2/454: mknod d1f/d21/d26/d63/d7f/c9c 0 2024-04-25T22:42:14.789 INFO:tasks.workunit.client.0.smithi057.stdout:0/428: mknod d0/d3/d6/d29/c92 0 2024-04-25T22:42:14.789 INFO:tasks.workunit.client.0.smithi057.stdout:4/381: chown d14/d47/d5e/d5f/l79 1308109 1 2024-04-25T22:42:14.790 INFO:tasks.workunit.client.0.smithi057.stdout:4/382: readlink d14/l2a 0 2024-04-25T22:42:14.790 INFO:tasks.workunit.client.0.smithi057.stdout:1/372: dread d7/dd/f46 [0,4194304] 0 2024-04-25T22:42:14.790 INFO:tasks.workunit.client.0.smithi057.stdout:2/455: mknod d1f/d21/d26/d63/c9d 0 2024-04-25T22:42:14.790 INFO:tasks.workunit.client.0.smithi057.stdout:0/429: creat d0/d3/d4d/f93 x:0 0 0 2024-04-25T22:42:14.791 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:14.791 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:14.791 INFO:tasks.workunit.client.0.smithi057.stdout:2/456: fsync d1f/d4a/f3b 0 2024-04-25T22:42:14.791 INFO:tasks.workunit.client.0.smithi057.stdout:0/430: write d0/d5/d53/f69 [1837867,66143] 0 2024-04-25T22:42:14.792 INFO:tasks.workunit.client.0.smithi057.stdout:0/431: fsync d0/d5/d53/f67 0 2024-04-25T22:42:14.792 INFO:tasks.workunit.client.0.smithi057.stdout:2/457: rename d1f/f42 to d1f/d21/d26/d63/d7f/d86/f9e 0 2024-04-25T22:42:14.792 INFO:tasks.workunit.client.0.smithi057.stdout:8/360: write d4/d5/d17/d19/f57 [295808,88438] 0 2024-04-25T22:42:14.793 INFO:tasks.workunit.client.0.smithi057.stdout:0/432: rmdir d0/d3/d6 39 2024-04-25T22:42:14.794 INFO:tasks.workunit.client.0.smithi057.stdout:2/458: write d1f/d21/d33/f5a [3355715,42490] 0 2024-04-25T22:42:14.794 INFO:tasks.workunit.client.0.smithi057.stdout:8/361: mknod d4/d5/d48/d5b/c8d 0 2024-04-25T22:42:14.794 INFO:tasks.workunit.client.0.smithi057.stdout:0/433: rename d0/d3/f15 to d0/d3/d4d/d87/d91/f94 0 2024-04-25T22:42:14.794 INFO:tasks.workunit.client.0.smithi057.stdout:8/362: fdatasync d4/f43 0 2024-04-25T22:42:14.795 INFO:tasks.workunit.client.0.smithi057.stdout:8/363: stat d4/db/d12/c2e 0 2024-04-25T22:42:14.795 INFO:tasks.workunit.client.0.smithi057.stdout:8/364: chown d4/d5/d17/l1a 1742084 1 2024-04-25T22:42:14.802 INFO:tasks.workunit.client.0.smithi057.stdout:8/365: dwrite d4/db/dd/f20 [0,4194304] 0 2024-04-25T22:42:14.802 INFO:tasks.workunit.client.0.smithi057.stdout:0/434: dwrite d0/d3/d6/d29/f89 [0,4194304] 0 2024-04-25T22:42:14.802 INFO:tasks.workunit.client.0.smithi057.stdout:0/435: dread - d0/d3/d6/d14/f72 zero size 2024-04-25T22:42:14.804 INFO:tasks.workunit.client.0.smithi057.stdout:0/436: write d0/f2b [956471,130064] 0 2024-04-25T22:42:14.809 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:14.809 INFO:tasks.workunit.client.0.smithi057.stdout:8/366: dwrite d4/db/dd/df/f13 [4194304,4194304] 0 2024-04-25T22:42:14.810 INFO:tasks.workunit.client.0.smithi057.stdout:8/367: creat d4/db/dd/d3a/f8e x:0 0 0 2024-04-25T22:42:14.811 INFO:tasks.workunit.client.0.smithi057.stdout:2/459: dread d1f/f76 [0,4194304] 0 2024-04-25T22:42:14.811 INFO:tasks.workunit.client.0.smithi057.stdout:8/368: creat d4/d5/d2f/f8f x:0 0 0 2024-04-25T22:42:14.813 INFO:tasks.workunit.client.0.smithi057.stdout:7/362: truncate d6/f54 1386949 0 2024-04-25T22:42:14.813 INFO:tasks.workunit.client.0.smithi057.stdout:6/426: truncate d2/f64 88391 0 2024-04-25T22:42:14.813 INFO:tasks.workunit.client.0.smithi057.stdout:6/427: sync 2024-04-25T22:42:14.813 INFO:tasks.workunit.client.0.smithi057.stdout:6/428: sync 2024-04-25T22:42:14.813 INFO:tasks.workunit.client.0.smithi057.stdout:1/373: write d7/dd/d16/d18/f23 [1048929,125164] 0 2024-04-25T22:42:14.813 INFO:tasks.workunit.client.0.smithi057.stdout:7/363: stat d6/f52 0 2024-04-25T22:42:14.814 INFO:tasks.workunit.client.0.smithi057.stdout:7/364: chown f1 20970 1 2024-04-25T22:42:14.814 INFO:tasks.workunit.client.0.smithi057.stdout:6/429: chown d2/f32 1 1 2024-04-25T22:42:14.815 INFO:tasks.workunit.client.0.smithi057.stdout:6/430: truncate d2/f2b 5186670 0 2024-04-25T22:42:14.816 INFO:tasks.workunit.client.0.smithi057.stdout:8/369: dread d4/d5/f33 [0,4194304] 0 2024-04-25T22:42:14.816 INFO:tasks.workunit.client.0.smithi057.stdout:7/365: fsync d6/d28/d4e/d1d/d51/f68 0 2024-04-25T22:42:14.817 INFO:tasks.workunit.client.0.smithi057.stdout:6/431: read d2/d19/d50/d1a/d22/f29 [3476374,120568] 0 2024-04-25T22:42:14.818 INFO:tasks.workunit.client.0.smithi057.stdout:2/460: dwrite d1f/f2a [0,4194304] 0 2024-04-25T22:42:14.818 INFO:tasks.workunit.client.0.smithi057.stdout:7/366: mknod d6/c7a 0 2024-04-25T22:42:14.818 INFO:tasks.workunit.client.0.smithi057.stdout:6/432: creat d2/d19/d50/d1a/d22/f82 x:0 0 0 2024-04-25T22:42:14.818 INFO:tasks.workunit.client.0.smithi057.stdout:7/367: readlink d6/d28/l2b 0 2024-04-25T22:42:14.819 INFO:tasks.workunit.client.0.smithi057.stdout:7/368: stat d6/d28/d4e/d1d/d51/d5f/c70 0 2024-04-25T22:42:14.819 INFO:tasks.workunit.client.0.smithi057.stdout:6/433: mkdir d2/d19/d50/d1a/d22/d31/d83 0 2024-04-25T22:42:14.820 INFO:tasks.workunit.client.0.smithi057.stdout:8/370: rename d4/d5/d48/d5b/f27 to d4/db/d89/f90 0 2024-04-25T22:42:14.820 INFO:tasks.workunit.client.0.smithi057.stdout:7/369: write d6/d28/d4e/d1d/d51/f6d [128312,34804] 0 2024-04-25T22:42:14.821 INFO:tasks.workunit.client.0.smithi057.stdout:8/371: rmdir d4/d85 0 2024-04-25T22:42:14.821 INFO:tasks.workunit.client.0.smithi057.stdout:9/389: dread d3/f1f [4194304,4194304] 0 2024-04-25T22:42:14.822 INFO:tasks.workunit.client.0.smithi057.stdout:7/370: fdatasync d6/d28/d4e/d1d/f2a 0 2024-04-25T22:42:14.822 INFO:tasks.workunit.client.0.smithi057.stdout:6/434: creat d2/d19/d26/d4f/f84 x:0 0 0 2024-04-25T22:42:14.823 INFO:tasks.workunit.client.0.smithi057.stdout:0/437: write d0/d3/f4 [1934985,56399] 0 2024-04-25T22:42:14.823 INFO:tasks.workunit.client.0.smithi057.stdout:9/390: dread - d3/d34/d42/d28/d62/d67/f74 zero size 2024-04-25T22:42:14.824 INFO:tasks.workunit.client.0.smithi057.stdout:6/435: mkdir d2/d19/d85 0 2024-04-25T22:42:14.824 INFO:tasks.workunit.client.0.smithi057.stdout:0/438: chown d0/f30 0 1 2024-04-25T22:42:14.824 INFO:tasks.workunit.client.0.smithi057.stdout:7/371: dread - d6/d28/d4e/d30/d46/f71 zero size 2024-04-25T22:42:14.824 INFO:tasks.workunit.client.0.smithi057.stdout:9/391: chown d3/d34/d42/c4a 173314 1 2024-04-25T22:42:14.824 INFO:tasks.workunit.client.0.smithi057.stdout:6/436: mkdir d2/d86 0 2024-04-25T22:42:14.825 INFO:tasks.workunit.client.0.smithi057.stdout:7/372: fsync d6/d28/d4e/d30/f36 0 2024-04-25T22:42:14.826 INFO:tasks.workunit.client.0.smithi057.stdout:0/439: write d0/d3/d4d/f93 [728636,131023] 0 2024-04-25T22:42:14.826 INFO:tasks.workunit.client.0.smithi057.stdout:2/461: dwrite f8 [0,4194304] 0 2024-04-25T22:42:14.827 INFO:tasks.workunit.client.0.smithi057.stdout:2/462: sync 2024-04-25T22:42:14.827 INFO:tasks.workunit.client.0.smithi057.stdout:3/360: dread d0/d11/f23 [0,4194304] 0 2024-04-25T22:42:14.827 INFO:tasks.workunit.client.0.smithi057.stdout:7/373: readlink d6/d28/d4e/d30/d46/l57 0 2024-04-25T22:42:14.828 INFO:tasks.workunit.client.0.smithi057.stdout:2/463: write d1f/d36/d54/f7a [134416,2748] 0 2024-04-25T22:42:14.829 INFO:tasks.workunit.client.0.smithi057.stdout:6/437: symlink d2/d19/d50/d1a/d22/d31/l87 0 2024-04-25T22:42:14.830 INFO:tasks.workunit.client.0.smithi057.stdout:8/372: dwrite d4/db/d12/f1c [0,4194304] 0 2024-04-25T22:42:14.831 INFO:tasks.workunit.client.0.smithi057.stdout:6/438: write d2/f2b [5173678,95930] 0 2024-04-25T22:42:14.831 INFO:tasks.workunit.client.0.smithi057.stdout:0/440: rename d0/d3/d4d/d87/f8d to d0/d49/f95 0 2024-04-25T22:42:14.833 INFO:tasks.workunit.client.0.smithi057.stdout:3/361: link d0/d4/d7/d46/d30/f5a d0/d4/d34/f77 0 2024-04-25T22:42:14.833 INFO:tasks.workunit.client.0.smithi057.stdout:7/374: rename d6/c63 to d6/d28/d4e/d1d/d51/c7b 0 2024-04-25T22:42:14.833 INFO:tasks.workunit.client.0.smithi057.stdout:8/373: symlink d4/d5/d21/l91 0 2024-04-25T22:42:14.833 INFO:tasks.workunit.client.0.smithi057.stdout:6/439: read d2/d19/d50/d1a/d22/f29 [2590279,118073] 0 2024-04-25T22:42:14.835 INFO:tasks.workunit.client.0.smithi057.stdout:5/408: dread d2/d2c/f2e [0,4194304] 0 2024-04-25T22:42:14.835 INFO:tasks.workunit.client.0.smithi057.stdout:3/362: truncate d0/d4/f57 766422 0 2024-04-25T22:42:14.836 INFO:tasks.workunit.client.0.smithi057.stdout:6/440: symlink d2/d19/d20/l88 0 2024-04-25T22:42:14.837 INFO:tasks.workunit.client.0.smithi057.stdout:8/374: dread - d4/d5/d48/d5b/f6b zero size 2024-04-25T22:42:14.837 INFO:tasks.workunit.client.0.smithi057.stdout:7/375: rename d6/cd to d6/d28/d4e/d30/d46/c7c 0 2024-04-25T22:42:14.839 INFO:tasks.workunit.client.0.smithi057.stdout:9/392: dwrite d3/f4e [4194304,4194304] 0 2024-04-25T22:42:14.839 INFO:tasks.workunit.client.0.smithi057.stdout:5/409: creat d2/d1c/d24/f86 x:0 0 0 2024-04-25T22:42:14.839 INFO:tasks.workunit.client.0.smithi057.stdout:3/363: creat d0/d4/d34/d3c/f78 x:0 0 0 2024-04-25T22:42:14.839 INFO:tasks.workunit.client.0.smithi057.stdout:6/441: fdatasync d2/d19/d49/d62/f70 0 2024-04-25T22:42:14.840 INFO:tasks.workunit.client.0.smithi057.stdout:5/410: write d2/d1c/f63 [268411,62558] 0 2024-04-25T22:42:14.844 INFO:tasks.workunit.client.0.smithi057.stdout:2/464: dwrite d1f/d21/d33/f5a [0,4194304] 0 2024-04-25T22:42:14.844 INFO:tasks.workunit.client.0.smithi057.stdout:0/441: dwrite d0/d3/f1c [0,4194304] 0 2024-04-25T22:42:14.846 INFO:tasks.workunit.client.0.smithi057.stdout:5/411: dread - d2/d1c/d24/f86 zero size 2024-04-25T22:42:14.848 INFO:tasks.workunit.client.0.smithi057.stdout:2/465: symlink d1f/d21/d26/d63/l9f 0 2024-04-25T22:42:14.849 INFO:tasks.workunit.client.0.smithi057.stdout:0/442: write d0/f9 [4780298,106750] 0 2024-04-25T22:42:14.850 INFO:tasks.workunit.client.0.smithi057.stdout:5/412: write d2/d1c/f63 [291617,119336] 0 2024-04-25T22:42:14.851 INFO:tasks.workunit.client.0.smithi057.stdout:4/383: dread d14/f22 [0,4194304] 0 2024-04-25T22:42:14.852 INFO:tasks.workunit.client.0.smithi057.stdout:3/364: dwrite d0/d4/d7/d26/f43 [4194304,4194304] 0 2024-04-25T22:42:14.853 INFO:tasks.workunit.client.0.smithi057.stdout:8/375: dwrite d4/d5/f4d [0,4194304] 0 2024-04-25T22:42:14.854 INFO:tasks.workunit.client.0.smithi057.stdout:9/393: dwrite d3/f66 [0,4194304] 0 2024-04-25T22:42:14.855 INFO:tasks.workunit.client.0.smithi057.stdout:2/466: unlink d1f/d34/d50/l74 0 2024-04-25T22:42:14.855 INFO:tasks.workunit.client.0.smithi057.stdout:7/376: dwrite d6/d28/f33 [0,4194304] 0 2024-04-25T22:42:14.855 INFO:tasks.workunit.client.0.smithi057.stdout:0/443: symlink d0/d3/d6/d83/l96 0 2024-04-25T22:42:14.857 INFO:tasks.workunit.client.0.smithi057.stdout:5/413: mkdir d2/d47/d87 0 2024-04-25T22:42:14.857 INFO:tasks.workunit.client.0.smithi057.stdout:4/384: fdatasync d14/f25 0 2024-04-25T22:42:14.857 INFO:tasks.workunit.client.0.smithi057.stdout:9/394: dread - d3/d34/d42/d28/d2d/f5c zero size 2024-04-25T22:42:14.857 INFO:tasks.workunit.client.0.smithi057.stdout:4/385: sync 2024-04-25T22:42:14.857 INFO:tasks.workunit.client.0.smithi057.stdout:3/365: creat d0/d5b/f79 x:0 0 0 2024-04-25T22:42:14.858 INFO:tasks.workunit.client.0.smithi057.stdout:7/377: unlink d6/c7a 0 2024-04-25T22:42:14.858 INFO:tasks.workunit.client.0.smithi057.stdout:2/467: write d1f/d34/f77 [1303147,50368] 0 2024-04-25T22:42:14.858 INFO:tasks.workunit.client.0.smithi057.stdout:0/444: read - d0/d3/d6/d29/f8a zero size 2024-04-25T22:42:14.858 INFO:tasks.workunit.client.0.smithi057.stdout:3/366: write d0/d4/f9 [4175807,62460] 0 2024-04-25T22:42:14.859 INFO:tasks.workunit.client.0.smithi057.stdout:8/376: rename d4/d5/d48 to d4/d5/d17/d19/d35/d83/d92 0 2024-04-25T22:42:14.859 INFO:tasks.workunit.client.0.smithi057.stdout:7/378: mkdir d6/d28/d4e/d1d/d51/d5f/d7d 0 2024-04-25T22:42:14.859 INFO:tasks.workunit.client.0.smithi057.stdout:5/414: mknod d2/d1c/d24/d3d/d50/d83/c88 0 2024-04-25T22:42:14.859 INFO:tasks.workunit.client.0.smithi057.stdout:2/468: fdatasync d1f/d36/f7b 0 2024-04-25T22:42:14.859 INFO:tasks.workunit.client.0.smithi057.stdout:0/445: unlink d0/d5/l86 0 2024-04-25T22:42:14.860 INFO:tasks.workunit.client.0.smithi057.stdout:4/386: link d14/l2a d14/d2f/d4c/d5b/l80 0 2024-04-25T22:42:14.860 INFO:tasks.workunit.client.0.smithi057.stdout:1/374: dread d7/dd/d16/f1e [0,4194304] 0 2024-04-25T22:42:14.860 INFO:tasks.workunit.client.0.smithi057.stdout:7/379: symlink d6/d28/d4e/d30/l7e 0 2024-04-25T22:42:14.860 INFO:tasks.workunit.client.0.smithi057.stdout:8/377: symlink d4/db/dd/d3a/d71/l93 0 2024-04-25T22:42:14.860 INFO:tasks.workunit.client.0.smithi057.stdout:3/367: write d0/d11/f1c [4105358,27365] 0 2024-04-25T22:42:14.861 INFO:tasks.workunit.client.0.smithi057.stdout:0/446: write d0/d49/f48 [3015396,60767] 0 2024-04-25T22:42:14.861 INFO:tasks.workunit.client.0.smithi057.stdout:1/375: chown d7/d65 5732 1 2024-04-25T22:42:14.861 INFO:tasks.workunit.client.0.smithi057.stdout:4/387: chown ff 26284591 1 2024-04-25T22:42:14.861 INFO:tasks.workunit.client.0.smithi057.stdout:4/388: sync 2024-04-25T22:42:14.861 INFO:tasks.workunit.client.0.smithi057.stdout:2/469: write d1f/d21/d33/f6e [2339325,86474] 0 2024-04-25T22:42:14.863 INFO:tasks.workunit.client.0.smithi057.stdout:0/447: mkdir d0/d49/d97 0 2024-04-25T22:42:14.863 INFO:tasks.workunit.client.0.smithi057.stdout:8/378: rmdir d4/db/d12 39 2024-04-25T22:42:14.864 INFO:tasks.workunit.client.0.smithi057.stdout:3/368: mkdir d0/d4/d7/d46/d30/d7a 0 2024-04-25T22:42:14.864 INFO:tasks.workunit.client.0.smithi057.stdout:2/470: symlink d1f/d4a/d4d/la0 0 2024-04-25T22:42:14.864 INFO:tasks.workunit.client.0.smithi057.stdout:4/389: truncate d14/d2f/d4c/d5b/f6b 4087352 0 2024-04-25T22:42:14.864 INFO:tasks.workunit.client.0.smithi057.stdout:4/390: sync 2024-04-25T22:42:14.864 INFO:tasks.workunit.client.0.smithi057.stdout:3/369: readlink d0/d4/d7/l2e 0 2024-04-25T22:42:14.865 INFO:tasks.workunit.client.0.smithi057.stdout:9/395: link d3/d34/d42/d28/d39/d54/c69 d3/d34/d42/d28/d62/d67/d6e/d7c/c7e 0 2024-04-25T22:42:14.865 INFO:tasks.workunit.client.0.smithi057.stdout:0/448: write d0/d5/f32 [1834584,23915] 0 2024-04-25T22:42:14.865 INFO:tasks.workunit.client.0.smithi057.stdout:7/380: getdents d6/d28/d4e/d1d/d51 0 2024-04-25T22:42:14.865 INFO:tasks.workunit.client.0.smithi057.stdout:3/370: fdatasync d0/d4/d7/d46/d30/f65 0 2024-04-25T22:42:14.866 INFO:tasks.workunit.client.0.smithi057.stdout:7/381: stat d6/c8 0 2024-04-25T22:42:14.866 INFO:tasks.workunit.client.0.smithi057.stdout:4/391: creat d14/d47/d5e/f81 x:0 0 0 2024-04-25T22:42:14.866 INFO:tasks.workunit.client.0.smithi057.stdout:0/449: mknod d0/d49/d97/c98 0 2024-04-25T22:42:14.867 INFO:tasks.workunit.client.0.smithi057.stdout:9/396: rename d3/l15 to d3/d34/d42/d28/d65/l7f 0 2024-04-25T22:42:14.867 INFO:tasks.workunit.client.0.smithi057.stdout:4/392: readlink d14/l2d 0 2024-04-25T22:42:14.867 INFO:tasks.workunit.client.0.smithi057.stdout:3/371: chown d0/d4/d7/d26/c45 7 1 2024-04-25T22:42:14.867 INFO:tasks.workunit.client.0.smithi057.stdout:2/471: mkdir d1f/d36/d60/da1 0 2024-04-25T22:42:14.867 INFO:tasks.workunit.client.0.smithi057.stdout:4/393: readlink d14/d3c/d44/l45 0 2024-04-25T22:42:14.867 INFO:tasks.workunit.client.0.smithi057.stdout:7/382: creat d6/d28/d4e/d1d/f7f x:0 0 0 2024-04-25T22:42:14.868 INFO:tasks.workunit.client.0.smithi057.stdout:3/372: chown d0/d4/d7/d46/f3a 3251115 1 2024-04-25T22:42:14.868 INFO:tasks.workunit.client.0.smithi057.stdout:2/472: chown d1f/d4a/d4d/la0 0 1 2024-04-25T22:42:14.868 INFO:tasks.workunit.client.0.smithi057.stdout:9/397: creat d3/d34/d42/d28/d62/d67/d6e/f80 x:0 0 0 2024-04-25T22:42:14.868 INFO:tasks.workunit.client.0.smithi057.stdout:4/394: mkdir d14/d2f/d82 0 2024-04-25T22:42:14.868 INFO:tasks.workunit.client.0.smithi057.stdout:7/383: chown d6/d28/d4e/d1d/l58 38 1 2024-04-25T22:42:14.869 INFO:tasks.workunit.client.0.smithi057.stdout:3/373: mkdir d0/d4/d7b 0 2024-04-25T22:42:14.869 INFO:tasks.workunit.client.0.smithi057.stdout:2/473: mknod d1f/d21/d26/d63/ca2 0 2024-04-25T22:42:14.869 INFO:tasks.workunit.client.0.smithi057.stdout:4/395: truncate d14/f61 427768 0 2024-04-25T22:42:14.869 INFO:tasks.workunit.client.0.smithi057.stdout:9/398: dread - d3/d34/d42/d28/d62/d67/d6e/f77 zero size 2024-04-25T22:42:14.869 INFO:tasks.workunit.client.0.smithi057.stdout:3/374: fdatasync d0/d11/f3b 0 2024-04-25T22:42:14.869 INFO:tasks.workunit.client.0.smithi057.stdout:7/384: creat d6/d28/d4e/d1d/d51/d5f/f80 x:0 0 0 2024-04-25T22:42:14.870 INFO:tasks.workunit.client.0.smithi057.stdout:4/396: fdatasync d14/f23 0 2024-04-25T22:42:14.870 INFO:tasks.workunit.client.0.smithi057.stdout:9/399: symlink d3/d34/d42/l81 0 2024-04-25T22:42:14.870 INFO:tasks.workunit.client.0.smithi057.stdout:2/474: rename l10 to d1f/d21/la3 0 2024-04-25T22:42:14.870 INFO:tasks.workunit.client.0.smithi057.stdout:4/397: chown fc 6 1 2024-04-25T22:42:14.870 INFO:tasks.workunit.client.0.smithi057.stdout:3/375: mkdir d0/d4/d7b/d7c 0 2024-04-25T22:42:14.871 INFO:tasks.workunit.client.0.smithi057.stdout:9/400: write d3/d34/f73 [30697,130278] 0 2024-04-25T22:42:14.871 INFO:tasks.workunit.client.0.smithi057.stdout:4/398: chown d14/l19 1554 1 2024-04-25T22:42:14.871 INFO:tasks.workunit.client.0.smithi057.stdout:2/475: creat d1f/d21/d26/d63/fa4 x:0 0 0 2024-04-25T22:42:14.871 INFO:tasks.workunit.client.0.smithi057.stdout:4/399: readlink d14/l15 0 2024-04-25T22:42:14.871 INFO:tasks.workunit.client.0.smithi057.stdout:3/376: mkdir d0/d4/d7/d46/d30/d7d 0 2024-04-25T22:42:14.872 INFO:tasks.workunit.client.0.smithi057.stdout:2/476: rename d1f/f58 to d1f/d34/d50/fa5 0 2024-04-25T22:42:14.872 INFO:tasks.workunit.client.0.smithi057.stdout:4/400: truncate d14/d2f/f52 970758 0 2024-04-25T22:42:14.872 INFO:tasks.workunit.client.0.smithi057.stdout:3/377: creat d0/d4/d7/f7e x:0 0 0 2024-04-25T22:42:14.874 INFO:tasks.workunit.client.0.smithi057.stdout:7/385: read d6/d28/d4e/d30/f36 [421175,115959] 0 2024-04-25T22:42:14.877 INFO:tasks.workunit.client.0.smithi057.stdout:4/401: dread d14/f22 [0,4194304] 0 2024-04-25T22:42:14.877 INFO:tasks.workunit.client.0.smithi057.stdout:7/386: write d6/d28/d4e/d1d/f2a [1977941,78963] 0 2024-04-25T22:42:14.878 INFO:tasks.workunit.client.0.smithi057.stdout:4/402: readlink d14/d3c/l3e 0 2024-04-25T22:42:14.881 INFO:tasks.workunit.client.0.smithi057.stdout:2/477: dwrite f0 [0,4194304] 0 2024-04-25T22:42:14.882 INFO:tasks.workunit.client.0.smithi057.stdout:5/415: dwrite d2/d1c/d46/f84 [0,4194304] 0 2024-04-25T22:42:14.883 INFO:tasks.workunit.client.0.smithi057.stdout:1/376: dwrite d7/dd/d26/f47 [0,4194304] 0 2024-04-25T22:42:14.883 INFO:tasks.workunit.client.0.smithi057.stdout:2/478: chown d1f/d34/l84 0 1 2024-04-25T22:42:14.884 INFO:tasks.workunit.client.0.smithi057.stdout:9/401: dwrite d3/d34/d42/d28/d62/d67/f71 [0,4194304] 0 2024-04-25T22:42:14.885 INFO:tasks.workunit.client.0.smithi057.stdout:1/377: write d7/d65/d6a/f6d [323442,78323] 0 2024-04-25T22:42:14.885 INFO:tasks.workunit.client.0.smithi057.stdout:9/402: chown d3/d34/d42/d28/d62 1841 1 2024-04-25T22:42:14.885 INFO:tasks.workunit.client.0.smithi057.stdout:4/403: symlink d14/d5a/l83 0 2024-04-25T22:42:14.886 INFO:tasks.workunit.client.0.smithi057.stdout:1/378: readlink d7/dd/d16/d18/l2f 0 2024-04-25T22:42:14.886 INFO:tasks.workunit.client.0.smithi057.stdout:4/404: chown d14/d2f/d4c/l6d 66687737 1 2024-04-25T22:42:14.887 INFO:tasks.workunit.client.0.smithi057.stdout:8/379: fdatasync d4/d5/f4d 0 2024-04-25T22:42:14.887 INFO:tasks.workunit.client.0.smithi057.stdout:1/379: rmdir d7/d65/d78 0 2024-04-25T22:42:14.888 INFO:tasks.workunit.client.0.smithi057.stdout:1/380: sync 2024-04-25T22:42:14.888 INFO:tasks.workunit.client.0.smithi057.stdout:4/405: rename d14/d5a/l7a to d14/d47/d5e/d5f/l84 0 2024-04-25T22:42:14.889 INFO:tasks.workunit.client.0.smithi057.stdout:4/406: rmdir d14/d3d 39 2024-04-25T22:42:14.889 INFO:tasks.workunit.client.0.smithi057.stdout:7/387: dwrite d6/d28/d4e/d1d/d5d/f5e [0,4194304] 0 2024-04-25T22:42:14.890 INFO:tasks.workunit.client.0.smithi057.stdout:1/381: write d7/dd/d40/d41/d45/f5d [1101006,1680] 0 2024-04-25T22:42:14.890 INFO:tasks.workunit.client.0.smithi057.stdout:4/407: write d14/d3c/f7d [993193,37861] 0 2024-04-25T22:42:14.891 INFO:tasks.workunit.client.0.smithi057.stdout:4/408: stat d14/d2f/d4c/d5b 0 2024-04-25T22:42:14.891 INFO:tasks.workunit.client.0.smithi057.stdout:1/382: write d7/dd/d16/d18/d31/f79 [455832,6339] 0 2024-04-25T22:42:14.892 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:42:14.893 INFO:tasks.workunit.client.0.smithi057.stdout:9/403: dwrite d3/d34/d42/d28/f55 [0,4194304] 0 2024-04-25T22:42:14.893 INFO:tasks.workunit.client.0.smithi057.stdout:4/409: mkdir d14/d5a/d67/d70/d85 0 2024-04-25T22:42:14.895 INFO:tasks.workunit.client.0.smithi057.stdout:1/383: getdents d7/dd/d16/d18 0 2024-04-25T22:42:14.896 INFO:tasks.workunit.client.0.smithi057.stdout:4/410: mkdir d14/d2f/d86 0 2024-04-25T22:42:14.897 INFO:tasks.workunit.client.0.smithi057.stdout:4/411: symlink d14/d2f/d86/l87 0 2024-04-25T22:42:14.897 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:14.896+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:14.897 INFO:tasks.workunit.client.0.smithi057.stdout:7/388: dwrite d6/f26 [0,4194304] 0 2024-04-25T22:42:14.899 INFO:tasks.workunit.client.0.smithi057.stdout:7/389: creat d6/d28/f81 x:0 0 0 2024-04-25T22:42:14.899 INFO:tasks.workunit.client.0.smithi057.stdout:4/412: link f9 d14/d47/d62/f88 0 2024-04-25T22:42:14.900 INFO:tasks.workunit.client.0.smithi057.stdout:4/413: sync 2024-04-25T22:42:14.903 INFO:tasks.workunit.client.0.smithi057.stdout:9/404: dwrite d3/d34/d42/d28/f3b [0,4194304] 0 2024-04-25T22:42:14.903 INFO:tasks.workunit.client.0.smithi057.stdout:4/414: mkdir d14/d3d/d89 0 2024-04-25T22:42:14.903 INFO:tasks.workunit.client.0.smithi057.stdout:7/390: creat d6/d28/d4e/d1d/d51/d5f/f82 x:0 0 0 2024-04-25T22:42:14.904 INFO:tasks.workunit.client.0.smithi057.stdout:9/405: creat d3/d34/d42/d28/d62/d67/f82 x:0 0 0 2024-04-25T22:42:14.904 INFO:tasks.workunit.client.0.smithi057.stdout:7/391: unlink d6/d28/d4e/d1d/l34 0 2024-04-25T22:42:14.904 INFO:tasks.workunit.client.0.smithi057.stdout:4/415: link d14/d2f/c49 d14/d5a/d67/d70/c8a 0 2024-04-25T22:42:14.905 INFO:tasks.workunit.client.0.smithi057.stdout:7/392: write d6/f26 [5067615,75284] 0 2024-04-25T22:42:14.906 INFO:tasks.workunit.client.0.smithi057.stdout:7/393: rmdir d6/d28 39 2024-04-25T22:42:14.907 INFO:tasks.workunit.client.0.smithi057.stdout:7/394: write d6/f15 [3501896,54305] 0 2024-04-25T22:42:14.907 INFO:tasks.workunit.client.0.smithi057.stdout:1/384: dwrite d7/dd/d16/d24/f38 [0,4194304] 0 2024-04-25T22:42:14.909 INFO:tasks.workunit.client.0.smithi057.stdout:1/385: write d7/dd/d16/d24/d63/f66 [554481,86945] 0 2024-04-25T22:42:14.917 INFO:tasks.workunit.client.0.smithi057.stdout:4/416: truncate d14/d3c/d44/f46 2490994 0 2024-04-25T22:42:14.919 INFO:tasks.workunit.client.0.smithi057.stdout:1/386: dwrite d7/dd/d16/f7e [0,4194304] 0 2024-04-25T22:42:14.920 INFO:tasks.workunit.client.0.smithi057.stdout:6/442: dread d2/d19/d50/d1a/d22/f53 [0,4194304] 0 2024-04-25T22:42:14.920 INFO:tasks.workunit.client.0.smithi057.stdout:3/378: dread d0/f61 [0,4194304] 0 2024-04-25T22:42:14.920 INFO:tasks.workunit.client.0.smithi057.stdout:1/387: mkdir d7/d65/d7f 0 2024-04-25T22:42:14.921 INFO:tasks.workunit.client.0.smithi057.stdout:3/379: truncate d0/d4/d34/f47 296322 0 2024-04-25T22:42:14.922 INFO:tasks.workunit.client.0.smithi057.stdout:0/450: dread d0/d5/f32 [0,4194304] 0 2024-04-25T22:42:14.923 INFO:tasks.workunit.client.0.smithi057.stdout:1/388: link d7/dd/d16/d18/l2f d7/dd/l80 0 2024-04-25T22:42:14.924 INFO:tasks.workunit.client.0.smithi057.stdout:1/389: dread - d7/dd/d40/d41/f4b zero size 2024-04-25T22:42:14.925 INFO:tasks.workunit.client.0.smithi057.stdout:1/390: chown d7/dd/d16/d24/f54 2 1 2024-04-25T22:42:14.925 INFO:tasks.workunit.client.0.smithi057.stdout:0/451: link d0/d3/d6/f59 d0/d3/d6/d29/f99 0 2024-04-25T22:42:14.925 INFO:tasks.workunit.client.0.smithi057.stdout:4/417: dwrite d14/f25 [0,4194304] 0 2024-04-25T22:42:14.925 INFO:tasks.workunit.client.0.smithi057.stdout:1/391: creat d7/d4e/f81 x:0 0 0 2024-04-25T22:42:14.926 INFO:tasks.workunit.client.0.smithi057.stdout:0/452: mknod d0/d3/d88/c9a 0 2024-04-25T22:42:14.926 INFO:tasks.workunit.client.0.smithi057.stdout:4/418: fdatasync d14/d3c/f7d 0 2024-04-25T22:42:14.926 INFO:tasks.workunit.client.0.smithi057.stdout:1/392: rename d7/d65 to d7/d65/d6a/d82 22 2024-04-25T22:42:14.926 INFO:tasks.workunit.client.0.smithi057.stdout:4/419: read - d14/d47/f7c zero size 2024-04-25T22:42:14.927 INFO:tasks.workunit.client.0.smithi057.stdout:0/453: symlink d0/d3/d6/d78/l9b 0 2024-04-25T22:42:14.927 INFO:tasks.workunit.client.0.smithi057.stdout:4/420: unlink d14/d2f/c34 0 2024-04-25T22:42:14.928 INFO:tasks.workunit.client.0.smithi057.stdout:0/454: creat d0/d3/d4d/f9c x:0 0 0 2024-04-25T22:42:14.928 INFO:tasks.workunit.client.0.smithi057.stdout:4/421: fsync d14/d2f/f7b 0 2024-04-25T22:42:14.928 INFO:tasks.workunit.client.0.smithi057.stdout:1/393: rename d7/dd/d16/d18/l1b to d7/dd/d40/l83 0 2024-04-25T22:42:14.928 INFO:tasks.workunit.client.0.smithi057.stdout:1/394: chown d7/d65/d6a 1046061337 1 2024-04-25T22:42:14.928 INFO:tasks.workunit.client.0.smithi057.stdout:4/422: fdatasync d14/d47/f7c 0 2024-04-25T22:42:14.929 INFO:tasks.workunit.client.0.smithi057.stdout:0/455: creat d0/d5/d53/f9d x:0 0 0 2024-04-25T22:42:14.929 INFO:tasks.workunit.client.0.smithi057.stdout:4/423: readlink d14/l33 0 2024-04-25T22:42:14.929 INFO:tasks.workunit.client.0.smithi057.stdout:1/395: write d7/dd/d16/d24/f2e [1781620,97390] 0 2024-04-25T22:42:14.930 INFO:tasks.workunit.client.0.smithi057.stdout:4/424: creat d14/d3c/d44/f8b x:0 0 0 2024-04-25T22:42:14.930 INFO:tasks.workunit.client.0.smithi057.stdout:1/396: read - d7/dd/d40/f60 zero size 2024-04-25T22:42:14.931 INFO:tasks.workunit.client.0.smithi057.stdout:6/443: truncate d2/d19/d50/d1a/f42 3933151 0 2024-04-25T22:42:14.931 INFO:tasks.workunit.client.0.smithi057.stdout:4/425: symlink d14/d47/l8c 0 2024-04-25T22:42:14.932 INFO:tasks.workunit.client.0.smithi057.stdout:1/397: getdents d7 0 2024-04-25T22:42:14.933 INFO:tasks.workunit.client.0.smithi057.stdout:6/444: link d2/d19/d26/d63/f66 d2/d19/d20/d61/f89 0 2024-04-25T22:42:14.934 INFO:tasks.workunit.client.0.smithi057.stdout:1/398: fdatasync d7/dd/d16/d24/f77 0 2024-04-25T22:42:14.935 INFO:tasks.workunit.client.0.smithi057.stdout:6/445: unlink d2/d19/d26/c7f 0 2024-04-25T22:42:14.935 INFO:tasks.workunit.client.0.smithi057.stdout:1/399: symlink d7/dd/d26/l84 0 2024-04-25T22:42:14.935 INFO:tasks.workunit.client.0.smithi057.stdout:3/380: dread d0/d4/d7/f69 [0,4194304] 0 2024-04-25T22:42:14.936 INFO:tasks.workunit.client.0.smithi057.stdout:4/426: dread d14/f25 [0,4194304] 0 2024-04-25T22:42:14.936 INFO:tasks.workunit.client.0.smithi057.stdout:6/446: creat d2/d19/d50/f8a x:0 0 0 2024-04-25T22:42:14.936 INFO:tasks.workunit.client.0.smithi057.stdout:1/400: mknod d7/dd/d40/d41/d6b/c85 0 2024-04-25T22:42:14.936 INFO:tasks.workunit.client.0.smithi057.stdout:4/427: truncate d14/f23 2296880 0 2024-04-25T22:42:14.937 INFO:tasks.workunit.client.0.smithi057.stdout:3/381: rmdir d0/d4/d7/d46/d30/d7d 0 2024-04-25T22:42:14.937 INFO:tasks.workunit.client.0.smithi057.stdout:1/401: unlink d7/dd/d26/f50 0 2024-04-25T22:42:14.937 INFO:tasks.workunit.client.0.smithi057.stdout:4/428: creat d14/d47/d5e/d5f/f8d x:0 0 0 2024-04-25T22:42:14.939 INFO:tasks.workunit.client.0.smithi057.stdout:4/429: write d14/f30 [321185,76390] 0 2024-04-25T22:42:14.940 INFO:tasks.workunit.client.0.smithi057.stdout:1/402: chown d7/d65/d6a/f6d 13 1 2024-04-25T22:42:14.940 INFO:tasks.workunit.client.0.smithi057.stdout:4/430: creat d14/d47/d5e/f8e x:0 0 0 2024-04-25T22:42:14.941 INFO:tasks.workunit.client.0.smithi057.stdout:4/431: link d14/d3c/f75 d14/d2f/d4c/d5b/f8f 0 2024-04-25T22:42:14.942 INFO:tasks.workunit.client.0.smithi057.stdout:4/432: read - d14/d47/f7c zero size 2024-04-25T22:42:14.942 INFO:tasks.workunit.client.0.smithi057.stdout:4/433: dread - d14/d2f/f7b zero size 2024-04-25T22:42:14.942 INFO:tasks.workunit.client.0.smithi057.stdout:4/434: chown d14/d2f/d4c/d5b 589785336 1 2024-04-25T22:42:14.944 INFO:tasks.workunit.client.0.smithi057.stdout:4/435: unlink d14/d2f/c41 0 2024-04-25T22:42:14.945 INFO:tasks.workunit.client.0.smithi057.stdout:8/380: dread d4/d5/d17/d19/d35/d83/d92/f55 [0,4194304] 0 2024-04-25T22:42:14.947 INFO:tasks.workunit.client.0.smithi057.stdout:4/436: symlink d14/d2f/d82/l90 0 2024-04-25T22:42:14.948 INFO:tasks.workunit.client.0.smithi057.stdout:8/381: truncate d4/f52 430772 0 2024-04-25T22:42:14.948 INFO:tasks.workunit.client.0.smithi057.stdout:4/437: write d14/f28 [3428239,129142] 0 2024-04-25T22:42:14.949 INFO:tasks.workunit.client.0.smithi057.stdout:5/416: dread d2/d1c/d46/f73 [0,4194304] 0 2024-04-25T22:42:14.949 INFO:tasks.workunit.client.0.smithi057.stdout:1/403: dwrite d7/dd/f14 [4194304,4194304] 0 2024-04-25T22:42:14.950 INFO:tasks.workunit.client.0.smithi057.stdout:1/404: mknod d7/d65/c86 0 2024-04-25T22:42:14.950 INFO:tasks.workunit.client.0.smithi057.stdout:5/417: fsync d2/d1c/d46/f73 0 2024-04-25T22:42:14.952 INFO:tasks.workunit.client.0.smithi057.stdout:1/405: creat d7/dd/d40/d41/d45/f87 x:0 0 0 2024-04-25T22:42:14.952 INFO:tasks.workunit.client.0.smithi057.stdout:4/438: link d14/d3c/d44/f78 d14/d5a/d67/d70/f91 0 2024-04-25T22:42:14.953 INFO:tasks.workunit.client.0.smithi057.stdout:5/418: link d2/d6/f64 d2/d1c/d46/f89 0 2024-04-25T22:42:14.954 INFO:tasks.workunit.client.0.smithi057.stdout:6/447: dwrite d2/d19/d26/d4f/f56 [0,4194304] 0 2024-04-25T22:42:14.955 INFO:tasks.workunit.client.0.smithi057.stdout:2/479: dread d1f/d4a/f4b [0,4194304] 0 2024-04-25T22:42:14.955 INFO:tasks.workunit.client.0.smithi057.stdout:4/439: creat d14/d47/d5e/f92 x:0 0 0 2024-04-25T22:42:14.956 INFO:tasks.workunit.client.0.smithi057.stdout:6/448: read d2/f64 [48861,72486] 0 2024-04-25T22:42:14.956 INFO:tasks.workunit.client.0.smithi057.stdout:8/382: truncate d4/d5/d17/d19/d35/d83/d92/f55 239852 0 2024-04-25T22:42:14.957 INFO:tasks.workunit.client.0.smithi057.stdout:2/480: rename l19 to d1f/d21/d26/d5c/la6 0 2024-04-25T22:42:14.957 INFO:tasks.workunit.client.0.smithi057.stdout:5/419: link d2/d1c/d24/d3d/l78 d2/d1c/d24/d3d/d50/l8a 0 2024-04-25T22:42:14.957 INFO:tasks.workunit.client.0.smithi057.stdout:6/449: mknod d2/c8b 0 2024-04-25T22:42:14.957 INFO:tasks.workunit.client.0.smithi057.stdout:4/440: link d14/f28 d14/d2f/d4c/d5b/f93 0 2024-04-25T22:42:14.958 INFO:tasks.workunit.client.0.smithi057.stdout:8/383: mkdir d4/db/dd/d3a/d94 0 2024-04-25T22:42:14.959 INFO:tasks.workunit.client.0.smithi057.stdout:5/420: mknod d2/d1c/d24/d74/c8b 0 2024-04-25T22:42:14.959 INFO:tasks.workunit.client.0.smithi057.stdout:9/406: dread d3/f29 [0,4194304] 0 2024-04-25T22:42:14.959 INFO:tasks.workunit.client.0.smithi057.stdout:4/441: mknod d14/d5a/d67/d70/c94 0 2024-04-25T22:42:14.960 INFO:tasks.workunit.client.0.smithi057.stdout:5/421: creat d2/d47/f8c x:0 0 0 2024-04-25T22:42:14.961 INFO:tasks.workunit.client.0.smithi057.stdout:5/422: chown d2/c21 12 1 2024-04-25T22:42:14.961 INFO:tasks.workunit.client.0.smithi057.stdout:7/395: dread d6/d28/d4e/d30/f56 [0,4194304] 0 2024-04-25T22:42:14.961 INFO:tasks.workunit.client.0.smithi057.stdout:9/407: chown d3/d34/d42/d28/d62/d67/d6e/f80 9673 1 2024-04-25T22:42:14.963 INFO:tasks.workunit.client.0.smithi057.stdout:9/408: mkdir d3/d34/d42/d5e/d83 0 2024-04-25T22:42:14.963 INFO:tasks.workunit.client.0.smithi057.stdout:7/396: rename d6/f26 to d6/d28/d4e/d1d/d51/f83 0 2024-04-25T22:42:14.964 INFO:tasks.workunit.client.0.smithi057.stdout:9/409: chown d3/f1f 233607 1 2024-04-25T22:42:14.965 INFO:tasks.workunit.client.0.smithi057.stdout:7/397: chown d6/l6e 6993068 1 2024-04-25T22:42:14.965 INFO:tasks.workunit.client.0.smithi057.stdout:6/450: dread d2/f2b [4194304,4194304] 0 2024-04-25T22:42:14.965 INFO:tasks.workunit.client.0.smithi057.stdout:2/481: dwrite fe [0,4194304] 0 2024-04-25T22:42:14.967 INFO:tasks.workunit.client.0.smithi057.stdout:6/451: write d2/d19/d26/d4f/f6d [37770,105697] 0 2024-04-25T22:42:14.967 INFO:tasks.workunit.client.0.smithi057.stdout:2/482: rmdir d1f/d21/d26/d63/d7f 39 2024-04-25T22:42:14.968 INFO:tasks.workunit.client.0.smithi057.stdout:9/410: stat d3/d34/d42/d28/d62/d67/d6e/c78 0 2024-04-25T22:42:14.969 INFO:tasks.workunit.client.0.smithi057.stdout:9/411: symlink d3/l84 0 2024-04-25T22:42:14.969 INFO:tasks.workunit.client.0.smithi057.stdout:8/384: dwrite d4/db/dd/f2b [0,4194304] 0 2024-04-25T22:42:14.971 INFO:tasks.workunit.client.0.smithi057.stdout:9/412: write d3/d34/d42/d28/f3b [60353,54777] 0 2024-04-25T22:42:14.971 INFO:tasks.workunit.client.0.smithi057.stdout:2/483: symlink d1f/d34/d50/la7 0 2024-04-25T22:42:14.972 INFO:tasks.workunit.client.0.smithi057.stdout:8/385: creat d4/db/d72/f95 x:0 0 0 2024-04-25T22:42:14.972 INFO:tasks.workunit.client.0.smithi057.stdout:6/452: mknod d2/d19/d50/d1a/d22/d31/d83/c8c 0 2024-04-25T22:42:14.972 INFO:tasks.workunit.client.0.smithi057.stdout:9/413: chown d3/d34/d42/d28/d39 1 1 2024-04-25T22:42:14.972 INFO:tasks.workunit.client.0.smithi057.stdout:7/398: dwrite d6/f27 [0,4194304] 0 2024-04-25T22:42:14.974 INFO:tasks.workunit.client.0.smithi057.stdout:8/386: getdents d4/db/dd/d3a/d5c 0 2024-04-25T22:42:14.974 INFO:tasks.workunit.client.0.smithi057.stdout:9/414: creat d3/d34/d42/d28/f85 x:0 0 0 2024-04-25T22:42:14.974 INFO:tasks.workunit.client.0.smithi057.stdout:6/453: link d2/d59/l5d d2/d19/l8d 0 2024-04-25T22:42:14.974 INFO:tasks.workunit.client.0.smithi057.stdout:7/399: mkdir d6/d28/d4e/d1d/d59/d84 0 2024-04-25T22:42:14.975 INFO:tasks.workunit.client.0.smithi057.stdout:7/400: chown d6/d28 226 1 2024-04-25T22:42:14.975 INFO:tasks.workunit.client.0.smithi057.stdout:9/415: stat d3/d34/d42/f2b 0 2024-04-25T22:42:14.975 INFO:tasks.workunit.client.0.smithi057.stdout:6/454: chown d2/d19/d26/d4f 288857 1 2024-04-25T22:42:14.975 INFO:tasks.workunit.client.0.smithi057.stdout:7/401: write d6/d28/f42 [1355963,39551] 0 2024-04-25T22:42:14.975 INFO:tasks.workunit.client.0.smithi057.stdout:6/455: fsync d2/d19/d50/ff 0 2024-04-25T22:42:14.975 INFO:tasks.workunit.client.0.smithi057.stdout:8/387: rename d4/db/dd/f67 to d4/d5/d17/d19/d35/d83/d92/f96 0 2024-04-25T22:42:14.976 INFO:tasks.workunit.client.0.smithi057.stdout:7/402: chown d6/d28/f81 6647454 1 2024-04-25T22:42:14.977 INFO:tasks.workunit.client.0.smithi057.stdout:9/416: link d3/d34/d42/d28/c75 d3/d34/d42/d28/d62/d67/d6e/c86 0 2024-04-25T22:42:14.980 INFO:tasks.workunit.client.0.smithi057.stdout:2/484: read f16 [120805,3724] 0 2024-04-25T22:42:14.981 INFO:tasks.workunit.client.0.smithi057.stdout:2/485: creat d1f/d36/d60/da1/fa8 x:0 0 0 2024-04-25T22:42:14.982 INFO:tasks.workunit.client.0.smithi057.stdout:8/388: dwrite d4/db/d12/f1c [4194304,4194304] 0 2024-04-25T22:42:14.982 INFO:tasks.workunit.client.0.smithi057.stdout:7/403: write d6/f9 [727494,105677] 0 2024-04-25T22:42:14.984 INFO:tasks.workunit.client.0.smithi057.stdout:2/486: getdents d1f/d21 0 2024-04-25T22:42:14.984 INFO:tasks.workunit.client.0.smithi057.stdout:7/404: readlink d6/d28/d4e/d1d/d51/d5f/l67 0 2024-04-25T22:42:14.984 INFO:tasks.workunit.client.0.smithi057.stdout:8/389: creat d4/db/dd/d3a/d5c/d76/f97 x:0 0 0 2024-04-25T22:42:14.985 INFO:tasks.workunit.client.0.smithi057.stdout:7/405: rmdir d6/d28/d4e/d30/d60/d6f 39 2024-04-25T22:42:14.985 INFO:tasks.workunit.client.0.smithi057.stdout:8/390: symlink d4/d5/d17/l98 0 2024-04-25T22:42:14.985 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:14.980+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:14.986 INFO:tasks.workunit.client.0.smithi057.stdout:7/406: read - d6/f3a zero size 2024-04-25T22:42:14.986 INFO:tasks.workunit.client.0.smithi057.stdout:2/487: rename d1f/d4a/f83 to d1f/d36/d60/da1/fa9 0 2024-04-25T22:42:14.986 INFO:tasks.workunit.client.0.smithi057.stdout:2/488: rmdir d1f/d21/d26/d63/d7f 39 2024-04-25T22:42:14.987 INFO:tasks.workunit.client.0.smithi057.stdout:2/489: stat d1f/d4a/d4d/la0 0 2024-04-25T22:42:14.988 INFO:tasks.workunit.client.0.smithi057.stdout:4/442: dread d14/d47/f51 [0,4194304] 0 2024-04-25T22:42:14.988 INFO:tasks.workunit.client.0.smithi057.stdout:8/391: dread d4/d5/d17/d19/f57 [0,4194304] 0 2024-04-25T22:42:14.990 INFO:tasks.workunit.client.0.smithi057.stdout:7/407: dread d6/f4b [0,4194304] 0 2024-04-25T22:42:14.990 INFO:tasks.workunit.client.0.smithi057.stdout:4/443: getdents d14/d3c/d44 0 2024-04-25T22:42:14.990 INFO:tasks.workunit.client.0.smithi057.stdout:8/392: write d4/db/dd/d3a/f3c [3361784,73159] 0 2024-04-25T22:42:14.991 INFO:tasks.workunit.client.0.smithi057.stdout:4/444: mkdir d14/d3c/d95 0 2024-04-25T22:42:14.991 INFO:tasks.workunit.client.0.smithi057.stdout:8/393: mknod d4/db/dd/d3a/c99 0 2024-04-25T22:42:14.992 INFO:tasks.workunit.client.0.smithi057.stdout:8/394: fsync d4/db/dd/d3a/d5c/f44 0 2024-04-25T22:42:14.992 INFO:tasks.workunit.client.0.smithi057.stdout:4/445: creat d14/d47/d5e/f96 x:0 0 0 2024-04-25T22:42:14.993 INFO:tasks.workunit.client.0.smithi057.stdout:4/446: chown d14/d47/f7c 611 1 2024-04-25T22:42:14.993 INFO:tasks.workunit.client.0.smithi057.stdout:8/395: chown d4/d5/d17/c47 900503 1 2024-04-25T22:42:14.994 INFO:tasks.workunit.client.0.smithi057.stdout:1/406: dread d7/d4e/f7d [0,4194304] 0 2024-04-25T22:42:14.994 INFO:tasks.workunit.client.0.smithi057.stdout:4/447: mknod d14/d5a/d67/c97 0 2024-04-25T22:42:14.995 INFO:tasks.workunit.client.0.smithi057.stdout:7/408: dread d6/f4b [0,4194304] 0 2024-04-25T22:42:14.995 INFO:tasks.workunit.client.0.smithi057.stdout:1/407: mkdir d7/dd/d16/d88 0 2024-04-25T22:42:14.995 INFO:tasks.workunit.client.0.smithi057.stdout:8/396: write d4/d5/d17/d19/d35/d83/d92/d5b/f59 [181982,99499] 0 2024-04-25T22:42:14.996 INFO:tasks.workunit.client.0.smithi057.stdout:4/448: link fc d14/d3c/f98 0 2024-04-25T22:42:14.996 INFO:tasks.workunit.client.0.smithi057.stdout:7/409: write d6/d28/d4e/d30/f5a [3872820,105102] 0 2024-04-25T22:42:14.996 INFO:tasks.workunit.client.0.smithi057.stdout:1/408: write d7/dd/d16/d24/f54 [2731116,106240] 0 2024-04-25T22:42:14.997 INFO:tasks.workunit.client.0.smithi057.stdout:4/449: creat d14/d2f/f99 x:0 0 0 2024-04-25T22:42:14.997 INFO:tasks.workunit.client.0.smithi057.stdout:1/409: symlink d7/l89 0 2024-04-25T22:42:14.998 INFO:tasks.workunit.client.0.smithi057.stdout:1/410: dread - d7/dd/d16/d24/d61/f53 zero size 2024-04-25T22:42:15.002 INFO:tasks.workunit.client.0.smithi057.stdout:8/397: truncate d4/d5/d17/d19/d35/d83/d92/d5b/f7e 1649864 0 2024-04-25T22:42:15.003 INFO:tasks.workunit.client.0.smithi057.stdout:1/411: truncate d7/dd/d40/d41/d6b/f7b 350003 0 2024-04-25T22:42:15.003 INFO:tasks.workunit.client.0.smithi057.stdout:7/410: dread d6/d28/d4e/d1d/d51/f83 [0,4194304] 0 2024-04-25T22:42:15.003 INFO:tasks.workunit.client.0.smithi057.stdout:6/456: dread d2/f14 [0,4194304] 0 2024-04-25T22:42:15.003 INFO:tasks.workunit.client.0.smithi057.stdout:2/490: truncate d1f/d21/d26/d63/d7f/d86/f9e 2679226 0 2024-04-25T22:42:15.003 INFO:tasks.workunit.client.0.smithi057.stdout:1/412: link d7/dd/d16/d24/c64 d7/dd/d16/d88/c8a 0 2024-04-25T22:42:15.003 INFO:tasks.workunit.client.0.smithi057.stdout:6/457: creat d2/d19/d20/f8e x:0 0 0 2024-04-25T22:42:15.003 INFO:tasks.workunit.client.0.smithi057.stdout:1/413: chown d7/l89 244612 1 2024-04-25T22:42:15.003 INFO:tasks.workunit.client.0.smithi057.stdout:2/491: mkdir d1f/d21/d33/daa 0 2024-04-25T22:42:15.004 INFO:tasks.workunit.client.0.smithi057.stdout:6/458: creat d2/d19/d49/d62/f8f x:0 0 0 2024-04-25T22:42:15.005 INFO:tasks.workunit.client.0.smithi057.stdout:1/414: creat d7/dd/d16/d88/f8b x:0 0 0 2024-04-25T22:42:15.006 INFO:tasks.workunit.client.0.smithi057.stdout:8/398: dwrite d4/db/dd/d3a/f66 [0,4194304] 0 2024-04-25T22:42:15.007 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:15.007 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:15.007 INFO:tasks.workunit.client.0.smithi057.stdout:6/459: mkdir d2/d86/d90 0 2024-04-25T22:42:15.009 INFO:tasks.workunit.client.0.smithi057.stdout:2/492: read d1f/d21/f25 [179880,457] 0 2024-04-25T22:42:15.009 INFO:tasks.workunit.client.0.smithi057.stdout:9/417: dread d3/d34/d42/d28/d39/f3a [0,4194304] 0 2024-04-25T22:42:15.010 INFO:tasks.workunit.client.0.smithi057.stdout:8/399: mknod d4/db/dd/d3a/d5c/c9a 0 2024-04-25T22:42:15.011 INFO:tasks.workunit.client.0.smithi057.stdout:9/418: stat d3/d34/d42/d28/d2d/d7a/c7b 0 2024-04-25T22:42:15.012 INFO:tasks.workunit.client.0.smithi057.stdout:4/450: write d14/f20 [1892148,2892] 0 2024-04-25T22:42:15.012 INFO:tasks.workunit.client.0.smithi057.stdout:8/400: creat d4/db/d89/f9b x:0 0 0 2024-04-25T22:42:15.013 INFO:tasks.workunit.client.0.smithi057.stdout:4/451: dread - d14/d47/d5e/f81 zero size 2024-04-25T22:42:15.013 INFO:tasks.workunit.client.0.smithi057.stdout:1/415: dwrite d7/dd/d40/d41/f4b [0,4194304] 0 2024-04-25T22:42:15.014 INFO:tasks.workunit.client.0.smithi057.stdout:8/401: unlink d4/d5/d21/l7c 0 2024-04-25T22:42:15.014 INFO:tasks.workunit.client.0.smithi057.stdout:9/419: dread - d3/d34/d42/d28/d62/d67/d6e/f7d zero size 2024-04-25T22:42:15.014 INFO:tasks.workunit.client.0.smithi057.stdout:9/420: truncate d3/f64 351699 0 2024-04-25T22:42:15.015 INFO:tasks.workunit.client.0.smithi057.stdout:8/402: readlink d4/d5/d17/d19/d35/d83/d92/d5b/l61 0 2024-04-25T22:42:15.015 INFO:tasks.workunit.client.0.smithi057.stdout:4/452: symlink d14/d2f/l9a 0 2024-04-25T22:42:15.016 INFO:tasks.workunit.client.0.smithi057.stdout:9/421: creat d3/d34/d42/d28/d2d/d7a/f87 x:0 0 0 2024-04-25T22:42:15.017 INFO:tasks.workunit.client.0.smithi057.stdout:9/422: dread - d3/d34/d42/d28/f5d zero size 2024-04-25T22:42:15.017 INFO:tasks.workunit.client.0.smithi057.stdout:8/403: link d4/d5/d17/d19/c63 d4/db/d89/c9c 0 2024-04-25T22:42:15.018 INFO:tasks.workunit.client.0.smithi057.stdout:9/423: mkdir d3/d34/d42/d28/d39/d54/d88 0 2024-04-25T22:42:15.018 INFO:tasks.workunit.client.0.smithi057.stdout:8/404: read d4/d5/f7 [1112681,77842] 0 2024-04-25T22:42:15.019 INFO:tasks.workunit.client.0.smithi057.stdout:7/411: dread d6/d28/d4e/f22 [0,4194304] 0 2024-04-25T22:42:15.019 INFO:tasks.workunit.client.0.smithi057.stdout:9/424: symlink d3/d34/d42/d28/d39/l89 0 2024-04-25T22:42:15.020 INFO:tasks.workunit.client.0.smithi057.stdout:4/453: dread d14/d47/f51 [0,4194304] 0 2024-04-25T22:42:15.020 INFO:tasks.workunit.client.0.smithi057.stdout:0/456: sync 2024-04-25T22:42:15.020 INFO:tasks.workunit.client.0.smithi057.stdout:5/423: sync 2024-04-25T22:42:15.020 INFO:tasks.workunit.client.0.smithi057.stdout:7/412: mknod d6/d28/d4e/d1d/d51/c85 0 2024-04-25T22:42:15.021 INFO:tasks.workunit.client.0.smithi057.stdout:5/424: fdatasync d2/d6/db/f17 0 2024-04-25T22:42:15.021 INFO:tasks.workunit.client.0.smithi057.stdout:7/413: rmdir d6 39 2024-04-25T22:42:15.021 INFO:tasks.workunit.client.0.smithi057.stdout:4/454: chown d14/d2f/l63 1 1 2024-04-25T22:42:15.021 INFO:tasks.workunit.client.0.smithi057.stdout:0/457: creat d0/d49/f9e x:0 0 0 2024-04-25T22:42:15.022 INFO:tasks.workunit.client.0.smithi057.stdout:5/425: mknod d2/d1c/d24/d3d/d77/c8d 0 2024-04-25T22:42:15.023 INFO:tasks.workunit.client.0.smithi057.stdout:5/426: write d2/d2c/f36 [463729,90388] 0 2024-04-25T22:42:15.024 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:15.026 INFO:tasks.workunit.client.0.smithi057.stdout:8/405: dwrite d4/d5/d17/d19/f26 [4194304,4194304] 0 2024-04-25T22:42:15.029 INFO:tasks.workunit.client.0.smithi057.stdout:7/414: dwrite d6/d28/d4e/d30/d46/f69 [0,4194304] 0 2024-04-25T22:42:15.029 INFO:tasks.workunit.client.0.smithi057.stdout:0/458: dwrite d0/d3/d6/d14/f72 [0,4194304] 0 2024-04-25T22:42:15.030 INFO:tasks.workunit.client.0.smithi057.stdout:7/415: write d6/d28/d4e/f31 [842443,128836] 0 2024-04-25T22:42:15.030 INFO:tasks.workunit.client.0.smithi057.stdout:0/459: creat d0/d49/f9f x:0 0 0 2024-04-25T22:42:15.031 INFO:tasks.workunit.client.0.smithi057.stdout:4/455: write d14/d3c/f98 [5184129,38433] 0 2024-04-25T22:42:15.032 INFO:tasks.workunit.client.0.smithi057.stdout:0/460: mkdir d0/d3/d4d/d87/da0 0 2024-04-25T22:42:15.035 INFO:tasks.workunit.client.0.smithi057.stdout:7/416: read d6/f9 [3085425,50579] 0 2024-04-25T22:42:15.035 INFO:tasks.workunit.client.0.smithi057.stdout:8/406: dwrite d4/d5/d21/f60 [4194304,4194304] 0 2024-04-25T22:42:15.036 INFO:tasks.workunit.client.0.smithi057.stdout:2/493: dread d1f/d4a/f3b [0,4194304] 0 2024-04-25T22:42:15.036 INFO:tasks.workunit.client.0.smithi057.stdout:8/407: creat d4/d5/d17/f9d x:0 0 0 2024-04-25T22:42:15.037 INFO:tasks.workunit.client.0.smithi057.stdout:2/494: write d1f/d21/f78 [1017281,31857] 0 2024-04-25T22:42:15.037 INFO:tasks.workunit.client.0.smithi057.stdout:2/495: chown d1f/d21/d26/d63 61173 1 2024-04-25T22:42:15.038 INFO:tasks.workunit.client.0.smithi057.stdout:7/417: getdents d6/d28/d4e/d1d/d51/d5f/d7d 0 2024-04-25T22:42:15.038 INFO:tasks.workunit.client.0.smithi057.stdout:8/408: unlink d4/d5/d2f/f8f 0 2024-04-25T22:42:15.040 INFO:tasks.workunit.client.0.smithi057.stdout:8/409: write d4/d5/d17/d19/d35/d83/d92/d5b/f46 [3995594,65739] 0 2024-04-25T22:42:15.041 INFO:tasks.workunit.client.0.smithi057.stdout:0/461: dwrite d0/d3/d6/f59 [0,4194304] 0 2024-04-25T22:42:15.041 INFO:tasks.workunit.client.0.smithi057.stdout:0/462: read - d0/d3/d4d/f8f zero size 2024-04-25T22:42:15.043 INFO:tasks.workunit.client.0.smithi057.stdout:1/416: sync 2024-04-25T22:42:15.043 INFO:tasks.workunit.client.0.smithi057.stdout:3/382: sync 2024-04-25T22:42:15.043 INFO:tasks.workunit.client.0.smithi057.stdout:6/460: sync 2024-04-25T22:42:15.043 INFO:tasks.workunit.client.0.smithi057.stdout:2/496: truncate d1f/d4a/f3b 3824811 0 2024-04-25T22:42:15.044 INFO:tasks.workunit.client.0.smithi057.stdout:0/463: link d0/d3/d6/d29/c2c d0/d3/d6/d71/ca1 0 2024-04-25T22:42:15.045 INFO:tasks.workunit.client.0.smithi057.stdout:1/417: creat d7/dd/d26/f8c x:0 0 0 2024-04-25T22:42:15.046 INFO:tasks.workunit.client.0.smithi057.stdout:0/464: write d0/d5/d53/f67 [869939,123210] 0 2024-04-25T22:42:15.046 INFO:tasks.workunit.client.0.smithi057.stdout:0/465: sync 2024-04-25T22:42:15.047 INFO:tasks.workunit.client.0.smithi057.stdout:0/466: symlink d0/d3/d6/d78/la2 0 2024-04-25T22:42:15.049 INFO:tasks.workunit.client.0.smithi057.stdout:7/418: dwrite d6/d28/d4e/d30/f36 [0,4194304] 0 2024-04-25T22:42:15.050 INFO:tasks.workunit.client.0.smithi057.stdout:0/467: write d0/d3/d6/f90 [2360488,129426] 0 2024-04-25T22:42:15.052 INFO:tasks.workunit.client.0.smithi057.stdout:2/497: dread d1f/d21/d33/f5a [0,4194304] 0 2024-04-25T22:42:15.053 INFO:tasks.workunit.client.0.smithi057.stdout:9/425: dread d3/ff [0,4194304] 0 2024-04-25T22:42:15.053 INFO:tasks.workunit.client.0.smithi057.stdout:2/498: chown d1f/d21/f8e 9 1 2024-04-25T22:42:15.054 INFO:tasks.workunit.client.0.smithi057.stdout:1/418: dwrite d7/d4e/f81 [0,4194304] 0 2024-04-25T22:42:15.054 INFO:tasks.workunit.client.0.smithi057.stdout:6/461: dwrite d2/d19/d26/f2d [0,4194304] 0 2024-04-25T22:42:15.054 INFO:tasks.workunit.client.0.smithi057.stdout:2/499: fsync d1f/d34/f85 0 2024-04-25T22:42:15.054 INFO:tasks.workunit.client.0.smithi057.stdout:8/410: truncate d4/db/fc 2153923 0 2024-04-25T22:42:15.060 INFO:tasks.workunit.client.0.smithi057.stdout:9/426: link d3/d34/f43 d3/d34/d42/d28/f8a 0 2024-04-25T22:42:15.060 INFO:tasks.workunit.client.0.smithi057.stdout:1/419: chown d7/d65/d6a/f6d 1130440571 1 2024-04-25T22:42:15.060 INFO:tasks.workunit.client.0.smithi057.stdout:2/500: write d1f/d34/f52 [299548,76246] 0 2024-04-25T22:42:15.060 INFO:tasks.workunit.client.0.smithi057.stdout:8/411: mknod d4/d5/d17/c9e 0 2024-04-25T22:42:15.060 INFO:tasks.workunit.client.0.smithi057.stdout:1/420: write d7/dd/d40/d41/d45/f87 [135129,126256] 0 2024-04-25T22:42:15.060 INFO:tasks.workunit.client.0.smithi057.stdout:3/383: dwrite d0/d4/d7/d46/d30/f5a [0,4194304] 0 2024-04-25T22:42:15.062 INFO:tasks.workunit.client.0.smithi057.stdout:1/421: write d7/dd/d40/d41/d45/f87 [941319,107280] 0 2024-04-25T22:42:15.063 INFO:tasks.workunit.client.0.smithi057.stdout:9/427: symlink d3/d34/d42/d28/d62/d67/d6e/l8b 0 2024-04-25T22:42:15.066 INFO:tasks.workunit.client.0.smithi057.stdout:8/412: link d4/db/dd/f20 d4/d5/f9f 0 2024-04-25T22:42:15.066 INFO:tasks.workunit.client.0.smithi057.stdout:8/413: sync 2024-04-25T22:42:15.066 INFO:tasks.workunit.client.0.smithi057.stdout:9/428: read - d3/d34/f5b zero size 2024-04-25T22:42:15.067 INFO:tasks.workunit.client.0.smithi057.stdout:2/501: dwrite d1f/d36/d54/f5f [0,4194304] 0 2024-04-25T22:42:15.067 INFO:tasks.workunit.client.0.smithi057.stdout:2/502: sync 2024-04-25T22:42:15.068 INFO:tasks.workunit.client.0.smithi057.stdout:5/427: dread d2/d1c/d46/f22 [0,4194304] 0 2024-04-25T22:42:15.069 INFO:tasks.workunit.client.0.smithi057.stdout:2/503: fdatasync d1f/d36/d54/f95 0 2024-04-25T22:42:15.069 INFO:tasks.workunit.client.0.smithi057.stdout:8/414: symlink d4/d5/d17/d19/d35/d83/d92/d5b/la0 0 2024-04-25T22:42:15.070 INFO:tasks.workunit.client.0.smithi057.stdout:9/429: truncate d3/f20 6733060 0 2024-04-25T22:42:15.070 INFO:tasks.workunit.client.0.smithi057.stdout:9/430: sync 2024-04-25T22:42:15.071 INFO:tasks.workunit.client.0.smithi057.stdout:7/419: dwrite d6/f54 [0,4194304] 0 2024-04-25T22:42:15.073 INFO:tasks.workunit.client.0.smithi057.stdout:3/384: dwrite d0/d11/f1c [0,4194304] 0 2024-04-25T22:42:15.073 INFO:tasks.workunit.client.0.smithi057.stdout:1/422: dread d7/d4e/f81 [0,4194304] 0 2024-04-25T22:42:15.074 INFO:tasks.workunit.client.0.smithi057.stdout:1/423: dread - d7/d4e/f5c zero size 2024-04-25T22:42:15.075 INFO:tasks.workunit.client.0.smithi057.stdout:2/504: symlink d1f/d21/lab 0 2024-04-25T22:42:15.075 INFO:tasks.workunit.client.0.smithi057.stdout:9/431: symlink d3/d34/d42/d28/d2d/l8c 0 2024-04-25T22:42:15.076 INFO:tasks.workunit.client.0.smithi057.stdout:5/428: rename d2/d1c/d46/f22 to d2/d1c/d24/d74/f8e 0 2024-04-25T22:42:15.076 INFO:tasks.workunit.client.0.smithi057.stdout:3/385: mkdir d0/d4/d34/d3c/d53/d7f 0 2024-04-25T22:42:15.076 INFO:tasks.workunit.client.0.smithi057.stdout:1/424: creat d7/dd/d16/f8d x:0 0 0 2024-04-25T22:42:15.076 INFO:tasks.workunit.client.0.smithi057.stdout:9/432: readlink d3/l6d 0 2024-04-25T22:42:15.076 INFO:tasks.workunit.client.0.smithi057.stdout:7/420: creat d6/d28/d4e/d30/d60/f86 x:0 0 0 2024-04-25T22:42:15.077 INFO:tasks.workunit.client.0.smithi057.stdout:6/462: dwrite d2/f32 [0,4194304] 0 2024-04-25T22:42:15.077 INFO:tasks.workunit.client.0.smithi057.stdout:2/505: mknod d1f/d36/d60/cac 0 2024-04-25T22:42:15.078 INFO:tasks.workunit.client.0.smithi057.stdout:5/429: write d2/d6/fa [5678621,40728] 0 2024-04-25T22:42:15.078 INFO:tasks.workunit.client.0.smithi057.stdout:2/506: chown d1f/d36/d54/l65 1720 1 2024-04-25T22:42:15.078 INFO:tasks.workunit.client.0.smithi057.stdout:9/433: symlink d3/d34/d42/l8d 0 2024-04-25T22:42:15.079 INFO:tasks.workunit.client.0.smithi057.stdout:1/425: fdatasync d7/dd/d16/d24/f3a 0 2024-04-25T22:42:15.079 INFO:tasks.workunit.client.0.smithi057.stdout:7/421: symlink d6/d28/d4e/d1d/l87 0 2024-04-25T22:42:15.079 INFO:tasks.workunit.client.0.smithi057.stdout:3/386: mknod d0/d4/d7/d46/d30/d7a/c80 0 2024-04-25T22:42:15.079 INFO:tasks.workunit.client.0.smithi057.stdout:6/463: unlink d2/d19/d26/d63/f68 0 2024-04-25T22:42:15.080 INFO:tasks.workunit.client.0.smithi057.stdout:9/434: chown d3/f70 137 1 2024-04-25T22:42:15.081 INFO:tasks.workunit.client.0.smithi057.stdout:6/464: mkdir d2/d19/d50/d91 0 2024-04-25T22:42:15.082 INFO:tasks.workunit.client.0.smithi057.stdout:7/422: mkdir d6/d88 0 2024-04-25T22:42:15.082 INFO:tasks.workunit.client.0.smithi057.stdout:1/426: stat d7/dd/d40/d41/d6b 0 2024-04-25T22:42:15.083 INFO:tasks.workunit.client.0.smithi057.stdout:1/427: write d7/dd/d26/f73 [602688,62332] 0 2024-04-25T22:42:15.084 INFO:tasks.workunit.client.0.smithi057.stdout:6/465: dread - d2/d19/d49/d62/f7e zero size 2024-04-25T22:42:15.085 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:15.079+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:15.086 INFO:tasks.workunit.client.0.smithi057.stdout:2/507: rename d1f/d21/f62 to d1f/d21/d26/fad 0 2024-04-25T22:42:15.087 INFO:tasks.workunit.client.0.smithi057.stdout:6/466: fsync d2/d19/d20/f8e 0 2024-04-25T22:42:15.087 INFO:tasks.workunit.client.0.smithi057.stdout:7/423: symlink d6/d28/d4e/d75/l89 0 2024-04-25T22:42:15.087 INFO:tasks.workunit.client.0.smithi057.stdout:2/508: fdatasync d1f/d34/f57 0 2024-04-25T22:42:15.087 INFO:tasks.workunit.client.0.smithi057.stdout:7/424: truncate d6/d28/d4e/f2d 4313252 0 2024-04-25T22:42:15.089 INFO:tasks.workunit.client.0.smithi057.stdout:7/425: mkdir d6/d28/d4e/d30/d60/d6f/d8a 0 2024-04-25T22:42:15.090 INFO:tasks.workunit.client.0.smithi057.stdout:7/426: mknod d6/d28/d4e/d1d/c8b 0 2024-04-25T22:42:15.091 INFO:tasks.workunit.client.0.smithi057.stdout:7/427: creat d6/d28/d4e/f8c x:0 0 0 2024-04-25T22:42:15.093 INFO:tasks.workunit.client.0.smithi057.stdout:2/509: dwrite d1f/d21/d26/f29 [0,4194304] 0 2024-04-25T22:42:15.096 INFO:tasks.workunit.client.0.smithi057.stdout:2/510: chown d1f/d36/c92 107097 1 2024-04-25T22:42:15.098 INFO:tasks.workunit.client.0.smithi057.stdout:7/428: truncate d6/d28/f2c 6257894 0 2024-04-25T22:42:15.098 INFO:tasks.workunit.client.0.smithi057.stdout:1/428: write d7/dd/d40/d41/d45/f72 [4610262,100223] 0 2024-04-25T22:42:15.099 INFO:tasks.workunit.client.0.smithi057.stdout:9/435: rename d3/f20 to d3/d34/d42/d28/d65/f8e 0 2024-04-25T22:42:15.099 INFO:tasks.workunit.client.0.smithi057.stdout:3/387: dread d0/d4/f25 [0,4194304] 0 2024-04-25T22:42:15.100 INFO:tasks.workunit.client.0.smithi057.stdout:2/511: creat d1f/d21/d26/d63/d7f/fae x:0 0 0 2024-04-25T22:42:15.100 INFO:tasks.workunit.client.0.smithi057.stdout:1/429: fdatasync d7/dd/d16/d18/f70 0 2024-04-25T22:42:15.100 INFO:tasks.workunit.client.0.smithi057.stdout:6/467: rename d2/l10 to d2/d19/d26/d4f/l92 0 2024-04-25T22:42:15.100 INFO:tasks.workunit.client.0.smithi057.stdout:7/429: mkdir d6/d28/d4e/d30/d60/d8d 0 2024-04-25T22:42:15.100 INFO:tasks.workunit.client.0.smithi057.stdout:3/388: fdatasync d0/d4/d7/f2f 0 2024-04-25T22:42:15.101 INFO:tasks.workunit.client.0.smithi057.stdout:9/436: write d3/d34/d42/d28/f51 [879953,49743] 0 2024-04-25T22:42:15.101 INFO:tasks.workunit.client.0.smithi057.stdout:1/430: chown d7/d65/d6a 60313658 1 2024-04-25T22:42:15.103 INFO:tasks.workunit.client.0.smithi057.stdout:9/437: dread - d3/d34/d42/d28/f6f zero size 2024-04-25T22:42:15.103 INFO:tasks.workunit.client.0.smithi057.stdout:3/389: write d0/d4/d7/d46/d30/f5a [1824942,20138] 0 2024-04-25T22:42:15.103 INFO:tasks.workunit.client.0.smithi057.stdout:4/456: dread d14/f1c [0,4194304] 0 2024-04-25T22:42:15.103 INFO:tasks.workunit.client.0.smithi057.stdout:2/512: creat d1f/d4a/d4d/d88/faf x:0 0 0 2024-04-25T22:42:15.104 INFO:tasks.workunit.client.0.smithi057.stdout:3/390: fsync d0/d11/f3b 0 2024-04-25T22:42:15.104 INFO:tasks.workunit.client.0.smithi057.stdout:4/457: fsync d14/d3c/f75 0 2024-04-25T22:42:15.104 INFO:tasks.workunit.client.0.smithi057.stdout:2/513: fdatasync fe 0 2024-04-25T22:42:15.105 INFO:tasks.workunit.client.0.smithi057.stdout:3/391: fsync d0/d4/f2d 0 2024-04-25T22:42:15.106 INFO:tasks.workunit.client.0.smithi057.stdout:3/392: mknod d0/d6b/c81 0 2024-04-25T22:42:15.107 INFO:tasks.workunit.client.0.smithi057.stdout:4/458: truncate d14/d2f/f57 1106251 0 2024-04-25T22:42:15.107 INFO:tasks.workunit.client.0.smithi057.stdout:2/514: truncate d1f/d34/f90 764706 0 2024-04-25T22:42:15.107 INFO:tasks.workunit.client.0.smithi057.stdout:4/459: fdatasync d14/d47/d5e/f8e 0 2024-04-25T22:42:15.107 INFO:tasks.workunit.client.0.smithi057.stdout:3/393: creat d0/d4/d7/d46/d30/f82 x:0 0 0 2024-04-25T22:42:15.107 INFO:tasks.workunit.client.0.smithi057.stdout:4/460: symlink d14/d47/d62/l9b 0 2024-04-25T22:42:15.108 INFO:tasks.workunit.client.0.smithi057.stdout:4/461: chown d14/l19 184 1 2024-04-25T22:42:15.108 INFO:tasks.workunit.client.0.smithi057.stdout:3/394: dread - d0/d4/d34/d3c/f78 zero size 2024-04-25T22:42:15.110 INFO:tasks.workunit.client.0.smithi057.stdout:4/462: symlink d14/d2f/d82/l9c 0 2024-04-25T22:42:15.110 INFO:tasks.workunit.client.0.smithi057.stdout:3/395: mknod d0/d4/d7/d22/c83 0 2024-04-25T22:42:15.112 INFO:tasks.workunit.client.0.smithi057.stdout:3/396: write d0/d4/d7/d46/f6f [1607764,32870] 0 2024-04-25T22:42:15.114 INFO:tasks.workunit.client.0.smithi057.stdout:2/515: dwrite d1f/d21/d33/f87 [0,4194304] 0 2024-04-25T22:42:15.115 INFO:tasks.workunit.client.0.smithi057.stdout:4/463: rename d14/f3b to d14/d5a/f9d 0 2024-04-25T22:42:15.115 INFO:tasks.workunit.client.0.smithi057.stdout:3/397: write d0/d4/f25 [577613,66897] 0 2024-04-25T22:42:15.117 INFO:tasks.workunit.client.0.smithi057.stdout:3/398: creat d0/d4/d7/d46/f84 x:0 0 0 2024-04-25T22:42:15.117 INFO:tasks.workunit.client.0.smithi057.stdout:0/468: dread d0/d3/d6/d29/f89 [0,4194304] 0 2024-04-25T22:42:15.117 INFO:tasks.workunit.client.0.smithi057.stdout:3/399: read d0/f6 [442247,45243] 0 2024-04-25T22:42:15.118 INFO:tasks.workunit.client.0.smithi057.stdout:2/516: creat d1f/d4a/fb0 x:0 0 0 2024-04-25T22:42:15.119 INFO:tasks.workunit.client.0.smithi057.stdout:0/469: mkdir d0/d3/d88/da3 0 2024-04-25T22:42:15.119 INFO:tasks.workunit.client.0.smithi057.stdout:4/464: read d14/d5a/d67/d70/f91 [819552,56976] 0 2024-04-25T22:42:15.120 INFO:tasks.workunit.client.0.smithi057.stdout:2/517: mkdir d1f/d4a/db1 0 2024-04-25T22:42:15.120 INFO:tasks.workunit.client.0.smithi057.stdout:4/465: write d14/d47/f59 [52381,69896] 0 2024-04-25T22:42:15.120 INFO:tasks.workunit.client.0.smithi057.stdout:0/470: mknod d0/d3/d4d/d87/da0/ca4 0 2024-04-25T22:42:15.124 INFO:tasks.workunit.client.0.smithi057.stdout:8/415: dread d4/db/fc [0,4194304] 0 2024-04-25T22:42:15.125 INFO:tasks.workunit.client.0.smithi057.stdout:1/431: dread d7/dd/d40/d41/d45/f72 [4194304,4194304] 0 2024-04-25T22:42:15.125 INFO:tasks.workunit.client.0.smithi057.stdout:3/400: dread d0/d4/d34/f77 [0,4194304] 0 2024-04-25T22:42:15.125 INFO:tasks.workunit.client.0.smithi057.stdout:5/430: dread d2/d2c/f2e [0,4194304] 0 2024-04-25T22:42:15.126 INFO:tasks.workunit.client.0.smithi057.stdout:1/432: creat d7/f8e x:0 0 0 2024-04-25T22:42:15.127 INFO:tasks.workunit.client.0.smithi057.stdout:5/431: dread - d2/d1c/d46/d3a/d6a/f7f zero size 2024-04-25T22:42:15.127 INFO:tasks.workunit.client.0.smithi057.stdout:8/416: read - d4/d5/d17/d19/d35/d83/d92/d5b/f5d zero size 2024-04-25T22:42:15.128 INFO:tasks.workunit.client.0.smithi057.stdout:4/466: dwrite d14/d5a/f64 [0,4194304] 0 2024-04-25T22:42:15.128 INFO:tasks.workunit.client.0.smithi057.stdout:1/433: mkdir d7/dd/d16/d18/d31/d8f 0 2024-04-25T22:42:15.128 INFO:tasks.workunit.client.0.smithi057.stdout:0/471: dwrite d0/d3/d4d/f9c [0,4194304] 0 2024-04-25T22:42:15.129 INFO:tasks.workunit.client.0.smithi057.stdout:1/434: dread - d7/d4e/f5c zero size 2024-04-25T22:42:15.130 INFO:tasks.workunit.client.0.smithi057.stdout:0/472: fdatasync d0/d3/d6/d29/f79 0 2024-04-25T22:42:15.132 INFO:tasks.workunit.client.0.smithi057.stdout:3/401: rename d0/d4/c4f to d0/d4/d34/d3c/c85 0 2024-04-25T22:42:15.133 INFO:tasks.workunit.client.0.smithi057.stdout:1/435: write d7/d4e/f7d [3055955,84951] 0 2024-04-25T22:42:15.133 INFO:tasks.workunit.client.0.smithi057.stdout:3/402: symlink d0/d4/d7/d22/l86 0 2024-04-25T22:42:15.135 INFO:tasks.workunit.client.0.smithi057.stdout:3/403: fdatasync d0/d4/d7/d46/f29 0 2024-04-25T22:42:15.135 INFO:tasks.workunit.client.0.smithi057.stdout:1/436: rmdir d7/dd/d16/d24/d61 39 2024-04-25T22:42:15.137 INFO:tasks.workunit.client.0.smithi057.stdout:6/468: dread d2/d19/d20/f3b [0,4194304] 0 2024-04-25T22:42:15.138 INFO:tasks.workunit.client.0.smithi057.stdout:0/473: truncate d0/d3/d4d/d87/d91/f94 2541388 0 2024-04-25T22:42:15.138 INFO:tasks.workunit.client.0.smithi057.stdout:8/417: dwrite d4/d5/f82 [0,4194304] 0 2024-04-25T22:42:15.140 INFO:tasks.workunit.client.0.smithi057.stdout:8/418: creat d4/d5/d17/d19/fa1 x:0 0 0 2024-04-25T22:42:15.140 INFO:tasks.workunit.client.0.smithi057.stdout:5/432: dwrite d2/d1c/d24/f43 [0,4194304] 0 2024-04-25T22:42:15.141 INFO:tasks.workunit.client.0.smithi057.stdout:0/474: rename d0/c44 to d0/d3/d6/d83/ca5 0 2024-04-25T22:42:15.143 INFO:tasks.workunit.client.0.smithi057.stdout:5/433: mkdir d2/d1c/d24/d8f 0 2024-04-25T22:42:15.143 INFO:tasks.workunit.client.0.smithi057.stdout:4/467: dwrite d14/d2f/d4c/d5b/f8f [0,4194304] 0 2024-04-25T22:42:15.143 INFO:tasks.workunit.client.0.smithi057.stdout:8/419: chown d4/db/dd/df/f62 232380 1 2024-04-25T22:42:15.144 INFO:tasks.workunit.client.0.smithi057.stdout:5/434: dread - d2/d1c/d46/f66 zero size 2024-04-25T22:42:15.144 INFO:tasks.workunit.client.0.smithi057.stdout:4/468: dread - d14/d47/d5e/f96 zero size 2024-04-25T22:42:15.145 INFO:tasks.workunit.client.0.smithi057.stdout:8/420: rmdir d4/d5/d17/d19/d35/d83 39 2024-04-25T22:42:15.145 INFO:tasks.workunit.client.0.smithi057.stdout:5/435: chown d2/d47/f68 457 1 2024-04-25T22:42:15.145 INFO:tasks.workunit.client.0.smithi057.stdout:3/404: dwrite d0/d11/f1e [0,4194304] 0 2024-04-25T22:42:15.146 INFO:tasks.workunit.client.0.smithi057.stdout:6/469: dread d2/d19/d26/d63/f7d [0,4194304] 0 2024-04-25T22:42:15.146 INFO:tasks.workunit.client.0.smithi057.stdout:3/405: unlink d0/f61 0 2024-04-25T22:42:15.146 INFO:tasks.workunit.client.0.smithi057.stdout:8/421: symlink d4/d5/d17/d19/d35/d83/la2 0 2024-04-25T22:42:15.147 INFO:tasks.workunit.client.0.smithi057.stdout:5/436: rename d2/d47/l61 to d2/d47/d60/l90 0 2024-04-25T22:42:15.147 INFO:tasks.workunit.client.0.smithi057.stdout:5/437: chown d2/d2c 1055460528 1 2024-04-25T22:42:15.148 INFO:tasks.workunit.client.0.smithi057.stdout:0/475: fsync d0/f30 0 2024-04-25T22:42:15.148 INFO:tasks.workunit.client.0.smithi057.stdout:8/422: dread - d4/db/dd/d3a/f8e zero size 2024-04-25T22:42:15.148 INFO:tasks.workunit.client.0.smithi057.stdout:3/406: rename d0/d4/d7/d22/l86 to d0/d4/d7/d26/l87 0 2024-04-25T22:42:15.148 INFO:tasks.workunit.client.0.smithi057.stdout:0/476: readlink d0/l7b 0 2024-04-25T22:42:15.148 INFO:tasks.workunit.client.0.smithi057.stdout:1/437: truncate d7/dd/d16/d18/f2a 990963 0 2024-04-25T22:42:15.149 INFO:tasks.workunit.client.0.smithi057.stdout:8/423: mknod d4/db/dd/ca3 0 2024-04-25T22:42:15.149 INFO:tasks.workunit.client.0.smithi057.stdout:0/477: mkdir d0/d3/d4d/da6 0 2024-04-25T22:42:15.150 INFO:tasks.workunit.client.0.smithi057.stdout:1/438: write d7/d4e/f7d [2662459,113865] 0 2024-04-25T22:42:15.151 INFO:tasks.workunit.client.0.smithi057.stdout:8/424: creat d4/db/dd/d3a/fa4 x:0 0 0 2024-04-25T22:42:15.151 INFO:tasks.workunit.client.0.smithi057.stdout:1/439: fsync d7/dd/d26/f35 0 2024-04-25T22:42:15.152 INFO:tasks.workunit.client.0.smithi057.stdout:8/425: read - d4/d5/d17/f9d zero size 2024-04-25T22:42:15.152 INFO:tasks.workunit.client.0.smithi057.stdout:1/440: fdatasync d7/dd/d40/f60 0 2024-04-25T22:42:15.152 INFO:tasks.workunit.client.0.smithi057.stdout:0/478: creat d0/d5/d53/fa7 x:0 0 0 2024-04-25T22:42:15.152 INFO:tasks.workunit.client.0.smithi057.stdout:1/441: chown d7/dd/d40/d41/c55 153 1 2024-04-25T22:42:15.153 INFO:tasks.workunit.client.0.smithi057.stdout:0/479: write d0/d49/f9e [252282,72071] 0 2024-04-25T22:42:15.153 INFO:tasks.workunit.client.0.smithi057.stdout:1/442: write d7/dd/f14 [224699,86236] 0 2024-04-25T22:42:15.153 INFO:tasks.workunit.client.0.smithi057.stdout:1/443: stat d7/dd 0 2024-04-25T22:42:15.154 INFO:tasks.workunit.client.0.smithi057.stdout:0/480: unlink d0/d3/d6/d14/d39/c65 0 2024-04-25T22:42:15.154 INFO:tasks.workunit.client.0.smithi057.stdout:7/430: sync 2024-04-25T22:42:15.154 INFO:tasks.workunit.client.0.smithi057.stdout:1/444: truncate d7/f8e 121305 0 2024-04-25T22:42:15.155 INFO:tasks.workunit.client.0.smithi057.stdout:0/481: creat d0/d3/d3a/fa8 x:0 0 0 2024-04-25T22:42:15.158 INFO:tasks.workunit.client.0.smithi057.stdout:6/470: truncate d2/d19/d20/f3b 2586232 0 2024-04-25T22:42:15.160 INFO:tasks.workunit.client.0.smithi057.stdout:0/482: rename d0/d49/f7d to d0/d3/d3a/d3b/fa9 0 2024-04-25T22:42:15.161 INFO:tasks.workunit.client.0.smithi057.stdout:4/469: dwrite d14/d5a/d67/f71 [0,4194304] 0 2024-04-25T22:42:15.162 INFO:tasks.workunit.client.0.smithi057.stdout:4/470: creat d14/d47/f9e x:0 0 0 2024-04-25T22:42:15.163 INFO:tasks.workunit.client.0.smithi057.stdout:7/431: dwrite d6/d28/d4e/d30/f43 [0,4194304] 0 2024-04-25T22:42:15.164 INFO:tasks.workunit.client.0.smithi057.stdout:1/445: dread d7/dd/d40/d41/d6b/f7b [0,4194304] 0 2024-04-25T22:42:15.165 INFO:tasks.workunit.client.0.smithi057.stdout:3/407: read d0/d4/d7/d22/f55 [874229,54921] 0 2024-04-25T22:42:15.165 INFO:tasks.workunit.client.0.smithi057.stdout:1/446: fdatasync d7/dd/d40/f51 0 2024-04-25T22:42:15.165 INFO:tasks.workunit.client.0.smithi057.stdout:7/432: fdatasync d6/f52 0 2024-04-25T22:42:15.167 INFO:tasks.workunit.client.0.smithi057.stdout:6/471: dwrite d2/d19/d49/f54 [0,4194304] 0 2024-04-25T22:42:15.168 INFO:tasks.workunit.client.0.smithi057.stdout:3/408: link d0/d4/d7/l13 d0/d4/d7/d46/d30/l88 0 2024-04-25T22:42:15.168 INFO:tasks.workunit.client.0.smithi057.stdout:8/426: dread d4/f4f [0,4194304] 0 2024-04-25T22:42:15.169 INFO:tasks.workunit.client.0.smithi057.stdout:6/472: read d2/d19/d50/d1a/f52 [1838833,13447] 0 2024-04-25T22:42:15.170 INFO:tasks.workunit.client.0.smithi057.stdout:3/409: rmdir d0/d4/d7/d46/d30/d7a 39 2024-04-25T22:42:15.170 INFO:tasks.workunit.client.0.smithi057.stdout:3/410: fdatasync d0/d5b/f79 0 2024-04-25T22:42:15.171 INFO:tasks.workunit.client.0.smithi057.stdout:6/473: chown d2/d19/d26/d4f/c71 99489969 1 2024-04-25T22:42:15.172 INFO:tasks.workunit.client.0.smithi057.stdout:3/411: mkdir d0/d4/d7/d26/d89 0 2024-04-25T22:42:15.174 INFO:tasks.workunit.client.0.smithi057.stdout:5/438: dread d2/d6/db/f25 [0,4194304] 0 2024-04-25T22:42:15.174 INFO:tasks.workunit.client.0.smithi057.stdout:3/412: creat d0/d4/d7/d46/f8a x:0 0 0 2024-04-25T22:42:15.174 INFO:tasks.workunit.client.0.smithi057.stdout:1/447: dwrite d7/dd/d16/d18/f39 [4194304,4194304] 0 2024-04-25T22:42:15.174 INFO:tasks.workunit.client.0.smithi057.stdout:5/439: fsync d2/d2c/f81 0 2024-04-25T22:42:15.176 INFO:tasks.workunit.client.0.smithi057.stdout:1/448: mkdir d7/dd/d90 0 2024-04-25T22:42:15.176 INFO:tasks.workunit.client.0.smithi057.stdout:3/413: mkdir d0/d4/d7b/d7c/d8b 0 2024-04-25T22:42:15.176 INFO:tasks.workunit.client.0.smithi057.stdout:7/433: dwrite d6/f54 [0,4194304] 0 2024-04-25T22:42:15.178 INFO:tasks.workunit.client.0.smithi057.stdout:3/414: chown d0/d4/d4a/l5f 0 1 2024-04-25T22:42:15.180 INFO:tasks.workunit.client.0.smithi057.stdout:3/415: rmdir d0/d4/d7/d26/d72 39 2024-04-25T22:42:15.180 INFO:tasks.workunit.client.0.smithi057.stdout:4/471: write d14/d47/d62/f88 [2572633,98673] 0 2024-04-25T22:42:15.180 INFO:tasks.workunit.client.0.smithi057.stdout:1/449: mknod d7/dd/d16/d18/d31/d8f/c91 0 2024-04-25T22:42:15.182 INFO:tasks.workunit.client.0.smithi057.stdout:8/427: write d4/f43 [1171390,94892] 0 2024-04-25T22:42:15.182 INFO:tasks.workunit.client.0.smithi057.stdout:0/483: write d0/d3/d6/d29/f6c [781418,30830] 0 2024-04-25T22:42:15.182 INFO:tasks.workunit.client.0.smithi057.stdout:6/474: write d2/d19/d26/d63/f66 [622091,107629] 0 2024-04-25T22:42:15.183 INFO:tasks.workunit.client.0.smithi057.stdout:6/475: read d2/d19/d50/d1a/f52 [363823,42072] 0 2024-04-25T22:42:15.183 INFO:tasks.workunit.client.0.smithi057.stdout:0/484: fsync d0/d3/d4d/f1d 0 2024-04-25T22:42:15.185 INFO:tasks.workunit.client.0.smithi057.stdout:3/416: getdents d0/d4/d34/d3c/d70 0 2024-04-25T22:42:15.185 INFO:tasks.workunit.client.0.smithi057.stdout:6/476: creat d2/d19/d50/d1a/f93 x:0 0 0 2024-04-25T22:42:15.185 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:15.179+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:15.186 INFO:tasks.workunit.client.0.smithi057.stdout:5/440: dwrite d2/d6/db/f2b [0,4194304] 0 2024-04-25T22:42:15.186 INFO:tasks.workunit.client.0.smithi057.stdout:8/428: symlink d4/d5/d17/d19/d35/d83/d92/d5b/d8c/la5 0 2024-04-25T22:42:15.186 INFO:tasks.workunit.client.0.smithi057.stdout:4/472: read d14/d47/d5e/f77 [494191,77694] 0 2024-04-25T22:42:15.186 INFO:tasks.workunit.client.0.smithi057.stdout:6/477: mknod d2/d19/d26/d63/c94 0 2024-04-25T22:42:15.187 INFO:tasks.workunit.client.0.smithi057.stdout:5/441: fdatasync d2/d1c/d46/f84 0 2024-04-25T22:42:15.187 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:15.187 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:15.188 INFO:tasks.workunit.client.0.smithi057.stdout:3/417: rename d0/d4/d7/d46/d30/f82 to d0/d4/d34/d3c/f8c 0 2024-04-25T22:42:15.188 INFO:tasks.workunit.client.0.smithi057.stdout:8/429: mkdir d4/d5/d17/d19/d35/d83/d92/da6 0 2024-04-25T22:42:15.188 INFO:tasks.workunit.client.0.smithi057.stdout:3/418: rmdir d0/d4/d7b 39 2024-04-25T22:42:15.189 INFO:tasks.workunit.client.0.smithi057.stdout:6/478: rename d2/d73 to d2/d19/d26/d4f/d95 0 2024-04-25T22:42:15.189 INFO:tasks.workunit.client.0.smithi057.stdout:5/442: fsync d2/d47/d6e/f82 0 2024-04-25T22:42:15.189 INFO:tasks.workunit.client.0.smithi057.stdout:4/473: rename d14/d2f/l9a to d14/d2f/l9f 0 2024-04-25T22:42:15.190 INFO:tasks.workunit.client.0.smithi057.stdout:5/443: dread - d2/d47/f68 zero size 2024-04-25T22:42:15.190 INFO:tasks.workunit.client.0.smithi057.stdout:8/430: write d4/db/dd/d3a/f74 [843849,54125] 0 2024-04-25T22:42:15.190 INFO:tasks.workunit.client.0.smithi057.stdout:3/419: write d0/f6 [228957,7941] 0 2024-04-25T22:42:15.190 INFO:tasks.workunit.client.0.smithi057.stdout:1/450: dwrite d7/dd/d26/f8c [0,4194304] 0 2024-04-25T22:42:15.191 INFO:tasks.workunit.client.0.smithi057.stdout:5/444: mkdir d2/d91 0 2024-04-25T22:42:15.191 INFO:tasks.workunit.client.0.smithi057.stdout:8/431: mkdir d4/d5/d17/da7 0 2024-04-25T22:42:15.191 INFO:tasks.workunit.client.0.smithi057.stdout:1/451: creat d7/f92 x:0 0 0 2024-04-25T22:42:15.191 INFO:tasks.workunit.client.0.smithi057.stdout:6/479: symlink d2/d19/d85/l96 0 2024-04-25T22:42:15.192 INFO:tasks.workunit.client.0.smithi057.stdout:8/432: unlink d4/db/dd/df/f13 0 2024-04-25T22:42:15.192 INFO:tasks.workunit.client.0.smithi057.stdout:1/452: truncate d7/f6c 85047 0 2024-04-25T22:42:15.193 INFO:tasks.workunit.client.0.smithi057.stdout:5/445: link d2/f10 d2/d6/f92 0 2024-04-25T22:42:15.193 INFO:tasks.workunit.client.0.smithi057.stdout:6/480: write d2/d19/d49/d62/f7e [120017,110244] 0 2024-04-25T22:42:15.193 INFO:tasks.workunit.client.0.smithi057.stdout:5/446: stat d2/d47/f8c 0 2024-04-25T22:42:15.194 INFO:tasks.workunit.client.0.smithi057.stdout:6/481: mknod d2/d19/d50/c97 0 2024-04-25T22:42:15.195 INFO:tasks.workunit.client.0.smithi057.stdout:8/433: rename d4/d5/d17/d19/d35/d83/d92/f96 to d4/d5/d17/d19/d35/d83/d92/fa8 0 2024-04-25T22:42:15.195 INFO:tasks.workunit.client.0.smithi057.stdout:5/447: symlink d2/d1c/d24/d3d/d50/l93 0 2024-04-25T22:42:15.195 INFO:tasks.workunit.client.0.smithi057.stdout:5/448: rmdir d2/d47/d6e 39 2024-04-25T22:42:15.196 INFO:tasks.workunit.client.0.smithi057.stdout:8/434: truncate d4/d5/d17/f9d 1044424 0 2024-04-25T22:42:15.196 INFO:tasks.workunit.client.0.smithi057.stdout:5/449: mkdir d2/d47/d94 0 2024-04-25T22:42:15.196 INFO:tasks.workunit.client.0.smithi057.stdout:8/435: fsync d4/d5/d21/f6c 0 2024-04-25T22:42:15.197 INFO:tasks.workunit.client.0.smithi057.stdout:5/450: rename d2/d6/db/f7d to d2/d1c/d24/d8f/f95 0 2024-04-25T22:42:15.197 INFO:tasks.workunit.client.0.smithi057.stdout:6/482: read d2/d19/d50/d1a/d22/d31/f33 [32251,95993] 0 2024-04-25T22:42:15.198 INFO:tasks.workunit.client.0.smithi057.stdout:6/483: rmdir d2/d59 39 2024-04-25T22:42:15.199 INFO:tasks.workunit.client.0.smithi057.stdout:3/420: dread d0/d4/d4a/f4c [0,4194304] 0 2024-04-25T22:42:15.199 INFO:tasks.workunit.client.0.smithi057.stdout:5/451: link d2/d1c/d46/c1d d2/d1c/d46/d3a/c96 0 2024-04-25T22:42:15.200 INFO:tasks.workunit.client.0.smithi057.stdout:5/452: symlink d2/l97 0 2024-04-25T22:42:15.200 INFO:tasks.workunit.client.0.smithi057.stdout:3/421: chown d0/d4/d7/l74 362895 1 2024-04-25T22:42:15.201 INFO:tasks.workunit.client.0.smithi057.stdout:3/422: symlink d0/d6b/l8d 0 2024-04-25T22:42:15.201 INFO:tasks.workunit.client.0.smithi057.stdout:5/453: rmdir d2/d1c/d24/d3d/d50/d83 39 2024-04-25T22:42:15.202 INFO:tasks.workunit.client.0.smithi057.stdout:3/423: creat d0/d5b/f8e x:0 0 0 2024-04-25T22:42:15.204 INFO:tasks.workunit.client.0.smithi057.stdout:5/454: link d2/d6/f62 d2/d47/d6e/f98 0 2024-04-25T22:42:15.204 INFO:tasks.workunit.client.0.smithi057.stdout:8/436: dwrite d4/d5/d17/d19/d35/f5a [0,4194304] 0 2024-04-25T22:42:15.206 INFO:tasks.workunit.client.0.smithi057.stdout:3/424: rename d0/d4/d7b/d7c/d8b to d0/d4/d7b/d8f 0 2024-04-25T22:42:15.206 INFO:tasks.workunit.client.0.smithi057.stdout:8/437: creat d4/d5/d17/da7/fa9 x:0 0 0 2024-04-25T22:42:15.206 INFO:tasks.workunit.client.0.smithi057.stdout:5/455: symlink d2/d1c/d24/d3d/d77/l99 0 2024-04-25T22:42:15.206 INFO:tasks.workunit.client.0.smithi057.stdout:6/484: dwrite d2/d19/d26/d63/f7d [4194304,4194304] 0 2024-04-25T22:42:15.206 INFO:tasks.workunit.client.0.smithi057.stdout:5/456: dread - d2/d6/db/f85 zero size 2024-04-25T22:42:15.208 INFO:tasks.workunit.client.0.smithi057.stdout:8/438: symlink d4/db/dd/d3a/d71/laa 0 2024-04-25T22:42:15.208 INFO:tasks.workunit.client.0.smithi057.stdout:5/457: truncate d2/d47/d60/f6d 876671 0 2024-04-25T22:42:15.210 INFO:tasks.workunit.client.0.smithi057.stdout:6/485: creat d2/d86/f98 x:0 0 0 2024-04-25T22:42:15.210 INFO:tasks.workunit.client.0.smithi057.stdout:3/425: creat d0/d4/f90 x:0 0 0 2024-04-25T22:42:15.210 INFO:tasks.workunit.client.0.smithi057.stdout:8/439: truncate d4/d5/d17/d19/d35/d83/d92/d5b/f6b 127877 0 2024-04-25T22:42:15.211 INFO:tasks.workunit.client.0.smithi057.stdout:5/458: symlink d2/d6/db/l9a 0 2024-04-25T22:42:15.211 INFO:tasks.workunit.client.0.smithi057.stdout:5/459: readlink d2/d1c/l40 0 2024-04-25T22:42:15.211 INFO:tasks.workunit.client.0.smithi057.stdout:3/426: chown d0/l38 55 1 2024-04-25T22:42:15.212 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:15.213 INFO:tasks.workunit.client.0.smithi057.stdout:5/460: rmdir d2/d1c/d46/d3a/d6a 39 2024-04-25T22:42:15.213 INFO:tasks.workunit.client.0.smithi057.stdout:3/427: truncate d0/d4/d34/d3c/f5c 1494831 0 2024-04-25T22:42:15.213 INFO:tasks.workunit.client.0.smithi057.stdout:6/486: fsync d2/d19/d50/d1a/f46 0 2024-04-25T22:42:15.213 INFO:tasks.workunit.client.0.smithi057.stdout:3/428: chown d0/d11/c18 26 1 2024-04-25T22:42:15.214 INFO:tasks.workunit.client.0.smithi057.stdout:5/461: mknod d2/d1c/d24/d8f/c9b 0 2024-04-25T22:42:15.214 INFO:tasks.workunit.client.0.smithi057.stdout:6/487: mknod d2/d19/d26/d63/c99 0 2024-04-25T22:42:15.215 INFO:tasks.workunit.client.0.smithi057.stdout:3/429: mkdir d0/d4/d7/d46/d30/d7a/d91 0 2024-04-25T22:42:15.216 INFO:tasks.workunit.client.0.smithi057.stdout:3/430: write d0/fa [8473532,101351] 0 2024-04-25T22:42:15.217 INFO:tasks.workunit.client.0.smithi057.stdout:8/440: dwrite d4/d5/f7 [0,4194304] 0 2024-04-25T22:42:15.217 INFO:tasks.workunit.client.0.smithi057.stdout:3/431: rename d0/d4/d34/d3c/f78 to d0/d4/d7/d22/f92 0 2024-04-25T22:42:15.218 INFO:tasks.workunit.client.0.smithi057.stdout:3/432: stat d0/d4/d7/d46/d30 0 2024-04-25T22:42:15.219 INFO:tasks.workunit.client.0.smithi057.stdout:8/441: getdents d4/d5/d21 0 2024-04-25T22:42:15.220 INFO:tasks.workunit.client.0.smithi057.stdout:8/442: rename d4/db/dd/d3a/d71/c7b to d4/d5/cab 0 2024-04-25T22:42:15.220 INFO:tasks.workunit.client.0.smithi057.stdout:8/443: mknod d4/cac 0 2024-04-25T22:42:15.221 INFO:tasks.workunit.client.0.smithi057.stdout:8/444: chown d4/d5 744 1 2024-04-25T22:42:15.224 INFO:tasks.workunit.client.0.smithi057.stdout:7/434: dread d6/d28/d4e/d30/f5a [0,4194304] 0 2024-04-25T22:42:15.227 INFO:tasks.workunit.client.0.smithi057.stdout:9/438: sync 2024-04-25T22:42:15.227 INFO:tasks.workunit.client.0.smithi057.stdout:2/518: sync 2024-04-25T22:42:15.229 INFO:tasks.workunit.client.0.smithi057.stdout:9/439: write d3/d34/d42/d28/d2d/f40 [1543022,51160] 0 2024-04-25T22:42:15.230 INFO:tasks.workunit.client.0.smithi057.stdout:8/445: dwrite d4/d5/d17/d19/d35/d83/d92/d5b/f6b [0,4194304] 0 2024-04-25T22:42:15.230 INFO:tasks.workunit.client.0.smithi057.stdout:2/519: link d1f/d36/l9a d1f/d21/d26/d63/d7f/d86/lb2 0 2024-04-25T22:42:15.231 INFO:tasks.workunit.client.0.smithi057.stdout:9/440: rename d3/d34/d42/c4a to d3/d34/d42/d28/d39/c8f 0 2024-04-25T22:42:15.231 INFO:tasks.workunit.client.0.smithi057.stdout:7/435: dwrite d6/d28/d4e/d30/d46/f49 [0,4194304] 0 2024-04-25T22:42:15.232 INFO:tasks.workunit.client.0.smithi057.stdout:9/441: fsync d3/d34/f6b 0 2024-04-25T22:42:15.233 INFO:tasks.workunit.client.0.smithi057.stdout:7/436: write d6/d28/d4e/d1d/f2a [4855278,119510] 0 2024-04-25T22:42:15.233 INFO:tasks.workunit.client.0.smithi057.stdout:9/442: mknod d3/d34/d42/d28/d62/d67/c90 0 2024-04-25T22:42:15.234 INFO:tasks.workunit.client.0.smithi057.stdout:7/437: dread - d6/d28/d4e/d30/d60/f86 zero size 2024-04-25T22:42:15.234 INFO:tasks.workunit.client.0.smithi057.stdout:9/443: fdatasync d3/d34/f73 0 2024-04-25T22:42:15.236 INFO:tasks.workunit.client.0.smithi057.stdout:9/444: creat d3/d34/d42/d28/f91 x:0 0 0 2024-04-25T22:42:15.237 INFO:tasks.workunit.client.0.smithi057.stdout:9/445: mknod d3/d34/d42/d28/d62/d67/d6e/c92 0 2024-04-25T22:42:15.238 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:42:15.239 INFO:tasks.workunit.client.0.smithi057.stdout:5/462: dread d2/d2c/f4e [0,4194304] 0 2024-04-25T22:42:15.239 INFO:tasks.workunit.client.0.smithi057.stdout:8/446: truncate d4/d5/d17/d19/d35/d83/d92/d5b/f6b 3483213 0 2024-04-25T22:42:15.239 INFO:tasks.workunit.client.0.smithi057.stdout:9/446: mkdir d3/d34/d42/d28/d62/d67/d6e/d7c/d93 0 2024-04-25T22:42:15.241 INFO:tasks.workunit.client.0.smithi057.stdout:5/463: chown d2/d1c/d46/d3a 71029 1 2024-04-25T22:42:15.241 INFO:tasks.workunit.client.0.smithi057.stdout:8/447: read d4/f4f [266690,81277] 0 2024-04-25T22:42:15.241 INFO:tasks.workunit.client.0.smithi057.stdout:9/447: dread - d3/d34/d42/d28/f72 zero size 2024-04-25T22:42:15.241 INFO:tasks.workunit.client.0.smithi057.stdout:7/438: dwrite d6/f54 [4194304,4194304] 0 2024-04-25T22:42:15.242 INFO:tasks.workunit.client.0.smithi057.stdout:8/448: fdatasync d4/d5/d17/d19/d35/d83/d92/f68 0 2024-04-25T22:42:15.242 INFO:tasks.workunit.client.0.smithi057.stdout:7/439: write d6/d28/f33 [8171358,115234] 0 2024-04-25T22:42:15.242 INFO:tasks.workunit.client.0.smithi057.stdout:9/448: creat d3/d34/d42/d28/d62/d67/f94 x:0 0 0 2024-04-25T22:42:15.244 INFO:tasks.workunit.client.0.smithi057.stdout:8/449: symlink d4/db/dd/d3a/d94/lad 0 2024-04-25T22:42:15.244 INFO:tasks.workunit.client.0.smithi057.stdout:9/449: mkdir d3/d34/d42/d28/d95 0 2024-04-25T22:42:15.244 INFO:tasks.workunit.client.0.smithi057.stdout:7/440: truncate d6/d28/d4e/d1d/d51/d5f/f80 54463 0 2024-04-25T22:42:15.245 INFO:tasks.workunit.client.0.smithi057.stdout:8/450: rename d4/db/dd/f2b to d4/db/dd/fae 0 2024-04-25T22:42:15.245 INFO:tasks.workunit.client.0.smithi057.stdout:5/464: dread d2/d1c/d24/d74/f8e [0,4194304] 0 2024-04-25T22:42:15.246 INFO:tasks.workunit.client.0.smithi057.stdout:7/441: chown d6/d28/d4e/d1d/d51/f83 958883698 1 2024-04-25T22:42:15.246 INFO:tasks.workunit.client.0.smithi057.stdout:8/451: chown d4/db/dd/d3a/d5c/d76 13 1 2024-04-25T22:42:15.247 INFO:tasks.workunit.client.0.smithi057.stdout:8/452: creat d4/d5/d17/d19/d35/faf x:0 0 0 2024-04-25T22:42:15.247 INFO:tasks.workunit.client.0.smithi057.stdout:5/465: truncate d2/d1c/d46/f35 577224 0 2024-04-25T22:42:15.248 INFO:tasks.workunit.client.0.smithi057.stdout:7/442: rename d6/d28/f81 to d6/d28/d4e/d1d/d51/d5f/f8e 0 2024-04-25T22:42:15.250 INFO:tasks.workunit.client.0.smithi057.stdout:8/453: rename d4/db/dd/df to d4/d5/d21/db0 0 2024-04-25T22:42:15.250 INFO:tasks.workunit.client.0.smithi057.stdout:9/450: dwrite d3/d34/f5b [0,4194304] 0 2024-04-25T22:42:15.252 INFO:tasks.workunit.client.0.smithi057.stdout:9/451: write d3/d34/d42/d28/f85 [641224,19919] 0 2024-04-25T22:42:15.253 INFO:tasks.workunit.client.0.smithi057.stdout:9/452: symlink d3/d34/d42/l96 0 2024-04-25T22:42:15.254 INFO:tasks.workunit.client.0.smithi057.stdout:9/453: unlink d3/l25 0 2024-04-25T22:42:15.255 INFO:tasks.workunit.client.0.smithi057.stdout:9/454: rmdir d3/d34/d42 39 2024-04-25T22:42:15.255 INFO:tasks.workunit.client.0.smithi057.stdout:7/443: dwrite d6/d28/d4e/f31 [0,4194304] 0 2024-04-25T22:42:15.256 INFO:tasks.workunit.client.0.smithi057.stdout:9/455: creat d3/d34/d42/d28/d62/d67/d6e/d7c/f97 x:0 0 0 2024-04-25T22:42:15.256 INFO:tasks.workunit.client.0.smithi057.stdout:7/444: creat d6/d28/d4e/d30/d60/d6f/d8a/f8f x:0 0 0 2024-04-25T22:42:15.257 INFO:tasks.workunit.client.0.smithi057.stdout:7/445: write d6/d28/d4e/d1d/d51/f68 [453443,48077] 0 2024-04-25T22:42:15.258 INFO:tasks.workunit.client.0.smithi057.stdout:9/456: getdents d3/d34/d42/d28 0 2024-04-25T22:42:15.259 INFO:tasks.workunit.client.0.smithi057.stdout:7/446: dread - d6/d28/d4e/d1d/d59/f61 zero size 2024-04-25T22:42:15.259 INFO:tasks.workunit.client.0.smithi057.stdout:9/457: getdents d3/d34 0 2024-04-25T22:42:15.260 INFO:tasks.workunit.client.0.smithi057.stdout:7/447: creat d6/d28/d4e/d30/d46/f90 x:0 0 0 2024-04-25T22:42:15.260 INFO:tasks.workunit.client.0.smithi057.stdout:9/458: mkdir d3/d98 0 2024-04-25T22:42:15.261 INFO:tasks.workunit.client.0.smithi057.stdout:7/448: mkdir d6/d91 0 2024-04-25T22:42:15.261 INFO:tasks.workunit.client.0.smithi057.stdout:5/466: dwrite d2/d6/f92 [0,4194304] 0 2024-04-25T22:42:15.262 INFO:tasks.workunit.client.0.smithi057.stdout:5/467: rmdir d2/d47 39 2024-04-25T22:42:15.262 INFO:tasks.workunit.client.0.smithi057.stdout:7/449: mknod d6/d28/d4e/d1d/d5d/c92 0 2024-04-25T22:42:15.263 INFO:tasks.workunit.client.0.smithi057.stdout:5/468: truncate d2/d6/db/f17 4516541 0 2024-04-25T22:42:15.265 INFO:tasks.workunit.client.0.smithi057.stdout:5/469: dread - d2/d1c/d46/d3a/d6a/f7f zero size 2024-04-25T22:42:15.267 INFO:tasks.workunit.client.0.smithi057.stdout:7/450: dread d6/d28/d4e/d30/d46/f49 [0,4194304] 0 2024-04-25T22:42:15.267 INFO:tasks.workunit.client.0.smithi057.stdout:9/459: dwrite d3/f23 [0,4194304] 0 2024-04-25T22:42:15.269 INFO:tasks.workunit.client.0.smithi057.stdout:7/451: truncate d6/d28/d4e/d1d/d51/d5f/f82 853009 0 2024-04-25T22:42:15.269 INFO:tasks.workunit.client.0.smithi057.stdout:9/460: unlink d3/f14 0 2024-04-25T22:42:15.269 INFO:tasks.workunit.client.0.smithi057.stdout:7/452: chown d6/d28/d4e/d30/d46/d73 0 1 2024-04-25T22:42:15.271 INFO:tasks.workunit.client.0.smithi057.stdout:9/461: link d3/d34/d42/l96 d3/d34/d42/d28/d65/l99 0 2024-04-25T22:42:15.271 INFO:tasks.workunit.client.0.smithi057.stdout:7/453: symlink d6/d28/d4e/d1d/d51/d5f/d7d/l93 0 2024-04-25T22:42:15.271 INFO:tasks.workunit.client.0.smithi057.stdout:9/462: stat d3/d34/d42/d28/f91 0 2024-04-25T22:42:15.272 INFO:tasks.workunit.client.0.smithi057.stdout:9/463: creat d3/d34/d42/d28/f9a x:0 0 0 2024-04-25T22:42:15.273 INFO:tasks.workunit.client.0.smithi057.stdout:7/454: rename d6/d28/d4e/d30/d60/d6f/f77 to d6/d28/d4e/d30/d60/d6f/f94 0 2024-04-25T22:42:15.274 INFO:tasks.workunit.client.0.smithi057.stdout:7/455: symlink d6/d28/d4e/d1d/d59/d84/l95 0 2024-04-25T22:42:15.275 INFO:tasks.workunit.client.0.smithi057.stdout:7/456: stat d6/d28/d4e/d30/d46/l57 0 2024-04-25T22:42:15.275 INFO:tasks.workunit.client.0.smithi057.stdout:8/454: write d4/db/dd/f20 [5096519,55463] 0 2024-04-25T22:42:15.276 INFO:tasks.workunit.client.0.smithi057.stdout:8/455: readlink d4/d5/d21/l91 0 2024-04-25T22:42:15.277 INFO:tasks.workunit.client.0.smithi057.stdout:8/456: getdents d4/db/dd/d3a/d94 0 2024-04-25T22:42:15.278 INFO:tasks.workunit.client.0.smithi057.stdout:0/485: sync 2024-04-25T22:42:15.278 INFO:tasks.workunit.client.0.smithi057.stdout:4/474: sync 2024-04-25T22:42:15.279 INFO:tasks.workunit.client.0.smithi057.stdout:8/457: dread d4/db/fc [0,4194304] 0 2024-04-25T22:42:15.280 INFO:tasks.workunit.client.0.smithi057.stdout:8/458: write d4/d5/d17/d19/d35/d83/d92/fa8 [4487675,35136] 0 2024-04-25T22:42:15.281 INFO:tasks.workunit.client.0.smithi057.stdout:5/470: write d2/d1c/d46/f89 [140095,112314] 0 2024-04-25T22:42:15.282 INFO:tasks.workunit.client.0.smithi057.stdout:8/459: write d4/d5/d17/da7/fa9 [778496,50907] 0 2024-04-25T22:42:15.282 INFO:tasks.workunit.client.0.smithi057.stdout:5/471: chown d2/d1c/d46/d3a/d6a 48679983 1 2024-04-25T22:42:15.282 INFO:tasks.workunit.client.0.smithi057.stdout:7/457: truncate d6/f4b 2607806 0 2024-04-25T22:42:15.282 INFO:tasks.workunit.client.0.smithi057.stdout:4/475: truncate d14/f25 749629 0 2024-04-25T22:42:15.283 INFO:tasks.workunit.client.0.smithi057.stdout:8/460: write d4/d5/d21/f4c [3384492,62819] 0 2024-04-25T22:42:15.283 INFO:tasks.workunit.client.0.smithi057.stdout:5/472: getdents d2/d91 0 2024-04-25T22:42:15.284 INFO:tasks.workunit.client.0.smithi057.stdout:8/461: fdatasync d4/db/dd/f20 0 2024-04-25T22:42:15.284 INFO:tasks.workunit.client.0.smithi057.stdout:9/464: rename d3/d34/d42/d28/f5d to d3/d34/d42/d28/d65/f9b 0 2024-04-25T22:42:15.284 INFO:tasks.workunit.client.0.smithi057.stdout:5/473: chown d2/d1c/d24/d3d/d50/d83 17888 1 2024-04-25T22:42:15.285 INFO:tasks.workunit.client.0.smithi057.stdout:7/458: rename d6/d28/d4e/d1d to d6/d28/d4e/d30/d60/d8d/d96 0 2024-04-25T22:42:15.285 INFO:tasks.workunit.client.0.smithi057.stdout:5/474: creat d2/d47/d94/f9c x:0 0 0 2024-04-25T22:42:15.286 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:15.284+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:15.286 INFO:tasks.workunit.client.0.smithi057.stdout:8/462: read d4/f5e [2134342,103768] 0 2024-04-25T22:42:15.287 INFO:tasks.workunit.client.0.smithi057.stdout:7/459: readlink d6/d28/d4e/d30/d60/d8d/d96/l24 0 2024-04-25T22:42:15.287 INFO:tasks.workunit.client.0.smithi057.stdout:5/475: chown d2/c3 12921214 1 2024-04-25T22:42:15.287 INFO:tasks.workunit.client.0.smithi057.stdout:8/463: write d4/d5/f9f [5094646,128677] 0 2024-04-25T22:42:15.288 INFO:tasks.workunit.client.0.smithi057.stdout:5/476: unlink d2/d2c/f57 0 2024-04-25T22:42:15.289 INFO:tasks.workunit.client.0.smithi057.stdout:9/465: mkdir d3/d34/d42/d28/d2d/d9c 0 2024-04-25T22:42:15.289 INFO:tasks.workunit.client.0.smithi057.stdout:8/464: write d4/d5/d21/f2a [170796,104510] 0 2024-04-25T22:42:15.290 INFO:tasks.workunit.client.0.smithi057.stdout:4/476: dwrite ff [4194304,4194304] 0 2024-04-25T22:42:15.291 INFO:tasks.workunit.client.0.smithi057.stdout:7/460: dread d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/f82 [0,4194304] 0 2024-04-25T22:42:15.292 INFO:tasks.workunit.client.0.smithi057.stdout:4/477: symlink d14/d47/la0 0 2024-04-25T22:42:15.292 INFO:tasks.workunit.client.0.smithi057.stdout:5/477: write d2/d6/f62 [690994,81419] 0 2024-04-25T22:42:15.292 INFO:tasks.workunit.client.0.smithi057.stdout:7/461: mkdir d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d97 0 2024-04-25T22:42:15.293 INFO:tasks.workunit.client.0.smithi057.stdout:4/478: read - d14/d2f/f99 zero size 2024-04-25T22:42:15.293 INFO:tasks.workunit.client.0.smithi057.stdout:9/466: creat d3/d34/d42/d28/d2d/d7a/f9d x:0 0 0 2024-04-25T22:42:15.294 INFO:tasks.workunit.client.0.smithi057.stdout:4/479: readlink d14/d2f/d4c/d5b/l68 0 2024-04-25T22:42:15.294 INFO:tasks.workunit.client.0.smithi057.stdout:5/478: mkdir d2/d1c/d24/d9d 0 2024-04-25T22:42:15.294 INFO:tasks.workunit.client.0.smithi057.stdout:7/462: mkdir d6/d28/d4e/d30/d46/d73/d98 0 2024-04-25T22:42:15.295 INFO:tasks.workunit.client.0.smithi057.stdout:7/463: write d6/f14 [3719125,129904] 0 2024-04-25T22:42:15.296 INFO:tasks.workunit.client.0.smithi057.stdout:9/467: rename d3/d34/d42/d28/d39/l89 to d3/d34/d42/d28/l9e 0 2024-04-25T22:42:15.296 INFO:tasks.workunit.client.0.smithi057.stdout:9/468: dread - d3/f32 zero size 2024-04-25T22:42:15.297 INFO:tasks.workunit.client.0.smithi057.stdout:7/464: write d6/d28/d4e/d30/f5a [2688056,7762] 0 2024-04-25T22:42:15.297 INFO:tasks.workunit.client.0.smithi057.stdout:9/469: fsync d3/d34/d42/d28/f6f 0 2024-04-25T22:42:15.299 INFO:tasks.workunit.client.0.smithi057.stdout:9/470: write d3/d34/d42/d28/d39/f3a [2096969,67447] 0 2024-04-25T22:42:15.300 INFO:tasks.workunit.client.0.smithi057.stdout:9/471: creat d3/d34/d42/d28/d2d/d9c/f9f x:0 0 0 2024-04-25T22:42:15.301 INFO:tasks.workunit.client.0.smithi057.stdout:5/479: dread d2/d6/f69 [0,4194304] 0 2024-04-25T22:42:15.303 INFO:tasks.workunit.client.0.smithi057.stdout:9/472: rename d3/d34/d42/d28/d65/l99 to d3/d34/d42/d28/d65/la0 0 2024-04-25T22:42:15.303 INFO:tasks.workunit.client.0.smithi057.stdout:7/465: dwrite d6/d28/d4e/d30/f36 [0,4194304] 0 2024-04-25T22:42:15.304 INFO:tasks.workunit.client.0.smithi057.stdout:7/466: creat d6/d28/d4e/d30/d46/f99 x:0 0 0 2024-04-25T22:42:15.308 INFO:tasks.workunit.client.0.smithi057.stdout:9/473: truncate d3/d34/d42/d28/d39/f3a 1170853 0 2024-04-25T22:42:15.310 INFO:tasks.workunit.client.0.smithi057.stdout:9/474: getdents d3/d34/d42/d28/d95 0 2024-04-25T22:42:15.311 INFO:tasks.workunit.client.0.smithi057.stdout:5/480: dread d2/d47/d6e/f98 [0,4194304] 0 2024-04-25T22:42:15.311 INFO:tasks.workunit.client.0.smithi057.stdout:9/475: creat d3/fa1 x:0 0 0 2024-04-25T22:42:15.312 INFO:tasks.workunit.client.0.smithi057.stdout:7/467: dwrite d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/f82 [0,4194304] 0 2024-04-25T22:42:15.313 INFO:tasks.workunit.client.0.smithi057.stdout:5/481: getdents d2/d47 0 2024-04-25T22:42:15.313 INFO:tasks.workunit.client.0.smithi057.stdout:9/476: symlink d3/d34/d42/d28/d39/d54/la2 0 2024-04-25T22:42:15.313 INFO:tasks.workunit.client.0.smithi057.stdout:5/482: truncate d2/d47/d94/f9c 382510 0 2024-04-25T22:42:15.314 INFO:tasks.workunit.client.0.smithi057.stdout:7/468: fsync d6/d28/f5b 0 2024-04-25T22:42:15.314 INFO:tasks.workunit.client.0.smithi057.stdout:9/477: chown d3/d34/d42/d28/d62/d67/d6e/d7c/f97 302 1 2024-04-25T22:42:15.314 INFO:tasks.workunit.client.0.smithi057.stdout:5/483: truncate d2/f31 4261624 0 2024-04-25T22:42:15.315 INFO:tasks.workunit.client.0.smithi057.stdout:7/469: symlink d6/d28/d4e/d75/l9a 0 2024-04-25T22:42:15.315 INFO:tasks.workunit.client.0.smithi057.stdout:5/484: readlink d2/d1c/d24/d3d/d77/l99 0 2024-04-25T22:42:15.316 INFO:tasks.workunit.client.0.smithi057.stdout:9/478: rename d3/d34/d42/d28/d62/d67/d6e/d7c/d93 to d3/d34/d42/d5e/da3 0 2024-04-25T22:42:15.317 INFO:tasks.workunit.client.0.smithi057.stdout:5/485: rename d2/d6/f69 to d2/d47/f9e 0 2024-04-25T22:42:15.318 INFO:tasks.workunit.client.0.smithi057.stdout:5/486: creat d2/d1c/d24/d3d/d50/d83/f9f x:0 0 0 2024-04-25T22:42:15.321 INFO:tasks.workunit.client.0.smithi057.stdout:9/479: dread d3/f1a [0,4194304] 0 2024-04-25T22:42:15.322 INFO:tasks.workunit.client.0.smithi057.stdout:7/470: dwrite d6/d28/d4e/d30/d60/d8d/d96/d59/f61 [0,4194304] 0 2024-04-25T22:42:15.323 INFO:tasks.workunit.client.0.smithi057.stdout:9/480: unlink d3/d34/d42/d28/d2d/l4d 0 2024-04-25T22:42:15.323 INFO:tasks.workunit.client.0.smithi057.stdout:5/487: dread d2/d6/f92 [0,4194304] 0 2024-04-25T22:42:15.326 INFO:tasks.workunit.client.0.smithi057.stdout:5/488: rename d2/d2c/l52 to d2/d1c/d24/d8f/la0 0 2024-04-25T22:42:15.329 INFO:tasks.workunit.client.0.smithi057.stdout:5/489: link d2/d1c/d24/d3d/d50/l8a d2/d1c/d24/d3d/la1 0 2024-04-25T22:42:15.330 INFO:tasks.workunit.client.0.smithi057.stdout:7/471: dwrite d6/d28/d4e/d30/d60/d8d/d96/d51/f6d [0,4194304] 0 2024-04-25T22:42:15.330 INFO:tasks.workunit.client.0.smithi057.stdout:9/481: dwrite d3/f64 [0,4194304] 0 2024-04-25T22:42:15.331 INFO:tasks.workunit.client.0.smithi057.stdout:7/472: dread - d6/d28/d4e/f3c zero size 2024-04-25T22:42:15.331 INFO:tasks.workunit.client.0.smithi057.stdout:5/490: link d2/d2c/f5d d2/d1c/d24/d3d/d77/fa2 0 2024-04-25T22:42:15.332 INFO:tasks.workunit.client.0.smithi057.stdout:7/473: write d6/f27 [3868254,50042] 0 2024-04-25T22:42:15.332 INFO:tasks.workunit.client.0.smithi057.stdout:9/482: getdents d3/d34/d42/d28/d39 0 2024-04-25T22:42:15.333 INFO:tasks.workunit.client.0.smithi057.stdout:5/491: write d2/d2c/f5d [2362498,108237] 0 2024-04-25T22:42:15.333 INFO:tasks.workunit.client.0.smithi057.stdout:9/483: write d3/d34/d42/d28/d62/d67/f94 [226801,38102] 0 2024-04-25T22:42:15.334 INFO:tasks.workunit.client.0.smithi057.stdout:5/492: rename d2/c44 to d2/d91/ca3 0 2024-04-25T22:42:15.335 INFO:tasks.workunit.client.0.smithi057.stdout:5/493: symlink d2/d1c/d24/d74/la4 0 2024-04-25T22:42:15.335 INFO:tasks.workunit.client.0.smithi057.stdout:9/484: mknod d3/d34/d42/d5e/d83/ca4 0 2024-04-25T22:42:15.335 INFO:tasks.workunit.client.0.smithi057.stdout:7/474: rename d6/d28/d4e/d30/d60/d8d/d96/d51/f68 to d6/f9b 0 2024-04-25T22:42:15.337 INFO:tasks.workunit.client.0.smithi057.stdout:5/494: truncate d2/d6/db/f25 1438754 0 2024-04-25T22:42:15.337 INFO:tasks.workunit.client.0.smithi057.stdout:5/495: dread - d2/d6/db/f85 zero size 2024-04-25T22:42:15.339 INFO:tasks.workunit.client.0.smithi057.stdout:5/496: rename d2/d1c/d24/d74 to d2/d47/da5 0 2024-04-25T22:42:15.339 INFO:tasks.workunit.client.0.smithi057.stdout:7/475: truncate d6/d28/d4e/d30/d46/f49 989384 0 2024-04-25T22:42:15.340 INFO:tasks.workunit.client.0.smithi057.stdout:7/476: mkdir d6/d28/d4e/d30/d60/d6f/d9c 0 2024-04-25T22:42:15.340 INFO:tasks.workunit.client.0.smithi057.stdout:9/485: dread d3/d34/d42/d28/f51 [0,4194304] 0 2024-04-25T22:42:15.341 INFO:tasks.workunit.client.0.smithi057.stdout:7/477: creat d6/d28/d4e/d30/f9d x:0 0 0 2024-04-25T22:42:15.342 INFO:tasks.workunit.client.0.smithi057.stdout:5/497: chown d2/d47/d60/c76 468014 1 2024-04-25T22:42:15.343 INFO:tasks.workunit.client.0.smithi057.stdout:5/498: chown d2/d6/f62 0 1 2024-04-25T22:42:15.343 INFO:tasks.workunit.client.0.smithi057.stdout:7/478: read d6/f52 [195387,48377] 0 2024-04-25T22:42:15.343 INFO:tasks.workunit.client.0.smithi057.stdout:5/499: read - d2/d6/f71 zero size 2024-04-25T22:42:15.344 INFO:tasks.workunit.client.0.smithi057.stdout:9/486: getdents d3/d34/d42/d5e/d83 0 2024-04-25T22:42:15.344 INFO:tasks.workunit.client.0.smithi057.stdout:7/479: write d6/d28/f41 [4087890,115160] 0 2024-04-25T22:42:15.344 INFO:tasks.workunit.client.0.smithi057.stdout:5/500: unlink d2/d2c/f2e 0 2024-04-25T22:42:15.345 INFO:tasks.workunit.client.0.smithi057.stdout:9/487: mkdir d3/d34/d42/d28/d39/d54/da5 0 2024-04-25T22:42:15.345 INFO:tasks.workunit.client.0.smithi057.stdout:5/501: chown d2/d6/c5e 2571062 1 2024-04-25T22:42:15.345 INFO:tasks.workunit.client.0.smithi057.stdout:9/488: rmdir d3/d34/d42/d28 39 2024-04-25T22:42:15.345 INFO:tasks.workunit.client.0.smithi057.stdout:7/480: chown d6/d28/d4e/d30/d60/d8d/d96/d51/f83 1912722 1 2024-04-25T22:42:15.346 INFO:tasks.workunit.client.0.smithi057.stdout:5/502: chown d2/d6/db/f2b 6247 1 2024-04-25T22:42:15.346 INFO:tasks.workunit.client.0.smithi057.stdout:7/481: write d6/f48 [3324531,42981] 0 2024-04-25T22:42:15.347 INFO:tasks.workunit.client.0.smithi057.stdout:7/482: rename d6/f52 to d6/d28/d4e/d30/d60/d8d/d96/d51/f9e 0 2024-04-25T22:42:15.348 INFO:tasks.workunit.client.0.smithi057.stdout:7/483: write f1 [40340,19025] 0 2024-04-25T22:42:15.349 INFO:tasks.workunit.client.0.smithi057.stdout:7/484: symlink d6/d28/d4e/l9f 0 2024-04-25T22:42:15.351 INFO:tasks.workunit.client.0.smithi057.stdout:7/485: mknod d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d97/ca0 0 2024-04-25T22:42:15.352 INFO:tasks.workunit.client.0.smithi057.stdout:9/489: dwrite d3/d34/d42/d28/f8a [0,4194304] 0 2024-04-25T22:42:15.353 INFO:tasks.workunit.client.0.smithi057.stdout:7/486: rename d6/d28 to d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/da1 22 2024-04-25T22:42:15.354 INFO:tasks.workunit.client.0.smithi057.stdout:9/490: creat d3/d34/d42/fa6 x:0 0 0 2024-04-25T22:42:15.355 INFO:tasks.workunit.client.0.smithi057.stdout:9/491: chown d3/d34/d42/fa6 2018595 1 2024-04-25T22:42:15.357 INFO:tasks.workunit.client.0.smithi057.stdout:9/492: dread - d3/d34/d42/d28/d2d/d7a/f9d zero size 2024-04-25T22:42:15.357 INFO:tasks.workunit.client.0.smithi057.stdout:9/493: chown d3/d34/d42/d28 40539 1 2024-04-25T22:42:15.359 INFO:tasks.workunit.client.0.smithi057.stdout:9/494: fsync d3/d34/d42/d28/d2d/f5c 0 2024-04-25T22:42:15.359 INFO:tasks.workunit.client.0.smithi057.stdout:9/495: chown d3/d34/d42/f41 9200382 1 2024-04-25T22:42:15.360 INFO:tasks.workunit.client.0.smithi057.stdout:7/487: dwrite d6/d28/d4e/d30/f43 [0,4194304] 0 2024-04-25T22:42:15.363 INFO:tasks.workunit.client.0.smithi057.stdout:9/496: mknod d3/d34/d42/d28/d2d/ca7 0 2024-04-25T22:42:15.363 INFO:tasks.workunit.client.0.smithi057.stdout:9/497: fdatasync d3/f70 0 2024-04-25T22:42:15.364 INFO:tasks.workunit.client.0.smithi057.stdout:5/503: dread d2/f31 [0,4194304] 0 2024-04-25T22:42:15.366 INFO:tasks.workunit.client.0.smithi057.stdout:5/504: truncate d2/d6/db/f25 852173 0 2024-04-25T22:42:15.367 INFO:tasks.workunit.client.0.smithi057.stdout:5/505: write d2/d47/f8c [1039215,22871] 0 2024-04-25T22:42:15.367 INFO:tasks.workunit.client.0.smithi057.stdout:9/498: getdents d3/d34/d42/d28/d2d 0 2024-04-25T22:42:15.368 INFO:tasks.workunit.client.0.smithi057.stdout:5/506: write d2/d1c/d24/d3d/f56 [1033983,61865] 0 2024-04-25T22:42:15.371 INFO:tasks.workunit.client.0.smithi057.stdout:5/507: dread d2/f10 [0,4194304] 0 2024-04-25T22:42:15.372 INFO:tasks.workunit.client.0.smithi057.stdout:5/508: fdatasync d2/d1c/d46/f73 0 2024-04-25T22:42:15.372 INFO:tasks.workunit.client.0.smithi057.stdout:9/499: dwrite d3/f5f [4194304,4194304] 0 2024-04-25T22:42:15.373 INFO:tasks.workunit.client.0.smithi057.stdout:5/509: link d2/d1c/f63 d2/d47/d60/fa6 0 2024-04-25T22:42:15.373 INFO:tasks.workunit.client.0.smithi057.stdout:9/500: rmdir d3/d34/d42/d28/d39 39 2024-04-25T22:42:15.374 INFO:tasks.workunit.client.0.smithi057.stdout:6/488: sync 2024-04-25T22:42:15.375 INFO:tasks.workunit.client.0.smithi057.stdout:3/433: sync 2024-04-25T22:42:15.375 INFO:tasks.workunit.client.0.smithi057.stdout:2/520: sync 2024-04-25T22:42:15.375 INFO:tasks.workunit.client.0.smithi057.stdout:1/453: sync 2024-04-25T22:42:15.375 INFO:tasks.workunit.client.0.smithi057.stdout:5/510: rename d2/d1c/d24/d9d to d2/d1c/d24/d3d/da7 0 2024-04-25T22:42:15.375 INFO:tasks.workunit.client.0.smithi057.stdout:9/501: mknod d3/d34/d42/ca8 0 2024-04-25T22:42:15.375 INFO:tasks.workunit.client.0.smithi057.stdout:1/454: rename d7/dd to d7/dd/d16/d24/d63/d93 22 2024-04-25T22:42:15.376 INFO:tasks.workunit.client.0.smithi057.stdout:9/502: dread - d3/d34/d42/d28/f9a zero size 2024-04-25T22:42:15.376 INFO:tasks.workunit.client.0.smithi057.stdout:6/489: creat d2/d19/d85/f9a x:0 0 0 2024-04-25T22:42:15.376 INFO:tasks.workunit.client.0.smithi057.stdout:5/511: mkdir d2/d1c/d46/d3a/da8 0 2024-04-25T22:42:15.376 INFO:tasks.workunit.client.0.smithi057.stdout:3/434: write d0/d4/d34/f77 [2530763,43764] 0 2024-04-25T22:42:15.377 INFO:tasks.workunit.client.0.smithi057.stdout:6/490: dread - d2/d19/d50/f8a zero size 2024-04-25T22:42:15.377 INFO:tasks.workunit.client.0.smithi057.stdout:9/503: mknod d3/d34/d42/d28/d62/ca9 0 2024-04-25T22:42:15.377 INFO:tasks.workunit.client.0.smithi057.stdout:5/512: rmdir d2/d1c/d24/d3d/d50/d83 39 2024-04-25T22:42:15.377 INFO:tasks.workunit.client.0.smithi057.stdout:6/491: dread - d2/d19/d20/f8e zero size 2024-04-25T22:42:15.377 INFO:tasks.workunit.client.0.smithi057.stdout:3/435: creat d0/d4/d7b/d7c/f93 x:0 0 0 2024-04-25T22:42:15.378 INFO:tasks.workunit.client.0.smithi057.stdout:3/436: chown d0/d5b/f79 36144 1 2024-04-25T22:42:15.378 INFO:tasks.workunit.client.0.smithi057.stdout:3/437: chown d0/d4/d7b 4 1 2024-04-25T22:42:15.379 INFO:tasks.workunit.client.0.smithi057.stdout:9/504: mknod d3/d34/d42/d28/d39/d54/da5/caa 0 2024-04-25T22:42:15.379 INFO:tasks.workunit.client.0.smithi057.stdout:9/505: stat d3/d34/d42 0 2024-04-25T22:42:15.380 INFO:tasks.workunit.client.0.smithi057.stdout:9/506: creat d3/d34/d42/d28/d62/d67/d6e/d7c/fab x:0 0 0 2024-04-25T22:42:15.381 INFO:tasks.workunit.client.0.smithi057.stdout:9/507: rmdir d3/d34/d42 39 2024-04-25T22:42:15.381 INFO:tasks.workunit.client.0.smithi057.stdout:9/508: readlink l2 0 2024-04-25T22:42:15.382 INFO:tasks.workunit.client.0.smithi057.stdout:5/513: write d2/d47/da5/f8e [4085697,4080] 0 2024-04-25T22:42:15.384 INFO:tasks.workunit.client.0.smithi057.stdout:5/514: getdents d2/d47/d6e 0 2024-04-25T22:42:15.385 INFO:tasks.workunit.client.0.smithi057.stdout:3/438: dwrite d0/d4/d7b/d7c/f93 [0,4194304] 0 2024-04-25T22:42:15.385 INFO:tasks.workunit.client.0.smithi057.stdout:2/521: dread d1f/d34/f90 [0,4194304] 0 2024-04-25T22:42:15.386 INFO:tasks.workunit.client.0.smithi057.stdout:5/515: write d2/d1c/d46/d3a/d6a/d54/f67 [10567,116229] 0 2024-04-25T22:42:15.386 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:15.384+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:15.387 INFO:tasks.workunit.client.0.smithi057.stdout:3/439: creat d0/d4/d34/d3c/d53/f94 x:0 0 0 2024-04-25T22:42:15.387 INFO:tasks.workunit.client.0.smithi057.stdout:2/522: truncate d1f/d21/d26/f6b 957196 0 2024-04-25T22:42:15.387 INFO:tasks.workunit.client.0.smithi057.stdout:2/523: dread - d1f/d36/f7b zero size 2024-04-25T22:42:15.388 INFO:tasks.workunit.client.0.smithi057.stdout:3/440: write d0/d11/f36 [1915732,111328] 0 2024-04-25T22:42:15.388 INFO:tasks.workunit.client.0.smithi057.stdout:5/516: getdents d2/d1c/d24/d3d/d77 0 2024-04-25T22:42:15.388 INFO:tasks.workunit.client.0.smithi057.stdout:2/524: creat d1f/d21/d26/d63/d7f/fb3 x:0 0 0 2024-04-25T22:42:15.389 INFO:tasks.workunit.client.0.smithi057.stdout:2/525: mkdir d1f/d21/d96/db4 0 2024-04-25T22:42:15.389 INFO:tasks.workunit.client.0.smithi057.stdout:3/441: getdents d0/d4/d7/d46/d30 0 2024-04-25T22:42:15.389 INFO:tasks.workunit.client.0.smithi057.stdout:2/526: write f9 [392706,81368] 0 2024-04-25T22:42:15.390 INFO:tasks.workunit.client.0.smithi057.stdout:5/517: write d2/d2c/f36 [3664367,81021] 0 2024-04-25T22:42:15.390 INFO:tasks.workunit.client.0.smithi057.stdout:2/527: stat d1f/d21/d26/d5c/la6 0 2024-04-25T22:42:15.391 INFO:tasks.workunit.client.0.smithi057.stdout:5/518: chown d2/d1c/l40 24887011 1 2024-04-25T22:42:15.391 INFO:tasks.workunit.client.0.smithi057.stdout:3/442: creat d0/f95 x:0 0 0 2024-04-25T22:42:15.392 INFO:tasks.workunit.client.0.smithi057.stdout:3/443: mkdir d0/d4/d96 0 2024-04-25T22:42:15.392 INFO:tasks.workunit.client.0.smithi057.stdout:3/444: chown d0/d4/d7/d46/f84 72 1 2024-04-25T22:42:15.397 INFO:tasks.workunit.client.0.smithi057.stdout:2/528: write d1f/d21/f46 [134136,81670] 0 2024-04-25T22:42:15.398 INFO:tasks.workunit.client.0.smithi057.stdout:2/529: dread - d1f/d36/d54/f8d zero size 2024-04-25T22:42:15.399 INFO:tasks.workunit.client.0.smithi057.stdout:2/530: symlink d1f/d4a/d4d/d88/lb5 0 2024-04-25T22:42:15.400 INFO:tasks.workunit.client.0.smithi057.stdout:2/531: read d1f/d34/f90 [373194,120003] 0 2024-04-25T22:42:15.401 INFO:tasks.workunit.client.0.smithi057.stdout:9/509: dwrite d3/d34/d42/d28/d65/f8e [0,4194304] 0 2024-04-25T22:42:15.401 INFO:tasks.workunit.client.0.smithi057.stdout:5/519: dwrite d2/d1c/f63 [0,4194304] 0 2024-04-25T22:42:15.402 INFO:tasks.workunit.client.0.smithi057.stdout:9/510: write d3/f9 [1316086,30227] 0 2024-04-25T22:42:15.402 INFO:tasks.workunit.client.0.smithi057.stdout:5/520: rmdir d2/d47/d60 39 2024-04-25T22:42:15.405 INFO:tasks.workunit.client.0.smithi057.stdout:5/521: mknod d2/d47/ca9 0 2024-04-25T22:42:15.405 INFO:tasks.workunit.client.0.smithi057.stdout:9/511: read d3/f4e [7370731,95500] 0 2024-04-25T22:42:15.405 INFO:tasks.workunit.client.0.smithi057.stdout:5/522: chown d2/d6/fa 0 1 2024-04-25T22:42:15.407 INFO:tasks.workunit.client.0.smithi057.stdout:9/512: link d3/d34/d42/d28/d62/d67/d6e/d7c/fab d3/d34/fac 0 2024-04-25T22:42:15.407 INFO:tasks.workunit.client.0.smithi057.stdout:6/492: dread d2/d19/d50/d1a/d22/f29 [0,4194304] 0 2024-04-25T22:42:15.407 INFO:tasks.workunit.client.0.smithi057.stdout:6/493: fdatasync d2/d19/d50/d1a/f74 0 2024-04-25T22:42:15.407 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:15.408 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:15.408 INFO:tasks.workunit.client.0.smithi057.stdout:5/523: dread - d2/d47/d6e/f82 zero size 2024-04-25T22:42:15.410 INFO:tasks.workunit.client.0.smithi057.stdout:5/524: rename d2/d6/c72 to d2/d1c/d46/d3a/da8/caa 0 2024-04-25T22:42:15.411 INFO:tasks.workunit.client.0.smithi057.stdout:5/525: link d2/d1c/d46/f84 d2/d2c/fab 0 2024-04-25T22:42:15.411 INFO:tasks.workunit.client.0.smithi057.stdout:6/494: dread d2/d19/d26/d4f/f6d [0,4194304] 0 2024-04-25T22:42:15.412 INFO:tasks.workunit.client.0.smithi057.stdout:5/526: creat d2/d1c/d24/d3d/da7/fac x:0 0 0 2024-04-25T22:42:15.412 INFO:tasks.workunit.client.0.smithi057.stdout:6/495: unlink d2/d19/d20/l21 0 2024-04-25T22:42:15.412 INFO:tasks.workunit.client.0.smithi057.stdout:5/527: read - d2/d1c/d46/f66 zero size 2024-04-25T22:42:15.412 INFO:tasks.workunit.client.0.smithi057.stdout:6/496: mkdir d2/d19/d9b 0 2024-04-25T22:42:15.412 INFO:tasks.workunit.client.0.smithi057.stdout:5/528: stat d2/d91 0 2024-04-25T22:42:15.413 INFO:tasks.workunit.client.0.smithi057.stdout:5/529: truncate d2/f53 1521194 0 2024-04-25T22:42:15.413 INFO:tasks.workunit.client.0.smithi057.stdout:6/497: stat d2/d19/d50/l15 0 2024-04-25T22:42:15.413 INFO:tasks.workunit.client.0.smithi057.stdout:6/498: fsync d2/d19/d50/d1a/f52 0 2024-04-25T22:42:15.414 INFO:tasks.workunit.client.0.smithi057.stdout:2/532: read d1f/d4a/f81 [153496,23781] 0 2024-04-25T22:42:15.414 INFO:tasks.workunit.client.0.smithi057.stdout:5/530: rename d2/d1c/d46/d3a/d6a/f7f to d2/d47/d94/fad 0 2024-04-25T22:42:15.415 INFO:tasks.workunit.client.0.smithi057.stdout:6/499: mkdir d2/d19/d26/d63/d9c 0 2024-04-25T22:42:15.415 INFO:tasks.workunit.client.0.smithi057.stdout:2/533: mknod d1f/d21/d96/db4/cb6 0 2024-04-25T22:42:15.416 INFO:tasks.workunit.client.0.smithi057.stdout:6/500: rmdir d2/d19/d26/d63/d9c 0 2024-04-25T22:42:15.416 INFO:tasks.workunit.client.0.smithi057.stdout:3/445: dread d0/d4/f2d [0,4194304] 0 2024-04-25T22:42:15.416 INFO:tasks.workunit.client.0.smithi057.stdout:5/531: dread d2/d47/d94/f9c [0,4194304] 0 2024-04-25T22:42:15.417 INFO:tasks.workunit.client.0.smithi057.stdout:6/501: rename d2/d19/d50/c37 to d2/d86/c9d 0 2024-04-25T22:42:15.417 INFO:tasks.workunit.client.0.smithi057.stdout:3/446: mkdir d0/d4/d7/d26/d89/d97 0 2024-04-25T22:42:15.417 INFO:tasks.workunit.client.0.smithi057.stdout:5/532: mknod d2/d1c/d46/d3a/da8/cae 0 2024-04-25T22:42:15.418 INFO:tasks.workunit.client.0.smithi057.stdout:3/447: link d0/f33 d0/d4/f98 0 2024-04-25T22:42:15.419 INFO:tasks.workunit.client.0.smithi057.stdout:6/502: truncate d2/d19/d50/d1a/d22/f5c 1818030 0 2024-04-25T22:42:15.419 INFO:tasks.workunit.client.0.smithi057.stdout:3/448: mkdir d0/d4/d7/d46/d30/d99 0 2024-04-25T22:42:15.423 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:15.424 INFO:tasks.workunit.client.0.smithi057.stdout:6/503: dwrite d2/d19/d49/d62/f7e [0,4194304] 0 2024-04-25T22:42:15.424 INFO:tasks.workunit.client.0.smithi057.stdout:6/504: chown d2/d86/d90 439564 1 2024-04-25T22:42:15.425 INFO:tasks.workunit.client.0.smithi057.stdout:3/449: dread - d0/d4/d7/d46/d30/f6d zero size 2024-04-25T22:42:15.425 INFO:tasks.workunit.client.0.smithi057.stdout:6/505: rmdir d2/d19/d20 39 2024-04-25T22:42:15.426 INFO:tasks.workunit.client.0.smithi057.stdout:6/506: mkdir d2/d19/d20/d9e 0 2024-04-25T22:42:15.426 INFO:tasks.workunit.client.0.smithi057.stdout:6/507: symlink d2/d19/d50/d1a/l9f 0 2024-04-25T22:42:15.431 INFO:tasks.workunit.client.0.smithi057.stdout:6/508: dread d2/d19/d20/d61/f89 [0,4194304] 0 2024-04-25T22:42:15.432 INFO:tasks.workunit.client.0.smithi057.stdout:6/509: mknod d2/d19/d26/d4f/d95/ca0 0 2024-04-25T22:42:15.437 INFO:tasks.workunit.client.0.smithi057.stdout:6/510: dwrite d2/d19/d20/f45 [0,4194304] 0 2024-04-25T22:42:15.438 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:15.438 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:15.438 INFO:tasks.workunit.client.0.smithi057.stdout:6/511: creat d2/d86/fa1 x:0 0 0 2024-04-25T22:42:15.439 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:15.444 INFO:tasks.workunit.client.0.smithi057.stdout:6/512: truncate d2/d19/d50/d1a/d22/f53 1617682 0 2024-04-25T22:42:15.444 INFO:tasks.workunit.client.0.smithi057.stdout:6/513: chown d2/d19/d49/d62/f8f 1 1 2024-04-25T22:42:15.458 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:15.458 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:15.459 INFO:tasks.workunit.client.0.smithi057.stdout:3/450: dread d0/fe [0,4194304] 0 2024-04-25T22:42:15.460 INFO:tasks.workunit.client.0.smithi057.stdout:3/451: fsync d0/d11/f1c 0 2024-04-25T22:42:15.460 INFO:tasks.workunit.client.0.smithi057.stdout:3/452: creat d0/d4/d4a/f9a x:0 0 0 2024-04-25T22:42:15.461 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:15.461 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:15.466 INFO:tasks.workunit.client.0.smithi057.stdout:3/453: dwrite d0/d4/f98 [0,4194304] 0 2024-04-25T22:42:15.467 INFO:tasks.workunit.client.0.smithi057.stdout:3/454: creat d0/d4/d7/d46/d30/f9b x:0 0 0 2024-04-25T22:42:15.469 INFO:tasks.workunit.client.0.smithi057.stdout:3/455: rename d0/f6c to d0/d4/d7/d26/f9c 0 2024-04-25T22:42:15.470 INFO:tasks.workunit.client.0.smithi057.stdout:3/456: truncate d0/f62 513176 0 2024-04-25T22:42:15.470 INFO:tasks.workunit.client.0.smithi057.stdout:3/457: write d0/f95 [400198,27084] 0 2024-04-25T22:42:15.471 INFO:tasks.workunit.client.0.smithi057.stdout:3/458: rmdir d0/d4/d7/d26/d89 39 2024-04-25T22:42:15.477 INFO:tasks.workunit.client.0.smithi057.stdout:0/486: sync 2024-04-25T22:42:15.481 INFO:tasks.workunit.client.0.smithi057.stdout:0/487: dread d0/d5/d53/f67 [0,4194304] 0 2024-04-25T22:42:15.482 INFO:tasks.workunit.client.0.smithi057.stdout:0/488: write d0/d3/d6/f59 [3801422,46067] 0 2024-04-25T22:42:15.483 INFO:tasks.workunit.client.0.smithi057.stdout:0/489: creat d0/d49/d97/faa x:0 0 0 2024-04-25T22:42:15.483 INFO:tasks.workunit.client.0.smithi057.stdout:0/490: stat d0/d3/d4d/l51 0 2024-04-25T22:42:15.483 INFO:tasks.workunit.client.0.smithi057.stdout:0/491: rmdir d0/d3/d6/d29 39 2024-04-25T22:42:15.486 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:15.483+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:15.551 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:15.551 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:15.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:15.551 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:15.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.552 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:15.552 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:15.552 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 120.95284052300001, 2024-04-25T22:42:15.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:15.552 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:15.552 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:15.552 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:15.552 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:15.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:15.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:15.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:15.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:15.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:15.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:15.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:15.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:15.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:15.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:15.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:15.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:15.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:15.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:15.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:15.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:15.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:15.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:15.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:15.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:15.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:15.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:15.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:15.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:15.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:15.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:15.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:15.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:15.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:15.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:15.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:15.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:15.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:15.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:15.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:15.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:15.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:15.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:15.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:15.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:15.557 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.557 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.558 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.558 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:15.558 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:15.558 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 120.952703267, 2024-04-25T22:42:15.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:15.558 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:15.558 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:15.558 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:15.558 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:15.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:15.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:15.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:15.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:15.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:15.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:15.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:15.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:15.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:15.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:15.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:15.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:15.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:15.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:15.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:15.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:15.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:15.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:15.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:15.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:15.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:15.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:15.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:15.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:15.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:15.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:15.562 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:15.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:15.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:15.562 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:15.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:15.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:15.562 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:15.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:15.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:15.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:15.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:15.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:15.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:15.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:15.563 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.563 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.564 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.564 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:15.564 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:15.564 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 120.95251188899999, 2024-04-25T22:42:15.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031977220000000001, 2024-04-25T22:42:15.564 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:15.564 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:15.564 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:15.564 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:15.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:15.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:15.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:15.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595943+0000", 2024-04-25T22:42:15.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:15.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595944+0000", 2024-04-25T22:42:15.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3239999999999999e-06 2024-04-25T22:42:15.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:15.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595953+0000", 2024-04-25T22:42:15.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5790000000000004e-06 2024-04-25T22:42:15.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:15.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595971+0000", 2024-04-25T22:42:15.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8689999999999999e-05 2024-04-25T22:42:15.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595986+0000", 2024-04-25T22:42:15.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4893e-05 2024-04-25T22:42:15.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596090+0000", 2024-04-25T22:42:15.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010362 2024-04-25T22:42:15.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:15.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596101+0000", 2024-04-25T22:42:15.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1079e-05 2024-04-25T22:42:15.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612662+0000", 2024-04-25T22:42:15.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016561010000000001 2024-04-25T22:42:15.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:15.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612889+0000", 2024-04-25T22:42:15.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00022694800000000001 2024-04-25T22:42:15.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:15.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613251+0000", 2024-04-25T22:42:15.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036206699999999999 2024-04-25T22:42:15.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:15.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619630+0000", 2024-04-25T22:42:15.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0063784740000000003 2024-04-25T22:42:15.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:15.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627676+0000", 2024-04-25T22:42:15.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080467379999999995 2024-04-25T22:42:15.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:15.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627818+0000", 2024-04-25T22:42:15.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014168300000000001 2024-04-25T22:42:15.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:15.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.627920+0000", 2024-04-25T22:42:15.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010211499999999999 2024-04-25T22:42:15.569 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.569 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.570 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.570 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.570 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:15.570 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:15.570 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 120.95244309900001, 2024-04-25T22:42:15.570 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:15.570 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:15.570 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:15.570 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:15.570 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:15.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.570 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:15.570 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:15.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:15.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:15.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:15.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:15.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:15.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:15.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:15.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:15.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:15.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:15.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:15.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:15.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:15.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:15.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:15.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:15.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:15.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:15.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:15.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:15.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:15.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:15.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:15.574 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.574 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:15.574 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:15.574 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:15.574 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.574 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:15.574 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:15.574 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:15.574 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.574 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:15.574 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:15.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:15.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:15.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:15.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:15.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:15.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:15.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:15.575 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.575 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.575 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.576 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:15.576 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:15.576 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 120.952374013, 2024-04-25T22:42:15.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.040638726, 2024-04-25T22:42:15.576 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:15.576 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:15.576 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:15.576 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:15.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:15.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:15.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:15.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596081+0000", 2024-04-25T22:42:15.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:15.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596082+0000", 2024-04-25T22:42:15.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.353e-06 2024-04-25T22:42:15.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:15.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596107+0000", 2024-04-25T22:42:15.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5179999999999999e-05 2024-04-25T22:42:15.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:15.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596126+0000", 2024-04-25T22:42:15.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8533e-05 2024-04-25T22:42:15.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596146+0000", 2024-04-25T22:42:15.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0423000000000001e-05 2024-04-25T22:42:15.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596216+0000", 2024-04-25T22:42:15.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0153000000000004e-05 2024-04-25T22:42:15.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:15.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596223+0000", 2024-04-25T22:42:15.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4930000000000003e-06 2024-04-25T22:42:15.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599359+0000", 2024-04-25T22:42:15.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0031362500000000001 2024-04-25T22:42:15.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:15.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.599695+0000", 2024-04-25T22:42:15.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00033547699999999999 2024-04-25T22:42:15.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:15.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.600031+0000", 2024-04-25T22:42:15.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000336204 2024-04-25T22:42:15.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:15.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.607488+0000", 2024-04-25T22:42:15.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0074569420000000003 2024-04-25T22:42:15.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:15.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636576+0000", 2024-04-25T22:42:15.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029088083000000001 2024-04-25T22:42:15.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:15.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636646+0000", 2024-04-25T22:42:15.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0685999999999994e-05 2024-04-25T22:42:15.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:15.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636719+0000", 2024-04-25T22:42:15.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.2948999999999996e-05 2024-04-25T22:42:15.581 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.581 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.581 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.582 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:15.582 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:15.582 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 120.9522779, 2024-04-25T22:42:15.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:15.582 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:15.582 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:15.582 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:15.582 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:15.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:15.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:15.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:15.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:15.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:15.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:15.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:15.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:15.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:15.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:15.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:15.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:15.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:15.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:15.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:15.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:15.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:15.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:15.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:15.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:15.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:15.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:15.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:15.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:15.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:15.586 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.586 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:15.586 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:15.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:15.586 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.586 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.586 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.586 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.586 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:15.586 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:15.586 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 120.952212238, 2024-04-25T22:42:15.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:15.586 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:15.587 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:15.587 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:15.587 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:15.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:15.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:15.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:15.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:15.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:15.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:15.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:15.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:15.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:15.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:15.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:15.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:15.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:15.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:15.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:15.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:15.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:15.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:15.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:15.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:15.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:15.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:15.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:15.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:15.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:15.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:15.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:15.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:15.590 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.590 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.590 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.591 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:10678 4.2c e63/17 4:36971e45:::100000030bd.00000001:head v 63'185, mlcod=63'183)", 2024-04-25T22:42:15.591 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.496727+0000", 2024-04-25T22:42:15.591 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 3.0517273770000002, 2024-04-25T22:42:15.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034699661, 2024-04-25T22:42:15.591 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:15.591 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:15.591 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:15.591 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:15.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.591 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:15.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.496727+0000", 2024-04-25T22:42:15.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.592 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.592 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:15.592 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.496727+0000", 2024-04-25T22:42:15.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.592 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.592 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.592 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:15.592 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.496730+0000", 2024-04-25T22:42:15.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3e-06 2024-04-25T22:42:15.592 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.592 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.592 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:15.592 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.508896+0000", 2024-04-25T22:42:15.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.012166692999999999 2024-04-25T22:42:15.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:15.593 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.508922+0000", 2024-04-25T22:42:15.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5927000000000001e-05 2024-04-25T22:42:15.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.593 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.508936+0000", 2024-04-25T22:42:15.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4063000000000001e-05 2024-04-25T22:42:15.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.509067+0000", 2024-04-25T22:42:15.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000130257 2024-04-25T22:42:15.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:15.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.509121+0000", 2024-04-25T22:42:15.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3936e-05 2024-04-25T22:42:15.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:15.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.531364+0000", 2024-04-25T22:42:15.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022243242 2024-04-25T22:42:15.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:15.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.531427+0000", 2024-04-25T22:42:15.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3243000000000004e-05 2024-04-25T22:42:15.595 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.595 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.595 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.595 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10700 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:15.595 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:15.595 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 3.0293450210000001, 2024-04-25T22:42:15.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066789482999999997, 2024-04-25T22:42:15.595 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:15.595 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:15.595 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:15.596 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:15.596 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:15.596 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:15.596 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10700 2024-04-25T22:42:15.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.596 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:15.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:15.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:15.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:15.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:15.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:15.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519112+0000", 2024-04-25T22:42:15.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1399999999999998e-06 2024-04-25T22:42:15.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:15.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527187+0000", 2024-04-25T22:42:15.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080748899999999995 2024-04-25T22:42:15.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:15.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527232+0000", 2024-04-25T22:42:15.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4895999999999998e-05 2024-04-25T22:42:15.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.598 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527259+0000", 2024-04-25T22:42:15.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7331999999999999e-05 2024-04-25T22:42:15.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.598 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529418+0000", 2024-04-25T22:42:15.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002158765 2024-04-25T22:42:15.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:15.598 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529572+0000", 2024-04-25T22:42:15.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015438499999999999 2024-04-25T22:42:15.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:15.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529762+0000", 2024-04-25T22:42:15.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018998100000000001 2024-04-25T22:42:15.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:15.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.548359+0000", 2024-04-25T22:42:15.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018596444 2024-04-25T22:42:15.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:15.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585801+0000", 2024-04-25T22:42:15.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.037442469999999999 2024-04-25T22:42:15.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:15.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585847+0000", 2024-04-25T22:42:15.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5565000000000002e-05 2024-04-25T22:42:15.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:15.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585899+0000", 2024-04-25T22:42:15.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2614999999999997e-05 2024-04-25T22:42:15.600 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.600 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.600 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.601 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10714 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:15.601 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:15.601 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 2.995664058, 2024-04-25T22:42:15.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.048080623000000003, 2024-04-25T22:42:15.601 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:15.601 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:15.601 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:15.601 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:15.601 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:15.601 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:15.601 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10714 2024-04-25T22:42:15.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.601 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:15.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:15.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:15.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:15.602 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:15.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:15.602 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552792+0000", 2024-04-25T22:42:15.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:42:15.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:15.603 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559915+0000", 2024-04-25T22:42:15.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071231690000000004 2024-04-25T22:42:15.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:15.603 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559932+0000", 2024-04-25T22:42:15.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7169000000000001e-05 2024-04-25T22:42:15.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.603 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559942+0000", 2024-04-25T22:42:15.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0261999999999999e-05 2024-04-25T22:42:15.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560018+0000", 2024-04-25T22:42:15.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5358000000000006e-05 2024-04-25T22:42:15.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:15.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560118+0000", 2024-04-25T22:42:15.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000100911 2024-04-25T22:42:15.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:15.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560281+0000", 2024-04-25T22:42:15.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016288500000000001 2024-04-25T22:42:15.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.605 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:15.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.579740+0000", 2024-04-25T22:42:15.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019458598000000001 2024-04-25T22:42:15.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.605 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:15.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600484+0000", 2024-04-25T22:42:15.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020744483000000001 2024-04-25T22:42:15.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.605 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:15.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600664+0000", 2024-04-25T22:42:15.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017953899999999999 2024-04-25T22:42:15.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:15.606 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600871+0000", 2024-04-25T22:42:15.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020737199999999999 2024-04-25T22:42:15.606 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.606 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.606 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.606 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.606 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.606 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10747 4.1e 4:7b0f9ddb:::100000030ee.00000000:head [write 0~4194304 [2@504501]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:15.606 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.623419+0000", 2024-04-25T22:42:15.606 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 2.925035442, 2024-04-25T22:42:15.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.032309891, 2024-04-25T22:42:15.606 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:15.607 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:15.607 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:15.607 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:15.607 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:15.607 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:15.607 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10747 2024-04-25T22:42:15.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.607 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:15.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:15.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.623419+0000", 2024-04-25T22:42:15.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:15.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.623419+0000", 2024-04-25T22:42:15.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:15.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.623421+0000", 2024-04-25T22:42:15.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.818e-06 2024-04-25T22:42:15.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:15.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.630043+0000", 2024-04-25T22:42:15.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066221179999999998 2024-04-25T22:42:15.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:15.609 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.630066+0000", 2024-04-25T22:42:15.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2833e-05 2024-04-25T22:42:15.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.609 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.609 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.609 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.630080+0000", 2024-04-25T22:42:15.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3987e-05 2024-04-25T22:42:15.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.609 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.609 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.609 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.630163+0000", 2024-04-25T22:42:15.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2640999999999997e-05 2024-04-25T22:42:15.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.609 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.609 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:15.610 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.630237+0000", 2024-04-25T22:42:15.610 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4281000000000003e-05 2024-04-25T22:42:15.610 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.610 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.610 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:15.610 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.630361+0000", 2024-04-25T22:42:15.610 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000123578 2024-04-25T22:42:15.610 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.610 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.610 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:15.610 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.646905+0000", 2024-04-25T22:42:15.610 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016544432000000001 2024-04-25T22:42:15.610 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:15.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.655662+0000", 2024-04-25T22:42:15.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0087570029999999993 2024-04-25T22:42:15.611 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:15.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.655703+0000", 2024-04-25T22:42:15.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.1186000000000002e-05 2024-04-25T22:42:15.611 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:15.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.655729+0000", 2024-04-25T22:42:15.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6013999999999999e-05 2024-04-25T22:42:15.611 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.612 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.612 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.612 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.612 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.612 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10813 4.17 4:e8010137:::100000030b0.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:15.612 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:15.612 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 2.8007150520000001, 2024-04-25T22:42:15.612 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.047503799999999999, 2024-04-25T22:42:15.612 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:15.612 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:15.612 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:15.612 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:15.612 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:15.612 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:15.612 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10813 2024-04-25T22:42:15.613 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.613 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:15.613 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.613 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:15.613 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:15.613 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.613 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.613 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.613 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:15.613 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:15.613 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.613 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.613 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.613 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:15.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747741+0000", 2024-04-25T22:42:15.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1119999999999999e-06 2024-04-25T22:42:15.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.614 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:15.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752366+0000", 2024-04-25T22:42:15.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046253240000000001 2024-04-25T22:42:15.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.614 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:15.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752382+0000", 2024-04-25T22:42:15.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5639999999999999e-05 2024-04-25T22:42:15.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.614 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.615 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.615 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752393+0000", 2024-04-25T22:42:15.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1626e-05 2024-04-25T22:42:15.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.615 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.615 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752459+0000", 2024-04-25T22:42:15.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5309999999999996e-05 2024-04-25T22:42:15.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.615 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:15.615 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752529+0000", 2024-04-25T22:42:15.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0543000000000005e-05 2024-04-25T22:42:15.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.616 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.616 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:15.616 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752637+0000", 2024-04-25T22:42:15.616 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010788799999999999 2024-04-25T22:42:15.616 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.616 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.616 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:15.616 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760295+0000", 2024-04-25T22:42:15.616 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076583290000000002 2024-04-25T22:42:15.616 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.616 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.616 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:15.616 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.794990+0000", 2024-04-25T22:42:15.616 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034694317000000002 2024-04-25T22:42:15.616 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.617 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:15.617 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795097+0000", 2024-04-25T22:42:15.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010768999999999999 2024-04-25T22:42:15.617 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.617 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:15.617 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795243+0000", 2024-04-25T22:42:15.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000146021 2024-04-25T22:42:15.617 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.617 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.617 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.617 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.618 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10816 4.17 4:e8010137:::100000030b0.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:15.618 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:15.618 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 2.7953855920000001, 2024-04-25T22:42:15.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042406530999999997, 2024-04-25T22:42:15.618 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:15.618 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:15.618 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:15.618 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:15.618 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:15.618 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:15.618 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10816 2024-04-25T22:42:15.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.618 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:15.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:15.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:15.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:15.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:15.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:15.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753070+0000", 2024-04-25T22:42:15.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9800000000000002e-07 2024-04-25T22:42:15.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:15.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753288+0000", 2024-04-25T22:42:15.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000217789 2024-04-25T22:42:15.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:15.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753301+0000", 2024-04-25T22:42:15.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2764e-05 2024-04-25T22:42:15.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753310+0000", 2024-04-25T22:42:15.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:42:15.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758240+0000", 2024-04-25T22:42:15.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049304910000000004 2024-04-25T22:42:15.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:15.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758374+0000", 2024-04-25T22:42:15.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000133428 2024-04-25T22:42:15.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:15.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758576+0000", 2024-04-25T22:42:15.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020177899999999999 2024-04-25T22:42:15.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:15.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760626+0000", 2024-04-25T22:42:15.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0020501489999999998 2024-04-25T22:42:15.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:15.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795329+0000", 2024-04-25T22:42:15.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034703352999999999 2024-04-25T22:42:15.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:15.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795414+0000", 2024-04-25T22:42:15.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5292999999999998e-05 2024-04-25T22:42:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795476+0000", 2024-04-25T22:42:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1206999999999999e-05 2024-04-25T22:42:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10865 4.26 4:6414d19f:::10000003137.00000000:head [write 0~3801088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.833503+0000", 2024-04-25T22:42:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 2.7149513120000002, 2024-04-25T22:42:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031509151999999999, 2024-04-25T22:42:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:15.624 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:15.624 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:15.624 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:15.624 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:15.624 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:15.624 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10865 2024-04-25T22:42:15.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.624 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:15.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:15.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.833503+0000", 2024-04-25T22:42:15.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:15.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.833503+0000", 2024-04-25T22:42:15.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:15.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.833505+0000", 2024-04-25T22:42:15.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0329999999999998e-06 2024-04-25T22:42:15.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:15.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.840364+0000", 2024-04-25T22:42:15.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0068586699999999999 2024-04-25T22:42:15.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:15.626 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.840386+0000", 2024-04-25T22:42:15.626 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2161999999999999e-05 2024-04-25T22:42:15.626 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.626 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.626 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.626 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.840399+0000", 2024-04-25T22:42:15.626 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2465e-05 2024-04-25T22:42:15.626 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.626 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.626 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.626 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.840525+0000", 2024-04-25T22:42:15.626 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012587199999999999 2024-04-25T22:42:15.626 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.626 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.627 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:15.627 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.840658+0000", 2024-04-25T22:42:15.627 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013379099999999999 2024-04-25T22:42:15.627 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.627 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.627 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:15.627 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.840817+0000", 2024-04-25T22:42:15.627 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015905699999999999 2024-04-25T22:42:15.627 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.627 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.627 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:15.627 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.851197+0000", 2024-04-25T22:42:15.627 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010379233 2024-04-25T22:42:15.627 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.627 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.627 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:15.628 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.864827+0000", 2024-04-25T22:42:15.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013629888 2024-04-25T22:42:15.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.628 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:15.628 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.864973+0000", 2024-04-25T22:42:15.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014591800000000001 2024-04-25T22:42:15.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.628 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:15.628 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.865013+0000", 2024-04-25T22:42:15.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0062999999999999e-05 2024-04-25T22:42:15.628 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.628 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.628 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.629 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10886 4.29 4:94939cb2:::10000003139.00000000:head [write 0~4194304 [2@3068692]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:15.629 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.893646+0000", 2024-04-25T22:42:15.629 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 2.654808359, 2024-04-25T22:42:15.629 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.039527421, 2024-04-25T22:42:15.629 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:15.629 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:15.629 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:15.629 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:15.629 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:15.629 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:15.629 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10886 2024-04-25T22:42:15.629 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.629 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:15.629 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.629 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:15.629 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.893646+0000", 2024-04-25T22:42:15.630 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.630 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.630 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.630 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:15.630 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.893646+0000", 2024-04-25T22:42:15.630 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.630 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.630 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.630 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:15.630 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.893649+0000", 2024-04-25T22:42:15.630 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2979999999999999e-06 2024-04-25T22:42:15.630 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.630 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.630 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:15.630 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.897975+0000", 2024-04-25T22:42:15.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0043259010000000001 2024-04-25T22:42:15.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:15.631 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.897997+0000", 2024-04-25T22:42:15.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2541e-05 2024-04-25T22:42:15.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.631 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.898010+0000", 2024-04-25T22:42:15.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2519e-05 2024-04-25T22:42:15.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.898099+0000", 2024-04-25T22:42:15.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.9510000000000002e-05 2024-04-25T22:42:15.632 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.632 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:15.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.898207+0000", 2024-04-25T22:42:15.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000107886 2024-04-25T22:42:15.632 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.632 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:15.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.898377+0000", 2024-04-25T22:42:15.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016960400000000001 2024-04-25T22:42:15.632 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.632 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:15.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.905921+0000", 2024-04-25T22:42:15.633 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0075444509999999998 2024-04-25T22:42:15.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.633 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.633 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:15.633 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.933046+0000", 2024-04-25T22:42:15.633 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.027124662000000001 2024-04-25T22:42:15.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.633 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.633 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:15.633 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.933116+0000", 2024-04-25T22:42:15.633 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0467000000000001e-05 2024-04-25T22:42:15.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.633 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.633 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:15.633 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.933174+0000", 2024-04-25T22:42:15.634 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7581999999999999e-05 2024-04-25T22:42:15.634 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.634 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.634 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.634 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.634 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.634 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10914 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:15.634 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:15.634 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 2.59458521, 2024-04-25T22:42:15.634 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044452984000000001, 2024-04-25T22:42:15.634 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:15.634 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:15.634 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:15.634 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:15.634 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:15.635 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:15.635 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10914 2024-04-25T22:42:15.635 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.635 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:15.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.635 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:15.635 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:15.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.635 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.635 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:15.635 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:15.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.635 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.635 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:15.636 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953871+0000", 2024-04-25T22:42:15.636 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1829999999999999e-06 2024-04-25T22:42:15.636 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.636 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.636 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:15.636 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.962992+0000", 2024-04-25T22:42:15.636 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091217409999999992 2024-04-25T22:42:15.636 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.636 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.636 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:15.636 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963027+0000", 2024-04-25T22:42:15.636 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4229e-05 2024-04-25T22:42:15.636 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.636 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.636 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.636 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963042+0000", 2024-04-25T22:42:15.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5152e-05 2024-04-25T22:42:15.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963143+0000", 2024-04-25T22:42:15.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101171 2024-04-25T22:42:15.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:15.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963269+0000", 2024-04-25T22:42:15.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012623499999999999 2024-04-25T22:42:15.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:15.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963453+0000", 2024-04-25T22:42:15.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018357900000000001 2024-04-25T22:42:15.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:15.638 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998133+0000", 2024-04-25T22:42:15.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034679789000000003 2024-04-25T22:42:15.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:15.638 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998220+0000", 2024-04-25T22:42:15.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7153999999999999e-05 2024-04-25T22:42:15.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:15.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998278+0000", 2024-04-25T22:42:15.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8035000000000003e-05 2024-04-25T22:42:15.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:15.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998323+0000", 2024-04-25T22:42:15.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4715999999999997e-05 2024-04-25T22:42:15.639 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.639 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.639 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.639 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10915 4.3e 4:7c16b777:::1000000314d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:15.639 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.963082+0000", 2024-04-25T22:42:15.639 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 2.5853726510000001, 2024-04-25T22:42:15.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035366902999999998, 2024-04-25T22:42:15.640 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:15.640 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:15.640 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:15.640 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:15.640 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:15.640 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:15.640 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10915 2024-04-25T22:42:15.640 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.640 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:15.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.640 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:15.640 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963082+0000", 2024-04-25T22:42:15.640 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.640 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:15.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963082+0000", 2024-04-25T22:42:15.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:15.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963084+0000", 2024-04-25T22:42:15.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1100000000000001e-06 2024-04-25T22:42:15.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:15.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.968222+0000", 2024-04-25T22:42:15.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0051377410000000004 2024-04-25T22:42:15.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:15.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.968253+0000", 2024-04-25T22:42:15.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0580000000000002e-05 2024-04-25T22:42:15.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.968268+0000", 2024-04-25T22:42:15.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5758999999999999e-05 2024-04-25T22:42:15.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.968371+0000", 2024-04-25T22:42:15.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010259000000000001 2024-04-25T22:42:15.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:15.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.968544+0000", 2024-04-25T22:42:15.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017335500000000001 2024-04-25T22:42:15.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:15.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998194+0000", 2024-04-25T22:42:15.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.029649825000000001 2024-04-25T22:42:15.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:15.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998336+0000", 2024-04-25T22:42:15.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000142294 2024-04-25T22:42:15.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.644 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:15.644 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998449+0000", 2024-04-25T22:42:15.644 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000112649 2024-04-25T22:42:15.644 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.644 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.644 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.644 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.644 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10919 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:15.644 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:15.644 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 2.5742739289999998, 2024-04-25T22:42:15.644 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044010552000000001, 2024-04-25T22:42:15.644 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:15.645 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:15.645 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:15.645 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:15.645 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:15.645 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:15.645 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10919 2024-04-25T22:42:15.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.645 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:15.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.645 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:15.645 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:15.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.645 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:15.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:15.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.646 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:15.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:15.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8100000000000003e-07 2024-04-25T22:42:15.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.646 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:15.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980221+0000", 2024-04-25T22:42:15.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060397230000000003 2024-04-25T22:42:15.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:15.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980242+0000", 2024-04-25T22:42:15.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1373e-05 2024-04-25T22:42:15.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980252+0000", 2024-04-25T22:42:15.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9990000000000003e-06 2024-04-25T22:42:15.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981303+0000", 2024-04-25T22:42:15.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010501670000000001 2024-04-25T22:42:15.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.648 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:15.648 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981444+0000", 2024-04-25T22:42:15.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014123799999999999 2024-04-25T22:42:15.648 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.648 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:15.648 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981585+0000", 2024-04-25T22:42:15.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014071999999999999 2024-04-25T22:42:15.648 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.648 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:15.648 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003640+0000", 2024-04-25T22:42:15.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022055113000000001 2024-04-25T22:42:15.648 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:15.649 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018070+0000", 2024-04-25T22:42:15.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014430877 2024-04-25T22:42:15.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:15.649 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018138+0000", 2024-04-25T22:42:15.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7743000000000005e-05 2024-04-25T22:42:15.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:15.649 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018191+0000", 2024-04-25T22:42:15.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3118000000000002e-05 2024-04-25T22:42:15.649 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.650 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.650 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.650 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.650 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.650 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10930 4.28 4:177ac060:::100000030dc.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:15.650 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.994384+0000", 2024-04-25T22:42:15.650 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 2.5540705259999998, 2024-04-25T22:42:15.650 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033055212, 2024-04-25T22:42:15.650 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:15.650 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:15.650 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:15.650 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:15.650 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:15.650 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:15.650 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10930 2024-04-25T22:42:15.651 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.651 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:15.651 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.651 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:15.651 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.994384+0000", 2024-04-25T22:42:15.651 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.651 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.651 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.651 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:15.651 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.994384+0000", 2024-04-25T22:42:15.651 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.651 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.651 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.651 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:15.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.994386+0000", 2024-04-25T22:42:15.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.57e-06 2024-04-25T22:42:15.652 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:15.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.001109+0000", 2024-04-25T22:42:15.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0067230190000000002 2024-04-25T22:42:15.652 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:15.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.001126+0000", 2024-04-25T22:42:15.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7073999999999999e-05 2024-04-25T22:42:15.652 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.001135+0000", 2024-04-25T22:42:15.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5440000000000004e-06 2024-04-25T22:42:15.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.001216+0000", 2024-04-25T22:42:15.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0333999999999994e-05 2024-04-25T22:42:15.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:15.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.001320+0000", 2024-04-25T22:42:15.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000104633 2024-04-25T22:42:15.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:15.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.027106+0000", 2024-04-25T22:42:15.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.025785408999999999 2024-04-25T22:42:15.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:15.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.027352+0000", 2024-04-25T22:42:15.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00024583999999999999 2024-04-25T22:42:15.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:15.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.027439+0000", 2024-04-25T22:42:15.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7788999999999996e-05 2024-04-25T22:42:15.654 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.655 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.655 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.655 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:10988 4.3c e64/17 4:3ee19ef4:::10000003114.00000000:head v 64'156, mlcod=62'154)", 2024-04-25T22:42:15.655 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:13.182004+0000", 2024-04-25T22:42:15.655 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 2.3664511660000001, 2024-04-25T22:42:15.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.032648479000000001, 2024-04-25T22:42:15.655 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:15.655 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:15.655 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:15.655 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:15.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:15.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.182004+0000", 2024-04-25T22:42:15.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:15.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.182004+0000", 2024-04-25T22:42:15.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:15.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:15.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.182006+0000", 2024-04-25T22:42:15.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3269999999999999e-06 2024-04-25T22:42:15.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:15.657 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.189383+0000", 2024-04-25T22:42:15.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073771180000000002 2024-04-25T22:42:15.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.657 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:15.657 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.189412+0000", 2024-04-25T22:42:15.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9079000000000001e-05 2024-04-25T22:42:15.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.657 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.657 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.189426+0000", 2024-04-25T22:42:15.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.347e-05 2024-04-25T22:42:15.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:15.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.189582+0000", 2024-04-25T22:42:15.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015685699999999999 2024-04-25T22:42:15.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:15.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.189642+0000", 2024-04-25T22:42:15.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9141999999999997e-05 2024-04-25T22:42:15.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:15.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.214533+0000", 2024-04-25T22:42:15.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.024891334000000001 2024-04-25T22:42:15.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:15.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:15.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:15.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.214652+0000", 2024-04-25T22:42:15.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000119152 2024-04-25T22:42:15.659 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.659 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.659 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.659 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:15.659 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:15.659 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:15.661 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:15.655+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:15.661 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:15.668 INFO:tasks.workunit.client.0.smithi057.stdout:8/465: sync 2024-04-25T22:42:15.668 INFO:tasks.workunit.client.0.smithi057.stdout:5/533: sync 2024-04-25T22:42:15.668 INFO:tasks.workunit.client.0.smithi057.stdout:7/488: sync 2024-04-25T22:42:15.668 INFO:tasks.workunit.client.0.smithi057.stdout:2/534: sync 2024-04-25T22:42:15.668 INFO:tasks.workunit.client.0.smithi057.stdout:4/480: sync 2024-04-25T22:42:15.668 INFO:tasks.workunit.client.0.smithi057.stdout:9/513: sync 2024-04-25T22:42:15.668 INFO:tasks.workunit.client.0.smithi057.stdout:1/455: sync 2024-04-25T22:42:15.668 INFO:tasks.workunit.client.0.smithi057.stdout:2/535: dread - d1f/d36/f7b zero size 2024-04-25T22:42:15.668 INFO:tasks.workunit.client.0.smithi057.stdout:7/489: chown d6/c53 2 1 2024-04-25T22:42:15.668 INFO:tasks.workunit.client.0.smithi057.stdout:9/514: write d3/f23 [2397446,5918] 0 2024-04-25T22:42:15.669 INFO:tasks.workunit.client.0.smithi057.stdout:5/534: chown d2/lc 1 1 2024-04-25T22:42:15.669 INFO:tasks.workunit.client.0.smithi057.stdout:4/481: write d14/d2f/f52 [1125565,95907] 0 2024-04-25T22:42:15.669 INFO:tasks.workunit.client.0.smithi057.stdout:9/515: dread - d3/fa1 zero size 2024-04-25T22:42:15.669 INFO:tasks.workunit.client.0.smithi057.stdout:1/456: creat d7/dd/d40/d41/d45/f94 x:0 0 0 2024-04-25T22:42:15.669 INFO:tasks.workunit.client.0.smithi057.stdout:1/457: chown d7/d65/d6a 338092983 1 2024-04-25T22:42:15.669 INFO:tasks.workunit.client.0.smithi057.stdout:4/482: truncate d14/d3c/f98 5453272 0 2024-04-25T22:42:15.669 INFO:tasks.workunit.client.0.smithi057.stdout:7/490: mkdir d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/da2 0 2024-04-25T22:42:15.669 INFO:tasks.workunit.client.0.smithi057.stdout:1/458: mkdir d7/d65/d95 0 2024-04-25T22:42:15.669 INFO:tasks.workunit.client.0.smithi057.stdout:1/459: fsync d7/dd/d40/d41/d45/f72 0 2024-04-25T22:42:15.669 INFO:tasks.workunit.client.0.smithi057.stdout:1/460: write d7/d4e/f7d [1449394,119807] 0 2024-04-25T22:42:15.669 INFO:tasks.workunit.client.0.smithi057.stdout:5/535: dread d2/d6/db/f2b [0,4194304] 0 2024-04-25T22:42:15.669 INFO:tasks.workunit.client.0.smithi057.stdout:4/483: truncate d14/f23 1079192 0 2024-04-25T22:42:15.669 INFO:tasks.workunit.client.0.smithi057.stdout:5/536: chown d2/d1c 2 1 2024-04-25T22:42:15.669 INFO:tasks.workunit.client.0.smithi057.stdout:1/461: read d7/dd/f14 [2612183,48337] 0 2024-04-25T22:42:15.669 INFO:tasks.workunit.client.0.smithi057.stdout:1/462: creat d7/d4e/f96 x:0 0 0 2024-04-25T22:42:15.670 INFO:tasks.workunit.client.0.smithi057.stdout:1/463: fsync d7/f92 0 2024-04-25T22:42:15.670 INFO:tasks.workunit.client.0.smithi057.stdout:2/536: dwrite d1f/d21/d33/f87 [0,4194304] 0 2024-04-25T22:42:15.670 INFO:tasks.workunit.client.0.smithi057.stdout:5/537: truncate d2/f53 1066659 0 2024-04-25T22:42:15.670 INFO:tasks.workunit.client.0.smithi057.stdout:1/464: link d7/dd/d40/d41/d45/f5b d7/dd/d90/f97 0 2024-04-25T22:42:15.670 INFO:tasks.workunit.client.0.smithi057.stdout:2/537: link d1f/d21/d26/d63/l9f d1f/d21/d26/d63/d7f/lb7 0 2024-04-25T22:42:15.670 INFO:tasks.workunit.client.0.smithi057.stdout:1/465: write d7/f6f [22766,10781] 0 2024-04-25T22:42:15.670 INFO:tasks.workunit.client.0.smithi057.stdout:2/538: chown d1f/d21/d26/c47 10839 1 2024-04-25T22:42:15.670 INFO:tasks.workunit.client.0.smithi057.stdout:4/484: dwrite d14/d47/d5e/f81 [0,4194304] 0 2024-04-25T22:42:15.670 INFO:tasks.workunit.client.0.smithi057.stdout:1/466: rename d7/dd/d40 to d7/d65/d6a/d98 0 2024-04-25T22:42:15.670 INFO:tasks.workunit.client.0.smithi057.stdout:5/538: dwrite d2/d47/d60/fa6 [0,4194304] 0 2024-04-25T22:42:15.670 INFO:tasks.workunit.client.0.smithi057.stdout:1/467: truncate d7/dd/d16/d18/f2a 1969184 0 2024-04-25T22:42:15.670 INFO:tasks.workunit.client.0.smithi057.stdout:5/539: creat d2/d1c/d46/d3a/d6a/faf x:0 0 0 2024-04-25T22:42:15.670 INFO:tasks.workunit.client.0.smithi057.stdout:2/539: dwrite d1f/d36/d60/f97 [0,4194304] 0 2024-04-25T22:42:15.671 INFO:tasks.workunit.client.0.smithi057.stdout:5/540: truncate d2/d6/f92 3196481 0 2024-04-25T22:42:15.671 INFO:tasks.workunit.client.0.smithi057.stdout:2/540: fsync f8 0 2024-04-25T22:42:15.671 INFO:tasks.workunit.client.0.smithi057.stdout:2/541: mknod d1f/d21/d96/cb8 0 2024-04-25T22:42:15.671 INFO:tasks.workunit.client.0.smithi057.stdout:5/541: symlink d2/d1c/d24/d8f/lb0 0 2024-04-25T22:42:15.671 INFO:tasks.workunit.client.0.smithi057.stdout:4/485: dwrite f9 [0,4194304] 0 2024-04-25T22:42:15.671 INFO:tasks.workunit.client.0.smithi057.stdout:5/542: truncate d2/d2c/f5c 4791522 0 2024-04-25T22:42:15.671 INFO:tasks.workunit.client.0.smithi057.stdout:4/486: rmdir d14/d5a/d67/d70 39 2024-04-25T22:42:15.671 INFO:tasks.workunit.client.0.smithi057.stdout:4/487: write d14/d2f/f7b [299894,45694] 0 2024-04-25T22:42:15.671 INFO:tasks.workunit.client.0.smithi057.stdout:4/488: creat d14/d5a/d67/d70/d85/fa1 x:0 0 0 2024-04-25T22:42:15.671 INFO:tasks.workunit.client.0.smithi057.stdout:7/491: dread d6/d28/d4e/d30/d60/d8d/d96/d51/f9e [0,4194304] 0 2024-04-25T22:42:15.671 INFO:tasks.workunit.client.0.smithi057.stdout:4/489: mkdir d14/da2 0 2024-04-25T22:42:15.671 INFO:tasks.workunit.client.0.smithi057.stdout:1/468: write d7/d65/d6a/d98/d41/d6b/f7b [537359,8516] 0 2024-04-25T22:42:15.671 INFO:tasks.workunit.client.0.smithi057.stdout:4/490: rmdir d14/d47/d5e 39 2024-04-25T22:42:15.671 INFO:tasks.workunit.client.0.smithi057.stdout:4/491: unlink d14/d3c/d44/c48 0 2024-04-25T22:42:15.672 INFO:tasks.workunit.client.0.smithi057.stdout:4/492: write d14/d47/d5e/f96 [184201,77253] 0 2024-04-25T22:42:15.672 INFO:tasks.workunit.client.0.smithi057.stdout:5/543: read d2/d1c/f1f [1263302,103503] 0 2024-04-25T22:42:15.672 INFO:tasks.workunit.client.0.smithi057.stdout:2/542: dwrite d1f/d4a/f81 [0,4194304] 0 2024-04-25T22:42:15.672 INFO:tasks.workunit.client.0.smithi057.stdout:5/544: dread - d2/d1c/d46/d3a/f65 zero size 2024-04-25T22:42:15.672 INFO:tasks.workunit.client.0.smithi057.stdout:1/469: dwrite d7/d65/d6a/f6d [0,4194304] 0 2024-04-25T22:42:15.672 INFO:tasks.workunit.client.0.smithi057.stdout:5/545: fdatasync d2/d1c/d24/f4c 0 2024-04-25T22:42:15.672 INFO:tasks.workunit.client.0.smithi057.stdout:5/546: creat d2/d1c/d46/d3a/d6a/d54/fb1 x:0 0 0 2024-04-25T22:42:15.672 INFO:tasks.workunit.client.0.smithi057.stdout:4/493: dwrite d14/d47/d5e/f81 [4194304,4194304] 0 2024-04-25T22:42:15.672 INFO:tasks.workunit.client.0.smithi057.stdout:5/547: truncate d2/d1c/d24/f4c 689424 0 2024-04-25T22:42:15.672 INFO:tasks.workunit.client.0.smithi057.stdout:5/548: dread - d2/d47/f68 zero size 2024-04-25T22:42:15.672 INFO:tasks.workunit.client.0.smithi057.stdout:5/549: chown d2/d1c/d24/c34 1349 1 2024-04-25T22:42:15.672 INFO:tasks.workunit.client.0.smithi057.stdout:1/470: dwrite d7/dd/d16/d24/f2e [0,4194304] 0 2024-04-25T22:42:15.672 INFO:tasks.workunit.client.0.smithi057.stdout:1/471: mkdir d7/d65/d6a/d98/d99 0 2024-04-25T22:42:15.672 INFO:tasks.workunit.client.0.smithi057.stdout:1/472: readlink d7/dd/l11 0 2024-04-25T22:42:15.673 INFO:tasks.workunit.client.0.smithi057.stdout:1/473: mkdir d7/dd/d26/d9a 0 2024-04-25T22:42:15.673 INFO:tasks.workunit.client.0.smithi057.stdout:1/474: fdatasync d7/dd/d16/d24/f3a 0 2024-04-25T22:42:15.673 INFO:tasks.workunit.client.0.smithi057.stdout:4/494: dwrite d14/d3c/d44/f78 [4194304,4194304] 0 2024-04-25T22:42:15.673 INFO:tasks.workunit.client.0.smithi057.stdout:1/475: write d7/d4e/f81 [4779530,57623] 0 2024-04-25T22:42:15.673 INFO:tasks.workunit.client.0.smithi057.stdout:1/476: creat d7/d4e/f9b x:0 0 0 2024-04-25T22:42:15.673 INFO:tasks.workunit.client.0.smithi057.stdout:4/495: truncate d14/d47/d62/f6a 894181 0 2024-04-25T22:42:15.673 INFO:tasks.workunit.client.0.smithi057.stdout:5/550: dwrite d2/d1c/d46/f35 [0,4194304] 0 2024-04-25T22:42:15.673 INFO:tasks.workunit.client.0.smithi057.stdout:4/496: write d14/d47/d5e/f81 [8211526,36555] 0 2024-04-25T22:42:15.673 INFO:tasks.workunit.client.0.smithi057.stdout:5/551: truncate d2/d6/f71 199030 0 2024-04-25T22:42:15.673 INFO:tasks.workunit.client.0.smithi057.stdout:4/497: creat d14/d2f/fa3 x:0 0 0 2024-04-25T22:42:15.673 INFO:tasks.workunit.client.0.smithi057.stdout:5/552: dread - d2/d2c/f81 zero size 2024-04-25T22:42:15.675 INFO:tasks.workunit.client.0.smithi057.stdout:5/553: mkdir d2/d1c/d24/d3d/da7/db2 0 2024-04-25T22:42:15.675 INFO:tasks.workunit.client.0.smithi057.stdout:5/554: write d2/d1c/d46/f35 [2966434,47822] 0 2024-04-25T22:42:15.675 INFO:tasks.workunit.client.0.smithi057.stdout:5/555: rmdir d2/d47/d60 39 2024-04-25T22:42:15.675 INFO:tasks.workunit.client.0.smithi057.stdout:5/556: chown d2/fe 2582442 1 2024-04-25T22:42:15.675 INFO:tasks.workunit.client.0.smithi057.stdout:5/557: write d2/d6/db/f85 [550640,89141] 0 2024-04-25T22:42:15.675 INFO:tasks.workunit.client.0.smithi057.stdout:5/558: write d2/d1c/d24/d3d/d50/d83/f9f [976055,8597] 0 2024-04-25T22:42:15.675 INFO:tasks.workunit.client.0.smithi057.stdout:5/559: symlink d2/d1c/d24/d3d/lb3 0 2024-04-25T22:42:15.675 INFO:tasks.workunit.client.0.smithi057.stdout:5/560: rmdir d2 39 2024-04-25T22:42:15.678 INFO:tasks.workunit.client.0.smithi057.stdout:3/459: sync 2024-04-25T22:42:15.678 INFO:tasks.workunit.client.0.smithi057.stdout:6/514: sync 2024-04-25T22:42:15.680 INFO:tasks.workunit.client.0.smithi057.stdout:6/515: rename d2/d19/d50/d1a/f52 to d2/d19/d50/d91/fa2 0 2024-04-25T22:42:15.696 INFO:tasks.workunit.client.0.smithi057.stdout:5/561: truncate d2/d6/db/f38 7504718 0 2024-04-25T22:42:15.696 INFO:tasks.workunit.client.0.smithi057.stdout:3/460: truncate d0/d4/d7/d46/d30/f5a 2322503 0 2024-04-25T22:42:15.698 INFO:tasks.workunit.client.0.smithi057.stdout:5/562: write d2/d1c/f63 [4898524,24107] 0 2024-04-25T22:42:15.698 INFO:tasks.workunit.client.0.smithi057.stdout:3/461: creat d0/d4/d7b/d7c/f9d x:0 0 0 2024-04-25T22:42:15.698 INFO:tasks.workunit.client.0.smithi057.stdout:7/492: dread d6/d28/f2c [0,4194304] 0 2024-04-25T22:42:15.699 INFO:tasks.workunit.client.0.smithi057.stdout:7/493: readlink d6/d28/d4e/d30/d60/d8d/d96/l24 0 2024-04-25T22:42:15.700 INFO:tasks.workunit.client.0.smithi057.stdout:7/494: creat d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d97/fa3 x:0 0 0 2024-04-25T22:42:15.703 INFO:tasks.workunit.client.0.smithi057.stdout:7/495: symlink d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/la4 0 2024-04-25T22:42:15.704 INFO:tasks.workunit.client.0.smithi057.stdout:2/543: dread d1f/d34/f85 [0,4194304] 0 2024-04-25T22:42:15.705 INFO:tasks.workunit.client.0.smithi057.stdout:2/544: readlink d1f/d34/l84 0 2024-04-25T22:42:15.706 INFO:tasks.workunit.client.0.smithi057.stdout:7/496: mknod d6/d28/d4e/d30/d60/d8d/d96/d5d/ca5 0 2024-04-25T22:42:15.706 INFO:tasks.workunit.client.0.smithi057.stdout:3/462: dwrite d0/d4/d34/f64 [0,4194304] 0 2024-04-25T22:42:15.706 INFO:tasks.workunit.client.0.smithi057.stdout:2/545: symlink d1f/lb9 0 2024-04-25T22:42:15.707 INFO:tasks.workunit.client.0.smithi057.stdout:3/463: write d0/d4/f98 [3204572,61153] 0 2024-04-25T22:42:15.708 INFO:tasks.workunit.client.0.smithi057.stdout:2/546: write d1f/d21/d26/d63/d7f/fb3 [64083,53340] 0 2024-04-25T22:42:15.710 INFO:tasks.workunit.client.0.smithi057.stdout:2/547: creat d1f/d34/d50/fba x:0 0 0 2024-04-25T22:42:15.710 INFO:tasks.workunit.client.0.smithi057.stdout:4/498: dread d14/d5a/f9d [0,4194304] 0 2024-04-25T22:42:15.710 INFO:tasks.workunit.client.0.smithi057.stdout:3/464: rename d0/d4/d34/d3c/c44 to d0/d4/d34/d3c/d70/c9e 0 2024-04-25T22:42:15.711 INFO:tasks.workunit.client.0.smithi057.stdout:4/499: creat d14/d3c/d44/fa4 x:0 0 0 2024-04-25T22:42:15.711 INFO:tasks.workunit.client.0.smithi057.stdout:3/465: unlink d0/d4/d7/f7e 0 2024-04-25T22:42:15.713 INFO:tasks.workunit.client.0.smithi057.stdout:4/500: rename d14/d2f/d4c/c7f to d14/d2f/d4c/d5b/ca5 0 2024-04-25T22:42:15.714 INFO:tasks.workunit.client.0.smithi057.stdout:7/497: dwrite d6/d28/d4e/d30/d60/f86 [0,4194304] 0 2024-04-25T22:42:15.715 INFO:tasks.workunit.client.0.smithi057.stdout:4/501: rmdir d14/d5a/d67/d70/d85 39 2024-04-25T22:42:15.719 INFO:tasks.workunit.client.0.smithi057.stdout:2/548: dwrite d1f/d21/f8e [0,4194304] 0 2024-04-25T22:42:15.720 INFO:tasks.workunit.client.0.smithi057.stdout:6/516: dread d2/d19/d50/ff [0,4194304] 0 2024-04-25T22:42:15.720 INFO:tasks.workunit.client.0.smithi057.stdout:2/549: mknod d1f/d34/d50/cbb 0 2024-04-25T22:42:15.721 INFO:tasks.workunit.client.0.smithi057.stdout:6/517: chown d2/d19/d26/d4f/d95/ca0 6 1 2024-04-25T22:42:15.721 INFO:tasks.workunit.client.0.smithi057.stdout:2/550: write f0 [4628716,37641] 0 2024-04-25T22:42:15.722 INFO:tasks.workunit.client.0.smithi057.stdout:7/498: dwrite d6/f27 [0,4194304] 0 2024-04-25T22:42:15.723 INFO:tasks.workunit.client.0.smithi057.stdout:5/563: dread d2/d1c/d46/f89 [0,4194304] 0 2024-04-25T22:42:15.723 INFO:tasks.workunit.client.0.smithi057.stdout:6/518: truncate d2/d86/fa1 791750 0 2024-04-25T22:42:15.723 INFO:tasks.workunit.client.0.smithi057.stdout:7/499: write d6/d28/d4e/d30/d46/f71 [750144,1317] 0 2024-04-25T22:42:15.724 INFO:tasks.workunit.client.0.smithi057.stdout:5/564: fdatasync d2/f31 0 2024-04-25T22:42:15.725 INFO:tasks.workunit.client.0.smithi057.stdout:7/500: mkdir d6/d28/d4e/d30/d60/d6f/d8a/da6 0 2024-04-25T22:42:15.725 INFO:tasks.workunit.client.0.smithi057.stdout:5/565: creat d2/d6/db/fb4 x:0 0 0 2024-04-25T22:42:15.726 INFO:tasks.workunit.client.0.smithi057.stdout:7/501: mkdir d6/d28/d4e/d30/d60/da7 0 2024-04-25T22:42:15.726 INFO:tasks.workunit.client.0.smithi057.stdout:5/566: creat d2/d1c/d24/d3d/da7/db2/fb5 x:0 0 0 2024-04-25T22:42:15.728 INFO:tasks.workunit.client.0.smithi057.stdout:2/551: dwrite fe [0,4194304] 0 2024-04-25T22:42:15.729 INFO:tasks.workunit.client.0.smithi057.stdout:5/567: dread d2/d47/f9e [0,4194304] 0 2024-04-25T22:42:15.730 INFO:tasks.workunit.client.0.smithi057.stdout:7/502: link f1 d6/d28/d4e/d30/d60/d8d/d96/d51/fa8 0 2024-04-25T22:42:15.730 INFO:tasks.workunit.client.0.smithi057.stdout:2/552: creat d1f/d4a/d4d/d88/fbc x:0 0 0 2024-04-25T22:42:15.731 INFO:tasks.workunit.client.0.smithi057.stdout:6/519: dwrite d2/d19/f1e [0,4194304] 0 2024-04-25T22:42:15.731 INFO:tasks.workunit.client.0.smithi057.stdout:9/516: sync 2024-04-25T22:42:15.731 INFO:tasks.workunit.client.0.smithi057.stdout:8/466: sync 2024-04-25T22:42:15.731 INFO:tasks.workunit.client.0.smithi057.stdout:0/492: sync 2024-04-25T22:42:15.731 INFO:tasks.workunit.client.0.smithi057.stdout:1/477: sync 2024-04-25T22:42:15.731 INFO:tasks.workunit.client.0.smithi057.stdout:3/466: sync 2024-04-25T22:42:15.731 INFO:tasks.workunit.client.0.smithi057.stdout:7/503: sync 2024-04-25T22:42:15.731 INFO:tasks.workunit.client.0.smithi057.stdout:5/568: write d2/d1c/d24/d3d/da7/fac [772537,109506] 0 2024-04-25T22:42:15.732 INFO:tasks.workunit.client.0.smithi057.stdout:8/467: creat d4/d5/d17/fb1 x:0 0 0 2024-04-25T22:42:15.732 INFO:tasks.workunit.client.0.smithi057.stdout:6/520: rmdir d2/d19/d26/d4f/d95 39 2024-04-25T22:42:15.733 INFO:tasks.workunit.client.0.smithi057.stdout:7/504: write d6/f27 [4341730,10058] 0 2024-04-25T22:42:15.733 INFO:tasks.workunit.client.0.smithi057.stdout:9/517: write d3/d34/d42/f52 [70536,126052] 0 2024-04-25T22:42:15.733 INFO:tasks.workunit.client.0.smithi057.stdout:2/553: rename d1f/d21/d26/d63/d7f/l8f to d1f/lbd 0 2024-04-25T22:42:15.734 INFO:tasks.workunit.client.0.smithi057.stdout:0/493: creat d0/d5/d53/fab x:0 0 0 2024-04-25T22:42:15.734 INFO:tasks.workunit.client.0.smithi057.stdout:1/478: creat d7/dd/d16/d18/d31/f9c x:0 0 0 2024-04-25T22:42:15.734 INFO:tasks.workunit.client.0.smithi057.stdout:8/468: creat d4/db/fb2 x:0 0 0 2024-04-25T22:42:15.735 INFO:tasks.workunit.client.0.smithi057.stdout:2/554: symlink d1f/d21/d26/d5c/lbe 0 2024-04-25T22:42:15.735 INFO:tasks.workunit.client.0.smithi057.stdout:6/521: rename d2/d19/d50/f4c to d2/d19/d50/d91/fa3 0 2024-04-25T22:42:15.735 INFO:tasks.workunit.client.0.smithi057.stdout:9/518: readlink d3/d34/d42/d28/d39/d54/la2 0 2024-04-25T22:42:15.736 INFO:tasks.workunit.client.0.smithi057.stdout:8/469: write d4/f10 [3097064,54074] 0 2024-04-25T22:42:15.736 INFO:tasks.workunit.client.0.smithi057.stdout:3/467: link d0/d11/f1e d0/d4/d7b/f9f 0 2024-04-25T22:42:15.736 INFO:tasks.workunit.client.0.smithi057.stdout:1/479: creat d7/d65/d6a/d98/d41/d75/f9d x:0 0 0 2024-04-25T22:42:15.737 INFO:tasks.workunit.client.0.smithi057.stdout:6/522: creat d2/d19/d49/fa4 x:0 0 0 2024-04-25T22:42:15.737 INFO:tasks.workunit.client.0.smithi057.stdout:1/480: chown d7/dd/d16 268 1 2024-04-25T22:42:15.738 INFO:tasks.workunit.client.0.smithi057.stdout:7/505: creat d6/d28/d4e/d30/d60/d8d/fa9 x:0 0 0 2024-04-25T22:42:15.738 INFO:tasks.workunit.client.0.smithi057.stdout:8/470: rmdir d4/db/dd 39 2024-04-25T22:42:15.738 INFO:tasks.workunit.client.0.smithi057.stdout:9/519: mknod d3/d34/d42/d28/d2d/cad 0 2024-04-25T22:42:15.738 INFO:tasks.workunit.client.0.smithi057.stdout:0/494: chown d0/d3/d6/d14/c26 31953777 1 2024-04-25T22:42:15.738 INFO:tasks.workunit.client.0.smithi057.stdout:6/523: creat d2/d19/d20/fa5 x:0 0 0 2024-04-25T22:42:15.739 INFO:tasks.workunit.client.0.smithi057.stdout:4/502: dwrite d14/f28 [0,4194304] 0 2024-04-25T22:42:15.739 INFO:tasks.workunit.client.0.smithi057.stdout:8/471: write d4/d5/f7 [3521952,62000] 0 2024-04-25T22:42:15.739 INFO:tasks.workunit.client.0.smithi057.stdout:9/520: dread - d3/d34/d42/d28/d2d/d9c/f9f zero size 2024-04-25T22:42:15.740 INFO:tasks.workunit.client.0.smithi057.stdout:0/495: mknod d0/d3/d4d/d87/da0/cac 0 2024-04-25T22:42:15.740 INFO:tasks.workunit.client.0.smithi057.stdout:1/481: rename d7/d65/d6a/d98/d41/d45/f5b to d7/d65/d6a/d98/f9e 0 2024-04-25T22:42:15.741 INFO:tasks.workunit.client.0.smithi057.stdout:6/524: write d2/d19/d49/d62/f8f [232958,120567] 0 2024-04-25T22:42:15.741 INFO:tasks.workunit.client.0.smithi057.stdout:7/506: dread d6/d28/d4e/d30/d46/f49 [0,4194304] 0 2024-04-25T22:42:15.741 INFO:tasks.workunit.client.0.smithi057.stdout:4/503: dread - d14/d5a/d67/d70/d85/fa1 zero size 2024-04-25T22:42:15.742 INFO:tasks.workunit.client.0.smithi057.stdout:9/521: read - d3/d34/d42/d28/f72 zero size 2024-04-25T22:42:15.742 INFO:tasks.workunit.client.0.smithi057.stdout:0/496: creat d0/d3/d6/d83/fad x:0 0 0 2024-04-25T22:42:15.742 INFO:tasks.workunit.client.0.smithi057.stdout:4/504: dread - d14/d47/d5e/f8e zero size 2024-04-25T22:42:15.742 INFO:tasks.workunit.client.0.smithi057.stdout:1/482: creat d7/dd/d16/d18/d31/d8f/f9f x:0 0 0 2024-04-25T22:42:15.743 INFO:tasks.workunit.client.0.smithi057.stdout:3/468: sync 2024-04-25T22:42:15.743 INFO:tasks.workunit.client.0.smithi057.stdout:8/472: sync 2024-04-25T22:42:15.743 INFO:tasks.workunit.client.0.smithi057.stdout:7/507: dread - d6/d28/d4e/d30/d46/f90 zero size 2024-04-25T22:42:15.743 INFO:tasks.workunit.client.0.smithi057.stdout:6/525: write d2/d19/d50/d91/fa3 [4465693,12777] 0 2024-04-25T22:42:15.743 INFO:tasks.workunit.client.0.smithi057.stdout:4/505: creat d14/d5a/fa6 x:0 0 0 2024-04-25T22:42:15.743 INFO:tasks.workunit.client.0.smithi057.stdout:3/469: chown d0/d5b/f79 501400 1 2024-04-25T22:42:15.744 INFO:tasks.workunit.client.0.smithi057.stdout:0/497: mkdir d0/d3/dae 0 2024-04-25T22:42:15.744 INFO:tasks.workunit.client.0.smithi057.stdout:8/473: creat d4/d5/d21/fb3 x:0 0 0 2024-04-25T22:42:15.744 INFO:tasks.workunit.client.0.smithi057.stdout:7/508: mkdir d6/daa 0 2024-04-25T22:42:15.745 INFO:tasks.workunit.client.0.smithi057.stdout:3/470: stat d0/d4/d7/d22/f59 0 2024-04-25T22:42:15.745 INFO:tasks.workunit.client.0.smithi057.stdout:8/474: chown d4/db/dd/l1f 862 1 2024-04-25T22:42:15.746 INFO:tasks.workunit.client.0.smithi057.stdout:3/471: chown d0/d4/d7b/d8f 0 1 2024-04-25T22:42:15.746 INFO:tasks.workunit.client.0.smithi057.stdout:5/569: dread d2/d1c/d24/f4c [0,4194304] 0 2024-04-25T22:42:15.746 INFO:tasks.workunit.client.0.smithi057.stdout:0/498: stat d0/l18 0 2024-04-25T22:42:15.748 INFO:tasks.workunit.client.0.smithi057.stdout:2/555: dread d1f/d34/f57 [0,4194304] 0 2024-04-25T22:42:15.749 INFO:tasks.workunit.client.0.smithi057.stdout:0/499: rmdir d0/d3/d3a/d3b 39 2024-04-25T22:42:15.749 INFO:tasks.workunit.client.0.smithi057.stdout:7/509: readlink d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/l67 0 2024-04-25T22:42:15.750 INFO:tasks.workunit.client.0.smithi057.stdout:2/556: fdatasync f6 0 2024-04-25T22:42:15.750 INFO:tasks.workunit.client.0.smithi057.stdout:8/475: creat d4/d5/d2f/fb4 x:0 0 0 2024-04-25T22:42:15.750 INFO:tasks.workunit.client.0.smithi057.stdout:8/476: sync 2024-04-25T22:42:15.752 INFO:tasks.workunit.client.0.smithi057.stdout:0/500: fdatasync d0/d3/d4d/f1d 0 2024-04-25T22:42:15.752 INFO:tasks.workunit.client.0.smithi057.stdout:7/510: rmdir d6/d28/d4e 39 2024-04-25T22:42:15.752 INFO:tasks.workunit.client.0.smithi057.stdout:9/522: dwrite d3/d34/d42/fa6 [0,4194304] 0 2024-04-25T22:42:15.753 INFO:tasks.workunit.client.0.smithi057.stdout:2/557: dread - d1f/d36/d54/f8d zero size 2024-04-25T22:42:15.753 INFO:tasks.workunit.client.0.smithi057.stdout:0/501: fdatasync d0/f2d 0 2024-04-25T22:42:15.754 INFO:tasks.workunit.client.0.smithi057.stdout:8/477: chown d4/f5e 31004909 1 2024-04-25T22:42:15.757 INFO:tasks.workunit.client.0.smithi057.stdout:1/483: dwrite d7/dd/d16/f36 [0,4194304] 0 2024-04-25T22:42:15.758 INFO:tasks.workunit.client.0.smithi057.stdout:9/523: chown d3/d34/d42/d28/d39/d54 1320222 1 2024-04-25T22:42:15.758 INFO:tasks.workunit.client.0.smithi057.stdout:4/506: dwrite d14/d2f/f4a [0,4194304] 0 2024-04-25T22:42:15.760 INFO:tasks.workunit.client.0.smithi057.stdout:0/502: creat d0/d3/d4d/d87/da0/faf x:0 0 0 2024-04-25T22:42:15.760 INFO:tasks.workunit.client.0.smithi057.stdout:7/511: rename d6/d28/d4e/d30/d46/f71 to d6/d91/fab 0 2024-04-25T22:42:15.762 INFO:tasks.workunit.client.0.smithi057.stdout:5/570: dwrite d2/d1c/d46/d3a/d6a/d54/fb1 [0,4194304] 0 2024-04-25T22:42:15.762 INFO:tasks.workunit.client.0.smithi057.stdout:4/507: mkdir d14/da2/da7 0 2024-04-25T22:42:15.762 INFO:tasks.workunit.client.0.smithi057.stdout:6/526: dwrite d2/d19/d49/f54 [0,4194304] 0 2024-04-25T22:42:15.762 INFO:tasks.workunit.client.0.smithi057.stdout:1/484: fsync d7/dd/d16/d18/d31/f9c 0 2024-04-25T22:42:15.762 INFO:tasks.workunit.client.0.smithi057.stdout:8/478: stat d4/d5/d17/d19/d35/d83/d92/d5b/d8c 0 2024-04-25T22:42:15.762 INFO:tasks.workunit.client.0.smithi057.stdout:3/472: dwrite d0/d4/f90 [0,4194304] 0 2024-04-25T22:42:15.763 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:15.760+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:15.763 INFO:tasks.workunit.client.0.smithi057.stdout:6/527: chown d2/d19/d49/d62 23 1 2024-04-25T22:42:15.763 INFO:tasks.workunit.client.0.smithi057.stdout:8/479: stat d4/d5/f9f 0 2024-04-25T22:42:15.766 INFO:tasks.workunit.client.0.smithi057.stdout:5/571: read d2/d6/f92 [268808,29085] 0 2024-04-25T22:42:15.766 INFO:tasks.workunit.client.0.smithi057.stdout:4/508: dread - d14/d5a/d67/d70/d85/fa1 zero size 2024-04-25T22:42:15.766 INFO:tasks.workunit.client.0.smithi057.stdout:1/485: readlink d7/d65/d6a/d98/l83 0 2024-04-25T22:42:15.766 INFO:tasks.workunit.client.0.smithi057.stdout:8/480: write d4/f32 [809273,103949] 0 2024-04-25T22:42:15.767 INFO:tasks.workunit.client.0.smithi057.stdout:1/486: readlink d7/d65/l69 0 2024-04-25T22:42:15.767 INFO:tasks.workunit.client.0.smithi057.stdout:8/481: fdatasync d4/d5/d21/f6c 0 2024-04-25T22:42:15.767 INFO:tasks.workunit.client.0.smithi057.stdout:5/572: truncate d2/d1c/f26 1581274 0 2024-04-25T22:42:15.768 INFO:tasks.workunit.client.0.smithi057.stdout:4/509: rename d14/d47/d5e/f96 to d14/d2f/d4c/fa8 0 2024-04-25T22:42:15.768 INFO:tasks.workunit.client.0.smithi057.stdout:8/482: write d4/d5/d21/f4c [4385059,111768] 0 2024-04-25T22:42:15.768 INFO:tasks.workunit.client.0.smithi057.stdout:1/487: creat d7/dd/d16/d24/d61/fa0 x:0 0 0 2024-04-25T22:42:15.769 INFO:tasks.workunit.client.0.smithi057.stdout:8/483: readlink d4/d5/d17/d19/l87 0 2024-04-25T22:42:15.769 INFO:tasks.workunit.client.0.smithi057.stdout:1/488: rename d7/d65 to d7/d65/d6a/d98/da1 22 2024-04-25T22:42:15.769 INFO:tasks.workunit.client.0.smithi057.stdout:8/484: rmdir d4/d5/d21/db0 39 2024-04-25T22:42:15.770 INFO:tasks.workunit.client.0.smithi057.stdout:8/485: sync 2024-04-25T22:42:15.770 INFO:tasks.workunit.client.0.smithi057.stdout:2/558: truncate f1d 371287 0 2024-04-25T22:42:15.773 INFO:tasks.workunit.client.0.smithi057.stdout:1/489: dread d7/dd/f46 [0,4194304] 0 2024-04-25T22:42:15.773 INFO:tasks.workunit.client.0.smithi057.stdout:5/573: dread d2/d1c/d24/d3d/da7/fac [0,4194304] 0 2024-04-25T22:42:15.773 INFO:tasks.workunit.client.0.smithi057.stdout:7/512: dread d6/d28/f41 [4194304,4194304] 0 2024-04-25T22:42:15.773 INFO:tasks.workunit.client.0.smithi057.stdout:7/513: sync 2024-04-25T22:42:15.773 INFO:tasks.workunit.client.0.smithi057.stdout:6/528: truncate d2/d19/d49/d62/f7e 801429 0 2024-04-25T22:42:15.774 INFO:tasks.workunit.client.0.smithi057.stdout:7/514: stat d6/d28/d4e/l78 0 2024-04-25T22:42:15.774 INFO:tasks.workunit.client.0.smithi057.stdout:1/490: mkdir d7/dd/d16/d18/d31/da2 0 2024-04-25T22:42:15.777 INFO:tasks.workunit.client.0.smithi057.stdout:4/510: dwrite d14/d2f/d4c/fa8 [0,4194304] 0 2024-04-25T22:42:15.781 INFO:tasks.workunit.client.0.smithi057.stdout:4/511: stat d14/d5a/d67/c97 0 2024-04-25T22:42:15.782 INFO:tasks.workunit.client.0.smithi057.stdout:0/503: dwrite d0/d3/d4d/d87/d91/f94 [0,4194304] 0 2024-04-25T22:42:15.783 INFO:tasks.workunit.client.0.smithi057.stdout:7/515: rename d6/d28/d4e/c79 to d6/d28/d4e/d30/d60/d6f/d8a/da6/cac 0 2024-04-25T22:42:15.783 INFO:tasks.workunit.client.0.smithi057.stdout:8/486: dwrite d4/db/d89/f9b [0,4194304] 0 2024-04-25T22:42:15.784 INFO:tasks.workunit.client.0.smithi057.stdout:5/574: dwrite d2/d1c/d46/f70 [0,4194304] 0 2024-04-25T22:42:15.784 INFO:tasks.workunit.client.0.smithi057.stdout:4/512: rename d14/d3c to d14/da9 0 2024-04-25T22:42:15.784 INFO:tasks.workunit.client.0.smithi057.stdout:0/504: symlink d0/d3/d3a/lb0 0 2024-04-25T22:42:15.785 INFO:tasks.workunit.client.0.smithi057.stdout:6/529: dwrite d2/d19/d26/d63/f7d [4194304,4194304] 0 2024-04-25T22:42:15.785 INFO:tasks.workunit.client.0.smithi057.stdout:4/513: fdatasync d14/d47/f9e 0 2024-04-25T22:42:15.785 INFO:tasks.workunit.client.0.smithi057.stdout:8/487: creat d4/d5/d17/d19/d35/d83/d92/da6/fb5 x:0 0 0 2024-04-25T22:42:15.786 INFO:tasks.workunit.client.0.smithi057.stdout:0/505: creat d0/d3/dae/fb1 x:0 0 0 2024-04-25T22:42:15.786 INFO:tasks.workunit.client.0.smithi057.stdout:6/530: read - d2/d19/d50/d1a/f55 zero size 2024-04-25T22:42:15.786 INFO:tasks.workunit.client.0.smithi057.stdout:4/514: mkdir d14/d2f/d4c/d5b/daa 0 2024-04-25T22:42:15.787 INFO:tasks.workunit.client.0.smithi057.stdout:8/488: mknod d4/d5/d21/cb6 0 2024-04-25T22:42:15.787 INFO:tasks.workunit.client.0.smithi057.stdout:3/473: dread d0/d4/d7/d26/f56 [0,4194304] 0 2024-04-25T22:42:15.787 INFO:tasks.workunit.client.0.smithi057.stdout:6/531: write d2/d19/f3d [3259772,116537] 0 2024-04-25T22:42:15.788 INFO:tasks.workunit.client.0.smithi057.stdout:4/515: mknod d14/cab 0 2024-04-25T22:42:15.788 INFO:tasks.workunit.client.0.smithi057.stdout:5/575: link d2/d47/da5/la4 d2/d47/d94/lb6 0 2024-04-25T22:42:15.788 INFO:tasks.workunit.client.0.smithi057.stdout:8/489: unlink d4/db/dd/d3a/f74 0 2024-04-25T22:42:15.789 INFO:tasks.workunit.client.0.smithi057.stdout:3/474: mkdir d0/d4/d7/d22/da0 0 2024-04-25T22:42:15.789 INFO:tasks.workunit.client.0.smithi057.stdout:4/516: symlink d14/lac 0 2024-04-25T22:42:15.789 INFO:tasks.workunit.client.0.smithi057.stdout:2/559: dread d1f/d34/f77 [0,4194304] 0 2024-04-25T22:42:15.790 INFO:tasks.workunit.client.0.smithi057.stdout:5/576: readlink d2/d47/d60/l90 0 2024-04-25T22:42:15.790 INFO:tasks.workunit.client.0.smithi057.stdout:1/491: dread d7/f8e [0,4194304] 0 2024-04-25T22:42:15.791 INFO:tasks.workunit.client.0.smithi057.stdout:2/560: write f1b [432898,113252] 0 2024-04-25T22:42:15.791 INFO:tasks.workunit.client.0.smithi057.stdout:4/517: symlink d14/d5a/d67/lad 0 2024-04-25T22:42:15.791 INFO:tasks.workunit.client.0.smithi057.stdout:6/532: link d2/d19/d50/d1a/d22/c5b d2/d19/d49/d62/d79/ca6 0 2024-04-25T22:42:15.791 INFO:tasks.workunit.client.0.smithi057.stdout:8/490: mkdir d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7 0 2024-04-25T22:42:15.791 INFO:tasks.workunit.client.0.smithi057.stdout:2/561: fsync d1f/d21/f45 0 2024-04-25T22:42:15.792 INFO:tasks.workunit.client.0.smithi057.stdout:6/533: mknod d2/d19/d26/ca7 0 2024-04-25T22:42:15.792 INFO:tasks.workunit.client.0.smithi057.stdout:8/491: fsync d4/d5/d17/d19/d35/faf 0 2024-04-25T22:42:15.792 INFO:tasks.workunit.client.0.smithi057.stdout:4/518: creat d14/d2f/d4c/fae x:0 0 0 2024-04-25T22:42:15.792 INFO:tasks.workunit.client.0.smithi057.stdout:2/562: creat d1f/d36/d54/fbf x:0 0 0 2024-04-25T22:42:15.793 INFO:tasks.workunit.client.0.smithi057.stdout:1/492: rename d7/dd/d16/d24/d61/c67 to d7/d65/d6a/d98/d41/d75/ca3 0 2024-04-25T22:42:15.793 INFO:tasks.workunit.client.0.smithi057.stdout:8/492: write d4/db/fb2 [944711,130301] 0 2024-04-25T22:42:15.793 INFO:tasks.workunit.client.0.smithi057.stdout:4/519: chown d14/c24 49 1 2024-04-25T22:42:15.794 INFO:tasks.workunit.client.0.smithi057.stdout:2/563: mkdir d1f/d36/d54/dc0 0 2024-04-25T22:42:15.794 INFO:tasks.workunit.client.0.smithi057.stdout:6/534: mknod d2/d19/d26/d4f/d95/ca8 0 2024-04-25T22:42:15.796 INFO:tasks.workunit.client.0.smithi057.stdout:8/493: mknod d4/d5/d17/cb8 0 2024-04-25T22:42:15.796 INFO:tasks.workunit.client.0.smithi057.stdout:4/520: write d14/d47/f9e [215672,82435] 0 2024-04-25T22:42:15.796 INFO:tasks.workunit.client.0.smithi057.stdout:6/535: creat d2/d19/d26/d4f/d95/fa9 x:0 0 0 2024-04-25T22:42:15.796 INFO:tasks.workunit.client.0.smithi057.stdout:1/493: chown d7/d65/d6a/d98/d41/d75/f9d 65132816 1 2024-04-25T22:42:15.796 INFO:tasks.workunit.client.0.smithi057.stdout:1/494: sync 2024-04-25T22:42:15.796 INFO:tasks.workunit.client.0.smithi057.stdout:8/494: chown d4/d5/f9f 1799114 1 2024-04-25T22:42:15.797 INFO:tasks.workunit.client.0.smithi057.stdout:4/521: fsync d14/d47/d5e/f92 0 2024-04-25T22:42:15.797 INFO:tasks.workunit.client.0.smithi057.stdout:2/564: rename f9 to d1f/d34/fc1 0 2024-04-25T22:42:15.797 INFO:tasks.workunit.client.0.smithi057.stdout:7/516: truncate d6/d28/d4e/d30/d60/f86 3534799 0 2024-04-25T22:42:15.797 INFO:tasks.workunit.client.0.smithi057.stdout:1/495: creat d7/fa4 x:0 0 0 2024-04-25T22:42:15.798 INFO:tasks.workunit.client.0.smithi057.stdout:3/475: write d0/d4/d7b/f9f [1962449,82079] 0 2024-04-25T22:42:15.798 INFO:tasks.workunit.client.0.smithi057.stdout:5/577: dwrite d2/d1c/d46/f89 [0,4194304] 0 2024-04-25T22:42:15.798 INFO:tasks.workunit.client.0.smithi057.stdout:6/536: truncate d2/d19/d50/d91/fa3 5881446 0 2024-04-25T22:42:15.798 INFO:tasks.workunit.client.0.smithi057.stdout:5/578: sync 2024-04-25T22:42:15.799 INFO:tasks.workunit.client.0.smithi057.stdout:8/495: write d4/d5/d17/d19/f26 [2602220,87592] 0 2024-04-25T22:42:15.799 INFO:tasks.workunit.client.0.smithi057.stdout:3/476: fsync d0/d4/d4a/f71 0 2024-04-25T22:42:15.800 INFO:tasks.workunit.client.0.smithi057.stdout:8/496: write d4/d5/f23 [342740,69669] 0 2024-04-25T22:42:15.800 INFO:tasks.workunit.client.0.smithi057.stdout:4/522: rename d14/d5a/l83 to d14/d47/d5e/d5f/laf 0 2024-04-25T22:42:15.800 INFO:tasks.workunit.client.0.smithi057.stdout:8/497: sync 2024-04-25T22:42:15.801 INFO:tasks.workunit.client.0.smithi057.stdout:7/517: rename d6/d28/d4e/d30/d60/d6f/d8a to d6/d28/d4e/d30/d60/d8d/d96/d51/dad 0 2024-04-25T22:42:15.803 INFO:tasks.workunit.client.0.smithi057.stdout:3/477: creat d0/fa1 x:0 0 0 2024-04-25T22:42:15.804 INFO:tasks.workunit.client.0.smithi057.stdout:8/498: creat d4/db/fb9 x:0 0 0 2024-04-25T22:42:15.804 INFO:tasks.workunit.client.0.smithi057.stdout:5/579: dread d2/d1c/d46/f84 [0,4194304] 0 2024-04-25T22:42:15.805 INFO:tasks.workunit.client.0.smithi057.stdout:2/565: dwrite d1f/d4a/f9b [0,4194304] 0 2024-04-25T22:42:15.805 INFO:tasks.workunit.client.0.smithi057.stdout:7/518: symlink d6/d28/d4e/d30/d60/d8d/d96/d59/lae 0 2024-04-25T22:42:15.806 INFO:tasks.workunit.client.0.smithi057.stdout:3/478: read - d0/d4/d7/d46/f29 zero size 2024-04-25T22:42:15.806 INFO:tasks.workunit.client.0.smithi057.stdout:6/537: dread d2/d19/d50/d91/fa2 [4194304,4194304] 0 2024-04-25T22:42:15.807 INFO:tasks.workunit.client.0.smithi057.stdout:2/566: creat d1f/d21/fc2 x:0 0 0 2024-04-25T22:42:15.807 INFO:tasks.workunit.client.0.smithi057.stdout:8/499: mkdir d4/dba 0 2024-04-25T22:42:15.808 INFO:tasks.workunit.client.0.smithi057.stdout:3/479: write d0/d4/f90 [318467,94357] 0 2024-04-25T22:42:15.808 INFO:tasks.workunit.client.0.smithi057.stdout:6/538: fsync d2/d19/d49/d62/f70 0 2024-04-25T22:42:15.808 INFO:tasks.workunit.client.0.smithi057.stdout:2/567: stat d1f/d21/d33/f87 0 2024-04-25T22:42:15.808 INFO:tasks.workunit.client.0.smithi057.stdout:6/539: sync 2024-04-25T22:42:15.809 INFO:tasks.workunit.client.0.smithi057.stdout:3/480: fsync d0/d11/f12 0 2024-04-25T22:42:15.809 INFO:tasks.workunit.client.0.smithi057.stdout:8/500: chown d4/db/f42 56817 1 2024-04-25T22:42:15.810 INFO:tasks.workunit.client.0.smithi057.stdout:2/568: creat d1f/d34/d50/fc3 x:0 0 0 2024-04-25T22:42:15.811 INFO:tasks.workunit.client.0.smithi057.stdout:4/523: dwrite d14/d2f/d4c/fae [0,4194304] 0 2024-04-25T22:42:15.811 INFO:tasks.workunit.client.0.smithi057.stdout:3/481: symlink d0/d4/d7b/d7c/la2 0 2024-04-25T22:42:15.811 INFO:tasks.workunit.client.0.smithi057.stdout:2/569: rmdir d1f/d36/d60 39 2024-04-25T22:42:15.811 INFO:tasks.workunit.client.0.smithi057.stdout:2/570: chown d1f/d36/d54 22374 1 2024-04-25T22:42:15.812 INFO:tasks.workunit.client.0.smithi057.stdout:2/571: readlink d1f/d34/l84 0 2024-04-25T22:42:15.812 INFO:tasks.workunit.client.0.smithi057.stdout:6/540: mkdir d2/d19/d50/d1a/d22/d31/d83/daa 0 2024-04-25T22:42:15.812 INFO:tasks.workunit.client.0.smithi057.stdout:3/482: symlink d0/d4/d7b/d7c/la3 0 2024-04-25T22:42:15.813 INFO:tasks.workunit.client.0.smithi057.stdout:7/519: dread d6/d28/d4e/d30/f43 [0,4194304] 0 2024-04-25T22:42:15.813 INFO:tasks.workunit.client.0.smithi057.stdout:4/524: write d14/f39 [123502,129212] 0 2024-04-25T22:42:15.814 INFO:tasks.workunit.client.0.smithi057.stdout:6/541: mknod d2/d19/d20/d9e/cab 0 2024-04-25T22:42:15.814 INFO:tasks.workunit.client.0.smithi057.stdout:3/483: rename d0/f33 to d0/d4/d7/d22/da0/fa4 0 2024-04-25T22:42:15.814 INFO:tasks.workunit.client.0.smithi057.stdout:8/501: creat d4/d5/d17/d19/d35/d83/d92/da6/fbb x:0 0 0 2024-04-25T22:42:15.815 INFO:tasks.workunit.client.0.smithi057.stdout:6/542: stat d2/d19/d85/l96 0 2024-04-25T22:42:15.815 INFO:tasks.workunit.client.0.smithi057.stdout:7/520: chown d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/f8e 1 1 2024-04-25T22:42:15.815 INFO:tasks.workunit.client.0.smithi057.stdout:4/525: creat d14/d2f/d4c/d5b/daa/fb0 x:0 0 0 2024-04-25T22:42:15.816 INFO:tasks.workunit.client.0.smithi057.stdout:8/502: fsync d4/d5/d17/d19/d35/d83/d92/d5b/f59 0 2024-04-25T22:42:15.816 INFO:tasks.workunit.client.0.smithi057.stdout:6/543: readlink d2/d59/l5d 0 2024-04-25T22:42:15.818 INFO:tasks.workunit.client.0.smithi057.stdout:8/503: stat d4/db/d12 0 2024-04-25T22:42:15.818 INFO:tasks.workunit.client.0.smithi057.stdout:7/521: symlink d6/d28/d4e/d30/d46/d73/laf 0 2024-04-25T22:42:15.818 INFO:tasks.workunit.client.0.smithi057.stdout:3/484: rename d0/d4/d7/d26/f9c to d0/d4/fa5 0 2024-04-25T22:42:15.818 INFO:tasks.workunit.client.0.smithi057.stdout:1/496: dwrite d7/dd/d90/f97 [0,4194304] 0 2024-04-25T22:42:15.822 INFO:tasks.workunit.client.0.smithi057.stdout:1/497: unlink d7/d65/d6a/d98/d41/d6b/f6e 0 2024-04-25T22:42:15.822 INFO:tasks.workunit.client.0.smithi057.stdout:3/485: truncate d0/d4/d7b/d7c/f9d 323397 0 2024-04-25T22:42:15.822 INFO:tasks.workunit.client.0.smithi057.stdout:1/498: write d7/f92 [191001,125093] 0 2024-04-25T22:42:15.822 INFO:tasks.workunit.client.0.smithi057.stdout:5/580: dwrite d2/d2c/fab [0,4194304] 0 2024-04-25T22:42:15.823 INFO:tasks.workunit.client.0.smithi057.stdout:8/504: truncate d4/d5/d17/d19/d35/d83/d92/da6/fbb 789738 0 2024-04-25T22:42:15.824 INFO:tasks.workunit.client.0.smithi057.stdout:5/581: mkdir d2/d2c/db7 0 2024-04-25T22:42:15.825 INFO:tasks.workunit.client.0.smithi057.stdout:6/544: dwrite d2/d19/d50/d1a/f55 [0,4194304] 0 2024-04-25T22:42:15.825 INFO:tasks.workunit.client.0.smithi057.stdout:2/572: read d1f/d21/d26/fad [135658,74400] 0 2024-04-25T22:42:15.825 INFO:tasks.workunit.client.0.smithi057.stdout:1/499: mknod d7/dd/ca5 0 2024-04-25T22:42:15.826 INFO:tasks.workunit.client.0.smithi057.stdout:8/505: creat d4/d5/d17/d19/d35/d83/d92/da6/fbc x:0 0 0 2024-04-25T22:42:15.827 INFO:tasks.workunit.client.0.smithi057.stdout:5/582: write d2/d6/db/f2f [1042368,53193] 0 2024-04-25T22:42:15.827 INFO:tasks.workunit.client.0.smithi057.stdout:6/545: rmdir d2/d19/d26/d63 39 2024-04-25T22:42:15.827 INFO:tasks.workunit.client.0.smithi057.stdout:1/500: mknod d7/d65/ca6 0 2024-04-25T22:42:15.827 INFO:tasks.workunit.client.0.smithi057.stdout:8/506: chown d4/db/dd/d3a/fa4 130489587 1 2024-04-25T22:42:15.827 INFO:tasks.workunit.client.0.smithi057.stdout:6/546: rename d2/f6f to d2/d86/fac 0 2024-04-25T22:42:15.828 INFO:tasks.workunit.client.0.smithi057.stdout:5/583: dread d2/d47/f9e [0,4194304] 0 2024-04-25T22:42:15.828 INFO:tasks.workunit.client.0.smithi057.stdout:6/547: mkdir d2/d19/d49/d62/d79/dad 0 2024-04-25T22:42:15.829 INFO:tasks.workunit.client.0.smithi057.stdout:5/584: creat d2/d1c/d46/d3a/da8/fb8 x:0 0 0 2024-04-25T22:42:15.829 INFO:tasks.workunit.client.0.smithi057.stdout:8/507: mkdir d4/db/d72/dbd 0 2024-04-25T22:42:15.829 INFO:tasks.workunit.client.0.smithi057.stdout:6/548: stat d2/d19/d50/d1a/f93 0 2024-04-25T22:42:15.829 INFO:tasks.workunit.client.0.smithi057.stdout:5/585: chown d2/d1c/d24/d3d/d77 3651 1 2024-04-25T22:42:15.830 INFO:tasks.workunit.client.0.smithi057.stdout:6/549: mknod d2/d19/d50/d91/cae 0 2024-04-25T22:42:15.831 INFO:tasks.workunit.client.0.smithi057.stdout:4/526: write d14/f25 [292435,89981] 0 2024-04-25T22:42:15.831 INFO:tasks.workunit.client.0.smithi057.stdout:8/508: creat d4/db/dd/d3a/d5c/d76/fbe x:0 0 0 2024-04-25T22:42:15.831 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:15.831 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:15.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.831 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:12754 4.17 e64/57 4:ebd2090c:::100000034a3.00000000:head v 64'187, mlcod=64'185)", 2024-04-25T22:42:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.816709+0000", 2024-04-25T22:42:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.015222414, 2024-04-25T22:42:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015256726999999999, 2024-04-25T22:42:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.816709+0000", 2024-04-25T22:42:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:15.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.816709+0000", 2024-04-25T22:42:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.816711+0000", 2024-04-25T22:42:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.956e-06 2024-04-25T22:42:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.824224+0000", 2024-04-25T22:42:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0075130509999999998 2024-04-25T22:42:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:15.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.824245+0000", 2024-04-25T22:42:15.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0520999999999999e-05 2024-04-25T22:42:15.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.824257+0000", 2024-04-25T22:42:15.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2254e-05 2024-04-25T22:42:15.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:15.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.824344+0000", 2024-04-25T22:42:15.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7476000000000001e-05 2024-04-25T22:42:15.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:15.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.824377+0000", 2024-04-25T22:42:15.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3056999999999999e-05 2024-04-25T22:42:15.835 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:15.835 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:15.835 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:15.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.835 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12756 4.38 4:1cda8244:::100000035dc.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:15.835 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.818182+0000", 2024-04-25T22:42:15.835 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.013749236, 2024-04-25T22:42:15.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013843622, 2024-04-25T22:42:15.835 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:15.835 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:15.835 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:42:15.835 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:15.835 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:15.836 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:15.836 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12756 2024-04-25T22:42:15.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.836 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:15.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:15.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.818182+0000", 2024-04-25T22:42:15.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:15.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:15.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.818182+0000", 2024-04-25T22:42:15.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:15.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:15.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.818183+0000", 2024-04-25T22:42:15.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0999999999999997e-07 2024-04-25T22:42:15.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:15.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.824536+0000", 2024-04-25T22:42:15.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.006353399 2024-04-25T22:42:15.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:15.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.824551+0000", 2024-04-25T22:42:15.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4202999999999999e-05 2024-04-25T22:42:15.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.824559+0000", 2024-04-25T22:42:15.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5669999999999995e-06 2024-04-25T22:42:15.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:15.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.824703+0000", 2024-04-25T22:42:15.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014328999999999999 2024-04-25T22:42:15.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:15.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.824898+0000", 2024-04-25T22:42:15.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000195675 2024-04-25T22:42:15.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:15.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.825041+0000", 2024-04-25T22:42:15.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000142788 2024-04-25T22:42:15.839 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:15.839 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:15.839 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:15.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.839 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:12767 4.17 e64/57 4:ebaa5eb9:::100000031ea.00000000:head v 64'188, mlcod=64'185)", 2024-04-25T22:42:15.839 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.831769+0000", 2024-04-25T22:42:15.839 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00016195900000000001, 2024-04-25T22:42:15.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033336800000000001, 2024-04-25T22:42:15.839 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:15.840 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:15.840 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:15.840 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:15.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:15.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.831769+0000", 2024-04-25T22:42:15.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:15.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:15.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.831769+0000", 2024-04-25T22:42:15.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:15.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:15.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.831771+0000", 2024-04-25T22:42:15.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.522e-06 2024-04-25T22:42:15.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:15.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.831887+0000", 2024-04-25T22:42:15.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011626200000000001 2024-04-25T22:42:15.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:15.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.831904+0000", 2024-04-25T22:42:15.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6843000000000001e-05 2024-04-25T22:42:15.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.831914+0000", 2024-04-25T22:42:15.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0094e-05 2024-04-25T22:42:15.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:15.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.831983+0000", 2024-04-25T22:42:15.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8924999999999995e-05 2024-04-25T22:42:15.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:15.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.832008+0000", 2024-04-25T22:42:15.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4953e-05 2024-04-25T22:42:15.843 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:15.843 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:15.843 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:15.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.843 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12764 4.39 4.f37a33b9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:15.843 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.825335+0000", 2024-04-25T22:42:15.843 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0065969000000000002, 2024-04-25T22:42:15.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0068072669999999997, 2024-04-25T22:42:15.843 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:15.843 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:15.843 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-25T22:42:15.843 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:15.843 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:15.844 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:15.844 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12764 2024-04-25T22:42:15.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.844 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:15.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:15.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.825335+0000", 2024-04-25T22:42:15.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:15.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:15.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.825335+0000", 2024-04-25T22:42:15.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:15.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:15.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.825336+0000", 2024-04-25T22:42:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6330000000000001e-06 2024-04-25T22:42:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.832098+0000", 2024-04-25T22:42:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067619949999999998 2024-04-25T22:42:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.832113+0000", 2024-04-25T22:42:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5167999999999999e-05 2024-04-25T22:42:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.832123+0000", 2024-04-25T22:42:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0118e-05 2024-04-25T22:42:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12765 4.34 4.c4050274 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.832153+0000", 2024-04-25T22:42:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9997787, 2024-04-25T22:42:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2262999999999999e-05, 2024-04-25T22:42:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-25T22:42:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12765 2024-04-25T22:42:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.832153+0000", 2024-04-25T22:42:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.832153+0000", 2024-04-25T22:42:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.832155+0000", 2024-04-25T22:42:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.835e-06 2024-04-25T22:42:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.832159+0000", 2024-04-25T22:42:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7890000000000001e-06 2024-04-25T22:42:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.832168+0000", 2024-04-25T22:42:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5149999999999995e-06 2024-04-25T22:42:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.832177+0000", 2024-04-25T22:42:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0329999999999997e-06 2024-04-25T22:42:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-25T22:42:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 5 2024-04-25T22:42:15.849 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:15.852 INFO:tasks.workunit.client.0.smithi057.stdout:4/527: stat d14/d47/d5e/f92 0 2024-04-25T22:42:15.852 INFO:tasks.workunit.client.0.smithi057.stdout:6/550: write d2/d19/d49/d62/d79/f80 [915900,17096] 0 2024-04-25T22:42:15.852 INFO:tasks.workunit.client.0.smithi057.stdout:1/501: dwrite d7/d65/d6a/f6d [0,4194304] 0 2024-04-25T22:42:15.852 INFO:tasks.workunit.client.0.smithi057.stdout:6/551: sync 2024-04-25T22:42:15.852 INFO:tasks.workunit.client.0.smithi057.stdout:8/509: rename d4/d5/f23 to d4/fbf 0 2024-04-25T22:42:15.852 INFO:tasks.workunit.client.0.smithi057.stdout:4/528: read d14/d2f/f66 [48415,34119] 0 2024-04-25T22:42:15.852 INFO:tasks.workunit.client.0.smithi057.stdout:1/502: write d7/dd/d16/d18/f34 [5026383,37884] 0 2024-04-25T22:42:15.852 INFO:tasks.workunit.client.0.smithi057.stdout:8/510: mkdir d4/db/d12/dc0 0 2024-04-25T22:42:15.852 INFO:tasks.workunit.client.0.smithi057.stdout:4/529: link d14/d2f/l36 d14/da9/lb1 0 2024-04-25T22:42:15.852 INFO:tasks.workunit.client.0.smithi057.stdout:5/586: dwrite d2/d2c/f5d [0,4194304] 0 2024-04-25T22:42:15.852 INFO:tasks.workunit.client.0.smithi057.stdout:8/511: link d4/d5/d17/l29 d4/d5/d17/d19/d35/d83/d92/d5b/lc1 0 2024-04-25T22:42:15.852 INFO:tasks.workunit.client.0.smithi057.stdout:5/587: mknod d2/d1c/d46/d3a/d6a/d54/cb9 0 2024-04-25T22:42:15.852 INFO:tasks.workunit.client.0.smithi057.stdout:4/530: dread d14/d2f/f54 [0,4194304] 0 2024-04-25T22:42:15.853 INFO:tasks.workunit.client.0.smithi057.stdout:8/512: write d4/db/d12/f1c [4376677,22875] 0 2024-04-25T22:42:15.853 INFO:tasks.workunit.client.0.smithi057.stdout:6/552: dwrite d2/d19/d20/f6a [0,4194304] 0 2024-04-25T22:42:15.853 INFO:tasks.workunit.client.0.smithi057.stdout:1/503: dwrite d7/dd/d16/d24/f2e [0,4194304] 0 2024-04-25T22:42:15.853 INFO:tasks.workunit.client.0.smithi057.stdout:8/513: mkdir d4/d5/d2f/dc2 0 2024-04-25T22:42:15.853 INFO:tasks.workunit.client.0.smithi057.stdout:5/588: rename d2/d1c/f1f to d2/d1c/d24/d3d/d50/d83/fba 0 2024-04-25T22:42:15.853 INFO:tasks.workunit.client.0.smithi057.stdout:1/504: creat d7/d65/d6a/d98/d41/d6b/fa7 x:0 0 0 2024-04-25T22:42:15.853 INFO:tasks.workunit.client.0.smithi057.stdout:6/553: creat d2/d86/d90/faf x:0 0 0 2024-04-25T22:42:15.853 INFO:tasks.workunit.client.0.smithi057.stdout:6/554: fdatasync d2/d19/f3d 0 2024-04-25T22:42:15.853 INFO:tasks.workunit.client.0.smithi057.stdout:9/524: dread d3/ff [0,4194304] 0 2024-04-25T22:42:15.853 INFO:tasks.workunit.client.0.smithi057.stdout:6/555: rmdir d2 39 2024-04-25T22:42:15.853 INFO:tasks.workunit.client.0.smithi057.stdout:1/505: truncate d7/dd/d26/f47 1827134 0 2024-04-25T22:42:15.853 INFO:tasks.workunit.client.0.smithi057.stdout:6/556: mkdir d2/d19/d50/d1a/db0 0 2024-04-25T22:42:15.853 INFO:tasks.workunit.client.0.smithi057.stdout:9/525: creat d3/d34/d42/d28/d95/fae x:0 0 0 2024-04-25T22:42:15.853 INFO:tasks.workunit.client.0.smithi057.stdout:1/506: creat d7/dd/d16/d24/d61/fa8 x:0 0 0 2024-04-25T22:42:15.853 INFO:tasks.workunit.client.0.smithi057.stdout:2/573: write d1f/d21/f25 [957800,128656] 0 2024-04-25T22:42:15.854 INFO:tasks.workunit.client.0.smithi057.stdout:1/507: write d7/f42 [387389,54511] 0 2024-04-25T22:42:15.854 INFO:tasks.workunit.client.0.smithi057.stdout:2/574: rename f16 to d1f/d36/fc4 0 2024-04-25T22:42:15.854 INFO:tasks.workunit.client.0.smithi057.stdout:9/526: write d3/d34/d42/d28/f85 [1146262,96954] 0 2024-04-25T22:42:15.854 INFO:tasks.workunit.client.0.smithi057.stdout:4/531: dwrite d14/d47/d5e/f8e [0,4194304] 0 2024-04-25T22:42:15.855 INFO:tasks.workunit.client.0.smithi057.stdout:1/508: symlink d7/dd/d16/d24/la9 0 2024-04-25T22:42:15.855 INFO:tasks.workunit.client.0.smithi057.stdout:2/575: stat d1f/d34/d50/f53 0 2024-04-25T22:42:15.855 INFO:tasks.workunit.client.0.smithi057.stdout:3/486: dread d0/d4/d7/d46/f6f [0,4194304] 0 2024-04-25T22:42:15.855 INFO:tasks.workunit.client.0.smithi057.stdout:1/509: symlink d7/dd/d16/d24/d61/laa 0 2024-04-25T22:42:15.855 INFO:tasks.workunit.client.0.smithi057.stdout:5/589: truncate d2/d1c/d46/f89 3476192 0 2024-04-25T22:42:15.856 INFO:tasks.workunit.client.0.smithi057.stdout:9/527: getdents d3/d34 0 2024-04-25T22:42:15.856 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:15.857 INFO:tasks.workunit.client.0.smithi057.stdout:9/528: readlink d3/d34/d42/d28/d39/l47 0 2024-04-25T22:42:15.857 INFO:tasks.workunit.client.0.smithi057.stdout:2/576: link d1f/d36/d54/f95 d1f/d36/d54/fc5 0 2024-04-25T22:42:15.858 INFO:tasks.workunit.client.0.smithi057.stdout:1/510: creat d7/dd/d16/d18/fab x:0 0 0 2024-04-25T22:42:15.858 INFO:tasks.workunit.client.0.smithi057.stdout:5/590: truncate d2/d47/f68 444407 0 2024-04-25T22:42:15.858 INFO:tasks.workunit.client.0.smithi057.stdout:4/532: dread f9 [0,4194304] 0 2024-04-25T22:42:15.858 INFO:tasks.workunit.client.0.smithi057.stdout:2/577: dread - d1f/d34/f73 zero size 2024-04-25T22:42:15.859 INFO:tasks.workunit.client.0.smithi057.stdout:1/511: unlink d7/d65/d6a/d98/d41/d45/f5d 0 2024-04-25T22:42:15.859 INFO:tasks.workunit.client.0.smithi057.stdout:5/591: unlink d2/d6/c5e 0 2024-04-25T22:42:15.859 INFO:tasks.workunit.client.0.smithi057.stdout:4/533: chown d14/d2f/d4c/c5c 1518045355 1 2024-04-25T22:42:15.860 INFO:tasks.workunit.client.0.smithi057.stdout:9/529: link d3/c17 d3/d34/d42/d28/d2d/caf 0 2024-04-25T22:42:15.860 INFO:tasks.workunit.client.0.smithi057.stdout:1/512: chown d7/dd/d16/d18/fab 195 1 2024-04-25T22:42:15.860 INFO:tasks.workunit.client.0.smithi057.stdout:5/592: write d2/d1c/f48 [5089018,26794] 0 2024-04-25T22:42:15.861 INFO:tasks.workunit.client.0.smithi057.stdout:9/530: chown d3/d34/f5b 6613680 1 2024-04-25T22:42:15.861 INFO:tasks.workunit.client.0.smithi057.stdout:1/513: creat d7/dd/d16/d88/fac x:0 0 0 2024-04-25T22:42:15.861 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:15.855+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:15.862 INFO:tasks.workunit.client.0.smithi057.stdout:9/531: mkdir d3/d98/db0 0 2024-04-25T22:42:15.862 INFO:tasks.workunit.client.0.smithi057.stdout:0/506: dread d0/d49/f95 [0,4194304] 0 2024-04-25T22:42:15.862 INFO:tasks.workunit.client.0.smithi057.stdout:1/514: dread d7/f6f [0,4194304] 0 2024-04-25T22:42:15.862 INFO:tasks.workunit.client.0.smithi057.stdout:0/507: fsync d0/d5/d53/f67 0 2024-04-25T22:42:15.862 INFO:tasks.workunit.client.0.smithi057.stdout:9/532: creat d3/d34/d42/d28/d39/d54/d88/fb1 x:0 0 0 2024-04-25T22:42:15.864 INFO:tasks.workunit.client.0.smithi057.stdout:0/508: write d0/d3/d6/d14/f72 [3378394,25595] 0 2024-04-25T22:42:15.865 INFO:tasks.workunit.client.0.smithi057.stdout:0/509: rename d0/d3/c58 to d0/d3/dae/cb2 0 2024-04-25T22:42:15.865 INFO:tasks.workunit.client.0.smithi057.stdout:0/510: sync 2024-04-25T22:42:15.866 INFO:tasks.workunit.client.0.smithi057.stdout:0/511: chown d0/d3/d6/d14/l63 140 1 2024-04-25T22:42:15.866 INFO:tasks.workunit.client.0.smithi057.stdout:5/593: dwrite d2/d1c/d24/d3d/d50/d83/f9f [0,4194304] 0 2024-04-25T22:42:15.868 INFO:tasks.workunit.client.0.smithi057.stdout:5/594: creat d2/d6/db/fbb x:0 0 0 2024-04-25T22:42:15.869 INFO:tasks.workunit.client.0.smithi057.stdout:5/595: creat d2/d1c/d46/d3a/da8/fbc x:0 0 0 2024-04-25T22:42:15.870 INFO:tasks.workunit.client.0.smithi057.stdout:5/596: write d2/d6/f62 [462948,28223] 0 2024-04-25T22:42:15.871 INFO:tasks.workunit.client.0.smithi057.stdout:5/597: symlink d2/d1c/d46/lbd 0 2024-04-25T22:42:15.872 INFO:tasks.workunit.client.0.smithi057.stdout:1/515: getdents d7/dd/d16/d24/d61 0 2024-04-25T22:42:15.873 INFO:tasks.workunit.client.0.smithi057.stdout:5/598: mkdir d2/d1c/d46/d3a/d6a/dbe 0 2024-04-25T22:42:15.873 INFO:tasks.workunit.client.0.smithi057.stdout:1/516: rmdir d7/d4e 39 2024-04-25T22:42:15.874 INFO:tasks.workunit.client.0.smithi057.stdout:0/512: dwrite d0/d49/f9e [0,4194304] 0 2024-04-25T22:42:15.875 INFO:tasks.workunit.client.0.smithi057.stdout:5/599: symlink d2/d1c/d46/d3a/lbf 0 2024-04-25T22:42:15.875 INFO:tasks.workunit.client.0.smithi057.stdout:6/557: dwrite d2/d19/d50/d1a/d22/f5c [0,4194304] 0 2024-04-25T22:42:15.876 INFO:tasks.workunit.client.0.smithi057.stdout:1/517: dread - d7/dd/d16/d18/d31/d8f/f9f zero size 2024-04-25T22:42:15.876 INFO:tasks.workunit.client.0.smithi057.stdout:0/513: write d0/d5/d53/f69 [1647702,85299] 0 2024-04-25T22:42:15.876 INFO:tasks.workunit.client.0.smithi057.stdout:6/558: readlink d2/l16 0 2024-04-25T22:42:15.877 INFO:tasks.workunit.client.0.smithi057.stdout:4/534: dread d14/f39 [0,4194304] 0 2024-04-25T22:42:15.877 INFO:tasks.workunit.client.0.smithi057.stdout:7/522: dread d6/d28/d4e/d30/f56 [0,4194304] 0 2024-04-25T22:42:15.877 INFO:tasks.workunit.client.0.smithi057.stdout:1/518: creat d7/d65/d6a/fad x:0 0 0 2024-04-25T22:42:15.878 INFO:tasks.workunit.client.0.smithi057.stdout:5/600: chown d2/d6/db/l29 11478691 1 2024-04-25T22:42:15.878 INFO:tasks.workunit.client.0.smithi057.stdout:0/514: rmdir d0/d3/dae 39 2024-04-25T22:42:15.878 INFO:tasks.workunit.client.0.smithi057.stdout:6/559: creat d2/d59/fb1 x:0 0 0 2024-04-25T22:42:15.878 INFO:tasks.workunit.client.0.smithi057.stdout:4/535: rmdir d14/d5a 39 2024-04-25T22:42:15.879 INFO:tasks.workunit.client.0.smithi057.stdout:4/536: mknod d14/d47/cb2 0 2024-04-25T22:42:15.880 INFO:tasks.workunit.client.0.smithi057.stdout:1/519: truncate d7/dd/d16/f8d 294140 0 2024-04-25T22:42:15.880 INFO:tasks.workunit.client.0.smithi057.stdout:5/601: link d2/d6/c11 d2/d91/cc0 0 2024-04-25T22:42:15.881 INFO:tasks.workunit.client.0.smithi057.stdout:7/523: rename d6/d28/d4e/d30/d60/d8d/d96/d59/lae to d6/d28/d4e/d30/d60/d8d/d96/d59/lb0 0 2024-04-25T22:42:15.881 INFO:tasks.workunit.client.0.smithi057.stdout:6/560: rename d2/f11 to d2/d19/d49/d62/d79/fb2 0 2024-04-25T22:42:15.881 INFO:tasks.workunit.client.0.smithi057.stdout:1/520: chown d7/dd/d16/c68 319696990 1 2024-04-25T22:42:15.881 INFO:tasks.workunit.client.0.smithi057.stdout:4/537: chown d14/d5a/d67/d70/f91 688607 1 2024-04-25T22:42:15.883 INFO:tasks.workunit.client.0.smithi057.stdout:6/561: creat d2/d19/d26/d4f/fb3 x:0 0 0 2024-04-25T22:42:15.883 INFO:tasks.workunit.client.0.smithi057.stdout:1/521: truncate d7/dd/d16/f8d 894162 0 2024-04-25T22:42:15.883 INFO:tasks.workunit.client.0.smithi057.stdout:4/538: rmdir d14/da9/d44 39 2024-04-25T22:42:15.883 INFO:tasks.workunit.client.0.smithi057.stdout:5/602: truncate d2/d47/d6e/f82 294463 0 2024-04-25T22:42:15.884 INFO:tasks.workunit.client.0.smithi057.stdout:6/562: fdatasync d2/d19/d20/f45 0 2024-04-25T22:42:15.884 INFO:tasks.workunit.client.0.smithi057.stdout:4/539: symlink d14/da2/lb3 0 2024-04-25T22:42:15.885 INFO:tasks.workunit.client.0.smithi057.stdout:0/515: dwrite d0/d49/f6b [0,4194304] 0 2024-04-25T22:42:15.885 INFO:tasks.workunit.client.0.smithi057.stdout:1/522: chown d7/dd/d16/d18/d31/d8f/c91 790 1 2024-04-25T22:42:15.885 INFO:tasks.workunit.client.0.smithi057.stdout:4/540: write fc [2599976,86820] 0 2024-04-25T22:42:15.886 INFO:tasks.workunit.client.0.smithi057.stdout:5/603: creat d2/d1c/d24/d3d/da7/fc1 x:0 0 0 2024-04-25T22:42:15.886 INFO:tasks.workunit.client.0.smithi057.stdout:0/516: mknod d0/d49/d97/cb3 0 2024-04-25T22:42:15.887 INFO:tasks.workunit.client.0.smithi057.stdout:5/604: rename d2/d1c/d24/d3d/c4a to d2/d47/d87/cc2 0 2024-04-25T22:42:15.888 INFO:tasks.workunit.client.0.smithi057.stdout:5/605: stat d2/d47/d94/fad 0 2024-04-25T22:42:15.889 INFO:tasks.workunit.client.0.smithi057.stdout:3/487: dread d0/d11/f12 [0,4194304] 0 2024-04-25T22:42:15.889 INFO:tasks.workunit.client.0.smithi057.stdout:3/488: stat d0/f62 0 2024-04-25T22:42:15.891 INFO:tasks.workunit.client.0.smithi057.stdout:5/606: truncate d2/d1c/d46/d3a/d6a/d54/f67 1134488 0 2024-04-25T22:42:15.892 INFO:tasks.workunit.client.0.smithi057.stdout:3/489: mknod d0/d4/d7/d26/d89/d97/ca6 0 2024-04-25T22:42:15.892 INFO:tasks.workunit.client.0.smithi057.stdout:6/563: dwrite d2/d19/d50/d91/fa2 [0,4194304] 0 2024-04-25T22:42:15.893 INFO:tasks.workunit.client.0.smithi057.stdout:4/541: dwrite d14/f30 [0,4194304] 0 2024-04-25T22:42:15.894 INFO:tasks.workunit.client.0.smithi057.stdout:3/490: mkdir d0/d4/d7b/d7c/da7 0 2024-04-25T22:42:15.894 INFO:tasks.workunit.client.0.smithi057.stdout:6/564: mkdir d2/d19/d49/db4 0 2024-04-25T22:42:15.894 INFO:tasks.workunit.client.0.smithi057.stdout:6/565: sync 2024-04-25T22:42:15.895 INFO:tasks.workunit.client.0.smithi057.stdout:2/578: dread d1f/f2a [0,4194304] 0 2024-04-25T22:42:15.895 INFO:tasks.workunit.client.0.smithi057.stdout:3/491: mknod d0/d4/d7/d26/d89/ca8 0 2024-04-25T22:42:15.895 INFO:tasks.workunit.client.0.smithi057.stdout:4/542: truncate d14/d47/d5e/d5f/f8d 627395 0 2024-04-25T22:42:15.895 INFO:tasks.workunit.client.0.smithi057.stdout:3/492: symlink d0/d4/d7b/la9 0 2024-04-25T22:42:15.896 INFO:tasks.workunit.client.0.smithi057.stdout:4/543: chown d14/d2f/d4c/d5b/f93 42 1 2024-04-25T22:42:15.896 INFO:tasks.workunit.client.0.smithi057.stdout:6/566: fdatasync d2/d19/d50/d1a/d22/d31/f3f 0 2024-04-25T22:42:15.897 INFO:tasks.workunit.client.0.smithi057.stdout:2/579: rmdir d1f/d21/d96 39 2024-04-25T22:42:15.897 INFO:tasks.workunit.client.0.smithi057.stdout:3/493: getdents d0/d5b 0 2024-04-25T22:42:15.898 INFO:tasks.workunit.client.0.smithi057.stdout:6/567: creat d2/d19/d49/db4/fb5 x:0 0 0 2024-04-25T22:42:15.898 INFO:tasks.workunit.client.0.smithi057.stdout:3/494: chown d0/d11/f19 911609979 1 2024-04-25T22:42:15.899 INFO:tasks.workunit.client.0.smithi057.stdout:2/580: symlink d1f/d34/lc6 0 2024-04-25T22:42:15.902 INFO:tasks.workunit.client.0.smithi057.stdout:6/568: rmdir d2/d19/d26/d4f 39 2024-04-25T22:42:15.902 INFO:tasks.workunit.client.0.smithi057.stdout:0/517: dread d0/d3/d4d/f93 [0,4194304] 0 2024-04-25T22:42:15.902 INFO:tasks.workunit.client.0.smithi057.stdout:5/607: dwrite d2/d47/f8c [0,4194304] 0 2024-04-25T22:42:15.902 INFO:tasks.workunit.client.0.smithi057.stdout:2/581: stat d1f/d21/d33/f6e 0 2024-04-25T22:42:15.902 INFO:tasks.workunit.client.0.smithi057.stdout:3/495: rename d0/d5b/f79 to d0/d4/d7/d46/d30/faa 0 2024-04-25T22:42:15.902 INFO:tasks.workunit.client.0.smithi057.stdout:0/518: mknod d0/d3/d6/d14/cb4 0 2024-04-25T22:42:15.902 INFO:tasks.workunit.client.0.smithi057.stdout:2/582: fsync d1f/d4a/f3b 0 2024-04-25T22:42:15.903 INFO:tasks.workunit.client.0.smithi057.stdout:6/569: creat d2/d19/d26/d4f/d95/fb6 x:0 0 0 2024-04-25T22:42:15.903 INFO:tasks.workunit.client.0.smithi057.stdout:3/496: mkdir d0/d4/d4a/dab 0 2024-04-25T22:42:15.903 INFO:tasks.workunit.client.0.smithi057.stdout:3/497: sync 2024-04-25T22:42:15.903 INFO:tasks.workunit.client.0.smithi057.stdout:3/498: fsync d0/f95 0 2024-04-25T22:42:15.903 INFO:tasks.workunit.client.0.smithi057.stdout:0/519: write d0/d3/d4d/f8f [518758,108794] 0 2024-04-25T22:42:15.903 INFO:tasks.workunit.client.0.smithi057.stdout:3/499: rmdir d0/d5b 39 2024-04-25T22:42:15.907 INFO:tasks.workunit.client.0.smithi057.stdout:2/583: dwrite d1f/d21/d26/f4e [0,4194304] 0 2024-04-25T22:42:15.911 INFO:tasks.workunit.client.0.smithi057.stdout:0/520: dwrite d0/d5/f7f [0,4194304] 0 2024-04-25T22:42:15.912 INFO:tasks.workunit.client.0.smithi057.stdout:3/500: dwrite d0/d4/d34/d3c/d53/f94 [0,4194304] 0 2024-04-25T22:42:15.912 INFO:tasks.workunit.client.0.smithi057.stdout:7/524: truncate d6/d28/d4e/d30/d60/d8d/d96/d5d/f5e 2644961 0 2024-04-25T22:42:15.913 INFO:tasks.workunit.client.0.smithi057.stdout:0/521: truncate d0/f30 3199211 0 2024-04-25T22:42:15.913 INFO:tasks.workunit.client.0.smithi057.stdout:3/501: symlink d0/d4/d34/d3c/d53/lac 0 2024-04-25T22:42:15.914 INFO:tasks.workunit.client.0.smithi057.stdout:4/544: truncate d14/d2f/d4c/d5b/f8f 596353 0 2024-04-25T22:42:15.914 INFO:tasks.workunit.client.0.smithi057.stdout:3/502: chown d0/d4/d7/d22 325587634 1 2024-04-25T22:42:15.914 INFO:tasks.workunit.client.0.smithi057.stdout:0/522: dread - d0/d3/d4d/f81 zero size 2024-04-25T22:42:15.915 INFO:tasks.workunit.client.0.smithi057.stdout:7/525: unlink d6/d28/d4e/d30/d60/d8d/d96/l87 0 2024-04-25T22:42:15.915 INFO:tasks.workunit.client.0.smithi057.stdout:4/545: read - d14/da9/d44/fa4 zero size 2024-04-25T22:42:15.916 INFO:tasks.workunit.client.0.smithi057.stdout:0/523: write d0/d3/f68 [891376,90085] 0 2024-04-25T22:42:15.916 INFO:tasks.workunit.client.0.smithi057.stdout:3/503: mkdir d0/d4/d7/dad 0 2024-04-25T22:42:15.916 INFO:tasks.workunit.client.0.smithi057.stdout:4/546: read - d14/da9/f55 zero size 2024-04-25T22:42:15.917 INFO:tasks.workunit.client.0.smithi057.stdout:4/547: fdatasync d14/f39 0 2024-04-25T22:42:15.917 INFO:tasks.workunit.client.0.smithi057.stdout:3/504: chown d0/fe 3925 1 2024-04-25T22:42:15.917 INFO:tasks.workunit.client.0.smithi057.stdout:0/524: chown d0/l2e 391 1 2024-04-25T22:42:15.917 INFO:tasks.workunit.client.0.smithi057.stdout:4/548: chown d14/d47/d62 103849354 1 2024-04-25T22:42:15.919 INFO:tasks.workunit.client.0.smithi057.stdout:3/505: fdatasync d0/d4/d7/d46/d30/f65 0 2024-04-25T22:42:15.919 INFO:tasks.workunit.client.0.smithi057.stdout:2/584: dwrite d1f/d21/d26/f3a [0,4194304] 0 2024-04-25T22:42:15.919 INFO:tasks.workunit.client.0.smithi057.stdout:0/525: rename d0/d3/l3f to d0/d3/d88/lb5 0 2024-04-25T22:42:15.919 INFO:tasks.workunit.client.0.smithi057.stdout:4/549: mkdir d14/d5a/d67/db4 0 2024-04-25T22:42:15.919 INFO:tasks.workunit.client.0.smithi057.stdout:2/585: stat d1f/d4a/l5d 0 2024-04-25T22:42:15.921 INFO:tasks.workunit.client.0.smithi057.stdout:7/526: dread d6/f15 [0,4194304] 0 2024-04-25T22:42:15.921 INFO:tasks.workunit.client.0.smithi057.stdout:0/526: unlink d0/d3/d6/d29/c92 0 2024-04-25T22:42:15.921 INFO:tasks.workunit.client.0.smithi057.stdout:2/586: write d1f/d21/f25 [281466,52394] 0 2024-04-25T22:42:15.921 INFO:tasks.workunit.client.0.smithi057.stdout:4/550: mkdir d14/da9/db5 0 2024-04-25T22:42:15.922 INFO:tasks.workunit.client.0.smithi057.stdout:0/527: dread - d0/d3/d3a/fa8 zero size 2024-04-25T22:42:15.923 INFO:tasks.workunit.client.0.smithi057.stdout:6/570: write d2/f64 [640384,104264] 0 2024-04-25T22:42:15.924 INFO:tasks.workunit.client.0.smithi057.stdout:0/528: creat d0/d5/d53/fb6 x:0 0 0 2024-04-25T22:42:15.925 INFO:tasks.workunit.client.0.smithi057.stdout:0/529: mknod d0/d3/d3a/d3b/cb7 0 2024-04-25T22:42:15.925 INFO:tasks.workunit.client.0.smithi057.stdout:7/527: dread d6/f27 [0,4194304] 0 2024-04-25T22:42:15.925 INFO:tasks.workunit.client.0.smithi057.stdout:2/587: mknod d1f/d21/d96/cc7 0 2024-04-25T22:42:15.926 INFO:tasks.workunit.client.0.smithi057.stdout:7/528: write d6/d28/d4e/d30/f36 [2709342,9865] 0 2024-04-25T22:42:15.926 INFO:tasks.workunit.client.0.smithi057.stdout:0/530: unlink d0/d3/d6/d29/f75 0 2024-04-25T22:42:15.927 INFO:tasks.workunit.client.0.smithi057.stdout:2/588: creat d1f/d36/d60/fc8 x:0 0 0 2024-04-25T22:42:15.927 INFO:tasks.workunit.client.0.smithi057.stdout:7/529: dread - d6/d28/d4e/f3c zero size 2024-04-25T22:42:15.929 INFO:tasks.workunit.client.0.smithi057.stdout:7/530: rmdir d6/d28/d4e/d75 39 2024-04-25T22:42:15.929 INFO:tasks.workunit.client.0.smithi057.stdout:2/589: getdents d1f/d36/d60/da1 0 2024-04-25T22:42:15.930 INFO:tasks.workunit.client.0.smithi057.stdout:6/571: dwrite d2/d19/d50/d91/fa3 [4194304,4194304] 0 2024-04-25T22:42:15.931 INFO:tasks.workunit.client.0.smithi057.stdout:7/531: write d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d97/fa3 [66647,56240] 0 2024-04-25T22:42:15.932 INFO:tasks.workunit.client.0.smithi057.stdout:0/531: dread d0/d3/d4d/d87/d91/f94 [0,4194304] 0 2024-04-25T22:42:15.932 INFO:tasks.workunit.client.0.smithi057.stdout:8/514: dread d4/f5e [0,4194304] 0 2024-04-25T22:42:15.933 INFO:tasks.workunit.client.0.smithi057.stdout:8/515: sync 2024-04-25T22:42:15.933 INFO:tasks.workunit.client.0.smithi057.stdout:6/572: rename d2/d19/d26/d63/c67 to d2/d19/d49/cb7 0 2024-04-25T22:42:15.933 INFO:tasks.workunit.client.0.smithi057.stdout:7/532: symlink d6/d28/d4e/d30/d60/lb1 0 2024-04-25T22:42:15.934 INFO:tasks.workunit.client.0.smithi057.stdout:8/516: mkdir d4/d5/d2f/dc3 0 2024-04-25T22:42:15.935 INFO:tasks.workunit.client.0.smithi057.stdout:8/517: write d4/db/d12/f1c [4660349,25064] 0 2024-04-25T22:42:15.935 INFO:tasks.workunit.client.0.smithi057.stdout:7/533: mknod d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/cb2 0 2024-04-25T22:42:15.937 INFO:tasks.workunit.client.0.smithi057.stdout:4/551: truncate d14/da9/f75 1634654 0 2024-04-25T22:42:15.937 INFO:tasks.workunit.client.0.smithi057.stdout:8/518: dread - d4/d5/d17/d19/d35/d83/d92/da6/fbc zero size 2024-04-25T22:42:15.937 INFO:tasks.workunit.client.0.smithi057.stdout:4/552: sync 2024-04-25T22:42:15.937 INFO:tasks.workunit.client.0.smithi057.stdout:4/553: fsync d14/d2f/f99 0 2024-04-25T22:42:15.937 INFO:tasks.workunit.client.0.smithi057.stdout:7/534: chown d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/da2 522625245 1 2024-04-25T22:42:15.938 INFO:tasks.workunit.client.0.smithi057.stdout:7/535: write d6/d28/f5b [1246671,29820] 0 2024-04-25T22:42:15.938 INFO:tasks.workunit.client.0.smithi057.stdout:4/554: unlink d14/d47/la0 0 2024-04-25T22:42:15.939 INFO:tasks.workunit.client.0.smithi057.stdout:4/555: write d14/da9/f7d [1148778,98072] 0 2024-04-25T22:42:15.939 INFO:tasks.workunit.client.0.smithi057.stdout:9/533: dread d3/f66 [0,4194304] 0 2024-04-25T22:42:15.940 INFO:tasks.workunit.client.0.smithi057.stdout:7/536: mknod d6/d28/d4e/d30/d60/d6f/cb3 0 2024-04-25T22:42:15.940 INFO:tasks.workunit.client.0.smithi057.stdout:4/556: unlink d14/d47/d62/f88 0 2024-04-25T22:42:15.940 INFO:tasks.workunit.client.0.smithi057.stdout:1/523: dread d7/d65/d6a/d98/d41/f4b [0,4194304] 0 2024-04-25T22:42:15.940 INFO:tasks.workunit.client.0.smithi057.stdout:4/557: dread - d14/d2f/fa3 zero size 2024-04-25T22:42:15.942 INFO:tasks.workunit.client.0.smithi057.stdout:4/558: chown d14/da9/d44/c65 421 1 2024-04-25T22:42:15.943 INFO:tasks.workunit.client.0.smithi057.stdout:9/534: dread - d3/d34/d42/d28/d2d/d7a/f9d zero size 2024-04-25T22:42:15.943 INFO:tasks.workunit.client.0.smithi057.stdout:1/524: write d7/d65/d6a/d98/d41/d75/f9d [961606,2102] 0 2024-04-25T22:42:15.943 INFO:tasks.workunit.client.0.smithi057.stdout:7/537: creat d6/d28/d4e/d30/d60/d8d/d96/d59/d84/fb4 x:0 0 0 2024-04-25T22:42:15.943 INFO:tasks.workunit.client.0.smithi057.stdout:1/525: sync 2024-04-25T22:42:15.944 INFO:tasks.workunit.client.0.smithi057.stdout:8/519: dwrite d4/f10 [0,4194304] 0 2024-04-25T22:42:15.946 INFO:tasks.workunit.client.0.smithi057.stdout:2/590: dread d1f/d4a/f3b [0,4194304] 0 2024-04-25T22:42:15.946 INFO:tasks.workunit.client.0.smithi057.stdout:3/506: dread d0/d4/d7/d22/f2b [0,4194304] 0 2024-04-25T22:42:15.947 INFO:tasks.workunit.client.0.smithi057.stdout:0/532: write d0/d49/f9e [4975734,118380] 0 2024-04-25T22:42:15.947 INFO:tasks.workunit.client.0.smithi057.stdout:4/559: rename d14/da9/d44/fa4 to d14/d5a/d67/d70/d85/fb6 0 2024-04-25T22:42:15.950 INFO:tasks.workunit.client.0.smithi057.stdout:2/591: mknod d1f/d4a/cc9 0 2024-04-25T22:42:15.951 INFO:tasks.workunit.client.0.smithi057.stdout:8/520: read d4/d5/d17/d19/d35/d83/d92/d5b/f59 [151816,12541] 0 2024-04-25T22:42:15.951 INFO:tasks.workunit.client.0.smithi057.stdout:7/538: link d6/d28/d4e/f31 d6/d28/d4e/d30/d60/fb5 0 2024-04-25T22:42:15.952 INFO:tasks.workunit.client.0.smithi057.stdout:6/573: dwrite d2/d19/d50/d1a/f42 [0,4194304] 0 2024-04-25T22:42:15.953 INFO:tasks.workunit.client.0.smithi057.stdout:2/592: mknod d1f/d21/d33/cca 0 2024-04-25T22:42:15.954 INFO:tasks.workunit.client.0.smithi057.stdout:1/526: dread d7/dd/d16/d24/f2e [0,4194304] 0 2024-04-25T22:42:15.954 INFO:tasks.workunit.client.0.smithi057.stdout:6/574: mknod d2/d59/cb8 0 2024-04-25T22:42:15.956 INFO:tasks.workunit.client.0.smithi057.stdout:8/521: symlink d4/d5/d2f/dc3/lc4 0 2024-04-25T22:42:15.956 INFO:tasks.workunit.client.0.smithi057.stdout:2/593: symlink d1f/d36/d54/lcb 0 2024-04-25T22:42:15.957 INFO:tasks.workunit.client.0.smithi057.stdout:1/527: write d7/dd/d16/d24/d61/fa0 [13846,15931] 0 2024-04-25T22:42:15.958 INFO:tasks.workunit.client.0.smithi057.stdout:0/533: dwrite d0/d3/d6/d14/f72 [0,4194304] 0 2024-04-25T22:42:15.958 INFO:tasks.workunit.client.0.smithi057.stdout:8/522: chown d4/db/dd/d3a/d5c/c9a 749 1 2024-04-25T22:42:15.959 INFO:tasks.workunit.client.0.smithi057.stdout:3/507: dwrite d0/d4/d7/d46/f8a [0,4194304] 0 2024-04-25T22:42:15.960 INFO:tasks.workunit.client.0.smithi057.stdout:4/560: dwrite d14/d47/d5e/f92 [0,4194304] 0 2024-04-25T22:42:15.960 INFO:tasks.workunit.client.0.smithi057.stdout:1/528: chown d7/dd/d16/d24/f2e 1027669675 1 2024-04-25T22:42:15.960 INFO:tasks.workunit.client.0.smithi057.stdout:0/534: stat d0/d3/d3a/d3b/f70 0 2024-04-25T22:42:15.961 INFO:tasks.workunit.client.0.smithi057.stdout:3/508: fdatasync d0/d4/f57 0 2024-04-25T22:42:15.961 INFO:tasks.workunit.client.0.smithi057.stdout:2/594: creat d1f/d4a/d4d/d88/fcc x:0 0 0 2024-04-25T22:42:15.961 INFO:tasks.workunit.client.0.smithi057.stdout:1/529: readlink d7/dd/l7c 0 2024-04-25T22:42:15.961 INFO:tasks.workunit.client.0.smithi057.stdout:0/535: write d0/d3/d4d/f81 [616610,58211] 0 2024-04-25T22:42:15.962 INFO:tasks.workunit.client.0.smithi057.stdout:2/595: rmdir d1f/d21 39 2024-04-25T22:42:15.962 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:15.955+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:15.962 INFO:tasks.workunit.client.0.smithi057.stdout:4/561: rename d14/d2f/f52 to d14/d47/fb7 0 2024-04-25T22:42:15.962 INFO:tasks.workunit.client.0.smithi057.stdout:3/509: readlink d0/d4/d7/d22/l35 0 2024-04-25T22:42:15.963 INFO:tasks.workunit.client.0.smithi057.stdout:5/608: dread d2/d6/f58 [0,4194304] 0 2024-04-25T22:42:15.963 INFO:tasks.workunit.client.0.smithi057.stdout:1/530: rmdir d7/d65/d7f 0 2024-04-25T22:42:15.963 INFO:tasks.workunit.client.0.smithi057.stdout:8/523: rename d4/f10 to d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/fc5 0 2024-04-25T22:42:15.963 INFO:tasks.workunit.client.0.smithi057.stdout:0/536: mknod d0/d3/d6/d14/d39/cb8 0 2024-04-25T22:42:15.964 INFO:tasks.workunit.client.0.smithi057.stdout:4/562: mkdir d14/d2f/d4c/d5b/db8 0 2024-04-25T22:42:15.964 INFO:tasks.workunit.client.0.smithi057.stdout:2/596: getdents d1f/d4a/d4d 0 2024-04-25T22:42:15.964 INFO:tasks.workunit.client.0.smithi057.stdout:8/524: creat d4/d5/d17/da7/fc6 x:0 0 0 2024-04-25T22:42:15.965 INFO:tasks.workunit.client.0.smithi057.stdout:4/563: creat d14/da9/d44/fb9 x:0 0 0 2024-04-25T22:42:15.965 INFO:tasks.workunit.client.0.smithi057.stdout:5/609: symlink d2/d1c/d24/d3d/da7/lc3 0 2024-04-25T22:42:15.965 INFO:tasks.workunit.client.0.smithi057.stdout:0/537: symlink d0/d3/d4d/d87/d91/lb9 0 2024-04-25T22:42:15.966 INFO:tasks.workunit.client.0.smithi057.stdout:2/597: mknod d1f/d4a/ccd 0 2024-04-25T22:42:15.966 INFO:tasks.workunit.client.0.smithi057.stdout:5/610: write d2/d6/f3e [93112,60826] 0 2024-04-25T22:42:15.966 INFO:tasks.workunit.client.0.smithi057.stdout:8/525: chown d4/d5/d21/f2a 2898 1 2024-04-25T22:42:15.966 INFO:tasks.workunit.client.0.smithi057.stdout:0/538: chown d0/d3/d4d/f81 0 1 2024-04-25T22:42:15.967 INFO:tasks.workunit.client.0.smithi057.stdout:5/611: symlink d2/d1c/d24/d3d/da7/lc4 0 2024-04-25T22:42:15.968 INFO:tasks.workunit.client.0.smithi057.stdout:0/539: creat d0/d3/d4d/d87/fba x:0 0 0 2024-04-25T22:42:15.968 INFO:tasks.workunit.client.0.smithi057.stdout:2/598: creat d1f/d21/d33/fce x:0 0 0 2024-04-25T22:42:15.968 INFO:tasks.workunit.client.0.smithi057.stdout:8/526: symlink d4/d5/d21/lc7 0 2024-04-25T22:42:15.968 INFO:tasks.workunit.client.0.smithi057.stdout:2/599: read d1f/d4a/f9b [1397662,65509] 0 2024-04-25T22:42:15.968 INFO:tasks.workunit.client.0.smithi057.stdout:6/575: read d2/d19/d20/f45 [1427135,115231] 0 2024-04-25T22:42:15.970 INFO:tasks.workunit.client.0.smithi057.stdout:5/612: unlink d2/d47/d87/cc2 0 2024-04-25T22:42:15.970 INFO:tasks.workunit.client.0.smithi057.stdout:0/540: creat d0/d3/d3a/d3b/fbb x:0 0 0 2024-04-25T22:42:15.970 INFO:tasks.workunit.client.0.smithi057.stdout:6/576: symlink d2/d86/lb9 0 2024-04-25T22:42:15.972 INFO:tasks.workunit.client.0.smithi057.stdout:5/613: dread - d2/d6/db/fb4 zero size 2024-04-25T22:42:15.972 INFO:tasks.workunit.client.0.smithi057.stdout:0/541: write d0/d3/dae/fb1 [577951,38712] 0 2024-04-25T22:42:15.972 INFO:tasks.workunit.client.0.smithi057.stdout:3/510: dwrite d0/d4/d7/d22/da0/fa4 [0,4194304] 0 2024-04-25T22:42:15.972 INFO:tasks.workunit.client.0.smithi057.stdout:5/614: chown d2/d6/db/l9a 329 1 2024-04-25T22:42:15.973 INFO:tasks.workunit.client.0.smithi057.stdout:0/542: chown d0/d49/d97/cb3 3 1 2024-04-25T22:42:15.973 INFO:tasks.workunit.client.0.smithi057.stdout:5/615: read d2/d47/f8c [1255691,55709] 0 2024-04-25T22:42:15.974 INFO:tasks.workunit.client.0.smithi057.stdout:3/511: truncate d0/d5b/f8e 990794 0 2024-04-25T22:42:15.976 INFO:tasks.workunit.client.0.smithi057.stdout:0/543: write d0/d3/d4d/f93 [675035,89025] 0 2024-04-25T22:42:15.976 INFO:tasks.workunit.client.0.smithi057.stdout:0/544: sync 2024-04-25T22:42:15.977 INFO:tasks.workunit.client.0.smithi057.stdout:4/564: getdents d14/da9/d44 0 2024-04-25T22:42:15.977 INFO:tasks.workunit.client.0.smithi057.stdout:3/512: symlink d0/d4/d34/d3c/d53/d7f/lae 0 2024-04-25T22:42:15.978 INFO:tasks.workunit.client.0.smithi057.stdout:4/565: chown d14/da9 1464729908 1 2024-04-25T22:42:15.978 INFO:tasks.workunit.client.0.smithi057.stdout:0/545: symlink d0/d49/lbc 0 2024-04-25T22:42:15.978 INFO:tasks.workunit.client.0.smithi057.stdout:4/566: sync 2024-04-25T22:42:15.978 INFO:tasks.workunit.client.0.smithi057.stdout:4/567: sync 2024-04-25T22:42:15.980 INFO:tasks.workunit.client.0.smithi057.stdout:3/513: rename d0/d11/c4d to d0/d5b/caf 0 2024-04-25T22:42:15.980 INFO:tasks.workunit.client.0.smithi057.stdout:4/568: chown d14/d2f/l43 189081407 1 2024-04-25T22:42:15.981 INFO:tasks.workunit.client.0.smithi057.stdout:6/577: dwrite d2/d19/d50/d1a/f74 [0,4194304] 0 2024-04-25T22:42:15.981 INFO:tasks.workunit.client.0.smithi057.stdout:1/531: dwrite d7/dd/d26/f47 [0,4194304] 0 2024-04-25T22:42:15.982 INFO:tasks.workunit.client.0.smithi057.stdout:3/514: chown d0/d4/d7/d46 160407630 1 2024-04-25T22:42:15.984 INFO:tasks.workunit.client.0.smithi057.stdout:4/569: symlink d14/d2f/d82/lba 0 2024-04-25T22:42:15.984 INFO:tasks.workunit.client.0.smithi057.stdout:7/539: write d6/d28/d4e/d30/d60/d8d/d96/d5d/f5e [1604638,101409] 0 2024-04-25T22:42:15.984 INFO:tasks.workunit.client.0.smithi057.stdout:8/527: write d4/db/d72/f7d [1001406,108645] 0 2024-04-25T22:42:15.986 INFO:tasks.workunit.client.0.smithi057.stdout:9/535: dread d3/f24 [0,4194304] 0 2024-04-25T22:42:15.986 INFO:tasks.workunit.client.0.smithi057.stdout:1/532: truncate d7/d4e/f96 227781 0 2024-04-25T22:42:15.987 INFO:tasks.workunit.client.0.smithi057.stdout:5/616: dwrite d2/d1c/d24/d8f/f95 [4194304,4194304] 0 2024-04-25T22:42:15.987 INFO:tasks.workunit.client.0.smithi057.stdout:4/570: read d14/d2f/d4c/fa8 [2896188,11508] 0 2024-04-25T22:42:15.987 INFO:tasks.workunit.client.0.smithi057.stdout:6/578: mkdir d2/d19/d50/d1a/d22/d31/d83/dba 0 2024-04-25T22:42:15.987 INFO:tasks.workunit.client.0.smithi057.stdout:6/579: sync 2024-04-25T22:42:15.987 INFO:tasks.workunit.client.0.smithi057.stdout:7/540: creat d6/d28/d4e/d30/fb6 x:0 0 0 2024-04-25T22:42:15.988 INFO:tasks.workunit.client.0.smithi057.stdout:9/536: creat d3/d34/fb2 x:0 0 0 2024-04-25T22:42:15.988 INFO:tasks.workunit.client.0.smithi057.stdout:7/541: write d6/f54 [2733371,60207] 0 2024-04-25T22:42:15.990 INFO:tasks.workunit.client.0.smithi057.stdout:8/528: rename d4/db/d89 to d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/dc8 0 2024-04-25T22:42:15.990 INFO:tasks.workunit.client.0.smithi057.stdout:6/580: readlink d2/d19/d26/d4f/l92 0 2024-04-25T22:42:15.991 INFO:tasks.workunit.client.0.smithi057.stdout:4/571: link d14/d2f/f4a d14/d5a/fbb 0 2024-04-25T22:42:15.991 INFO:tasks.workunit.client.0.smithi057.stdout:5/617: creat d2/d47/fc5 x:0 0 0 2024-04-25T22:42:15.991 INFO:tasks.workunit.client.0.smithi057.stdout:3/515: dwrite d0/d4/d7/d22/da0/fa4 [0,4194304] 0 2024-04-25T22:42:15.993 INFO:tasks.workunit.client.0.smithi057.stdout:3/516: fsync d0/d5b/f8e 0 2024-04-25T22:42:15.993 INFO:tasks.workunit.client.0.smithi057.stdout:3/517: chown d0/d4/d4a 1 1 2024-04-25T22:42:15.994 INFO:tasks.workunit.client.0.smithi057.stdout:5/618: creat d2/d1c/d46/d3a/d6a/fc6 x:0 0 0 2024-04-25T22:42:15.994 INFO:tasks.workunit.client.0.smithi057.stdout:4/572: rename d14/d3d/c60 to d14/d5a/d67/d70/d85/cbc 0 2024-04-25T22:42:15.995 INFO:tasks.workunit.client.0.smithi057.stdout:3/518: creat d0/d4/d7b/d7c/fb0 x:0 0 0 2024-04-25T22:42:15.995 INFO:tasks.workunit.client.0.smithi057.stdout:4/573: readlink d14/d2f/d4c/l6d 0 2024-04-25T22:42:15.996 INFO:tasks.workunit.client.0.smithi057.stdout:1/533: dwrite d7/f42 [0,4194304] 0 2024-04-25T22:42:15.996 INFO:tasks.workunit.client.0.smithi057.stdout:3/519: mkdir d0/d4/d34/d3c/d53/db1 0 2024-04-25T22:42:15.998 INFO:tasks.workunit.client.0.smithi057.stdout:1/534: chown d7/dd/d26/f8c 1512495435 1 2024-04-25T22:42:16.002 INFO:tasks.workunit.client.0.smithi057.stdout:1/535: creat d7/d65/d6a/d98/d41/d6b/fae x:0 0 0 2024-04-25T22:42:16.002 INFO:tasks.workunit.client.0.smithi057.stdout:9/537: rename d3/d34/d42/d28/d95 to d3/d34/d42/d28/d39/db3 0 2024-04-25T22:42:16.003 INFO:tasks.workunit.client.0.smithi057.stdout:8/529: truncate d4/d5/f82 1571708 0 2024-04-25T22:42:16.003 INFO:tasks.workunit.client.0.smithi057.stdout:5/619: dwrite d2/d47/da5/f8e [0,4194304] 0 2024-04-25T22:42:16.004 INFO:tasks.workunit.client.0.smithi057.stdout:3/520: rename d0/d4/d7/d26/f4e to d0/d4/d7/d46/d30/d7a/d91/fb2 0 2024-04-25T22:42:16.005 INFO:tasks.workunit.client.0.smithi057.stdout:9/538: mknod d3/d34/d42/d28/cb4 0 2024-04-25T22:42:16.005 INFO:tasks.workunit.client.0.smithi057.stdout:8/530: creat d4/db/d72/dbd/fc9 x:0 0 0 2024-04-25T22:42:16.005 INFO:tasks.workunit.client.0.smithi057.stdout:6/581: dwrite d2/d19/d50/d1a/f74 [0,4194304] 0 2024-04-25T22:42:16.006 INFO:tasks.workunit.client.0.smithi057.stdout:4/574: dwrite d14/d2f/f4a [4194304,4194304] 0 2024-04-25T22:42:16.006 INFO:tasks.workunit.client.0.smithi057.stdout:3/521: readlink d0/d4/d7/l13 0 2024-04-25T22:42:16.007 INFO:tasks.workunit.client.0.smithi057.stdout:3/522: sync 2024-04-25T22:42:16.007 INFO:tasks.workunit.client.0.smithi057.stdout:9/539: chown d3/d34/f6b 10 1 2024-04-25T22:42:16.007 INFO:tasks.workunit.client.0.smithi057.stdout:5/620: rename d2/d47/fc5 to d2/d1c/d46/d3a/fc7 0 2024-04-25T22:42:16.008 INFO:tasks.workunit.client.0.smithi057.stdout:6/582: chown d2/d19/d50/d1a/f74 1975126752 1 2024-04-25T22:42:16.009 INFO:tasks.workunit.client.0.smithi057.stdout:5/621: read d2/d2c/f5d [1802268,51545] 0 2024-04-25T22:42:16.009 INFO:tasks.workunit.client.0.smithi057.stdout:4/575: chown d14/d47/d5e/d5f/l79 1 1 2024-04-25T22:42:16.009 INFO:tasks.workunit.client.0.smithi057.stdout:3/523: mkdir d0/d4/d7/dad/db3 0 2024-04-25T22:42:16.010 INFO:tasks.workunit.client.0.smithi057.stdout:9/540: symlink d3/d98/db0/lb5 0 2024-04-25T22:42:16.010 INFO:tasks.workunit.client.0.smithi057.stdout:3/524: chown d0/d4/d34/d3c/d53/f94 30 1 2024-04-25T22:42:16.011 INFO:tasks.workunit.client.0.smithi057.stdout:6/583: rename d2/d19/d49/d62/d79/ca6 to d2/d59/cbb 0 2024-04-25T22:42:16.011 INFO:tasks.workunit.client.0.smithi057.stdout:6/584: write d2/d19/d20/fa5 [779622,86145] 0 2024-04-25T22:42:16.012 INFO:tasks.workunit.client.0.smithi057.stdout:6/585: fdatasync d2/d19/d26/d4f/f84 0 2024-04-25T22:42:16.014 INFO:tasks.workunit.client.0.smithi057.stdout:6/586: unlink d2/d19/d50/d91/fa2 0 2024-04-25T22:42:16.014 INFO:tasks.workunit.client.0.smithi057.stdout:1/536: dread d7/dd/f46 [0,4194304] 0 2024-04-25T22:42:16.014 INFO:tasks.workunit.client.0.smithi057.stdout:5/622: dread d2/d1c/d46/f89 [0,4194304] 0 2024-04-25T22:42:16.014 INFO:tasks.workunit.client.0.smithi057.stdout:6/587: creat d2/d86/d90/fbc x:0 0 0 2024-04-25T22:42:16.015 INFO:tasks.workunit.client.0.smithi057.stdout:6/588: rmdir d2/d19/d49/d62/d79 39 2024-04-25T22:42:16.016 INFO:tasks.workunit.client.0.smithi057.stdout:5/623: creat d2/d1c/d24/d3d/d77/fc8 x:0 0 0 2024-04-25T22:42:16.017 INFO:tasks.workunit.client.0.smithi057.stdout:6/589: fdatasync d2/d19/d49/d62/d79/f80 0 2024-04-25T22:42:16.018 INFO:tasks.workunit.client.0.smithi057.stdout:3/525: dwrite d0/d4/d7/d46/d30/f9b [0,4194304] 0 2024-04-25T22:42:16.019 INFO:tasks.workunit.client.0.smithi057.stdout:1/537: dread d7/d65/d6a/f6d [0,4194304] 0 2024-04-25T22:42:16.020 INFO:tasks.workunit.client.0.smithi057.stdout:3/526: unlink d0/d4/d34/l48 0 2024-04-25T22:42:16.020 INFO:tasks.workunit.client.0.smithi057.stdout:1/538: symlink d7/d65/d6a/d98/d41/d75/laf 0 2024-04-25T22:42:16.021 INFO:tasks.workunit.client.0.smithi057.stdout:3/527: truncate d0/d4/d7/d22/f59 228952 0 2024-04-25T22:42:16.021 INFO:tasks.workunit.client.0.smithi057.stdout:3/528: sync 2024-04-25T22:42:16.022 INFO:tasks.workunit.client.0.smithi057.stdout:3/529: write d0/d4/d7/d22/da0/fa4 [5100794,104754] 0 2024-04-25T22:42:16.026 INFO:tasks.workunit.client.0.smithi057.stdout:1/539: dread d7/dd/d16/d24/d61/fa0 [0,4194304] 0 2024-04-25T22:42:16.026 INFO:tasks.workunit.client.0.smithi057.stdout:8/531: dread d4/d5/d17/d19/d35/d83/d92/f68 [0,4194304] 0 2024-04-25T22:42:16.027 INFO:tasks.workunit.client.0.smithi057.stdout:5/624: dread d2/d1c/d24/d3d/da7/fac [0,4194304] 0 2024-04-25T22:42:16.027 INFO:tasks.workunit.client.0.smithi057.stdout:8/532: write d4/d5/d17/d19/f30 [3450134,118994] 0 2024-04-25T22:42:16.027 INFO:tasks.workunit.client.0.smithi057.stdout:1/540: mkdir d7/d65/d6a/d98/d99/db0 0 2024-04-25T22:42:16.027 INFO:tasks.workunit.client.0.smithi057.stdout:2/600: dread d1f/d21/d26/f29 [0,4194304] 0 2024-04-25T22:42:16.029 INFO:tasks.workunit.client.0.smithi057.stdout:2/601: symlink d1f/d21/d33/lcf 0 2024-04-25T22:42:16.030 INFO:tasks.workunit.client.0.smithi057.stdout:1/541: creat d7/d65/d95/fb1 x:0 0 0 2024-04-25T22:42:16.030 INFO:tasks.workunit.client.0.smithi057.stdout:7/542: dread d6/d28/d4e/f22 [0,4194304] 0 2024-04-25T22:42:16.031 INFO:tasks.workunit.client.0.smithi057.stdout:3/530: dwrite d0/d4/d7b/f9f [0,4194304] 0 2024-04-25T22:42:16.031 INFO:tasks.workunit.client.0.smithi057.stdout:4/576: truncate d14/f28 2065149 0 2024-04-25T22:42:16.031 INFO:tasks.workunit.client.0.smithi057.stdout:5/625: creat d2/fc9 x:0 0 0 2024-04-25T22:42:16.032 INFO:tasks.workunit.client.0.smithi057.stdout:8/533: truncate d4/db/dd/d3a/d5c/d76/f97 726481 0 2024-04-25T22:42:16.032 INFO:tasks.workunit.client.0.smithi057.stdout:2/602: creat d1f/d21/d26/d63/d7f/d86/fd0 x:0 0 0 2024-04-25T22:42:16.032 INFO:tasks.workunit.client.0.smithi057.stdout:3/531: fdatasync d0/d4/f57 0 2024-04-25T22:42:16.033 INFO:tasks.workunit.client.0.smithi057.stdout:5/626: chown d2/d6/f3e 1364137 1 2024-04-25T22:42:16.033 INFO:tasks.workunit.client.0.smithi057.stdout:1/542: mknod d7/d65/d6a/d98/d41/d6b/cb2 0 2024-04-25T22:42:16.033 INFO:tasks.workunit.client.0.smithi057.stdout:2/603: chown f6 69932930 1 2024-04-25T22:42:16.033 INFO:tasks.workunit.client.0.smithi057.stdout:4/577: write d14/f22 [3610416,120239] 0 2024-04-25T22:42:16.034 INFO:tasks.workunit.client.0.smithi057.stdout:9/541: dread d3/d34/d42/f41 [0,4194304] 0 2024-04-25T22:42:16.034 INFO:tasks.workunit.client.0.smithi057.stdout:7/543: creat d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/fb7 x:0 0 0 2024-04-25T22:42:16.034 INFO:tasks.workunit.client.0.smithi057.stdout:2/604: fsync d1f/d34/d50/fa5 0 2024-04-25T22:42:16.035 INFO:tasks.workunit.client.0.smithi057.stdout:5/627: write d2/d47/f68 [786856,122337] 0 2024-04-25T22:42:16.035 INFO:tasks.workunit.client.0.smithi057.stdout:4/578: chown d14/d5a/fbb 131118677 1 2024-04-25T22:42:16.036 INFO:tasks.workunit.client.0.smithi057.stdout:7/544: fdatasync d6/d28/d4e/f31 0 2024-04-25T22:42:16.037 INFO:tasks.workunit.client.0.smithi057.stdout:9/542: creat d3/d34/d42/d28/d62/d67/d6e/fb6 x:0 0 0 2024-04-25T22:42:16.038 INFO:tasks.workunit.client.0.smithi057.stdout:4/579: write d14/d2f/f54 [683786,41867] 0 2024-04-25T22:42:16.038 INFO:tasks.workunit.client.0.smithi057.stdout:6/590: dread d2/d19/d50/d91/fa3 [0,4194304] 0 2024-04-25T22:42:16.040 INFO:tasks.workunit.client.0.smithi057.stdout:2/605: rename d1f/d21/d33/c93 to d1f/d21/cd1 0 2024-04-25T22:42:16.041 INFO:tasks.workunit.client.0.smithi057.stdout:7/545: symlink d6/d28/d4e/d30/d46/lb8 0 2024-04-25T22:42:16.043 INFO:tasks.workunit.client.0.smithi057.stdout:8/534: dwrite d4/f43 [0,4194304] 0 2024-04-25T22:42:16.043 INFO:tasks.workunit.client.0.smithi057.stdout:9/543: write d3/d34/d42/d28/d2d/d7a/f87 [361353,19738] 0 2024-04-25T22:42:16.043 INFO:tasks.workunit.client.0.smithi057.stdout:0/546: dread d0/d3/d3a/d3b/f70 [0,4194304] 0 2024-04-25T22:42:16.046 INFO:tasks.workunit.client.0.smithi057.stdout:3/532: dwrite d0/d4/d7/d26/f63 [0,4194304] 0 2024-04-25T22:42:16.047 INFO:tasks.workunit.client.0.smithi057.stdout:1/543: dwrite d7/dd/d16/d88/f8b [0,4194304] 0 2024-04-25T22:42:16.047 INFO:tasks.workunit.client.0.smithi057.stdout:2/606: symlink d1f/d4a/ld2 0 2024-04-25T22:42:16.048 INFO:tasks.workunit.client.0.smithi057.stdout:0/547: chown d0/d3/d6/d14/c26 1 1 2024-04-25T22:42:16.049 INFO:tasks.workunit.client.0.smithi057.stdout:9/544: write d3/f24 [3928871,37082] 0 2024-04-25T22:42:16.049 INFO:tasks.workunit.client.0.smithi057.stdout:2/607: chown d1f/d21/d33 200852 1 2024-04-25T22:42:16.050 INFO:tasks.workunit.client.0.smithi057.stdout:8/535: dread - d4/d5/d17/d19/d35/d83/d92/d5b/f5d zero size 2024-04-25T22:42:16.050 INFO:tasks.workunit.client.0.smithi057.stdout:1/544: creat d7/dd/d16/d18/d31/d8f/fb3 x:0 0 0 2024-04-25T22:42:16.052 INFO:tasks.workunit.client.0.smithi057.stdout:2/608: unlink d1f/d21/f46 0 2024-04-25T22:42:16.053 INFO:tasks.workunit.client.0.smithi057.stdout:8/536: chown d4/d5/d17/d19/f26 1209 1 2024-04-25T22:42:16.054 INFO:tasks.workunit.client.0.smithi057.stdout:0/548: creat d0/d3/d88/da3/fbd x:0 0 0 2024-04-25T22:42:16.056 INFO:tasks.workunit.client.0.smithi057.stdout:2/609: creat d1f/d34/d50/fd3 x:0 0 0 2024-04-25T22:42:16.056 INFO:tasks.workunit.client.0.smithi057.stdout:4/580: dwrite d14/d5a/d67/d70/f91 [0,4194304] 0 2024-04-25T22:42:16.056 INFO:tasks.workunit.client.0.smithi057.stdout:6/591: dwrite d2/d19/d50/f8a [0,4194304] 0 2024-04-25T22:42:16.057 INFO:tasks.workunit.client.0.smithi057.stdout:1/545: dread d7/f8e [0,4194304] 0 2024-04-25T22:42:16.057 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:16.057 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:16.057 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:42:16.057 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:42:16.057 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:16.058 INFO:tasks.workunit.client.0.smithi057.stdout:8/537: creat d4/d5/d17/d19/fca x:0 0 0 2024-04-25T22:42:16.058 INFO:tasks.workunit.client.0.smithi057.stdout:6/592: fsync d2/d19/d49/d62/f7b 0 2024-04-25T22:42:16.058 INFO:tasks.workunit.client.0.smithi057.stdout:2/610: mknod d1f/d21/cd4 0 2024-04-25T22:42:16.058 INFO:tasks.workunit.client.0.smithi057.stdout:7/546: dwrite d6/d28/d4e/d30/d60/d8d/d96/f7f [0,4194304] 0 2024-04-25T22:42:16.059 INFO:tasks.workunit.client.0.smithi057.stdout:8/538: write d4/d5/f4d [1530789,67481] 0 2024-04-25T22:42:16.059 INFO:tasks.workunit.client.0.smithi057.stdout:3/533: truncate d0/fe 4291247 0 2024-04-25T22:42:16.059 INFO:tasks.workunit.client.0.smithi057.stdout:0/549: link d0/d3/f4 d0/d3/d6/d78/fbe 0 2024-04-25T22:42:16.060 INFO:tasks.workunit.client.0.smithi057.stdout:6/593: mknod d2/d19/d50/d1a/cbd 0 2024-04-25T22:42:16.060 INFO:tasks.workunit.client.0.smithi057.stdout:2/611: creat d1f/d36/d54/dc0/fd5 x:0 0 0 2024-04-25T22:42:16.060 INFO:tasks.workunit.client.0.smithi057.stdout:8/539: symlink d4/dba/lcb 0 2024-04-25T22:42:16.060 INFO:tasks.workunit.client.0.smithi057.stdout:2/612: sync 2024-04-25T22:42:16.061 INFO:tasks.workunit.client.0.smithi057.stdout:0/550: symlink d0/d3/d6/d14/d39/lbf 0 2024-04-25T22:42:16.061 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:16.060+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:16.062 INFO:tasks.workunit.client.0.smithi057.stdout:2/613: getdents d1f/d36/d54 0 2024-04-25T22:42:16.062 INFO:tasks.workunit.client.0.smithi057.stdout:0/551: symlink d0/d3/d88/da3/lc0 0 2024-04-25T22:42:16.063 INFO:tasks.workunit.client.0.smithi057.stdout:2/614: mkdir d1f/d36/d60/dd6 0 2024-04-25T22:42:16.063 INFO:tasks.workunit.client.0.smithi057.stdout:0/552: symlink d0/d3/d4d/d87/da0/lc1 0 2024-04-25T22:42:16.066 INFO:tasks.workunit.client.0.smithi057.stdout:0/553: getdents d0/d5/d53 0 2024-04-25T22:42:16.067 INFO:tasks.workunit.client.0.smithi057.stdout:1/546: dread d7/d4e/f96 [0,4194304] 0 2024-04-25T22:42:16.067 INFO:tasks.workunit.client.0.smithi057.stdout:0/554: chown d0/d3/d88/da3/fbd 3 1 2024-04-25T22:42:16.068 INFO:tasks.workunit.client.0.smithi057.stdout:7/547: dwrite d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/f8e [0,4194304] 0 2024-04-25T22:42:16.068 INFO:tasks.workunit.client.0.smithi057.stdout:1/547: readlink d7/dd/d16/d24/d61/l52 0 2024-04-25T22:42:16.069 INFO:tasks.workunit.client.0.smithi057.stdout:6/594: dwrite d2/d86/f98 [0,4194304] 0 2024-04-25T22:42:16.069 INFO:tasks.workunit.client.0.smithi057.stdout:5/628: dread d2/d2c/f36 [0,4194304] 0 2024-04-25T22:42:16.069 INFO:tasks.workunit.client.0.smithi057.stdout:0/555: symlink d0/d5/lc2 0 2024-04-25T22:42:16.069 INFO:tasks.workunit.client.0.smithi057.stdout:5/629: sync 2024-04-25T22:42:16.070 INFO:tasks.workunit.client.0.smithi057.stdout:1/548: creat d7/fb4 x:0 0 0 2024-04-25T22:42:16.070 INFO:tasks.workunit.client.0.smithi057.stdout:5/630: write d2/d47/f9e [1642339,40414] 0 2024-04-25T22:42:16.071 INFO:tasks.workunit.client.0.smithi057.stdout:1/549: unlink d7/dd/f46 0 2024-04-25T22:42:16.072 INFO:tasks.workunit.client.0.smithi057.stdout:4/581: truncate d14/d5a/f9d 143140 0 2024-04-25T22:42:16.072 INFO:tasks.workunit.client.0.smithi057.stdout:5/631: creat d2/d2c/fca x:0 0 0 2024-04-25T22:42:16.072 INFO:tasks.workunit.client.0.smithi057.stdout:5/632: fsync d2/fc9 0 2024-04-25T22:42:16.072 INFO:tasks.workunit.client.0.smithi057.stdout:2/615: stat d1f/d36/f4f 0 2024-04-25T22:42:16.073 INFO:tasks.workunit.client.0.smithi057.stdout:5/633: creat d2/d2c/db7/fcb x:0 0 0 2024-04-25T22:42:16.073 INFO:tasks.workunit.client.0.smithi057.stdout:2/616: readlink d1f/lb9 0 2024-04-25T22:42:16.074 INFO:tasks.workunit.client.0.smithi057.stdout:1/550: rename d7/d65/d6a/d98/f9e to d7/dd/d90/fb5 0 2024-04-25T22:42:16.074 INFO:tasks.workunit.client.0.smithi057.stdout:4/582: truncate d14/d5a/d67/d70/d85/fb6 912944 0 2024-04-25T22:42:16.075 INFO:tasks.workunit.client.0.smithi057.stdout:5/634: symlink d2/d47/d60/lcc 0 2024-04-25T22:42:16.075 INFO:tasks.workunit.client.0.smithi057.stdout:9/545: read d3/d34/d42/d28/d62/d67/f71 [2650878,4440] 0 2024-04-25T22:42:16.075 INFO:tasks.workunit.client.0.smithi057.stdout:9/546: sync 2024-04-25T22:42:16.075 INFO:tasks.workunit.client.0.smithi057.stdout:2/617: chown d1f/d21/d26/d63/d7f/lb7 5778478 1 2024-04-25T22:42:16.076 INFO:tasks.workunit.client.0.smithi057.stdout:6/595: mkdir d2/d19/d50/d1a/d22/d31/d83/dba/dbe 0 2024-04-25T22:42:16.076 INFO:tasks.workunit.client.0.smithi057.stdout:4/583: mkdir d14/da2/da7/dbd 0 2024-04-25T22:42:16.076 INFO:tasks.workunit.client.0.smithi057.stdout:1/551: creat d7/d65/d6a/d98/d99/db0/fb6 x:0 0 0 2024-04-25T22:42:16.076 INFO:tasks.workunit.client.0.smithi057.stdout:9/547: write d3/f1a [1423990,85472] 0 2024-04-25T22:42:16.077 INFO:tasks.workunit.client.0.smithi057.stdout:6/596: unlink d2/d19/d49/d62/d79/f80 0 2024-04-25T22:42:16.077 INFO:tasks.workunit.client.0.smithi057.stdout:4/584: rename fc to d14/da2/da7/fbe 0 2024-04-25T22:42:16.078 INFO:tasks.workunit.client.0.smithi057.stdout:1/552: stat d7/dd/d16/d24/d61/f53 0 2024-04-25T22:42:16.078 INFO:tasks.workunit.client.0.smithi057.stdout:9/548: mknod d3/d34/d42/d28/d39/cb7 0 2024-04-25T22:42:16.078 INFO:tasks.workunit.client.0.smithi057.stdout:6/597: fsync d2/d86/d90/faf 0 2024-04-25T22:42:16.078 INFO:tasks.workunit.client.0.smithi057.stdout:5/635: getdents d2/d1c/d24/d3d/da7/db2 0 2024-04-25T22:42:16.079 INFO:tasks.workunit.client.0.smithi057.stdout:1/553: unlink d7/d4e/f7d 0 2024-04-25T22:42:16.079 INFO:tasks.workunit.client.0.smithi057.stdout:0/556: dwrite d0/d3/d4d/f37 [0,4194304] 0 2024-04-25T22:42:16.080 INFO:tasks.workunit.client.0.smithi057.stdout:1/554: write d7/dd/d16/d18/f23 [955506,119720] 0 2024-04-25T22:42:16.080 INFO:tasks.workunit.client.0.smithi057.stdout:0/557: truncate d0/d3/d6/d29/f6c 1595104 0 2024-04-25T22:42:16.081 INFO:tasks.workunit.client.0.smithi057.stdout:1/555: dread - d7/d4e/f5c zero size 2024-04-25T22:42:16.081 INFO:tasks.workunit.client.0.smithi057.stdout:4/585: rename d14/d5a/d67/d70 to d14/d2f/d86/dbf 0 2024-04-25T22:42:16.081 INFO:tasks.workunit.client.0.smithi057.stdout:9/549: mkdir d3/d34/d42/d28/d62/d67/d6e/d7c/db8 0 2024-04-25T22:42:16.081 INFO:tasks.workunit.client.0.smithi057.stdout:6/598: mkdir d2/d19/d20/d61/dbf 0 2024-04-25T22:42:16.082 INFO:tasks.workunit.client.0.smithi057.stdout:9/550: rmdir d3/d34/d42/d5e 39 2024-04-25T22:42:16.083 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:16.083 INFO:tasks.workunit.client.0.smithi057.stdout:6/599: write d2/d19/d20/d61/f89 [1110547,96564] 0 2024-04-25T22:42:16.083 INFO:tasks.workunit.client.0.smithi057.stdout:6/600: chown d2/d19/d50 368393443 1 2024-04-25T22:42:16.085 INFO:tasks.workunit.client.0.smithi057.stdout:6/601: write d2/d19/d20/d61/f89 [740586,13281] 0 2024-04-25T22:42:16.085 INFO:tasks.workunit.client.0.smithi057.stdout:9/551: truncate d3/d34/d42/d28/d62/d67/d6e/f77 633134 0 2024-04-25T22:42:16.086 INFO:tasks.workunit.client.0.smithi057.stdout:9/552: symlink d3/d34/d42/d28/lb9 0 2024-04-25T22:42:16.087 INFO:tasks.workunit.client.0.smithi057.stdout:9/553: sync 2024-04-25T22:42:16.087 INFO:tasks.workunit.client.0.smithi057.stdout:4/586: read d14/d47/d5e/f77 [1585375,72955] 0 2024-04-25T22:42:16.088 INFO:tasks.workunit.client.0.smithi057.stdout:0/558: dwrite d0/d5/d53/f61 [0,4194304] 0 2024-04-25T22:42:16.089 INFO:tasks.workunit.client.0.smithi057.stdout:1/556: dwrite d7/d65/d6a/f6d [0,4194304] 0 2024-04-25T22:42:16.090 INFO:tasks.workunit.client.0.smithi057.stdout:4/587: getdents d14/d2f 0 2024-04-25T22:42:16.091 INFO:tasks.workunit.client.0.smithi057.stdout:4/588: chown d14/da9 7 1 2024-04-25T22:42:16.091 INFO:tasks.workunit.client.0.smithi057.stdout:0/559: rename d0/d3/d6/d78/fbe to d0/d3/d6/d83/fc3 0 2024-04-25T22:42:16.091 INFO:tasks.workunit.client.0.smithi057.stdout:4/589: mkdir d14/d47/d5e/dc0 0 2024-04-25T22:42:16.092 INFO:tasks.workunit.client.0.smithi057.stdout:0/560: write d0/d3/d4d/f81 [266134,121673] 0 2024-04-25T22:42:16.093 INFO:tasks.workunit.client.0.smithi057.stdout:0/561: symlink d0/d3/d6/d29/lc4 0 2024-04-25T22:42:16.096 INFO:tasks.workunit.client.0.smithi057.stdout:0/562: rmdir d0/d3 39 2024-04-25T22:42:16.097 INFO:tasks.workunit.client.0.smithi057.stdout:1/557: dwrite d7/f42 [0,4194304] 0 2024-04-25T22:42:16.097 INFO:tasks.workunit.client.0.smithi057.stdout:3/534: dread d0/d4/f9 [0,4194304] 0 2024-04-25T22:42:16.098 INFO:tasks.workunit.client.0.smithi057.stdout:3/535: chown d0/d4/d7/l74 13549 1 2024-04-25T22:42:16.098 INFO:tasks.workunit.client.0.smithi057.stdout:1/558: write d7/dd/d16/d18/f70 [2114414,96254] 0 2024-04-25T22:42:16.098 INFO:tasks.workunit.client.0.smithi057.stdout:2/618: write d1f/f76 [691642,94851] 0 2024-04-25T22:42:16.098 INFO:tasks.workunit.client.0.smithi057.stdout:5/636: write d2/d6/db/f2b [141119,74030] 0 2024-04-25T22:42:16.099 INFO:tasks.workunit.client.0.smithi057.stdout:6/602: dread d2/d19/d20/fa5 [0,4194304] 0 2024-04-25T22:42:16.099 INFO:tasks.workunit.client.0.smithi057.stdout:9/554: truncate d3/f1a 415466 0 2024-04-25T22:42:16.100 INFO:tasks.workunit.client.0.smithi057.stdout:3/536: creat d0/d4/d34/d3c/fb4 x:0 0 0 2024-04-25T22:42:16.101 INFO:tasks.workunit.client.0.smithi057.stdout:2/619: dread - d1f/d36/d54/f8d zero size 2024-04-25T22:42:16.101 INFO:tasks.workunit.client.0.smithi057.stdout:1/559: fsync d7/d65/d6a/d98/d41/d45/f72 0 2024-04-25T22:42:16.101 INFO:tasks.workunit.client.0.smithi057.stdout:0/563: mknod d0/d5/d53/cc5 0 2024-04-25T22:42:16.101 INFO:tasks.workunit.client.0.smithi057.stdout:4/590: dwrite d14/d47/d5e/f92 [0,4194304] 0 2024-04-25T22:42:16.101 INFO:tasks.workunit.client.0.smithi057.stdout:4/591: stat d14/c24 0 2024-04-25T22:42:16.102 INFO:tasks.workunit.client.0.smithi057.stdout:9/555: unlink d3/d34/d42/d28/f55 0 2024-04-25T22:42:16.104 INFO:tasks.workunit.client.0.smithi057.stdout:4/592: getdents d14/da9/d95 0 2024-04-25T22:42:16.104 INFO:tasks.workunit.client.0.smithi057.stdout:3/537: creat d0/d4/d7/fb5 x:0 0 0 2024-04-25T22:42:16.104 INFO:tasks.workunit.client.0.smithi057.stdout:2/620: creat d1f/d21/d26/d63/fd7 x:0 0 0 2024-04-25T22:42:16.104 INFO:tasks.workunit.client.0.smithi057.stdout:0/564: symlink d0/d3/d6/lc6 0 2024-04-25T22:42:16.105 INFO:tasks.workunit.client.0.smithi057.stdout:9/556: symlink d3/d34/d42/d28/lba 0 2024-04-25T22:42:16.106 INFO:tasks.workunit.client.0.smithi057.stdout:0/565: write d0/d49/f77 [389841,85285] 0 2024-04-25T22:42:16.106 INFO:tasks.workunit.client.0.smithi057.stdout:6/603: dread d2/d19/d50/d91/fa3 [4194304,4194304] 0 2024-04-25T22:42:16.106 INFO:tasks.workunit.client.0.smithi057.stdout:3/538: mkdir d0/d6b/db6 0 2024-04-25T22:42:16.108 INFO:tasks.workunit.client.0.smithi057.stdout:9/557: dread - d3/d34/d42/d28/d62/d67/d6e/d7c/fab zero size 2024-04-25T22:42:16.108 INFO:tasks.workunit.client.0.smithi057.stdout:0/566: chown d0/d3/d6/d83/l96 52 1 2024-04-25T22:42:16.109 INFO:tasks.workunit.client.0.smithi057.stdout:6/604: symlink d2/d19/d50/d1a/d22/d31/d83/dba/lc0 0 2024-04-25T22:42:16.109 INFO:tasks.workunit.client.0.smithi057.stdout:1/560: dread d7/f6c [0,4194304] 0 2024-04-25T22:42:16.109 INFO:tasks.workunit.client.0.smithi057.stdout:3/539: creat d0/d4/d7/d22/da0/fb7 x:0 0 0 2024-04-25T22:42:16.109 INFO:tasks.workunit.client.0.smithi057.stdout:1/561: sync 2024-04-25T22:42:16.112 INFO:tasks.workunit.client.0.smithi057.stdout:5/637: dwrite d2/d2c/f81 [0,4194304] 0 2024-04-25T22:42:16.112 INFO:tasks.workunit.client.0.smithi057.stdout:1/562: mknod d7/d65/d6a/d98/d41/d75/cb7 0 2024-04-25T22:42:16.113 INFO:tasks.workunit.client.0.smithi057.stdout:6/605: write d2/d19/d50/d91/fa3 [4364682,11716] 0 2024-04-25T22:42:16.113 INFO:tasks.workunit.client.0.smithi057.stdout:3/540: write d0/d4/d7/d22/f55 [1667344,75904] 0 2024-04-25T22:42:16.115 INFO:tasks.workunit.client.0.smithi057.stdout:5/638: write d2/d6/f92 [4504573,109081] 0 2024-04-25T22:42:16.115 INFO:tasks.workunit.client.0.smithi057.stdout:2/621: dwrite fe [0,4194304] 0 2024-04-25T22:42:16.116 INFO:tasks.workunit.client.0.smithi057.stdout:9/558: rename d3/d34/d42/d5e/f6a to d3/d34/d42/d28/d2d/d7a/fbb 0 2024-04-25T22:42:16.116 INFO:tasks.workunit.client.0.smithi057.stdout:6/606: read - d2/d19/d49/db4/fb5 zero size 2024-04-25T22:42:16.116 INFO:tasks.workunit.client.0.smithi057.stdout:3/541: symlink d0/d4/d7/d22/lb8 0 2024-04-25T22:42:16.117 INFO:tasks.workunit.client.0.smithi057.stdout:4/593: dwrite d14/d2f/d4c/d5b/daa/fb0 [0,4194304] 0 2024-04-25T22:42:16.119 INFO:tasks.workunit.client.0.smithi057.stdout:1/563: rename d7/dd/d16/d24/f54 to d7/d65/d6a/d98/d41/d75/fb8 0 2024-04-25T22:42:16.119 INFO:tasks.workunit.client.0.smithi057.stdout:9/559: creat d3/d34/d42/d28/d62/d67/fbc x:0 0 0 2024-04-25T22:42:16.120 INFO:tasks.workunit.client.0.smithi057.stdout:2/622: creat d1f/d36/d60/dd6/fd8 x:0 0 0 2024-04-25T22:42:16.120 INFO:tasks.workunit.client.0.smithi057.stdout:3/542: mkdir d0/d4/d7/d46/d30/db9 0 2024-04-25T22:42:16.120 INFO:tasks.workunit.client.0.smithi057.stdout:1/564: readlink d7/dd/d16/d24/la9 0 2024-04-25T22:42:16.121 INFO:tasks.workunit.client.0.smithi057.stdout:0/567: dwrite d0/d3/d6/d29/f6c [0,4194304] 0 2024-04-25T22:42:16.121 INFO:tasks.workunit.client.0.smithi057.stdout:4/594: creat d14/da9/db5/fc1 x:0 0 0 2024-04-25T22:42:16.121 INFO:tasks.workunit.client.0.smithi057.stdout:5/639: unlink d2/d1c/d24/d3d/d50/d83/fba 0 2024-04-25T22:42:16.123 INFO:tasks.workunit.client.0.smithi057.stdout:8/540: dread d4/d5/f9f [0,4194304] 0 2024-04-25T22:42:16.123 INFO:tasks.workunit.client.0.smithi057.stdout:8/541: read - d4/db/dd/d3a/f8e zero size 2024-04-25T22:42:16.124 INFO:tasks.workunit.client.0.smithi057.stdout:3/543: truncate d0/fa 1680083 0 2024-04-25T22:42:16.126 INFO:tasks.workunit.client.0.smithi057.stdout:4/595: fsync d14/d2f/d4c/d5b/f93 0 2024-04-25T22:42:16.127 INFO:tasks.workunit.client.0.smithi057.stdout:1/565: dread d7/d65/d6a/d98/d41/f4b [0,4194304] 0 2024-04-25T22:42:16.127 INFO:tasks.workunit.client.0.smithi057.stdout:3/544: write d0/d4/d7/fb5 [881,15410] 0 2024-04-25T22:42:16.128 INFO:tasks.workunit.client.0.smithi057.stdout:8/542: symlink d4/d5/d21/db0/lcc 0 2024-04-25T22:42:16.130 INFO:tasks.workunit.client.0.smithi057.stdout:1/566: symlink d7/d65/d6a/lb9 0 2024-04-25T22:42:16.131 INFO:tasks.workunit.client.0.smithi057.stdout:9/560: dwrite d3/d34/d42/d28/d2d/f5c [0,4194304] 0 2024-04-25T22:42:16.131 INFO:tasks.workunit.client.0.smithi057.stdout:4/596: write d14/da9/d44/fb9 [628236,106790] 0 2024-04-25T22:42:16.131 INFO:tasks.workunit.client.0.smithi057.stdout:0/568: dwrite d0/d49/f77 [0,4194304] 0 2024-04-25T22:42:16.132 INFO:tasks.workunit.client.0.smithi057.stdout:7/548: dread d6/d28/d4e/d30/d60/d8d/d96/d5d/f5e [0,4194304] 0 2024-04-25T22:42:16.133 INFO:tasks.workunit.client.0.smithi057.stdout:9/561: mkdir d3/d34/d42/d28/d39/dbd 0 2024-04-25T22:42:16.133 INFO:tasks.workunit.client.0.smithi057.stdout:8/543: creat d4/d5/d17/d19/d35/d83/d92/d5b/fcd x:0 0 0 2024-04-25T22:42:16.134 INFO:tasks.workunit.client.0.smithi057.stdout:5/640: dwrite d2/d1c/d46/d3a/f65 [0,4194304] 0 2024-04-25T22:42:16.134 INFO:tasks.workunit.client.0.smithi057.stdout:4/597: write d14/d47/d5e/f8e [971569,6961] 0 2024-04-25T22:42:16.134 INFO:tasks.workunit.client.0.smithi057.stdout:1/567: unlink d7/dd/d90/f97 0 2024-04-25T22:42:16.137 INFO:tasks.workunit.client.0.smithi057.stdout:7/549: chown d6/d28/d4e/d30/d60/d8d/d96/d5d/c92 23 1 2024-04-25T22:42:16.138 INFO:tasks.workunit.client.0.smithi057.stdout:1/568: creat d7/dd/d90/fba x:0 0 0 2024-04-25T22:42:16.138 INFO:tasks.workunit.client.0.smithi057.stdout:5/641: mkdir d2/d1c/d24/d3d/d77/dcd 0 2024-04-25T22:42:16.139 INFO:tasks.workunit.client.0.smithi057.stdout:9/562: creat d3/d34/d42/d28/d39/d54/fbe x:0 0 0 2024-04-25T22:42:16.139 INFO:tasks.workunit.client.0.smithi057.stdout:2/623: rename d1f/d36/d60 to d1f/d4a/d4d/d88/dd9 0 2024-04-25T22:42:16.141 INFO:tasks.workunit.client.0.smithi057.stdout:3/545: dwrite d0/d4/d7/d46/d30/f65 [0,4194304] 0 2024-04-25T22:42:16.141 INFO:tasks.workunit.client.0.smithi057.stdout:5/642: mkdir d2/d1c/d24/d8f/dce 0 2024-04-25T22:42:16.143 INFO:tasks.workunit.client.0.smithi057.stdout:0/569: dwrite d0/d3/d6/f59 [4194304,4194304] 0 2024-04-25T22:42:16.144 INFO:tasks.workunit.client.0.smithi057.stdout:1/569: write d7/dd/d16/d18/d31/f79 [736691,105481] 0 2024-04-25T22:42:16.144 INFO:tasks.workunit.client.0.smithi057.stdout:9/563: rename d3/d34/d42/f52 to d3/d34/d42/d28/d62/d67/d6e/fbf 0 2024-04-25T22:42:16.144 INFO:tasks.workunit.client.0.smithi057.stdout:7/550: link d6/d28/l2b d6/d28/d4e/d30/d60/d6f/d9c/lb9 0 2024-04-25T22:42:16.144 INFO:tasks.workunit.client.0.smithi057.stdout:3/546: stat d0/d4/d7/d26/c45 0 2024-04-25T22:42:16.145 INFO:tasks.workunit.client.0.smithi057.stdout:5/643: symlink d2/d1c/d46/d3a/da8/lcf 0 2024-04-25T22:42:16.145 INFO:tasks.workunit.client.0.smithi057.stdout:8/544: dwrite d4/d5/d2f/f5f [0,4194304] 0 2024-04-25T22:42:16.145 INFO:tasks.workunit.client.0.smithi057.stdout:2/624: truncate d1f/d21/d26/d63/d7f/fae 917287 0 2024-04-25T22:42:16.146 INFO:tasks.workunit.client.0.smithi057.stdout:1/570: write d7/dd/d90/fba [788234,123377] 0 2024-04-25T22:42:16.146 INFO:tasks.workunit.client.0.smithi057.stdout:0/570: rmdir d0/d3/d4d/d87/da0 39 2024-04-25T22:42:16.146 INFO:tasks.workunit.client.0.smithi057.stdout:9/564: write d3/ff [8410747,28901] 0 2024-04-25T22:42:16.148 INFO:tasks.workunit.client.0.smithi057.stdout:3/547: creat d0/d4/d34/d3c/d53/d7f/fba x:0 0 0 2024-04-25T22:42:16.148 INFO:tasks.workunit.client.0.smithi057.stdout:5/644: write d2/d1c/d24/f43 [5648601,128261] 0 2024-04-25T22:42:16.148 INFO:tasks.workunit.client.0.smithi057.stdout:6/607: dread d2/d19/d49/d62/f7e [0,4194304] 0 2024-04-25T22:42:16.148 INFO:tasks.workunit.client.0.smithi057.stdout:0/571: rmdir d0 39 2024-04-25T22:42:16.149 INFO:tasks.workunit.client.0.smithi057.stdout:4/598: dwrite d14/d2f/f54 [0,4194304] 0 2024-04-25T22:42:16.149 INFO:tasks.workunit.client.0.smithi057.stdout:1/571: creat d7/d65/d6a/d98/d41/d6b/fbb x:0 0 0 2024-04-25T22:42:16.150 INFO:tasks.workunit.client.0.smithi057.stdout:7/551: getdents d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/da2 0 2024-04-25T22:42:16.150 INFO:tasks.workunit.client.0.smithi057.stdout:5/645: fdatasync d2/d1c/d24/f4c 0 2024-04-25T22:42:16.150 INFO:tasks.workunit.client.0.smithi057.stdout:0/572: chown d0/d3/d4d/f81 35 1 2024-04-25T22:42:16.150 INFO:tasks.workunit.client.0.smithi057.stdout:8/545: truncate d4/d5/d17/d19/d35/faf 967398 0 2024-04-25T22:42:16.151 INFO:tasks.workunit.client.0.smithi057.stdout:4/599: creat d14/fc2 x:0 0 0 2024-04-25T22:42:16.151 INFO:tasks.workunit.client.0.smithi057.stdout:1/572: rmdir d7/dd/d16/d24/d63 39 2024-04-25T22:42:16.151 INFO:tasks.workunit.client.0.smithi057.stdout:0/573: write d0/d3/f68 [1001916,122325] 0 2024-04-25T22:42:16.152 INFO:tasks.workunit.client.0.smithi057.stdout:8/546: chown d4/db/dd/d3a/d5c/d76/f97 1966 1 2024-04-25T22:42:16.153 INFO:tasks.workunit.client.0.smithi057.stdout:2/625: read d1f/d4a/d4d/f72 [554951,66685] 0 2024-04-25T22:42:16.153 INFO:tasks.workunit.client.0.smithi057.stdout:5/646: write d2/d47/d6e/f98 [963045,17060] 0 2024-04-25T22:42:16.153 INFO:tasks.workunit.client.0.smithi057.stdout:4/600: rmdir d14/d47/d5e/dc0 0 2024-04-25T22:42:16.154 INFO:tasks.workunit.client.0.smithi057.stdout:0/574: unlink d0/d3/d6/d71/ca1 0 2024-04-25T22:42:16.155 INFO:tasks.workunit.client.0.smithi057.stdout:2/626: mkdir d1f/d36/d54/dda 0 2024-04-25T22:42:16.155 INFO:tasks.workunit.client.0.smithi057.stdout:8/547: creat d4/d5/d17/fce x:0 0 0 2024-04-25T22:42:16.155 INFO:tasks.workunit.client.0.smithi057.stdout:4/601: mkdir d14/d2f/d4c/d5b/dc3 0 2024-04-25T22:42:16.155 INFO:tasks.workunit.client.0.smithi057.stdout:0/575: write d0/f9 [4193113,26862] 0 2024-04-25T22:42:16.156 INFO:tasks.workunit.client.0.smithi057.stdout:2/627: write d1f/d21/d26/f6b [1765760,129461] 0 2024-04-25T22:42:16.156 INFO:tasks.workunit.client.0.smithi057.stdout:1/573: rename d7/d65/d6a/d98/d41/d45/f87 to d7/dd/d16/fbc 0 2024-04-25T22:42:16.157 INFO:tasks.workunit.client.0.smithi057.stdout:8/548: mkdir d4/db/dd/d3a/d94/dcf 0 2024-04-25T22:42:16.157 INFO:tasks.workunit.client.0.smithi057.stdout:6/608: dread d2/d19/d50/d91/fa3 [0,4194304] 0 2024-04-25T22:42:16.157 INFO:tasks.workunit.client.0.smithi057.stdout:2/628: chown d1f/d21/c5b 1 1 2024-04-25T22:42:16.157 INFO:tasks.workunit.client.0.smithi057.stdout:0/576: creat d0/d3/d6/d14/d39/fc7 x:0 0 0 2024-04-25T22:42:16.157 INFO:tasks.workunit.client.0.smithi057.stdout:5/647: rename d2/d1c/d24/d8f/dce to d2/d1c/d46/dd0 0 2024-04-25T22:42:16.157 INFO:tasks.workunit.client.0.smithi057.stdout:6/609: stat d2/d19/d50/d1a/f74 0 2024-04-25T22:42:16.157 INFO:tasks.workunit.client.0.smithi057.stdout:1/574: write d7/dd/d16/f7e [1310096,129364] 0 2024-04-25T22:42:16.159 INFO:tasks.workunit.client.0.smithi057.stdout:4/602: truncate d14/d2f/d4c/fa8 1352373 0 2024-04-25T22:42:16.159 INFO:tasks.workunit.client.0.smithi057.stdout:1/575: fsync d7/dd/d16/d18/d31/f9c 0 2024-04-25T22:42:16.159 INFO:tasks.workunit.client.0.smithi057.stdout:2/629: write d1f/d34/d50/fba [991434,13183] 0 2024-04-25T22:42:16.160 INFO:tasks.workunit.client.0.smithi057.stdout:2/630: truncate d1f/d36/d54/fbf 576503 0 2024-04-25T22:42:16.160 INFO:tasks.workunit.client.0.smithi057.stdout:0/577: mkdir d0/d3/d6/d29/dc8 0 2024-04-25T22:42:16.160 INFO:tasks.workunit.client.0.smithi057.stdout:5/648: creat d2/d1c/d24/fd1 x:0 0 0 2024-04-25T22:42:16.160 INFO:tasks.workunit.client.0.smithi057.stdout:6/610: creat d2/d19/d50/d1a/d22/fc1 x:0 0 0 2024-04-25T22:42:16.160 INFO:tasks.workunit.client.0.smithi057.stdout:1/576: rmdir d7/d65/d6a/d98/d41/d75 39 2024-04-25T22:42:16.161 INFO:tasks.workunit.client.0.smithi057.stdout:5/649: stat d2/d47/d60/lcc 0 2024-04-25T22:42:16.161 INFO:tasks.workunit.client.0.smithi057.stdout:8/549: getdents d4/db/dd/d3a/d71 0 2024-04-25T22:42:16.162 INFO:tasks.workunit.client.0.smithi057.stdout:8/550: readlink d4/d5/d17/l98 0 2024-04-25T22:42:16.162 INFO:tasks.workunit.client.0.smithi057.stdout:4/603: read d14/d2f/f57 [804116,18868] 0 2024-04-25T22:42:16.162 INFO:tasks.workunit.client.0.smithi057.stdout:6/611: chown d2/d19/d26/d4f/l92 34 1 2024-04-25T22:42:16.162 INFO:tasks.workunit.client.0.smithi057.stdout:5/650: write d2/d1c/d46/d3a/fc7 [852741,95168] 0 2024-04-25T22:42:16.162 INFO:tasks.workunit.client.0.smithi057.stdout:8/551: chown d4/db/dd/d3a/f3c 216284 1 2024-04-25T22:42:16.163 INFO:tasks.workunit.client.0.smithi057.stdout:6/612: fsync d2/d19/d49/fa4 0 2024-04-25T22:42:16.163 INFO:tasks.workunit.client.0.smithi057.stdout:8/552: symlink d4/d5/d17/d19/ld0 0 2024-04-25T22:42:16.164 INFO:tasks.workunit.client.0.smithi057.stdout:1/577: read d7/dd/d26/f8c [2370761,7689] 0 2024-04-25T22:42:16.165 INFO:tasks.workunit.client.0.smithi057.stdout:7/552: truncate d6/d28/d4e/d30/f43 3362542 0 2024-04-25T22:42:16.166 INFO:tasks.workunit.client.0.smithi057.stdout:1/578: dread - d7/dd/d16/d24/f77 zero size 2024-04-25T22:42:16.168 INFO:tasks.workunit.client.0.smithi057.stdout:7/553: symlink d6/d28/d4e/d30/d60/d8d/d96/d59/lba 0 2024-04-25T22:42:16.169 INFO:tasks.workunit.client.0.smithi057.stdout:1/579: chown d7/dd/d16/d88/f8b 103002755 1 2024-04-25T22:42:16.169 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:16.168+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:16.170 INFO:tasks.workunit.client.0.smithi057.stdout:0/578: dwrite d0/d5/f32 [0,4194304] 0 2024-04-25T22:42:16.170 INFO:tasks.workunit.client.0.smithi057.stdout:1/580: creat d7/d65/fbd x:0 0 0 2024-04-25T22:42:16.171 INFO:tasks.workunit.client.0.smithi057.stdout:0/579: creat d0/d49/d6d/fc9 x:0 0 0 2024-04-25T22:42:16.171 INFO:tasks.workunit.client.0.smithi057.stdout:5/651: dwrite d2/d1c/d46/d3a/da8/fbc [0,4194304] 0 2024-04-25T22:42:16.171 INFO:tasks.workunit.client.0.smithi057.stdout:2/631: dwrite d1f/d34/f7d [0,4194304] 0 2024-04-25T22:42:16.172 INFO:tasks.workunit.client.0.smithi057.stdout:0/580: fsync d0/d5/d53/f61 0 2024-04-25T22:42:16.173 INFO:tasks.workunit.client.0.smithi057.stdout:0/581: chown d0/d49/d6d/f8b 292648473 1 2024-04-25T22:42:16.173 INFO:tasks.workunit.client.0.smithi057.stdout:2/632: creat d1f/d36/fdb x:0 0 0 2024-04-25T22:42:16.173 INFO:tasks.workunit.client.0.smithi057.stdout:5/652: stat d2/d1c/d46/d3a/fc7 0 2024-04-25T22:42:16.177 INFO:tasks.workunit.client.0.smithi057.stdout:8/553: write d4/db/fc [2617799,123254] 0 2024-04-25T22:42:16.177 INFO:tasks.workunit.client.0.smithi057.stdout:2/633: truncate d1f/d36/fc4 1297585 0 2024-04-25T22:42:16.178 INFO:tasks.workunit.client.0.smithi057.stdout:2/634: truncate f8 4428893 0 2024-04-25T22:42:16.178 INFO:tasks.workunit.client.0.smithi057.stdout:3/548: sync 2024-04-25T22:42:16.178 INFO:tasks.workunit.client.0.smithi057.stdout:7/554: sync 2024-04-25T22:42:16.179 INFO:tasks.workunit.client.0.smithi057.stdout:4/604: sync 2024-04-25T22:42:16.181 INFO:tasks.workunit.client.0.smithi057.stdout:6/613: dwrite d2/d19/d50/d1a/d22/d31/f33 [0,4194304] 0 2024-04-25T22:42:16.181 INFO:tasks.workunit.client.0.smithi057.stdout:8/554: mknod d4/db/cd1 0 2024-04-25T22:42:16.181 INFO:tasks.workunit.client.0.smithi057.stdout:1/581: dwrite d7/d65/d6a/d98/d41/f4b [0,4194304] 0 2024-04-25T22:42:16.181 INFO:tasks.workunit.client.0.smithi057.stdout:6/614: mknod d2/d19/d50/cc2 0 2024-04-25T22:42:16.181 INFO:tasks.workunit.client.0.smithi057.stdout:0/582: rename d0/d49/d97/c98 to d0/d3/d4d/d87/d91/cca 0 2024-04-25T22:42:16.182 INFO:tasks.workunit.client.0.smithi057.stdout:1/582: write d7/d4e/f81 [1212179,121473] 0 2024-04-25T22:42:16.182 INFO:tasks.workunit.client.0.smithi057.stdout:4/605: rmdir d14/da9/d95 0 2024-04-25T22:42:16.182 INFO:tasks.workunit.client.0.smithi057.stdout:8/555: write d4/d5/d17/d19/d35/f5a [4688144,1258] 0 2024-04-25T22:42:16.182 INFO:tasks.workunit.client.0.smithi057.stdout:6/615: stat d2/f2b 0 2024-04-25T22:42:16.184 INFO:tasks.workunit.client.0.smithi057.stdout:7/555: creat d6/d28/d4e/d30/d60/fbb x:0 0 0 2024-04-25T22:42:16.184 INFO:tasks.workunit.client.0.smithi057.stdout:2/635: rename d1f/d21/d96/db4 to d1f/d4a/d4d/d88/dd9/da1/ddc 0 2024-04-25T22:42:16.184 INFO:tasks.workunit.client.0.smithi057.stdout:8/556: readlink d4/db/dd/l1f 0 2024-04-25T22:42:16.185 INFO:tasks.workunit.client.0.smithi057.stdout:1/583: unlink d7/dd/d16/f8d 0 2024-04-25T22:42:16.185 INFO:tasks.workunit.client.0.smithi057.stdout:2/636: fdatasync f11 0 2024-04-25T22:42:16.185 INFO:tasks.workunit.client.0.smithi057.stdout:7/556: read d6/d28/d4e/d30/d60/d8d/d96/f2a [4133137,12980] 0 2024-04-25T22:42:16.185 INFO:tasks.workunit.client.0.smithi057.stdout:4/606: mknod d14/d2f/d4c/d5b/dc3/cc4 0 2024-04-25T22:42:16.185 INFO:tasks.workunit.client.0.smithi057.stdout:6/616: symlink d2/d19/d20/d61/lc3 0 2024-04-25T22:42:16.187 INFO:tasks.workunit.client.0.smithi057.stdout:1/584: rename d7 to d7/dd/d16/dbe 22 2024-04-25T22:42:16.188 INFO:tasks.workunit.client.0.smithi057.stdout:1/585: chown d7/dd 116 1 2024-04-25T22:42:16.188 INFO:tasks.workunit.client.0.smithi057.stdout:3/549: dwrite d0/d4/f90 [4194304,4194304] 0 2024-04-25T22:42:16.190 INFO:tasks.workunit.client.0.smithi057.stdout:8/557: rmdir d4/db/dd/d3a/d5c/d76 39 2024-04-25T22:42:16.190 INFO:tasks.workunit.client.0.smithi057.stdout:9/565: dread d3/d34/d42/d28/d2d/f6c [0,4194304] 0 2024-04-25T22:42:16.191 INFO:tasks.workunit.client.0.smithi057.stdout:2/637: write d1f/d34/fc1 [2673678,66867] 0 2024-04-25T22:42:16.191 INFO:tasks.workunit.client.0.smithi057.stdout:8/558: readlink d4/d5/d17/l2d 0 2024-04-25T22:42:16.191 INFO:tasks.workunit.client.0.smithi057.stdout:1/586: mkdir d7/dd/d90/dbf 0 2024-04-25T22:42:16.192 INFO:tasks.workunit.client.0.smithi057.stdout:9/566: chown d3/f24 29191 1 2024-04-25T22:42:16.192 INFO:tasks.workunit.client.0.smithi057.stdout:6/617: mknod d2/d19/cc4 0 2024-04-25T22:42:16.192 INFO:tasks.workunit.client.0.smithi057.stdout:7/557: link d6/d28/l2b d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/lbc 0 2024-04-25T22:42:16.193 INFO:tasks.workunit.client.0.smithi057.stdout:6/618: readlink d2/d19/d85/l96 0 2024-04-25T22:42:16.194 INFO:tasks.workunit.client.0.smithi057.stdout:2/638: write d1f/d4a/d4d/d88/dd9/fc8 [600430,13741] 0 2024-04-25T22:42:16.194 INFO:tasks.workunit.client.0.smithi057.stdout:9/567: dread - d3/d34/d42/d28/d62/d67/d6e/f80 zero size 2024-04-25T22:42:16.194 INFO:tasks.workunit.client.0.smithi057.stdout:8/559: chown d4/db/dd/d3a/d94/lad 21 1 2024-04-25T22:42:16.195 INFO:tasks.workunit.client.0.smithi057.stdout:0/583: dread d0/d3/dae/fb1 [0,4194304] 0 2024-04-25T22:42:16.195 INFO:tasks.workunit.client.0.smithi057.stdout:7/558: stat d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/f8e 0 2024-04-25T22:42:16.195 INFO:tasks.workunit.client.0.smithi057.stdout:1/587: creat d7/d65/d6a/d98/d41/fc0 x:0 0 0 2024-04-25T22:42:16.196 INFO:tasks.workunit.client.0.smithi057.stdout:2/639: readlink d1f/d34/d50/la7 0 2024-04-25T22:42:16.196 INFO:tasks.workunit.client.0.smithi057.stdout:9/568: unlink d3/l84 0 2024-04-25T22:42:16.196 INFO:tasks.workunit.client.0.smithi057.stdout:4/607: dwrite d14/da9/f55 [0,4194304] 0 2024-04-25T22:42:16.197 INFO:tasks.workunit.client.0.smithi057.stdout:5/653: dread d2/d47/f68 [0,4194304] 0 2024-04-25T22:42:16.197 INFO:tasks.workunit.client.0.smithi057.stdout:6/619: getdents d2/d19 0 2024-04-25T22:42:16.197 INFO:tasks.workunit.client.0.smithi057.stdout:4/608: fdatasync d14/f1c 0 2024-04-25T22:42:16.201 INFO:tasks.workunit.client.0.smithi057.stdout:0/584: creat d0/d49/fcb x:0 0 0 2024-04-25T22:42:16.201 INFO:tasks.workunit.client.0.smithi057.stdout:7/559: creat d6/d28/d4e/d30/d60/d8d/d96/d59/fbd x:0 0 0 2024-04-25T22:42:16.202 INFO:tasks.workunit.client.0.smithi057.stdout:6/620: chown d2/d19/d50/d1a/f4e 181 1 2024-04-25T22:42:16.203 INFO:tasks.workunit.client.0.smithi057.stdout:4/609: read d14/d5a/f9d [32776,51910] 0 2024-04-25T22:42:16.203 INFO:tasks.workunit.client.0.smithi057.stdout:3/550: dwrite d0/d4/d7/d46/d30/f6d [0,4194304] 0 2024-04-25T22:42:16.203 INFO:tasks.workunit.client.0.smithi057.stdout:2/640: write d1f/d34/f52 [820420,32377] 0 2024-04-25T22:42:16.204 INFO:tasks.workunit.client.0.smithi057.stdout:5/654: rename d2/d1c/d46/d3a/d6a/d54 to d2/d47/d87/dd2 0 2024-04-25T22:42:16.205 INFO:tasks.workunit.client.0.smithi057.stdout:3/551: readlink d0/d4/lf 0 2024-04-25T22:42:16.207 INFO:tasks.workunit.client.0.smithi057.stdout:4/610: creat d14/d47/d5e/d5f/fc5 x:0 0 0 2024-04-25T22:42:16.207 INFO:tasks.workunit.client.0.smithi057.stdout:6/621: fdatasync d2/d19/d50/d1a/d22/f53 0 2024-04-25T22:42:16.208 INFO:tasks.workunit.client.0.smithi057.stdout:8/560: dwrite d4/d5/d17/d19/f54 [0,4194304] 0 2024-04-25T22:42:16.209 INFO:tasks.workunit.client.0.smithi057.stdout:5/655: rename d2/d47/d6e to d2/d47/da5/dd3 0 2024-04-25T22:42:16.210 INFO:tasks.workunit.client.0.smithi057.stdout:3/552: mknod d0/d6b/cbb 0 2024-04-25T22:42:16.211 INFO:tasks.workunit.client.0.smithi057.stdout:1/588: dwrite d7/d4e/f5c [0,4194304] 0 2024-04-25T22:42:16.212 INFO:tasks.workunit.client.0.smithi057.stdout:9/569: dwrite d3/f66 [4194304,4194304] 0 2024-04-25T22:42:16.213 INFO:tasks.workunit.client.0.smithi057.stdout:8/561: write d4/d5/d2f/fb4 [517865,60212] 0 2024-04-25T22:42:16.218 INFO:tasks.workunit.client.0.smithi057.stdout:6/622: mknod d2/d19/d9b/cc5 0 2024-04-25T22:42:16.220 INFO:tasks.workunit.client.0.smithi057.stdout:4/611: read d14/d2f/d4c/d5b/f6b [2112677,1175] 0 2024-04-25T22:42:16.221 INFO:tasks.workunit.client.0.smithi057.stdout:9/570: truncate d3/d34/d42/d28/f85 2232185 0 2024-04-25T22:42:16.221 INFO:tasks.workunit.client.0.smithi057.stdout:8/562: unlink d4/d5/d17/d19/d35/d83/d92/d5b/f56 0 2024-04-25T22:42:16.222 INFO:tasks.workunit.client.0.smithi057.stdout:9/571: chown l2 32 1 2024-04-25T22:42:16.222 INFO:tasks.workunit.client.0.smithi057.stdout:6/623: creat d2/d19/d26/fc6 x:0 0 0 2024-04-25T22:42:16.225 INFO:tasks.workunit.client.0.smithi057.stdout:8/563: stat d4/db/dd/fae 0 2024-04-25T22:42:16.226 INFO:tasks.workunit.client.0.smithi057.stdout:5/656: dwrite d2/d6/fa [0,4194304] 0 2024-04-25T22:42:16.226 INFO:tasks.workunit.client.0.smithi057.stdout:7/560: dwrite d6/d28/d4e/d30/d60/f86 [0,4194304] 0 2024-04-25T22:42:16.229 INFO:tasks.workunit.client.0.smithi057.stdout:1/589: dwrite d7/dd/d16/d88/f8b [0,4194304] 0 2024-04-25T22:42:16.229 INFO:tasks.workunit.client.0.smithi057.stdout:6/624: rmdir d2/d19/d49/d62 39 2024-04-25T22:42:16.229 INFO:tasks.workunit.client.0.smithi057.stdout:9/572: chown d3/d34/d42/d28/d39/d54/da5 20 1 2024-04-25T22:42:16.229 INFO:tasks.workunit.client.0.smithi057.stdout:3/553: dwrite d0/fe [0,4194304] 0 2024-04-25T22:42:16.230 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is set 2024-04-25T22:42:16.230 INFO:tasks.workunit.client.0.smithi057.stdout:8/564: mkdir d4/d5/dd2 0 2024-04-25T22:42:16.231 INFO:tasks.workunit.client.0.smithi057.stdout:3/554: write d0/d4/d7/d22/f59 [283413,83891] 0 2024-04-25T22:42:16.231 INFO:tasks.workunit.client.0.smithi057.stdout:5/657: rmdir d2/d47/d60 39 2024-04-25T22:42:16.231 INFO:tasks.workunit.client.0.smithi057.stdout:6/625: mknod d2/d19/cc7 0 2024-04-25T22:42:16.232 INFO:tasks.workunit.client.0.smithi057.stdout:1/590: symlink d7/dd/d90/dbf/lc1 0 2024-04-25T22:42:16.233 INFO:tasks.workunit.client.0.smithi057.stdout:8/565: symlink d4/d5/d21/ld3 0 2024-04-25T22:42:16.233 INFO:tasks.workunit.client.0.smithi057.stdout:5/658: creat d2/d1c/fd4 x:0 0 0 2024-04-25T22:42:16.233 INFO:tasks.workunit.client.0.smithi057.stdout:3/555: chown d0/d4/d7/d26 1062721 1 2024-04-25T22:42:16.233 INFO:tasks.workunit.client.0.smithi057.stdout:4/612: dwrite d14/d2f/fa3 [0,4194304] 0 2024-04-25T22:42:16.234 INFO:tasks.workunit.client.0.smithi057.stdout:1/591: getdents d7 0 2024-04-25T22:42:16.234 INFO:tasks.workunit.client.0.smithi057.stdout:5/659: write d2/d6/db/fbb [482818,19782] 0 2024-04-25T22:42:16.235 INFO:tasks.workunit.client.0.smithi057.stdout:8/566: write d4/d5/d17/d19/d35/faf [1561917,97833] 0 2024-04-25T22:42:16.235 INFO:tasks.workunit.client.0.smithi057.stdout:9/573: dread - d3/d34/fb2 zero size 2024-04-25T22:42:16.235 INFO:tasks.workunit.client.0.smithi057.stdout:1/592: creat d7/dd/d90/dbf/fc2 x:0 0 0 2024-04-25T22:42:16.235 INFO:tasks.workunit.client.0.smithi057.stdout:3/556: creat d0/d4/d7/d46/d30/d99/fbc x:0 0 0 2024-04-25T22:42:16.236 INFO:tasks.workunit.client.0.smithi057.stdout:5/660: creat d2/d1c/d24/d3d/fd5 x:0 0 0 2024-04-25T22:42:16.236 INFO:tasks.workunit.client.0.smithi057.stdout:9/574: mknod d3/d34/d42/d5e/cc0 0 2024-04-25T22:42:16.236 INFO:tasks.workunit.client.0.smithi057.stdout:8/567: creat d4/d5/d21/db0/fd4 x:0 0 0 2024-04-25T22:42:16.236 INFO:tasks.workunit.client.0.smithi057.stdout:1/593: chown d7/dd/d16/d24/f3a 379948 1 2024-04-25T22:42:16.237 INFO:tasks.workunit.client.0.smithi057.stdout:1/594: read - d7/d65/d6a/d98/d41/d45/f48 zero size 2024-04-25T22:42:16.238 INFO:tasks.workunit.client.0.smithi057.stdout:5/661: rmdir d2/d1c/d46/d3a/d6a/dbe 0 2024-04-25T22:42:16.239 INFO:tasks.workunit.client.0.smithi057.stdout:5/662: write d2/d1c/f48 [2341461,26797] 0 2024-04-25T22:42:16.239 INFO:tasks.workunit.client.0.smithi057.stdout:7/561: rename d6/f20 to d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/fbe 0 2024-04-25T22:42:16.239 INFO:tasks.workunit.client.0.smithi057.stdout:1/595: fsync d7/d65/d6a/d98/d41/d6b/fbb 0 2024-04-25T22:42:16.240 INFO:tasks.workunit.client.0.smithi057.stdout:7/562: mkdir d6/d28/d4e/d30/d60/d6f/dbf 0 2024-04-25T22:42:16.241 INFO:tasks.workunit.client.0.smithi057.stdout:3/557: dread d0/fe [0,4194304] 0 2024-04-25T22:42:16.241 INFO:tasks.workunit.client.0.smithi057.stdout:5/663: link d2/d47/da5/f8e d2/d1c/d24/d3d/d77/fd6 0 2024-04-25T22:42:16.241 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:42:16.250 INFO:tasks.workunit.client.0.smithi057.stdout:7/563: mknod d6/d28/cc0 0 2024-04-25T22:42:16.250 INFO:tasks.workunit.client.0.smithi057.stdout:3/558: chown d0/d4/d7b/d7c/fb0 9486867 1 2024-04-25T22:42:16.250 INFO:tasks.workunit.client.0.smithi057.stdout:5/664: rmdir d2/d1c/d24/d8f 39 2024-04-25T22:42:16.251 INFO:tasks.workunit.client.0.smithi057.stdout:5/665: getdents d2/d1c/d24/d3d/da7/db2 0 2024-04-25T22:42:16.251 INFO:tasks.workunit.client.0.smithi057.stdout:7/564: link d6/d28/d4e/d30/d60/d8d/d96/f7f d6/d28/d4e/d30/d60/d8d/fc1 0 2024-04-25T22:42:16.251 INFO:tasks.workunit.client.0.smithi057.stdout:5/666: stat d2/d1c/d24/d3d/d77/fd6 0 2024-04-25T22:42:16.251 INFO:tasks.workunit.client.0.smithi057.stdout:5/667: chown d2/c15 568174 1 2024-04-25T22:42:16.251 INFO:tasks.workunit.client.0.smithi057.stdout:5/668: link d2/d1c/d46/d3a/da8/fb8 d2/d1c/d24/d3d/d50/fd7 0 2024-04-25T22:42:16.251 INFO:tasks.workunit.client.0.smithi057.stdout:7/565: dread d6/d28/d4e/d30/d60/d8d/d96/d5d/f5e [0,4194304] 0 2024-04-25T22:42:16.251 INFO:tasks.workunit.client.0.smithi057.stdout:5/669: mknod d2/d47/d87/dd2/cd8 0 2024-04-25T22:42:16.251 INFO:tasks.workunit.client.0.smithi057.stdout:3/559: dwrite d0/d4/d7/d26/f63 [4194304,4194304] 0 2024-04-25T22:42:16.251 INFO:tasks.workunit.client.0.smithi057.stdout:7/566: chown d6/d28/d4e/d30/d60/fb5 542 1 2024-04-25T22:42:16.251 INFO:tasks.workunit.client.0.smithi057.stdout:5/670: creat d2/d1c/d46/d3a/d6a/fd9 x:0 0 0 2024-04-25T22:42:16.251 INFO:tasks.workunit.client.0.smithi057.stdout:3/560: chown d0/d4/f9 2723953 1 2024-04-25T22:42:16.252 INFO:tasks.workunit.client.0.smithi057.stdout:5/671: creat d2/d1c/d46/dd0/fda x:0 0 0 2024-04-25T22:42:16.252 INFO:tasks.workunit.client.0.smithi057.stdout:7/567: rename d6/d28/d4e/d30/d60/f64 to d6/d28/d4e/d30/d60/fc2 0 2024-04-25T22:42:16.252 INFO:tasks.workunit.client.0.smithi057.stdout:3/561: creat d0/d4/d34/fbd x:0 0 0 2024-04-25T22:42:16.252 INFO:tasks.workunit.client.0.smithi057.stdout:5/672: write d2/d1c/d24/d3d/da7/db2/fb5 [86220,107141] 0 2024-04-25T22:42:16.253 INFO:tasks.workunit.client.0.smithi057.stdout:3/562: mknod d0/d4/d4a/cbe 0 2024-04-25T22:42:16.253 INFO:tasks.workunit.client.0.smithi057.stdout:5/673: read d2/d1c/f26 [1007092,38453] 0 2024-04-25T22:42:16.253 INFO:tasks.workunit.client.0.smithi057.stdout:7/568: creat d6/d28/d4e/d30/d60/d8d/d96/fc3 x:0 0 0 2024-04-25T22:42:16.253 INFO:tasks.workunit.client.0.smithi057.stdout:3/563: write d0/d4/d7/d46/d30/f65 [4877756,20493] 0 2024-04-25T22:42:16.254 INFO:tasks.workunit.client.0.smithi057.stdout:5/674: rmdir d2/d1c/d24/d3d/d77 39 2024-04-25T22:42:16.255 INFO:tasks.workunit.client.0.smithi057.stdout:3/564: creat d0/d4/d7/d46/d30/d7a/d91/fbf x:0 0 0 2024-04-25T22:42:16.256 INFO:tasks.workunit.client.0.smithi057.stdout:5/675: chown d2/d1c/d24/d3d/d50/d83 388099585 1 2024-04-25T22:42:16.256 INFO:tasks.workunit.client.0.smithi057.stdout:7/569: getdents d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d 0 2024-04-25T22:42:16.256 INFO:tasks.workunit.client.0.smithi057.stdout:5/676: write d2/d1c/f63 [4796524,89968] 0 2024-04-25T22:42:16.256 INFO:tasks.workunit.client.0.smithi057.stdout:3/565: truncate d0/d4/d34/f64 4657822 0 2024-04-25T22:42:16.256 INFO:tasks.workunit.client.0.smithi057.stdout:7/570: write d6/d28/d4e/d30/f9d [203577,115311] 0 2024-04-25T22:42:16.256 INFO:tasks.workunit.client.0.smithi057.stdout:5/677: chown d2/f53 3 1 2024-04-25T22:42:16.257 INFO:tasks.workunit.client.0.smithi057.stdout:7/571: write d6/f48 [2968511,119292] 0 2024-04-25T22:42:16.260 INFO:tasks.workunit.client.0.smithi057.stdout:7/572: mkdir d6/d28/d4e/d30/d60/d6f/d9c/dc4 0 2024-04-25T22:42:16.261 INFO:tasks.workunit.client.0.smithi057.stdout:7/573: mknod d6/d28/d4e/d30/cc5 0 2024-04-25T22:42:16.261 INFO:tasks.workunit.client.0.smithi057.stdout:0/585: dread d0/d49/f6b [0,4194304] 0 2024-04-25T22:42:16.262 INFO:tasks.workunit.client.0.smithi057.stdout:7/574: rename d6/d28/d4e/d30/d60 to d6/d28/d4e/d30/d60/d8d/dc6 22 2024-04-25T22:42:16.263 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:16.259+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:16.263 INFO:tasks.workunit.client.0.smithi057.stdout:3/566: dwrite d0/d11/f36 [0,4194304] 0 2024-04-25T22:42:16.263 INFO:tasks.workunit.client.0.smithi057.stdout:7/575: dread - d6/f3a zero size 2024-04-25T22:42:16.263 INFO:tasks.workunit.client.0.smithi057.stdout:0/586: creat d0/d3/fcc x:0 0 0 2024-04-25T22:42:16.264 INFO:tasks.workunit.client.0.smithi057.stdout:5/678: dread d2/d6/db/f85 [0,4194304] 0 2024-04-25T22:42:16.264 INFO:tasks.workunit.client.0.smithi057.stdout:3/567: readlink d0/d4/d7b/d7c/la2 0 2024-04-25T22:42:16.264 INFO:tasks.workunit.client.0.smithi057.stdout:7/576: write d6/d28/d4e/d30/d60/d8d/fa9 [458841,97837] 0 2024-04-25T22:42:16.265 INFO:tasks.workunit.client.0.smithi057.stdout:8/568: read d4/d5/d17/d19/d35/faf [1306630,90530] 0 2024-04-25T22:42:16.265 INFO:tasks.workunit.client.0.smithi057.stdout:9/575: truncate d3/d34/d42/d28/f51 737343 0 2024-04-25T22:42:16.266 INFO:tasks.workunit.client.0.smithi057.stdout:2/641: dread d1f/d34/d50/f53 [0,4194304] 0 2024-04-25T22:42:16.266 INFO:tasks.workunit.client.0.smithi057.stdout:5/679: write d2/d47/d60/fa6 [4747221,81031] 0 2024-04-25T22:42:16.267 INFO:tasks.workunit.client.0.smithi057.stdout:3/568: mkdir d0/d4/d34/d3c/d70/dc0 0 2024-04-25T22:42:16.267 INFO:tasks.workunit.client.0.smithi057.stdout:5/680: write d2/d6/f62 [851302,11961] 0 2024-04-25T22:42:16.268 INFO:tasks.workunit.client.0.smithi057.stdout:2/642: fdatasync d1f/d21/f2e 0 2024-04-25T22:42:16.269 INFO:tasks.workunit.client.0.smithi057.stdout:9/576: chown d3/c60 7492677 1 2024-04-25T22:42:16.269 INFO:tasks.workunit.client.0.smithi057.stdout:3/569: mkdir d0/d4/d7/d26/d89/d97/dc1 0 2024-04-25T22:42:16.270 INFO:tasks.workunit.client.0.smithi057.stdout:0/587: rename d0/d3/d6/d14/f72 to d0/d5/fcd 0 2024-04-25T22:42:16.270 INFO:tasks.workunit.client.0.smithi057.stdout:3/570: chown d0/d4/d7/l2e 1944295 1 2024-04-25T22:42:16.271 INFO:tasks.workunit.client.0.smithi057.stdout:0/588: creat d0/d49/d6d/fce x:0 0 0 2024-04-25T22:42:16.272 INFO:tasks.workunit.client.0.smithi057.stdout:2/643: dread d1f/d36/d54/f7a [0,4194304] 0 2024-04-25T22:42:16.272 INFO:tasks.workunit.client.0.smithi057.stdout:9/577: getdents d3/d34/d42/d28/d65 0 2024-04-25T22:42:16.273 INFO:tasks.workunit.client.0.smithi057.stdout:3/571: creat d0/d4/fc2 x:0 0 0 2024-04-25T22:42:16.273 INFO:tasks.workunit.client.0.smithi057.stdout:0/589: dread - d0/d49/d6d/f74 zero size 2024-04-25T22:42:16.274 INFO:tasks.workunit.client.0.smithi057.stdout:6/626: dread d2/d19/d20/f3b [0,4194304] 0 2024-04-25T22:42:16.275 INFO:tasks.workunit.client.0.smithi057.stdout:3/572: symlink d0/d4/d96/lc3 0 2024-04-25T22:42:16.275 INFO:tasks.workunit.client.0.smithi057.stdout:8/569: dwrite d4/db/d12/f6e [0,4194304] 0 2024-04-25T22:42:16.277 INFO:tasks.workunit.client.0.smithi057.stdout:0/590: write d0/d3/d6/d14/d39/f56 [4779294,100645] 0 2024-04-25T22:42:16.277 INFO:tasks.workunit.client.0.smithi057.stdout:2/644: getdents d1f/d21/d26/d63/d7f 0 2024-04-25T22:42:16.277 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:16.277 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:42:16.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:42:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.678955164, 2024-04-25T22:42:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:42:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:42:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:42:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:42:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:42:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:42:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:42:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:42:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:42:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:42:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:42:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:42:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:42:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:42:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:42:16.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:42:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:42:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:42:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:42:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:42:16.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:42:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:42:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:42:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:42:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:42:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:16.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:42:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:42:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.678846851, 2024-04-25T22:42:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:42:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:16.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:42:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:42:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:42:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:42:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:42:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:42:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:42:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:42:16.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:42:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:42:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:42:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:42:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:42:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:42:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:42:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:42:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:42:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:42:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:16.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:42:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:42:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:42:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:42:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:42:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:42:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:16.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:42:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:42:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.678780195, 2024-04-25T22:42:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:42:16.290 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:42:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:42:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:42:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:42:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:42:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:42:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:42:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:42:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:42:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:42:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:42:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:42:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:42:16.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:42:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:42:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:42:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:42:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:42:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:42:16.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:42:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:42:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:42:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:42:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:42:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:42:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:42:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.295 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.67868959899999, 2024-04-25T22:42:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:42:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:42:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:42:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:42:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:42:16.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:42:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:42:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:42:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:42:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:42:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:42:16.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:42:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:42:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:42:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:42:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:42:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:42:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:42:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:42:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:42:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:42:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:42:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:42:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:42:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:42:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:42:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:42:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.67862502600001, 2024-04-25T22:42:16.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:42:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:42:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:42:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:42:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:42:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:16.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:42:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:42:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:42:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:42:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:42:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:16.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:42:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:42:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:42:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:42:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:42:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:42:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:42:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:42:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:42:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:42:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:42:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:42:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:42:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:42:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:42:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:42:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.678559603, 2024-04-25T22:42:16.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:42:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:42:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:42:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:42:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:42:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:42:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:42:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:42:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:42:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:42:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:42:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:42:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:42:16.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:42:16.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:16.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:42:16.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:42:16.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:16.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:42:16.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:42:16.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:16.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:42:16.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:42:16.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:16.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:42:16.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:42:16.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:16.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:42:16.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:42:16.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:16.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:42:16.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:42:16.313 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.313 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.313 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.313 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:16.313 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:16.313 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.678381308, 2024-04-25T22:42:16.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045433793, 2024-04-25T22:42:16.314 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:16.314 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:16.314 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:16.314 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:16.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:16.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:16.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:16.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596738+0000", 2024-04-25T22:42:16.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:16.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596739+0000", 2024-04-25T22:42:16.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8000000000000004e-07 2024-04-25T22:42:16.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:16.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596762+0000", 2024-04-25T22:42:16.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3173999999999999e-05 2024-04-25T22:42:16.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:16.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596803+0000", 2024-04-25T22:42:16.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0352000000000003e-05 2024-04-25T22:42:16.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596818+0000", 2024-04-25T22:42:16.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4960000000000001e-05 2024-04-25T22:42:16.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596915+0000", 2024-04-25T22:42:16.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7689000000000006e-05 2024-04-25T22:42:16.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:16.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596929+0000", 2024-04-25T22:42:16.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.384e-05 2024-04-25T22:42:16.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636478+0000", 2024-04-25T22:42:16.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039548291999999999 2024-04-25T22:42:16.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:16.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636671+0000", 2024-04-25T22:42:16.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019331200000000001 2024-04-25T22:42:16.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:16.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636859+0000", 2024-04-25T22:42:16.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000188128 2024-04-25T22:42:16.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:16.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640564+0000", 2024-04-25T22:42:16.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037051480000000001 2024-04-25T22:42:16.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:16.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642001+0000", 2024-04-25T22:42:16.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001436955 2024-04-25T22:42:16.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:16.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642070+0000", 2024-04-25T22:42:16.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8860000000000001e-05 2024-04-25T22:42:16.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:16.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642172+0000", 2024-04-25T22:42:16.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102203 2024-04-25T22:42:16.319 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.319 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.319 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.319 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:16.319 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:16.319 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.678279069, 2024-04-25T22:42:16.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:42:16.319 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:16.320 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:16.320 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:16.320 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:16.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:16.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:16.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:16.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:16.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:16.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:42:16.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:42:16.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:16.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:42:16.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:42:16.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:16.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:42:16.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:42:16.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:42:16.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:42:16.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:42:16.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:42:16.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:16.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:42:16.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:42:16.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:42:16.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:42:16.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:16.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:42:16.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:42:16.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:16.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:42:16.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:42:16.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:16.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:42:16.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:42:16.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:16.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:42:16.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:42:16.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:16.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:42:16.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:42:16.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:16.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:42:16.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:42:16.325 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.325 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.325 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.325 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:16.325 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:16.325 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 121.677897902, 2024-04-25T22:42:16.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.043216663000000002, 2024-04-25T22:42:16.325 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:16.325 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:16.325 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:16.325 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:16.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:16.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:16.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:16.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597222+0000", 2024-04-25T22:42:16.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:16.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597223+0000", 2024-04-25T22:42:16.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:16.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:16.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597243+0000", 2024-04-25T22:42:16.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.035e-05 2024-04-25T22:42:16.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:16.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597255+0000", 2024-04-25T22:42:16.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1707e-05 2024-04-25T22:42:16.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597266+0000", 2024-04-25T22:42:16.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1212999999999999e-05 2024-04-25T22:42:16.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597364+0000", 2024-04-25T22:42:16.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7388999999999999e-05 2024-04-25T22:42:16.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-25T22:42:16.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.597371+0000", 2024-04-25T22:42:16.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8369999999999999e-06 2024-04-25T22:42:16.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633147+0000", 2024-04-25T22:42:16.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035776603999999997 2024-04-25T22:42:16.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:16.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.633446+0000", 2024-04-25T22:42:16.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00029866799999999998 2024-04-25T22:42:16.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:16.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.634450+0000", 2024-04-25T22:42:16.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010042289999999999 2024-04-25T22:42:16.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:16.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639704+0000", 2024-04-25T22:42:16.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052542020000000004 2024-04-25T22:42:16.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:16.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640110+0000", 2024-04-25T22:42:16.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040552200000000001 2024-04-25T22:42:16.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:16.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640275+0000", 2024-04-25T22:42:16.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016539500000000001 2024-04-25T22:42:16.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:16.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640438+0000", 2024-04-25T22:42:16.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163167 2024-04-25T22:42:16.331 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.331 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.331 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.331 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10678 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:16.331 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:16.331 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.7869943299999997, 2024-04-25T22:42:16.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050477795999999998, 2024-04-25T22:42:16.331 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:16.331 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:16.331 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:16.331 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:16.331 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:16.331 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:16.332 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10678 2024-04-25T22:42:16.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.332 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:16.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:16.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:16.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:16.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:16.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:16.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488127+0000", 2024-04-25T22:42:16.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.716e-06 2024-04-25T22:42:16.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:16.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496392+0000", 2024-04-25T22:42:16.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082651500000000006 2024-04-25T22:42:16.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:16.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496428+0000", 2024-04-25T22:42:16.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5441999999999997e-05 2024-04-25T22:42:16.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496451+0000", 2024-04-25T22:42:16.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3529000000000001e-05 2024-04-25T22:42:16.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496601+0000", 2024-04-25T22:42:16.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014935600000000001 2024-04-25T22:42:16.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:16.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496856+0000", 2024-04-25T22:42:16.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025537900000000002 2024-04-25T22:42:16.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:16.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.497206+0000", 2024-04-25T22:42:16.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000350599 2024-04-25T22:42:16.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:16.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538231+0000", 2024-04-25T22:42:16.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041024146999999997 2024-04-25T22:42:16.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:16.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538298+0000", 2024-04-25T22:42:16.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7688000000000007e-05 2024-04-25T22:42:16.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:16.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538467+0000", 2024-04-25T22:42:16.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000168178 2024-04-25T22:42:16.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:16.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538603+0000", 2024-04-25T22:42:16.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013661200000000001 2024-04-25T22:42:16.336 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.336 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.336 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.336 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10692 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:16.336 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:16.336 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.770404536, 2024-04-25T22:42:16.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.061242408999999998, 2024-04-25T22:42:16.336 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:16.336 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:16.337 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:16.337 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:16.337 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:16.337 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:16.337 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10692 2024-04-25T22:42:16.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.337 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:16.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:16.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:16.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:16.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:16.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:16.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504717+0000", 2024-04-25T22:42:16.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6199999999999999e-06 2024-04-25T22:42:16.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:16.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511770+0000", 2024-04-25T22:42:16.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0070530929999999999 2024-04-25T22:42:16.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:16.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511810+0000", 2024-04-25T22:42:16.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0635e-05 2024-04-25T22:42:16.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511837+0000", 2024-04-25T22:42:16.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6423000000000001e-05 2024-04-25T22:42:16.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520096+0000", 2024-04-25T22:42:16.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082593730000000004 2024-04-25T22:42:16.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:16.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520345+0000", 2024-04-25T22:42:16.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024908800000000001 2024-04-25T22:42:16.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:16.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520794+0000", 2024-04-25T22:42:16.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000449023 2024-04-25T22:42:16.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:16.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538675+0000", 2024-04-25T22:42:16.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017880991999999998 2024-04-25T22:42:16.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:16.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565761+0000", 2024-04-25T22:42:16.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027085260999999999 2024-04-25T22:42:16.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:16.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565892+0000", 2024-04-25T22:42:16.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013152300000000001 2024-04-25T22:42:16.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:16.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565958+0000", 2024-04-25T22:42:16.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5377999999999996e-05 2024-04-25T22:42:16.342 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.342 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.342 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.342 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10693 4.2c 4:36971e45:::100000030bd.00000001:head [write 971225~86041] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:16.342 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:16.342 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.7632261740000001, 2024-04-25T22:42:16.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054529782999999998, 2024-04-25T22:42:16.343 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:16.343 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:16.343 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:16.343 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:16.343 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:16.343 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:16.343 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10693 2024-04-25T22:42:16.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.343 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:16.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:16.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:16.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:16.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:16.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:16.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511897+0000", 2024-04-25T22:42:16.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2499999999999998e-06 2024-04-25T22:42:16.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:16.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512094+0000", 2024-04-25T22:42:16.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019700100000000001 2024-04-25T22:42:16.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:16.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512121+0000", 2024-04-25T22:42:16.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7288999999999999e-05 2024-04-25T22:42:16.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512137+0000", 2024-04-25T22:42:16.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.592e-05 2024-04-25T22:42:16.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.533845+0000", 2024-04-25T22:42:16.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021707595999999999 2024-04-25T22:42:16.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:16.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534176+0000", 2024-04-25T22:42:16.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033187000000000001 2024-04-25T22:42:16.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:16.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534626+0000", 2024-04-25T22:42:16.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00045008599999999999 2024-04-25T22:42:16.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:16.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.539165+0000", 2024-04-25T22:42:16.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045386380000000002 2024-04-25T22:42:16.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:16.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566169+0000", 2024-04-25T22:42:16.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027004199 2024-04-25T22:42:16.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:16.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566317+0000", 2024-04-25T22:42:16.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014747999999999999 2024-04-25T22:42:16.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:16.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566423+0000", 2024-04-25T22:42:16.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010645399999999999 2024-04-25T22:42:16.347 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.347 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.347 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.347 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10696 4.2b 4:d56d2a96:::100000030c3.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:16.348 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:16.348 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.7615185289999999, 2024-04-25T22:42:16.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052282190999999999, 2024-04-25T22:42:16.348 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:16.348 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:16.348 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:16.348 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:16.348 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:16.348 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:16.348 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10696 2024-04-25T22:42:16.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.348 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:16.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:16.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:16.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:16.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:16.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:16.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513603+0000", 2024-04-25T22:42:16.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.283e-06 2024-04-25T22:42:16.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:16.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518647+0000", 2024-04-25T22:42:16.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050440859999999997 2024-04-25T22:42:16.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:16.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518672+0000", 2024-04-25T22:42:16.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4468e-05 2024-04-25T22:42:16.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518691+0000", 2024-04-25T22:42:16.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9213999999999999e-05 2024-04-25T22:42:16.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518806+0000", 2024-04-25T22:42:16.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115296 2024-04-25T22:42:16.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:16.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519011+0000", 2024-04-25T22:42:16.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020445700000000001 2024-04-25T22:42:16.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:16.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519207+0000", 2024-04-25T22:42:16.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000196431 2024-04-25T22:42:16.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:16.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531309+0000", 2024-04-25T22:42:16.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012101694 2024-04-25T22:42:16.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:16.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565622+0000", 2024-04-25T22:42:16.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034312976000000002 2024-04-25T22:42:16.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:16.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565769+0000", 2024-04-25T22:42:16.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014715900000000001 2024-04-25T22:42:16.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:16.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565883+0000", 2024-04-25T22:42:16.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000114127 2024-04-25T22:42:16.353 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.353 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.353 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.353 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10701 4.a 4:51b6a63a:::100000030f2.00000000:head [write 0~3014656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:16.353 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:16.353 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.750074519, 2024-04-25T22:42:16.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047414393999999999, 2024-04-25T22:42:16.353 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:16.353 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:16.353 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:16.353 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:16.354 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:16.354 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:16.354 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10701 2024-04-25T22:42:16.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.354 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:16.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:16.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:16.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:16.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:16.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:16.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525048+0000", 2024-04-25T22:42:16.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0819999999999999e-06 2024-04-25T22:42:16.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:16.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531709+0000", 2024-04-25T22:42:16.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066610929999999999 2024-04-25T22:42:16.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:16.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531751+0000", 2024-04-25T22:42:16.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1650000000000003e-05 2024-04-25T22:42:16.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531788+0000", 2024-04-25T22:42:16.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7305000000000003e-05 2024-04-25T22:42:16.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531943+0000", 2024-04-25T22:42:16.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015500600000000001 2024-04-25T22:42:16.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:16.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532086+0000", 2024-04-25T22:42:16.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014238599999999999 2024-04-25T22:42:16.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:16.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532295+0000", 2024-04-25T22:42:16.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020922000000000001 2024-04-25T22:42:16.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:16.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.545987+0000", 2024-04-25T22:42:16.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013692582999999999 2024-04-25T22:42:16.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:16.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572315+0000", 2024-04-25T22:42:16.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026327488 2024-04-25T22:42:16.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:16.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572381+0000", 2024-04-25T22:42:16.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5609000000000002e-05 2024-04-25T22:42:16.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:16.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572460+0000", 2024-04-25T22:42:16.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8972000000000002e-05 2024-04-25T22:42:16.358 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.358 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.358 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.358 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:10700 4.11 e63/57 4:88409fbf:::100000030ec.00000000:head v 63'193, mlcod=62'191)", 2024-04-25T22:42:16.358 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:16.359 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.7392450630000003, 2024-04-25T22:42:16.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050517667000000002, 2024-04-25T22:42:16.359 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:16.359 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:16.359 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:16.359 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:16.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:16.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:16.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:16.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:16.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:16.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535876+0000", 2024-04-25T22:42:16.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0300000000000001e-06 2024-04-25T22:42:16.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:16.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565275+0000", 2024-04-25T22:42:16.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029399033000000001 2024-04-25T22:42:16.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:16.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565358+0000", 2024-04-25T22:42:16.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3403000000000001e-05 2024-04-25T22:42:16.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565380+0000", 2024-04-25T22:42:16.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1761999999999999e-05 2024-04-25T22:42:16.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565505+0000", 2024-04-25T22:42:16.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000125153 2024-04-25T22:42:16.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:16.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565550+0000", 2024-04-25T22:42:16.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5479000000000003e-05 2024-04-25T22:42:16.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:16.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586328+0000", 2024-04-25T22:42:16.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020777982 2024-04-25T22:42:16.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:16.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586392+0000", 2024-04-25T22:42:16.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3825000000000006e-05 2024-04-25T22:42:16.362 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.362 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.362 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.363 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10712 4.3a 4:5ea9d1a5:::100000030c8.00000001:head [write 0~3670016 [2@2002048]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:16.363 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.552669+0000", 2024-04-25T22:42:16.363 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.7224502790000003, 2024-04-25T22:42:16.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042904635000000003, 2024-04-25T22:42:16.363 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:16.363 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:16.363 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:16.363 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:16.363 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:16.363 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:16.363 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10712 2024-04-25T22:42:16.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.364 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:16.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:16.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.552669+0000", 2024-04-25T22:42:16.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:16.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.552669+0000", 2024-04-25T22:42:16.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:16.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.552671+0000", 2024-04-25T22:42:16.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.24e-06 2024-04-25T22:42:16.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:16.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.559944+0000", 2024-04-25T22:42:16.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0072729819999999999 2024-04-25T22:42:16.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:16.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.559976+0000", 2024-04-25T22:42:16.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2598999999999997e-05 2024-04-25T22:42:16.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.559998+0000", 2024-04-25T22:42:16.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1350999999999999e-05 2024-04-25T22:42:16.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.560108+0000", 2024-04-25T22:42:16.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000110642 2024-04-25T22:42:16.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:16.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.560290+0000", 2024-04-25T22:42:16.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018165299999999999 2024-04-25T22:42:16.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:16.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.560549+0000", 2024-04-25T22:42:16.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025912999999999999 2024-04-25T22:42:16.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:16.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.573011+0000", 2024-04-25T22:42:16.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012461653 2024-04-25T22:42:16.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:16.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.595428+0000", 2024-04-25T22:42:16.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022417243999999999 2024-04-25T22:42:16.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:16.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.595481+0000", 2024-04-25T22:42:16.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3554999999999998e-05 2024-04-25T22:42:16.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:16.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.595574+0000", 2024-04-25T22:42:16.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2585999999999998e-05 2024-04-25T22:42:16.368 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.368 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.368 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.368 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12632 4.a 4:506aad5d:::1000000310f.00000000:head [write 0~4194304 [2@2043125]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:16.368 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:16.368 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.64018993700000004, 2024-04-25T22:42:16.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051574097999999999, 2024-04-25T22:42:16.368 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:16.368 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:16.368 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:16.368 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:16.369 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:16.369 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:16.369 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12632 2024-04-25T22:42:16.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.369 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:16.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:16.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:16.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:16.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:16.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:16.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634932+0000", 2024-04-25T22:42:16.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1600000000000001e-06 2024-04-25T22:42:16.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:16.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642614+0000", 2024-04-25T22:42:16.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076823000000000004 2024-04-25T22:42:16.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:16.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642660+0000", 2024-04-25T22:42:16.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6016000000000001e-05 2024-04-25T22:42:16.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642686+0000", 2024-04-25T22:42:16.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5491999999999999e-05 2024-04-25T22:42:16.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642870+0000", 2024-04-25T22:42:16.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000184045 2024-04-25T22:42:16.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:16.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643122+0000", 2024-04-25T22:42:16.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025242299999999999 2024-04-25T22:42:16.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:16.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643634+0000", 2024-04-25T22:42:16.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051145800000000001 2024-04-25T22:42:16.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:16.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.682287+0000", 2024-04-25T22:42:16.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038653342 2024-04-25T22:42:16.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:16.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686419+0000", 2024-04-25T22:42:16.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0041325169999999996 2024-04-25T22:42:16.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:16.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686464+0000", 2024-04-25T22:42:16.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4171000000000001e-05 2024-04-25T22:42:16.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:16.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686504+0000", 2024-04-25T22:42:16.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0173999999999999e-05 2024-04-25T22:42:16.373 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.373 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.373 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.373 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12691 4.39 4:9d0d8843:::100000030ef.00000000:head [write 0~4194304 [3@92787]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:16.374 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:16.374 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.54446884799999995, 2024-04-25T22:42:16.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045521998000000001, 2024-04-25T22:42:16.374 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:16.374 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:16.374 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:16.374 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:16.374 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:16.374 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:16.374 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12691 2024-04-25T22:42:16.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.374 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:16.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:16.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:16.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:16.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:16.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:16.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730653+0000", 2024-04-25T22:42:16.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1799999999999999e-06 2024-04-25T22:42:16.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:16.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738136+0000", 2024-04-25T22:42:16.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0074832789999999998 2024-04-25T22:42:16.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:16.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738169+0000", 2024-04-25T22:42:16.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3115999999999999e-05 2024-04-25T22:42:16.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738190+0000", 2024-04-25T22:42:16.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1060000000000002e-05 2024-04-25T22:42:16.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738264+0000", 2024-04-25T22:42:16.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3150000000000003e-05 2024-04-25T22:42:16.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:16.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738333+0000", 2024-04-25T22:42:16.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9314999999999996e-05 2024-04-25T22:42:16.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:16.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738425+0000", 2024-04-25T22:42:16.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2498999999999996e-05 2024-04-25T22:42:16.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:16.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.745181+0000", 2024-04-25T22:42:16.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067553240000000001 2024-04-25T22:42:16.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:16.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776101+0000", 2024-04-25T22:42:16.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.030920033 2024-04-25T22:42:16.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:16.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776140+0000", 2024-04-25T22:42:16.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9706999999999998e-05 2024-04-25T22:42:16.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:16.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776173+0000", 2024-04-25T22:42:16.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2335000000000001e-05 2024-04-25T22:42:16.379 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.380 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.380 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.380 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12813 4.18 4:1945bfc2:::10000003578.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:16.380 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:16.380 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.405945367, 2024-04-25T22:42:16.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054261216000000001, 2024-04-25T22:42:16.380 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:16.380 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:16.380 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:16.380 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:16.380 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:16.380 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:16.380 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12813 2024-04-25T22:42:16.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.381 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:16.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:16.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:16.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:16.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:16.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:16.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869175+0000", 2024-04-25T22:42:16.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3200000000000005e-07 2024-04-25T22:42:16.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:16.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872980+0000", 2024-04-25T22:42:16.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038049720000000002 2024-04-25T22:42:16.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:16.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872988+0000", 2024-04-25T22:42:16.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5429999999999994e-06 2024-04-25T22:42:16.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872993+0000", 2024-04-25T22:42:16.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8570000000000003e-06 2024-04-25T22:42:16.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873054+0000", 2024-04-25T22:42:16.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0801000000000003e-05 2024-04-25T22:42:16.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:16.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873140+0000", 2024-04-25T22:42:16.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6236999999999994e-05 2024-04-25T22:42:16.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:16.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873271+0000", 2024-04-25T22:42:16.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130541 2024-04-25T22:42:16.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:16.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.884240+0000", 2024-04-25T22:42:16.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010969527 2024-04-25T22:42:16.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:16.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923308+0000", 2024-04-25T22:42:16.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039067317999999997 2024-04-25T22:42:16.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:16.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923373+0000", 2024-04-25T22:42:16.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5055000000000006e-05 2024-04-25T22:42:16.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:16.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923436+0000", 2024-04-25T22:42:16.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2732999999999997e-05 2024-04-25T22:42:16.385 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.385 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.385 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.385 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13033 4.39 4:9d0d8843:::100000030ef.00000000:head [write 0~4194304 [3@92787]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:16.385 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.118983+0000", 2024-04-25T22:42:16.385 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.156136467, 2024-04-25T22:42:16.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044781091000000002, 2024-04-25T22:42:16.386 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:16.386 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:16.386 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:16.386 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:16.386 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:16.386 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:16.386 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13033 2024-04-25T22:42:16.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.386 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:16.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:16.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.118983+0000", 2024-04-25T22:42:16.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:16.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.118983+0000", 2024-04-25T22:42:16.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:16.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:16.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.118984+0000", 2024-04-25T22:42:16.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3200000000000005e-07 2024-04-25T22:42:16.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:16.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.123816+0000", 2024-04-25T22:42:16.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048320120000000001 2024-04-25T22:42:16.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:16.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.123830+0000", 2024-04-25T22:42:16.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4146e-05 2024-04-25T22:42:16.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.123837+0000", 2024-04-25T22:42:16.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1940000000000001e-06 2024-04-25T22:42:16.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:16.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.123898+0000", 2024-04-25T22:42:16.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1123000000000004e-05 2024-04-25T22:42:16.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:16.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.123969+0000", 2024-04-25T22:42:16.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1168999999999996e-05 2024-04-25T22:42:16.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:16.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.124099+0000", 2024-04-25T22:42:16.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012916800000000001 2024-04-25T22:42:16.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:16.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.138135+0000", 2024-04-25T22:42:16.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014036775 2024-04-25T22:42:16.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:16.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.163586+0000", 2024-04-25T22:42:16.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025450190000000001 2024-04-25T22:42:16.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:16.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.163643+0000", 2024-04-25T22:42:16.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7858000000000001e-05 2024-04-25T22:42:16.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:16.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:16.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:16.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.163764+0000", 2024-04-25T22:42:16.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012082399999999999 2024-04-25T22:42:16.391 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.391 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.391 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.391 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:16.391 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:16.391 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:16.394 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:16.394 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:16.388+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:16.397 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-04-25T22:42:16.414 INFO:tasks.workunit.client.0.smithi057.stdout:3/573: symlink d0/d4/d7b/d8f/lc4 0 2024-04-25T22:42:16.414 INFO:tasks.workunit.client.0.smithi057.stdout:8/570: read - d4/db/d72/dbd/fc9 zero size 2024-04-25T22:42:16.414 INFO:tasks.workunit.client.0.smithi057.stdout:6/627: fsync d2/d19/d50/d1a/d22/fc1 0 2024-04-25T22:42:16.414 INFO:tasks.workunit.client.0.smithi057.stdout:5/681: dwrite d2/d1c/d24/d8f/f95 [4194304,4194304] 0 2024-04-25T22:42:16.414 INFO:tasks.workunit.client.0.smithi057.stdout:9/578: read d3/d34/d42/d28/d62/d67/f71 [2290140,79060] 0 2024-04-25T22:42:16.414 INFO:tasks.workunit.client.0.smithi057.stdout:2/645: chown d1f/d21/d26/d63/d7f/lb7 108077 1 2024-04-25T22:42:16.414 INFO:tasks.workunit.client.0.smithi057.stdout:8/571: write d4/f32 [888965,48147] 0 2024-04-25T22:42:16.414 INFO:tasks.workunit.client.0.smithi057.stdout:1/596: dread d7/dd/d16/f36 [0,4194304] 0 2024-04-25T22:42:16.414 INFO:tasks.workunit.client.0.smithi057.stdout:8/572: readlink d4/d5/l11 0 2024-04-25T22:42:16.415 INFO:tasks.workunit.client.0.smithi057.stdout:1/597: write d7/dd/d16/d88/f8b [4430233,129225] 0 2024-04-25T22:42:16.415 INFO:tasks.workunit.client.0.smithi057.stdout:3/574: symlink d0/d4/d7/d46/d30/d99/lc5 0 2024-04-25T22:42:16.415 INFO:tasks.workunit.client.0.smithi057.stdout:8/573: rmdir d4/d5 39 2024-04-25T22:42:16.415 INFO:tasks.workunit.client.0.smithi057.stdout:5/682: symlink d2/d47/ldb 0 2024-04-25T22:42:16.415 INFO:tasks.workunit.client.0.smithi057.stdout:9/579: mkdir d3/d34/d42/d28/dc1 0 2024-04-25T22:42:16.415 INFO:tasks.workunit.client.0.smithi057.stdout:1/598: creat d7/d65/d6a/d98/d99/fc3 x:0 0 0 2024-04-25T22:42:16.415 INFO:tasks.workunit.client.0.smithi057.stdout:9/580: creat d3/d34/d42/d28/dc1/fc2 x:0 0 0 2024-04-25T22:42:16.415 INFO:tasks.workunit.client.0.smithi057.stdout:6/628: rename d2/d19/d50/c1f to d2/d59/cc8 0 2024-04-25T22:42:16.415 INFO:tasks.workunit.client.0.smithi057.stdout:9/581: write d3/d34/d42/d28/f6f [88646,39013] 0 2024-04-25T22:42:16.415 INFO:tasks.workunit.client.0.smithi057.stdout:5/683: getdents d2/d47/d87/dd2 0 2024-04-25T22:42:16.415 INFO:tasks.workunit.client.0.smithi057.stdout:1/599: mkdir d7/d65/d6a/d98/d41/d75/dc4 0 2024-04-25T22:42:16.415 INFO:tasks.workunit.client.0.smithi057.stdout:6/629: creat d2/d19/d50/d1a/d22/d31/fc9 x:0 0 0 2024-04-25T22:42:16.415 INFO:tasks.workunit.client.0.smithi057.stdout:5/684: unlink d2/d1c/d24/c34 0 2024-04-25T22:42:16.415 INFO:tasks.workunit.client.0.smithi057.stdout:8/574: truncate d4/d5/d17/d19/d35/d83/d92/da6/fbb 1787346 0 2024-04-25T22:42:16.415 INFO:tasks.workunit.client.0.smithi057.stdout:9/582: chown d3/d34/f6b 101706 1 2024-04-25T22:42:16.415 INFO:tasks.workunit.client.0.smithi057.stdout:1/600: unlink d7/dd/d16/d88/c8a 0 2024-04-25T22:42:16.416 INFO:tasks.workunit.client.0.smithi057.stdout:6/630: creat d2/d86/fca x:0 0 0 2024-04-25T22:42:16.416 INFO:tasks.workunit.client.0.smithi057.stdout:8/575: mknod d4/d5/dd2/cd5 0 2024-04-25T22:42:16.416 INFO:tasks.workunit.client.0.smithi057.stdout:0/591: write d0/d3/d6/f45 [557071,118033] 0 2024-04-25T22:42:16.416 INFO:tasks.workunit.client.0.smithi057.stdout:5/685: mknod d2/d47/d87/dd2/cdc 0 2024-04-25T22:42:16.416 INFO:tasks.workunit.client.0.smithi057.stdout:4/613: sync 2024-04-25T22:42:16.416 INFO:tasks.workunit.client.0.smithi057.stdout:1/601: unlink d7/d65/d6a/d98/d41/d45/c4a 0 2024-04-25T22:42:16.416 INFO:tasks.workunit.client.0.smithi057.stdout:9/583: link d3/d34/d42/l96 d3/d34/d42/d28/d39/dbd/lc3 0 2024-04-25T22:42:16.416 INFO:tasks.workunit.client.0.smithi057.stdout:3/575: dwrite d0/d4/d7/d46/d30/f9b [0,4194304] 0 2024-04-25T22:42:16.416 INFO:tasks.workunit.client.0.smithi057.stdout:5/686: chown d2/d1c/d24/d3d/d50/fd7 2059299712 1 2024-04-25T22:42:16.416 INFO:tasks.workunit.client.0.smithi057.stdout:6/631: truncate d2/d19/d50/d1a/d22/d31/f5f 165017 0 2024-04-25T22:42:16.416 INFO:tasks.workunit.client.0.smithi057.stdout:5/687: dread - d2/d1c/d46/d3a/d6a/fc6 zero size 2024-04-25T22:42:16.416 INFO:tasks.workunit.client.0.smithi057.stdout:7/577: dread d6/d28/d4e/d30/d60/d8d/d96/d59/f61 [0,4194304] 0 2024-04-25T22:42:16.416 INFO:tasks.workunit.client.0.smithi057.stdout:2/646: dwrite d1f/d4a/f3b [4194304,4194304] 0 2024-04-25T22:42:16.416 INFO:tasks.workunit.client.0.smithi057.stdout:6/632: fdatasync d2/d19/d50/d1a/d22/fc1 0 2024-04-25T22:42:16.416 INFO:tasks.workunit.client.0.smithi057.stdout:1/602: mkdir d7/d65/d6a/d98/dc5 0 2024-04-25T22:42:16.417 INFO:tasks.workunit.client.0.smithi057.stdout:2/647: chown d1f/d34/f90 954328 1 2024-04-25T22:42:16.417 INFO:tasks.workunit.client.0.smithi057.stdout:1/603: mknod d7/dd/d16/cc6 0 2024-04-25T22:42:16.417 INFO:tasks.workunit.client.0.smithi057.stdout:5/688: mkdir d2/d1c/d24/d3d/d77/dcd/ddd 0 2024-04-25T22:42:16.417 INFO:tasks.workunit.client.0.smithi057.stdout:6/633: creat d2/d19/d50/d1a/d22/d31/d83/fcb x:0 0 0 2024-04-25T22:42:16.417 INFO:tasks.workunit.client.0.smithi057.stdout:7/578: rename d6/d28/d4e/d30/d60/lb1 to d6/daa/lc7 0 2024-04-25T22:42:16.417 INFO:tasks.workunit.client.0.smithi057.stdout:6/634: fsync d2/d19/d85/f9a 0 2024-04-25T22:42:16.417 INFO:tasks.workunit.client.0.smithi057.stdout:2/648: rename d1f/d21/d26/d63/d7f/c8b to d1f/d21/d96/cdd 0 2024-04-25T22:42:16.417 INFO:tasks.workunit.client.0.smithi057.stdout:1/604: rename d7/d65/d6a/d98/d99 to d7/dd/d16/d24/d63/dc7 0 2024-04-25T22:42:16.417 INFO:tasks.workunit.client.0.smithi057.stdout:1/605: fsync d7/dd/d16/f36 0 2024-04-25T22:42:16.417 INFO:tasks.workunit.client.0.smithi057.stdout:7/579: creat d6/d28/d4e/d30/d60/d8d/d96/d51/fc8 x:0 0 0 2024-04-25T22:42:16.417 INFO:tasks.workunit.client.0.smithi057.stdout:1/606: symlink d7/dd/d90/lc8 0 2024-04-25T22:42:16.417 INFO:tasks.workunit.client.0.smithi057.stdout:7/580: symlink d6/lc9 0 2024-04-25T22:42:16.417 INFO:tasks.workunit.client.0.smithi057.stdout:7/581: write d6/d28/d4e/d30/d60/d6f/f94 [845470,113665] 0 2024-04-25T22:42:16.417 INFO:tasks.workunit.client.0.smithi057.stdout:2/649: dread d1f/d36/d54/fc5 [0,4194304] 0 2024-04-25T22:42:16.418 INFO:tasks.workunit.client.0.smithi057.stdout:9/584: dwrite d3/d34/fac [0,4194304] 0 2024-04-25T22:42:16.418 INFO:tasks.workunit.client.0.smithi057.stdout:7/582: symlink d6/d28/d4e/d30/d60/d6f/d9c/lca 0 2024-04-25T22:42:16.418 INFO:tasks.workunit.client.0.smithi057.stdout:6/635: write d2/d19/d26/d4f/f56 [5020181,45491] 0 2024-04-25T22:42:16.418 INFO:tasks.workunit.client.0.smithi057.stdout:7/583: fsync d6/d28/d4e/d30/d60/fbb 0 2024-04-25T22:42:16.418 INFO:tasks.workunit.client.0.smithi057.stdout:2/650: read - d1f/d36/fdb zero size 2024-04-25T22:42:16.418 INFO:tasks.workunit.client.0.smithi057.stdout:9/585: truncate d3/d34/d42/d28/d62/d67/f74 138975 0 2024-04-25T22:42:16.418 INFO:tasks.workunit.client.0.smithi057.stdout:2/651: fsync d1f/d21/d26/d63/fa4 0 2024-04-25T22:42:16.418 INFO:tasks.workunit.client.0.smithi057.stdout:7/584: mkdir d6/d28/d4e/d30/d46/d73/dcb 0 2024-04-25T22:42:16.418 INFO:tasks.workunit.client.0.smithi057.stdout:9/586: chown d3/d98/db0/lb5 374494993 1 2024-04-25T22:42:16.418 INFO:tasks.workunit.client.0.smithi057.stdout:1/607: dwrite d7/dd/d16/d24/f2e [0,4194304] 0 2024-04-25T22:42:16.418 INFO:tasks.workunit.client.0.smithi057.stdout:9/587: write d3/d34/d42/d28/d62/d67/d6e/f77 [276842,51435] 0 2024-04-25T22:42:16.418 INFO:tasks.workunit.client.0.smithi057.stdout:6/636: truncate d2/f1c 3690368 0 2024-04-25T22:42:16.418 INFO:tasks.workunit.client.0.smithi057.stdout:6/637: fdatasync d2/d19/d20/f6a 0 2024-04-25T22:42:16.418 INFO:tasks.workunit.client.0.smithi057.stdout:1/608: rmdir d7/d65/d6a/d98/d41 39 2024-04-25T22:42:16.419 INFO:tasks.workunit.client.0.smithi057.stdout:1/609: write d7/dd/d16/d18/f70 [1056335,94370] 0 2024-04-25T22:42:16.419 INFO:tasks.workunit.client.0.smithi057.stdout:2/652: dread d1f/d4a/d4d/d88/dd9/fc8 [0,4194304] 0 2024-04-25T22:42:16.419 INFO:tasks.workunit.client.0.smithi057.stdout:6/638: dread d2/d86/fa1 [0,4194304] 0 2024-04-25T22:42:16.419 INFO:tasks.workunit.client.0.smithi057.stdout:1/610: creat d7/d65/d6a/d98/d41/d6b/fc9 x:0 0 0 2024-04-25T22:42:16.419 INFO:tasks.workunit.client.0.smithi057.stdout:2/653: mknod d1f/d36/d54/dda/cde 0 2024-04-25T22:42:16.419 INFO:tasks.workunit.client.0.smithi057.stdout:6/639: creat d2/d19/fcc x:0 0 0 2024-04-25T22:42:16.419 INFO:tasks.workunit.client.0.smithi057.stdout:1/611: stat d7/f6f 0 2024-04-25T22:42:16.419 INFO:tasks.workunit.client.0.smithi057.stdout:1/612: dread - d7/dd/d16/d24/d63/dc7/db0/fb6 zero size 2024-04-25T22:42:16.419 INFO:tasks.workunit.client.0.smithi057.stdout:9/588: dwrite d3/d34/d42/d28/d2d/f40 [0,4194304] 0 2024-04-25T22:42:16.419 INFO:tasks.workunit.client.0.smithi057.stdout:1/613: rename d7/dd/d16/d18/d31/f79 to d7/dd/d16/d24/d63/fca 0 2024-04-25T22:42:16.419 INFO:tasks.workunit.client.0.smithi057.stdout:9/589: readlink d3/d34/d42/l8d 0 2024-04-25T22:42:16.419 INFO:tasks.workunit.client.0.smithi057.stdout:1/614: write d7/dd/d16/d24/f2e [2065553,67559] 0 2024-04-25T22:42:16.419 INFO:tasks.workunit.client.0.smithi057.stdout:9/590: chown d3/fa1 15244216 1 2024-04-25T22:42:16.419 INFO:tasks.workunit.client.0.smithi057.stdout:9/591: write d3/f24 [2913340,20968] 0 2024-04-25T22:42:16.419 INFO:tasks.workunit.client.0.smithi057.stdout:1/615: getdents d7/dd 0 2024-04-25T22:42:16.419 INFO:tasks.workunit.client.0.smithi057.stdout:2/654: dwrite d1f/d36/d54/f5f [0,4194304] 0 2024-04-25T22:42:16.420 INFO:tasks.workunit.client.0.smithi057.stdout:9/592: mknod d3/d34/d42/d28/d62/cc4 0 2024-04-25T22:42:16.420 INFO:tasks.workunit.client.0.smithi057.stdout:2/655: creat d1f/d21/d26/d63/d7f/d86/fdf x:0 0 0 2024-04-25T22:42:16.420 INFO:tasks.workunit.client.0.smithi057.stdout:9/593: mknod d3/d34/d42/d28/d65/cc5 0 2024-04-25T22:42:16.420 INFO:tasks.workunit.client.0.smithi057.stdout:9/594: symlink d3/d34/d42/d28/dc1/lc6 0 2024-04-25T22:42:16.420 INFO:tasks.workunit.client.0.smithi057.stdout:2/656: mknod d1f/d4a/d4d/d88/dd9/da1/ce0 0 2024-04-25T22:42:16.420 INFO:tasks.workunit.client.0.smithi057.stdout:9/595: fsync d3/d34/d42/d28/d2d/d7a/f87 0 2024-04-25T22:42:16.420 INFO:tasks.workunit.client.0.smithi057.stdout:8/576: dread d4/d5/d21/f4c [0,4194304] 0 2024-04-25T22:42:16.420 INFO:tasks.workunit.client.0.smithi057.stdout:2/657: chown d1f/d21/cd1 1143933 1 2024-04-25T22:42:16.420 INFO:tasks.workunit.client.0.smithi057.stdout:2/658: unlink d1f/d34/f90 0 2024-04-25T22:42:16.420 INFO:tasks.workunit.client.0.smithi057.stdout:8/577: symlink d4/d5/d17/ld6 0 2024-04-25T22:42:16.420 INFO:tasks.workunit.client.0.smithi057.stdout:7/585: dread d6/d28/f2c [4194304,4194304] 0 2024-04-25T22:42:16.420 INFO:tasks.workunit.client.0.smithi057.stdout:0/592: dread d0/d3/d4d/d87/d91/f94 [0,4194304] 0 2024-04-25T22:42:16.420 INFO:tasks.workunit.client.0.smithi057.stdout:2/659: rename d1f/d21/lab to d1f/d4a/db1/le1 0 2024-04-25T22:42:16.420 INFO:tasks.workunit.client.0.smithi057.stdout:7/586: creat d6/d28/d4e/d30/d60/d6f/d9c/dc4/fcc x:0 0 0 2024-04-25T22:42:16.420 INFO:tasks.workunit.client.0.smithi057.stdout:0/593: link d0/d5/d53/f61 d0/d5/fcf 0 2024-04-25T22:42:16.420 INFO:tasks.workunit.client.0.smithi057.stdout:7/587: write d6/f74 [160910,94112] 0 2024-04-25T22:42:16.421 INFO:tasks.workunit.client.0.smithi057.stdout:2/660: getdents d1f/d4a 0 2024-04-25T22:42:16.421 INFO:tasks.workunit.client.0.smithi057.stdout:7/588: chown d6/l13 222466990 1 2024-04-25T22:42:16.421 INFO:tasks.workunit.client.0.smithi057.stdout:8/578: dread d4/d5/d17/d19/d35/d83/d92/da6/fbb [0,4194304] 0 2024-04-25T22:42:16.421 INFO:tasks.workunit.client.0.smithi057.stdout:2/661: mknod d1f/d21/ce2 0 2024-04-25T22:42:16.421 INFO:tasks.workunit.client.0.smithi057.stdout:7/589: write d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/f80 [463238,12126] 0 2024-04-25T22:42:16.421 INFO:tasks.workunit.client.0.smithi057.stdout:8/579: creat d4/db/dd/d3a/d94/fd7 x:0 0 0 2024-04-25T22:42:16.421 INFO:tasks.workunit.client.0.smithi057.stdout:0/594: link d0/d3/d3a/f4f d0/d3/d3a/d3b/fd0 0 2024-04-25T22:42:16.421 INFO:tasks.workunit.client.0.smithi057.stdout:2/662: dread - d1f/d36/fdb zero size 2024-04-25T22:42:16.421 INFO:tasks.workunit.client.0.smithi057.stdout:7/590: chown d6/d28/d4e/d30/d60/d6f/f94 748153694 1 2024-04-25T22:42:16.421 INFO:tasks.workunit.client.0.smithi057.stdout:9/596: write d3/d34/d42/d28/f51 [1036205,99884] 0 2024-04-25T22:42:16.421 INFO:tasks.workunit.client.0.smithi057.stdout:2/663: unlink d1f/d36/fc4 0 2024-04-25T22:42:16.421 INFO:tasks.workunit.client.0.smithi057.stdout:0/595: rename d0/d3/d6/d78 to d0/d3/d6/d14/dd1 0 2024-04-25T22:42:16.421 INFO:tasks.workunit.client.0.smithi057.stdout:5/689: dread d2/d2c/f5d [0,4194304] 0 2024-04-25T22:42:16.421 INFO:tasks.workunit.client.0.smithi057.stdout:9/597: creat d3/d34/d42/d28/d39/d54/da5/fc7 x:0 0 0 2024-04-25T22:42:16.421 INFO:tasks.workunit.client.0.smithi057.stdout:2/664: rename d1f/d34/d50/l89 to d1f/d4a/d4d/d88/dd9/dd6/le3 0 2024-04-25T22:42:16.422 INFO:tasks.workunit.client.0.smithi057.stdout:0/596: chown d0/d3/d4d/d87/d91/f94 0 1 2024-04-25T22:42:16.422 INFO:tasks.workunit.client.0.smithi057.stdout:7/591: chown d6/d28/d4e/d30/d60/d8d/d96/d51/dad/da6/cac 15 1 2024-04-25T22:42:16.422 INFO:tasks.workunit.client.0.smithi057.stdout:6/640: dread d2/d19/d26/d63/f66 [0,4194304] 0 2024-04-25T22:42:16.422 INFO:tasks.workunit.client.0.smithi057.stdout:7/592: fdatasync d6/d28/d4e/f22 0 2024-04-25T22:42:16.422 INFO:tasks.workunit.client.0.smithi057.stdout:6/641: symlink d2/d19/d9b/lcd 0 2024-04-25T22:42:16.422 INFO:tasks.workunit.client.0.smithi057.stdout:6/642: dread - d2/d86/fac zero size 2024-04-25T22:42:16.422 INFO:tasks.workunit.client.0.smithi057.stdout:0/597: mknod d0/d3/d6/d29/dc8/cd2 0 2024-04-25T22:42:16.422 INFO:tasks.workunit.client.0.smithi057.stdout:8/580: dwrite d4/d5/d17/fce [0,4194304] 0 2024-04-25T22:42:16.422 INFO:tasks.workunit.client.0.smithi057.stdout:5/690: dwrite d2/d1c/d24/d3d/d77/fc8 [0,4194304] 0 2024-04-25T22:42:16.422 INFO:tasks.workunit.client.0.smithi057.stdout:8/581: write d4/d5/d2f/fb4 [1324430,3913] 0 2024-04-25T22:42:16.422 INFO:tasks.workunit.client.0.smithi057.stdout:0/598: link d0/c24 d0/d3/d4d/d87/d91/cd3 0 2024-04-25T22:42:16.422 INFO:tasks.workunit.client.0.smithi057.stdout:9/598: dwrite d3/d34/d42/d28/d62/d67/f74 [0,4194304] 0 2024-04-25T22:42:16.422 INFO:tasks.workunit.client.0.smithi057.stdout:7/593: dwrite d6/d28/f66 [0,4194304] 0 2024-04-25T22:42:16.422 INFO:tasks.workunit.client.0.smithi057.stdout:0/599: write d0/d3/d4d/d87/d91/f94 [3134390,38821] 0 2024-04-25T22:42:16.422 INFO:tasks.workunit.client.0.smithi057.stdout:9/599: write d3/f1f [1478340,20692] 0 2024-04-25T22:42:16.423 INFO:tasks.workunit.client.0.smithi057.stdout:0/600: chown d0/d3/d3a 25780 1 2024-04-25T22:42:16.423 INFO:tasks.workunit.client.0.smithi057.stdout:9/600: truncate d3/fa1 280456 0 2024-04-25T22:42:16.423 INFO:tasks.workunit.client.0.smithi057.stdout:0/601: chown d0/d3/d4d/f37 0 1 2024-04-25T22:42:16.423 INFO:tasks.workunit.client.0.smithi057.stdout:7/594: getdents d6/d28/d4e/d30/d60/d8d/d96/d59 0 2024-04-25T22:42:16.423 INFO:tasks.workunit.client.0.smithi057.stdout:9/601: fdatasync d3/d34/d42/d28/d2d/f40 0 2024-04-25T22:42:16.423 INFO:tasks.workunit.client.0.smithi057.stdout:7/595: rmdir d6/d91 39 2024-04-25T22:42:16.423 INFO:tasks.workunit.client.0.smithi057.stdout:9/602: chown d3/d34/d42/d28/d39/db3 3694 1 2024-04-25T22:42:16.423 INFO:tasks.workunit.client.0.smithi057.stdout:0/602: rename d0/d3/f68 to d0/d3/fd4 0 2024-04-25T22:42:16.423 INFO:tasks.workunit.client.0.smithi057.stdout:6/643: dwrite d2/d19/d20/f8e [0,4194304] 0 2024-04-25T22:42:16.423 INFO:tasks.workunit.client.0.smithi057.stdout:6/644: creat d2/d19/d26/fce x:0 0 0 2024-04-25T22:42:16.423 INFO:tasks.workunit.client.0.smithi057.stdout:6/645: chown d2/d19/cc4 49443 1 2024-04-25T22:42:16.423 INFO:tasks.workunit.client.0.smithi057.stdout:9/603: mkdir d3/d34/d42/d28/d2d/dc8 0 2024-04-25T22:42:16.423 INFO:tasks.workunit.client.0.smithi057.stdout:9/604: write d3/d34/d42/d28/d62/d67/d6e/fb6 [222971,87932] 0 2024-04-25T22:42:16.423 INFO:tasks.workunit.client.0.smithi057.stdout:9/605: creat d3/d34/d42/d28/d39/d54/fc9 x:0 0 0 2024-04-25T22:42:16.423 INFO:tasks.workunit.client.0.smithi057.stdout:6/646: dwrite d2/d19/d26/d63/f66 [0,4194304] 0 2024-04-25T22:42:16.424 INFO:tasks.workunit.client.0.smithi057.stdout:0/603: truncate d0/f9 3735486 0 2024-04-25T22:42:16.424 INFO:tasks.workunit.client.0.smithi057.stdout:0/604: link d0/d5/l1e d0/d5/ld5 0 2024-04-25T22:42:16.424 INFO:tasks.workunit.client.0.smithi057.stdout:9/606: dwrite d3/d34/d42/d28/dc1/fc2 [0,4194304] 0 2024-04-25T22:42:16.424 INFO:tasks.workunit.client.0.smithi057.stdout:0/605: fdatasync d0/d5/d53/f69 0 2024-04-25T22:42:16.424 INFO:tasks.workunit.client.0.smithi057.stdout:9/607: creat d3/d98/db0/fca x:0 0 0 2024-04-25T22:42:16.424 INFO:tasks.workunit.client.0.smithi057.stdout:0/606: creat d0/d3/d6/d29/dc8/fd6 x:0 0 0 2024-04-25T22:42:16.424 INFO:tasks.workunit.client.0.smithi057.stdout:6/647: dwrite d2/d86/f98 [0,4194304] 0 2024-04-25T22:42:16.424 INFO:tasks.workunit.client.0.smithi057.stdout:0/607: read d0/d3/d6/d29/f6c [3202240,4302] 0 2024-04-25T22:42:16.424 INFO:tasks.workunit.client.0.smithi057.stdout:9/608: readlink d3/d34/d42/d28/d2d/l8c 0 2024-04-25T22:42:16.424 INFO:tasks.workunit.client.0.smithi057.stdout:6/648: getdents d2/d19/d50/d1a/db0 0 2024-04-25T22:42:16.424 INFO:tasks.workunit.client.0.smithi057.stdout:0/608: symlink d0/d3/d3a/d3b/ld7 0 2024-04-25T22:42:16.424 INFO:tasks.workunit.client.0.smithi057.stdout:9/609: rename d3/f1f to d3/d34/d42/d28/d39/d54/fcb 0 2024-04-25T22:42:16.424 INFO:tasks.workunit.client.0.smithi057.stdout:0/609: read - d0/d3/d3a/d3b/fa9 zero size 2024-04-25T22:42:16.424 INFO:tasks.workunit.client.0.smithi057.stdout:9/610: dread - d3/f58 zero size 2024-04-25T22:42:16.424 INFO:tasks.workunit.client.0.smithi057.stdout:6/649: write d2/d19/d50/d1a/d22/d31/f3a [3585479,13267] 0 2024-04-25T22:42:16.424 INFO:tasks.workunit.client.0.smithi057.stdout:0/610: readlink d0/d3/d6/d14/d39/l4c 0 2024-04-25T22:42:16.425 INFO:tasks.workunit.client.0.smithi057.stdout:9/611: rmdir d3/d98 39 2024-04-25T22:42:16.425 INFO:tasks.workunit.client.0.smithi057.stdout:6/650: mkdir d2/d19/d50/d1a/d22/d31/d83/dba/dbe/dcf 0 2024-04-25T22:42:16.425 INFO:tasks.workunit.client.0.smithi057.stdout:9/612: truncate d3/d34/d42/d28/d62/d67/d6e/f77 1655207 0 2024-04-25T22:42:16.425 INFO:tasks.workunit.client.0.smithi057.stdout:6/651: read - d2/d19/d85/f9a zero size 2024-04-25T22:42:16.425 INFO:tasks.workunit.client.0.smithi057.stdout:6/652: creat d2/d19/d50/d1a/d22/d31/d83/dba/fd0 x:0 0 0 2024-04-25T22:42:16.425 INFO:tasks.workunit.client.0.smithi057.stdout:6/653: mknod d2/d19/d20/cd1 0 2024-04-25T22:42:16.425 INFO:tasks.workunit.client.0.smithi057.stdout:6/654: mknod d2/d19/d20/d61/cd2 0 2024-04-25T22:42:16.425 INFO:tasks.workunit.client.0.smithi057.stdout:0/611: dwrite d0/d3/dae/fb1 [0,4194304] 0 2024-04-25T22:42:16.425 INFO:tasks.workunit.client.0.smithi057.stdout:6/655: mknod d2/d19/d49/db4/cd3 0 2024-04-25T22:42:16.425 INFO:tasks.workunit.client.0.smithi057.stdout:6/656: creat d2/d59/fd4 x:0 0 0 2024-04-25T22:42:16.425 INFO:tasks.workunit.client.0.smithi057.stdout:0/612: symlink d0/d3/d6/d14/d39/ld8 0 2024-04-25T22:42:16.425 INFO:tasks.workunit.client.0.smithi057.stdout:6/657: dread - d2/d19/d26/d4f/f84 zero size 2024-04-25T22:42:16.425 INFO:tasks.workunit.client.0.smithi057.stdout:6/658: write d2/d59/fb1 [880251,96751] 0 2024-04-25T22:42:16.425 INFO:tasks.workunit.client.0.smithi057.stdout:6/659: mknod d2/d19/cd5 0 2024-04-25T22:42:16.425 INFO:tasks.workunit.client.0.smithi057.stdout:6/660: creat d2/fd6 x:0 0 0 2024-04-25T22:42:16.426 INFO:tasks.workunit.client.0.smithi057.stdout:6/661: chown d2/d59/cc8 108 1 2024-04-25T22:42:16.426 INFO:tasks.workunit.client.0.smithi057.stdout:6/662: dwrite d2/f40 [0,4194304] 0 2024-04-25T22:42:16.426 INFO:tasks.workunit.client.0.smithi057.stdout:6/663: truncate d2/d59/fb1 1207320 0 2024-04-25T22:42:16.426 INFO:tasks.workunit.client.0.smithi057.stdout:9/613: truncate d3/f4e 5548661 0 2024-04-25T22:42:16.426 INFO:tasks.workunit.client.0.smithi057.stdout:9/614: chown d3/d34/d42/d28/d39/cb7 4378666 1 2024-04-25T22:42:16.426 INFO:tasks.workunit.client.0.smithi057.stdout:2/665: dread d1f/d21/d33/f5a [0,4194304] 0 2024-04-25T22:42:16.426 INFO:tasks.workunit.client.0.smithi057.stdout:9/615: chown d3/d34/d42/d28/d2d/caf 1829085 1 2024-04-25T22:42:16.426 INFO:tasks.workunit.client.0.smithi057.stdout:2/666: fdatasync d1f/d34/f73 0 2024-04-25T22:42:16.426 INFO:tasks.workunit.client.0.smithi057.stdout:9/616: chown d3/d34/d42/d28/dc1 919314854 1 2024-04-25T22:42:16.426 INFO:tasks.workunit.client.0.smithi057.stdout:2/667: chown d1f/d36/d54/f5f 19152440 1 2024-04-25T22:42:16.426 INFO:tasks.workunit.client.0.smithi057.stdout:2/668: readlink d1f/d36/l69 0 2024-04-25T22:42:16.426 INFO:tasks.workunit.client.0.smithi057.stdout:6/664: dwrite d2/d19/d20/d61/f89 [4194304,4194304] 0 2024-04-25T22:42:16.426 INFO:tasks.workunit.client.0.smithi057.stdout:2/669: rmdir d1f/d21/d26 39 2024-04-25T22:42:16.426 INFO:tasks.workunit.client.0.smithi057.stdout:6/665: truncate d2/fd6 483788 0 2024-04-25T22:42:16.426 INFO:tasks.workunit.client.0.smithi057.stdout:9/617: link d3/d34/d42/l96 d3/lcc 0 2024-04-25T22:42:16.426 INFO:tasks.workunit.client.0.smithi057.stdout:6/666: fsync d2/d19/d26/f2d 0 2024-04-25T22:42:16.427 INFO:tasks.workunit.client.0.smithi057.stdout:7/596: dread d6/f15 [0,4194304] 0 2024-04-25T22:42:16.427 INFO:tasks.workunit.client.0.smithi057.stdout:0/613: dwrite d0/f30 [0,4194304] 0 2024-04-25T22:42:16.427 INFO:tasks.workunit.client.0.smithi057.stdout:0/614: dread - d0/d3/d6/d14/d39/fc7 zero size 2024-04-25T22:42:16.427 INFO:tasks.workunit.client.0.smithi057.stdout:2/670: creat d1f/d21/d26/d63/fe4 x:0 0 0 2024-04-25T22:42:16.427 INFO:tasks.workunit.client.0.smithi057.stdout:6/667: unlink d2/d19/d26/d4f/d95/fa9 0 2024-04-25T22:42:16.427 INFO:tasks.workunit.client.0.smithi057.stdout:3/576: sync 2024-04-25T22:42:16.427 INFO:tasks.workunit.client.0.smithi057.stdout:4/614: sync 2024-04-25T22:42:16.427 INFO:tasks.workunit.client.0.smithi057.stdout:2/671: rmdir d1f/d4a 39 2024-04-25T22:42:16.427 INFO:tasks.workunit.client.0.smithi057.stdout:0/615: truncate d0/d3/d6/f90 2136346 0 2024-04-25T22:42:16.427 INFO:tasks.workunit.client.0.smithi057.stdout:4/615: chown d14/d2f/d4c/d5b/l68 1489 1 2024-04-25T22:42:16.427 INFO:tasks.workunit.client.0.smithi057.stdout:4/616: write d14/f39 [1193991,22905] 0 2024-04-25T22:42:16.427 INFO:tasks.workunit.client.0.smithi057.stdout:0/616: fsync d0/d3/d4d/f81 0 2024-04-25T22:42:16.428 INFO:tasks.workunit.client.0.smithi057.stdout:2/672: unlink d1f/d21/d26/l43 0 2024-04-25T22:42:16.428 INFO:tasks.workunit.client.0.smithi057.stdout:0/617: creat d0/d3/d4d/fd9 x:0 0 0 2024-04-25T22:42:16.428 INFO:tasks.workunit.client.0.smithi057.stdout:4/617: creat d14/d2f/d86/fc6 x:0 0 0 2024-04-25T22:42:16.428 INFO:tasks.workunit.client.0.smithi057.stdout:2/673: chown d1f/d21/d26/d5c/la6 50519684 1 2024-04-25T22:42:16.428 INFO:tasks.workunit.client.0.smithi057.stdout:3/577: read d0/d4/d7/fb5 [15650,84837] 0 2024-04-25T22:42:16.428 INFO:tasks.workunit.client.0.smithi057.stdout:9/618: dwrite d3/f23 [0,4194304] 0 2024-04-25T22:42:16.428 INFO:tasks.workunit.client.0.smithi057.stdout:4/618: readlink l12 0 2024-04-25T22:42:16.428 INFO:tasks.workunit.client.0.smithi057.stdout:6/668: dread d2/d19/d20/f8e [0,4194304] 0 2024-04-25T22:42:16.428 INFO:tasks.workunit.client.0.smithi057.stdout:0/618: mkdir d0/d3/d6/d14/d39/dda 0 2024-04-25T22:42:16.428 INFO:tasks.workunit.client.0.smithi057.stdout:0/619: dread - d0/d5/d53/f9d zero size 2024-04-25T22:42:16.428 INFO:tasks.workunit.client.0.smithi057.stdout:5/691: dread d2/d1c/d24/d3d/d50/d83/f9f [0,4194304] 0 2024-04-25T22:42:16.428 INFO:tasks.workunit.client.0.smithi057.stdout:3/578: mknod d0/d4/d7/d26/d72/cc6 0 2024-04-25T22:42:16.428 INFO:tasks.workunit.client.0.smithi057.stdout:4/619: creat d14/d2f/d4c/d5b/db8/fc7 x:0 0 0 2024-04-25T22:42:16.428 INFO:tasks.workunit.client.0.smithi057.stdout:5/692: unlink d2/c6c 0 2024-04-25T22:42:16.428 INFO:tasks.workunit.client.0.smithi057.stdout:6/669: creat d2/d19/d49/d62/d79/fd7 x:0 0 0 2024-04-25T22:42:16.429 INFO:tasks.workunit.client.0.smithi057.stdout:0/620: creat d0/d3/fdb x:0 0 0 2024-04-25T22:42:16.429 INFO:tasks.workunit.client.0.smithi057.stdout:5/693: chown d2/c21 61000 1 2024-04-25T22:42:16.429 INFO:tasks.workunit.client.0.smithi057.stdout:6/670: write d2/d19/d49/d62/d79/fd7 [406167,51664] 0 2024-04-25T22:42:16.429 INFO:tasks.workunit.client.0.smithi057.stdout:0/621: chown d0/d3/d6/d83/fc3 7 1 2024-04-25T22:42:16.429 INFO:tasks.workunit.client.0.smithi057.stdout:4/620: rename d14/d47/d5e/f81 to d14/da9/db5/fc8 0 2024-04-25T22:42:16.429 INFO:tasks.workunit.client.0.smithi057.stdout:5/694: stat d2/d47/da5/la4 0 2024-04-25T22:42:16.429 INFO:tasks.workunit.client.0.smithi057.stdout:6/671: unlink d2/d19/d49/l65 0 2024-04-25T22:42:16.429 INFO:tasks.workunit.client.0.smithi057.stdout:8/582: dread d4/d5/d17/d19/d35/d83/d92/fa8 [0,4194304] 0 2024-04-25T22:42:16.429 INFO:tasks.workunit.client.0.smithi057.stdout:0/622: link d0/c21 d0/d3/d6/d14/cdc 0 2024-04-25T22:42:16.429 INFO:tasks.workunit.client.0.smithi057.stdout:6/672: write d2/d19/d50/d1a/d22/d31/d83/fcb [989834,95606] 0 2024-04-25T22:42:16.429 INFO:tasks.workunit.client.0.smithi057.stdout:6/673: chown d2/f4 810 1 2024-04-25T22:42:16.433 INFO:tasks.workunit.client.0.smithi057.stdout:8/583: write d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/dc8/f9b [1164945,126381] 0 2024-04-25T22:42:16.433 INFO:tasks.workunit.client.0.smithi057.stdout:2/674: dread d1f/d34/f77 [0,4194304] 0 2024-04-25T22:42:16.433 INFO:tasks.workunit.client.0.smithi057.stdout:6/674: getdents d2/d19/d50 0 2024-04-25T22:42:16.433 INFO:tasks.workunit.client.0.smithi057.stdout:2/675: chown d1f/d21/c98 2307711 1 2024-04-25T22:42:16.433 INFO:tasks.workunit.client.0.smithi057.stdout:6/675: readlink d2/d59/l5d 0 2024-04-25T22:42:16.433 INFO:tasks.workunit.client.0.smithi057.stdout:8/584: read d4/d5/d2f/fb4 [714190,68271] 0 2024-04-25T22:42:16.433 INFO:tasks.workunit.client.0.smithi057.stdout:2/676: creat d1f/d21/d33/daa/fe5 x:0 0 0 2024-04-25T22:42:16.433 INFO:tasks.workunit.client.0.smithi057.stdout:5/695: read d2/f10 [2883925,17291] 0 2024-04-25T22:42:16.433 INFO:tasks.workunit.client.0.smithi057.stdout:6/676: chown d2/d19/d26/d4f/l78 185463 1 2024-04-25T22:42:16.433 INFO:tasks.workunit.client.0.smithi057.stdout:4/621: dwrite d14/f16 [0,4194304] 0 2024-04-25T22:42:16.433 INFO:tasks.workunit.client.0.smithi057.stdout:2/677: creat d1f/d4a/d4d/d88/dd9/fe6 x:0 0 0 2024-04-25T22:42:16.433 INFO:tasks.workunit.client.0.smithi057.stdout:8/585: rename d4/d5/d17/d19/d35/d83/d92/d5b/c8d to d4/db/d72/dbd/cd8 0 2024-04-25T22:42:16.433 INFO:tasks.workunit.client.0.smithi057.stdout:2/678: fdatasync d1f/d21/d33/f6e 0 2024-04-25T22:42:16.434 INFO:tasks.workunit.client.0.smithi057.stdout:8/586: unlink d4/d5/d17/d19/c63 0 2024-04-25T22:42:16.434 INFO:tasks.workunit.client.0.smithi057.stdout:0/623: write d0/d3/d6/d14/f7a [500150,77583] 0 2024-04-25T22:42:16.434 INFO:tasks.workunit.client.0.smithi057.stdout:4/622: write d14/f23 [224007,118461] 0 2024-04-25T22:42:16.434 INFO:tasks.workunit.client.0.smithi057.stdout:2/679: truncate d1f/d34/f3d 1819548 0 2024-04-25T22:42:16.434 INFO:tasks.workunit.client.0.smithi057.stdout:8/587: mknod d4/d5/d17/d19/d35/d83/d92/d5b/cd9 0 2024-04-25T22:42:16.434 INFO:tasks.workunit.client.0.smithi057.stdout:0/624: link d0/d3/d6/d14/c57 d0/d5/d53/cdd 0 2024-04-25T22:42:16.434 INFO:tasks.workunit.client.0.smithi057.stdout:8/588: dread - d4/d5/d21/f88 zero size 2024-04-25T22:42:16.434 INFO:tasks.workunit.client.0.smithi057.stdout:2/680: rename d1f/d4a to d1f/de7 0 2024-04-25T22:42:16.434 INFO:tasks.workunit.client.0.smithi057.stdout:6/677: dwrite d2/d19/d49/fa4 [0,4194304] 0 2024-04-25T22:42:16.434 INFO:tasks.workunit.client.0.smithi057.stdout:5/696: dwrite d2/d6/f92 [0,4194304] 0 2024-04-25T22:42:16.434 INFO:tasks.workunit.client.0.smithi057.stdout:3/579: dread d0/f6 [0,4194304] 0 2024-04-25T22:42:16.434 INFO:tasks.workunit.client.0.smithi057.stdout:0/625: fsync d0/d3/d4d/d87/da0/faf 0 2024-04-25T22:42:16.434 INFO:tasks.workunit.client.0.smithi057.stdout:3/580: chown d0/d5b 1637985 1 2024-04-25T22:42:16.435 INFO:tasks.workunit.client.0.smithi057.stdout:8/589: creat d4/d5/dd2/fda x:0 0 0 2024-04-25T22:42:16.435 INFO:tasks.workunit.client.0.smithi057.stdout:8/590: dread - d4/db/fb9 zero size 2024-04-25T22:42:16.435 INFO:tasks.workunit.client.0.smithi057.stdout:8/591: write d4/db/dd/d3a/f3c [2048092,91193] 0 2024-04-25T22:42:16.435 INFO:tasks.workunit.client.0.smithi057.stdout:2/681: mknod d1f/d21/d26/d5c/ce8 0 2024-04-25T22:42:16.435 INFO:tasks.workunit.client.0.smithi057.stdout:6/678: unlink d2/d19/d49/d62/d79/fb2 0 2024-04-25T22:42:16.435 INFO:tasks.workunit.client.0.smithi057.stdout:3/581: symlink d0/d4/d7/dad/lc7 0 2024-04-25T22:42:16.435 INFO:tasks.workunit.client.0.smithi057.stdout:0/626: creat d0/d3/d4d/d87/da0/fde x:0 0 0 2024-04-25T22:42:16.435 INFO:tasks.workunit.client.0.smithi057.stdout:4/623: write d14/d47/d5e/f77 [1205051,20410] 0 2024-04-25T22:42:16.435 INFO:tasks.workunit.client.0.smithi057.stdout:2/682: stat d1f/d21/d33/c7e 0 2024-04-25T22:42:16.435 INFO:tasks.workunit.client.0.smithi057.stdout:0/627: stat d0/d3/d88/da3 0 2024-04-25T22:42:16.435 INFO:tasks.workunit.client.0.smithi057.stdout:6/679: symlink d2/d19/d50/d1a/d22/ld8 0 2024-04-25T22:42:16.435 INFO:tasks.workunit.client.0.smithi057.stdout:4/624: mknod d14/d2f/d86/dbf/cc9 0 2024-04-25T22:42:16.435 INFO:tasks.workunit.client.0.smithi057.stdout:2/683: write d1f/d36/d54/f7a [245761,30747] 0 2024-04-25T22:42:16.436 INFO:tasks.workunit.client.0.smithi057.stdout:6/680: symlink d2/d19/d26/d4f/d95/ld9 0 2024-04-25T22:42:16.436 INFO:tasks.workunit.client.0.smithi057.stdout:5/697: dwrite d2/d6/db/f17 [0,4194304] 0 2024-04-25T22:42:16.436 INFO:tasks.workunit.client.0.smithi057.stdout:8/592: dwrite d4/db/d12/f3e [0,4194304] 0 2024-04-25T22:42:16.438 INFO:tasks.workunit.client.0.smithi057.stdout:0/628: write d0/d3/d3a/d3b/fd0 [8464657,56333] 0 2024-04-25T22:42:16.438 INFO:tasks.workunit.client.0.smithi057.stdout:2/684: link d1f/d21/d26/d63/d7f/d86/lb2 d1f/le9 0 2024-04-25T22:42:16.438 INFO:tasks.workunit.client.0.smithi057.stdout:8/593: rename d4/db/d12/f6e to d4/db/d12/fdb 0 2024-04-25T22:42:16.439 INFO:tasks.workunit.client.0.smithi057.stdout:0/629: chown d0/d5/fcd 836085 1 2024-04-25T22:42:16.439 INFO:tasks.workunit.client.0.smithi057.stdout:2/685: chown d1f/d21/d33/f7c 7940058 1 2024-04-25T22:42:16.439 INFO:tasks.workunit.client.0.smithi057.stdout:6/681: unlink d2/d19/d26/d4f/f56 0 2024-04-25T22:42:16.440 INFO:tasks.workunit.client.0.smithi057.stdout:6/682: readlink d2/d19/d20/d61/lc3 0 2024-04-25T22:42:16.440 INFO:tasks.workunit.client.0.smithi057.stdout:0/630: truncate d0/d3/d88/da3/fbd 506988 0 2024-04-25T22:42:16.441 INFO:tasks.workunit.client.0.smithi057.stdout:2/686: mkdir d1f/dea 0 2024-04-25T22:42:16.442 INFO:tasks.workunit.client.0.smithi057.stdout:8/594: dread - d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/dc8/f90 zero size 2024-04-25T22:42:16.442 INFO:tasks.workunit.client.0.smithi057.stdout:0/631: rmdir d0/d3/d4d/d87/d91 39 2024-04-25T22:42:16.444 INFO:tasks.workunit.client.0.smithi057.stdout:6/683: chown d2/d19/d20/d61 2036442531 1 2024-04-25T22:42:16.444 INFO:tasks.workunit.client.0.smithi057.stdout:0/632: symlink d0/d3/d6/d14/d39/ldf 0 2024-04-25T22:42:16.444 INFO:tasks.workunit.client.0.smithi057.stdout:6/684: readlink d2/d19/d26/l77 0 2024-04-25T22:42:16.444 INFO:tasks.workunit.client.0.smithi057.stdout:0/633: creat d0/d3/d88/fe0 x:0 0 0 2024-04-25T22:42:16.444 INFO:tasks.workunit.client.0.smithi057.stdout:5/698: dwrite d2/d47/d87/dd2/fb1 [0,4194304] 0 2024-04-25T22:42:16.445 INFO:tasks.workunit.client.0.smithi057.stdout:5/699: rmdir d2/d1c 39 2024-04-25T22:42:16.445 INFO:tasks.workunit.client.0.smithi057.stdout:0/634: creat d0/fe1 x:0 0 0 2024-04-25T22:42:16.448 INFO:tasks.workunit.client.0.smithi057.stdout:5/700: rename d2/d1c/d24/f43 to d2/d1c/d24/d3d/da7/db2/fde 0 2024-04-25T22:42:16.448 INFO:tasks.workunit.client.0.smithi057.stdout:4/625: dread d14/da9/d44/fb9 [0,4194304] 0 2024-04-25T22:42:16.450 INFO:tasks.workunit.client.0.smithi057.stdout:5/701: fsync d2/d1c/d24/d3d/da7/fac 0 2024-04-25T22:42:16.450 INFO:tasks.workunit.client.0.smithi057.stdout:4/626: creat d14/d2f/d4c/d5b/fca x:0 0 0 2024-04-25T22:42:16.450 INFO:tasks.workunit.client.0.smithi057.stdout:8/595: dwrite d4/d5/d17/d19/f30 [0,4194304] 0 2024-04-25T22:42:16.451 INFO:tasks.workunit.client.0.smithi057.stdout:5/702: dread - d2/d1c/d46/f66 zero size 2024-04-25T22:42:16.451 INFO:tasks.workunit.client.0.smithi057.stdout:2/687: dwrite d1f/de7/d4d/d88/dd9/da1/fa9 [0,4194304] 0 2024-04-25T22:42:16.451 INFO:tasks.workunit.client.0.smithi057.stdout:4/627: rmdir d14/da9/db5 39 2024-04-25T22:42:16.451 INFO:tasks.workunit.client.0.smithi057.stdout:2/688: fdatasync f1b 0 2024-04-25T22:42:16.452 INFO:tasks.workunit.client.0.smithi057.stdout:4/628: symlink d14/d2f/d82/lcb 0 2024-04-25T22:42:16.453 INFO:tasks.workunit.client.0.smithi057.stdout:4/629: mkdir d14/d5a/d67/dcc 0 2024-04-25T22:42:16.453 INFO:tasks.workunit.client.0.smithi057.stdout:2/689: dread d1f/d34/f77 [0,4194304] 0 2024-04-25T22:42:16.455 INFO:tasks.workunit.client.0.smithi057.stdout:0/635: dread d0/d5/d53/f67 [0,4194304] 0 2024-04-25T22:42:16.456 INFO:tasks.workunit.client.0.smithi057.stdout:2/690: symlink d1f/d34/d50/leb 0 2024-04-25T22:42:16.456 INFO:tasks.workunit.client.0.smithi057.stdout:5/703: dread d2/d1c/d24/d3d/d77/fc8 [0,4194304] 0 2024-04-25T22:42:16.458 INFO:tasks.workunit.client.0.smithi057.stdout:2/691: dread - d1f/d21/fc2 zero size 2024-04-25T22:42:16.458 INFO:tasks.workunit.client.0.smithi057.stdout:0/636: creat d0/d3/d6/d14/d39/fe2 x:0 0 0 2024-04-25T22:42:16.458 INFO:tasks.workunit.client.0.smithi057.stdout:5/704: read d2/f10 [591828,57920] 0 2024-04-25T22:42:16.459 INFO:tasks.workunit.client.0.smithi057.stdout:2/692: rmdir d1f/d21/d26/d63/d7f 39 2024-04-25T22:42:16.459 INFO:tasks.workunit.client.0.smithi057.stdout:8/596: dwrite d4/db/d12/f3e [0,4194304] 0 2024-04-25T22:42:16.459 INFO:tasks.workunit.client.0.smithi057.stdout:5/705: write d2/d1c/d46/d3a/fc7 [324522,17482] 0 2024-04-25T22:42:16.460 INFO:tasks.workunit.client.0.smithi057.stdout:5/706: symlink d2/d2c/db7/ldf 0 2024-04-25T22:42:16.460 INFO:tasks.workunit.client.0.smithi057.stdout:8/597: read - d4/db/d72/f95 zero size 2024-04-25T22:42:16.462 INFO:tasks.workunit.client.0.smithi057.stdout:8/598: rmdir d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/dc8 39 2024-04-25T22:42:16.463 INFO:tasks.workunit.client.0.smithi057.stdout:8/599: creat d4/d5/dd2/fdc x:0 0 0 2024-04-25T22:42:16.464 INFO:tasks.workunit.client.0.smithi057.stdout:8/600: creat d4/d5/d17/fdd x:0 0 0 2024-04-25T22:42:16.466 INFO:tasks.workunit.client.0.smithi057.stdout:8/601: dread - d4/d5/d21/db0/fd4 zero size 2024-04-25T22:42:16.466 INFO:tasks.workunit.client.0.smithi057.stdout:2/693: dwrite d1f/f2a [0,4194304] 0 2024-04-25T22:42:16.467 INFO:tasks.workunit.client.0.smithi057.stdout:8/602: fsync d4/d5/d21/fb3 0 2024-04-25T22:42:16.467 INFO:tasks.workunit.client.0.smithi057.stdout:1/616: sync 2024-04-25T22:42:16.467 INFO:tasks.workunit.client.0.smithi057.stdout:2/694: mkdir d1f/d36/d54/dec 0 2024-04-25T22:42:16.469 INFO:tasks.workunit.client.0.smithi057.stdout:3/582: dread d0/d11/f1e [0,4194304] 0 2024-04-25T22:42:16.470 INFO:tasks.workunit.client.0.smithi057.stdout:4/630: dwrite d14/d2f/f54 [4194304,4194304] 0 2024-04-25T22:42:16.470 INFO:tasks.workunit.client.0.smithi057.stdout:2/695: truncate d1f/d21/f45 1001732 0 2024-04-25T22:42:16.470 INFO:tasks.workunit.client.0.smithi057.stdout:1/617: mknod d7/d65/d6a/d98/d41/ccb 0 2024-04-25T22:42:16.470 INFO:tasks.workunit.client.0.smithi057.stdout:3/583: chown d0/l38 3892103 1 2024-04-25T22:42:16.470 INFO:tasks.workunit.client.0.smithi057.stdout:2/696: fdatasync fe 0 2024-04-25T22:42:16.470 INFO:tasks.workunit.client.0.smithi057.stdout:4/631: rmdir d14 39 2024-04-25T22:42:16.471 INFO:tasks.workunit.client.0.smithi057.stdout:2/697: readlink d1f/d21/l24 0 2024-04-25T22:42:16.471 INFO:tasks.workunit.client.0.smithi057.stdout:4/632: readlink d14/d47/l74 0 2024-04-25T22:42:16.472 INFO:tasks.workunit.client.0.smithi057.stdout:4/633: chown d14/d2f/d4c/d5b/dc3 184 1 2024-04-25T22:42:16.472 INFO:tasks.workunit.client.0.smithi057.stdout:4/634: unlink d14/c24 0 2024-04-25T22:42:16.473 INFO:tasks.workunit.client.0.smithi057.stdout:2/698: rename d1f/d34/d50/fba to d1f/d21/d33/daa/fed 0 2024-04-25T22:42:16.473 INFO:tasks.workunit.client.0.smithi057.stdout:4/635: symlink d14/d2f/d4c/lcd 0 2024-04-25T22:42:16.475 INFO:tasks.workunit.client.0.smithi057.stdout:5/707: dread d2/d47/d94/f9c [0,4194304] 0 2024-04-25T22:42:16.475 INFO:tasks.workunit.client.0.smithi057.stdout:2/699: creat d1f/d36/d54/dda/fee x:0 0 0 2024-04-25T22:42:16.475 INFO:tasks.workunit.client.0.smithi057.stdout:4/636: chown d14/da9/d44/f78 18661 1 2024-04-25T22:42:16.476 INFO:tasks.workunit.client.0.smithi057.stdout:2/700: read - d1f/d34/d50/fd3 zero size 2024-04-25T22:42:16.476 INFO:tasks.workunit.client.0.smithi057.stdout:5/708: unlink d2/d6/fa 0 2024-04-25T22:42:16.476 INFO:tasks.workunit.client.0.smithi057.stdout:8/603: dwrite d4/d5/d17/d19/d35/d83/d92/fa8 [0,4194304] 0 2024-04-25T22:42:16.478 INFO:tasks.workunit.client.0.smithi057.stdout:1/618: dwrite d7/d65/d6a/d98/d41/d6b/f7b [0,4194304] 0 2024-04-25T22:42:16.478 INFO:tasks.workunit.client.0.smithi057.stdout:2/701: creat d1f/d21/d96/fef x:0 0 0 2024-04-25T22:42:16.479 INFO:tasks.workunit.client.0.smithi057.stdout:5/709: truncate d2/d6/f64 213172 0 2024-04-25T22:42:16.480 INFO:tasks.workunit.client.0.smithi057.stdout:5/710: dread - d2/d1c/d24/f86 zero size 2024-04-25T22:42:16.480 INFO:tasks.workunit.client.0.smithi057.stdout:2/702: mkdir d1f/d34/d50/df0 0 2024-04-25T22:42:16.480 INFO:tasks.workunit.client.0.smithi057.stdout:1/619: dread - d7/d65/d6a/d98/d41/d45/f94 zero size 2024-04-25T22:42:16.481 INFO:tasks.workunit.client.0.smithi057.stdout:8/604: creat d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/fde x:0 0 0 2024-04-25T22:42:16.482 INFO:tasks.workunit.client.0.smithi057.stdout:2/703: link d1f/d21/d26/d63/d7f/d86/fdf d1f/d34/ff1 0 2024-04-25T22:42:16.484 INFO:tasks.workunit.client.0.smithi057.stdout:4/637: dwrite d14/d47/d5e/d5f/fc5 [0,4194304] 0 2024-04-25T22:42:16.484 INFO:tasks.workunit.client.0.smithi057.stdout:2/704: creat d1f/d21/d26/d63/ff2 x:0 0 0 2024-04-25T22:42:16.485 INFO:tasks.workunit.client.0.smithi057.stdout:4/638: unlink d14/d47/d5e/d5f/l84 0 2024-04-25T22:42:16.485 INFO:tasks.workunit.client.0.smithi057.stdout:4/639: stat d14/d2f/d82/lba 0 2024-04-25T22:42:16.486 INFO:tasks.workunit.client.0.smithi057.stdout:2/705: mkdir d1f/d34/d50/df0/df3 0 2024-04-25T22:42:16.488 INFO:tasks.workunit.client.0.smithi057.stdout:2/706: creat d1f/d34/d50/df0/ff4 x:0 0 0 2024-04-25T22:42:16.488 INFO:tasks.workunit.client.0.smithi057.stdout:4/640: write d14/d2f/d86/dbf/d85/fb6 [290315,14315] 0 2024-04-25T22:42:16.490 INFO:tasks.workunit.client.0.smithi057.stdout:6/685: sync 2024-04-25T22:42:16.490 INFO:tasks.workunit.client.0.smithi057.stdout:7/597: sync 2024-04-25T22:42:16.490 INFO:tasks.workunit.client.0.smithi057.stdout:9/619: sync 2024-04-25T22:42:16.490 INFO:tasks.workunit.client.0.smithi057.stdout:4/641: chown d14/d47/d62/l9b 129 1 2024-04-25T22:42:16.491 INFO:tasks.workunit.client.0.smithi057.stdout:9/620: stat d3/d34/d42/d28/d2d/l3c 0 2024-04-25T22:42:16.491 INFO:tasks.workunit.client.0.smithi057.stdout:8/605: dwrite d4/d5/d21/db0/f62 [0,4194304] 0 2024-04-25T22:42:16.491 INFO:tasks.workunit.client.0.smithi057.stdout:7/598: chown d6/d28/d4e/d30/f43 125 1 2024-04-25T22:42:16.491 INFO:tasks.workunit.client.0.smithi057.stdout:4/642: rmdir d14/d3d/d89 0 2024-04-25T22:42:16.491 INFO:tasks.workunit.client.0.smithi057.stdout:6/686: read d2/d19/d26/d63/f66 [349892,41732] 0 2024-04-25T22:42:16.492 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~41s 2024-04-25T22:42:16.493 INFO:tasks.workunit.client.0.smithi057.stdout:6/687: write d2/d19/d26/fc6 [349263,66847] 0 2024-04-25T22:42:16.493 INFO:tasks.workunit.client.0.smithi057.stdout:7/599: write d6/f16 [2054029,4563] 0 2024-04-25T22:42:16.493 INFO:tasks.workunit.client.0.smithi057.stdout:8/606: rename d4/db/d12/f1c to d4/d5/d17/d19/fdf 0 2024-04-25T22:42:16.494 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:16.492+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:16.494 INFO:tasks.workunit.client.0.smithi057.stdout:6/688: mkdir d2/d19/d50/d1a/d22/d5e/dda 0 2024-04-25T22:42:16.494 INFO:tasks.workunit.client.0.smithi057.stdout:8/607: chown d4/d5/d17/d19 42753374 1 2024-04-25T22:42:16.495 INFO:tasks.workunit.client.0.smithi057.stdout:9/621: getdents d3/d34/d42/d28/d62/d67/d6e 0 2024-04-25T22:42:16.495 INFO:tasks.workunit.client.0.smithi057.stdout:6/689: chown d2/d19/d50/l35 1015247729 1 2024-04-25T22:42:16.496 INFO:tasks.workunit.client.0.smithi057.stdout:9/622: creat d3/d34/d42/d28/d62/d67/d6e/d7c/fcd x:0 0 0 2024-04-25T22:42:16.496 INFO:tasks.workunit.client.0.smithi057.stdout:7/600: getdents d6/d28/d4e/d30/d60/d8d/d96/d5d 0 2024-04-25T22:42:16.498 INFO:tasks.workunit.client.0.smithi057.stdout:7/601: chown d6/d28/d4e/d30/d60/d8d/d96/c8b 285510525 1 2024-04-25T22:42:16.498 INFO:tasks.workunit.client.0.smithi057.stdout:4/643: dwrite d14/d47/f59 [0,4194304] 0 2024-04-25T22:42:16.498 INFO:teuthology.orchestra.console.smithi148:Power on completed 2024-04-25T22:42:16.499 INFO:tasks.workunit.client.0.smithi057.stdout:8/608: dread d4/d5/d17/d19/f57 [0,4194304] 0 2024-04-25T22:42:16.500 INFO:tasks.workunit.client.0.smithi057.stdout:1/620: dread d7/f92 [0,4194304] 0 2024-04-25T22:42:16.500 INFO:tasks.workunit.client.0.smithi057.stdout:1/621: fdatasync d7/f6c 0 2024-04-25T22:42:16.501 INFO:tasks.workunit.client.0.smithi057.stdout:8/609: truncate d4/d5/d17/d19/fa1 1033570 0 2024-04-25T22:42:16.502 INFO:tasks.workunit.client.0.smithi057.stdout:8/610: dread - d4/d5/d17/fdd zero size 2024-04-25T22:42:16.503 INFO:tasks.workunit.client.0.smithi057.stdout:1/622: symlink d7/dd/d16/d24/d63/dc7/db0/lcc 0 2024-04-25T22:42:16.503 INFO:tasks.workunit.client.0.smithi057.stdout:9/623: dwrite d3/d34/d42/fa6 [4194304,4194304] 0 2024-04-25T22:42:16.504 INFO:tasks.workunit.client.0.smithi057.stdout:4/644: dwrite d14/d5a/fbb [0,4194304] 0 2024-04-25T22:42:16.505 INFO:tasks.workunit.client.0.smithi057.stdout:1/623: creat d7/dd/d26/d9a/fcd x:0 0 0 2024-04-25T22:42:16.505 INFO:tasks.workunit.client.0.smithi057.stdout:4/645: write d14/d2f/f7b [1273109,62786] 0 2024-04-25T22:42:16.506 INFO:tasks.workunit.client.0.smithi057.stdout:2/707: read d1f/d21/d26/d63/d7f/fae [900560,34493] 0 2024-04-25T22:42:16.506 INFO:tasks.workunit.client.0.smithi057.stdout:8/611: rename d4/d5/d17/d19/d35/d83/d92/da6/fbc to d4/db/dd/d3a/d5c/d76/fe0 0 2024-04-25T22:42:16.507 INFO:tasks.workunit.client.0.smithi057.stdout:4/646: rmdir d14/d2f/d86/dbf/d85 39 2024-04-25T22:42:16.507 INFO:tasks.workunit.client.0.smithi057.stdout:1/624: rename d7/d65/d6a/d98/d41/l74 to d7/d65/d6a/d98/d41/d45/lce 0 2024-04-25T22:42:16.507 INFO:tasks.workunit.client.0.smithi057.stdout:2/708: creat d1f/d21/d26/d63/d7f/ff5 x:0 0 0 2024-04-25T22:42:16.509 INFO:tasks.workunit.client.0.smithi057.stdout:8/612: write d4/db/d12/f3e [4539604,25330] 0 2024-04-25T22:42:16.509 INFO:tasks.workunit.client.0.smithi057.stdout:4/647: mkdir d14/d5a/d67/dcc/dce 0 2024-04-25T22:42:16.509 INFO:tasks.workunit.client.0.smithi057.stdout:7/602: truncate d6/f15 3225773 0 2024-04-25T22:42:16.510 INFO:tasks.workunit.client.0.smithi057.stdout:4/648: write d14/d2f/d4c/d5b/daa/fb0 [2529184,33255] 0 2024-04-25T22:42:16.510 INFO:tasks.workunit.client.0.smithi057.stdout:2/709: rmdir d1f/de7/d4d/d88/dd9/dd6 39 2024-04-25T22:42:16.510 INFO:tasks.workunit.client.0.smithi057.stdout:8/613: mknod d4/db/d12/ce1 0 2024-04-25T22:42:16.511 INFO:tasks.workunit.client.0.smithi057.stdout:7/603: symlink d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/lcd 0 2024-04-25T22:42:16.511 INFO:tasks.workunit.client.0.smithi057.stdout:1/625: rename d7/dd/d16/d88/fac to d7/dd/d16/d18/d31/d8f/fcf 0 2024-04-25T22:42:16.512 INFO:tasks.workunit.client.0.smithi057.stdout:9/624: dwrite d3/f66 [0,4194304] 0 2024-04-25T22:42:16.512 INFO:tasks.workunit.client.0.smithi057.stdout:2/710: mkdir d1f/d21/df6 0 2024-04-25T22:42:16.513 INFO:tasks.workunit.client.0.smithi057.stdout:8/614: write d4/db/dd/d3a/fa4 [1021258,19842] 0 2024-04-25T22:42:16.514 INFO:tasks.workunit.client.0.smithi057.stdout:7/604: getdents d6/d28 0 2024-04-25T22:42:16.514 INFO:tasks.workunit.client.0.smithi057.stdout:6/690: sync 2024-04-25T22:42:16.515 INFO:tasks.workunit.client.0.smithi057.stdout:1/626: creat d7/dd/d16/d24/fd0 x:0 0 0 2024-04-25T22:42:16.515 INFO:tasks.workunit.client.0.smithi057.stdout:9/625: rmdir d3/d34/d42/d28/d39/d54/da5 39 2024-04-25T22:42:16.516 INFO:tasks.workunit.client.0.smithi057.stdout:2/711: getdents d1f/d21/d33/daa 0 2024-04-25T22:42:16.516 INFO:tasks.workunit.client.0.smithi057.stdout:7/605: write d6/d28/d4e/d30/d60/d8d/d96/f2a [5352601,60728] 0 2024-04-25T22:42:16.516 INFO:tasks.workunit.client.0.smithi057.stdout:6/691: symlink d2/d19/d20/d9e/ldb 0 2024-04-25T22:42:16.516 INFO:tasks.workunit.client.0.smithi057.stdout:1/627: creat d7/d65/d6a/fd1 x:0 0 0 2024-04-25T22:42:16.517 INFO:tasks.workunit.client.0.smithi057.stdout:0/637: dread d0/d3/d6/d29/f99 [0,4194304] 0 2024-04-25T22:42:16.517 INFO:tasks.workunit.client.0.smithi057.stdout:9/626: write d3/d34/d42/d28/d62/d67/fbc [347760,100661] 0 2024-04-25T22:42:16.518 INFO:tasks.workunit.client.0.smithi057.stdout:1/628: rmdir d7/dd/d26 39 2024-04-25T22:42:16.519 INFO:tasks.workunit.client.0.smithi057.stdout:0/638: chown d0/d3/d6/lc6 675 1 2024-04-25T22:42:16.520 INFO:tasks.workunit.client.0.smithi057.stdout:0/639: fsync d0/d49/d97/faa 0 2024-04-25T22:42:16.521 INFO:tasks.workunit.client.0.smithi057.stdout:7/606: link d6/f54 d6/d28/d4e/d30/d60/d8d/d96/fce 0 2024-04-25T22:42:16.522 INFO:tasks.workunit.client.0.smithi057.stdout:5/711: dread d2/d6/f62 [0,4194304] 0 2024-04-25T22:42:16.522 INFO:tasks.workunit.client.0.smithi057.stdout:1/629: rename d7/dd/d90/fba to d7/dd/d16/d24/d61/fd2 0 2024-04-25T22:42:16.523 INFO:tasks.workunit.client.0.smithi057.stdout:0/640: creat d0/d3/d6/fe3 x:0 0 0 2024-04-25T22:42:16.524 INFO:tasks.workunit.client.0.smithi057.stdout:5/712: fdatasync d2/f31 0 2024-04-25T22:42:16.524 INFO:tasks.workunit.client.0.smithi057.stdout:6/692: dwrite d2/d19/f1e [0,4194304] 0 2024-04-25T22:42:16.525 INFO:tasks.workunit.client.0.smithi057.stdout:6/693: stat d2/d19/d20/f6a 0 2024-04-25T22:42:16.526 INFO:tasks.workunit.client.0.smithi057.stdout:2/712: dwrite d1f/de7/d4d/d88/fcc [0,4194304] 0 2024-04-25T22:42:16.527 INFO:tasks.workunit.client.0.smithi057.stdout:0/641: fsync d0/d3/d6/f59 0 2024-04-25T22:42:16.527 INFO:tasks.workunit.client.0.smithi057.stdout:7/607: fsync d6/d28/d4e/d30/d60/d8d/d96/d59/f61 0 2024-04-25T22:42:16.527 INFO:tasks.workunit.client.0.smithi057.stdout:5/713: mknod d2/d1c/d24/d3d/d50/ce0 0 2024-04-25T22:42:16.527 INFO:tasks.workunit.client.0.smithi057.stdout:6/694: readlink d2/d59/l5d 0 2024-04-25T22:42:16.528 INFO:tasks.workunit.client.0.smithi057.stdout:5/714: chown d2/d6 152 1 2024-04-25T22:42:16.528 INFO:tasks.workunit.client.0.smithi057.stdout:4/649: dwrite d14/d2f/d4c/d5b/f8f [0,4194304] 0 2024-04-25T22:42:16.529 INFO:tasks.workunit.client.0.smithi057.stdout:5/715: chown d2/d1c/f48 5990535 1 2024-04-25T22:42:16.530 INFO:tasks.workunit.client.0.smithi057.stdout:0/642: getdents d0/d3/d4d 0 2024-04-25T22:42:16.530 INFO:tasks.workunit.client.0.smithi057.stdout:6/695: rename d2/d19/d26/d4f/l78 to d2/ldc 0 2024-04-25T22:42:16.530 INFO:tasks.workunit.client.0.smithi057.stdout:5/716: fsync d2/d2c/f36 0 2024-04-25T22:42:16.531 INFO:tasks.workunit.client.0.smithi057.stdout:1/630: dwrite d7/fb4 [0,4194304] 0 2024-04-25T22:42:16.532 INFO:tasks.workunit.client.0.smithi057.stdout:0/643: mknod d0/d49/d6d/ce4 0 2024-04-25T22:42:16.532 INFO:tasks.workunit.client.0.smithi057.stdout:6/696: stat d2/d19/d50/d1a/d22/d31/f5f 0 2024-04-25T22:42:16.532 INFO:tasks.workunit.client.0.smithi057.stdout:5/717: chown d2/d1c/d46/d3a/d6a/faf 258774689 1 2024-04-25T22:42:16.532 INFO:tasks.workunit.client.0.smithi057.stdout:5/718: sync 2024-04-25T22:42:16.532 INFO:tasks.workunit.client.0.smithi057.stdout:2/713: link d1f/de7/f9b d1f/d21/d26/d63/ff7 0 2024-04-25T22:42:16.534 INFO:tasks.workunit.client.0.smithi057.stdout:0/644: mkdir d0/de5 0 2024-04-25T22:42:16.535 INFO:tasks.workunit.client.0.smithi057.stdout:2/714: rename d1f/d21/d96/cb8 to d1f/de7/cf8 0 2024-04-25T22:42:16.536 INFO:tasks.workunit.client.0.smithi057.stdout:5/719: creat d2/d6/fe1 x:0 0 0 2024-04-25T22:42:16.536 INFO:tasks.workunit.client.0.smithi057.stdout:2/715: readlink d1f/d21/l23 0 2024-04-25T22:42:16.536 INFO:tasks.workunit.client.0.smithi057.stdout:0/645: truncate d0/d5/fcf 4246705 0 2024-04-25T22:42:16.537 INFO:tasks.workunit.client.0.smithi057.stdout:6/697: rename d2/d86/c9d to d2/d19/d50/d1a/d22/d31/d83/dba/dbe/cdd 0 2024-04-25T22:42:16.537 INFO:tasks.workunit.client.0.smithi057.stdout:2/716: truncate d1f/d36/f4f 361885 0 2024-04-25T22:42:16.538 INFO:tasks.workunit.client.0.smithi057.stdout:2/717: sync 2024-04-25T22:42:16.538 INFO:tasks.workunit.client.0.smithi057.stdout:6/698: chown d2/d19/d49/db4/fb5 673 1 2024-04-25T22:42:16.539 INFO:tasks.workunit.client.0.smithi057.stdout:7/608: dwrite d6/d28/d4e/d30/d60/d8d/d96/fc3 [0,4194304] 0 2024-04-25T22:42:16.539 INFO:tasks.workunit.client.0.smithi057.stdout:6/699: chown d2/d19/cc7 488 1 2024-04-25T22:42:16.539 INFO:tasks.workunit.client.0.smithi057.stdout:4/650: dwrite d14/da9/d44/f8b [0,4194304] 0 2024-04-25T22:42:16.539 INFO:tasks.workunit.client.0.smithi057.stdout:6/700: rmdir d2/d19/d50 39 2024-04-25T22:42:16.540 INFO:tasks.workunit.client.0.smithi057.stdout:4/651: fdatasync ff 0 2024-04-25T22:42:16.540 INFO:tasks.workunit.client.0.smithi057.stdout:0/646: truncate d0/d3/d4d/d87/fba 220519 0 2024-04-25T22:42:16.541 INFO:tasks.workunit.client.0.smithi057.stdout:6/701: creat d2/d19/d50/d1a/d22/fde x:0 0 0 2024-04-25T22:42:16.541 INFO:tasks.workunit.client.0.smithi057.stdout:2/718: creat d1f/d21/ff9 x:0 0 0 2024-04-25T22:42:16.541 INFO:tasks.workunit.client.0.smithi057.stdout:3/584: dread d0/d4/d7/d46/d30/f5a [0,4194304] 0 2024-04-25T22:42:16.542 INFO:tasks.workunit.client.0.smithi057.stdout:6/702: chown d2/d19/d50/d1a/d22/d31/d83/c8c 180506835 1 2024-04-25T22:42:16.544 INFO:tasks.workunit.client.0.smithi057.stdout:2/719: mkdir d1f/d36/d54/dec/dfa 0 2024-04-25T22:42:16.544 INFO:tasks.workunit.client.0.smithi057.stdout:6/703: mkdir d2/d19/d50/d1a/d22/d31/d83/ddf 0 2024-04-25T22:42:16.544 INFO:tasks.workunit.client.0.smithi057.stdout:3/585: link d0/d4/d7/dad/lc7 d0/d4/d7/d26/d72/lc8 0 2024-04-25T22:42:16.544 INFO:tasks.workunit.client.0.smithi057.stdout:1/631: dread d7/f6f [0,4194304] 0 2024-04-25T22:42:16.544 INFO:tasks.workunit.client.0.smithi057.stdout:2/720: chown d1f/de7/d4d/d88 14965 1 2024-04-25T22:42:16.545 INFO:tasks.workunit.client.0.smithi057.stdout:6/704: unlink d2/d59/l5d 0 2024-04-25T22:42:16.546 INFO:tasks.workunit.client.0.smithi057.stdout:2/721: write d1f/de7/f3b [5565687,6381] 0 2024-04-25T22:42:16.546 INFO:tasks.workunit.client.0.smithi057.stdout:5/720: dread d2/d2c/f5c [0,4194304] 0 2024-04-25T22:42:16.546 INFO:tasks.workunit.client.0.smithi057.stdout:4/652: dread d14/d47/d5e/d5f/f8d [0,4194304] 0 2024-04-25T22:42:16.546 INFO:tasks.workunit.client.0.smithi057.stdout:6/705: stat d2/d19/d49/f54 0 2024-04-25T22:42:16.547 INFO:tasks.workunit.client.0.smithi057.stdout:5/721: chown d2/d6/db 967 1 2024-04-25T22:42:16.547 INFO:tasks.workunit.client.0.smithi057.stdout:8/615: dread d4/d5/d17/da7/fa9 [0,4194304] 0 2024-04-25T22:42:16.547 INFO:tasks.workunit.client.0.smithi057.stdout:4/653: chown d14/d2f/d4c/d5b/f93 56 1 2024-04-25T22:42:16.547 INFO:tasks.workunit.client.0.smithi057.stdout:5/722: read - d2/d47/d94/fad zero size 2024-04-25T22:42:16.547 INFO:tasks.workunit.client.0.smithi057.stdout:6/706: write d2/d19/d49/d62/f70 [996157,117906] 0 2024-04-25T22:42:16.548 INFO:tasks.workunit.client.0.smithi057.stdout:6/707: chown d2/d19/d85 0 1 2024-04-25T22:42:16.549 INFO:tasks.workunit.client.0.smithi057.stdout:3/586: symlink d0/d4/d7/d26/lc9 0 2024-04-25T22:42:16.549 INFO:tasks.workunit.client.0.smithi057.stdout:4/654: chown d14/l1e 280735 1 2024-04-25T22:42:16.550 INFO:tasks.workunit.client.0.smithi057.stdout:6/708: chown d2/d59/fd4 769 1 2024-04-25T22:42:16.550 INFO:tasks.workunit.client.0.smithi057.stdout:3/587: stat d0/d4/d7/d26/f63 0 2024-04-25T22:42:16.550 INFO:tasks.workunit.client.0.smithi057.stdout:4/655: rmdir d14/d2f/d4c/d5b/db8 39 2024-04-25T22:42:16.552 INFO:tasks.workunit.client.0.smithi057.stdout:6/709: mkdir d2/d19/d9b/de0 0 2024-04-25T22:42:16.552 INFO:tasks.workunit.client.0.smithi057.stdout:3/588: symlink d0/d4/d7/dad/lca 0 2024-04-25T22:42:16.555 INFO:tasks.workunit.client.0.smithi057.stdout:1/632: dwrite d7/d65/d95/fb1 [0,4194304] 0 2024-04-25T22:42:16.555 INFO:tasks.workunit.client.0.smithi057.stdout:2/722: dwrite d1f/d36/d54/f8d [0,4194304] 0 2024-04-25T22:42:16.556 INFO:tasks.workunit.client.0.smithi057.stdout:3/589: symlink d0/d4/d7/lcb 0 2024-04-25T22:42:16.557 INFO:tasks.workunit.client.0.smithi057.stdout:4/656: rename d14/d2f/d4c/d5b/f6b to d14/d5a/d67/fcf 0 2024-04-25T22:42:16.557 INFO:tasks.workunit.client.0.smithi057.stdout:6/710: creat d2/d19/d50/d1a/d22/d5e/fe1 x:0 0 0 2024-04-25T22:42:16.558 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:16.558 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:16.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.558 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13370 4.3f 4:fd52b5fc:::100000034de.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:16.558 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.548019+0000", 2024-04-25T22:42:16.558 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.010245153999999999, 2024-04-25T22:42:16.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.010267372, 2024-04-25T22:42:16.558 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:16.558 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:16.558 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:16.559 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:16.559 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:16.559 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:16.559 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13370 2024-04-25T22:42:16.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.559 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:16.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:16.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.548019+0000", 2024-04-25T22:42:16.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:16.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:16.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.548019+0000", 2024-04-25T22:42:16.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:16.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:16.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.548020+0000", 2024-04-25T22:42:16.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2100000000000001e-06 2024-04-25T22:42:16.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:16.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.554693+0000", 2024-04-25T22:42:16.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066728539999999998 2024-04-25T22:42:16.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:16.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.554709+0000", 2024-04-25T22:42:16.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6174000000000001e-05 2024-04-25T22:42:16.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.554718+0000", 2024-04-25T22:42:16.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4400000000000005e-06 2024-04-25T22:42:16.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:16.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.554792+0000", 2024-04-25T22:42:16.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.4235999999999999e-05 2024-04-25T22:42:16.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:16.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.554936+0000", 2024-04-25T22:42:16.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014393500000000001 2024-04-25T22:42:16.562 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:16.562 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:16.562 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:16.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.562 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13382 4.2f 4:f535ee6b:::10000003405.00000000:head [write 996157~117906 in=117906b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:16.562 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.554740+0000", 2024-04-25T22:42:16.562 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0035244550000000001, 2024-04-25T22:42:16.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0035924260000000001, 2024-04-25T22:42:16.562 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:16.562 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:16.562 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:16.562 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:16.563 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:16.563 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:16.563 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13382 2024-04-25T22:42:16.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.563 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:16.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:16.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.554740+0000", 2024-04-25T22:42:16.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:16.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:16.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.554740+0000", 2024-04-25T22:42:16.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:16.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:16.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.554742+0000", 2024-04-25T22:42:16.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.716e-06 2024-04-25T22:42:16.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:16.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.554811+0000", 2024-04-25T22:42:16.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9494999999999998e-05 2024-04-25T22:42:16.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:16.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.554819+0000", 2024-04-25T22:42:16.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6720000000000004e-06 2024-04-25T22:42:16.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.554825+0000", 2024-04-25T22:42:16.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8420000000000001e-06 2024-04-25T22:42:16.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:16.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.554896+0000", 2024-04-25T22:42:16.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1774999999999996e-05 2024-04-25T22:42:16.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:16.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.555084+0000", 2024-04-25T22:42:16.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018754399999999999 2024-04-25T22:42:16.565 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:16.565 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:16.566 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:16.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.566 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:1919 3.8 3:17051619:::200.0000000f:head [write 1040228~1959 [fadvise_dontneed] in=1959b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e65)", 2024-04-25T22:42:16.566 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.556269+0000", 2024-04-25T22:42:16.566 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0019948779999999998, 2024-04-25T22:42:16.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0021052219999999999, 2024-04-25T22:42:16.566 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:16.566 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:16.566 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:16.566 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:16.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:16.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.556269+0000", 2024-04-25T22:42:16.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:16.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:16.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.556269+0000", 2024-04-25T22:42:16.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:16.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:16.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.556271+0000", 2024-04-25T22:42:16.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5910000000000001e-06 2024-04-25T22:42:16.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:16.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.556279+0000", 2024-04-25T22:42:16.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1680000000000004e-06 2024-04-25T22:42:16.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:16.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.556294+0000", 2024-04-25T22:42:16.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4771e-05 2024-04-25T22:42:16.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.556302+0000", 2024-04-25T22:42:16.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3739999999999998e-06 2024-04-25T22:42:16.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:16.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.557441+0000", 2024-04-25T22:42:16.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001138275 2024-04-25T22:42:16.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:16.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.557543+0000", 2024-04-25T22:42:16.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000102452 2024-04-25T22:42:16.569 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:16.569 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:16.569 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:16.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.569 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13364 4.23 4:c571217c:::1000000318c.00000000:head [write 0~4194304 [2@596353] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:16.569 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.534580+0000", 2024-04-25T22:42:16.569 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.023684521, 2024-04-25T22:42:16.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023828044999999999, 2024-04-25T22:42:16.570 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:16.570 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:16.570 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:16.570 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:16.570 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:16.570 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:16.570 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13364 2024-04-25T22:42:16.570 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.570 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:16.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.570 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:16.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.534580+0000", 2024-04-25T22:42:16.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:16.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:16.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.534580+0000", 2024-04-25T22:42:16.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:16.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:16.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.534581+0000", 2024-04-25T22:42:16.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2950000000000001e-06 2024-04-25T22:42:16.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:16.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.541115+0000", 2024-04-25T22:42:16.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.006534354 2024-04-25T22:42:16.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:16.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.541128+0000", 2024-04-25T22:42:16.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2897e-05 2024-04-25T22:42:16.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.541137+0000", 2024-04-25T22:42:16.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4749999999999993e-06 2024-04-25T22:42:16.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:16.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.541205+0000", 2024-04-25T22:42:16.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.8042999999999999e-05 2024-04-25T22:42:16.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:16.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.541290+0000", 2024-04-25T22:42:16.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4688e-05 2024-04-25T22:42:16.573 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:16.573 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:16.573 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:16.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.574 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13369 4.3e 4:7c02873f:::100000036ba.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:16.574 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.541160+0000", 2024-04-25T22:42:16.574 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.017104668999999999, 2024-04-25T22:42:16.574 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017291770000000001, 2024-04-25T22:42:16.574 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:16.574 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:16.574 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:16.574 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:16.574 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:16.574 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:16.574 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13369 2024-04-25T22:42:16.574 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.574 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:16.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:16.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.541160+0000", 2024-04-25T22:42:16.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:16.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:16.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.541160+0000", 2024-04-25T22:42:16.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:16.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:16.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.541160+0000", 2024-04-25T22:42:16.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.1900000000000001e-07 2024-04-25T22:42:16.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:16.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.547966+0000", 2024-04-25T22:42:16.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0068050899999999998 2024-04-25T22:42:16.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:16.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.547982+0000", 2024-04-25T22:42:16.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6181999999999999e-05 2024-04-25T22:42:16.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.547990+0000", 2024-04-25T22:42:16.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.524e-06 2024-04-25T22:42:16.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:16.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.548069+0000", 2024-04-25T22:42:16.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8572999999999995e-05 2024-04-25T22:42:16.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:16.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.548287+0000", 2024-04-25T22:42:16.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021853199999999999 2024-04-25T22:42:16.577 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:16.577 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:16.577 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:16.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.577 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:13366 4.18 e65/17 4:19a11536:::10000003666.00000000:head v 65'212, mlcod=65'210)", 2024-04-25T22:42:16.577 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.544175+0000", 2024-04-25T22:42:16.577 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.014089005999999999, 2024-04-25T22:42:16.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014310761999999999, 2024-04-25T22:42:16.577 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:16.578 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:16.578 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:16.578 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:16.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:16.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.544175+0000", 2024-04-25T22:42:16.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:16.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:16.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.544175+0000", 2024-04-25T22:42:16.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:16.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:16.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.544176+0000", 2024-04-25T22:42:16.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4899999999999995e-07 2024-04-25T22:42:16.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:16.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.552845+0000", 2024-04-25T22:42:16.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0086694340000000002 2024-04-25T22:42:16.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:16.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.552865+0000", 2024-04-25T22:42:16.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.946e-05 2024-04-25T22:42:16.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.552877+0000", 2024-04-25T22:42:16.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2316e-05 2024-04-25T22:42:16.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:16.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.552987+0000", 2024-04-25T22:42:16.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000109987 2024-04-25T22:42:16.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:16.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553032+0000", 2024-04-25T22:42:16.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5337000000000003e-05 2024-04-25T22:42:16.580 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:16.580 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:16.580 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:16.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.581 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:1917 3.8 3:17051619:::200.0000000f:head [write 1024418~7363 [fadvise_dontneed] in=7363b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e65)", 2024-04-25T22:42:16.581 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.553062+0000", 2024-04-25T22:42:16.581 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0052020800000000004, 2024-04-25T22:42:16.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0054640890000000001, 2024-04-25T22:42:16.581 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:16.581 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:16.581 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:16.581 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:16.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:16.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553062+0000", 2024-04-25T22:42:16.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:16.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:16.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553062+0000", 2024-04-25T22:42:16.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:16.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:16.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553064+0000", 2024-04-25T22:42:16.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6360000000000001e-06 2024-04-25T22:42:16.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:16.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553075+0000", 2024-04-25T22:42:16.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1296e-05 2024-04-25T22:42:16.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:16.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553086+0000", 2024-04-25T22:42:16.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0824e-05 2024-04-25T22:42:16.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553094+0000", 2024-04-25T22:42:16.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.8550000000000002e-06 2024-04-25T22:42:16.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:16.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553149+0000", 2024-04-25T22:42:16.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5262e-05 2024-04-25T22:42:16.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:16.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553273+0000", 2024-04-25T22:42:16.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012377800000000001 2024-04-25T22:42:16.584 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:16.584 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:16.584 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:16.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.584 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:1918 3.8 3:17051619:::200.0000000f:head [write 1031781~8447 [fadvise_dontneed] in=8447b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e65)", 2024-04-25T22:42:16.584 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.553271+0000", 2024-04-25T22:42:16.584 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0049929889999999998, 2024-04-25T22:42:16.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0052886169999999998, 2024-04-25T22:42:16.585 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:16.585 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:16.585 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:16.585 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:16.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:16.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553271+0000", 2024-04-25T22:42:16.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:16.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:16.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553271+0000", 2024-04-25T22:42:16.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:16.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.586 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:16.586 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553272+0000", 2024-04-25T22:42:16.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:42:16.586 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.586 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:16.586 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553283+0000", 2024-04-25T22:42:16.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1027e-05 2024-04-25T22:42:16.586 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.586 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:16.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553292+0000", 2024-04-25T22:42:16.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7269999999999996e-06 2024-04-25T22:42:16.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:16.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553302+0000", 2024-04-25T22:42:16.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0484e-05 2024-04-25T22:42:16.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:16.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.555751+0000", 2024-04-25T22:42:16.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002448792 2024-04-25T22:42:16.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:16.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:16.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:16.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.555868+0000", 2024-04-25T22:42:16.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011678100000000001 2024-04-25T22:42:16.588 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:16.588 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:16.588 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:16.588 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:16.588 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-25T22:42:16.588 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 8 2024-04-25T22:42:16.588 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:16.590 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:16.593 INFO:tasks.workunit.client.0.smithi057.stdout:8/616: dwrite d4/db/d72/dbd/fc9 [0,4194304] 0 2024-04-25T22:42:16.593 INFO:tasks.workunit.client.0.smithi057.stdout:4/657: write d14/d47/f59 [3037164,67005] 0 2024-04-25T22:42:16.593 INFO:tasks.workunit.client.0.smithi057.stdout:2/723: rename d1f/d34/f85 to d1f/de7/d4d/d88/dd9/ffb 0 2024-04-25T22:42:16.593 INFO:tasks.workunit.client.0.smithi057.stdout:8/617: fdatasync d4/db/dd/d3a/d5c/d76/f97 0 2024-04-25T22:42:16.593 INFO:tasks.workunit.client.0.smithi057.stdout:4/658: unlink d14/d2f/d86/dbf/c94 0 2024-04-25T22:42:16.593 INFO:tasks.workunit.client.0.smithi057.stdout:4/659: symlink d14/d5a/d67/db4/ld0 0 2024-04-25T22:42:16.593 INFO:tasks.workunit.client.0.smithi057.stdout:4/660: rename d14/d5a/d67/db4/ld0 to d14/d2f/ld1 0 2024-04-25T22:42:16.594 INFO:tasks.workunit.client.0.smithi057.stdout:4/661: write d14/da9/d44/f8b [3230156,116648] 0 2024-04-25T22:42:16.594 INFO:tasks.workunit.client.0.smithi057.stdout:6/711: write d2/d19/d26/d63/f7d [3107414,4049] 0 2024-04-25T22:42:16.594 INFO:tasks.workunit.client.0.smithi057.stdout:3/590: dread d0/d4/d7/d46/d30/d7a/d91/fb2 [0,4194304] 0 2024-04-25T22:42:16.594 INFO:tasks.workunit.client.0.smithi057.stdout:4/662: write d14/d2f/f54 [6119453,130152] 0 2024-04-25T22:42:16.594 INFO:tasks.workunit.client.0.smithi057.stdout:3/591: dread d0/d4/f25 [0,4194304] 0 2024-04-25T22:42:16.594 INFO:tasks.workunit.client.0.smithi057.stdout:4/663: rename d14/da2/da7/dbd to d14/d5a/dd2 0 2024-04-25T22:42:16.594 INFO:tasks.workunit.client.0.smithi057.stdout:4/664: chown d14/da9/f75 0 1 2024-04-25T22:42:16.594 INFO:tasks.workunit.client.0.smithi057.stdout:4/665: rmdir d14/da2 39 2024-04-25T22:42:16.594 INFO:tasks.workunit.client.0.smithi057.stdout:4/666: mkdir d14/d5a/d67/db4/dd3 0 2024-04-25T22:42:16.594 INFO:tasks.workunit.client.0.smithi057.stdout:4/667: fsync d14/da9/d44/fb9 0 2024-04-25T22:42:16.594 INFO:tasks.workunit.client.0.smithi057.stdout:3/592: write d0/d4/d7/d22/f2b [1639867,3981] 0 2024-04-25T22:42:16.594 INFO:tasks.workunit.client.0.smithi057.stdout:4/668: mkdir d14/d2f/d86/dbf/dd4 0 2024-04-25T22:42:16.594 INFO:tasks.workunit.client.0.smithi057.stdout:3/593: symlink d0/d4/d7/dad/lcc 0 2024-04-25T22:42:16.595 INFO:tasks.workunit.client.0.smithi057.stdout:6/712: dwrite d2/d19/d50/d1a/d22/d31/d83/dba/fd0 [0,4194304] 0 2024-04-25T22:42:16.595 INFO:tasks.workunit.client.0.smithi057.stdout:4/669: write d14/da9/f98 [4908635,112576] 0 2024-04-25T22:42:16.595 INFO:tasks.workunit.client.0.smithi057.stdout:3/594: dread - d0/d4/d7/d46/f84 zero size 2024-04-25T22:42:16.595 INFO:tasks.workunit.client.0.smithi057.stdout:6/713: mkdir d2/d19/d20/d61/dbf/de2 0 2024-04-25T22:42:16.595 INFO:tasks.workunit.client.0.smithi057.stdout:6/714: write d2/d19/d50/d1a/d22/d31/f3a [4554997,14034] 0 2024-04-25T22:42:16.595 INFO:tasks.workunit.client.0.smithi057.stdout:6/715: unlink d2/d19/d20/f8e 0 2024-04-25T22:42:16.595 INFO:tasks.workunit.client.0.smithi057.stdout:4/670: dread d14/f61 [0,4194304] 0 2024-04-25T22:42:16.595 INFO:tasks.workunit.client.0.smithi057.stdout:6/716: write d2/d19/fcc [405007,113537] 0 2024-04-25T22:42:16.595 INFO:tasks.workunit.client.0.smithi057.stdout:4/671: read d14/f1c [2978047,20466] 0 2024-04-25T22:42:16.595 INFO:tasks.workunit.client.0.smithi057.stdout:3/595: dread d0/d5b/f8e [0,4194304] 0 2024-04-25T22:42:16.595 INFO:tasks.workunit.client.0.smithi057.stdout:3/596: truncate d0/d4/fc2 457438 0 2024-04-25T22:42:16.595 INFO:tasks.workunit.client.0.smithi057.stdout:6/717: dwrite d2/d19/d20/f6a [4194304,4194304] 0 2024-04-25T22:42:16.595 INFO:tasks.workunit.client.0.smithi057.stdout:3/597: mknod d0/d11/ccd 0 2024-04-25T22:42:16.595 INFO:tasks.workunit.client.0.smithi057.stdout:6/718: rename d2/d19/d9b/lcd to d2/d19/d26/d4f/d95/le3 0 2024-04-25T22:42:16.595 INFO:tasks.workunit.client.0.smithi057.stdout:6/719: symlink d2/d19/d26/d4f/le4 0 2024-04-25T22:42:16.595 INFO:tasks.workunit.client.0.smithi057.stdout:9/627: dread d3/f12 [0,4194304] 0 2024-04-25T22:42:16.596 INFO:tasks.workunit.client.0.smithi057.stdout:4/672: truncate d14/da9/db5/fc8 4665980 0 2024-04-25T22:42:16.596 INFO:tasks.workunit.client.0.smithi057.stdout:6/720: write d2/d19/d49/d62/d79/fd7 [1361510,130943] 0 2024-04-25T22:42:16.596 INFO:tasks.workunit.client.0.smithi057.stdout:4/673: creat d14/da9/fd5 x:0 0 0 2024-04-25T22:42:16.596 INFO:tasks.workunit.client.0.smithi057.stdout:0/647: dread d0/d3/d4d/f9c [0,4194304] 0 2024-04-25T22:42:16.596 INFO:tasks.workunit.client.0.smithi057.stdout:4/674: creat d14/d5a/d67/dcc/fd6 x:0 0 0 2024-04-25T22:42:16.596 INFO:tasks.workunit.client.0.smithi057.stdout:6/721: truncate d2/d19/d50/d1a/d22/d31/fc9 974805 0 2024-04-25T22:42:16.597 INFO:tasks.workunit.client.0.smithi057.stdout:6/722: mknod d2/d19/ce5 0 2024-04-25T22:42:16.597 INFO:tasks.workunit.client.0.smithi057.stdout:8/618: dread d4/f5e [0,4194304] 0 2024-04-25T22:42:16.597 INFO:tasks.workunit.client.0.smithi057.stdout:6/723: mknod d2/d19/d50/d1a/ce6 0 2024-04-25T22:42:16.597 INFO:tasks.workunit.client.0.smithi057.stdout:8/619: stat d4/d5/d17/cb8 0 2024-04-25T22:42:16.597 INFO:tasks.workunit.client.0.smithi057.stdout:5/723: dread d2/d6/db/f38 [0,4194304] 0 2024-04-25T22:42:16.597 INFO:tasks.workunit.client.0.smithi057.stdout:3/598: read d0/d4/d7/d22/f2b [1065626,2452] 0 2024-04-25T22:42:16.598 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:16.592+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:16.599 INFO:tasks.workunit.client.0.smithi057.stdout:5/724: rename d2/d1c/d46/lbd to d2/d1c/d46/le2 0 2024-04-25T22:42:16.599 INFO:tasks.workunit.client.0.smithi057.stdout:3/599: rmdir d0/d4/d7/d46/d30/d99 39 2024-04-25T22:42:16.599 INFO:tasks.workunit.client.0.smithi057.stdout:7/609: dread d6/d28/d4e/d30/d60/d8d/d96/d51/f6d [0,4194304] 0 2024-04-25T22:42:16.599 INFO:tasks.workunit.client.0.smithi057.stdout:8/620: link d4/db/c24 d4/d5/d17/d19/d35/ce2 0 2024-04-25T22:42:16.599 INFO:tasks.workunit.client.0.smithi057.stdout:3/600: read d0/d5b/f8e [638151,37983] 0 2024-04-25T22:42:16.599 DEBUG:teuthology.orchestra.console.smithi148:Waiting for login prompt 2024-04-25T22:42:16.600 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi148 2024-04-25T22:42:16.609 INFO:tasks.workunit.client.0.smithi057.stdout:7/610: creat d6/fcf x:0 0 0 2024-04-25T22:42:16.610 INFO:tasks.workunit.client.0.smithi057.stdout:5/725: dread d2/d47/da5/dd3/f82 [0,4194304] 0 2024-04-25T22:42:16.610 INFO:tasks.workunit.client.0.smithi057.stdout:7/611: dread - d6/f3a zero size 2024-04-25T22:42:16.610 INFO:tasks.workunit.client.0.smithi057.stdout:3/601: mkdir d0/d4/d34/d3c/d53/db1/dce 0 2024-04-25T22:42:16.610 INFO:tasks.workunit.client.0.smithi057.stdout:5/726: link d2/d6/db/fb4 d2/d2c/db7/fe3 0 2024-04-25T22:42:16.610 INFO:tasks.workunit.client.0.smithi057.stdout:3/602: write d0/d4/d7/d46/d30/d7a/d91/fbf [760896,24067] 0 2024-04-25T22:42:16.610 INFO:tasks.workunit.client.0.smithi057.stdout:2/724: dread d1f/d21/f25 [0,4194304] 0 2024-04-25T22:42:16.610 INFO:tasks.workunit.client.0.smithi057.stdout:5/727: chown d2/d1c/d24/d3d/d50/d83/f9f 7 1 2024-04-25T22:42:16.610 INFO:tasks.workunit.client.0.smithi057.stdout:3/603: fsync d0/d4/d7/d26/f43 0 2024-04-25T22:42:16.610 INFO:tasks.workunit.client.0.smithi057.stdout:5/728: unlink d2/lc 0 2024-04-25T22:42:16.610 INFO:tasks.workunit.client.0.smithi057.stdout:6/724: dread d2/f64 [0,4194304] 0 2024-04-25T22:42:16.610 INFO:tasks.workunit.client.0.smithi057.stdout:2/725: link d1f/d21/d26/d5c/la6 d1f/d21/d26/d63/d7f/lfc 0 2024-04-25T22:42:16.610 INFO:tasks.workunit.client.0.smithi057.stdout:5/729: chown d2/d6/db/l29 523079 1 2024-04-25T22:42:16.611 INFO:tasks.workunit.client.0.smithi057.stdout:3/604: truncate d0/d4/d4a/f71 178938 0 2024-04-25T22:42:16.611 INFO:tasks.workunit.client.0.smithi057.stdout:2/726: dread - d1f/d21/d33/fce zero size 2024-04-25T22:42:16.611 INFO:tasks.workunit.client.0.smithi057.stdout:9/628: dread d3/f9 [0,4194304] 0 2024-04-25T22:42:16.611 INFO:tasks.workunit.client.0.smithi057.stdout:6/725: symlink d2/d19/d49/d62/d79/dad/le7 0 2024-04-25T22:42:16.611 INFO:tasks.workunit.client.0.smithi057.stdout:9/629: write d3/d34/d42/d28/d39/d54/fbe [1009534,8707] 0 2024-04-25T22:42:16.611 INFO:tasks.workunit.client.0.smithi057.stdout:7/612: dwrite d6/d28/f42 [0,4194304] 0 2024-04-25T22:42:16.611 INFO:tasks.workunit.client.0.smithi057.stdout:2/727: truncate d1f/d21/d26/d63/d7f/d86/f9e 237695 0 2024-04-25T22:42:16.612 INFO:tasks.workunit.client.0.smithi057.stdout:7/613: dread - d6/d28/d4e/d30/d60/fc2 zero size 2024-04-25T22:42:16.612 INFO:tasks.workunit.client.0.smithi057.stdout:7/614: getdents d6/d88 0 2024-04-25T22:42:16.615 INFO:tasks.workunit.client.0.smithi057.stdout:7/615: write d6/d28/d4e/d30/d60/d8d/d96/fc3 [468403,122561] 0 2024-04-25T22:42:16.616 INFO:tasks.workunit.client.0.smithi057.stdout:2/728: dread d1f/f2a [0,4194304] 0 2024-04-25T22:42:16.616 INFO:tasks.workunit.client.0.smithi057.stdout:6/726: dwrite d2/d19/d50/d1a/d22/f53 [0,4194304] 0 2024-04-25T22:42:16.617 INFO:tasks.workunit.client.0.smithi057.stdout:3/605: dwrite d0/d11/f12 [0,4194304] 0 2024-04-25T22:42:16.618 INFO:tasks.workunit.client.0.smithi057.stdout:7/616: unlink d6/d28/d4e/d30/d60/d8d/d96/d51/f6d 0 2024-04-25T22:42:16.619 INFO:tasks.workunit.client.0.smithi057.stdout:7/617: stat d6/d28/d4e/d30/d60/fb5 0 2024-04-25T22:42:16.619 INFO:tasks.workunit.client.0.smithi057.stdout:3/606: dread d0/d4/f25 [0,4194304] 0 2024-04-25T22:42:16.620 INFO:tasks.workunit.client.0.smithi057.stdout:7/618: unlink d6/d28/d4e/d30/d60/d8d/d96/c55 0 2024-04-25T22:42:16.621 INFO:tasks.workunit.client.0.smithi057.stdout:3/607: write d0/d4/d34/d3c/fb4 [705433,63274] 0 2024-04-25T22:42:16.621 INFO:tasks.workunit.client.0.smithi057.stdout:9/630: truncate d3/d34/d42/d28/f85 491464 0 2024-04-25T22:42:16.622 INFO:tasks.workunit.client.0.smithi057.stdout:9/631: unlink d3/l33 0 2024-04-25T22:42:16.624 INFO:tasks.workunit.client.0.smithi057.stdout:3/608: dread d0/f6 [0,4194304] 0 2024-04-25T22:42:16.624 INFO:tasks.workunit.client.0.smithi057.stdout:0/648: dread d0/d5/d53/f61 [0,4194304] 0 2024-04-25T22:42:16.625 INFO:tasks.workunit.client.0.smithi057.stdout:3/609: chown d0/d11 99234 1 2024-04-25T22:42:16.625 INFO:tasks.workunit.client.0.smithi057.stdout:6/727: dwrite d2/d59/fb1 [0,4194304] 0 2024-04-25T22:42:16.625 INFO:tasks.workunit.client.0.smithi057.stdout:4/675: dread d14/d2f/d4c/d5b/f93 [0,4194304] 0 2024-04-25T22:42:16.626 INFO:tasks.workunit.client.0.smithi057.stdout:1/633: dread d7/d65/d6a/d98/f51 [0,4194304] 0 2024-04-25T22:42:16.627 INFO:tasks.workunit.client.0.smithi057.stdout:1/634: symlink d7/ld3 0 2024-04-25T22:42:16.628 INFO:tasks.workunit.client.0.smithi057.stdout:3/610: rename d0/l5e to d0/d4/d7/d46/d30/d7a/lcf 0 2024-04-25T22:42:16.629 INFO:tasks.workunit.client.0.smithi057.stdout:6/728: link d2/d19/d50/d1a/d22/f29 d2/d19/d26/d63/fe8 0 2024-04-25T22:42:16.629 INFO:tasks.workunit.client.0.smithi057.stdout:3/611: mkdir d0/d4/d7/d26/d72/dd0 0 2024-04-25T22:42:16.630 INFO:tasks.workunit.client.0.smithi057.stdout:1/635: write d7/dd/d16/d24/d63/fca [675465,131048] 0 2024-04-25T22:42:16.630 INFO:tasks.workunit.client.0.smithi057.stdout:2/729: dwrite d1f/de7/f9b [4194304,4194304] 0 2024-04-25T22:42:16.630 INFO:tasks.workunit.client.0.smithi057.stdout:6/729: symlink d2/d86/d90/le9 0 2024-04-25T22:42:16.630 INFO:tasks.workunit.client.0.smithi057.stdout:3/612: chown d0/d4/d7/d26/l2a 1268045 1 2024-04-25T22:42:16.631 INFO:tasks.workunit.client.0.smithi057.stdout:1/636: creat d7/dd/d90/fd4 x:0 0 0 2024-04-25T22:42:16.631 INFO:tasks.workunit.client.0.smithi057.stdout:6/730: readlink d2/l16 0 2024-04-25T22:42:16.631 INFO:tasks.workunit.client.0.smithi057.stdout:2/730: getdents d1f/d21/d26 0 2024-04-25T22:42:16.632 INFO:tasks.workunit.client.0.smithi057.stdout:1/637: write d7/dd/d16/d24/d63/fca [167700,37697] 0 2024-04-25T22:42:16.632 INFO:tasks.workunit.client.0.smithi057.stdout:0/649: read d0/d3/d4d/f93 [163123,42324] 0 2024-04-25T22:42:16.632 INFO:tasks.workunit.client.0.smithi057.stdout:3/613: creat d0/d4/d7/d46/d30/d7a/fd1 x:0 0 0 2024-04-25T22:42:16.632 INFO:tasks.workunit.client.0.smithi057.stdout:6/731: getdents d2/d19/d9b/de0 0 2024-04-25T22:42:16.633 INFO:tasks.workunit.client.0.smithi057.stdout:0/650: fdatasync d0/d3/d88/fe0 0 2024-04-25T22:42:16.634 INFO:tasks.workunit.client.0.smithi057.stdout:0/651: fdatasync d0/d3/d4d/fd9 0 2024-04-25T22:42:16.635 INFO:tasks.workunit.client.0.smithi057.stdout:3/614: dread - d0/d4/d7/d46/d30/d99/fbc zero size 2024-04-25T22:42:16.635 INFO:tasks.workunit.client.0.smithi057.stdout:0/652: chown d0/d3/d6/d83/fc3 1986 1 2024-04-25T22:42:16.635 INFO:tasks.workunit.client.0.smithi057.stdout:4/676: dwrite d14/d2f/d4c/d5b/f93 [0,4194304] 0 2024-04-25T22:42:16.636 INFO:tasks.workunit.client.0.smithi057.stdout:8/621: dread d4/db/dd/d3a/f3c [0,4194304] 0 2024-04-25T22:42:16.636 INFO:tasks.workunit.client.0.smithi057.stdout:3/615: readlink d0/d4/d7/dad/lcc 0 2024-04-25T22:42:16.637 INFO:tasks.workunit.client.0.smithi057.stdout:9/632: truncate d3/d34/d42/d28/d39/d54/fcb 3947157 0 2024-04-25T22:42:16.638 INFO:tasks.workunit.client.0.smithi057.stdout:4/677: symlink d14/d2f/d86/ld7 0 2024-04-25T22:42:16.638 INFO:tasks.workunit.client.0.smithi057.stdout:3/616: symlink d0/d4/d7/d26/d89/ld2 0 2024-04-25T22:42:16.638 INFO:tasks.workunit.client.0.smithi057.stdout:9/633: mknod d3/d34/d42/d28/d65/cce 0 2024-04-25T22:42:16.640 INFO:tasks.workunit.client.0.smithi057.stdout:2/731: truncate d1f/d21/d26/f4e 4491281 0 2024-04-25T22:42:16.640 INFO:tasks.workunit.client.0.smithi057.stdout:3/617: unlink d0/d4/d34/fbd 0 2024-04-25T22:42:16.640 INFO:tasks.workunit.client.0.smithi057.stdout:9/634: chown d3/d34/d42/d28/d62/d67/d6e/c78 15 1 2024-04-25T22:42:16.643 INFO:tasks.workunit.client.0.smithi057.stdout:3/618: mkdir d0/d4/d7/d26/d89/d97/dc1/dd3 0 2024-04-25T22:42:16.644 INFO:tasks.workunit.client.0.smithi057.stdout:5/730: dread d2/d6/db/f2f [0,4194304] 0 2024-04-25T22:42:16.644 INFO:tasks.workunit.client.0.smithi057.stdout:9/635: mkdir d3/d34/d42/d28/d62/dcf 0 2024-04-25T22:42:16.645 INFO:tasks.workunit.client.0.smithi057.stdout:0/653: dwrite d0/d5/d53/fb6 [0,4194304] 0 2024-04-25T22:42:16.645 INFO:tasks.workunit.client.0.smithi057.stdout:8/622: dwrite d4/fbf [0,4194304] 0 2024-04-25T22:42:16.646 INFO:tasks.workunit.client.0.smithi057.stdout:5/731: chown d2/d47/ldb 2890256 1 2024-04-25T22:42:16.646 INFO:tasks.workunit.client.0.smithi057.stdout:1/638: dwrite d7/f6c [0,4194304] 0 2024-04-25T22:42:16.646 INFO:tasks.workunit.client.0.smithi057.stdout:3/619: write d0/f1b [4495363,84159] 0 2024-04-25T22:42:16.646 INFO:tasks.workunit.client.0.smithi057.stdout:8/623: chown d4/d5/d17/d19/d35/d83 1087583306 1 2024-04-25T22:42:16.647 INFO:tasks.workunit.client.0.smithi057.stdout:7/619: read d6/d28/d4e/d30/d60/d8d/d96/d51/f83 [2808219,123377] 0 2024-04-25T22:42:16.647 INFO:tasks.workunit.client.0.smithi057.stdout:0/654: unlink d0/d5/d53/f61 0 2024-04-25T22:42:16.647 INFO:tasks.workunit.client.0.smithi057.stdout:5/732: unlink d2/c51 0 2024-04-25T22:42:16.648 INFO:tasks.workunit.client.0.smithi057.stdout:7/620: write d6/d28/f41 [4338317,14055] 0 2024-04-25T22:42:16.648 INFO:tasks.workunit.client.0.smithi057.stdout:5/733: mkdir d2/d1c/d46/de4 0 2024-04-25T22:42:16.648 INFO:tasks.workunit.client.0.smithi057.stdout:9/636: creat d3/d34/d42/d28/d62/d67/d6e/d7c/db8/fd0 x:0 0 0 2024-04-25T22:42:16.648 INFO:tasks.workunit.client.0.smithi057.stdout:4/678: rename d14/d2f/d86 to d14/d2f/d4c/d5b/dd8 0 2024-04-25T22:42:16.649 INFO:tasks.workunit.client.0.smithi057.stdout:3/620: rename d0/d4/d7/d22/f2b to d0/d4/d7/d22/da0/fd4 0 2024-04-25T22:42:16.649 INFO:tasks.workunit.client.0.smithi057.stdout:9/637: fdatasync d3/d34/d42/d28/f68 0 2024-04-25T22:42:16.649 INFO:tasks.workunit.client.0.smithi057.stdout:0/655: link d0/d3/d6/c52 d0/d3/d4d/d87/ce6 0 2024-04-25T22:42:16.650 INFO:tasks.workunit.client.0.smithi057.stdout:8/624: rename d4/db/dd/d3a/d5c/d76/fe0 to d4/db/d12/dc0/fe3 0 2024-04-25T22:42:16.650 INFO:tasks.workunit.client.0.smithi057.stdout:5/734: rename d2/d1c/d24/d3d/f56 to d2/d1c/d24/d3d/d50/d83/fe5 0 2024-04-25T22:42:16.651 INFO:tasks.workunit.client.0.smithi057.stdout:8/625: creat d4/db/d12/fe4 x:0 0 0 2024-04-25T22:42:16.651 INFO:tasks.workunit.client.0.smithi057.stdout:0/656: symlink d0/d3/le7 0 2024-04-25T22:42:16.651 INFO:tasks.workunit.client.0.smithi057.stdout:5/735: stat d2/d1c/f63 0 2024-04-25T22:42:16.652 INFO:tasks.workunit.client.0.smithi057.stdout:0/657: stat d0/d3/d6/d29/lc4 0 2024-04-25T22:42:16.652 INFO:tasks.workunit.client.0.smithi057.stdout:8/626: write d4/db/dd/d3a/f8e [496355,60087] 0 2024-04-25T22:42:16.652 INFO:tasks.workunit.client.0.smithi057.stdout:5/736: chown d2/d1c/d46/d3a/c6f 8 1 2024-04-25T22:42:16.654 INFO:tasks.workunit.client.0.smithi057.stdout:8/627: write d4/d5/d17/d19/fca [664084,122264] 0 2024-04-25T22:42:16.654 INFO:tasks.workunit.client.0.smithi057.stdout:5/737: mkdir d2/d1c/d24/d3d/d77/de6 0 2024-04-25T22:42:16.655 INFO:tasks.workunit.client.0.smithi057.stdout:1/639: dwrite d7/dd/d16/d18/f39 [4194304,4194304] 0 2024-04-25T22:42:16.656 INFO:tasks.workunit.client.0.smithi057.stdout:8/628: write d4/db/d72/f7d [2247762,39066] 0 2024-04-25T22:42:16.656 INFO:tasks.workunit.client.0.smithi057.stdout:1/640: write d7/d65/d6a/d98/d41/d6b/fae [619934,44902] 0 2024-04-25T22:42:16.656 INFO:tasks.workunit.client.0.smithi057.stdout:8/629: getdents d4/d5/d2f/dc2 0 2024-04-25T22:42:16.657 INFO:tasks.workunit.client.0.smithi057.stdout:1/641: rmdir d7/dd/d16/d18/d31 39 2024-04-25T22:42:16.658 INFO:tasks.workunit.client.0.smithi057.stdout:8/630: readlink d4/d5/d17/d19/d35/d83/d92/d5b/d8c/la5 0 2024-04-25T22:42:16.658 INFO:tasks.workunit.client.0.smithi057.stdout:1/642: mknod d7/dd/d16/d18/cd5 0 2024-04-25T22:42:16.659 INFO:tasks.workunit.client.0.smithi057.stdout:1/643: creat d7/dd/d16/fd6 x:0 0 0 2024-04-25T22:42:16.659 INFO:tasks.workunit.client.0.smithi057.stdout:9/638: getdents d3/d34/d42/d28/d62 0 2024-04-25T22:42:16.659 INFO:tasks.workunit.client.0.smithi057.stdout:1/644: fdatasync d7/dd/d16/f1e 0 2024-04-25T22:42:16.660 INFO:tasks.workunit.client.0.smithi057.stdout:9/639: chown d3/d34/d42/d28/d2d/f5c 552685 1 2024-04-25T22:42:16.660 INFO:tasks.workunit.client.0.smithi057.stdout:1/645: write d7/dd/d16/fbc [1214247,77799] 0 2024-04-25T22:42:16.662 INFO:tasks.workunit.client.0.smithi057.stdout:9/640: creat d3/d34/fd1 x:0 0 0 2024-04-25T22:42:16.663 INFO:tasks.workunit.client.0.smithi057.stdout:1/646: dread - d7/dd/d16/d24/d63/dc7/db0/fb6 zero size 2024-04-25T22:42:16.664 INFO:tasks.workunit.client.0.smithi057.stdout:1/647: chown d7/dd/d16/d24/f38 1984 1 2024-04-25T22:42:16.664 INFO:tasks.workunit.client.0.smithi057.stdout:9/641: write d3/d34/d42/d28/d62/d67/d6e/d7c/fcd [286883,77967] 0 2024-04-25T22:42:16.665 INFO:tasks.workunit.client.0.smithi057.stdout:8/631: dwrite d4/f49 [0,4194304] 0 2024-04-25T22:42:16.666 INFO:tasks.workunit.client.0.smithi057.stdout:1/648: write d7/dd/d16/f7e [685470,128024] 0 2024-04-25T22:42:16.666 INFO:tasks.workunit.client.0.smithi057.stdout:8/632: read - d4/d5/d17/d19/d35/d83/d92/f8b zero size 2024-04-25T22:42:16.666 INFO:tasks.workunit.client.0.smithi057.stdout:1/649: chown d7/d65/d6a/d98 15 1 2024-04-25T22:42:16.667 INFO:tasks.workunit.client.0.smithi057.stdout:9/642: truncate d3/d34/d42/d28/d2d/d9c/f9f 613608 0 2024-04-25T22:42:16.667 INFO:tasks.workunit.client.0.smithi057.stdout:9/643: write d3/f24 [215529,98804] 0 2024-04-25T22:42:16.671 INFO:tasks.workunit.client.0.smithi057.stdout:6/732: dread d2/f14 [0,4194304] 0 2024-04-25T22:42:16.672 INFO:tasks.workunit.client.0.smithi057.stdout:6/733: dread - d2/d86/d90/faf zero size 2024-04-25T22:42:16.672 INFO:tasks.workunit.client.0.smithi057.stdout:2/732: sync 2024-04-25T22:42:16.673 INFO:tasks.workunit.client.0.smithi057.stdout:6/734: rmdir d2/d19/d9b 39 2024-04-25T22:42:16.673 INFO:tasks.workunit.client.0.smithi057.stdout:1/650: dwrite d7/d65/d6a/d98/d41/d6b/fc9 [0,4194304] 0 2024-04-25T22:42:16.674 INFO:tasks.workunit.client.0.smithi057.stdout:2/733: symlink d1f/d34/lfd 0 2024-04-25T22:42:16.675 INFO:tasks.workunit.client.0.smithi057.stdout:6/735: chown d2/f1c 89 1 2024-04-25T22:42:16.675 INFO:tasks.workunit.client.0.smithi057.stdout:9/644: dwrite d3/d34/f73 [0,4194304] 0 2024-04-25T22:42:16.677 INFO:tasks.workunit.client.0.smithi057.stdout:1/651: chown d7/d65/d6a/d98/d41/ccb 15 1 2024-04-25T22:42:16.677 INFO:tasks.workunit.client.0.smithi057.stdout:6/736: chown d2/d19/d26/l77 968947072 1 2024-04-25T22:42:16.677 INFO:tasks.workunit.client.0.smithi057.stdout:5/738: dread d2/d2c/f36 [0,4194304] 0 2024-04-25T22:42:16.678 INFO:tasks.workunit.client.0.smithi057.stdout:2/734: symlink d1f/d36/d54/dc0/lfe 0 2024-04-25T22:42:16.679 INFO:tasks.workunit.client.0.smithi057.stdout:6/737: symlink d2/d19/d49/d62/d79/lea 0 2024-04-25T22:42:16.680 INFO:tasks.workunit.client.0.smithi057.stdout:9/645: unlink d3/d34/d42/d28/d62/d67/d6e/d7c/fab 0 2024-04-25T22:42:16.681 INFO:tasks.workunit.client.0.smithi057.stdout:2/735: mkdir d1f/d21/d26/d63/d7f/dff 0 2024-04-25T22:42:16.681 INFO:tasks.workunit.client.0.smithi057.stdout:5/739: mknod d2/d6/ce7 0 2024-04-25T22:42:16.681 INFO:tasks.workunit.client.0.smithi057.stdout:9/646: mknod d3/d34/d42/d5e/da3/cd2 0 2024-04-25T22:42:16.681 INFO:tasks.workunit.client.0.smithi057.stdout:5/740: fdatasync d2/d2c/db7/fe3 0 2024-04-25T22:42:16.682 INFO:tasks.workunit.client.0.smithi057.stdout:2/736: creat d1f/d36/d54/dec/f100 x:0 0 0 2024-04-25T22:42:16.682 INFO:tasks.workunit.client.0.smithi057.stdout:2/737: fdatasync d1f/d36/f4f 0 2024-04-25T22:42:16.683 INFO:tasks.workunit.client.0.smithi057.stdout:5/741: write d2/d2c/f81 [1824849,48771] 0 2024-04-25T22:42:16.683 INFO:tasks.workunit.client.0.smithi057.stdout:9/647: read d3/d34/d42/d28/d39/d54/fbe [245734,58101] 0 2024-04-25T22:42:16.683 INFO:tasks.workunit.client.0.smithi057.stdout:2/738: chown d1f/d36/l9a 401868 1 2024-04-25T22:42:16.684 INFO:tasks.workunit.client.0.smithi057.stdout:5/742: chown d2/d1c/d46/c1d 25 1 2024-04-25T22:42:16.685 INFO:tasks.workunit.client.0.smithi057.stdout:1/652: dwrite d7/d65/d6a/d98/d41/f4b [0,4194304] 0 2024-04-25T22:42:16.685 INFO:tasks.workunit.client.0.smithi057.stdout:2/739: creat d1f/de7/d4d/d88/f101 x:0 0 0 2024-04-25T22:42:16.686 INFO:tasks.workunit.client.0.smithi057.stdout:2/740: dread - d1f/d21/ff9 zero size 2024-04-25T22:42:16.687 INFO:tasks.workunit.client.0.smithi057.stdout:5/743: symlink d2/d1c/d24/d3d/d77/dcd/ddd/le8 0 2024-04-25T22:42:16.687 INFO:tasks.workunit.client.0.smithi057.stdout:1/653: symlink d7/dd/d26/d9a/ld7 0 2024-04-25T22:42:16.687 INFO:tasks.workunit.client.0.smithi057.stdout:2/741: write d1f/d21/d26/d63/fd7 [966825,115377] 0 2024-04-25T22:42:16.688 INFO:tasks.workunit.client.0.smithi057.stdout:6/738: dwrite d2/d19/d49/d62/f7b [0,4194304] 0 2024-04-25T22:42:16.689 INFO:tasks.workunit.client.0.smithi057.stdout:6/739: unlink d2/d19/d50/d1a/c1d 0 2024-04-25T22:42:16.692 INFO:tasks.workunit.client.0.smithi057.stdout:6/740: creat d2/d19/d50/d1a/d22/d31/d83/daa/feb x:0 0 0 2024-04-25T22:42:16.692 INFO:tasks.workunit.client.0.smithi057.stdout:7/621: dread d6/d28/d4e/d30/d60/d8d/fc1 [0,4194304] 0 2024-04-25T22:42:16.692 INFO:tasks.workunit.client.0.smithi057.stdout:6/741: mknod d2/d19/d20/d9e/cec 0 2024-04-25T22:42:16.694 INFO:tasks.workunit.client.0.smithi057.stdout:7/622: link d6/d28/d4e/d30/d60/d8d/d96/d5d/c92 d6/d28/d4e/d30/d46/d73/cd0 0 2024-04-25T22:42:16.695 INFO:tasks.workunit.client.0.smithi057.stdout:6/742: rename d2/d19/d50/d1a/d22/d31/d83/c8c to d2/d19/d26/d4f/d95/ced 0 2024-04-25T22:42:16.696 INFO:tasks.workunit.client.0.smithi057.stdout:7/623: write d6/d28/d4e/d30/d60/d8d/d96/d5d/f5e [2581379,115043] 0 2024-04-25T22:42:16.696 INFO:tasks.workunit.client.0.smithi057.stdout:6/743: symlink d2/d19/d50/d1a/lee 0 2024-04-25T22:42:16.697 INFO:tasks.workunit.client.0.smithi057.stdout:5/744: truncate d2/d6/f58 885818 0 2024-04-25T22:42:16.697 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:16.696+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:16.698 INFO:tasks.workunit.client.0.smithi057.stdout:6/744: rename d2/f1c to d2/d19/d20/d61/fef 0 2024-04-25T22:42:16.698 INFO:tasks.workunit.client.0.smithi057.stdout:5/745: write d2/d1c/d46/d3a/d6a/fd9 [858367,47398] 0 2024-04-25T22:42:16.699 INFO:tasks.workunit.client.0.smithi057.stdout:9/648: dwrite d3/d34/d42/d5e/f76 [0,4194304] 0 2024-04-25T22:42:16.700 INFO:tasks.workunit.client.0.smithi057.stdout:5/746: write d2/d2c/f5d [3185329,64531] 0 2024-04-25T22:42:16.701 INFO:tasks.workunit.client.0.smithi057.stdout:6/745: rename d2/d19/d50/d1a/d22/d31/d83/daa/feb to d2/d19/d49/d62/d79/dad/ff0 0 2024-04-25T22:42:16.701 INFO:tasks.workunit.client.0.smithi057.stdout:9/649: truncate d3/f58 537283 0 2024-04-25T22:42:16.702 INFO:tasks.workunit.client.0.smithi057.stdout:9/650: readlink l2 0 2024-04-25T22:42:16.702 INFO:tasks.workunit.client.0.smithi057.stdout:0/658: dread d0/d3/dae/fb1 [0,4194304] 0 2024-04-25T22:42:16.702 INFO:tasks.workunit.client.0.smithi057.stdout:2/742: dread d1f/d36/f4f [0,4194304] 0 2024-04-25T22:42:16.702 INFO:tasks.workunit.client.0.smithi057.stdout:5/747: chown d2/d47/da5/c8b 3761137 1 2024-04-25T22:42:16.702 INFO:tasks.workunit.client.0.smithi057.stdout:9/651: write d3/f24 [2792311,98619] 0 2024-04-25T22:42:16.704 INFO:tasks.workunit.client.0.smithi057.stdout:5/748: write d2/d1c/d24/d3d/fd5 [439941,61826] 0 2024-04-25T22:42:16.704 INFO:tasks.workunit.client.0.smithi057.stdout:2/743: creat d1f/d36/d54/dc0/f102 x:0 0 0 2024-04-25T22:42:16.704 INFO:tasks.workunit.client.0.smithi057.stdout:7/624: dwrite d6/d28/d4e/d30/f36 [4194304,4194304] 0 2024-04-25T22:42:16.704 INFO:tasks.workunit.client.0.smithi057.stdout:0/659: rename d0/d3/d4d/da6 to d0/d3/d6/d14/d39/de8 0 2024-04-25T22:42:16.705 INFO:tasks.workunit.client.0.smithi057.stdout:5/749: readlink d2/d1c/l75 0 2024-04-25T22:42:16.707 INFO:tasks.workunit.client.0.smithi057.stdout:0/660: symlink d0/d3/dae/le9 0 2024-04-25T22:42:16.708 INFO:tasks.workunit.client.0.smithi057.stdout:7/625: link d6/d28/d4e/l38 d6/d28/d4e/d30/d46/d73/dcb/ld1 0 2024-04-25T22:42:16.708 INFO:tasks.workunit.client.0.smithi057.stdout:2/744: creat d1f/d21/d26/d63/f103 x:0 0 0 2024-04-25T22:42:16.708 INFO:tasks.workunit.client.0.smithi057.stdout:0/661: mkdir d0/d49/d6d/dea 0 2024-04-25T22:42:16.708 INFO:tasks.workunit.client.0.smithi057.stdout:7/626: chown d6/daa 360686 1 2024-04-25T22:42:16.709 INFO:tasks.workunit.client.0.smithi057.stdout:6/746: dwrite d2/d86/d90/fbc [0,4194304] 0 2024-04-25T22:42:16.710 INFO:tasks.workunit.client.0.smithi057.stdout:7/627: write d6/f19 [4988570,71156] 0 2024-04-25T22:42:16.711 INFO:tasks.workunit.client.0.smithi057.stdout:0/662: mkdir d0/d5/deb 0 2024-04-25T22:42:16.712 INFO:tasks.workunit.client.0.smithi057.stdout:3/621: sync 2024-04-25T22:42:16.712 INFO:tasks.workunit.client.0.smithi057.stdout:6/747: getdents d2/d19/d26 0 2024-04-25T22:42:16.712 INFO:tasks.workunit.client.0.smithi057.stdout:9/652: dwrite d3/d34/d42/fa6 [8388608,4194304] 0 2024-04-25T22:42:16.712 INFO:tasks.workunit.client.0.smithi057.stdout:8/633: sync 2024-04-25T22:42:16.712 INFO:tasks.workunit.client.0.smithi057.stdout:1/654: sync 2024-04-25T22:42:16.712 INFO:tasks.workunit.client.0.smithi057.stdout:4/679: sync 2024-04-25T22:42:16.712 INFO:tasks.workunit.client.0.smithi057.stdout:2/745: sync 2024-04-25T22:42:16.712 INFO:tasks.workunit.client.0.smithi057.stdout:1/655: sync 2024-04-25T22:42:16.715 INFO:tasks.workunit.client.0.smithi057.stdout:5/750: dwrite d2/d1c/d24/d3d/da7/db2/fb5 [0,4194304] 0 2024-04-25T22:42:16.715 INFO:tasks.workunit.client.0.smithi057.stdout:2/746: write d1f/d21/ff9 [412377,34387] 0 2024-04-25T22:42:16.715 INFO:tasks.workunit.client.0.smithi057.stdout:9/653: write d3/d34/d42/d28/d62/d67/d6e/f80 [481016,35739] 0 2024-04-25T22:42:16.717 INFO:tasks.workunit.client.0.smithi057.stdout:0/663: rename d0/d3/d6/d29 to d0/d3/d88/da3/dec 0 2024-04-25T22:42:16.718 INFO:tasks.workunit.client.0.smithi057.stdout:2/747: creat d1f/de7/f104 x:0 0 0 2024-04-25T22:42:16.718 INFO:tasks.workunit.client.0.smithi057.stdout:8/634: dread d4/db/f34 [0,4194304] 0 2024-04-25T22:42:16.719 INFO:tasks.workunit.client.0.smithi057.stdout:9/654: symlink d3/d34/d42/d28/d39/db3/ld3 0 2024-04-25T22:42:16.719 INFO:tasks.workunit.client.0.smithi057.stdout:5/751: truncate d2/d6/db/fb4 122594 0 2024-04-25T22:42:16.719 INFO:tasks.workunit.client.0.smithi057.stdout:7/628: dwrite d6/d91/fab [0,4194304] 0 2024-04-25T22:42:16.720 INFO:tasks.workunit.client.0.smithi057.stdout:3/622: creat d0/d4/d34/fd5 x:0 0 0 2024-04-25T22:42:16.720 INFO:tasks.workunit.client.0.smithi057.stdout:5/752: fdatasync d2/d1c/d46/d3a/d6a/fc6 0 2024-04-25T22:42:16.721 INFO:tasks.workunit.client.0.smithi057.stdout:6/748: getdents d2/d19/d50/d1a/d22/d31/d83/daa 0 2024-04-25T22:42:16.721 INFO:tasks.workunit.client.0.smithi057.stdout:2/748: mkdir d1f/d21/d105 0 2024-04-25T22:42:16.721 INFO:tasks.workunit.client.0.smithi057.stdout:9/655: dread - d3/d34/d42/d28/d62/d67/d6e/d7c/f97 zero size 2024-04-25T22:42:16.721 INFO:tasks.workunit.client.0.smithi057.stdout:8/635: truncate d4/db/dd/d3a/fa4 1463044 0 2024-04-25T22:42:16.722 INFO:tasks.workunit.client.0.smithi057.stdout:9/656: stat d3/d34/d42/d28/d62/d67/f71 0 2024-04-25T22:42:16.722 INFO:tasks.workunit.client.0.smithi057.stdout:2/749: truncate d1f/de7/d4d/d88/f101 864892 0 2024-04-25T22:42:16.722 INFO:tasks.workunit.client.0.smithi057.stdout:6/749: truncate d2/d19/d50/d1a/d22/f82 187066 0 2024-04-25T22:42:16.723 INFO:tasks.workunit.client.0.smithi057.stdout:9/657: write d3/d34/d42/d28/d39/db3/fae [36885,89448] 0 2024-04-25T22:42:16.724 INFO:tasks.workunit.client.0.smithi057.stdout:3/623: rename d0/d4/c42 to d0/cd6 0 2024-04-25T22:42:16.724 INFO:tasks.workunit.client.0.smithi057.stdout:8/636: symlink d4/dba/le5 0 2024-04-25T22:42:16.724 INFO:tasks.workunit.client.0.smithi057.stdout:7/629: mkdir d6/dd2 0 2024-04-25T22:42:16.724 INFO:tasks.workunit.client.0.smithi057.stdout:6/750: creat d2/d19/ff1 x:0 0 0 2024-04-25T22:42:16.724 INFO:tasks.workunit.client.0.smithi057.stdout:3/624: fsync d0/d4/d7/d46/d30/f65 0 2024-04-25T22:42:16.725 INFO:tasks.workunit.client.0.smithi057.stdout:8/637: write d4/db/dd/d3a/d5c/f44 [98994,40120] 0 2024-04-25T22:42:16.726 INFO:tasks.workunit.client.0.smithi057.stdout:9/658: symlink d3/d34/d42/d28/d2d/d9c/ld4 0 2024-04-25T22:42:16.726 INFO:tasks.workunit.client.0.smithi057.stdout:8/638: chown d4/d5/d21 102515 1 2024-04-25T22:42:16.726 INFO:tasks.workunit.client.0.smithi057.stdout:7/630: mknod d6/d28/d4e/cd3 0 2024-04-25T22:42:16.726 INFO:tasks.workunit.client.0.smithi057.stdout:6/751: write d2/d19/d49/d62/d79/fd7 [548249,93212] 0 2024-04-25T22:42:16.726 INFO:tasks.workunit.client.0.smithi057.stdout:9/659: write d3/fa1 [802347,60923] 0 2024-04-25T22:42:16.727 INFO:tasks.workunit.client.0.smithi057.stdout:1/656: dread d7/dd/d26/f73 [0,4194304] 0 2024-04-25T22:42:16.730 INFO:tasks.workunit.client.0.smithi057.stdout:8/639: write d4/db/dd/d3a/f3c [3752953,68015] 0 2024-04-25T22:42:16.730 INFO:tasks.workunit.client.0.smithi057.stdout:9/660: chown d3/d34/fac 539 1 2024-04-25T22:42:16.730 INFO:tasks.workunit.client.0.smithi057.stdout:1/657: mkdir d7/d65/d6a/d98/d41/d45/dd8 0 2024-04-25T22:42:16.733 INFO:tasks.workunit.client.0.smithi057.stdout:4/680: dread d14/d2f/f57 [0,4194304] 0 2024-04-25T22:42:16.733 INFO:tasks.workunit.client.0.smithi057.stdout:8/640: link d4/db/c24 d4/dba/ce6 0 2024-04-25T22:42:16.733 INFO:tasks.workunit.client.0.smithi057.stdout:2/750: dread d1f/d21/d33/daa/fed [0,4194304] 0 2024-04-25T22:42:16.733 INFO:tasks.workunit.client.0.smithi057.stdout:1/658: write d7/dd/d16/d24/f38 [3092229,119795] 0 2024-04-25T22:42:16.734 INFO:tasks.workunit.client.0.smithi057.stdout:7/631: dwrite d6/d28/d4e/d30/d60/f86 [0,4194304] 0 2024-04-25T22:42:16.736 INFO:tasks.workunit.client.0.smithi057.stdout:2/751: mknod d1f/d21/c106 0 2024-04-25T22:42:16.736 INFO:tasks.workunit.client.0.smithi057.stdout:4/681: mknod d14/d2f/d4c/d5b/dd8/dbf/dd4/cd9 0 2024-04-25T22:42:16.737 INFO:tasks.workunit.client.0.smithi057.stdout:6/752: dwrite d2/d19/d50/d1a/d22/d31/fc9 [0,4194304] 0 2024-04-25T22:42:16.737 INFO:tasks.workunit.client.0.smithi057.stdout:7/632: fsync d6/f3a 0 2024-04-25T22:42:16.738 INFO:tasks.workunit.client.0.smithi057.stdout:2/752: truncate d1f/d21/d26/d63/d7f/fb3 588317 0 2024-04-25T22:42:16.738 INFO:tasks.workunit.client.0.smithi057.stdout:7/633: read d6/d28/d4e/d30/f9d [231352,23288] 0 2024-04-25T22:42:16.739 INFO:tasks.workunit.client.0.smithi057.stdout:5/753: dwrite d2/d6/db/f25 [0,4194304] 0 2024-04-25T22:42:16.740 INFO:tasks.workunit.client.0.smithi057.stdout:3/625: truncate d0/d4/f90 4013618 0 2024-04-25T22:42:16.740 INFO:tasks.workunit.client.0.smithi057.stdout:4/682: truncate d14/d5a/f9d 927583 0 2024-04-25T22:42:16.741 INFO:tasks.workunit.client.0.smithi057.stdout:4/683: sync 2024-04-25T22:42:16.741 INFO:tasks.workunit.client.0.smithi057.stdout:2/753: creat d1f/d34/d50/df0/f107 x:0 0 0 2024-04-25T22:42:16.742 INFO:tasks.workunit.client.0.smithi057.stdout:1/659: getdents d7/dd/d16/d18/d31/d8f 0 2024-04-25T22:42:16.742 INFO:tasks.workunit.client.0.smithi057.stdout:3/626: mknod d0/d4/d34/d3c/d53/cd7 0 2024-04-25T22:42:16.742 INFO:tasks.workunit.client.0.smithi057.stdout:2/754: creat d1f/de7/d4d/d88/dd9/da1/ddc/f108 x:0 0 0 2024-04-25T22:42:16.744 INFO:tasks.workunit.client.0.smithi057.stdout:1/660: readlink d7/dd/d16/d18/l2f 0 2024-04-25T22:42:16.745 INFO:tasks.workunit.client.0.smithi057.stdout:2/755: mknod d1f/de7/d4d/d88/c109 0 2024-04-25T22:42:16.745 INFO:tasks.workunit.client.0.smithi057.stdout:5/754: rename d2/d1c/d24/d3d/d77/dcd/ddd/le8 to d2/d47/d87/dd2/le9 0 2024-04-25T22:42:16.745 INFO:tasks.workunit.client.0.smithi057.stdout:9/661: truncate d3/d34/d42/d28/f51 388556 0 2024-04-25T22:42:16.746 INFO:tasks.workunit.client.0.smithi057.stdout:3/627: getdents d0/d4/d7 0 2024-04-25T22:42:16.748 INFO:tasks.workunit.client.0.smithi057.stdout:7/634: write d6/d28/d4e/d30/d60/d8d/d96/fce [671023,102231] 0 2024-04-25T22:42:16.748 INFO:tasks.workunit.client.0.smithi057.stdout:5/755: fsync d2/d1c/d46/d3a/d6a/fd9 0 2024-04-25T22:42:16.749 INFO:tasks.workunit.client.0.smithi057.stdout:6/753: dwrite d2/d19/d50/d1a/d22/f5c [0,4194304] 0 2024-04-25T22:42:16.751 INFO:tasks.workunit.client.0.smithi057.stdout:4/684: dwrite d14/da9/d44/fb9 [0,4194304] 0 2024-04-25T22:42:16.751 INFO:tasks.workunit.client.0.smithi057.stdout:2/756: mkdir d1f/d21/d26/d63/d7f/d10a 0 2024-04-25T22:42:16.751 INFO:tasks.workunit.client.0.smithi057.stdout:5/756: rmdir d2/d1c/d24/d3d 39 2024-04-25T22:42:16.752 INFO:tasks.workunit.client.0.smithi057.stdout:1/661: read d7/dd/d16/d18/f39 [2266167,52331] 0 2024-04-25T22:42:16.752 INFO:tasks.workunit.client.0.smithi057.stdout:7/635: mkdir d6/d28/d4e/d75/dd4 0 2024-04-25T22:42:16.753 INFO:tasks.workunit.client.0.smithi057.stdout:1/662: sync 2024-04-25T22:42:16.753 INFO:tasks.workunit.client.0.smithi057.stdout:6/754: mknod d2/d19/d50/d1a/d22/d31/d83/cf2 0 2024-04-25T22:42:16.754 INFO:tasks.workunit.client.0.smithi057.stdout:4/685: creat d14/da2/da7/fda x:0 0 0 2024-04-25T22:42:16.756 INFO:tasks.workunit.client.0.smithi057.stdout:2/757: getdents d1f/d21/d33 0 2024-04-25T22:42:16.756 INFO:tasks.workunit.client.0.smithi057.stdout:1/663: write d7/dd/d26/f8c [681005,114289] 0 2024-04-25T22:42:16.757 INFO:tasks.workunit.client.0.smithi057.stdout:6/755: chown d2/d19/d50/d1a/d22/d31/fc9 1 1 2024-04-25T22:42:16.757 INFO:tasks.workunit.client.0.smithi057.stdout:3/628: dwrite d0/f62 [0,4194304] 0 2024-04-25T22:42:16.758 INFO:tasks.workunit.client.0.smithi057.stdout:6/756: fdatasync d2/d86/f98 0 2024-04-25T22:42:16.759 INFO:tasks.workunit.client.0.smithi057.stdout:0/664: dread d0/f66 [0,4194304] 0 2024-04-25T22:42:16.759 INFO:tasks.workunit.client.0.smithi057.stdout:1/664: creat d7/dd/d16/d18/d31/fd9 x:0 0 0 2024-04-25T22:42:16.760 INFO:tasks.workunit.client.0.smithi057.stdout:7/636: read d6/d28/d4e/d30/d60/d8d/d96/fce [6832802,108902] 0 2024-04-25T22:42:16.760 INFO:tasks.workunit.client.0.smithi057.stdout:9/662: dwrite d3/d34/f5b [0,4194304] 0 2024-04-25T22:42:16.761 INFO:tasks.workunit.client.0.smithi057.stdout:6/757: write d2/d19/d26/d4f/fb3 [270000,37133] 0 2024-04-25T22:42:16.762 INFO:tasks.workunit.client.0.smithi057.stdout:3/629: chown d0/d4/d7/l14 4 1 2024-04-25T22:42:16.763 INFO:tasks.workunit.client.0.smithi057.stdout:9/663: write d3/f58 [623404,100198] 0 2024-04-25T22:42:16.763 INFO:tasks.workunit.client.0.smithi057.stdout:5/757: dwrite d2/d2c/db7/fcb [0,4194304] 0 2024-04-25T22:42:16.765 INFO:tasks.workunit.client.0.smithi057.stdout:1/665: write d7/dd/d16/d24/d63/dc7/db0/fb6 [423068,72235] 0 2024-04-25T22:42:16.765 INFO:tasks.workunit.client.0.smithi057.stdout:1/666: stat c3 0 2024-04-25T22:42:16.766 INFO:tasks.workunit.client.0.smithi057.stdout:3/630: readlink d0/d4/d7b/d7c/la3 0 2024-04-25T22:42:16.766 INFO:tasks.workunit.client.0.smithi057.stdout:4/686: dwrite ff [0,4194304] 0 2024-04-25T22:42:16.769 INFO:tasks.workunit.client.0.smithi057.stdout:9/664: write d3/d34/f73 [4588384,113151] 0 2024-04-25T22:42:16.769 INFO:tasks.workunit.client.0.smithi057.stdout:5/758: unlink d2/d1c/d24/d3d/da7/lc4 0 2024-04-25T22:42:16.769 INFO:tasks.workunit.client.0.smithi057.stdout:2/758: dwrite d1f/de7/d4d/d88/dd9/f97 [0,4194304] 0 2024-04-25T22:42:16.772 INFO:tasks.workunit.client.0.smithi057.stdout:6/758: rename d2/d19/d50/d1a/d22 to d2/d19/d9b/df3 0 2024-04-25T22:42:16.772 INFO:tasks.workunit.client.0.smithi057.stdout:4/687: unlink d14/d2f/d4c/d5b/dd8/dbf/dd4/cd9 0 2024-04-25T22:42:16.772 INFO:tasks.workunit.client.0.smithi057.stdout:6/759: readlink d2/d86/lb9 0 2024-04-25T22:42:16.772 INFO:tasks.workunit.client.0.smithi057.stdout:2/759: fsync d1f/d36/d54/f5f 0 2024-04-25T22:42:16.772 INFO:tasks.workunit.client.0.smithi057.stdout:9/665: symlink d3/d34/d42/d5e/da3/ld5 0 2024-04-25T22:42:16.772 INFO:tasks.workunit.client.0.smithi057.stdout:4/688: stat d14/d2f/d4c/d5b/c6f 0 2024-04-25T22:42:16.772 INFO:tasks.workunit.client.0.smithi057.stdout:5/759: link d2/f10 d2/d1c/d24/d3d/d77/dcd/ddd/fea 0 2024-04-25T22:42:16.773 INFO:tasks.workunit.client.0.smithi057.stdout:2/760: mkdir d1f/d21/d96/d10b 0 2024-04-25T22:42:16.773 INFO:tasks.workunit.client.0.smithi057.stdout:6/760: write d2/d19/d49/d62/f8f [1321213,17841] 0 2024-04-25T22:42:16.775 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:16.775 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:16.775 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:42:16.775 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:42:16.775 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:16.776 INFO:tasks.workunit.client.0.smithi057.stdout:0/665: dwrite d0/d3/d3a/d3b/fbb [0,4194304] 0 2024-04-25T22:42:16.777 INFO:tasks.workunit.client.0.smithi057.stdout:7/637: dwrite d6/f21 [4194304,4194304] 0 2024-04-25T22:42:16.777 INFO:tasks.workunit.client.0.smithi057.stdout:5/760: mkdir d2/d1c/d24/d3d/deb 0 2024-04-25T22:42:16.778 INFO:tasks.workunit.client.0.smithi057.stdout:9/666: rename d3/d34/d42/d28/d62/d67/d6e/c78 to d3/d34/d42/d28/d2d/d9c/cd6 0 2024-04-25T22:42:16.779 INFO:tasks.workunit.client.0.smithi057.stdout:1/667: dwrite d7/dd/d16/d24/d61/f53 [0,4194304] 0 2024-04-25T22:42:16.780 INFO:tasks.workunit.client.0.smithi057.stdout:6/761: creat d2/d19/d9b/df3/d5e/dda/ff4 x:0 0 0 2024-04-25T22:42:16.780 INFO:tasks.workunit.client.0.smithi057.stdout:5/761: creat d2/d1c/fec x:0 0 0 2024-04-25T22:42:16.781 INFO:tasks.workunit.client.0.smithi057.stdout:2/761: getdents d1f/d21/d26/d63/d7f/d86 0 2024-04-25T22:42:16.781 INFO:tasks.workunit.client.0.smithi057.stdout:2/762: sync 2024-04-25T22:42:16.781 INFO:tasks.workunit.client.0.smithi057.stdout:3/631: dwrite d0/d4/d7/d46/f6f [0,4194304] 0 2024-04-25T22:42:16.782 INFO:tasks.workunit.client.0.smithi057.stdout:9/667: chown d3/d34/d42/d28/d62/d67/d6e/d7c/f97 1808 1 2024-04-25T22:42:16.782 INFO:tasks.workunit.client.0.smithi057.stdout:0/666: chown d0/d3/d4d/d87/d91/cca 1070331175 1 2024-04-25T22:42:16.782 INFO:tasks.workunit.client.0.smithi057.stdout:1/668: fdatasync d7/d4e/f96 0 2024-04-25T22:42:16.783 INFO:tasks.workunit.client.0.smithi057.stdout:7/638: mknod d6/d28/d4e/d30/d60/d6f/cd5 0 2024-04-25T22:42:16.783 INFO:tasks.workunit.client.0.smithi057.stdout:9/668: readlink d3/d34/d42/d28/lb9 0 2024-04-25T22:42:16.783 INFO:tasks.workunit.client.0.smithi057.stdout:4/689: dwrite d14/da9/db5/fc1 [0,4194304] 0 2024-04-25T22:42:16.784 INFO:tasks.workunit.client.0.smithi057.stdout:6/762: rename d2/d19/d49/c51 to d2/d19/d50/d1a/db0/cf5 0 2024-04-25T22:42:16.785 INFO:tasks.workunit.client.0.smithi057.stdout:0/667: creat d0/d3/d4d/d87/fed x:0 0 0 2024-04-25T22:42:16.785 INFO:tasks.workunit.client.0.smithi057.stdout:7/639: write d6/d28/d4e/d30/f36 [7237912,82386] 0 2024-04-25T22:42:16.787 INFO:tasks.workunit.client.0.smithi057.stdout:8/641: dread d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/dc8/f9b [0,4194304] 0 2024-04-25T22:42:16.787 INFO:tasks.workunit.client.0.smithi057.stdout:1/669: chown d7/dd/d90/fb5 533556 1 2024-04-25T22:42:16.787 INFO:tasks.workunit.client.0.smithi057.stdout:4/690: unlink d14/da2/da7/fda 0 2024-04-25T22:42:16.788 INFO:tasks.workunit.client.0.smithi057.stdout:7/640: unlink d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/la4 0 2024-04-25T22:42:16.789 INFO:tasks.workunit.client.0.smithi057.stdout:4/691: read d14/f28 [1987465,98962] 0 2024-04-25T22:42:16.789 INFO:tasks.workunit.client.0.smithi057.stdout:3/632: chown d0/d4/d34/d3c/d70/c9e 53 1 2024-04-25T22:42:16.790 INFO:tasks.workunit.client.0.smithi057.stdout:4/692: mknod d14/d2f/d4c/cdb 0 2024-04-25T22:42:16.791 INFO:tasks.workunit.client.0.smithi057.stdout:3/633: chown d0/d4/d7/d26/d89/d97/dc1 55344490 1 2024-04-25T22:42:16.793 INFO:tasks.workunit.client.0.smithi057.stdout:7/641: mkdir d6/d28/d4e/d30/d60/d6f/d9c/dc4/dd6 0 2024-04-25T22:42:16.794 INFO:tasks.workunit.client.0.smithi057.stdout:2/763: dwrite d1f/d36/d54/f95 [0,4194304] 0 2024-04-25T22:42:16.794 INFO:tasks.workunit.client.0.smithi057.stdout:4/693: creat d14/d2f/fdc x:0 0 0 2024-04-25T22:42:16.794 INFO:tasks.workunit.client.0.smithi057.stdout:3/634: mknod d0/d4/d7/dad/db3/cd8 0 2024-04-25T22:42:16.794 INFO:tasks.workunit.client.0.smithi057.stdout:6/763: dread d2/d19/d49/d62/f7b [0,4194304] 0 2024-04-25T22:42:16.795 INFO:tasks.workunit.client.0.smithi057.stdout:1/670: truncate d7/d65/d6a/d98/d41/d45/f48 39608 0 2024-04-25T22:42:16.795 INFO:tasks.workunit.client.0.smithi057.stdout:2/764: rename d1f/d21/d33/c7e to d1f/d21/d96/c10c 0 2024-04-25T22:42:16.798 INFO:tasks.workunit.client.0.smithi057.stdout:3/635: rename d0/d4/d7b/d7c/fb0 to d0/d4/d7/d22/fd9 0 2024-04-25T22:42:16.798 INFO:tasks.workunit.client.0.smithi057.stdout:1/671: read - d7/dd/d16/d24/d61/fa8 zero size 2024-04-25T22:42:16.798 INFO:tasks.workunit.client.0.smithi057.stdout:4/694: readlink d14/d47/d62/l9b 0 2024-04-25T22:42:16.799 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:16.795+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:16.799 INFO:tasks.workunit.client.0.smithi057.stdout:2/765: mkdir d1f/d21/d33/d10d 0 2024-04-25T22:42:16.799 INFO:tasks.workunit.client.0.smithi057.stdout:2/766: sync 2024-04-25T22:42:16.800 INFO:tasks.workunit.client.0.smithi057.stdout:6/764: rename d2/d59/fb1 to d2/d19/d9b/df3/d31/d83/ff6 0 2024-04-25T22:42:16.800 INFO:tasks.workunit.client.0.smithi057.stdout:0/668: truncate d0/d3/fd4 687496 0 2024-04-25T22:42:16.801 INFO:tasks.workunit.client.0.smithi057.stdout:4/695: creat d14/d47/d62/fdd x:0 0 0 2024-04-25T22:42:16.801 INFO:tasks.workunit.client.0.smithi057.stdout:7/642: rename d6/d28/d4e/d75 to d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/dd7 0 2024-04-25T22:42:16.802 INFO:tasks.workunit.client.0.smithi057.stdout:3/636: creat d0/d4/d34/d3c/d53/db1/dce/fda x:0 0 0 2024-04-25T22:42:16.802 INFO:tasks.workunit.client.0.smithi057.stdout:0/669: dread - d0/d3/d4d/d87/da0/fde zero size 2024-04-25T22:42:16.802 INFO:tasks.workunit.client.0.smithi057.stdout:5/762: dwrite d2/d47/d94/f9c [0,4194304] 0 2024-04-25T22:42:16.802 INFO:tasks.workunit.client.0.smithi057.stdout:4/696: symlink d14/d47/d62/lde 0 2024-04-25T22:42:16.802 INFO:tasks.workunit.client.0.smithi057.stdout:6/765: truncate d2/d86/fac 223247 0 2024-04-25T22:42:16.803 INFO:tasks.workunit.client.0.smithi057.stdout:4/697: readlink l2 0 2024-04-25T22:42:16.804 INFO:tasks.workunit.client.0.smithi057.stdout:2/767: rename d1f/d21/c2f to d1f/d34/d50/df0/df3/c10e 0 2024-04-25T22:42:16.804 INFO:tasks.workunit.client.0.smithi057.stdout:5/763: mkdir d2/d47/ded 0 2024-04-25T22:42:16.804 INFO:tasks.workunit.client.0.smithi057.stdout:6/766: creat d2/d59/ff7 x:0 0 0 2024-04-25T22:42:16.805 INFO:tasks.workunit.client.0.smithi057.stdout:1/672: rename d7/d65/d6a/d98/d41/f4b to d7/dd/d16/d24/d63/dc7/db0/fda 0 2024-04-25T22:42:16.805 INFO:tasks.workunit.client.0.smithi057.stdout:5/764: chown d2/d6/f64 1 1 2024-04-25T22:42:16.805 INFO:tasks.workunit.client.0.smithi057.stdout:4/698: mknod d14/d2f/d4c/d5b/cdf 0 2024-04-25T22:42:16.806 INFO:tasks.workunit.client.0.smithi057.stdout:2/768: unlink d1f/d21/d33/f6e 0 2024-04-25T22:42:16.806 INFO:tasks.workunit.client.0.smithi057.stdout:3/637: link d0/d6b/cbb d0/d4/d7/d46/d30/d7a/d91/cdb 0 2024-04-25T22:42:16.806 INFO:tasks.workunit.client.0.smithi057.stdout:9/669: read d3/d34/d42/f41 [680970,59348] 0 2024-04-25T22:42:16.806 INFO:tasks.workunit.client.0.smithi057.stdout:6/767: mknod d2/d86/d90/cf8 0 2024-04-25T22:42:16.807 INFO:tasks.workunit.client.0.smithi057.stdout:5/765: mknod d2/cee 0 2024-04-25T22:42:16.807 INFO:tasks.workunit.client.0.smithi057.stdout:2/769: readlink d1f/de7/d4d/la0 0 2024-04-25T22:42:16.808 INFO:tasks.workunit.client.0.smithi057.stdout:2/770: read - d1f/d34/d50/df0/ff4 zero size 2024-04-25T22:42:16.809 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:16.810 INFO:tasks.workunit.client.0.smithi057.stdout:8/642: dread d4/d5/d17/d19/d35/d83/d92/da6/fbb [0,4194304] 0 2024-04-25T22:42:16.810 INFO:tasks.workunit.client.0.smithi057.stdout:3/638: mknod d0/d4/d34/cdc 0 2024-04-25T22:42:16.811 INFO:tasks.workunit.client.0.smithi057.stdout:9/670: write d3/d34/d42/d28/d62/d67/d6e/d7c/db8/fd0 [683770,11846] 0 2024-04-25T22:42:16.812 INFO:tasks.workunit.client.0.smithi057.stdout:3/639: readlink d0/d4/d7b/la9 0 2024-04-25T22:42:16.812 INFO:tasks.workunit.client.0.smithi057.stdout:7/643: dwrite d6/d28/d4e/d30/d60/d8d/fc1 [0,4194304] 0 2024-04-25T22:42:16.812 INFO:tasks.workunit.client.0.smithi057.stdout:4/699: dread d14/da9/db5/fc1 [0,4194304] 0 2024-04-25T22:42:16.812 INFO:tasks.workunit.client.0.smithi057.stdout:3/640: truncate d0/fa 4928701 0 2024-04-25T22:42:16.812 INFO:tasks.workunit.client.0.smithi057.stdout:8/643: symlink d4/d5/le7 0 2024-04-25T22:42:16.812 INFO:tasks.workunit.client.0.smithi057.stdout:9/671: mkdir d3/d34/d42/d28/d65/dd7 0 2024-04-25T22:42:16.815 INFO:tasks.workunit.client.0.smithi057.stdout:4/700: write d14/f28 [312136,127633] 0 2024-04-25T22:42:16.816 INFO:tasks.workunit.client.0.smithi057.stdout:9/672: getdents d3/d34/d42/d28/d62 0 2024-04-25T22:42:16.817 INFO:tasks.workunit.client.0.smithi057.stdout:9/673: fdatasync d3/d34/d42/d28/d62/d67/f74 0 2024-04-25T22:42:16.819 INFO:tasks.workunit.client.0.smithi057.stdout:7/644: dwrite d6/d28/d4e/f22 [0,4194304] 0 2024-04-25T22:42:16.820 INFO:tasks.workunit.client.0.smithi057.stdout:1/673: truncate d7/dd/d16/d88/f8b 2763801 0 2024-04-25T22:42:16.820 INFO:tasks.workunit.client.0.smithi057.stdout:6/768: truncate d2/d19/d50/d91/fa3 3885088 0 2024-04-25T22:42:16.821 INFO:tasks.workunit.client.0.smithi057.stdout:3/641: dwrite d0/d4/fc2 [0,4194304] 0 2024-04-25T22:42:16.821 INFO:tasks.workunit.client.0.smithi057.stdout:5/766: truncate d2/d1c/d46/d3a/f65 2332520 0 2024-04-25T22:42:16.824 INFO:tasks.workunit.client.0.smithi057.stdout:1/674: write d7/d65/d6a/d98/d41/d6b/fbb [857531,36631] 0 2024-04-25T22:42:16.825 INFO:tasks.workunit.client.0.smithi057.stdout:7/645: chown d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/dd7 1 1 2024-04-25T22:42:16.825 INFO:tasks.workunit.client.0.smithi057.stdout:6/769: readlink d2/d19/d20/d9e/ldb 0 2024-04-25T22:42:16.825 INFO:tasks.workunit.client.0.smithi057.stdout:8/644: dwrite d4/db/d12/dc0/fe3 [0,4194304] 0 2024-04-25T22:42:16.827 INFO:tasks.workunit.client.0.smithi057.stdout:3/642: truncate d0/f95 133179 0 2024-04-25T22:42:16.827 INFO:tasks.workunit.client.0.smithi057.stdout:1/675: write d7/dd/d16/d24/f4f [5660087,24964] 0 2024-04-25T22:42:16.828 INFO:tasks.workunit.client.0.smithi057.stdout:8/645: symlink d4/db/le8 0 2024-04-25T22:42:16.829 INFO:tasks.workunit.client.0.smithi057.stdout:2/771: dwrite f1d [0,4194304] 0 2024-04-25T22:42:16.829 INFO:tasks.workunit.client.0.smithi057.stdout:9/674: dwrite d3/d34/d42/d28/f9a [0,4194304] 0 2024-04-25T22:42:16.829 INFO:tasks.workunit.client.0.smithi057.stdout:4/701: dread d14/f39 [0,4194304] 0 2024-04-25T22:42:16.830 INFO:tasks.workunit.client.0.smithi057.stdout:7/646: truncate d6/d28/d4e/f31 1371795 0 2024-04-25T22:42:16.830 INFO:tasks.workunit.client.0.smithi057.stdout:3/643: dread - d0/d4/d34/d3c/d53/d7f/fba zero size 2024-04-25T22:42:16.830 INFO:tasks.workunit.client.0.smithi057.stdout:2/772: rmdir d1f/de7/d4d/d88/dd9 39 2024-04-25T22:42:16.831 INFO:tasks.workunit.client.0.smithi057.stdout:4/702: stat d14/d2f/d4c/d5b/daa/fb0 0 2024-04-25T22:42:16.831 INFO:tasks.workunit.client.0.smithi057.stdout:1/676: creat d7/dd/d16/d24/fdb x:0 0 0 2024-04-25T22:42:16.831 INFO:tasks.workunit.client.0.smithi057.stdout:3/644: chown d0/d4/f90 1350307552 1 2024-04-25T22:42:16.831 INFO:tasks.workunit.client.0.smithi057.stdout:9/675: unlink d3/d34/f6b 0 2024-04-25T22:42:16.832 INFO:tasks.workunit.client.0.smithi057.stdout:6/770: link d2/d19/d9b/df3/d31/d83/ff6 d2/d19/d9b/df3/d5e/dda/ff9 0 2024-04-25T22:42:16.832 INFO:tasks.workunit.client.0.smithi057.stdout:1/677: rmdir d7/d65/d6a/d98/d41 39 2024-04-25T22:42:16.832 INFO:tasks.workunit.client.0.smithi057.stdout:8/646: mkdir d4/d5/d17/d19/d35/d83/d92/d5b/d8c/de9 0 2024-04-25T22:42:16.834 INFO:tasks.workunit.client.0.smithi057.stdout:2/773: creat d1f/de7/d4d/d88/dd9/f10f x:0 0 0 2024-04-25T22:42:16.834 INFO:tasks.workunit.client.0.smithi057.stdout:4/703: link d14/d5a/d67/dcc/fd6 d14/d5a/d67/dcc/dce/fe0 0 2024-04-25T22:42:16.834 INFO:tasks.workunit.client.0.smithi057.stdout:3/645: getdents d0/d4/d34/d3c 0 2024-04-25T22:42:16.834 INFO:tasks.workunit.client.0.smithi057.stdout:6/771: rename d2/d19/d9b/df3/d31 to d2/d19/d9b/df3/d31/d83/dba/dbe/dfa 22 2024-04-25T22:42:16.834 INFO:tasks.workunit.client.0.smithi057.stdout:1/678: mkdir d7/dd/d16/d24/d63/ddc 0 2024-04-25T22:42:16.835 INFO:tasks.workunit.client.0.smithi057.stdout:2/774: chown d1f/de7/l48 14885888 1 2024-04-25T22:42:16.835 INFO:tasks.workunit.client.0.smithi057.stdout:7/647: read d6/d28/f5b [238910,70516] 0 2024-04-25T22:42:16.836 INFO:tasks.workunit.client.0.smithi057.stdout:6/772: chown d2/d86/d90/cf8 371328015 1 2024-04-25T22:42:16.836 INFO:tasks.workunit.client.0.smithi057.stdout:1/679: mkdir d7/ddd 0 2024-04-25T22:42:16.836 INFO:tasks.workunit.client.0.smithi057.stdout:3/646: rename d0/d4/d34/f77 to d0/d11/fdd 0 2024-04-25T22:42:16.837 INFO:tasks.workunit.client.0.smithi057.stdout:2/775: rename d1f/d34/d50/fc3 to d1f/d21/df6/f110 0 2024-04-25T22:42:16.837 INFO:tasks.workunit.client.0.smithi057.stdout:9/676: dread d3/d34/d42/d28/f51 [0,4194304] 0 2024-04-25T22:42:16.838 INFO:tasks.workunit.client.0.smithi057.stdout:3/647: creat d0/d4/d34/d3c/d53/d7f/fde x:0 0 0 2024-04-25T22:42:16.839 INFO:tasks.workunit.client.0.smithi057.stdout:5/767: truncate d2/d1c/d24/d3d/d77/fa2 1347741 0 2024-04-25T22:42:16.839 INFO:tasks.workunit.client.0.smithi057.stdout:1/680: mknod d7/dd/d16/d18/cde 0 2024-04-25T22:42:16.839 INFO:tasks.workunit.client.0.smithi057.stdout:6/773: write d2/d19/d9b/df3/f53 [4956401,77128] 0 2024-04-25T22:42:16.840 INFO:tasks.workunit.client.0.smithi057.stdout:7/648: dread d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d97/fa3 [0,4194304] 0 2024-04-25T22:42:16.840 INFO:tasks.workunit.client.0.smithi057.stdout:9/677: write d3/fa1 [1397936,69125] 0 2024-04-25T22:42:16.841 INFO:tasks.workunit.client.0.smithi057.stdout:2/776: write d1f/d36/d54/dec/f100 [355980,63456] 0 2024-04-25T22:42:16.841 INFO:tasks.workunit.client.0.smithi057.stdout:4/704: truncate d14/da9/f7d 1098004 0 2024-04-25T22:42:16.841 INFO:tasks.workunit.client.0.smithi057.stdout:5/768: creat d2/d47/da5/fef x:0 0 0 2024-04-25T22:42:16.842 INFO:tasks.workunit.client.0.smithi057.stdout:6/774: mkdir d2/d19/d20/d61/dbf/dfb 0 2024-04-25T22:42:16.842 INFO:tasks.workunit.client.0.smithi057.stdout:6/775: sync 2024-04-25T22:42:16.842 INFO:tasks.workunit.client.0.smithi057.stdout:8/647: dwrite d4/d5/d2f/fb4 [0,4194304] 0 2024-04-25T22:42:16.843 INFO:tasks.workunit.client.0.smithi057.stdout:5/769: stat d2/d47/ca9 0 2024-04-25T22:42:16.843 INFO:tasks.workunit.client.0.smithi057.stdout:4/705: write d14/f1c [5047720,82784] 0 2024-04-25T22:42:16.843 INFO:tasks.workunit.client.0.smithi057.stdout:3/648: rename d0/d4/d7/d46/d30/f6d to d0/d4/d7/d46/d30/d7a/fdf 0 2024-04-25T22:42:16.844 INFO:tasks.workunit.client.0.smithi057.stdout:7/649: creat d6/d28/d4e/fd8 x:0 0 0 2024-04-25T22:42:16.844 INFO:tasks.workunit.client.0.smithi057.stdout:6/776: write d2/d19/d26/d63/f7d [5186583,44290] 0 2024-04-25T22:42:16.845 INFO:tasks.workunit.client.0.smithi057.stdout:1/681: getdents d7/d65/d6a/d98/d41/d75 0 2024-04-25T22:42:16.845 INFO:tasks.workunit.client.0.smithi057.stdout:5/770: write d2/fe [2045114,67878] 0 2024-04-25T22:42:16.845 INFO:tasks.workunit.client.0.smithi057.stdout:7/650: chown d6/d28/d4e/d30/d60 6855473 1 2024-04-25T22:42:16.845 INFO:tasks.workunit.client.0.smithi057.stdout:2/777: chown d1f/de7/d4d/d88/dd9/da1/ddc/f108 6901 1 2024-04-25T22:42:16.845 INFO:tasks.workunit.client.0.smithi057.stdout:3/649: write d0/d4/d7b/f9f [2373181,126966] 0 2024-04-25T22:42:16.846 INFO:tasks.workunit.client.0.smithi057.stdout:6/777: creat d2/d19/d26/ffc x:0 0 0 2024-04-25T22:42:16.851 INFO:tasks.workunit.client.0.smithi057.stdout:2/778: write d1f/d36/f7b [51747,53444] 0 2024-04-25T22:42:16.851 INFO:tasks.workunit.client.0.smithi057.stdout:7/651: write d6/d28/f41 [4901220,102646] 0 2024-04-25T22:42:16.851 INFO:tasks.workunit.client.0.smithi057.stdout:4/706: link d14/d47/f9e d14/d2f/d4c/d5b/db8/fe1 0 2024-04-25T22:42:16.851 INFO:tasks.workunit.client.0.smithi057.stdout:1/682: unlink d7/dd/d26/d9a/ld7 0 2024-04-25T22:42:16.851 INFO:tasks.workunit.client.0.smithi057.stdout:5/771: truncate d2/d47/da5/fef 362555 0 2024-04-25T22:42:16.851 INFO:tasks.workunit.client.0.smithi057.stdout:1/683: fsync d7/f92 0 2024-04-25T22:42:16.851 INFO:tasks.workunit.client.0.smithi057.stdout:4/707: mknod d14/d5a/ce2 0 2024-04-25T22:42:16.852 INFO:tasks.workunit.client.0.smithi057.stdout:2/779: write d1f/de7/d4d/d88/dd9/da1/fa8 [344285,55522] 0 2024-04-25T22:42:16.852 INFO:tasks.workunit.client.0.smithi057.stdout:3/650: creat d0/d4/d7/d46/d30/d7a/d91/fe0 x:0 0 0 2024-04-25T22:42:16.852 INFO:tasks.workunit.client.0.smithi057.stdout:5/772: creat d2/d1c/d24/ff0 x:0 0 0 2024-04-25T22:42:16.852 INFO:tasks.workunit.client.0.smithi057.stdout:7/652: rename d6/d28/d4e/d30/d60/d6f/cb3 to d6/d28/d4e/d30/d60/d6f/d9c/cd9 0 2024-04-25T22:42:16.852 INFO:tasks.workunit.client.0.smithi057.stdout:5/773: fsync d2/d1c/d24/f86 0 2024-04-25T22:42:16.852 INFO:tasks.workunit.client.0.smithi057.stdout:2/780: unlink d1f/de7/d4d/d88/dd9/ffb 0 2024-04-25T22:42:16.852 INFO:tasks.workunit.client.0.smithi057.stdout:7/653: mkdir d6/daa/dda 0 2024-04-25T22:42:16.853 INFO:tasks.workunit.client.0.smithi057.stdout:3/651: creat d0/d4/d7/d26/d89/d97/dc1/fe1 x:0 0 0 2024-04-25T22:42:16.853 INFO:tasks.workunit.client.0.smithi057.stdout:1/684: truncate d7/dd/d16/d24/f3a 7401515 0 2024-04-25T22:42:16.853 INFO:tasks.workunit.client.0.smithi057.stdout:2/781: write d1f/d36/d54/fc5 [1003762,65947] 0 2024-04-25T22:42:16.854 INFO:tasks.workunit.client.0.smithi057.stdout:3/652: rmdir d0/d4/d7b 39 2024-04-25T22:42:16.855 INFO:tasks.workunit.client.0.smithi057.stdout:5/774: write d2/d1c/d46/d3a/da8/fbc [1503757,88058] 0 2024-04-25T22:42:16.855 INFO:tasks.workunit.client.0.smithi057.stdout:8/648: dwrite d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/fde [0,4194304] 0 2024-04-25T22:42:16.855 INFO:tasks.workunit.client.0.smithi057.stdout:6/778: write d2/d19/d26/d4f/d95/fb6 [620225,63378] 0 2024-04-25T22:42:16.856 INFO:tasks.workunit.client.0.smithi057.stdout:1/685: chown d7/dd/d16/d24/fdb 11035927 1 2024-04-25T22:42:16.857 INFO:tasks.workunit.client.0.smithi057.stdout:9/678: dread d3/d34/d42/d28/d65/f8e [4194304,4194304] 0 2024-04-25T22:42:16.857 INFO:tasks.workunit.client.0.smithi057.stdout:3/653: symlink d0/d4/d96/le2 0 2024-04-25T22:42:16.857 INFO:tasks.workunit.client.0.smithi057.stdout:8/649: chown d4/d5/d2f/f5f 3 1 2024-04-25T22:42:16.858 INFO:tasks.workunit.client.0.smithi057.stdout:3/654: fdatasync d0/d4/d7/d26/f63 0 2024-04-25T22:42:16.859 INFO:tasks.workunit.client.0.smithi057.stdout:0/670: dread d0/d3/d88/da3/dec/f89 [0,4194304] 0 2024-04-25T22:42:16.859 INFO:tasks.workunit.client.0.smithi057.stdout:9/679: mkdir d3/dd8 0 2024-04-25T22:42:16.859 INFO:tasks.workunit.client.0.smithi057.stdout:5/775: creat d2/d47/ded/ff1 x:0 0 0 2024-04-25T22:42:16.859 INFO:tasks.workunit.client.0.smithi057.stdout:1/686: write d7/dd/d16/d18/d31/f9c [937901,94389] 0 2024-04-25T22:42:16.860 INFO:tasks.workunit.client.0.smithi057.stdout:2/782: dread f1d [0,4194304] 0 2024-04-25T22:42:16.860 INFO:tasks.workunit.client.0.smithi057.stdout:8/650: chown d4/d5/d17/d19/d35/d83/d92/d5b/d8c 899250 1 2024-04-25T22:42:16.861 INFO:tasks.workunit.client.0.smithi057.stdout:2/783: chown d1f/d34 8 1 2024-04-25T22:42:16.861 INFO:tasks.workunit.client.0.smithi057.stdout:8/651: fsync d4/d5/f7 0 2024-04-25T22:42:16.861 INFO:tasks.workunit.client.0.smithi057.stdout:9/680: rmdir d3/d98/db0 39 2024-04-25T22:42:16.862 INFO:tasks.workunit.client.0.smithi057.stdout:2/784: creat d1f/de7/d4d/f111 x:0 0 0 2024-04-25T22:42:16.863 INFO:tasks.workunit.client.0.smithi057.stdout:1/687: read d7/f92 [136640,82654] 0 2024-04-25T22:42:16.863 INFO:tasks.workunit.client.0.smithi057.stdout:0/671: creat d0/d3/d4d/d87/fee x:0 0 0 2024-04-25T22:42:16.863 INFO:tasks.workunit.client.0.smithi057.stdout:9/681: creat d3/d34/d42/d28/d2d/d9c/fd9 x:0 0 0 2024-04-25T22:42:16.865 INFO:tasks.workunit.client.0.smithi057.stdout:7/654: dwrite d6/d28/d4e/d30/d60/d8d/fa9 [0,4194304] 0 2024-04-25T22:42:16.865 INFO:tasks.workunit.client.0.smithi057.stdout:1/688: readlink d7/d65/d6a/d98/l58 0 2024-04-25T22:42:16.865 INFO:tasks.workunit.client.0.smithi057.stdout:0/672: stat d0/d3/d6/d71/c84 0 2024-04-25T22:42:16.866 INFO:tasks.workunit.client.0.smithi057.stdout:7/655: unlink d6/d28/f66 0 2024-04-25T22:42:16.868 INFO:tasks.workunit.client.0.smithi057.stdout:7/656: chown d6/lc9 0 1 2024-04-25T22:42:16.868 INFO:tasks.workunit.client.0.smithi057.stdout:9/682: truncate d3/f1a 132368 0 2024-04-25T22:42:16.869 INFO:tasks.workunit.client.0.smithi057.stdout:3/655: dwrite d0/d4/d7/d22/f59 [0,4194304] 0 2024-04-25T22:42:16.870 INFO:tasks.workunit.client.0.smithi057.stdout:5/776: dwrite d2/d1c/d24/d3d/fd5 [0,4194304] 0 2024-04-25T22:42:16.870 INFO:tasks.workunit.client.0.smithi057.stdout:9/683: mkdir d3/d34/d42/d28/dc1/dda 0 2024-04-25T22:42:16.871 INFO:tasks.workunit.client.0.smithi057.stdout:3/656: symlink d0/d4/d7/le3 0 2024-04-25T22:42:16.871 INFO:tasks.workunit.client.0.smithi057.stdout:1/689: rename d7/dd/d16/d24/d63/dc7/db0/fda to d7/dd/d16/d24/fdf 0 2024-04-25T22:42:16.871 INFO:tasks.workunit.client.0.smithi057.stdout:5/777: truncate d2/d1c/f63 5555194 0 2024-04-25T22:42:16.872 INFO:tasks.workunit.client.0.smithi057.stdout:4/708: dread d14/d2f/d4c/fa8 [0,4194304] 0 2024-04-25T22:42:16.872 INFO:tasks.workunit.client.0.smithi057.stdout:2/785: write d1f/d21/f25 [1677824,101318] 0 2024-04-25T22:42:16.872 INFO:tasks.workunit.client.0.smithi057.stdout:8/652: write d4/d5/d17/d19/d35/d83/d92/f55 [583095,114843] 0 2024-04-25T22:42:16.873 INFO:tasks.workunit.client.0.smithi057.stdout:3/657: stat d0/d4/d34/d3c/d53/c58 0 2024-04-25T22:42:16.873 INFO:tasks.workunit.client.0.smithi057.stdout:5/778: read d2/d47/d60/f6d [845139,80624] 0 2024-04-25T22:42:16.874 INFO:tasks.workunit.client.0.smithi057.stdout:1/690: write d7/dd/d16/d24/d63/dc7/fc3 [396528,129787] 0 2024-04-25T22:42:16.874 INFO:tasks.workunit.client.0.smithi057.stdout:2/786: mknod d1f/d21/d26/d5c/c112 0 2024-04-25T22:42:16.874 INFO:tasks.workunit.client.0.smithi057.stdout:9/684: rename d3/d34/d42/d28/d62/d67/d6e/fb6 to d3/d34/d42/d28/d62/d67/d6e/d7c/fdb 0 2024-04-25T22:42:16.875 INFO:tasks.workunit.client.0.smithi057.stdout:8/653: symlink d4/db/d72/dbd/lea 0 2024-04-25T22:42:16.875 INFO:tasks.workunit.client.0.smithi057.stdout:4/709: chown d14/da9/f98 358769074 1 2024-04-25T22:42:16.875 INFO:tasks.workunit.client.0.smithi057.stdout:3/658: mknod d0/d4/d34/ce4 0 2024-04-25T22:42:16.875 INFO:tasks.workunit.client.0.smithi057.stdout:2/787: rmdir d1f/d21/d33/daa 39 2024-04-25T22:42:16.876 INFO:tasks.workunit.client.0.smithi057.stdout:4/710: creat d14/da2/fe3 x:0 0 0 2024-04-25T22:42:16.876 INFO:tasks.workunit.client.0.smithi057.stdout:1/691: getdents d7/ddd 0 2024-04-25T22:42:16.876 INFO:tasks.workunit.client.0.smithi057.stdout:4/711: sync 2024-04-25T22:42:16.876 INFO:tasks.workunit.client.0.smithi057.stdout:5/779: mknod d2/d1c/d24/d3d/d50/cf2 0 2024-04-25T22:42:16.876 INFO:tasks.workunit.client.0.smithi057.stdout:8/654: dread - d4/d5/d17/f73 zero size 2024-04-25T22:42:16.877 INFO:tasks.workunit.client.0.smithi057.stdout:2/788: fsync d1f/d21/d26/d63/fa4 0 2024-04-25T22:42:16.877 INFO:tasks.workunit.client.0.smithi057.stdout:9/685: truncate d3/d34/d42/d28/d2d/d7a/f9d 1026853 0 2024-04-25T22:42:16.877 INFO:tasks.workunit.client.0.smithi057.stdout:4/712: chown d14/d3d/l4d 3 1 2024-04-25T22:42:16.878 INFO:tasks.workunit.client.0.smithi057.stdout:8/655: mkdir d4/deb 0 2024-04-25T22:42:16.878 INFO:tasks.workunit.client.0.smithi057.stdout:1/692: mkdir d7/dd/d26/de0 0 2024-04-25T22:42:16.878 INFO:tasks.workunit.client.0.smithi057.stdout:4/713: sync 2024-04-25T22:42:16.878 INFO:tasks.workunit.client.0.smithi057.stdout:3/659: mkdir d0/d4/d7/d26/d72/dd0/de5 0 2024-04-25T22:42:16.878 INFO:tasks.workunit.client.0.smithi057.stdout:2/789: chown d1f/d21/d33/c59 5 1 2024-04-25T22:42:16.879 INFO:tasks.workunit.client.0.smithi057.stdout:8/656: mkdir d4/d5/d17/d19/dec 0 2024-04-25T22:42:16.879 INFO:tasks.workunit.client.0.smithi057.stdout:1/693: fdatasync d7/d4e/f9b 0 2024-04-25T22:42:16.879 INFO:tasks.workunit.client.0.smithi057.stdout:9/686: fsync d3/d34/d42/d28/f51 0 2024-04-25T22:42:16.879 INFO:tasks.workunit.client.0.smithi057.stdout:2/790: rmdir d1f/d21 39 2024-04-25T22:42:16.879 INFO:tasks.workunit.client.0.smithi057.stdout:4/714: write d14/d2f/d4c/d5b/fca [494206,78983] 0 2024-04-25T22:42:16.880 INFO:tasks.workunit.client.0.smithi057.stdout:3/660: readlink d0/d4/d7/d46/d30/d99/lc5 0 2024-04-25T22:42:16.880 INFO:tasks.workunit.client.0.smithi057.stdout:2/791: mknod d1f/c113 0 2024-04-25T22:42:16.881 INFO:tasks.workunit.client.0.smithi057.stdout:9/687: write d3/f9 [1322161,109217] 0 2024-04-25T22:42:16.881 INFO:tasks.workunit.client.0.smithi057.stdout:5/780: dread d2/d47/da5/dd3/f82 [0,4194304] 0 2024-04-25T22:42:16.884 INFO:tasks.workunit.client.0.smithi057.stdout:1/694: rename d7/dd/d26/de0 to d7/d65/d6a/d98/d41/de1 0 2024-04-25T22:42:16.884 INFO:tasks.workunit.client.0.smithi057.stdout:3/661: write d0/d5b/f8e [412099,107096] 0 2024-04-25T22:42:16.884 INFO:tasks.workunit.client.0.smithi057.stdout:7/657: dwrite d6/d28/d4e/d30/d46/f99 [0,4194304] 0 2024-04-25T22:42:16.886 INFO:tasks.workunit.client.0.smithi057.stdout:5/781: link d2/l1e d2/d6/db/lf3 0 2024-04-25T22:42:16.886 INFO:tasks.workunit.client.0.smithi057.stdout:1/695: symlink d7/ddd/le2 0 2024-04-25T22:42:16.887 INFO:tasks.workunit.client.0.smithi057.stdout:3/662: symlink d0/d4/d34/d3c/d70/dc0/le6 0 2024-04-25T22:42:16.887 INFO:tasks.workunit.client.0.smithi057.stdout:4/715: dread d14/f28 [0,4194304] 0 2024-04-25T22:42:16.891 INFO:tasks.workunit.client.0.smithi057.stdout:2/792: dwrite d1f/de7/f9b [0,4194304] 0 2024-04-25T22:42:16.891 INFO:tasks.workunit.client.0.smithi057.stdout:8/657: dwrite d4/db/f34 [4194304,4194304] 0 2024-04-25T22:42:16.891 INFO:tasks.workunit.client.0.smithi057.stdout:5/782: creat d2/d1c/d46/d3a/ff4 x:0 0 0 2024-04-25T22:42:16.893 INFO:tasks.workunit.client.0.smithi057.stdout:0/673: dread d0/d3/d6/d14/d39/f56 [0,4194304] 0 2024-04-25T22:42:16.893 INFO:tasks.workunit.client.0.smithi057.stdout:2/793: stat d1f/d34/d50/la7 0 2024-04-25T22:42:16.893 INFO:tasks.workunit.client.0.smithi057.stdout:9/688: dwrite d3/d34/d42/d28/d62/d67/d6e/fbf [0,4194304] 0 2024-04-25T22:42:16.894 INFO:tasks.workunit.client.0.smithi057.stdout:8/658: symlink d4/d5/d21/db0/led 0 2024-04-25T22:42:16.896 INFO:tasks.workunit.client.0.smithi057.stdout:8/659: readlink d4/d5/d21/ld3 0 2024-04-25T22:42:16.896 INFO:tasks.workunit.client.0.smithi057.stdout:7/658: dwrite d6/d28/d4e/d30/d60/d8d/d96/fce [8388608,4194304] 0 2024-04-25T22:42:16.897 INFO:tasks.workunit.client.0.smithi057.stdout:2/794: creat d1f/d21/d26/d63/d7f/f114 x:0 0 0 2024-04-25T22:42:16.899 INFO:tasks.workunit.client.0.smithi057.stdout:0/674: creat d0/d5/d53/fef x:0 0 0 2024-04-25T22:42:16.899 INFO:tasks.workunit.client.0.smithi057.stdout:2/795: write d1f/d21/f2e [8182364,23871] 0 2024-04-25T22:42:16.899 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:16.895+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:16.899 INFO:tasks.workunit.client.0.smithi057.stdout:8/660: creat d4/d5/fee x:0 0 0 2024-04-25T22:42:16.900 INFO:tasks.workunit.client.0.smithi057.stdout:4/716: dwrite d14/f22 [4194304,4194304] 0 2024-04-25T22:42:16.901 INFO:tasks.workunit.client.0.smithi057.stdout:2/796: stat d1f/d34/d50/df0/ff4 0 2024-04-25T22:42:16.901 INFO:tasks.workunit.client.0.smithi057.stdout:4/717: rmdir d14/d2f/d4c/d5b/daa 39 2024-04-25T22:42:16.901 INFO:tasks.workunit.client.0.smithi057.stdout:9/689: getdents d3/d34/d42/d5e/da3 0 2024-04-25T22:42:16.901 INFO:tasks.workunit.client.0.smithi057.stdout:8/661: rename d4/d5/d17/l29 to d4/d5/d2f/lef 0 2024-04-25T22:42:16.901 INFO:tasks.workunit.client.0.smithi057.stdout:7/659: dread - d6/d28/d4e/d30/d60/d8d/d96/d51/dad/f8f zero size 2024-04-25T22:42:16.902 INFO:tasks.workunit.client.0.smithi057.stdout:9/690: write d3/d34/d42/f41 [1409625,17727] 0 2024-04-25T22:42:16.903 INFO:tasks.workunit.client.0.smithi057.stdout:5/783: dwrite d2/d47/da5/f8e [4194304,4194304] 0 2024-04-25T22:42:16.903 INFO:tasks.workunit.client.0.smithi057.stdout:2/797: mknod d1f/d34/d50/df0/df3/c115 0 2024-04-25T22:42:16.904 INFO:tasks.workunit.client.0.smithi057.stdout:8/662: creat d4/d5/d17/d19/d35/d83/d92/d5b/d8c/ff0 x:0 0 0 2024-04-25T22:42:16.904 INFO:tasks.workunit.client.0.smithi057.stdout:5/784: readlink d2/d1c/d46/d3a/lbf 0 2024-04-25T22:42:16.904 INFO:tasks.workunit.client.0.smithi057.stdout:9/691: write d3/d34/d42/d28/d65/f8e [5264964,6311] 0 2024-04-25T22:42:16.905 INFO:tasks.workunit.client.0.smithi057.stdout:8/663: symlink d4/db/dd/lf1 0 2024-04-25T22:42:16.907 INFO:tasks.workunit.client.0.smithi057.stdout:9/692: write d3/d34/d42/d28/d2d/f6c [488079,115113] 0 2024-04-25T22:42:16.907 INFO:tasks.workunit.client.0.smithi057.stdout:2/798: link d1f/d34/d50/df0/df3/c115 d1f/d21/d26/d5c/c116 0 2024-04-25T22:42:16.907 INFO:tasks.workunit.client.0.smithi057.stdout:8/664: symlink d4/deb/lf2 0 2024-04-25T22:42:16.909 INFO:tasks.workunit.client.0.smithi057.stdout:9/693: stat d3/d34/d42/d28/cb4 0 2024-04-25T22:42:16.909 INFO:tasks.workunit.client.0.smithi057.stdout:2/799: read - d1f/d21/fc2 zero size 2024-04-25T22:42:16.910 INFO:tasks.workunit.client.0.smithi057.stdout:5/785: rename d2/d47/da5/dd3/f98 to d2/d1c/d46/d3a/d6a/ff5 0 2024-04-25T22:42:16.911 INFO:tasks.workunit.client.0.smithi057.stdout:0/675: dwrite d0/d3/d6/d83/fad [0,4194304] 0 2024-04-25T22:42:16.912 INFO:tasks.workunit.client.0.smithi057.stdout:4/718: dwrite d14/da9/d44/f46 [0,4194304] 0 2024-04-25T22:42:16.916 INFO:tasks.workunit.client.0.smithi057.stdout:7/660: dwrite d6/d28/d4e/d30/d60/d8d/d96/d5d/f5e [0,4194304] 0 2024-04-25T22:42:16.916 INFO:tasks.workunit.client.0.smithi057.stdout:5/786: mkdir d2/d1c/d24/d3d/deb/df6 0 2024-04-25T22:42:16.916 INFO:tasks.workunit.client.0.smithi057.stdout:4/719: chown d14/d2f/fa3 22 1 2024-04-25T22:42:16.917 INFO:tasks.workunit.client.0.smithi057.stdout:5/787: sync 2024-04-25T22:42:16.917 INFO:tasks.workunit.client.0.smithi057.stdout:6/779: dread d2/d19/d9b/df3/d5e/dda/ff9 [0,4194304] 0 2024-04-25T22:42:16.917 INFO:tasks.workunit.client.0.smithi057.stdout:0/676: rename d0/d3/dae/fb1 to d0/d3/dae/ff0 0 2024-04-25T22:42:16.917 INFO:tasks.workunit.client.0.smithi057.stdout:4/720: dread - d14/d47/d62/fdd zero size 2024-04-25T22:42:16.917 INFO:tasks.workunit.client.0.smithi057.stdout:5/788: write d2/d1c/d24/d3d/da7/fc1 [24657,29984] 0 2024-04-25T22:42:16.917 INFO:tasks.workunit.client.0.smithi057.stdout:0/677: creat d0/d5/ff1 x:0 0 0 2024-04-25T22:42:16.918 INFO:tasks.workunit.client.0.smithi057.stdout:5/789: mkdir d2/d1c/d46/dd0/df7 0 2024-04-25T22:42:16.919 INFO:tasks.workunit.client.0.smithi057.stdout:6/780: creat d2/d19/d26/d63/ffd x:0 0 0 2024-04-25T22:42:16.919 INFO:tasks.workunit.client.0.smithi057.stdout:4/721: link d14/d47/d62/f6a d14/da2/fe4 0 2024-04-25T22:42:16.919 INFO:tasks.workunit.client.0.smithi057.stdout:7/661: link d6/d28/d4e/d30/d60/f86 d6/d88/fdb 0 2024-04-25T22:42:16.919 INFO:tasks.workunit.client.0.smithi057.stdout:2/800: dwrite d1f/d21/d33/f87 [0,4194304] 0 2024-04-25T22:42:16.919 INFO:tasks.workunit.client.0.smithi057.stdout:0/678: unlink d0/d3/d88/da3/dec/f79 0 2024-04-25T22:42:16.921 INFO:tasks.workunit.client.0.smithi057.stdout:6/781: mknod d2/d19/d49/d62/d79/cfe 0 2024-04-25T22:42:16.921 INFO:tasks.workunit.client.0.smithi057.stdout:0/679: unlink d0/d3/f2f 0 2024-04-25T22:42:16.921 INFO:tasks.workunit.client.0.smithi057.stdout:2/801: stat d1f/d34/d50/fa5 0 2024-04-25T22:42:16.921 INFO:tasks.workunit.client.0.smithi057.stdout:7/662: symlink d6/d28/d4e/d30/d46/d73/ldc 0 2024-04-25T22:42:16.922 INFO:tasks.workunit.client.0.smithi057.stdout:2/802: creat d1f/d34/d50/df0/df3/f117 x:0 0 0 2024-04-25T22:42:16.923 INFO:tasks.workunit.client.0.smithi057.stdout:7/663: write d6/d28/d4e/f8c [947928,13670] 0 2024-04-25T22:42:16.923 INFO:tasks.workunit.client.0.smithi057.stdout:6/782: mknod d2/d19/d9b/df3/d31/d83/daa/cff 0 2024-04-25T22:42:16.923 INFO:tasks.workunit.client.0.smithi057.stdout:5/790: rename d2/d1c/d24/d3d/la1 to d2/d1c/d46/d3a/d6a/lf8 0 2024-04-25T22:42:16.925 INFO:tasks.workunit.client.0.smithi057.stdout:0/680: link d0/d3/d6/f1b d0/d3/d4d/d87/ff2 0 2024-04-25T22:42:16.925 INFO:tasks.workunit.client.0.smithi057.stdout:2/803: readlink d1f/d21/d26/d63/d7f/lfc 0 2024-04-25T22:42:16.926 INFO:tasks.workunit.client.0.smithi057.stdout:6/783: fdatasync d2/d19/d49/d62/f7b 0 2024-04-25T22:42:16.926 INFO:tasks.workunit.client.0.smithi057.stdout:7/664: creat d6/d28/d4e/fdd x:0 0 0 2024-04-25T22:42:16.926 INFO:tasks.workunit.client.0.smithi057.stdout:0/681: creat d0/d49/d97/ff3 x:0 0 0 2024-04-25T22:42:16.926 INFO:tasks.workunit.client.0.smithi057.stdout:2/804: creat d1f/d21/d26/d5c/f118 x:0 0 0 2024-04-25T22:42:16.927 INFO:tasks.workunit.client.0.smithi057.stdout:4/722: dwrite d14/f20 [0,4194304] 0 2024-04-25T22:42:16.927 INFO:tasks.workunit.client.0.smithi057.stdout:5/791: link d2/d6/c7c d2/d47/ded/cf9 0 2024-04-25T22:42:16.927 INFO:tasks.workunit.client.0.smithi057.stdout:0/682: stat d0/d5/l1e 0 2024-04-25T22:42:16.928 INFO:tasks.workunit.client.0.smithi057.stdout:0/683: chown d0 17070589 1 2024-04-25T22:42:16.928 INFO:tasks.workunit.client.0.smithi057.stdout:4/723: stat d14/d5a/d67/db4 0 2024-04-25T22:42:16.928 INFO:tasks.workunit.client.0.smithi057.stdout:2/805: creat d1f/d21/d105/f119 x:0 0 0 2024-04-25T22:42:16.928 INFO:tasks.workunit.client.0.smithi057.stdout:5/792: stat d2/d1c/d46/d3a/da8 0 2024-04-25T22:42:16.928 INFO:tasks.workunit.client.0.smithi057.stdout:0/684: mkdir d0/d3/d4d/df4 0 2024-04-25T22:42:16.929 INFO:tasks.workunit.client.0.smithi057.stdout:4/724: symlink d14/le5 0 2024-04-25T22:42:16.929 INFO:tasks.workunit.client.0.smithi057.stdout:2/806: rename d1f/d36/l4c to d1f/dea/l11a 0 2024-04-25T22:42:16.929 INFO:tasks.workunit.client.0.smithi057.stdout:5/793: symlink d2/d1c/d24/d8f/lfa 0 2024-04-25T22:42:16.929 INFO:tasks.workunit.client.0.smithi057.stdout:0/685: symlink d0/d49/d6d/lf5 0 2024-04-25T22:42:16.930 INFO:tasks.workunit.client.0.smithi057.stdout:2/807: readlink d1f/l28 0 2024-04-25T22:42:16.930 INFO:tasks.workunit.client.0.smithi057.stdout:0/686: chown d0/d3/d6/d83/fad 2679 1 2024-04-25T22:42:16.930 INFO:tasks.workunit.client.0.smithi057.stdout:5/794: unlink d2/d1c/l40 0 2024-04-25T22:42:16.931 INFO:tasks.workunit.client.0.smithi057.stdout:0/687: write d0/f8c [546490,40446] 0 2024-04-25T22:42:16.931 INFO:tasks.workunit.client.0.smithi057.stdout:1/696: dread d7/dd/d16/d24/d63/f66 [0,4194304] 0 2024-04-25T22:42:16.931 INFO:tasks.workunit.client.0.smithi057.stdout:2/808: rename d1f/d21/c8c to d1f/de7/db1/c11b 0 2024-04-25T22:42:16.931 INFO:tasks.workunit.client.0.smithi057.stdout:2/809: readlink d1f/d34/lfd 0 2024-04-25T22:42:16.932 INFO:tasks.workunit.client.0.smithi057.stdout:1/697: fdatasync d7/d4e/f81 0 2024-04-25T22:42:16.932 INFO:tasks.workunit.client.0.smithi057.stdout:5/795: getdents d2/d91 0 2024-04-25T22:42:16.933 INFO:tasks.workunit.client.0.smithi057.stdout:0/688: creat d0/d3/d3a/ff6 x:0 0 0 2024-04-25T22:42:16.933 INFO:tasks.workunit.client.0.smithi057.stdout:5/796: fsync d2/d2c/f5c 0 2024-04-25T22:42:16.933 INFO:tasks.workunit.client.0.smithi057.stdout:2/810: mkdir d1f/d36/d54/dec/d11c 0 2024-04-25T22:42:16.934 INFO:tasks.workunit.client.0.smithi057.stdout:1/698: link d7/l89 d7/dd/d16/d18/d31/le3 0 2024-04-25T22:42:16.934 INFO:tasks.workunit.client.0.smithi057.stdout:2/811: fsync d1f/d21/f3e 0 2024-04-25T22:42:16.934 INFO:tasks.workunit.client.0.smithi057.stdout:1/699: chown d7/dd/d90/fb5 42 1 2024-04-25T22:42:16.935 INFO:tasks.workunit.client.0.smithi057.stdout:2/812: fdatasync d1f/de7/d4d/d88/f101 0 2024-04-25T22:42:16.936 INFO:tasks.workunit.client.0.smithi057.stdout:1/700: rename d7/dd/d16/d24/d61/fd2 to d7/ddd/fe4 0 2024-04-25T22:42:16.936 INFO:tasks.workunit.client.0.smithi057.stdout:2/813: creat d1f/d21/d26/d5c/f11d x:0 0 0 2024-04-25T22:42:16.937 INFO:tasks.workunit.client.0.smithi057.stdout:2/814: mknod d1f/de7/c11e 0 2024-04-25T22:42:16.939 INFO:tasks.workunit.client.0.smithi057.stdout:0/689: dwrite d0/d49/f9e [0,4194304] 0 2024-04-25T22:42:16.940 INFO:tasks.workunit.client.0.smithi057.stdout:0/690: rmdir d0/d3/d4d/d87/d91 39 2024-04-25T22:42:16.941 INFO:tasks.workunit.client.0.smithi057.stdout:0/691: write d0/d3/d3a/d3b/fd0 [2455698,95374] 0 2024-04-25T22:42:16.941 INFO:tasks.workunit.client.0.smithi057.stdout:1/701: dwrite d7/d4e/f81 [0,4194304] 0 2024-04-25T22:42:16.942 INFO:tasks.workunit.client.0.smithi057.stdout:1/702: creat d7/d65/fe5 x:0 0 0 2024-04-25T22:42:16.948 INFO:tasks.workunit.client.0.smithi057.stdout:1/703: dwrite d7/dd/d16/d24/d63/fca [0,4194304] 0 2024-04-25T22:42:16.949 INFO:tasks.workunit.client.0.smithi057.stdout:1/704: write d7/d4e/f9b [330086,1398] 0 2024-04-25T22:42:16.949 INFO:tasks.workunit.client.0.smithi057.stdout:1/705: sync 2024-04-25T22:42:16.950 INFO:tasks.workunit.client.0.smithi057.stdout:0/692: read d0/d3/d3a/f40 [83153,70519] 0 2024-04-25T22:42:16.950 INFO:tasks.workunit.client.0.smithi057.stdout:1/706: unlink d7/dd/d16/d18/fab 0 2024-04-25T22:42:16.953 INFO:tasks.workunit.client.0.smithi057.stdout:4/725: truncate d14/d47/d62/f6a 748550 0 2024-04-25T22:42:16.954 INFO:tasks.workunit.client.0.smithi057.stdout:0/693: fsync d0/d3/d4d/d87/ff2 0 2024-04-25T22:42:16.954 INFO:tasks.workunit.client.0.smithi057.stdout:2/815: getdents d1f/dea 0 2024-04-25T22:42:16.957 INFO:tasks.workunit.client.0.smithi057.stdout:1/707: dwrite d7/dd/d26/d9a/fcd [0,4194304] 0 2024-04-25T22:42:16.961 INFO:tasks.workunit.client.0.smithi057.stdout:2/816: dwrite d1f/d21/d26/d63/f103 [0,4194304] 0 2024-04-25T22:42:16.962 INFO:tasks.workunit.client.0.smithi057.stdout:2/817: dread - d1f/d34/d50/df0/ff4 zero size 2024-04-25T22:42:16.964 INFO:tasks.workunit.client.0.smithi057.stdout:2/818: symlink d1f/d21/d96/d10b/l11f 0 2024-04-25T22:42:16.965 INFO:tasks.workunit.client.0.smithi057.stdout:1/708: write d7/dd/d16/d24/f3a [6225010,109125] 0 2024-04-25T22:42:16.967 INFO:tasks.workunit.client.0.smithi057.stdout:4/726: dread d14/da2/fe4 [0,4194304] 0 2024-04-25T22:42:16.968 INFO:tasks.workunit.client.0.smithi057.stdout:1/709: rename d7/d65/d6a/d98/d41/d45/l7a to d7/d65/d6a/d98/d41/d75/dc4/le6 0 2024-04-25T22:42:16.968 INFO:tasks.workunit.client.0.smithi057.stdout:4/727: write d14/da9/db5/fc1 [3342007,28606] 0 2024-04-25T22:42:16.969 INFO:tasks.workunit.client.0.smithi057.stdout:7/665: dread d6/f9 [0,4194304] 0 2024-04-25T22:42:16.969 INFO:tasks.workunit.client.0.smithi057.stdout:1/710: truncate d7/d65/d6a/d98/d41/d75/f9d 1461677 0 2024-04-25T22:42:16.970 INFO:tasks.workunit.client.0.smithi057.stdout:7/666: write d6/f48 [4570770,60181] 0 2024-04-25T22:42:16.970 INFO:tasks.workunit.client.0.smithi057.stdout:1/711: chown d7/dd/d16/d24/d61/laa 5919 1 2024-04-25T22:42:16.971 INFO:tasks.workunit.client.0.smithi057.stdout:8/665: dread d4/d5/d2f/f5f [0,4194304] 0 2024-04-25T22:42:16.971 INFO:tasks.workunit.client.0.smithi057.stdout:7/667: mknod d6/d28/d4e/d30/d60/d8d/d96/d51/cde 0 2024-04-25T22:42:16.971 INFO:tasks.workunit.client.0.smithi057.stdout:7/668: sync 2024-04-25T22:42:16.972 INFO:tasks.workunit.client.0.smithi057.stdout:8/666: creat d4/d5/d17/d19/ff3 x:0 0 0 2024-04-25T22:42:16.972 INFO:tasks.workunit.client.0.smithi057.stdout:1/712: getdents d7/d65/d6a/d98/d41/d75 0 2024-04-25T22:42:16.972 INFO:tasks.workunit.client.0.smithi057.stdout:8/667: rmdir d4/db/dd/d3a/d5c 39 2024-04-25T22:42:16.975 INFO:tasks.workunit.client.0.smithi057.stdout:6/784: dread d2/d19/d49/f54 [0,4194304] 0 2024-04-25T22:42:16.975 INFO:tasks.workunit.client.0.smithi057.stdout:1/713: rename d7/d65/d6a/d98/d41 to d7/d65/d6a/d98/dc5/de7 0 2024-04-25T22:42:16.975 INFO:tasks.workunit.client.0.smithi057.stdout:3/663: dread d0/d4/fd [0,4194304] 0 2024-04-25T22:42:16.977 INFO:tasks.workunit.client.0.smithi057.stdout:8/668: rename d4/d5/d21/c4b to d4/d5/d2f/dc2/cf4 0 2024-04-25T22:42:16.979 INFO:tasks.workunit.client.0.smithi057.stdout:1/714: creat d7/dd/d16/d18/d31/fe8 x:0 0 0 2024-04-25T22:42:16.979 INFO:tasks.workunit.client.0.smithi057.stdout:6/785: mknod d2/d19/d50/d1a/db0/c100 0 2024-04-25T22:42:16.981 INFO:tasks.workunit.client.0.smithi057.stdout:1/715: creat d7/fe9 x:0 0 0 2024-04-25T22:42:16.981 INFO:tasks.workunit.client.0.smithi057.stdout:2/819: dwrite d1f/d21/d26/f4e [0,4194304] 0 2024-04-25T22:42:16.981 INFO:tasks.workunit.client.0.smithi057.stdout:8/669: creat d4/d5/d2f/ff5 x:0 0 0 2024-04-25T22:42:16.981 INFO:tasks.workunit.client.0.smithi057.stdout:3/664: link d0/d4/d34/d3c/d70/dc0/le6 d0/d4/le7 0 2024-04-25T22:42:16.982 INFO:tasks.workunit.client.0.smithi057.stdout:7/669: dwrite d6/f48 [0,4194304] 0 2024-04-25T22:42:16.982 INFO:tasks.workunit.client.0.smithi057.stdout:3/665: readlink d0/d4/lf 0 2024-04-25T22:42:16.982 INFO:tasks.workunit.client.0.smithi057.stdout:4/728: dwrite d14/da9/f7d [0,4194304] 0 2024-04-25T22:42:16.983 INFO:tasks.workunit.client.0.smithi057.stdout:6/786: read d2/d19/d26/d4f/f6d [1030379,27320] 0 2024-04-25T22:42:16.983 INFO:tasks.workunit.client.0.smithi057.stdout:1/716: truncate d7/dd/d16/f7e 5000337 0 2024-04-25T22:42:16.985 INFO:tasks.workunit.client.0.smithi057.stdout:9/694: dread d3/d34/d42/fa6 [4194304,4194304] 0 2024-04-25T22:42:16.985 INFO:tasks.workunit.client.0.smithi057.stdout:3/666: mkdir d0/d4/d7b/d7c/de8 0 2024-04-25T22:42:16.985 INFO:tasks.workunit.client.0.smithi057.stdout:4/729: mknod d14/da9/db5/ce6 0 2024-04-25T22:42:16.985 INFO:tasks.workunit.client.0.smithi057.stdout:6/787: creat d2/d19/d9b/df3/d31/f101 x:0 0 0 2024-04-25T22:42:16.985 INFO:tasks.workunit.client.0.smithi057.stdout:3/667: creat d0/d4/d7/d26/d72/fe9 x:0 0 0 2024-04-25T22:42:16.989 INFO:tasks.workunit.client.0.smithi057.stdout:1/717: creat d7/dd/d16/d18/d31/fea x:0 0 0 2024-04-25T22:42:16.989 INFO:tasks.workunit.client.0.smithi057.stdout:6/788: creat d2/d19/d49/d62/f102 x:0 0 0 2024-04-25T22:42:16.989 INFO:tasks.workunit.client.0.smithi057.stdout:7/670: mkdir d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/ddf 0 2024-04-25T22:42:16.990 INFO:tasks.workunit.client.0.smithi057.stdout:1/718: fsync d7/fa4 0 2024-04-25T22:42:16.990 INFO:tasks.workunit.client.0.smithi057.stdout:3/668: link d0/d4/d7/d26/d72/cc6 d0/d4/d34/cea 0 2024-04-25T22:42:16.990 INFO:tasks.workunit.client.0.smithi057.stdout:4/730: creat d14/d5a/d67/db4/fe7 x:0 0 0 2024-04-25T22:42:16.991 INFO:tasks.workunit.client.0.smithi057.stdout:5/797: dread d2/f31 [0,4194304] 0 2024-04-25T22:42:16.991 INFO:tasks.workunit.client.0.smithi057.stdout:6/789: creat d2/d19/d20/d61/dbf/dfb/f103 x:0 0 0 2024-04-25T22:42:16.992 INFO:tasks.workunit.client.0.smithi057.stdout:3/669: stat d0/d4/d7/d26/d89/d97/dc1/dd3 0 2024-04-25T22:42:16.992 INFO:tasks.workunit.client.0.smithi057.stdout:0/694: dread d0/d3/d4d/d87/ff2 [0,4194304] 0 2024-04-25T22:42:16.992 INFO:tasks.workunit.client.0.smithi057.stdout:1/719: mknod d7/d65/d6a/d98/dc5/de7/d45/ceb 0 2024-04-25T22:42:16.993 INFO:tasks.workunit.client.0.smithi057.stdout:4/731: chown d14/d47/l8c 86 1 2024-04-25T22:42:16.993 INFO:tasks.workunit.client.0.smithi057.stdout:7/671: unlink d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d97/fa3 0 2024-04-25T22:42:16.993 INFO:tasks.workunit.client.0.smithi057.stdout:8/670: dwrite d4/db/d12/fdb [4194304,4194304] 0 2024-04-25T22:42:16.993 INFO:tasks.workunit.client.0.smithi057.stdout:9/695: rename d3/d34/d42/d28/f91 to d3/d34/d42/d28/d39/db3/fdc 0 2024-04-25T22:42:16.993 INFO:tasks.workunit.client.0.smithi057.stdout:0/695: symlink d0/lf7 0 2024-04-25T22:42:16.994 INFO:tasks.workunit.client.0.smithi057.stdout:1/720: creat d7/d65/d6a/d98/dc5/de7/de1/fec x:0 0 0 2024-04-25T22:42:16.995 INFO:tasks.workunit.client.0.smithi057.stdout:0/696: chown d0/d5/f32 109623 1 2024-04-25T22:42:16.996 INFO:tasks.workunit.client.0.smithi057.stdout:0/697: chown d0/d3/d4d/c5e 23348 1 2024-04-25T22:42:16.996 INFO:tasks.workunit.client.0.smithi057.stdout:1/721: write d7/dd/d16/d24/d63/fca [1389013,48852] 0 2024-04-25T22:42:16.996 INFO:tasks.workunit.client.0.smithi057.stdout:4/732: symlink d14/d2f/le8 0 2024-04-25T22:42:16.998 INFO:tasks.workunit.client.0.smithi057.stdout:5/798: dread d2/f31 [0,4194304] 0 2024-04-25T22:42:16.998 INFO:tasks.workunit.client.0.smithi057.stdout:8/671: rename d4/d5/d17/d19/f57 to d4/db/dd/ff6 0 2024-04-25T22:42:16.999 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:16.996+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:17.000 INFO:tasks.workunit.client.0.smithi057.stdout:4/733: creat d14/d5a/fe9 x:0 0 0 2024-04-25T22:42:17.000 INFO:tasks.workunit.client.0.smithi057.stdout:4/734: sync 2024-04-25T22:42:17.000 INFO:tasks.workunit.client.0.smithi057.stdout:8/672: stat d4/d5/d17/ld6 0 2024-04-25T22:42:17.002 INFO:tasks.workunit.client.0.smithi057.stdout:5/799: getdents d2/d1c/d46/de4 0 2024-04-25T22:42:17.002 INFO:tasks.workunit.client.0.smithi057.stdout:4/735: mkdir d14/d47/d5e/dea 0 2024-04-25T22:42:17.003 INFO:tasks.workunit.client.0.smithi057.stdout:8/673: mkdir d4/db/dd/d3a/d94/dcf/df7 0 2024-04-25T22:42:17.003 INFO:tasks.workunit.client.0.smithi057.stdout:6/790: dwrite d2/d19/d9b/df3/d5e/dda/ff4 [0,4194304] 0 2024-04-25T22:42:17.003 INFO:tasks.workunit.client.0.smithi057.stdout:3/670: dwrite d0/d4/d34/d3c/f5c [0,4194304] 0 2024-04-25T22:42:17.004 INFO:tasks.workunit.client.0.smithi057.stdout:4/736: readlink d14/da9/d44/l4b 0 2024-04-25T22:42:17.004 INFO:tasks.workunit.client.0.smithi057.stdout:3/671: stat d0/l38 0 2024-04-25T22:42:17.004 INFO:tasks.workunit.client.0.smithi057.stdout:5/800: getdents d2/d91 0 2024-04-25T22:42:17.004 INFO:tasks.workunit.client.0.smithi057.stdout:8/674: creat d4/db/d12/dc0/ff8 x:0 0 0 2024-04-25T22:42:17.005 INFO:tasks.workunit.client.0.smithi057.stdout:8/675: chown d4/db/d12/dc0 4538 1 2024-04-25T22:42:17.005 INFO:tasks.workunit.client.0.smithi057.stdout:5/801: chown d2/d6/db/f2b 0 1 2024-04-25T22:42:17.005 INFO:tasks.workunit.client.0.smithi057.stdout:3/672: link d0/fa d0/d4/d34/d3c/d70/feb 0 2024-04-25T22:42:17.006 INFO:tasks.workunit.client.0.smithi057.stdout:5/802: creat d2/d2c/ffb x:0 0 0 2024-04-25T22:42:17.010 INFO:tasks.workunit.client.0.smithi057.stdout:4/737: dread d14/f20 [0,4194304] 0 2024-04-25T22:42:17.011 INFO:tasks.workunit.client.0.smithi057.stdout:5/803: dread d2/d47/d94/f9c [0,4194304] 0 2024-04-25T22:42:17.011 INFO:tasks.workunit.client.0.smithi057.stdout:8/676: write d4/db/dd/d3a/d5c/d76/f97 [1713898,67356] 0 2024-04-25T22:42:17.011 INFO:tasks.workunit.client.0.smithi057.stdout:6/791: dwrite d2/d19/d9b/df3/d31/fc9 [0,4194304] 0 2024-04-25T22:42:17.012 INFO:tasks.workunit.client.0.smithi057.stdout:3/673: dread d0/d4/fd [0,4194304] 0 2024-04-25T22:42:17.013 INFO:tasks.workunit.client.0.smithi057.stdout:5/804: creat d2/d1c/d46/d3a/d6a/ffc x:0 0 0 2024-04-25T22:42:17.014 INFO:tasks.workunit.client.0.smithi057.stdout:4/738: rmdir d14/d2f/d4c/d5b/dd8/dbf/dd4 0 2024-04-25T22:42:17.014 INFO:tasks.workunit.client.0.smithi057.stdout:6/792: creat d2/d19/d49/d62/d79/f104 x:0 0 0 2024-04-25T22:42:17.014 INFO:tasks.workunit.client.0.smithi057.stdout:8/677: creat d4/d5/ff9 x:0 0 0 2024-04-25T22:42:17.014 INFO:tasks.workunit.client.0.smithi057.stdout:5/805: mkdir d2/d1c/dfd 0 2024-04-25T22:42:17.015 INFO:tasks.workunit.client.0.smithi057.stdout:3/674: dread - d0/d4/fa5 zero size 2024-04-25T22:42:17.015 INFO:tasks.workunit.client.0.smithi057.stdout:6/793: fsync d2/d19/d9b/df3/f53 0 2024-04-25T22:42:17.015 INFO:tasks.workunit.client.0.smithi057.stdout:0/698: dwrite d0/d5/d53/f69 [0,4194304] 0 2024-04-25T22:42:17.015 INFO:tasks.workunit.client.0.smithi057.stdout:5/806: fdatasync d2/d2c/fab 0 2024-04-25T22:42:17.016 INFO:tasks.workunit.client.0.smithi057.stdout:8/678: truncate d4/db/dd/d3a/fa4 2083886 0 2024-04-25T22:42:17.016 INFO:tasks.workunit.client.0.smithi057.stdout:8/679: readlink d4/deb/lf2 0 2024-04-25T22:42:17.017 INFO:tasks.workunit.client.0.smithi057.stdout:5/807: chown d2/d47/da5/la4 217858449 1 2024-04-25T22:42:17.017 INFO:tasks.workunit.client.0.smithi057.stdout:5/808: chown d2/d1c/d46/f27 115 1 2024-04-25T22:42:17.017 INFO:tasks.workunit.client.0.smithi057.stdout:8/680: chown d4/d5/d17/d19/d35/d83/d92/da6 125 1 2024-04-25T22:42:17.018 INFO:tasks.workunit.client.0.smithi057.stdout:8/681: chown d4/f4f 260 1 2024-04-25T22:42:17.019 INFO:tasks.workunit.client.0.smithi057.stdout:4/739: mkdir d14/d2f/d82/deb 0 2024-04-25T22:42:17.020 INFO:tasks.workunit.client.0.smithi057.stdout:0/699: creat d0/d3/d6/d14/dd1/ff8 x:0 0 0 2024-04-25T22:42:17.020 INFO:tasks.workunit.client.0.smithi057.stdout:3/675: rmdir d0/d4/d7b/d7c/da7 0 2024-04-25T22:42:17.020 INFO:tasks.workunit.client.0.smithi057.stdout:5/809: symlink d2/d1c/d24/d3d/d77/dcd/ddd/lfe 0 2024-04-25T22:42:17.020 INFO:tasks.workunit.client.0.smithi057.stdout:4/740: dread - d14/da9/fd5 zero size 2024-04-25T22:42:17.020 INFO:tasks.workunit.client.0.smithi057.stdout:3/676: stat d0/d4/d7b/d8f/lc4 0 2024-04-25T22:42:17.021 INFO:tasks.workunit.client.0.smithi057.stdout:8/682: rename d4/d5/dd2/cd5 to d4/db/dd/d3a/d5c/d76/cfa 0 2024-04-25T22:42:17.021 INFO:tasks.workunit.client.0.smithi057.stdout:0/700: write d0/d3/d3a/d3b/f70 [265878,40185] 0 2024-04-25T22:42:17.022 INFO:tasks.workunit.client.0.smithi057.stdout:5/810: creat d2/d1c/d46/dd0/fff x:0 0 0 2024-04-25T22:42:17.026 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:17.026 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:17.026 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:17.026 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:17.026 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.026 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:17.026 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:17.026 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 122.425085778, 2024-04-25T22:42:17.026 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:17.026 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:17.027 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:17.027 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:17.027 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:17.027 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.027 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:17.027 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:17.027 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.027 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.027 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:17.027 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:17.027 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.027 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.027 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:17.027 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:17.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:17.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:17.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:17.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:17.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:17.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:17.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:17.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:17.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:17.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:17.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:17.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:17.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:17.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:17.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.030 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:17.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:17.030 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.030 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.030 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:17.030 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:17.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:17.030 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.030 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.030 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:17.030 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:17.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:17.030 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.031 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.031 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:17.031 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:17.031 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:17.031 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.031 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.031 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:17.031 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:17.031 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:17.031 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.031 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.031 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:17.031 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:17.032 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:17.032 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.032 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.032 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:17.032 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:17.032 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:17.032 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.032 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.032 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.032 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.032 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.032 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:17.032 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:17.032 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 122.42494852199999, 2024-04-25T22:42:17.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:17.033 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:17.033 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:17.033 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:17.033 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:17.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:17.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:17.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:17.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:17.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:17.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:17.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:17.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:17.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:17.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:17.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:17.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:17.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:17.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.035 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:17.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:17.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.035 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:17.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:17.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.035 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:17.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:17.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:17.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.036 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.036 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.036 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:17.036 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:17.036 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.036 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.036 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:17.036 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:17.036 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:17.036 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.036 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.036 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:17.036 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:17.037 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:17.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:17.037 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:17.037 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:17.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:17.037 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:17.037 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:17.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:17.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:17.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:17.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.038 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:17.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:17.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:17.038 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.038 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.038 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.038 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:17.039 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:17.039 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 122.424688354, 2024-04-25T22:42:17.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:17.039 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:17.039 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:17.039 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:17.039 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:17.039 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.039 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:17.039 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:17.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.039 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.039 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:17.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:17.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.040 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:17.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:17.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:17.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.040 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:17.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:17.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:17.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.041 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.041 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:17.041 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:17.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:17.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.041 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.041 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.041 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:17.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:17.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.041 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.041 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.041 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:17.042 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:17.042 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.042 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.042 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:17.042 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:17.042 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:17.042 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.042 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.042 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.042 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:17.042 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:17.042 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.042 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.043 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:17.043 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:17.043 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:17.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.043 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.043 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:17.043 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:17.043 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:17.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.043 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.043 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:17.043 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:17.043 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:17.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.043 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.043 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:17.044 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:17.044 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:17.044 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.044 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.044 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:17.044 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:17.044 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:17.044 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.044 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.044 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:17.044 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:17.044 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:17.044 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.044 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.045 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.045 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.045 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.045 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:17.045 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:17.045 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 122.424523155, 2024-04-25T22:42:17.045 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:17.045 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:17.045 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:17.045 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:17.045 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:17.045 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.045 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:17.045 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:17.045 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.046 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.046 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:17.046 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:17.046 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.046 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.046 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:17.046 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:17.046 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:17.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.046 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.046 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:17.046 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:17.047 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:17.047 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.047 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.047 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:17.047 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:17.047 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:17.047 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.047 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.047 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.047 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:17.047 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:17.047 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.047 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.047 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.047 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:17.048 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:17.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.048 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.048 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:17.048 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:17.048 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:17.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.048 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.048 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.048 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:17.048 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:17.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.048 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.048 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:17.049 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:17.049 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:17.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.049 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:17.049 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:17.049 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:17.049 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.049 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.049 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.049 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:17.049 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:17.049 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 122.42445749300001, 2024-04-25T22:42:17.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:17.050 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:17.050 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:17.050 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:17.050 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:17.050 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:17.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:17.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.050 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.050 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:17.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:17.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.050 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.051 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.051 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:17.051 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:17.051 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:17.051 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.051 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.051 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:17.051 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:17.051 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:17.051 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.051 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.051 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:17.051 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:17.051 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:17.052 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.052 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:17.052 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:17.052 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.052 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:17.052 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:17.052 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.052 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:17.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:17.052 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:17.053 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.053 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.053 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.053 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:17.053 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:17.053 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.053 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.053 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:17.053 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:17.053 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:17.053 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.053 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.053 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:17.054 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:17.054 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:17.054 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.054 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.054 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.054 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.054 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.054 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10700 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:17.054 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:17.054 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.5015902759999999, 2024-04-25T22:42:17.054 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066789482999999997, 2024-04-25T22:42:17.054 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:17.054 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:17.054 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:17.055 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:17.055 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:17.055 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:17.055 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10700 2024-04-25T22:42:17.055 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.055 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:17.055 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.055 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:17.055 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:17.055 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.055 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.055 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.055 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:17.055 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:17.055 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.055 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.056 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.056 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:17.056 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519112+0000", 2024-04-25T22:42:17.056 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1399999999999998e-06 2024-04-25T22:42:17.056 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.056 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.056 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:17.056 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527187+0000", 2024-04-25T22:42:17.056 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080748899999999995 2024-04-25T22:42:17.056 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.056 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.056 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:17.056 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527232+0000", 2024-04-25T22:42:17.056 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4895999999999998e-05 2024-04-25T22:42:17.057 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.057 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.057 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.057 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527259+0000", 2024-04-25T22:42:17.057 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7331999999999999e-05 2024-04-25T22:42:17.057 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.057 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.057 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.057 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529418+0000", 2024-04-25T22:42:17.057 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002158765 2024-04-25T22:42:17.057 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.057 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.057 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:17.057 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529572+0000", 2024-04-25T22:42:17.057 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015438499999999999 2024-04-25T22:42:17.058 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.058 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.058 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:17.058 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529762+0000", 2024-04-25T22:42:17.058 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018998100000000001 2024-04-25T22:42:17.058 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.058 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.058 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:17.058 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.548359+0000", 2024-04-25T22:42:17.058 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018596444 2024-04-25T22:42:17.058 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.058 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.058 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:17.058 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585801+0000", 2024-04-25T22:42:17.058 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.037442469999999999 2024-04-25T22:42:17.059 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.059 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.059 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:17.059 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585847+0000", 2024-04-25T22:42:17.059 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5565000000000002e-05 2024-04-25T22:42:17.059 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.059 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.059 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:17.059 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585899+0000", 2024-04-25T22:42:17.059 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2614999999999997e-05 2024-04-25T22:42:17.059 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.059 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.060 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.060 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.060 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.060 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10714 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:17.060 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:17.060 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.4679093129999998, 2024-04-25T22:42:17.060 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.048080623000000003, 2024-04-25T22:42:17.060 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:17.060 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:17.060 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:17.060 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:17.060 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:17.060 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:17.060 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10714 2024-04-25T22:42:17.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.061 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:17.061 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.061 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:17.061 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:17.061 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.061 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.061 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:17.061 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:17.061 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.061 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.061 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:17.061 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552792+0000", 2024-04-25T22:42:17.061 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:42:17.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.062 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.062 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:17.062 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559915+0000", 2024-04-25T22:42:17.062 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071231690000000004 2024-04-25T22:42:17.062 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.062 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.062 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:17.062 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559932+0000", 2024-04-25T22:42:17.062 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7169000000000001e-05 2024-04-25T22:42:17.062 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.062 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.062 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.062 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559942+0000", 2024-04-25T22:42:17.062 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0261999999999999e-05 2024-04-25T22:42:17.062 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.063 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.063 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.063 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560018+0000", 2024-04-25T22:42:17.063 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5358000000000006e-05 2024-04-25T22:42:17.063 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.063 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.063 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:17.063 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560118+0000", 2024-04-25T22:42:17.063 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000100911 2024-04-25T22:42:17.063 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.063 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.063 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:17.063 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560281+0000", 2024-04-25T22:42:17.063 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016288500000000001 2024-04-25T22:42:17.063 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.064 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.064 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:17.064 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.579740+0000", 2024-04-25T22:42:17.064 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019458598000000001 2024-04-25T22:42:17.064 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.064 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.064 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:17.064 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600484+0000", 2024-04-25T22:42:17.064 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020744483000000001 2024-04-25T22:42:17.064 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.064 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.064 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:17.064 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600664+0000", 2024-04-25T22:42:17.064 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017953899999999999 2024-04-25T22:42:17.064 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.064 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600871+0000", 2024-04-25T22:42:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020737199999999999 2024-04-25T22:42:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10813 4.17 4:e8010137:::100000030b0.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.272960307, 2024-04-25T22:42:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.047503799999999999, 2024-04-25T22:42:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:17.065 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10813 2024-04-25T22:42:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.066 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747741+0000", 2024-04-25T22:42:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1119999999999999e-06 2024-04-25T22:42:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752366+0000", 2024-04-25T22:42:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046253240000000001 2024-04-25T22:42:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752382+0000", 2024-04-25T22:42:17.067 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5639999999999999e-05 2024-04-25T22:42:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752393+0000", 2024-04-25T22:42:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1626e-05 2024-04-25T22:42:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752459+0000", 2024-04-25T22:42:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5309999999999996e-05 2024-04-25T22:42:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:17.068 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752529+0000", 2024-04-25T22:42:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0543000000000005e-05 2024-04-25T22:42:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752637+0000", 2024-04-25T22:42:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010788799999999999 2024-04-25T22:42:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760295+0000", 2024-04-25T22:42:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076583290000000002 2024-04-25T22:42:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.794990+0000", 2024-04-25T22:42:17.069 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034694317000000002 2024-04-25T22:42:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795097+0000", 2024-04-25T22:42:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010768999999999999 2024-04-25T22:42:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795243+0000", 2024-04-25T22:42:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000146021 2024-04-25T22:42:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.070 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10816 4.17 4:e8010137:::100000030b0.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.2676308470000004, 2024-04-25T22:42:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042406530999999997, 2024-04-25T22:42:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10816 2024-04-25T22:42:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.071 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753070+0000", 2024-04-25T22:42:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9800000000000002e-07 2024-04-25T22:42:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.072 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753288+0000", 2024-04-25T22:42:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000217789 2024-04-25T22:42:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753301+0000", 2024-04-25T22:42:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2764e-05 2024-04-25T22:42:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753310+0000", 2024-04-25T22:42:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:42:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.073 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758240+0000", 2024-04-25T22:42:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049304910000000004 2024-04-25T22:42:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758374+0000", 2024-04-25T22:42:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000133428 2024-04-25T22:42:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758576+0000", 2024-04-25T22:42:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020177899999999999 2024-04-25T22:42:17.074 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.075 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.075 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:17.075 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760626+0000", 2024-04-25T22:42:17.075 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0020501489999999998 2024-04-25T22:42:17.075 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.075 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.075 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:17.075 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795329+0000", 2024-04-25T22:42:17.075 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034703352999999999 2024-04-25T22:42:17.075 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.075 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.075 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:17.075 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795414+0000", 2024-04-25T22:42:17.075 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5292999999999998e-05 2024-04-25T22:42:17.075 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.076 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.076 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:17.076 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795476+0000", 2024-04-25T22:42:17.076 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1206999999999999e-05 2024-04-25T22:42:17.076 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.076 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.076 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.076 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.076 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.076 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10914 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:17.076 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:17.076 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.0668304649999998, 2024-04-25T22:42:17.076 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044452984000000001, 2024-04-25T22:42:17.076 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:17.076 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:17.077 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:17.077 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:17.077 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:17.077 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:17.077 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10914 2024-04-25T22:42:17.077 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.077 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:17.077 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.077 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:17.077 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:17.077 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.077 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.077 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.077 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:17.077 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:17.078 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.078 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.078 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.078 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:17.078 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953871+0000", 2024-04-25T22:42:17.078 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1829999999999999e-06 2024-04-25T22:42:17.078 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.078 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.078 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:17.078 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.962992+0000", 2024-04-25T22:42:17.078 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091217409999999992 2024-04-25T22:42:17.078 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.078 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.079 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:17.079 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963027+0000", 2024-04-25T22:42:17.079 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4229e-05 2024-04-25T22:42:17.079 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.079 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.079 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.079 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963042+0000", 2024-04-25T22:42:17.079 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5152e-05 2024-04-25T22:42:17.079 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.079 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.079 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.079 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963143+0000", 2024-04-25T22:42:17.079 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101171 2024-04-25T22:42:17.079 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.080 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.080 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:17.080 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963269+0000", 2024-04-25T22:42:17.080 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012623499999999999 2024-04-25T22:42:17.080 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.080 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.080 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:17.080 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963453+0000", 2024-04-25T22:42:17.080 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018357900000000001 2024-04-25T22:42:17.080 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.080 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.080 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:17.080 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998133+0000", 2024-04-25T22:42:17.081 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034679789000000003 2024-04-25T22:42:17.081 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.081 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.081 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:17.081 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998220+0000", 2024-04-25T22:42:17.081 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7153999999999999e-05 2024-04-25T22:42:17.081 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.081 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.081 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:17.081 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998278+0000", 2024-04-25T22:42:17.081 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8035000000000003e-05 2024-04-25T22:42:17.081 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.081 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.081 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:17.082 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998323+0000", 2024-04-25T22:42:17.082 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4715999999999997e-05 2024-04-25T22:42:17.082 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.082 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.082 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.082 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.082 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.082 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10919 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:17.082 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:17.082 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.0465191840000001, 2024-04-25T22:42:17.082 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044010552000000001, 2024-04-25T22:42:17.082 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:17.082 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:17.082 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:17.083 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:17.083 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:17.083 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:17.083 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10919 2024-04-25T22:42:17.083 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.083 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:17.083 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.083 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:17.083 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:17.083 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.083 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.083 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.083 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:17.083 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:17.083 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.084 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.084 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.084 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:17.084 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:17.084 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8100000000000003e-07 2024-04-25T22:42:17.084 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.084 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.084 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:17.084 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980221+0000", 2024-04-25T22:42:17.084 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060397230000000003 2024-04-25T22:42:17.084 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.084 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.084 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:17.084 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980242+0000", 2024-04-25T22:42:17.084 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1373e-05 2024-04-25T22:42:17.085 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.085 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.085 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.085 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980252+0000", 2024-04-25T22:42:17.085 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9990000000000003e-06 2024-04-25T22:42:17.085 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.085 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.085 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.085 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981303+0000", 2024-04-25T22:42:17.085 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010501670000000001 2024-04-25T22:42:17.085 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.085 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.085 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:17.086 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981444+0000", 2024-04-25T22:42:17.086 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014123799999999999 2024-04-25T22:42:17.086 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.086 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.086 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:17.086 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981585+0000", 2024-04-25T22:42:17.086 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014071999999999999 2024-04-25T22:42:17.086 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.086 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.086 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:17.086 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003640+0000", 2024-04-25T22:42:17.086 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022055113000000001 2024-04-25T22:42:17.086 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.086 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.087 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:17.087 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018070+0000", 2024-04-25T22:42:17.087 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014430877 2024-04-25T22:42:17.087 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.087 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.087 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:17.087 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018138+0000", 2024-04-25T22:42:17.087 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7743000000000005e-05 2024-04-25T22:42:17.087 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.087 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.087 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:17.087 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018191+0000", 2024-04-25T22:42:17.087 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3118000000000002e-05 2024-04-25T22:42:17.087 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.087 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.088 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.088 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.088 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.088 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:12632 4.a e64/17 4:506aad5d:::1000000310f.00000000:head v 64'203, mlcod=64'201)", 2024-04-25T22:42:17.088 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:17.088 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.377170789, 2024-04-25T22:42:17.088 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041913617, 2024-04-25T22:42:17.088 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:17.088 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:17.088 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:17.088 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:17.088 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.088 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:17.088 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:17.088 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.089 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.089 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.089 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:17.089 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:17.089 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.089 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.089 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.089 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:17.089 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643531+0000", 2024-04-25T22:42:17.089 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.497e-06 2024-04-25T22:42:17.089 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.089 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.089 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:17.089 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650159+0000", 2024-04-25T22:42:17.089 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066287059999999998 2024-04-25T22:42:17.090 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.090 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.090 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:17.090 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650185+0000", 2024-04-25T22:42:17.090 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5646000000000001e-05 2024-04-25T22:42:17.090 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.090 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.090 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.090 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650205+0000", 2024-04-25T22:42:17.090 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9720000000000001e-05 2024-04-25T22:42:17.090 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.090 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.090 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.090 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650521+0000", 2024-04-25T22:42:17.091 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00031590699999999998 2024-04-25T22:42:17.091 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.091 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.091 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:17.091 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650574+0000", 2024-04-25T22:42:17.091 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3192000000000002e-05 2024-04-25T22:42:17.091 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.091 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.091 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:17.091 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685374+0000", 2024-04-25T22:42:17.091 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034799902000000001 2024-04-25T22:42:17.091 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.091 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.092 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:17.092 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685443+0000", 2024-04-25T22:42:17.092 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9047000000000005e-05 2024-04-25T22:42:17.092 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.092 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.092 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.092 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.092 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.092 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12644 4.11 4:8893db93:::100000034c2.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:17.092 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:17.092 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.3687618989999999, 2024-04-25T22:42:17.092 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045039497999999997, 2024-04-25T22:42:17.092 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:17.092 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:17.092 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:17.093 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:17.093 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:17.093 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:17.093 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12644 2024-04-25T22:42:17.093 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.093 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:17.093 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.093 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:17.093 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:17.093 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.093 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.093 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.093 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:17.093 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:17.093 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.094 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.094 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.094 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:17.094 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651940+0000", 2024-04-25T22:42:17.094 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.013e-06 2024-04-25T22:42:17.094 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.094 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.094 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:17.094 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659663+0000", 2024-04-25T22:42:17.094 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077228150000000001 2024-04-25T22:42:17.094 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.095 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.095 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:17.095 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659694+0000", 2024-04-25T22:42:17.095 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1112999999999998e-05 2024-04-25T22:42:17.095 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.095 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.095 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.095 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659715+0000", 2024-04-25T22:42:17.095 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1053e-05 2024-04-25T22:42:17.095 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.095 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.095 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.095 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659842+0000", 2024-04-25T22:42:17.095 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012738100000000001 2024-04-25T22:42:17.096 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.096 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.096 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:17.096 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660068+0000", 2024-04-25T22:42:17.096 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000225746 2024-04-25T22:42:17.096 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.096 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.096 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:17.096 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660307+0000", 2024-04-25T22:42:17.096 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000238352 2024-04-25T22:42:17.096 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.096 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.096 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:17.096 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.683776+0000", 2024-04-25T22:42:17.096 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023469891999999999 2024-04-25T22:42:17.097 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.097 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.097 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:17.097 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696810+0000", 2024-04-25T22:42:17.097 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013033385999999999 2024-04-25T22:42:17.097 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.097 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.097 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:17.097 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696904+0000", 2024-04-25T22:42:17.097 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3820000000000006e-05 2024-04-25T22:42:17.097 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.097 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.097 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:17.097 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696978+0000", 2024-04-25T22:42:17.097 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3926999999999999e-05 2024-04-25T22:42:17.098 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.098 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.098 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.098 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.098 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.098 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12645 4.2d 4:b45456a9:::10000003241.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:17.098 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:17.098 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.3609414120000001, 2024-04-25T22:42:17.098 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.043099660999999997, 2024-04-25T22:42:17.098 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:17.098 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:17.098 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:17.098 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:17.099 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:17.099 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:17.099 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12645 2024-04-25T22:42:17.099 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.099 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:17.099 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.099 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:17.099 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:17.099 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.099 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.099 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.099 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:17.099 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:17.099 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.100 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.100 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.100 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:17.100 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659761+0000", 2024-04-25T22:42:17.100 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8459999999999999e-06 2024-04-25T22:42:17.100 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.100 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.100 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:17.100 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666663+0000", 2024-04-25T22:42:17.100 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0069017080000000003 2024-04-25T22:42:17.100 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.100 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.100 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:17.100 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666684+0000", 2024-04-25T22:42:17.100 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0706000000000001e-05 2024-04-25T22:42:17.101 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.101 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.101 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.101 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666700+0000", 2024-04-25T22:42:17.101 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5985999999999999e-05 2024-04-25T22:42:17.101 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.101 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.101 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.101 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666914+0000", 2024-04-25T22:42:17.101 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000213861 2024-04-25T22:42:17.101 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.101 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.101 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:17.101 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.667082+0000", 2024-04-25T22:42:17.102 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016809 2024-04-25T22:42:17.102 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.102 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.102 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:17.102 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702598+0000", 2024-04-25T22:42:17.102 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035515962999999998 2024-04-25T22:42:17.102 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.102 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.102 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:17.102 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702705+0000", 2024-04-25T22:42:17.102 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010689800000000001 2024-04-25T22:42:17.102 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.102 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.102 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:17.103 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702858+0000", 2024-04-25T22:42:17.103 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015360300000000001 2024-04-25T22:42:17.103 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.103 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.103 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.103 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.103 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.103 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12829 4.3b 4:de8bdadd:::100000033c7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:17.103 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:17.103 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 1.1326814970000001, 2024-04-25T22:42:17.103 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042457306, 2024-04-25T22:42:17.103 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:17.103 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:17.103 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:17.104 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:17.104 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:17.104 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:17.104 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12829 2024-04-25T22:42:17.104 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.104 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:17.104 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.104 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:17.104 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:17.104 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.104 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.104 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.104 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:17.104 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:17.105 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.105 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.105 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.105 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:17.105 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888019+0000", 2024-04-25T22:42:17.105 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3300000000000002e-07 2024-04-25T22:42:17.105 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.105 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.105 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:17.105 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891638+0000", 2024-04-25T22:42:17.105 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036189109999999998 2024-04-25T22:42:17.105 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.105 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.105 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:17.106 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891661+0000", 2024-04-25T22:42:17.106 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3345000000000001e-05 2024-04-25T22:42:17.106 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.106 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.106 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.106 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891671+0000", 2024-04-25T22:42:17.106 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0115000000000001e-05 2024-04-25T22:42:17.106 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.106 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.106 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.106 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891737+0000", 2024-04-25T22:42:17.106 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5600999999999998e-05 2024-04-25T22:42:17.106 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.106 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.107 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:17.107 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891856+0000", 2024-04-25T22:42:17.107 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011881 2024-04-25T22:42:17.107 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.107 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.107 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:17.107 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930251+0000", 2024-04-25T22:42:17.107 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.038395141000000001 2024-04-25T22:42:17.107 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.107 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.107 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:17.107 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930389+0000", 2024-04-25T22:42:17.107 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013849000000000001 2024-04-25T22:42:17.107 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.108 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.108 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:17.108 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930476+0000", 2024-04-25T22:42:17.108 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6360000000000007e-05 2024-04-25T22:42:17.108 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.108 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.108 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.108 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.108 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.108 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13009 4.1e 4:78728bd7:::100000033a5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:17.108 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:17.108 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.93079448499999995, 2024-04-25T22:42:17.108 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049997452999999997, 2024-04-25T22:42:17.108 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:17.108 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:17.109 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:17.109 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:17.109 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:17.109 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:17.109 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13009 2024-04-25T22:42:17.109 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.109 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:17.109 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.109 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:17.109 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:17.109 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.109 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.109 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.109 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:17.109 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:17.110 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.110 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.110 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.110 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:17.110 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:17.110 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4799999999999997e-07 2024-04-25T22:42:17.110 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.110 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.110 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:17.110 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097105+0000", 2024-04-25T22:42:17.110 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071984060000000001 2024-04-25T22:42:17.110 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.110 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.110 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:17.110 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097118+0000", 2024-04-25T22:42:17.111 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2865e-05 2024-04-25T22:42:17.111 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.111 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.111 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.111 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097127+0000", 2024-04-25T22:42:17.111 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8449999999999998e-06 2024-04-25T22:42:17.111 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.111 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.111 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.111 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097174+0000", 2024-04-25T22:42:17.111 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6084000000000001e-05 2024-04-25T22:42:17.111 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.111 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.111 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:17.112 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097232+0000", 2024-04-25T22:42:17.112 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8928999999999998e-05 2024-04-25T22:42:17.112 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.112 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.112 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:17.112 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097309+0000", 2024-04-25T22:42:17.112 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7014999999999994e-05 2024-04-25T22:42:17.112 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.112 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.112 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:17.112 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.108708+0000", 2024-04-25T22:42:17.112 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011398233000000001 2024-04-25T22:42:17.112 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.112 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.112 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:17.113 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139793+0000", 2024-04-25T22:42:17.113 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031084856000000001 2024-04-25T22:42:17.113 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.113 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.113 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:17.113 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139848+0000", 2024-04-25T22:42:17.113 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5464000000000003e-05 2024-04-25T22:42:17.113 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.113 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.113 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:17.113 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139903+0000", 2024-04-25T22:42:17.113 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4907999999999997e-05 2024-04-25T22:42:17.113 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.113 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.114 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.114 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.114 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.114 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13318 4.16 4:6810bf9e:::10000003259.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:17.114 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:17.114 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.56022012700000001, 2024-04-25T22:42:17.114 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057538179000000002, 2024-04-25T22:42:17.114 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:17.114 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:17.114 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:17.114 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:17.114 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:17.114 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:17.114 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13318 2024-04-25T22:42:17.114 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.115 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:17.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.115 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:17.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:17.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.115 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.115 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:17.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:17.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.115 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.115 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.115 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:17.115 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460481+0000", 2024-04-25T22:42:17.115 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:42:17.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:17.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466775+0000", 2024-04-25T22:42:17.116 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062944239999999999 2024-04-25T22:42:17.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:17.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466787+0000", 2024-04-25T22:42:17.116 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1688999999999999e-05 2024-04-25T22:42:17.116 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.116 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.116 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.116 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466793+0000", 2024-04-25T22:42:17.116 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7209999999999999e-06 2024-04-25T22:42:17.117 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466845+0000", 2024-04-25T22:42:17.117 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2166999999999997e-05 2024-04-25T22:42:17.117 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:17.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466912+0000", 2024-04-25T22:42:17.117 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7016999999999999e-05 2024-04-25T22:42:17.117 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.117 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.117 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:17.117 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.467020+0000", 2024-04-25T22:42:17.117 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010827699999999999 2024-04-25T22:42:17.118 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.118 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.118 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:17.118 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.476718+0000", 2024-04-25T22:42:17.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0096980439999999994 2024-04-25T22:42:17.118 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.118 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.118 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:17.118 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517860+0000", 2024-04-25T22:42:17.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041141847000000002 2024-04-25T22:42:17.118 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.118 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.118 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:17.118 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517924+0000", 2024-04-25T22:42:17.118 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3997000000000004e-05 2024-04-25T22:42:17.119 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.119 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.119 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:17.119 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.518018+0000", 2024-04-25T22:42:17.119 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4139000000000001e-05 2024-04-25T22:42:17.119 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.119 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.119 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.119 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.119 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.119 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13328 4.16 4:6a9ab238:::1000000339b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:17.119 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:17.119 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.54130714199999996, 2024-04-25T22:42:17.119 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057072695999999999, 2024-04-25T22:42:17.119 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:17.120 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:17.120 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:17.120 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:17.120 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:17.120 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:17.120 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13328 2024-04-25T22:42:17.120 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.120 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:17.120 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.120 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:17.120 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:17.120 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.120 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.120 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.120 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:17.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:17.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:17.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479395+0000", 2024-04-25T22:42:17.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2859999999999998e-06 2024-04-25T22:42:17.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:17.121 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486667+0000", 2024-04-25T22:42:17.121 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072715599999999998 2024-04-25T22:42:17.121 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.121 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.121 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:17.122 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486677+0000", 2024-04-25T22:42:17.122 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0305e-05 2024-04-25T22:42:17.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.122 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486683+0000", 2024-04-25T22:42:17.122 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5300000000000004e-06 2024-04-25T22:42:17.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.122 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486768+0000", 2024-04-25T22:42:17.122 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5725999999999999e-05 2024-04-25T22:42:17.122 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.122 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.122 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:17.123 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486905+0000", 2024-04-25T22:42:17.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013696699999999999 2024-04-25T22:42:17.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.123 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:17.123 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.487121+0000", 2024-04-25T22:42:17.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021615299999999999 2024-04-25T22:42:17.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.123 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:17.123 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.509675+0000", 2024-04-25T22:42:17.123 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022553225999999999 2024-04-25T22:42:17.123 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.123 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:17.124 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536355+0000", 2024-04-25T22:42:17.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026680855 2024-04-25T22:42:17.124 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:17.124 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536401+0000", 2024-04-25T22:42:17.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5649000000000003e-05 2024-04-25T22:42:17.124 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.124 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.124 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:17.124 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536466+0000", 2024-04-25T22:42:17.124 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4438999999999997e-05 2024-04-25T22:42:17.124 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.124 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.125 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.125 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.125 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.125 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13329 4.26 4:64e005a2:::10000003483.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:17.125 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:17.125 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.53399874300000005, 2024-04-25T22:42:17.125 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066502845000000005, 2024-04-25T22:42:17.125 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:17.125 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:17.125 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:17.125 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:17.125 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:17.125 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:17.125 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13329 2024-04-25T22:42:17.126 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.126 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:17.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.126 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:17.126 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:17.126 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.126 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.126 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:17.126 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:17.126 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.126 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.126 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.126 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:17.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486703+0000", 2024-04-25T22:42:17.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3909999999999999e-06 2024-04-25T22:42:17.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:17.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494612+0000", 2024-04-25T22:42:17.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0079096670000000004 2024-04-25T22:42:17.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:17.127 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494626+0000", 2024-04-25T22:42:17.127 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3263e-05 2024-04-25T22:42:17.127 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.127 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.127 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494637+0000", 2024-04-25T22:42:17.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.171e-05 2024-04-25T22:42:17.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494720+0000", 2024-04-25T22:42:17.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2767000000000002e-05 2024-04-25T22:42:17.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:17.128 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494834+0000", 2024-04-25T22:42:17.128 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011387699999999999 2024-04-25T22:42:17.128 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.128 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.128 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:17.129 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494998+0000", 2024-04-25T22:42:17.129 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016390799999999999 2024-04-25T22:42:17.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.129 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:17.129 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517407+0000", 2024-04-25T22:42:17.129 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022409068000000001 2024-04-25T22:42:17.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.129 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:17.129 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553040+0000", 2024-04-25T22:42:17.129 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035633155 2024-04-25T22:42:17.129 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.129 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.129 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:17.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553140+0000", 2024-04-25T22:42:17.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9623000000000005e-05 2024-04-25T22:42:17.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.130 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:17.130 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553204+0000", 2024-04-25T22:42:17.130 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4416000000000001e-05 2024-04-25T22:42:17.130 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.130 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.130 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.130 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.130 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.130 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13399 4.16 4:6bb7cc3a:::10000003648.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:17.130 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:17.130 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.46063294300000002, 2024-04-25T22:42:17.131 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045625003999999997, 2024-04-25T22:42:17.131 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:17.131 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:17.131 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:17.131 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:17.131 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:17.131 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:17.131 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13399 2024-04-25T22:42:17.131 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.131 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:17.131 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.131 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:17.131 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:17.131 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:17.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:17.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:17.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:17.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560068+0000", 2024-04-25T22:42:17.132 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:42:17.132 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.132 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.132 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:17.132 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576902+0000", 2024-04-25T22:42:17.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016833806 2024-04-25T22:42:17.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:17.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576916+0000", 2024-04-25T22:42:17.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3648e-05 2024-04-25T22:42:17.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.133 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576927+0000", 2024-04-25T22:42:17.133 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0992000000000001e-05 2024-04-25T22:42:17.133 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.133 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.133 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:17.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577026+0000", 2024-04-25T22:42:17.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9116000000000004e-05 2024-04-25T22:42:17.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:17.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577203+0000", 2024-04-25T22:42:17.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017700499999999999 2024-04-25T22:42:17.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:17.134 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577336+0000", 2024-04-25T22:42:17.134 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013340800000000001 2024-04-25T22:42:17.134 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.134 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.134 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:17.135 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.589077+0000", 2024-04-25T22:42:17.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011741151 2024-04-25T22:42:17.135 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.135 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.135 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:17.135 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605436+0000", 2024-04-25T22:42:17.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016359146000000001 2024-04-25T22:42:17.135 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.135 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.135 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:17.135 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605493+0000", 2024-04-25T22:42:17.135 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7067000000000001e-05 2024-04-25T22:42:17.135 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:17.135 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:17.136 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:17.136 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605692+0000", 2024-04-25T22:42:17.136 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00019855799999999999 2024-04-25T22:42:17.136 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.136 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.136 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.136 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:17.136 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:17.136 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:17.138 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:17.131+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:17.139 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:17.161 INFO:tasks.workunit.client.0.smithi057.stdout:0/701: dread - d0/d5/d53/f9d zero size 2024-04-25T22:42:17.161 INFO:tasks.workunit.client.0.smithi057.stdout:6/794: dwrite d2/d19/d26/f2d [4194304,4194304] 0 2024-04-25T22:42:17.161 INFO:tasks.workunit.client.0.smithi057.stdout:3/677: mknod d0/d4/d7/d26/d72/dd0/de5/cec 0 2024-04-25T22:42:17.161 INFO:tasks.workunit.client.0.smithi057.stdout:8/683: write d4/f4f [627157,7544] 0 2024-04-25T22:42:17.162 INFO:tasks.workunit.client.0.smithi057.stdout:5/811: symlink d2/d1c/d24/d3d/d50/l100 0 2024-04-25T22:42:17.162 INFO:tasks.workunit.client.0.smithi057.stdout:4/741: write d14/d2f/f66 [784412,19477] 0 2024-04-25T22:42:17.162 INFO:tasks.workunit.client.0.smithi057.stdout:8/684: chown d4/f4f 48825 1 2024-04-25T22:42:17.162 INFO:tasks.workunit.client.0.smithi057.stdout:6/795: mknod d2/d19/d9b/df3/d31/c105 0 2024-04-25T22:42:17.162 INFO:tasks.workunit.client.0.smithi057.stdout:5/812: readlink d2/d2c/db7/ldf 0 2024-04-25T22:42:17.162 INFO:tasks.workunit.client.0.smithi057.stdout:0/702: getdents d0/d3/d6/d83 0 2024-04-25T22:42:17.162 INFO:tasks.workunit.client.0.smithi057.stdout:3/678: creat d0/d4/d7/d26/d89/d97/dc1/dd3/fed x:0 0 0 2024-04-25T22:42:17.162 INFO:tasks.workunit.client.0.smithi057.stdout:4/742: chown d14/da9/db5/fc8 14197099 1 2024-04-25T22:42:17.162 INFO:tasks.workunit.client.0.smithi057.stdout:4/743: read - d14/da2/fe3 zero size 2024-04-25T22:42:17.162 INFO:tasks.workunit.client.0.smithi057.stdout:5/813: mknod d2/d1c/d24/d8f/c101 0 2024-04-25T22:42:17.162 INFO:tasks.workunit.client.0.smithi057.stdout:2/820: dread f11 [0,4194304] 0 2024-04-25T22:42:17.162 INFO:tasks.workunit.client.0.smithi057.stdout:0/703: dread - d0/d3/d4d/d87/da0/fde zero size 2024-04-25T22:42:17.162 INFO:tasks.workunit.client.0.smithi057.stdout:3/679: dread - d0/d4/d4a/f9a zero size 2024-04-25T22:42:17.162 INFO:tasks.workunit.client.0.smithi057.stdout:5/814: fdatasync d2/d2c/f81 0 2024-04-25T22:42:17.163 INFO:tasks.workunit.client.0.smithi057.stdout:4/744: creat d14/d5a/fec x:0 0 0 2024-04-25T22:42:17.163 INFO:tasks.workunit.client.0.smithi057.stdout:2/821: creat d1f/d21/d96/f120 x:0 0 0 2024-04-25T22:42:17.163 INFO:tasks.workunit.client.0.smithi057.stdout:5/815: rmdir d2/d1c 39 2024-04-25T22:42:17.163 INFO:tasks.workunit.client.0.smithi057.stdout:3/680: write d0/d4/d7/d46/d30/d7a/fd1 [674128,34927] 0 2024-04-25T22:42:17.163 INFO:tasks.workunit.client.0.smithi057.stdout:4/745: read - d14/d5a/d67/dcc/fd6 zero size 2024-04-25T22:42:17.163 INFO:tasks.workunit.client.0.smithi057.stdout:5/816: rename d2/fc9 to d2/d1c/d24/d3d/da7/db2/f102 0 2024-04-25T22:42:17.163 INFO:tasks.workunit.client.0.smithi057.stdout:4/746: creat d14/d2f/d4c/d5b/fed x:0 0 0 2024-04-25T22:42:17.163 INFO:tasks.workunit.client.0.smithi057.stdout:8/685: dwrite d4/db/dd/d3a/f3c [0,4194304] 0 2024-04-25T22:42:17.163 INFO:tasks.workunit.client.0.smithi057.stdout:2/822: rename d1f/de7/d4d/d88/dd9/da1/ddc/cb6 to d1f/d21/d96/c121 0 2024-04-25T22:42:17.163 INFO:tasks.workunit.client.0.smithi057.stdout:4/747: read d14/f39 [689155,8738] 0 2024-04-25T22:42:17.163 INFO:tasks.workunit.client.0.smithi057.stdout:0/704: dread d0/d5/d53/f69 [0,4194304] 0 2024-04-25T22:42:17.163 INFO:tasks.workunit.client.0.smithi057.stdout:6/796: dwrite d2/d19/d9b/df3/d31/fc9 [0,4194304] 0 2024-04-25T22:42:17.163 INFO:tasks.workunit.client.0.smithi057.stdout:3/681: link d0/d11/c41 d0/d6b/db6/cee 0 2024-04-25T22:42:17.163 INFO:tasks.workunit.client.0.smithi057.stdout:8/686: readlink d4/d5/d2f/lef 0 2024-04-25T22:42:17.164 INFO:tasks.workunit.client.0.smithi057.stdout:2/823: stat d1f/d21/d26/d5c/l5e 0 2024-04-25T22:42:17.164 INFO:tasks.workunit.client.0.smithi057.stdout:4/748: chown d14/d47/d5e/f8e 49527983 1 2024-04-25T22:42:17.164 INFO:tasks.workunit.client.0.smithi057.stdout:5/817: write d2/d1c/d24/fd1 [297753,78965] 0 2024-04-25T22:42:17.164 INFO:tasks.workunit.client.0.smithi057.stdout:0/705: symlink d0/d3/dae/lf9 0 2024-04-25T22:42:17.164 INFO:tasks.workunit.client.0.smithi057.stdout:3/682: truncate d0/d4/d4a/f67 928264 0 2024-04-25T22:42:17.164 INFO:tasks.workunit.client.0.smithi057.stdout:1/722: dread d7/dd/d16/d88/f8b [0,4194304] 0 2024-04-25T22:42:17.164 INFO:tasks.workunit.client.0.smithi057.stdout:0/706: mkdir d0/d3/d6/d83/dfa 0 2024-04-25T22:42:17.164 INFO:tasks.workunit.client.0.smithi057.stdout:5/818: rename d2/d1c/d24/d3d/d50/d83/c88 to d2/d1c/d24/d3d/d77/c103 0 2024-04-25T22:42:17.164 INFO:tasks.workunit.client.0.smithi057.stdout:6/797: write d2/f64 [1412593,121630] 0 2024-04-25T22:42:17.164 INFO:tasks.workunit.client.0.smithi057.stdout:1/723: mknod d7/dd/d26/ced 0 2024-04-25T22:42:17.164 INFO:tasks.workunit.client.0.smithi057.stdout:3/683: fdatasync d0/f95 0 2024-04-25T22:42:17.164 INFO:tasks.workunit.client.0.smithi057.stdout:2/824: getdents d1f/d34/d50/df0/df3 0 2024-04-25T22:42:17.164 INFO:tasks.workunit.client.0.smithi057.stdout:0/707: chown d0/d3/f4 43211835 1 2024-04-25T22:42:17.164 INFO:tasks.workunit.client.0.smithi057.stdout:6/798: stat d2/d19/d50/d91/cae 0 2024-04-25T22:42:17.164 INFO:tasks.workunit.client.0.smithi057.stdout:8/687: getdents d4/db/dd/d3a/d5c/d76 0 2024-04-25T22:42:17.165 INFO:tasks.workunit.client.0.smithi057.stdout:1/724: creat d7/dd/d90/fee x:0 0 0 2024-04-25T22:42:17.165 INFO:tasks.workunit.client.0.smithi057.stdout:5/819: fdatasync d2/d6/f58 0 2024-04-25T22:42:17.165 INFO:tasks.workunit.client.0.smithi057.stdout:2/825: creat d1f/de7/d4d/d88/dd9/da1/f122 x:0 0 0 2024-04-25T22:42:17.165 INFO:tasks.workunit.client.0.smithi057.stdout:6/799: rename d2/d19/d9b/df3/d5e to d2/d86/d90/d106 0 2024-04-25T22:42:17.165 INFO:tasks.workunit.client.0.smithi057.stdout:9/696: dread d3/d34/f5b [0,4194304] 0 2024-04-25T22:42:17.165 INFO:tasks.workunit.client.0.smithi057.stdout:4/749: creat d14/d2f/d4c/d5b/dd8/dbf/fee x:0 0 0 2024-04-25T22:42:17.165 INFO:tasks.workunit.client.0.smithi057.stdout:1/725: chown d7/dd/l7c 33344603 1 2024-04-25T22:42:17.165 INFO:tasks.workunit.client.0.smithi057.stdout:0/708: mkdir d0/d49/d6d/dea/dfb 0 2024-04-25T22:42:17.165 INFO:tasks.workunit.client.0.smithi057.stdout:6/800: chown d2/d19/d26/d4f/d95/ld9 178707 1 2024-04-25T22:42:17.165 INFO:tasks.workunit.client.0.smithi057.stdout:2/826: chown d1f/d21/d26/c55 23 1 2024-04-25T22:42:17.165 INFO:tasks.workunit.client.0.smithi057.stdout:1/726: symlink d7/dd/d90/lef 0 2024-04-25T22:42:17.165 INFO:tasks.workunit.client.0.smithi057.stdout:6/801: read d2/d86/d90/d106/dda/ff9 [2513973,74192] 0 2024-04-25T22:42:17.165 INFO:tasks.workunit.client.0.smithi057.stdout:4/750: rename d14/da9/d44 to d14/d47/d5e/dea/def 0 2024-04-25T22:42:17.165 INFO:tasks.workunit.client.0.smithi057.stdout:1/727: creat d7/dd/d26/ff0 x:0 0 0 2024-04-25T22:42:17.166 INFO:tasks.workunit.client.0.smithi057.stdout:2/827: creat d1f/f123 x:0 0 0 2024-04-25T22:42:17.166 INFO:tasks.workunit.client.0.smithi057.stdout:7/672: dread d6/d28/d4e/d30/d60/d8d/d96/d59/f61 [0,4194304] 0 2024-04-25T22:42:17.166 INFO:tasks.workunit.client.0.smithi057.stdout:6/802: chown d2/d86/f98 5904 1 2024-04-25T22:42:17.166 INFO:tasks.workunit.client.0.smithi057.stdout:2/828: chown d1f/d21/cd1 9 1 2024-04-25T22:42:17.166 INFO:tasks.workunit.client.0.smithi057.stdout:7/673: chown d6/l6e 123 1 2024-04-25T22:42:17.166 INFO:tasks.workunit.client.0.smithi057.stdout:1/728: dread - d7/d65/d6a/d98/dc5/de7/d45/f94 zero size 2024-04-25T22:42:17.166 INFO:tasks.workunit.client.0.smithi057.stdout:6/803: mknod d2/d19/d49/d62/d79/c107 0 2024-04-25T22:42:17.166 INFO:tasks.workunit.client.0.smithi057.stdout:2/829: unlink d1f/d34/l79 0 2024-04-25T22:42:17.166 INFO:tasks.workunit.client.0.smithi057.stdout:4/751: read d14/da9/f75 [1587536,118717] 0 2024-04-25T22:42:17.166 INFO:tasks.workunit.client.0.smithi057.stdout:1/729: creat d7/d65/d6a/d98/dc5/de7/d45/dd8/ff1 x:0 0 0 2024-04-25T22:42:17.166 INFO:tasks.workunit.client.0.smithi057.stdout:2/830: dread - d1f/de7/d4d/d88/dd9/dd6/fd8 zero size 2024-04-25T22:42:17.166 INFO:tasks.workunit.client.0.smithi057.stdout:0/709: dwrite d0/f66 [0,4194304] 0 2024-04-25T22:42:17.166 INFO:tasks.workunit.client.0.smithi057.stdout:4/752: creat d14/d2f/d4c/ff0 x:0 0 0 2024-04-25T22:42:17.166 INFO:tasks.workunit.client.0.smithi057.stdout:1/730: symlink d7/dd/d16/lf2 0 2024-04-25T22:42:17.167 INFO:tasks.workunit.client.0.smithi057.stdout:7/674: link d6/d28/d4e/d30/d60/d8d/d96/d51/dad/da6/cac d6/d28/ce0 0 2024-04-25T22:42:17.167 INFO:tasks.workunit.client.0.smithi057.stdout:2/831: dread - d1f/d34/d50/df0/ff4 zero size 2024-04-25T22:42:17.167 INFO:tasks.workunit.client.0.smithi057.stdout:1/731: rename d7/f8e to d7/dd/d16/d88/ff3 0 2024-04-25T22:42:17.167 INFO:tasks.workunit.client.0.smithi057.stdout:2/832: chown d1f/de7/d4d/d88/fcc 2 1 2024-04-25T22:42:17.167 INFO:tasks.workunit.client.0.smithi057.stdout:7/675: fdatasync d6/d28/d4e/d30/d60/d8d/d96/d51/f83 0 2024-04-25T22:42:17.167 INFO:tasks.workunit.client.0.smithi057.stdout:9/697: dwrite d3/d34/d42/d28/d62/d67/d6e/d7c/fcd [0,4194304] 0 2024-04-25T22:42:17.167 INFO:tasks.workunit.client.0.smithi057.stdout:1/732: link d7/dd/d90/dbf/fc2 d7/dd/d26/ff4 0 2024-04-25T22:42:17.167 INFO:tasks.workunit.client.0.smithi057.stdout:1/733: fdatasync d7/d65/d6a/d98/f60 0 2024-04-25T22:42:17.167 INFO:tasks.workunit.client.0.smithi057.stdout:9/698: getdents d3 0 2024-04-25T22:42:17.167 INFO:tasks.workunit.client.0.smithi057.stdout:2/833: dwrite f6 [0,4194304] 0 2024-04-25T22:42:17.167 INFO:tasks.workunit.client.0.smithi057.stdout:6/804: write d2/d19/d20/d61/f89 [1296268,9145] 0 2024-04-25T22:42:17.167 INFO:tasks.workunit.client.0.smithi057.stdout:0/710: dwrite d0/d49/f6b [0,4194304] 0 2024-04-25T22:42:17.167 INFO:tasks.workunit.client.0.smithi057.stdout:0/711: readlink d0/lf7 0 2024-04-25T22:42:17.167 INFO:tasks.workunit.client.0.smithi057.stdout:1/734: creat d7/d65/d6a/d98/dc5/de7/d45/ff5 x:0 0 0 2024-04-25T22:42:17.167 INFO:tasks.workunit.client.0.smithi057.stdout:2/834: rmdir d1f/de7/d4d/d88 39 2024-04-25T22:42:17.168 INFO:tasks.workunit.client.0.smithi057.stdout:9/699: creat d3/d34/d42/d28/d62/dcf/fdd x:0 0 0 2024-04-25T22:42:17.168 INFO:tasks.workunit.client.0.smithi057.stdout:2/835: readlink d1f/d34/d50/leb 0 2024-04-25T22:42:17.168 INFO:tasks.workunit.client.0.smithi057.stdout:7/676: dread d6/d28/d4e/d30/d60/d8d/d96/d5d/f5e [0,4194304] 0 2024-04-25T22:42:17.168 INFO:tasks.workunit.client.0.smithi057.stdout:8/688: dwrite d4/d5/d17/d19/d35/d83/d92/d5b/f7e [0,4194304] 0 2024-04-25T22:42:17.168 INFO:tasks.workunit.client.0.smithi057.stdout:8/689: symlink d4/db/d12/dc0/lfb 0 2024-04-25T22:42:17.168 INFO:tasks.workunit.client.0.smithi057.stdout:7/677: getdents d6/d88 0 2024-04-25T22:42:17.168 INFO:tasks.workunit.client.0.smithi057.stdout:1/735: dwrite d7/dd/d16/d18/d31/fd9 [0,4194304] 0 2024-04-25T22:42:17.168 INFO:tasks.workunit.client.0.smithi057.stdout:9/700: dread d3/d34/d42/d28/d62/d67/d6e/d7c/fcd [0,4194304] 0 2024-04-25T22:42:17.168 INFO:tasks.workunit.client.0.smithi057.stdout:5/820: dread d2/d1c/d24/d3d/da7/db2/fb5 [0,4194304] 0 2024-04-25T22:42:17.168 INFO:tasks.workunit.client.0.smithi057.stdout:4/753: dread d14/d2f/d4c/d5b/db8/fe1 [0,4194304] 0 2024-04-25T22:42:17.168 INFO:tasks.workunit.client.0.smithi057.stdout:1/736: write d7/dd/d16/f7e [38534,100819] 0 2024-04-25T22:42:17.168 INFO:tasks.workunit.client.0.smithi057.stdout:9/701: write d3/f64 [1285847,13539] 0 2024-04-25T22:42:17.168 INFO:tasks.workunit.client.0.smithi057.stdout:3/684: dread d0/d11/f1e [0,4194304] 0 2024-04-25T22:42:17.168 INFO:tasks.workunit.client.0.smithi057.stdout:7/678: creat d6/d28/d4e/d30/d60/d8d/d96/d59/d84/fe1 x:0 0 0 2024-04-25T22:42:17.168 INFO:tasks.workunit.client.0.smithi057.stdout:5/821: dread - d2/d6/fe1 zero size 2024-04-25T22:42:17.169 INFO:tasks.workunit.client.0.smithi057.stdout:2/836: dwrite d1f/d36/fdb [0,4194304] 0 2024-04-25T22:42:17.169 INFO:tasks.workunit.client.0.smithi057.stdout:1/737: creat d7/dd/d90/ff6 x:0 0 0 2024-04-25T22:42:17.169 INFO:tasks.workunit.client.0.smithi057.stdout:3/685: write d0/d4/f2d [3284623,115051] 0 2024-04-25T22:42:17.169 INFO:tasks.workunit.client.0.smithi057.stdout:4/754: mknod d14/d5a/d67/dcc/cf1 0 2024-04-25T22:42:17.169 INFO:tasks.workunit.client.0.smithi057.stdout:8/690: write d4/d5/d2f/f41 [1911820,44431] 0 2024-04-25T22:42:17.169 INFO:tasks.workunit.client.0.smithi057.stdout:2/837: write d1f/d21/d33/f5a [4486970,46969] 0 2024-04-25T22:42:17.169 INFO:tasks.workunit.client.0.smithi057.stdout:7/679: truncate d6/d28/d4e/f2d 5834018 0 2024-04-25T22:42:17.169 INFO:tasks.workunit.client.0.smithi057.stdout:0/712: dwrite d0/d3/d4d/d87/ff2 [0,4194304] 0 2024-04-25T22:42:17.169 INFO:tasks.workunit.client.0.smithi057.stdout:9/702: mknod d3/d34/d42/d28/d2d/dc8/cde 0 2024-04-25T22:42:17.169 INFO:tasks.workunit.client.0.smithi057.stdout:7/680: readlink d6/d28/d4e/d30/l3f 0 2024-04-25T22:42:17.169 INFO:tasks.workunit.client.0.smithi057.stdout:1/738: truncate d7/dd/d16/fbc 1452950 0 2024-04-25T22:42:17.169 INFO:tasks.workunit.client.0.smithi057.stdout:8/691: truncate d4/db/dd/d3a/fa4 2872813 0 2024-04-25T22:42:17.169 INFO:tasks.workunit.client.0.smithi057.stdout:1/739: write d7/d65/d6a/d98/f51 [1447310,129901] 0 2024-04-25T22:42:17.169 INFO:tasks.workunit.client.0.smithi057.stdout:8/692: creat d4/deb/ffc x:0 0 0 2024-04-25T22:42:17.169 INFO:tasks.workunit.client.0.smithi057.stdout:0/713: unlink d0/d3/d6/d14/d39/f76 0 2024-04-25T22:42:17.170 INFO:tasks.workunit.client.0.smithi057.stdout:9/703: symlink d3/d34/d42/d28/d62/d67/d6e/d7c/db8/ldf 0 2024-04-25T22:42:17.170 INFO:tasks.workunit.client.0.smithi057.stdout:7/681: creat d6/d28/d4e/d30/d60/d8d/d96/d51/fe2 x:0 0 0 2024-04-25T22:42:17.170 INFO:tasks.workunit.client.0.smithi057.stdout:7/682: readlink d6/lc9 0 2024-04-25T22:42:17.170 INFO:tasks.workunit.client.0.smithi057.stdout:0/714: dread - d0/d3/d3a/d3b/fa9 zero size 2024-04-25T22:42:17.170 INFO:tasks.workunit.client.0.smithi057.stdout:9/704: write d3/d34/d42/d28/dc1/fc2 [2405098,63992] 0 2024-04-25T22:42:17.170 INFO:tasks.workunit.client.0.smithi057.stdout:1/740: creat d7/d65/d6a/d98/dc5/de7/d45/dd8/ff7 x:0 0 0 2024-04-25T22:42:17.170 INFO:tasks.workunit.client.0.smithi057.stdout:0/715: chown d0/d3/d6/d14/l8e 1866 1 2024-04-25T22:42:17.170 INFO:tasks.workunit.client.0.smithi057.stdout:7/683: creat d6/d28/d4e/d30/d60/fe3 x:0 0 0 2024-04-25T22:42:17.170 INFO:tasks.workunit.client.0.smithi057.stdout:9/705: creat d3/d34/d42/d28/dc1/dda/fe0 x:0 0 0 2024-04-25T22:42:17.170 INFO:tasks.workunit.client.0.smithi057.stdout:1/741: mkdir d7/d65/d6a/d98/dc5/de7/d75/dc4/df8 0 2024-04-25T22:42:17.170 INFO:tasks.workunit.client.0.smithi057.stdout:2/838: dwrite d1f/d34/f57 [0,4194304] 0 2024-04-25T22:42:17.170 INFO:tasks.workunit.client.0.smithi057.stdout:2/839: fdatasync d1f/d21/d26/d63/d7f/ff5 0 2024-04-25T22:42:17.170 INFO:tasks.workunit.client.0.smithi057.stdout:4/755: write d14/d2f/f57 [1606616,69527] 0 2024-04-25T22:42:17.170 INFO:tasks.workunit.client.0.smithi057.stdout:9/706: write d3/d34/d42/d28/d62/d67/d6e/d7c/fdb [163385,11474] 0 2024-04-25T22:42:17.171 INFO:tasks.workunit.client.0.smithi057.stdout:8/693: dwrite d4/db/d12/fe4 [0,4194304] 0 2024-04-25T22:42:17.171 INFO:tasks.workunit.client.0.smithi057.stdout:2/840: symlink d1f/d36/d54/dda/l124 0 2024-04-25T22:42:17.171 INFO:tasks.workunit.client.0.smithi057.stdout:4/756: creat d14/d5a/d67/dcc/ff2 x:0 0 0 2024-04-25T22:42:17.171 INFO:tasks.workunit.client.0.smithi057.stdout:2/841: mknod d1f/d36/c125 0 2024-04-25T22:42:17.171 INFO:tasks.workunit.client.0.smithi057.stdout:0/716: dwrite d0/d3/d3a/d3b/f70 [4194304,4194304] 0 2024-04-25T22:42:17.171 INFO:tasks.workunit.client.0.smithi057.stdout:2/842: unlink d1f/d21/df6/f110 0 2024-04-25T22:42:17.171 INFO:tasks.workunit.client.0.smithi057.stdout:9/707: chown d3/d34/d42/d28/d62/d67/d6e/c86 249 1 2024-04-25T22:42:17.171 INFO:tasks.workunit.client.0.smithi057.stdout:3/686: dwrite d0/d11/f12 [0,4194304] 0 2024-04-25T22:42:17.171 INFO:tasks.workunit.client.0.smithi057.stdout:6/805: dread d2/d19/f43 [0,4194304] 0 2024-04-25T22:42:17.171 INFO:tasks.workunit.client.0.smithi057.stdout:1/742: dread d7/dd/d16/d24/d61/fa0 [0,4194304] 0 2024-04-25T22:42:17.171 INFO:tasks.workunit.client.0.smithi057.stdout:2/843: chown d1f/de7/db1/le1 172328 1 2024-04-25T22:42:17.171 INFO:tasks.workunit.client.0.smithi057.stdout:2/844: fsync d1f/d34/d50/f53 0 2024-04-25T22:42:17.171 INFO:tasks.workunit.client.0.smithi057.stdout:3/687: write d0/d4/d7/d22/fd9 [115742,63313] 0 2024-04-25T22:42:17.171 INFO:tasks.workunit.client.0.smithi057.stdout:2/845: dread - d1f/d34/d50/df0/df3/f117 zero size 2024-04-25T22:42:17.171 INFO:tasks.workunit.client.0.smithi057.stdout:5/822: dread d2/d47/f9e [0,4194304] 0 2024-04-25T22:42:17.172 INFO:tasks.workunit.client.0.smithi057.stdout:5/823: mkdir d2/d104 0 2024-04-25T22:42:17.172 INFO:tasks.workunit.client.0.smithi057.stdout:2/846: mkdir d1f/d21/d26/d63/d7f/dff/d126 0 2024-04-25T22:42:17.172 INFO:tasks.workunit.client.0.smithi057.stdout:8/694: truncate d4/db/fb2 134546 0 2024-04-25T22:42:17.172 INFO:tasks.workunit.client.0.smithi057.stdout:9/708: dread d3/d34/d42/fa6 [8388608,4194304] 0 2024-04-25T22:42:17.172 INFO:tasks.workunit.client.0.smithi057.stdout:5/824: creat d2/d1c/dfd/f105 x:0 0 0 2024-04-25T22:42:17.172 INFO:tasks.workunit.client.0.smithi057.stdout:3/688: creat d0/d4/d7/d26/d89/fef x:0 0 0 2024-04-25T22:42:17.172 INFO:tasks.workunit.client.0.smithi057.stdout:0/717: dread d0/d3/d6/d14/f7a [0,4194304] 0 2024-04-25T22:42:17.172 INFO:tasks.workunit.client.0.smithi057.stdout:9/709: write d3/d34/d42/d28/f6f [320826,114667] 0 2024-04-25T22:42:17.172 INFO:tasks.workunit.client.0.smithi057.stdout:0/718: stat d0/f8c 0 2024-04-25T22:42:17.172 INFO:tasks.workunit.client.0.smithi057.stdout:3/689: rename d0/l50 to d0/d4/d34/d3c/d53/lf0 0 2024-04-25T22:42:17.172 INFO:tasks.workunit.client.0.smithi057.stdout:9/710: chown d3/d34/d42/d28/d62/dcf/fdd 554897 1 2024-04-25T22:42:17.172 INFO:tasks.workunit.client.0.smithi057.stdout:0/719: read - d0/d49/d6d/fc9 zero size 2024-04-25T22:42:17.172 INFO:tasks.workunit.client.0.smithi057.stdout:5/825: rename d2/d1c/d24/d8f/lb0 to d2/d47/da5/l106 0 2024-04-25T22:42:17.172 INFO:tasks.workunit.client.0.smithi057.stdout:3/690: dread - d0/d4/d34/d3c/d53/db1/dce/fda zero size 2024-04-25T22:42:17.172 INFO:tasks.workunit.client.0.smithi057.stdout:4/757: dread d14/d47/fb7 [0,4194304] 0 2024-04-25T22:42:17.173 INFO:tasks.workunit.client.0.smithi057.stdout:5/826: write d2/d2c/db7/fcb [1958200,15502] 0 2024-04-25T22:42:17.173 INFO:tasks.workunit.client.0.smithi057.stdout:0/720: mknod d0/d3/d6/d14/d39/cfc 0 2024-04-25T22:42:17.173 INFO:tasks.workunit.client.0.smithi057.stdout:4/758: mknod d14/d2f/d4c/d5b/db8/cf3 0 2024-04-25T22:42:17.173 INFO:tasks.workunit.client.0.smithi057.stdout:5/827: creat d2/d47/d87/dd2/f107 x:0 0 0 2024-04-25T22:42:17.173 INFO:tasks.workunit.client.0.smithi057.stdout:3/691: creat d0/d4/d34/d3c/d53/ff1 x:0 0 0 2024-04-25T22:42:17.173 INFO:tasks.workunit.client.0.smithi057.stdout:0/721: read d0/f8c [20417,97044] 0 2024-04-25T22:42:17.173 INFO:tasks.workunit.client.0.smithi057.stdout:8/695: dwrite d4/d5/d2f/fb4 [0,4194304] 0 2024-04-25T22:42:17.173 INFO:tasks.workunit.client.0.smithi057.stdout:5/828: write d2/d1c/d46/f66 [844728,27843] 0 2024-04-25T22:42:17.173 INFO:tasks.workunit.client.0.smithi057.stdout:3/692: chown d0/d4/d7/d46/f84 7 1 2024-04-25T22:42:17.173 INFO:tasks.workunit.client.0.smithi057.stdout:4/759: creat d14/d2f/d4c/d5b/daa/ff4 x:0 0 0 2024-04-25T22:42:17.173 INFO:tasks.workunit.client.0.smithi057.stdout:0/722: symlink d0/d49/d6d/dea/lfd 0 2024-04-25T22:42:17.173 INFO:tasks.workunit.client.0.smithi057.stdout:8/696: creat d4/db/d12/dc0/ffd x:0 0 0 2024-04-25T22:42:17.173 INFO:tasks.workunit.client.0.smithi057.stdout:9/711: dwrite d3/d34/d42/d28/d62/dcf/fdd [0,4194304] 0 2024-04-25T22:42:17.173 INFO:tasks.workunit.client.0.smithi057.stdout:3/693: mknod d0/d4/d34/d3c/d53/db1/dce/cf2 0 2024-04-25T22:42:17.173 INFO:tasks.workunit.client.0.smithi057.stdout:4/760: rename d14/d2f/fa3 to d14/d2f/ff5 0 2024-04-25T22:42:17.174 INFO:tasks.workunit.client.0.smithi057.stdout:8/697: fsync d4/f5e 0 2024-04-25T22:42:17.174 INFO:tasks.workunit.client.0.smithi057.stdout:3/694: creat d0/d5b/ff3 x:0 0 0 2024-04-25T22:42:17.174 INFO:tasks.workunit.client.0.smithi057.stdout:4/761: chown d14/da9/f98 50849 1 2024-04-25T22:42:17.174 INFO:tasks.workunit.client.0.smithi057.stdout:5/829: truncate d2/d1c/d24/d3d/d77/dcd/ddd/fea 1341595 0 2024-04-25T22:42:17.174 INFO:tasks.workunit.client.0.smithi057.stdout:0/723: getdents d0/d3/d88/da3/dec 0 2024-04-25T22:42:17.174 INFO:tasks.workunit.client.0.smithi057.stdout:3/695: fdatasync d0/d4/d7/d22/da0/fb7 0 2024-04-25T22:42:17.174 INFO:tasks.workunit.client.0.smithi057.stdout:6/806: dread d2/d19/d26/d4f/d95/fb6 [0,4194304] 0 2024-04-25T22:42:17.174 INFO:tasks.workunit.client.0.smithi057.stdout:6/807: mkdir d2/d86/d108 0 2024-04-25T22:42:17.174 INFO:tasks.workunit.client.0.smithi057.stdout:3/696: creat d0/d4/d7b/ff4 x:0 0 0 2024-04-25T22:42:17.174 INFO:tasks.workunit.client.0.smithi057.stdout:6/808: rmdir d2/d86/d90 39 2024-04-25T22:42:17.174 INFO:tasks.workunit.client.0.smithi057.stdout:0/724: rename d0/d3/d6/d14/d39/fc7 to d0/d5/d53/ffe 0 2024-04-25T22:42:17.174 INFO:tasks.workunit.client.0.smithi057.stdout:9/712: dread d3/d34/d42/d28/d2d/d7a/f87 [0,4194304] 0 2024-04-25T22:42:17.174 INFO:tasks.workunit.client.0.smithi057.stdout:2/847: dread d1f/d21/f45 [0,4194304] 0 2024-04-25T22:42:17.174 INFO:tasks.workunit.client.0.smithi057.stdout:6/809: symlink d2/d19/d20/d61/l109 0 2024-04-25T22:42:17.174 INFO:tasks.workunit.client.0.smithi057.stdout:0/725: mknod d0/d3/d6/d14/d39/dda/cff 0 2024-04-25T22:42:17.175 INFO:tasks.workunit.client.0.smithi057.stdout:9/713: getdents d3/d34/d42/d28/d39/d54 0 2024-04-25T22:42:17.175 INFO:tasks.workunit.client.0.smithi057.stdout:6/810: creat d2/d86/f10a x:0 0 0 2024-04-25T22:42:17.175 INFO:tasks.workunit.client.0.smithi057.stdout:0/726: creat d0/de5/f100 x:0 0 0 2024-04-25T22:42:17.175 INFO:tasks.workunit.client.0.smithi057.stdout:2/848: symlink d1f/d21/d105/l127 0 2024-04-25T22:42:17.175 INFO:tasks.workunit.client.0.smithi057.stdout:9/714: mkdir d3/d34/d42/d5e/da3/de1 0 2024-04-25T22:42:17.175 INFO:tasks.workunit.client.0.smithi057.stdout:0/727: symlink d0/d3/d6/l101 0 2024-04-25T22:42:17.175 INFO:tasks.workunit.client.0.smithi057.stdout:2/849: creat d1f/d21/d26/d63/d7f/d86/f128 x:0 0 0 2024-04-25T22:42:17.175 INFO:tasks.workunit.client.0.smithi057.stdout:2/850: fsync d1f/d21/d26/d63/ff7 0 2024-04-25T22:42:17.175 INFO:tasks.workunit.client.0.smithi057.stdout:9/715: creat d3/d34/d42/d5e/da3/fe2 x:0 0 0 2024-04-25T22:42:17.175 INFO:tasks.workunit.client.0.smithi057.stdout:0/728: rename d0/d3/d88 to d0/d3/d4d/d87/d102 0 2024-04-25T22:42:17.175 INFO:tasks.workunit.client.0.smithi057.stdout:4/762: dwrite d14/d47/d62/f6a [0,4194304] 0 2024-04-25T22:42:17.175 INFO:tasks.workunit.client.0.smithi057.stdout:9/716: chown d3/d34/d42/d28/d2d/f40 98 1 2024-04-25T22:42:17.175 INFO:tasks.workunit.client.0.smithi057.stdout:2/851: rmdir d1f/de7/d4d/d88/dd9/da1/ddc 39 2024-04-25T22:42:17.175 INFO:tasks.workunit.client.0.smithi057.stdout:0/729: stat d0/d3/d3a/d3b/f73 0 2024-04-25T22:42:17.176 INFO:tasks.workunit.client.0.smithi057.stdout:9/717: read - d3/d34/d42/d28/d39/db3/fdc zero size 2024-04-25T22:42:17.176 INFO:tasks.workunit.client.0.smithi057.stdout:0/730: write d0/d49/d6d/fce [384503,39437] 0 2024-04-25T22:42:17.176 INFO:tasks.workunit.client.0.smithi057.stdout:6/811: dwrite d2/f14 [0,4194304] 0 2024-04-25T22:42:17.176 INFO:tasks.workunit.client.0.smithi057.stdout:9/718: unlink d3/d34/d42/d28/d62/dcf/fdd 0 2024-04-25T22:42:17.176 INFO:tasks.workunit.client.0.smithi057.stdout:0/731: symlink d0/d3/d6/d14/l103 0 2024-04-25T22:42:17.176 INFO:tasks.workunit.client.0.smithi057.stdout:9/719: dread d3/d34/d42/d28/d2d/d7a/f87 [0,4194304] 0 2024-04-25T22:42:17.176 INFO:tasks.workunit.client.0.smithi057.stdout:8/698: truncate d4/db/f34 6778699 0 2024-04-25T22:42:17.176 INFO:tasks.workunit.client.0.smithi057.stdout:5/830: truncate d2/d47/d87/dd2/fb1 3267518 0 2024-04-25T22:42:17.176 INFO:tasks.workunit.client.0.smithi057.stdout:1/743: dread d7/dd/f14 [4194304,4194304] 0 2024-04-25T22:42:17.176 INFO:tasks.workunit.client.0.smithi057.stdout:8/699: dread - d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/dc8/f90 zero size 2024-04-25T22:42:17.176 INFO:tasks.workunit.client.0.smithi057.stdout:5/831: write d2/d1c/d24/d3d/da7/fac [1250565,99737] 0 2024-04-25T22:42:17.176 INFO:tasks.workunit.client.0.smithi057.stdout:7/684: dread d6/d28/d4e/d30/f5a [0,4194304] 0 2024-04-25T22:42:17.176 INFO:tasks.workunit.client.0.smithi057.stdout:6/812: dwrite d2/d19/f1e [0,4194304] 0 2024-04-25T22:42:17.176 INFO:tasks.workunit.client.0.smithi057.stdout:1/744: creat d7/dd/d16/d18/ff9 x:0 0 0 2024-04-25T22:42:17.176 INFO:tasks.workunit.client.0.smithi057.stdout:2/852: dread d1f/d21/d33/daa/fed [0,4194304] 0 2024-04-25T22:42:17.177 INFO:tasks.workunit.client.0.smithi057.stdout:8/700: stat d4/d5/d17/d19/d35/d83/d92/d5b/lc1 0 2024-04-25T22:42:17.177 INFO:tasks.workunit.client.0.smithi057.stdout:0/732: dwrite d0/d5/d53/ffe [0,4194304] 0 2024-04-25T22:42:17.177 INFO:tasks.workunit.client.0.smithi057.stdout:9/720: truncate d3/d34/d42/f41 578475 0 2024-04-25T22:42:17.177 INFO:tasks.workunit.client.0.smithi057.stdout:7/685: readlink d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/lcd 0 2024-04-25T22:42:17.177 INFO:tasks.workunit.client.0.smithi057.stdout:8/701: rmdir d4/d5/d17/da7 39 2024-04-25T22:42:17.177 INFO:tasks.workunit.client.0.smithi057.stdout:5/832: stat d2/d1c/d24/d3d/d77/dcd 0 2024-04-25T22:42:17.177 INFO:tasks.workunit.client.0.smithi057.stdout:9/721: mkdir d3/dd8/de3 0 2024-04-25T22:42:17.177 INFO:tasks.workunit.client.0.smithi057.stdout:0/733: rmdir d0/d3/d3a/d3b 39 2024-04-25T22:42:17.177 INFO:tasks.workunit.client.0.smithi057.stdout:3/697: dwrite d0/d4/d7/d22/f59 [4194304,4194304] 0 2024-04-25T22:42:17.177 INFO:tasks.workunit.client.0.smithi057.stdout:7/686: dread - d6/d28/d4e/d30/d60/d8d/d96/d59/d84/fb4 zero size 2024-04-25T22:42:17.177 INFO:tasks.workunit.client.0.smithi057.stdout:6/813: getdents d2/d19/d85 0 2024-04-25T22:42:17.177 INFO:tasks.workunit.client.0.smithi057.stdout:5/833: symlink d2/d47/da5/l108 0 2024-04-25T22:42:17.177 INFO:tasks.workunit.client.0.smithi057.stdout:3/698: rmdir d0/d4/d7/dad/db3 39 2024-04-25T22:42:17.177 INFO:tasks.workunit.client.0.smithi057.stdout:1/745: dwrite d7/dd/d16/d24/f38 [4194304,4194304] 0 2024-04-25T22:42:17.178 INFO:tasks.workunit.client.0.smithi057.stdout:0/734: write d0/d3/d4d/f37 [3896858,81738] 0 2024-04-25T22:42:17.178 INFO:tasks.workunit.client.0.smithi057.stdout:6/814: chown d2/d59/cbb 90185513 1 2024-04-25T22:42:17.178 INFO:tasks.workunit.client.0.smithi057.stdout:2/853: dwrite d1f/d21/d105/f119 [0,4194304] 0 2024-04-25T22:42:17.178 INFO:tasks.workunit.client.0.smithi057.stdout:9/722: rename d3/d34/d42/d28/d39/c4c to d3/d34/d42/d28/dc1/dda/ce4 0 2024-04-25T22:42:17.178 INFO:tasks.workunit.client.0.smithi057.stdout:7/687: mkdir d6/d28/d4e/d30/d46/d73/de4 0 2024-04-25T22:42:17.178 INFO:tasks.workunit.client.0.smithi057.stdout:1/746: truncate d7/dd/d16/fbc 2497905 0 2024-04-25T22:42:17.178 INFO:tasks.workunit.client.0.smithi057.stdout:3/699: rename d0/d4/f98 to d0/d6b/db6/ff5 0 2024-04-25T22:42:17.178 INFO:tasks.workunit.client.0.smithi057.stdout:1/747: mknod d7/dd/d26/cfa 0 2024-04-25T22:42:17.178 INFO:tasks.workunit.client.0.smithi057.stdout:6/815: chown d2/d19/d50/d1a/c44 886858941 1 2024-04-25T22:42:17.178 INFO:tasks.workunit.client.0.smithi057.stdout:2/854: mkdir d1f/d36/d129 0 2024-04-25T22:42:17.178 INFO:tasks.workunit.client.0.smithi057.stdout:8/702: dwrite d4/db/fc [0,4194304] 0 2024-04-25T22:42:17.178 INFO:tasks.workunit.client.0.smithi057.stdout:3/700: mkdir d0/d4/d7/d46/df6 0 2024-04-25T22:42:17.178 INFO:tasks.workunit.client.0.smithi057.stdout:7/688: dread - d6/d28/d4e/d30/d60/d8d/d96/d51/fe2 zero size 2024-04-25T22:42:17.178 INFO:tasks.workunit.client.0.smithi057.stdout:2/855: mkdir d1f/d21/d96/d12a 0 2024-04-25T22:42:17.179 INFO:tasks.workunit.client.0.smithi057.stdout:9/723: link d3/c17 d3/d34/d42/d5e/d83/ce5 0 2024-04-25T22:42:17.179 INFO:tasks.workunit.client.0.smithi057.stdout:3/701: write d0/d4/d7/d46/d30/d99/fbc [434639,9944] 0 2024-04-25T22:42:17.179 INFO:tasks.workunit.client.0.smithi057.stdout:6/816: mkdir d2/d86/d90/d106/dda/d10b 0 2024-04-25T22:42:17.183 INFO:tasks.workunit.client.0.smithi057.stdout:2/856: fdatasync d1f/d36/d54/f95 0 2024-04-25T22:42:17.183 INFO:tasks.workunit.client.0.smithi057.stdout:5/834: write d2/d1c/d46/d3a/f65 [2736739,41492] 0 2024-04-25T22:42:17.183 INFO:tasks.workunit.client.0.smithi057.stdout:7/689: symlink d6/d28/d4e/d30/d60/d6f/dbf/le5 0 2024-04-25T22:42:17.183 INFO:tasks.workunit.client.0.smithi057.stdout:5/835: readlink d2/d6/db/l45 0 2024-04-25T22:42:17.183 INFO:tasks.workunit.client.0.smithi057.stdout:9/724: write d3/d34/d42/d28/d2d/d7a/f87 [972984,111846] 0 2024-04-25T22:42:17.183 INFO:tasks.workunit.client.0.smithi057.stdout:8/703: dread d4/f52 [0,4194304] 0 2024-04-25T22:42:17.183 INFO:tasks.workunit.client.0.smithi057.stdout:5/836: chown d2/l97 422387992 1 2024-04-25T22:42:17.183 INFO:tasks.workunit.client.0.smithi057.stdout:0/735: dwrite d0/d3/d3a/f40 [0,4194304] 0 2024-04-25T22:42:17.183 INFO:tasks.workunit.client.0.smithi057.stdout:8/704: creat d4/db/dd/d3a/d5c/d76/ffe x:0 0 0 2024-04-25T22:42:17.184 INFO:tasks.workunit.client.0.smithi057.stdout:9/725: symlink d3/d34/d42/d28/dc1/le6 0 2024-04-25T22:42:17.184 INFO:tasks.workunit.client.0.smithi057.stdout:7/690: rename d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/f8e to d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/fe6 0 2024-04-25T22:42:17.184 INFO:tasks.workunit.client.0.smithi057.stdout:5/837: rename d2/d1c/d46/dd0/fff to d2/d1c/d46/d3a/da8/f109 0 2024-04-25T22:42:17.184 INFO:tasks.workunit.client.0.smithi057.stdout:9/726: creat d3/fe7 x:0 0 0 2024-04-25T22:42:17.184 INFO:tasks.workunit.client.0.smithi057.stdout:6/817: link d2/d19/d26/d4f/f60 d2/d19/d26/d4f/f10c 0 2024-04-25T22:42:17.184 INFO:tasks.workunit.client.0.smithi057.stdout:0/736: rename d0/d3/d4d/c5e to d0/d49/d6d/dea/c104 0 2024-04-25T22:42:17.184 INFO:tasks.workunit.client.0.smithi057.stdout:6/818: dread - d2/d19/d9b/df3/fc1 zero size 2024-04-25T22:42:17.184 INFO:tasks.workunit.client.0.smithi057.stdout:5/838: creat d2/d1c/d24/d3d/d50/f10a x:0 0 0 2024-04-25T22:42:17.184 INFO:tasks.workunit.client.0.smithi057.stdout:0/737: truncate d0/d3/d4d/d87/ff2 4925304 0 2024-04-25T22:42:17.184 INFO:tasks.workunit.client.0.smithi057.stdout:0/738: symlink d0/d49/d97/l105 0 2024-04-25T22:42:17.184 INFO:tasks.workunit.client.0.smithi057.stdout:5/839: chown d2/d6/db/l3f 15419372 1 2024-04-25T22:42:17.184 INFO:tasks.workunit.client.0.smithi057.stdout:7/691: link d6/d28/d4e/d30/d46/f99 d6/d28/d4e/d30/d60/da7/fe7 0 2024-04-25T22:42:17.184 INFO:tasks.workunit.client.0.smithi057.stdout:3/702: truncate d0/f62 4170189 0 2024-04-25T22:42:17.184 INFO:tasks.workunit.client.0.smithi057.stdout:1/748: write d7/dd/d16/d18/f2a [2848958,81286] 0 2024-04-25T22:42:17.185 INFO:tasks.workunit.client.0.smithi057.stdout:5/840: readlink d2/d47/d87/dd2/le9 0 2024-04-25T22:42:17.185 INFO:tasks.workunit.client.0.smithi057.stdout:3/703: unlink d0/d4/d7/dad/lcc 0 2024-04-25T22:42:17.185 INFO:tasks.workunit.client.0.smithi057.stdout:0/739: write d0/d3/d6/d14/d39/f56 [5040615,98278] 0 2024-04-25T22:42:17.185 INFO:tasks.workunit.client.0.smithi057.stdout:3/704: readlink d0/l6e 0 2024-04-25T22:42:17.185 INFO:tasks.workunit.client.0.smithi057.stdout:1/749: chown d7/d65/d6a/d98/dc5/de7/ccb 16057247 1 2024-04-25T22:42:17.185 INFO:tasks.workunit.client.0.smithi057.stdout:9/727: dwrite d3/d34/fd1 [0,4194304] 0 2024-04-25T22:42:17.185 INFO:tasks.workunit.client.0.smithi057.stdout:5/841: write d2/d1c/d46/f73 [5047843,128111] 0 2024-04-25T22:42:17.185 INFO:tasks.workunit.client.0.smithi057.stdout:6/819: dwrite d2/d86/f10a [0,4194304] 0 2024-04-25T22:42:17.185 INFO:tasks.workunit.client.0.smithi057.stdout:5/842: rmdir d2/d47/d94 39 2024-04-25T22:42:17.185 INFO:tasks.workunit.client.0.smithi057.stdout:0/740: creat d0/d3/d6/d14/d39/de8/f106 x:0 0 0 2024-04-25T22:42:17.185 INFO:tasks.workunit.client.0.smithi057.stdout:9/728: rmdir d3/d34/d42/d28/d39/db3 39 2024-04-25T22:42:17.185 INFO:tasks.workunit.client.0.smithi057.stdout:1/750: creat d7/dd/d16/d24/d63/ddc/ffb x:0 0 0 2024-04-25T22:42:17.185 INFO:tasks.workunit.client.0.smithi057.stdout:9/729: write d3/f64 [3252407,82320] 0 2024-04-25T22:42:17.185 INFO:tasks.workunit.client.0.smithi057.stdout:6/820: mknod d2/d19/d26/c10d 0 2024-04-25T22:42:17.186 INFO:tasks.workunit.client.0.smithi057.stdout:3/705: creat d0/d4/d7/d26/d72/dd0/de5/ff7 x:0 0 0 2024-04-25T22:42:17.186 INFO:tasks.workunit.client.0.smithi057.stdout:0/741: chown d0/d3/fdb 4 1 2024-04-25T22:42:17.186 INFO:tasks.workunit.client.0.smithi057.stdout:9/730: readlink d3/l36 0 2024-04-25T22:42:17.186 INFO:tasks.workunit.client.0.smithi057.stdout:7/692: fsync d6/d28/d4e/d30/d46/f99 0 2024-04-25T22:42:17.186 INFO:tasks.workunit.client.0.smithi057.stdout:6/821: creat d2/d19/d50/d1a/f10e x:0 0 0 2024-04-25T22:42:17.186 INFO:tasks.workunit.client.0.smithi057.stdout:0/742: chown d0/d3/d4d/l51 51 1 2024-04-25T22:42:17.187 INFO:tasks.workunit.client.0.smithi057.stdout:5/843: fdatasync d2/d1c/d24/d3d/d77/dcd/ddd/fea 0 2024-04-25T22:42:17.187 INFO:tasks.workunit.client.0.smithi057.stdout:6/822: mkdir d2/d19/d9b/df3/d31/d83/daa/d10f 0 2024-04-25T22:42:17.187 INFO:tasks.workunit.client.0.smithi057.stdout:5/844: chown d2/d1c/d46/f66 226395583 1 2024-04-25T22:42:17.187 INFO:tasks.workunit.client.0.smithi057.stdout:4/763: dread d14/d47/d5e/dea/def/f78 [0,4194304] 0 2024-04-25T22:42:17.187 INFO:tasks.workunit.client.0.smithi057.stdout:6/823: dread - d2/d19/d9b/df3/fc1 zero size 2024-04-25T22:42:17.187 INFO:tasks.workunit.client.0.smithi057.stdout:0/743: chown d0/d3/d4d/d87/da0/lc1 214488619 1 2024-04-25T22:42:17.187 INFO:tasks.workunit.client.0.smithi057.stdout:4/764: mkdir d14/da2/da7/df6 0 2024-04-25T22:42:17.188 INFO:tasks.workunit.client.0.smithi057.stdout:6/824: getdents d2/d59 0 2024-04-25T22:42:17.188 INFO:tasks.workunit.client.0.smithi057.stdout:4/765: stat d14/d2f/d4c/d5b/dd8/dbf/cc9 0 2024-04-25T22:42:17.189 INFO:tasks.workunit.client.0.smithi057.stdout:6/825: write d2/d19/d50/d1a/f93 [709501,48901] 0 2024-04-25T22:42:17.189 INFO:tasks.workunit.client.0.smithi057.stdout:4/766: mknod d14/da2/da7/df6/cf7 0 2024-04-25T22:42:17.190 INFO:tasks.workunit.client.0.smithi057.stdout:3/706: dread d0/d4/d7/d46/d30/d7a/d91/fb2 [0,4194304] 0 2024-04-25T22:42:17.191 INFO:tasks.workunit.client.0.smithi057.stdout:7/693: dwrite d6/d28/d4e/d30/d46/f99 [0,4194304] 0 2024-04-25T22:42:17.192 INFO:tasks.workunit.client.0.smithi057.stdout:6/826: symlink d2/d19/d49/d62/l110 0 2024-04-25T22:42:17.194 INFO:tasks.workunit.client.0.smithi057.stdout:5/845: dwrite d2/d1c/d46/d3a/d6a/fd9 [0,4194304] 0 2024-04-25T22:42:17.194 INFO:tasks.workunit.client.0.smithi057.stdout:6/827: rmdir d2/d19/d20/d9e 39 2024-04-25T22:42:17.195 INFO:tasks.workunit.client.0.smithi057.stdout:5/846: unlink d2/c3 0 2024-04-25T22:42:17.196 INFO:tasks.workunit.client.0.smithi057.stdout:8/705: dread d4/db/f34 [4194304,4194304] 0 2024-04-25T22:42:17.196 INFO:tasks.workunit.client.0.smithi057.stdout:0/744: dwrite d0/d3/f1c [0,4194304] 0 2024-04-25T22:42:17.197 INFO:tasks.workunit.client.0.smithi057.stdout:6/828: getdents d2/d19/d9b 0 2024-04-25T22:42:17.197 INFO:tasks.workunit.client.0.smithi057.stdout:8/706: dread - d4/db/d72/f95 zero size 2024-04-25T22:42:17.198 INFO:tasks.workunit.client.0.smithi057.stdout:8/707: fsync d4/db/d12/dc0/ff8 0 2024-04-25T22:42:17.198 INFO:tasks.workunit.client.0.smithi057.stdout:6/829: creat d2/d19/d26/f111 x:0 0 0 2024-04-25T22:42:17.200 INFO:tasks.workunit.client.0.smithi057.stdout:6/830: creat d2/d19/d9b/df3/f112 x:0 0 0 2024-04-25T22:42:17.200 INFO:tasks.workunit.client.0.smithi057.stdout:8/708: fsync d4/d5/d17/d19/d35/d83/d92/d5b/f5d 0 2024-04-25T22:42:17.200 INFO:tasks.workunit.client.0.smithi057.stdout:4/767: dwrite d14/da9/f75 [0,4194304] 0 2024-04-25T22:42:17.201 INFO:tasks.workunit.client.0.smithi057.stdout:7/694: dwrite d6/f3a [0,4194304] 0 2024-04-25T22:42:17.202 INFO:tasks.workunit.client.0.smithi057.stdout:8/709: mkdir d4/db/d12/dff 0 2024-04-25T22:42:17.202 INFO:tasks.workunit.client.0.smithi057.stdout:6/831: mkdir d2/d19/d49/d62/d79/dad/d113 0 2024-04-25T22:42:17.204 INFO:tasks.workunit.client.0.smithi057.stdout:8/710: readlink d4/d5/d17/ld6 0 2024-04-25T22:42:17.205 INFO:tasks.workunit.client.0.smithi057.stdout:8/711: fdatasync d4/d5/d17/d19/fa1 0 2024-04-25T22:42:17.205 INFO:tasks.workunit.client.0.smithi057.stdout:6/832: fsync d2/d19/d9b/df3/d31/f3a 0 2024-04-25T22:42:17.205 INFO:tasks.workunit.client.0.smithi057.stdout:7/695: mknod d6/d28/d4e/d30/d46/d73/de4/ce8 0 2024-04-25T22:42:17.205 INFO:tasks.workunit.client.0.smithi057.stdout:4/768: getdents d14/d2f/d4c/d5b/dc3 0 2024-04-25T22:42:17.207 INFO:tasks.workunit.client.0.smithi057.stdout:5/847: write d2/d6/db/f17 [412797,40934] 0 2024-04-25T22:42:17.207 INFO:tasks.workunit.client.0.smithi057.stdout:4/769: dread - d14/f4e zero size 2024-04-25T22:42:17.207 INFO:tasks.workunit.client.0.smithi057.stdout:0/745: dwrite d0/d49/d97/faa [0,4194304] 0 2024-04-25T22:42:17.207 INFO:tasks.workunit.client.0.smithi057.stdout:6/833: unlink d2/d19/d9b/df3/f112 0 2024-04-25T22:42:17.208 INFO:tasks.workunit.client.0.smithi057.stdout:4/770: write d14/d47/d62/f6a [4468157,56715] 0 2024-04-25T22:42:17.208 INFO:tasks.workunit.client.0.smithi057.stdout:6/834: mkdir d2/d19/d20/d114 0 2024-04-25T22:42:17.209 INFO:tasks.workunit.client.0.smithi057.stdout:5/848: chown d2/d1c/d24/d3d/d77/c8d 387025 1 2024-04-25T22:42:17.209 INFO:tasks.workunit.client.0.smithi057.stdout:6/835: symlink d2/d19/d9b/l115 0 2024-04-25T22:42:17.210 INFO:tasks.workunit.client.0.smithi057.stdout:6/836: chown d2/d19/d9b/df3/d31/d83/dba/dbe/dcf 4 1 2024-04-25T22:42:17.212 INFO:tasks.workunit.client.0.smithi057.stdout:1/751: dread d7/d65/d6a/d98/dc5/de7/d6b/fbb [0,4194304] 0 2024-04-25T22:42:17.213 INFO:tasks.workunit.client.0.smithi057.stdout:1/752: write d7/dd/d16/d24/f4f [3217340,74524] 0 2024-04-25T22:42:17.215 INFO:tasks.workunit.client.0.smithi057.stdout:1/753: truncate d7/d4e/f96 1067387 0 2024-04-25T22:42:17.215 INFO:tasks.workunit.client.0.smithi057.stdout:4/771: dwrite d14/f39 [0,4194304] 0 2024-04-25T22:42:17.215 INFO:tasks.workunit.client.0.smithi057.stdout:1/754: write d7/fb4 [4693401,123102] 0 2024-04-25T22:42:17.216 INFO:tasks.workunit.client.0.smithi057.stdout:7/696: write d6/f15 [1180963,116225] 0 2024-04-25T22:42:17.217 INFO:tasks.workunit.client.0.smithi057.stdout:1/755: write d7/dd/d90/fb5 [1923840,61099] 0 2024-04-25T22:42:17.217 INFO:tasks.workunit.client.0.smithi057.stdout:4/772: rename d14/l35 to d14/d5a/d67/lf8 0 2024-04-25T22:42:17.218 INFO:tasks.workunit.client.0.smithi057.stdout:7/697: dread - d6/d28/d4e/d30/d60/d8d/d96/d5d/f6a zero size 2024-04-25T22:42:17.219 INFO:tasks.workunit.client.0.smithi057.stdout:6/837: truncate d2/d19/d20/f6a 4061590 0 2024-04-25T22:42:17.219 INFO:tasks.workunit.client.0.smithi057.stdout:5/849: write d2/d1c/d46/d3a/da8/fb8 [368894,45778] 0 2024-04-25T22:42:17.220 INFO:tasks.workunit.client.0.smithi057.stdout:4/773: chown d14/d2f/l58 37 1 2024-04-25T22:42:17.221 INFO:tasks.workunit.client.0.smithi057.stdout:5/850: creat d2/d1c/d24/d3d/d77/f10b x:0 0 0 2024-04-25T22:42:17.221 INFO:tasks.workunit.client.0.smithi057.stdout:6/838: readlink d2/d19/l8d 0 2024-04-25T22:42:17.221 INFO:tasks.workunit.client.0.smithi057.stdout:4/774: fsync d14/d2f/f4a 0 2024-04-25T22:42:17.223 INFO:tasks.workunit.client.0.smithi057.stdout:6/839: rename d2/d19/d20/l88 to d2/d19/d9b/df3/l116 0 2024-04-25T22:42:17.223 INFO:tasks.workunit.client.0.smithi057.stdout:4/775: mknod d14/d47/d5e/dea/cf9 0 2024-04-25T22:42:17.223 INFO:tasks.workunit.client.0.smithi057.stdout:5/851: write d2/d47/d94/f9c [4063694,2001] 0 2024-04-25T22:42:17.224 INFO:tasks.workunit.client.0.smithi057.stdout:6/840: write d2/d19/d26/f111 [9350,47108] 0 2024-04-25T22:42:17.224 INFO:tasks.workunit.client.0.smithi057.stdout:5/852: read - d2/d1c/d46/d3a/d6a/ffc zero size 2024-04-25T22:42:17.225 INFO:tasks.workunit.client.0.smithi057.stdout:4/776: creat d14/d5a/d67/ffa x:0 0 0 2024-04-25T22:42:17.225 INFO:tasks.workunit.client.0.smithi057.stdout:7/698: dwrite d6/f21 [0,4194304] 0 2024-04-25T22:42:17.225 INFO:tasks.workunit.client.0.smithi057.stdout:4/777: stat d14/d47/d62/lde 0 2024-04-25T22:42:17.226 INFO:tasks.workunit.client.0.smithi057.stdout:6/841: unlink d2/d19/d26/d4f/d95/ld9 0 2024-04-25T22:42:17.226 INFO:tasks.workunit.client.0.smithi057.stdout:4/778: mkdir d14/da2/da7/dfb 0 2024-04-25T22:42:17.227 INFO:tasks.workunit.client.0.smithi057.stdout:4/779: mkdir d14/d47/dfc 0 2024-04-25T22:42:17.229 INFO:tasks.workunit.client.0.smithi057.stdout:6/842: read d2/f4 [3038989,55436] 0 2024-04-25T22:42:17.232 INFO:tasks.workunit.client.0.smithi057.stdout:7/699: dwrite d6/d28/f42 [0,4194304] 0 2024-04-25T22:42:17.232 INFO:tasks.workunit.client.0.smithi057.stdout:4/780: dread d14/f20 [0,4194304] 0 2024-04-25T22:42:17.233 INFO:tasks.workunit.client.0.smithi057.stdout:7/700: fdatasync d6/d88/fdb 0 2024-04-25T22:42:17.233 INFO:tasks.workunit.client.0.smithi057.stdout:4/781: fdatasync d14/d2f/d4c/fa8 0 2024-04-25T22:42:17.235 INFO:tasks.workunit.client.0.smithi057.stdout:4/782: getdents d14/d5a 0 2024-04-25T22:42:17.236 INFO:tasks.workunit.client.0.smithi057.stdout:6/843: dwrite d2/d19/d85/f9a [0,4194304] 0 2024-04-25T22:42:17.238 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:17.236+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:17.240 INFO:tasks.workunit.client.0.smithi057.stdout:6/844: getdents d2/d19/d49/d62/d79/dad 0 2024-04-25T22:42:17.240 INFO:tasks.workunit.client.0.smithi057.stdout:6/845: chown d2/d19/d26/d63/c76 241784757 1 2024-04-25T22:42:17.240 INFO:tasks.workunit.client.0.smithi057.stdout:6/846: stat d2/d19/d50/c75 0 2024-04-25T22:42:17.242 INFO:tasks.workunit.client.0.smithi057.stdout:6/847: mkdir d2/d86/d90/d106/dda/d10b/d117 0 2024-04-25T22:42:17.242 INFO:tasks.workunit.client.0.smithi057.stdout:4/783: dwrite d14/d5a/d67/f71 [0,4194304] 0 2024-04-25T22:42:17.242 INFO:tasks.workunit.client.0.smithi057.stdout:6/848: creat d2/d19/d50/f118 x:0 0 0 2024-04-25T22:42:17.243 INFO:tasks.workunit.client.0.smithi057.stdout:4/784: rename d14/d5a/d67/dcc/fd6 to d14/d3d/ffd 0 2024-04-25T22:42:17.243 INFO:tasks.workunit.client.0.smithi057.stdout:4/785: fdatasync d14/f25 0 2024-04-25T22:42:17.247 INFO:tasks.workunit.client.0.smithi057.stdout:2/857: sync 2024-04-25T22:42:17.248 INFO:tasks.workunit.client.0.smithi057.stdout:2/858: mknod d1f/d21/d33/d10d/c12b 0 2024-04-25T22:42:17.249 INFO:tasks.workunit.client.0.smithi057.stdout:2/859: truncate d1f/de7/d4d/f111 777058 0 2024-04-25T22:42:17.249 INFO:tasks.workunit.client.0.smithi057.stdout:8/712: dread d4/db/dd/fae [0,4194304] 0 2024-04-25T22:42:17.250 INFO:tasks.workunit.client.0.smithi057.stdout:8/713: creat d4/db/dd/d3a/f100 x:0 0 0 2024-04-25T22:42:17.251 INFO:tasks.workunit.client.0.smithi057.stdout:8/714: write d4/db/dd/d3a/d5c/f44 [1218958,28713] 0 2024-04-25T22:42:17.252 INFO:tasks.workunit.client.0.smithi057.stdout:1/756: write d7/d4e/f96 [932719,116402] 0 2024-04-25T22:42:17.253 INFO:tasks.workunit.client.0.smithi057.stdout:8/715: dread - d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/dc8/f90 zero size 2024-04-25T22:42:17.254 INFO:tasks.workunit.client.0.smithi057.stdout:1/757: write d7/d65/fbd [267766,68191] 0 2024-04-25T22:42:17.255 INFO:tasks.workunit.client.0.smithi057.stdout:8/716: chown d4/d5/d17/d19/d35/d83/d92 499 1 2024-04-25T22:42:17.256 INFO:tasks.workunit.client.0.smithi057.stdout:5/853: dwrite d2/d2c/db7/fe3 [0,4194304] 0 2024-04-25T22:42:17.256 INFO:tasks.workunit.client.0.smithi057.stdout:7/701: dwrite d6/d28/d4e/d30/d46/f49 [0,4194304] 0 2024-04-25T22:42:17.256 INFO:tasks.workunit.client.0.smithi057.stdout:5/854: fsync d2/d47/ded/ff1 0 2024-04-25T22:42:17.257 INFO:tasks.workunit.client.0.smithi057.stdout:4/786: truncate d14/da2/da7/fbe 1020503 0 2024-04-25T22:42:17.257 INFO:tasks.workunit.client.0.smithi057.stdout:8/717: symlink d4/db/dd/d3a/d94/dcf/df7/l101 0 2024-04-25T22:42:17.258 INFO:tasks.workunit.client.0.smithi057.stdout:7/702: chown d6/d28/d4e/d30/d60/c65 772 1 2024-04-25T22:42:17.258 INFO:tasks.workunit.client.0.smithi057.stdout:5/855: unlink d2/d1c/d24/d3d/lb3 0 2024-04-25T22:42:17.260 INFO:tasks.workunit.client.0.smithi057.stdout:4/787: rename d14/d47/d5e/dea to d14/d3d/dfe 0 2024-04-25T22:42:17.261 INFO:tasks.workunit.client.0.smithi057.stdout:5/856: truncate d2/d1c/d46/f89 766992 0 2024-04-25T22:42:17.262 INFO:tasks.workunit.client.0.smithi057.stdout:1/758: dwrite d7/dd/d16/d24/f2e [4194304,4194304] 0 2024-04-25T22:42:17.262 INFO:tasks.workunit.client.0.smithi057.stdout:4/788: rmdir d14/da2/da7/dfb 0 2024-04-25T22:42:17.263 INFO:tasks.workunit.client.0.smithi057.stdout:4/789: rmdir d14/d3d 39 2024-04-25T22:42:17.263 INFO:tasks.workunit.client.0.smithi057.stdout:5/857: write d2/d1c/d24/d3d/d50/fd7 [1382384,99793] 0 2024-04-25T22:42:17.265 INFO:tasks.workunit.client.0.smithi057.stdout:1/759: chown d7/dd/d16/d24/d61/l52 1978061 1 2024-04-25T22:42:17.265 INFO:tasks.workunit.client.0.smithi057.stdout:0/746: dread d0/d3/dae/ff0 [0,4194304] 0 2024-04-25T22:42:17.266 INFO:tasks.workunit.client.0.smithi057.stdout:4/790: rmdir d14/d2f/d4c/d5b/dc3 39 2024-04-25T22:42:17.266 INFO:tasks.workunit.client.0.smithi057.stdout:1/760: write d7/dd/d90/fee [770301,94485] 0 2024-04-25T22:42:17.266 INFO:tasks.workunit.client.0.smithi057.stdout:0/747: symlink d0/de5/l107 0 2024-04-25T22:42:17.266 INFO:tasks.workunit.client.0.smithi057.stdout:5/858: rename d2/d6/db/f17 to d2/d1c/d24/d3d/d50/d83/f10c 0 2024-04-25T22:42:17.267 INFO:tasks.workunit.client.0.smithi057.stdout:5/859: readlink d2/d47/d60/lcc 0 2024-04-25T22:42:17.268 INFO:tasks.workunit.client.0.smithi057.stdout:5/860: mkdir d2/d47/ded/d10d 0 2024-04-25T22:42:17.268 INFO:tasks.workunit.client.0.smithi057.stdout:1/761: link d7/d65/d6a/d98/dc5/de7/d45/dd8/ff7 d7/dd/d16/d88/ffc 0 2024-04-25T22:42:17.268 INFO:tasks.workunit.client.0.smithi057.stdout:5/861: write d2/d1c/d46/d3a/da8/f109 [592029,108181] 0 2024-04-25T22:42:17.269 INFO:tasks.workunit.client.0.smithi057.stdout:1/762: getdents d7/dd/d90 0 2024-04-25T22:42:17.269 INFO:tasks.workunit.client.0.smithi057.stdout:5/862: creat d2/d1c/d46/de4/f10e x:0 0 0 2024-04-25T22:42:17.270 INFO:tasks.workunit.client.0.smithi057.stdout:1/763: mknod d7/d65/d6a/d98/dc5/de7/d45/dd8/cfd 0 2024-04-25T22:42:17.270 INFO:tasks.workunit.client.0.smithi057.stdout:5/863: write d2/d47/f68 [1141528,105453] 0 2024-04-25T22:42:17.271 INFO:tasks.workunit.client.0.smithi057.stdout:1/764: mknod d7/d65/d95/cfe 0 2024-04-25T22:42:17.272 INFO:tasks.workunit.client.0.smithi057.stdout:1/765: rename d7/dd/d16/lf2 to d7/dd/d90/dbf/lff 0 2024-04-25T22:42:17.272 INFO:tasks.workunit.client.0.smithi057.stdout:5/864: link d2/d2c/db7/fe3 d2/d1c/d24/d3d/d77/dcd/f10f 0 2024-04-25T22:42:17.277 INFO:tasks.workunit.client.0.smithi057.stdout:1/766: dwrite d7/d4e/f9b [0,4194304] 0 2024-04-25T22:42:17.278 INFO:tasks.workunit.client.0.smithi057.stdout:5/865: dwrite d2/d1c/d24/f4c [0,4194304] 0 2024-04-25T22:42:17.278 INFO:tasks.workunit.client.0.smithi057.stdout:5/866: write d2/d47/d87/dd2/f67 [1692910,84162] 0 2024-04-25T22:42:17.279 INFO:tasks.workunit.client.0.smithi057.stdout:1/767: write d7/dd/d16/d88/ffc [122592,91983] 0 2024-04-25T22:42:17.282 INFO:tasks.workunit.client.0.smithi057.stdout:9/731: sync 2024-04-25T22:42:17.282 INFO:tasks.workunit.client.0.smithi057.stdout:3/707: sync 2024-04-25T22:42:17.282 INFO:tasks.workunit.client.0.smithi057.stdout:1/768: rename d7/dd/d16/d18/cde to d7/dd/d16/d24/d63/dc7/db0/c100 0 2024-04-25T22:42:17.282 INFO:tasks.workunit.client.0.smithi057.stdout:9/732: stat d3/d34/d42/d28/f72 0 2024-04-25T22:42:17.282 INFO:tasks.workunit.client.0.smithi057.stdout:3/708: chown d0/d4/d34/d3c/d53/db1/dce/fda 25 1 2024-04-25T22:42:17.283 INFO:tasks.workunit.client.0.smithi057.stdout:3/709: chown d0/d11/f12 19 1 2024-04-25T22:42:17.285 INFO:tasks.workunit.client.0.smithi057.stdout:9/733: getdents d3/d34/d42/d5e/d83 0 2024-04-25T22:42:17.287 INFO:tasks.workunit.client.0.smithi057.stdout:0/748: read d0/d5/d53/f69 [1964267,103129] 0 2024-04-25T22:42:17.288 INFO:tasks.workunit.client.0.smithi057.stdout:9/734: link d3/d34/d42/d28/d2d/d7a/c7b d3/d34/d42/d28/d62/ce8 0 2024-04-25T22:42:17.289 INFO:tasks.workunit.client.0.smithi057.stdout:3/710: dwrite d0/d4/f2d [4194304,4194304] 0 2024-04-25T22:42:17.293 INFO:tasks.workunit.client.0.smithi057.stdout:5/867: dwrite d2/d1c/d46/f89 [0,4194304] 0 2024-04-25T22:42:17.293 INFO:tasks.workunit.client.0.smithi057.stdout:0/749: dread d0/d5/d53/f67 [0,4194304] 0 2024-04-25T22:42:17.295 INFO:tasks.workunit.client.0.smithi057.stdout:0/750: write d0/d5/d53/fef [711026,115343] 0 2024-04-25T22:42:17.297 INFO:tasks.workunit.client.0.smithi057.stdout:0/751: readlink d0/d49/d6d/dea/lfd 0 2024-04-25T22:42:17.297 INFO:tasks.workunit.client.0.smithi057.stdout:3/711: dwrite d0/d5b/ff3 [0,4194304] 0 2024-04-25T22:42:17.297 INFO:tasks.workunit.client.0.smithi057.stdout:9/735: dwrite d3/d34/d42/d28/d62/d67/d6e/d7c/f97 [0,4194304] 0 2024-04-25T22:42:17.299 INFO:tasks.workunit.client.0.smithi057.stdout:9/736: creat d3/dd8/de3/fe9 x:0 0 0 2024-04-25T22:42:17.299 INFO:tasks.workunit.client.0.smithi057.stdout:3/712: link d0/d4/d7/d26/d89/d97/dc1/fe1 d0/d4/d34/d3c/d53/ff8 0 2024-04-25T22:42:17.300 INFO:tasks.workunit.client.0.smithi057.stdout:7/703: dread d6/d91/fab [0,4194304] 0 2024-04-25T22:42:17.300 INFO:tasks.workunit.client.0.smithi057.stdout:9/737: write d3/d34/d42/d28/d39/f46 [674931,86832] 0 2024-04-25T22:42:17.301 INFO:tasks.workunit.client.0.smithi057.stdout:9/738: fsync d3/d34/f73 0 2024-04-25T22:42:17.301 INFO:tasks.workunit.client.0.smithi057.stdout:2/860: dread d1f/d34/f3d [0,4194304] 0 2024-04-25T22:42:17.301 INFO:tasks.workunit.client.0.smithi057.stdout:7/704: dread - d6/d28/d4e/d30/d60/d6f/d9c/dc4/fcc zero size 2024-04-25T22:42:17.302 INFO:tasks.workunit.client.0.smithi057.stdout:2/861: write d1f/d34/f73 [576467,94920] 0 2024-04-25T22:42:17.302 INFO:tasks.workunit.client.0.smithi057.stdout:9/739: dread - d3/d34/d42/d28/d62/d67/f82 zero size 2024-04-25T22:42:17.304 INFO:tasks.workunit.client.0.smithi057.stdout:9/740: unlink d3/d34/d42/d28/d62/cc4 0 2024-04-25T22:42:17.304 INFO:tasks.workunit.client.0.smithi057.stdout:7/705: write d6/d28/d4e/d30/d60/d8d/d96/d59/fbd [16658,119712] 0 2024-04-25T22:42:17.305 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:17.305 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:17.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:17.305 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:14032 4.31 4:8f5d6475:::10000003388.00000000:head [write 0~4194304 [3@213172] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:17.305 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:17.297580+0000", 2024-04-25T22:42:17.305 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0087080790000000005, 2024-04-25T22:42:17.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087423859999999996, 2024-04-25T22:42:17.305 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:17.305 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:17.305 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:17.305 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:17.306 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:17.306 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:17.306 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 14032 2024-04-25T22:42:17.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:17.306 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:17.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:17.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:17.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:17.297580+0000", 2024-04-25T22:42:17.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:17.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:17.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:17.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:17.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:17.297580+0000", 2024-04-25T22:42:17.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:17.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:17.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:17.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:17.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:17.297581+0000", 2024-04-25T22:42:17.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8449999999999999e-06 2024-04-25T22:42:17.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:17.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:17.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:17.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:17.303024+0000", 2024-04-25T22:42:17.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054422209999999997 2024-04-25T22:42:17.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:17.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:17.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:17.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:17.303042+0000", 2024-04-25T22:42:17.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8737999999999999e-05 2024-04-25T22:42:17.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:17.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:17.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:17.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:17.303052+0000", 2024-04-25T22:42:17.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3880000000000006e-06 2024-04-25T22:42:17.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:17.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:17.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:17.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:17.303156+0000", 2024-04-25T22:42:17.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104085 2024-04-25T22:42:17.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:17.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:17.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:17.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:17.303435+0000", 2024-04-25T22:42:17.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027889499999999998 2024-04-25T22:42:17.308 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:17.309 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:17.309 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:17.309 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:17.309 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-25T22:42:17.309 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 1 2024-04-25T22:42:17.309 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:17.310 INFO:tasks.workunit.client.0.smithi057.stdout:7/706: creat d6/d28/d4e/d30/d60/d6f/d9c/dc4/dd6/fe9 x:0 0 0 2024-04-25T22:42:17.310 INFO:tasks.workunit.client.0.smithi057.stdout:3/713: dwrite d0/d4/d7/d46/d30/faa [0,4194304] 0 2024-04-25T22:42:17.310 INFO:tasks.workunit.client.0.smithi057.stdout:7/707: readlink d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/l67 0 2024-04-25T22:42:17.311 INFO:tasks.workunit.client.0.smithi057.stdout:3/714: read d0/d11/f12 [195036,92594] 0 2024-04-25T22:42:17.311 INFO:tasks.workunit.client.0.smithi057.stdout:7/708: chown d6/d28/d4e/d30/d60/d6f/c72 80 1 2024-04-25T22:42:17.311 INFO:tasks.workunit.client.0.smithi057.stdout:3/715: rmdir d0/d4/d7/d26/d89/d97/dc1/dd3 39 2024-04-25T22:42:17.311 INFO:tasks.workunit.client.0.smithi057.stdout:7/709: write d6/d28/d4e/d30/d60/d8d/d96/d59/fbd [247216,60335] 0 2024-04-25T22:42:17.311 INFO:tasks.workunit.client.0.smithi057.stdout:3/716: creat d0/d5b/ff9 x:0 0 0 2024-04-25T22:42:17.311 INFO:tasks.workunit.client.0.smithi057.stdout:7/710: symlink d6/d28/d4e/d30/d60/d6f/dbf/lea 0 2024-04-25T22:42:17.311 INFO:tasks.workunit.client.0.smithi057.stdout:2/862: truncate f0 2860455 0 2024-04-25T22:42:17.311 INFO:tasks.workunit.client.0.smithi057.stdout:3/717: creat d0/d5b/ffa x:0 0 0 2024-04-25T22:42:17.312 INFO:tasks.workunit.client.0.smithi057.stdout:2/863: write d1f/de7/f9b [7477687,99600] 0 2024-04-25T22:42:17.312 INFO:tasks.workunit.client.0.smithi057.stdout:3/718: symlink d0/d4/d7/d46/d30/d7a/d91/lfb 0 2024-04-25T22:42:17.312 INFO:tasks.workunit.client.0.smithi057.stdout:2/864: read - d1f/d21/d26/f70 zero size 2024-04-25T22:42:17.312 INFO:tasks.workunit.client.0.smithi057.stdout:2/865: write f1b [4313044,17394] 0 2024-04-25T22:42:17.313 INFO:tasks.workunit.client.0.smithi057.stdout:3/719: rmdir d0/d4/d7b 39 2024-04-25T22:42:17.313 INFO:tasks.workunit.client.0.smithi057.stdout:2/866: dread - d1f/de7/fb0 zero size 2024-04-25T22:42:17.313 INFO:tasks.workunit.client.0.smithi057.stdout:3/720: creat d0/d4/d34/d3c/ffc x:0 0 0 2024-04-25T22:42:17.317 INFO:tasks.workunit.client.0.smithi057.stdout:7/711: dwrite d6/d28/d4e/d30/d60/d8d/d96/d59/d84/fe1 [0,4194304] 0 2024-04-25T22:42:17.318 INFO:tasks.workunit.client.0.smithi057.stdout:7/712: rmdir d6/d28/d4e 39 2024-04-25T22:42:17.318 INFO:tasks.workunit.client.0.smithi057.stdout:4/791: dread d14/d47/d5e/f92 [0,4194304] 0 2024-04-25T22:42:17.319 INFO:tasks.workunit.client.0.smithi057.stdout:4/792: stat d14/da9/f75 0 2024-04-25T22:42:17.320 INFO:tasks.workunit.client.0.smithi057.stdout:7/713: chown d6/f4b 13 1 2024-04-25T22:42:17.320 INFO:tasks.workunit.client.0.smithi057.stdout:3/721: dread d0/d4/d4a/f4c [0,4194304] 0 2024-04-25T22:42:17.321 INFO:tasks.workunit.client.0.smithi057.stdout:4/793: write d14/d47/f7c [110337,47766] 0 2024-04-25T22:42:17.321 INFO:tasks.workunit.client.0.smithi057.stdout:7/714: symlink d6/d88/leb 0 2024-04-25T22:42:17.321 INFO:tasks.workunit.client.0.smithi057.stdout:2/867: dwrite d1f/d21/d26/f4e [4194304,4194304] 0 2024-04-25T22:42:17.322 INFO:tasks.workunit.client.0.smithi057.stdout:3/722: chown d0/d4/d7/d46/d30/d7a/d91 26984095 1 2024-04-25T22:42:17.322 INFO:tasks.workunit.client.0.smithi057.stdout:2/868: mknod d1f/d34/d50/df0/c12c 0 2024-04-25T22:42:17.324 INFO:tasks.workunit.client.0.smithi057.stdout:3/723: fdatasync d0/d4/d34/d3c/d70/feb 0 2024-04-25T22:42:17.324 INFO:tasks.workunit.client.0.smithi057.stdout:2/869: symlink d1f/de7/db1/l12d 0 2024-04-25T22:42:17.324 INFO:tasks.workunit.client.0.smithi057.stdout:3/724: fdatasync d0/f95 0 2024-04-25T22:42:17.324 INFO:tasks.workunit.client.0.smithi057.stdout:2/870: creat d1f/f12e x:0 0 0 2024-04-25T22:42:17.325 INFO:tasks.workunit.client.0.smithi057.stdout:8/718: dread d4/f5e [0,4194304] 0 2024-04-25T22:42:17.326 INFO:tasks.workunit.client.0.smithi057.stdout:2/871: write d1f/de7/f9b [4496167,115805] 0 2024-04-25T22:42:17.326 INFO:tasks.workunit.client.0.smithi057.stdout:3/725: write d0/d4/d7b/ff4 [977777,18282] 0 2024-04-25T22:42:17.326 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:17.327 INFO:tasks.workunit.client.0.smithi057.stdout:8/719: mknod d4/d5/dd2/c102 0 2024-04-25T22:42:17.327 INFO:tasks.workunit.client.0.smithi057.stdout:3/726: fdatasync d0/d11/f36 0 2024-04-25T22:42:17.327 INFO:tasks.workunit.client.0.smithi057.stdout:2/872: creat d1f/d21/d33/daa/f12f x:0 0 0 2024-04-25T22:42:17.328 INFO:tasks.workunit.client.0.smithi057.stdout:2/873: rename d1f/d21 to d1f/d21/d130 22 2024-04-25T22:42:17.328 INFO:tasks.workunit.client.0.smithi057.stdout:8/720: getdents d4/d5/d17 0 2024-04-25T22:42:17.329 INFO:tasks.workunit.client.0.smithi057.stdout:3/727: link d0/d4/d7/d46/d30/f5a d0/d4/d34/d3c/d70/ffd 0 2024-04-25T22:42:17.329 INFO:tasks.workunit.client.0.smithi057.stdout:2/874: dread d1f/d36/d54/fbf [0,4194304] 0 2024-04-25T22:42:17.331 INFO:tasks.workunit.client.0.smithi057.stdout:2/875: stat d1f/d36/d54/lcb 0 2024-04-25T22:42:17.331 INFO:tasks.workunit.client.0.smithi057.stdout:7/715: dwrite d6/d28/d4e/d30/d60/d8d/d96/d51/fe2 [0,4194304] 0 2024-04-25T22:42:17.331 INFO:tasks.workunit.client.0.smithi057.stdout:2/876: chown lc 210920 1 2024-04-25T22:42:17.332 INFO:tasks.workunit.client.0.smithi057.stdout:7/716: symlink d6/d88/lec 0 2024-04-25T22:42:17.333 INFO:tasks.workunit.client.0.smithi057.stdout:2/877: write d1f/de7/d4d/d88/dd9/dd6/fd8 [775194,42035] 0 2024-04-25T22:42:17.334 INFO:tasks.workunit.client.0.smithi057.stdout:2/878: readlink d1f/d21/l23 0 2024-04-25T22:42:17.335 INFO:tasks.workunit.client.0.smithi057.stdout:2/879: unlink d1f/d21/d96/f120 0 2024-04-25T22:42:17.336 INFO:tasks.workunit.client.0.smithi057.stdout:0/752: dread d0/d3/d4d/d87/d102/da3/dec/f99 [0,4194304] 0 2024-04-25T22:42:17.336 INFO:tasks.workunit.client.0.smithi057.stdout:8/721: dwrite d4/db/dd/d3a/d5c/d76/ffe [0,4194304] 0 2024-04-25T22:42:17.336 INFO:tasks.workunit.client.0.smithi057.stdout:7/717: truncate d6/d28/d4e/d30/d60/d8d/d96/d59/d84/fb4 729673 0 2024-04-25T22:42:17.337 INFO:tasks.workunit.client.0.smithi057.stdout:2/880: fsync d1f/d21/d26/f3a 0 2024-04-25T22:42:17.339 INFO:tasks.workunit.client.0.smithi057.stdout:0/753: symlink d0/d49/d6d/dea/dfb/l108 0 2024-04-25T22:42:17.339 INFO:tasks.workunit.client.0.smithi057.stdout:3/728: dwrite d0/d4/d7/d46/d30/d7a/d91/fbf [0,4194304] 0 2024-04-25T22:42:17.339 INFO:tasks.workunit.client.0.smithi057.stdout:8/722: write d4/d5/d17/d19/d35/d83/d92/d5b/fcd [161066,51049] 0 2024-04-25T22:42:17.339 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:17.335+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:17.341 INFO:tasks.workunit.client.0.smithi057.stdout:0/754: creat d0/d3/f109 x:0 0 0 2024-04-25T22:42:17.341 INFO:tasks.workunit.client.0.smithi057.stdout:8/723: mknod d4/deb/c103 0 2024-04-25T22:42:17.341 INFO:tasks.workunit.client.0.smithi057.stdout:2/881: chown d1f/de7/d4d/d88/dd9/dd6/fd8 0 1 2024-04-25T22:42:17.342 INFO:tasks.workunit.client.0.smithi057.stdout:0/755: read d0/d49/f48 [2137170,116033] 0 2024-04-25T22:42:17.343 INFO:tasks.workunit.client.0.smithi057.stdout:2/882: fsync d1f/d21/d26/fad 0 2024-04-25T22:42:17.343 INFO:tasks.workunit.client.0.smithi057.stdout:1/769: dread d7/d65/d6a/f6d [0,4194304] 0 2024-04-25T22:42:17.344 INFO:tasks.workunit.client.0.smithi057.stdout:1/770: creat d7/dd/f101 x:0 0 0 2024-04-25T22:42:17.344 INFO:tasks.workunit.client.0.smithi057.stdout:7/718: dwrite d6/fb [0,4194304] 0 2024-04-25T22:42:17.346 INFO:tasks.workunit.client.0.smithi057.stdout:0/756: getdents d0/d3/d4d/d87/d102/da3/dec/dc8 0 2024-04-25T22:42:17.347 INFO:tasks.workunit.client.0.smithi057.stdout:6/849: sync 2024-04-25T22:42:17.347 INFO:tasks.workunit.client.0.smithi057.stdout:1/771: creat d7/d65/d6a/d98/dc5/de7/d45/dd8/f102 x:0 0 0 2024-04-25T22:42:17.349 INFO:tasks.workunit.client.0.smithi057.stdout:8/724: dwrite d4/db/f42 [0,4194304] 0 2024-04-25T22:42:17.350 INFO:tasks.workunit.client.0.smithi057.stdout:0/757: symlink d0/d3/d3a/d3b/l10a 0 2024-04-25T22:42:17.351 INFO:tasks.workunit.client.0.smithi057.stdout:1/772: read d7/f42 [3164717,9994] 0 2024-04-25T22:42:17.351 INFO:tasks.workunit.client.0.smithi057.stdout:6/850: symlink d2/d19/d26/d63/l119 0 2024-04-25T22:42:17.351 INFO:tasks.workunit.client.0.smithi057.stdout:7/719: getdents d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d97 0 2024-04-25T22:42:17.351 INFO:tasks.workunit.client.0.smithi057.stdout:8/725: write d4/d5/d17/d19/f26 [168399,92283] 0 2024-04-25T22:42:17.352 INFO:tasks.workunit.client.0.smithi057.stdout:1/773: dread - d7/d65/d6a/fd1 zero size 2024-04-25T22:42:17.353 INFO:tasks.workunit.client.0.smithi057.stdout:2/883: dwrite d1f/d34/d50/df0/df3/f117 [0,4194304] 0 2024-04-25T22:42:17.353 INFO:tasks.workunit.client.0.smithi057.stdout:8/726: symlink d4/db/dd/d3a/d94/dcf/l104 0 2024-04-25T22:42:17.353 INFO:tasks.workunit.client.0.smithi057.stdout:7/720: creat d6/d28/d4e/d30/d46/d73/de4/fed x:0 0 0 2024-04-25T22:42:17.354 INFO:tasks.workunit.client.0.smithi057.stdout:1/774: stat d7/d65/d6a/d98/dc5/de7/d45 0 2024-04-25T22:42:17.354 INFO:tasks.workunit.client.0.smithi057.stdout:8/727: chown d4/fbf 25223 1 2024-04-25T22:42:17.354 INFO:tasks.workunit.client.0.smithi057.stdout:7/721: fsync d6/d28/d4e/d30/d60/d8d/fa9 0 2024-04-25T22:42:17.355 INFO:tasks.workunit.client.0.smithi057.stdout:8/728: write d4/db/d12/fdb [1742176,64440] 0 2024-04-25T22:42:17.355 INFO:tasks.workunit.client.0.smithi057.stdout:4/794: dread d14/da9/f55 [0,4194304] 0 2024-04-25T22:42:17.356 INFO:tasks.workunit.client.0.smithi057.stdout:8/729: readlink d4/d5/d21/ld3 0 2024-04-25T22:42:17.356 INFO:tasks.workunit.client.0.smithi057.stdout:1/775: link d7/dd/d16/d24/l19 d7/dd/d16/d24/d63/dc7/l103 0 2024-04-25T22:42:17.356 INFO:tasks.workunit.client.0.smithi057.stdout:7/722: getdents d6/d28/d4e/d30/d46/d73 0 2024-04-25T22:42:17.357 INFO:tasks.workunit.client.0.smithi057.stdout:4/795: truncate d14/d2f/f7b 1654766 0 2024-04-25T22:42:17.358 INFO:tasks.workunit.client.0.smithi057.stdout:7/723: link d6/d28/d4e/d30/cc5 d6/d88/cee 0 2024-04-25T22:42:17.358 INFO:tasks.workunit.client.0.smithi057.stdout:4/796: link d14/d3d/dfe/def/f46 d14/d2f/d4c/d5b/fff 0 2024-04-25T22:42:17.359 INFO:tasks.workunit.client.0.smithi057.stdout:7/724: dread - d6/d28/d4e/d30/d60/fbb zero size 2024-04-25T22:42:17.360 INFO:tasks.workunit.client.0.smithi057.stdout:4/797: creat d14/da9/f100 x:0 0 0 2024-04-25T22:42:17.360 INFO:tasks.workunit.client.0.smithi057.stdout:4/798: chown d14/da9/fd5 88 1 2024-04-25T22:42:17.361 INFO:tasks.workunit.client.0.smithi057.stdout:7/725: truncate d6/d28/d4e/d30/d60/d8d/d96/d51/dad/f8f 222222 0 2024-04-25T22:42:17.362 INFO:tasks.workunit.client.0.smithi057.stdout:4/799: link d14/d3d/dfe/def/f8b d14/d2f/d4c/f101 0 2024-04-25T22:42:17.362 INFO:tasks.workunit.client.0.smithi057.stdout:7/726: write d6/f14 [2059354,11025] 0 2024-04-25T22:42:17.363 INFO:tasks.workunit.client.0.smithi057.stdout:4/800: chown d14/d5a/d67/ffa 221502838 1 2024-04-25T22:42:17.363 INFO:tasks.workunit.client.0.smithi057.stdout:1/776: dwrite d7/dd/d16/f7e [0,4194304] 0 2024-04-25T22:42:17.363 INFO:tasks.workunit.client.0.smithi057.stdout:1/777: mkdir d7/dd/d16/d104 0 2024-04-25T22:42:17.364 INFO:tasks.workunit.client.0.smithi057.stdout:7/727: write d6/d28/d4e/d30/d60/d8d/d96/d51/dad/f8f [925682,64075] 0 2024-04-25T22:42:17.365 INFO:tasks.workunit.client.0.smithi057.stdout:8/730: truncate d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/fc5 7076547 0 2024-04-25T22:42:17.366 INFO:tasks.workunit.client.0.smithi057.stdout:7/728: getdents d6/d28/d4e/d30/d46 0 2024-04-25T22:42:17.366 INFO:tasks.workunit.client.0.smithi057.stdout:8/731: truncate d4/d5/d17/da7/fc6 657679 0 2024-04-25T22:42:17.368 INFO:tasks.workunit.client.0.smithi057.stdout:3/729: dread d0/f1b [4194304,4194304] 0 2024-04-25T22:42:17.368 INFO:tasks.workunit.client.0.smithi057.stdout:8/732: chown d4/db/dd/d3a/d94/lad 12 1 2024-04-25T22:42:17.369 INFO:tasks.workunit.client.0.smithi057.stdout:7/729: chown d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d 57011440 1 2024-04-25T22:42:17.369 INFO:tasks.workunit.client.0.smithi057.stdout:3/730: mkdir d0/d4/d34/d3c/d53/d7f/dfe 0 2024-04-25T22:42:17.370 INFO:tasks.workunit.client.0.smithi057.stdout:4/801: dwrite d14/d2f/d4c/d5b/db8/fc7 [0,4194304] 0 2024-04-25T22:42:17.371 INFO:tasks.workunit.client.0.smithi057.stdout:1/778: dwrite d7/dd/d16/fd6 [0,4194304] 0 2024-04-25T22:42:17.371 INFO:tasks.workunit.client.0.smithi057.stdout:8/733: symlink d4/d5/d17/d19/d35/d83/d92/d5b/d8c/de9/l105 0 2024-04-25T22:42:17.372 INFO:tasks.workunit.client.0.smithi057.stdout:1/779: creat d7/dd/d90/dbf/f105 x:0 0 0 2024-04-25T22:42:17.372 INFO:tasks.workunit.client.0.smithi057.stdout:8/734: stat d4/db/d72/dbd/cd8 0 2024-04-25T22:42:17.372 INFO:tasks.workunit.client.0.smithi057.stdout:1/780: write d7/d4e/f96 [857366,14374] 0 2024-04-25T22:42:17.373 INFO:tasks.workunit.client.0.smithi057.stdout:1/781: fdatasync d7/dd/d90/ff6 0 2024-04-25T22:42:17.373 INFO:tasks.workunit.client.0.smithi057.stdout:8/735: symlink d4/d5/d17/d19/dec/l106 0 2024-04-25T22:42:17.375 INFO:tasks.workunit.client.0.smithi057.stdout:7/730: dread d6/d28/d4e/d30/d60/d8d/d96/d51/fe2 [0,4194304] 0 2024-04-25T22:42:17.375 INFO:tasks.workunit.client.0.smithi057.stdout:1/782: creat d7/d65/d6a/d98/dc5/f106 x:0 0 0 2024-04-25T22:42:17.375 INFO:tasks.workunit.client.0.smithi057.stdout:7/731: chown f1 375245 1 2024-04-25T22:42:17.376 INFO:tasks.workunit.client.0.smithi057.stdout:1/783: truncate d7/fa4 271308 0 2024-04-25T22:42:17.377 INFO:tasks.workunit.client.0.smithi057.stdout:1/784: creat d7/dd/d90/dbf/f107 x:0 0 0 2024-04-25T22:42:17.377 INFO:tasks.workunit.client.0.smithi057.stdout:4/802: dwrite d14/d47/f7c [0,4194304] 0 2024-04-25T22:42:17.378 INFO:tasks.workunit.client.0.smithi057.stdout:4/803: write d14/da9/f75 [3750055,36775] 0 2024-04-25T22:42:17.379 INFO:tasks.workunit.client.0.smithi057.stdout:4/804: rmdir d14/d5a 39 2024-04-25T22:42:17.379 INFO:tasks.workunit.client.0.smithi057.stdout:1/785: rename d7/dd/d16/d18/d31/d8f/fcf to d7/d65/d6a/d98/dc5/de7/d75/dc4/f108 0 2024-04-25T22:42:17.380 INFO:tasks.workunit.client.0.smithi057.stdout:1/786: readlink d7/ld3 0 2024-04-25T22:42:17.381 INFO:tasks.workunit.client.0.smithi057.stdout:4/805: write d14/d2f/d4c/d5b/dd8/dbf/d85/fa1 [170133,111309] 0 2024-04-25T22:42:17.381 INFO:tasks.workunit.client.0.smithi057.stdout:1/787: chown d7/dd/l7c 339251238 1 2024-04-25T22:42:17.381 INFO:tasks.workunit.client.0.smithi057.stdout:4/806: rmdir d14 39 2024-04-25T22:42:17.382 INFO:tasks.workunit.client.0.smithi057.stdout:1/788: mknod d7/dd/d16/d18/d31/c109 0 2024-04-25T22:42:17.382 INFO:tasks.workunit.client.0.smithi057.stdout:1/789: readlink d7/dd/d16/d18/d31/le3 0 2024-04-25T22:42:17.382 INFO:tasks.workunit.client.0.smithi057.stdout:4/807: rename d14/d5a/d67/db4/fe7 to d14/d5a/f102 0 2024-04-25T22:42:17.383 INFO:tasks.workunit.client.0.smithi057.stdout:4/808: fsync d14/d5a/d67/f71 0 2024-04-25T22:42:17.383 INFO:tasks.workunit.client.0.smithi057.stdout:1/790: symlink d7/dd/d16/d24/d63/dc7/l10a 0 2024-04-25T22:42:17.383 INFO:tasks.workunit.client.0.smithi057.stdout:4/809: chown d14/l19 0 1 2024-04-25T22:42:17.383 INFO:tasks.workunit.client.0.smithi057.stdout:1/791: stat d7/fe9 0 2024-04-25T22:42:17.384 INFO:tasks.workunit.client.0.smithi057.stdout:1/792: truncate d7/d65/d6a/fad 210575 0 2024-04-25T22:42:17.384 INFO:tasks.workunit.client.0.smithi057.stdout:4/810: link d14/d3d/dfe/def/l45 d14/d2f/d82/deb/l103 0 2024-04-25T22:42:17.384 INFO:tasks.workunit.client.0.smithi057.stdout:1/793: chown d7/dd/d26/c43 961989356 1 2024-04-25T22:42:17.385 INFO:tasks.workunit.client.0.smithi057.stdout:4/811: mknod d14/d5a/d67/dcc/c104 0 2024-04-25T22:42:17.385 INFO:tasks.workunit.client.0.smithi057.stdout:2/884: dread d1f/d21/ff9 [0,4194304] 0 2024-04-25T22:42:17.385 INFO:tasks.workunit.client.0.smithi057.stdout:1/794: getdents d7/d65/d95 0 2024-04-25T22:42:17.386 INFO:tasks.workunit.client.0.smithi057.stdout:4/812: stat d14/d2f/d82/l9c 0 2024-04-25T22:42:17.386 INFO:tasks.workunit.client.0.smithi057.stdout:2/885: fsync d1f/d21/d26/f3a 0 2024-04-25T22:42:17.386 INFO:tasks.workunit.client.0.smithi057.stdout:4/813: dread - d14/d3d/ffd zero size 2024-04-25T22:42:17.387 INFO:tasks.workunit.client.0.smithi057.stdout:2/886: rmdir d1f/d21/d105 39 2024-04-25T22:42:17.387 INFO:tasks.workunit.client.0.smithi057.stdout:8/736: truncate d4/db/dd/d3a/f66 2124405 0 2024-04-25T22:42:17.387 INFO:tasks.workunit.client.0.smithi057.stdout:8/737: readlink d4/d5/d17/ld6 0 2024-04-25T22:42:17.388 INFO:tasks.workunit.client.0.smithi057.stdout:5/868: sync 2024-04-25T22:42:17.388 INFO:tasks.workunit.client.0.smithi057.stdout:9/741: sync 2024-04-25T22:42:17.388 INFO:tasks.workunit.client.0.smithi057.stdout:2/887: dread - d1f/d21/d26/d63/d7f/d86/fdf zero size 2024-04-25T22:42:17.388 INFO:tasks.workunit.client.0.smithi057.stdout:8/738: chown d4/db/dd/d3a/d71 185 1 2024-04-25T22:42:17.389 INFO:tasks.workunit.client.0.smithi057.stdout:4/814: rename d14/d2f/d4c/d5b/db8/cf3 to d14/d3d/c105 0 2024-04-25T22:42:17.390 INFO:tasks.workunit.client.0.smithi057.stdout:2/888: readlink d1f/d36/d54/lcb 0 2024-04-25T22:42:17.390 INFO:tasks.workunit.client.0.smithi057.stdout:5/869: mknod d2/d1c/d24/d3d/d77/c110 0 2024-04-25T22:42:17.390 INFO:tasks.workunit.client.0.smithi057.stdout:9/742: symlink d3/d34/d42/d5e/da3/lea 0 2024-04-25T22:42:17.390 INFO:tasks.workunit.client.0.smithi057.stdout:8/739: chown d4/d5/dd2/fda 10462 1 2024-04-25T22:42:17.391 INFO:tasks.workunit.client.0.smithi057.stdout:4/815: write d14/f22 [3090523,97690] 0 2024-04-25T22:42:17.391 INFO:tasks.workunit.client.0.smithi057.stdout:8/740: dread - d4/d5/d21/fb3 zero size 2024-04-25T22:42:17.391 INFO:tasks.workunit.client.0.smithi057.stdout:5/870: readlink d2/d1c/d46/le2 0 2024-04-25T22:42:17.392 INFO:tasks.workunit.client.0.smithi057.stdout:9/743: symlink d3/d34/d42/d28/d39/d54/da5/leb 0 2024-04-25T22:42:17.392 INFO:tasks.workunit.client.0.smithi057.stdout:8/741: readlink d4/db/dd/lf1 0 2024-04-25T22:42:17.393 INFO:tasks.workunit.client.0.smithi057.stdout:5/871: write d2/d47/d60/fa6 [3491549,61408] 0 2024-04-25T22:42:17.394 INFO:tasks.workunit.client.0.smithi057.stdout:1/795: dwrite d7/dd/d16/d24/d63/ddc/ffb [0,4194304] 0 2024-04-25T22:42:17.394 INFO:tasks.workunit.client.0.smithi057.stdout:8/742: creat d4/d5/d17/da7/f107 x:0 0 0 2024-04-25T22:42:17.395 INFO:tasks.workunit.client.0.smithi057.stdout:9/744: write d3/d34/d42/d28/f37 [1114187,1164] 0 2024-04-25T22:42:17.395 INFO:tasks.workunit.client.0.smithi057.stdout:3/731: dread d0/d4/fd [0,4194304] 0 2024-04-25T22:42:17.395 INFO:tasks.workunit.client.0.smithi057.stdout:5/872: creat d2/d2c/db7/f111 x:0 0 0 2024-04-25T22:42:17.396 INFO:tasks.workunit.client.0.smithi057.stdout:1/796: chown d7/dd/d16/d18/d31 15895299 1 2024-04-25T22:42:17.397 INFO:tasks.workunit.client.0.smithi057.stdout:5/873: chown d2/d6/f58 31 1 2024-04-25T22:42:17.397 INFO:tasks.workunit.client.0.smithi057.stdout:8/743: mknod d4/db/dd/d3a/d5c/d76/c108 0 2024-04-25T22:42:17.397 INFO:tasks.workunit.client.0.smithi057.stdout:1/797: readlink d7/dd/d90/dbf/lc1 0 2024-04-25T22:42:17.397 INFO:tasks.workunit.client.0.smithi057.stdout:5/874: dread - d2/d1c/d24/f86 zero size 2024-04-25T22:42:17.397 INFO:tasks.workunit.client.0.smithi057.stdout:8/744: creat d4/d5/d17/f109 x:0 0 0 2024-04-25T22:42:17.398 INFO:tasks.workunit.client.0.smithi057.stdout:5/875: mkdir d2/d47/da5/dd3/d112 0 2024-04-25T22:42:17.398 INFO:tasks.workunit.client.0.smithi057.stdout:1/798: write d7/d65/d6a/d98/dc5/de7/d75/fb8 [1942888,16106] 0 2024-04-25T22:42:17.399 INFO:tasks.workunit.client.0.smithi057.stdout:2/889: dwrite f1b [0,4194304] 0 2024-04-25T22:42:17.401 INFO:tasks.workunit.client.0.smithi057.stdout:1/799: rename d7/d65/d6a/d98/dc5/de7 to d7/d65/d95/d10b 0 2024-04-25T22:42:17.402 INFO:tasks.workunit.client.0.smithi057.stdout:1/800: creat d7/dd/d90/dbf/f10c x:0 0 0 2024-04-25T22:42:17.402 INFO:tasks.workunit.client.0.smithi057.stdout:2/890: dread d1f/de7/d4d/d88/f101 [0,4194304] 0 2024-04-25T22:42:17.403 INFO:tasks.workunit.client.0.smithi057.stdout:1/801: chown d7/dd/d16/d18/d31/d8f/c91 4145562 1 2024-04-25T22:42:17.403 INFO:tasks.workunit.client.0.smithi057.stdout:5/876: dread d2/d6/db/fb4 [0,4194304] 0 2024-04-25T22:42:17.404 INFO:tasks.workunit.client.0.smithi057.stdout:5/877: write d2/f31 [3745468,95507] 0 2024-04-25T22:42:17.406 INFO:tasks.workunit.client.0.smithi057.stdout:8/745: symlink d4/d5/d17/d19/d35/l10a 0 2024-04-25T22:42:17.410 INFO:tasks.workunit.client.0.smithi057.stdout:1/802: read d7/d65/fbd [249979,82430] 0 2024-04-25T22:42:17.410 INFO:tasks.workunit.client.0.smithi057.stdout:0/758: dread d0/d3/d3a/f4f [0,4194304] 0 2024-04-25T22:42:17.412 INFO:tasks.workunit.client.0.smithi057.stdout:5/878: dwrite d2/d47/f68 [0,4194304] 0 2024-04-25T22:42:17.413 INFO:tasks.workunit.client.0.smithi057.stdout:8/746: dwrite d4/d5/d21/f4c [0,4194304] 0 2024-04-25T22:42:17.414 INFO:tasks.workunit.client.0.smithi057.stdout:8/747: chown d4/d5/d2f/dc3/lc4 974225 1 2024-04-25T22:42:17.414 INFO:tasks.workunit.client.0.smithi057.stdout:6/851: dread d2/d19/d49/fa4 [0,4194304] 0 2024-04-25T22:42:17.415 INFO:tasks.workunit.client.0.smithi057.stdout:8/748: rename d4/db/d12/dff to d4/dba/d10b 0 2024-04-25T22:42:17.416 INFO:tasks.workunit.client.0.smithi057.stdout:8/749: mkdir d4/dba/d10b/d10c 0 2024-04-25T22:42:17.417 INFO:tasks.workunit.client.0.smithi057.stdout:8/750: symlink d4/d5/d17/d19/dec/l10d 0 2024-04-25T22:42:17.418 INFO:tasks.workunit.client.0.smithi057.stdout:8/751: write d4/d5/d17/d19/fca [1402593,94052] 0 2024-04-25T22:42:17.419 INFO:tasks.workunit.client.0.smithi057.stdout:3/732: dread d0/d4/d7b/f9f [0,4194304] 0 2024-04-25T22:42:17.421 INFO:tasks.workunit.client.0.smithi057.stdout:3/733: write d0/d4/d7/d22/f59 [522898,74521] 0 2024-04-25T22:42:17.422 INFO:tasks.workunit.client.0.smithi057.stdout:3/734: truncate d0/d4/d34/d3c/d53/d7f/fba 270468 0 2024-04-25T22:42:17.424 INFO:tasks.workunit.client.0.smithi057.stdout:3/735: symlink d0/d4/d34/d3c/d53/d7f/dfe/lff 0 2024-04-25T22:42:17.424 INFO:tasks.workunit.client.0.smithi057.stdout:7/732: dread d6/f48 [0,4194304] 0 2024-04-25T22:42:17.424 INFO:tasks.workunit.client.0.smithi057.stdout:7/733: chown d6/d28/d4e/d30/d60/d8d/d96/d59/f61 0 1 2024-04-25T22:42:17.425 INFO:tasks.workunit.client.0.smithi057.stdout:0/759: truncate d0/d3/d6/f45 545647 0 2024-04-25T22:42:17.429 INFO:tasks.workunit.client.0.smithi057.stdout:0/760: write d0/d3/fd4 [1357539,23979] 0 2024-04-25T22:42:17.430 INFO:tasks.workunit.client.0.smithi057.stdout:9/745: dread d3/d34/fac [0,4194304] 0 2024-04-25T22:42:17.435 INFO:tasks.workunit.client.0.smithi057.stdout:0/761: dwrite d0/d3/fd4 [0,4194304] 0 2024-04-25T22:42:17.437 INFO:tasks.workunit.client.0.smithi057.stdout:0/762: readlink d0/d3/d6/d14/l64 0 2024-04-25T22:42:17.438 INFO:tasks.workunit.client.0.smithi057.stdout:9/746: dwrite d3/d34/d42/d28/f9a [0,4194304] 0 2024-04-25T22:42:17.439 INFO:tasks.workunit.client.0.smithi057.stdout:0/763: symlink d0/d3/d6/d83/l10b 0 2024-04-25T22:42:17.439 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:17.436+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:17.440 INFO:tasks.workunit.client.0.smithi057.stdout:9/747: symlink d3/d34/d42/d28/d65/lec 0 2024-04-25T22:42:17.440 INFO:tasks.workunit.client.0.smithi057.stdout:0/764: write d0/f8c [591279,76411] 0 2024-04-25T22:42:17.441 INFO:tasks.workunit.client.0.smithi057.stdout:9/748: mknod d3/d34/d42/d5e/d83/ced 0 2024-04-25T22:42:17.441 INFO:tasks.workunit.client.0.smithi057.stdout:9/749: truncate d3/f32 570746 0 2024-04-25T22:42:17.446 INFO:tasks.workunit.client.0.smithi057.stdout:0/765: dread d0/d49/d6d/fce [0,4194304] 0 2024-04-25T22:42:17.446 INFO:tasks.workunit.client.0.smithi057.stdout:6/852: dread d2/d19/d9b/df3/f29 [0,4194304] 0 2024-04-25T22:42:17.447 INFO:tasks.workunit.client.0.smithi057.stdout:0/766: truncate d0/d3/d6/fe3 118994 0 2024-04-25T22:42:17.447 INFO:tasks.workunit.client.0.smithi057.stdout:6/853: creat d2/d19/d20/d61/dbf/de2/f11a x:0 0 0 2024-04-25T22:42:17.447 INFO:tasks.workunit.client.0.smithi057.stdout:0/767: creat d0/d49/d97/f10c x:0 0 0 2024-04-25T22:42:17.448 INFO:tasks.workunit.client.0.smithi057.stdout:3/736: dread d0/d4/d34/d3c/d70/ffd [0,4194304] 0 2024-04-25T22:42:17.448 INFO:tasks.workunit.client.0.smithi057.stdout:0/768: fdatasync d0/d3/d4d/d87/d91/f94 0 2024-04-25T22:42:17.449 INFO:tasks.workunit.client.0.smithi057.stdout:6/854: getdents d2/d86/d90/d106/dda 0 2024-04-25T22:42:17.449 INFO:tasks.workunit.client.0.smithi057.stdout:6/855: symlink d2/d59/l11b 0 2024-04-25T22:42:17.449 INFO:tasks.workunit.client.0.smithi057.stdout:3/737: symlink d0/d4/d4a/dab/l100 0 2024-04-25T22:42:17.450 INFO:tasks.workunit.client.0.smithi057.stdout:3/738: write d0/d4/d7/d26/f63 [3744497,108887] 0 2024-04-25T22:42:17.450 INFO:tasks.workunit.client.0.smithi057.stdout:6/856: mkdir d2/d19/d9b/df3/d31/d83/dba/d11c 0 2024-04-25T22:42:17.451 INFO:tasks.workunit.client.0.smithi057.stdout:6/857: dread - d2/d86/d90/d106/fe1 zero size 2024-04-25T22:42:17.452 INFO:tasks.workunit.client.0.smithi057.stdout:6/858: chown d2/f4 0 1 2024-04-25T22:42:17.455 INFO:tasks.workunit.client.0.smithi057.stdout:4/816: sync 2024-04-25T22:42:17.455 INFO:tasks.workunit.client.0.smithi057.stdout:1/803: sync 2024-04-25T22:42:17.456 INFO:tasks.workunit.client.0.smithi057.stdout:0/769: dwrite d0/f66 [4194304,4194304] 0 2024-04-25T22:42:17.456 INFO:tasks.workunit.client.0.smithi057.stdout:7/734: dread d6/d28/d4e/d30/f36 [0,4194304] 0 2024-04-25T22:42:17.456 INFO:tasks.workunit.client.0.smithi057.stdout:4/817: write d14/d5a/d67/fcf [5139121,14784] 0 2024-04-25T22:42:17.457 INFO:tasks.workunit.client.0.smithi057.stdout:8/752: dread d4/d5/d17/d19/f54 [0,4194304] 0 2024-04-25T22:42:17.458 INFO:tasks.workunit.client.0.smithi057.stdout:0/770: mkdir d0/d3/d6/d71/d10d 0 2024-04-25T22:42:17.458 INFO:tasks.workunit.client.0.smithi057.stdout:4/818: chown d14/da9/f7d 1785329 1 2024-04-25T22:42:17.458 INFO:tasks.workunit.client.0.smithi057.stdout:8/753: mknod d4/d5/c10e 0 2024-04-25T22:42:17.459 INFO:tasks.workunit.client.0.smithi057.stdout:0/771: symlink d0/d3/d3a/l10e 0 2024-04-25T22:42:17.460 INFO:tasks.workunit.client.0.smithi057.stdout:8/754: unlink d4/db/dd/d3a/d5c/d76/ffe 0 2024-04-25T22:42:17.460 INFO:tasks.workunit.client.0.smithi057.stdout:6/859: dwrite d2/d19/d9b/df3/d31/fc9 [0,4194304] 0 2024-04-25T22:42:17.461 INFO:tasks.workunit.client.0.smithi057.stdout:8/755: write d4/db/dd/d3a/fa4 [999311,93086] 0 2024-04-25T22:42:17.462 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:42:17.463 INFO:tasks.workunit.client.0.smithi057.stdout:4/819: rename d14/da2/da7/df6 to d14/d5a/d67/db4/d106 0 2024-04-25T22:42:17.463 INFO:tasks.workunit.client.0.smithi057.stdout:6/860: chown d2/d19/cc7 7575 1 2024-04-25T22:42:17.465 INFO:tasks.workunit.client.0.smithi057.stdout:8/756: creat d4/db/f10f x:0 0 0 2024-04-25T22:42:17.465 INFO:tasks.workunit.client.0.smithi057.stdout:4/820: truncate d14/d5a/fe9 1035288 0 2024-04-25T22:42:17.465 INFO:tasks.workunit.client.0.smithi057.stdout:8/757: readlink d4/dba/le5 0 2024-04-25T22:42:17.465 INFO:tasks.workunit.client.0.smithi057.stdout:6/861: mkdir d2/d19/d9b/df3/d31/d11d 0 2024-04-25T22:42:17.466 INFO:tasks.workunit.client.0.smithi057.stdout:4/821: mknod d14/d2f/d4c/d5b/daa/c107 0 2024-04-25T22:42:17.466 INFO:tasks.workunit.client.0.smithi057.stdout:8/758: unlink d4/db/dd/d3a/d71/laa 0 2024-04-25T22:42:17.466 INFO:tasks.workunit.client.0.smithi057.stdout:6/862: fdatasync d2/f2b 0 2024-04-25T22:42:17.466 INFO:tasks.workunit.client.0.smithi057.stdout:4/822: read - d14/d5a/d67/dcc/ff2 zero size 2024-04-25T22:42:17.467 INFO:tasks.workunit.client.0.smithi057.stdout:4/823: readlink d14/l15 0 2024-04-25T22:42:17.468 INFO:tasks.workunit.client.0.smithi057.stdout:1/804: dread d7/dd/d16/d24/d63/dc7/db0/fb6 [0,4194304] 0 2024-04-25T22:42:17.468 INFO:tasks.workunit.client.0.smithi057.stdout:6/863: creat d2/d19/d49/d62/d79/dad/f11e x:0 0 0 2024-04-25T22:42:17.468 INFO:tasks.workunit.client.0.smithi057.stdout:9/750: dread d3/d34/d42/d28/d65/f8e [4194304,4194304] 0 2024-04-25T22:42:17.469 INFO:tasks.workunit.client.0.smithi057.stdout:4/824: chown d14/d3d/dfe/def/fb9 0 1 2024-04-25T22:42:17.469 INFO:tasks.workunit.client.0.smithi057.stdout:6/864: readlink d2/d19/d49/d62/d79/lea 0 2024-04-25T22:42:17.470 INFO:tasks.workunit.client.0.smithi057.stdout:6/865: write d2/d19/d50/ff [236097,113402] 0 2024-04-25T22:42:17.471 INFO:tasks.workunit.client.0.smithi057.stdout:4/825: creat d14/d3d/dfe/def/f108 x:0 0 0 2024-04-25T22:42:17.471 INFO:tasks.workunit.client.0.smithi057.stdout:4/826: fsync d14/d47/f51 0 2024-04-25T22:42:17.472 INFO:tasks.workunit.client.0.smithi057.stdout:7/735: dwrite d6/d28/f2c [4194304,4194304] 0 2024-04-25T22:42:17.474 INFO:tasks.workunit.client.0.smithi057.stdout:6/866: mkdir d2/d86/d90/d106/dda/d10b/d117/d11f 0 2024-04-25T22:42:17.474 INFO:tasks.workunit.client.0.smithi057.stdout:7/736: write d6/d28/d4e/d30/d46/f99 [4882149,82176] 0 2024-04-25T22:42:17.476 INFO:tasks.workunit.client.0.smithi057.stdout:1/805: dwrite d7/d65/fe5 [0,4194304] 0 2024-04-25T22:42:17.477 INFO:tasks.workunit.client.0.smithi057.stdout:9/751: dwrite d3/d34/d42/d28/d2d/f6c [0,4194304] 0 2024-04-25T22:42:17.477 INFO:tasks.workunit.client.0.smithi057.stdout:7/737: mkdir d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/dd7/dd4/def 0 2024-04-25T22:42:17.478 INFO:tasks.workunit.client.0.smithi057.stdout:9/752: creat d3/d34/d42/d28/d2d/d9c/fee x:0 0 0 2024-04-25T22:42:17.480 INFO:tasks.workunit.client.0.smithi057.stdout:9/753: fsync d3/d34/d42/d28/d65/f8e 0 2024-04-25T22:42:17.481 INFO:tasks.workunit.client.0.smithi057.stdout:9/754: mkdir d3/d34/d42/d5e/d83/def 0 2024-04-25T22:42:17.482 INFO:tasks.workunit.client.0.smithi057.stdout:9/755: chown d3/d34/d42/d28/d39/db3/fdc 0 1 2024-04-25T22:42:17.482 INFO:tasks.workunit.client.0.smithi057.stdout:9/756: creat d3/dd8/de3/ff0 x:0 0 0 2024-04-25T22:42:17.484 INFO:tasks.workunit.client.0.smithi057.stdout:9/757: write d3/d34/d42/d28/d62/d67/f94 [434112,47026] 0 2024-04-25T22:42:17.484 INFO:tasks.workunit.client.0.smithi057.stdout:2/891: sync 2024-04-25T22:42:17.484 INFO:tasks.workunit.client.0.smithi057.stdout:5/879: sync 2024-04-25T22:42:17.484 INFO:tasks.workunit.client.0.smithi057.stdout:8/759: dread d4/db/dd/d3a/f8e [0,4194304] 0 2024-04-25T22:42:17.485 INFO:tasks.workunit.client.0.smithi057.stdout:2/892: write d1f/de7/f3b [7774606,18355] 0 2024-04-25T22:42:17.485 INFO:tasks.workunit.client.0.smithi057.stdout:9/758: mkdir d3/d34/d42/d5e/d83/df1 0 2024-04-25T22:42:17.485 INFO:tasks.workunit.client.0.smithi057.stdout:8/760: rmdir d4/d5/d17/d19/d35 39 2024-04-25T22:42:17.486 INFO:tasks.workunit.client.0.smithi057.stdout:2/893: unlink d1f/d21/f2e 0 2024-04-25T22:42:17.486 INFO:tasks.workunit.client.0.smithi057.stdout:2/894: fdatasync f1b 0 2024-04-25T22:42:17.486 INFO:tasks.workunit.client.0.smithi057.stdout:5/880: rename d2/d47/da5/l108 to d2/d91/l113 0 2024-04-25T22:42:17.487 INFO:tasks.workunit.client.0.smithi057.stdout:9/759: write d3/d34/d42/d28/d39/d54/fbe [673620,107178] 0 2024-04-25T22:42:17.487 INFO:tasks.workunit.client.0.smithi057.stdout:2/895: unlink d1f/d34/f77 0 2024-04-25T22:42:17.489 INFO:tasks.workunit.client.0.smithi057.stdout:9/760: getdents d3/d98/db0 0 2024-04-25T22:42:17.490 INFO:tasks.workunit.client.0.smithi057.stdout:9/761: creat d3/d34/d42/ff2 x:0 0 0 2024-04-25T22:42:17.490 INFO:tasks.workunit.client.0.smithi057.stdout:3/739: dread d0/d4/d34/d3c/f5c [0,4194304] 0 2024-04-25T22:42:17.491 INFO:tasks.workunit.client.0.smithi057.stdout:9/762: write d3/f58 [909036,60737] 0 2024-04-25T22:42:17.491 INFO:tasks.workunit.client.0.smithi057.stdout:3/740: chown d0/d4/d7b/d8f 84655860 1 2024-04-25T22:42:17.493 INFO:tasks.workunit.client.0.smithi057.stdout:3/741: unlink d0/d4/d7/l74 0 2024-04-25T22:42:17.495 INFO:tasks.workunit.client.0.smithi057.stdout:2/896: dwrite d1f/d36/d54/dc0/f102 [0,4194304] 0 2024-04-25T22:42:17.496 INFO:tasks.workunit.client.0.smithi057.stdout:0/772: dread d0/d3/d4d/d87/ff2 [0,4194304] 0 2024-04-25T22:42:17.498 INFO:tasks.workunit.client.0.smithi057.stdout:2/897: link d1f/d21/d33/f7c d1f/d34/d50/f131 0 2024-04-25T22:42:17.499 INFO:tasks.workunit.client.0.smithi057.stdout:3/742: dread d0/d4/d7/d46/d30/d99/fbc [0,4194304] 0 2024-04-25T22:42:17.500 INFO:tasks.workunit.client.0.smithi057.stdout:9/763: dwrite d3/d34/d42/d28/d39/f3a [0,4194304] 0 2024-04-25T22:42:17.502 INFO:tasks.workunit.client.0.smithi057.stdout:3/743: write d0/d4/d7b/f9f [2762709,70899] 0 2024-04-25T22:42:17.502 INFO:tasks.workunit.client.0.smithi057.stdout:9/764: mkdir d3/d34/d42/d28/d62/dcf/df3 0 2024-04-25T22:42:17.503 INFO:tasks.workunit.client.0.smithi057.stdout:3/744: fsync d0/d4/d34/d3c/f8c 0 2024-04-25T22:42:17.503 INFO:tasks.workunit.client.0.smithi057.stdout:3/745: chown d0/d5b 6 1 2024-04-25T22:42:17.505 INFO:tasks.workunit.client.0.smithi057.stdout:4/827: dread d14/d2f/d4c/d5b/f93 [0,4194304] 0 2024-04-25T22:42:17.506 INFO:tasks.workunit.client.0.smithi057.stdout:9/765: rename d3/d34/d42/d28/d2d/d9c/f9f to d3/d34/d42/d28/d39/d54/ff4 0 2024-04-25T22:42:17.506 INFO:tasks.workunit.client.0.smithi057.stdout:4/828: write d14/d5a/fbb [5414994,68911] 0 2024-04-25T22:42:17.507 INFO:tasks.workunit.client.0.smithi057.stdout:4/829: truncate d14/d3d/dfe/def/f108 840198 0 2024-04-25T22:42:17.508 INFO:tasks.workunit.client.0.smithi057.stdout:4/830: unlink d14/d3d/c105 0 2024-04-25T22:42:17.510 INFO:tasks.workunit.client.0.smithi057.stdout:8/761: dread d4/db/dd/d3a/fa4 [0,4194304] 0 2024-04-25T22:42:17.510 INFO:tasks.workunit.client.0.smithi057.stdout:9/766: read d3/d34/d42/d28/d2d/d7a/f87 [124408,69847] 0 2024-04-25T22:42:17.510 INFO:tasks.workunit.client.0.smithi057.stdout:7/738: dread d6/d28/d4e/d30/d60/d8d/fc1 [0,4194304] 0 2024-04-25T22:42:17.511 INFO:tasks.workunit.client.0.smithi057.stdout:8/762: dread - d4/db/dd/d3a/d5c/d76/fbe zero size 2024-04-25T22:42:17.511 INFO:tasks.workunit.client.0.smithi057.stdout:5/881: dread d2/d6/f92 [0,4194304] 0 2024-04-25T22:42:17.512 INFO:tasks.workunit.client.0.smithi057.stdout:9/767: fsync d3/d34/d42/d28/f85 0 2024-04-25T22:42:17.513 INFO:tasks.workunit.client.0.smithi057.stdout:5/882: rename d2/d1c/d24/d3d/d77/c110 to d2/d2c/c114 0 2024-04-25T22:42:17.513 INFO:tasks.workunit.client.0.smithi057.stdout:8/763: creat d4/d5/d17/d19/d35/d83/d92/d5b/d8c/f110 x:0 0 0 2024-04-25T22:42:17.514 INFO:tasks.workunit.client.0.smithi057.stdout:8/764: rmdir d4/db/dd 39 2024-04-25T22:42:17.514 INFO:tasks.workunit.client.0.smithi057.stdout:5/883: creat d2/d1c/d46/d3a/da8/f115 x:0 0 0 2024-04-25T22:42:17.515 INFO:tasks.workunit.client.0.smithi057.stdout:3/746: dwrite d0/f62 [0,4194304] 0 2024-04-25T22:42:17.515 INFO:tasks.workunit.client.0.smithi057.stdout:8/765: mkdir d4/dba/d111 0 2024-04-25T22:42:17.516 INFO:tasks.workunit.client.0.smithi057.stdout:5/884: unlink d2/d1c/d24/d3d/d77/c103 0 2024-04-25T22:42:17.516 INFO:tasks.workunit.client.0.smithi057.stdout:3/747: chown d0/d4/d7/d22/c83 6 1 2024-04-25T22:42:17.517 INFO:tasks.workunit.client.0.smithi057.stdout:5/885: chown d2/d1c/d46/de4/f10e 7105 1 2024-04-25T22:42:17.517 INFO:tasks.workunit.client.0.smithi057.stdout:3/748: stat d0/d4/d34/d3c/c85 0 2024-04-25T22:42:17.517 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:17.517 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:17.518 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:42:17.518 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:42:17.518 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:17.518 INFO:tasks.workunit.client.0.smithi057.stdout:8/766: creat d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/f112 x:0 0 0 2024-04-25T22:42:17.518 INFO:tasks.workunit.client.0.smithi057.stdout:3/749: dread - d0/d4/d7/d26/d89/fef zero size 2024-04-25T22:42:17.518 INFO:tasks.workunit.client.0.smithi057.stdout:8/767: read d4/d5/d17/d19/f54 [3761032,105044] 0 2024-04-25T22:42:17.519 INFO:tasks.workunit.client.0.smithi057.stdout:3/750: write d0/d4/d7/d26/f56 [453509,2508] 0 2024-04-25T22:42:17.519 INFO:tasks.workunit.client.0.smithi057.stdout:8/768: truncate d4/deb/ffc 433320 0 2024-04-25T22:42:17.519 INFO:tasks.workunit.client.0.smithi057.stdout:3/751: readlink d0/d4/d7/dad/lc7 0 2024-04-25T22:42:17.520 INFO:tasks.workunit.client.0.smithi057.stdout:8/769: mknod d4/d5/d17/d19/d35/d83/d92/da6/c113 0 2024-04-25T22:42:17.521 INFO:tasks.workunit.client.0.smithi057.stdout:3/752: getdents d0/d4/d7 0 2024-04-25T22:42:17.521 INFO:tasks.workunit.client.0.smithi057.stdout:8/770: truncate d4/db/d72/f7d 8986264 0 2024-04-25T22:42:17.521 INFO:tasks.workunit.client.0.smithi057.stdout:8/771: creat d4/dba/f114 x:0 0 0 2024-04-25T22:42:17.522 INFO:tasks.workunit.client.0.smithi057.stdout:4/831: truncate d14/f1c 2059940 0 2024-04-25T22:42:17.522 INFO:tasks.workunit.client.0.smithi057.stdout:3/753: mknod d0/d4/d7/dad/c101 0 2024-04-25T22:42:17.522 INFO:tasks.workunit.client.0.smithi057.stdout:4/832: write d14/f30 [2471602,31737] 0 2024-04-25T22:42:17.523 INFO:tasks.workunit.client.0.smithi057.stdout:3/754: readlink d0/d4/d7/d26/d89/ld2 0 2024-04-25T22:42:17.523 INFO:tasks.workunit.client.0.smithi057.stdout:4/833: chown d14/d5a/d67/c97 426266776 1 2024-04-25T22:42:17.523 INFO:tasks.workunit.client.0.smithi057.stdout:4/834: fsync d14/f4e 0 2024-04-25T22:42:17.524 INFO:tasks.workunit.client.0.smithi057.stdout:3/755: link d0/f1b d0/d4/d7b/d8f/f102 0 2024-04-25T22:42:17.524 INFO:tasks.workunit.client.0.smithi057.stdout:4/835: mkdir d14/d5a/d67/d109 0 2024-04-25T22:42:17.524 INFO:tasks.workunit.client.0.smithi057.stdout:4/836: dread - d14/d5a/fa6 zero size 2024-04-25T22:42:17.530 INFO:tasks.workunit.client.0.smithi057.stdout:7/739: truncate d6/d28/d4e/d30/f56 2706420 0 2024-04-25T22:42:17.532 INFO:tasks.workunit.client.0.smithi057.stdout:5/886: write d2/d47/d60/f6d [517804,84040] 0 2024-04-25T22:42:17.533 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:17.534 INFO:tasks.workunit.client.0.smithi057.stdout:1/806: dread d7/dd/d16/d24/f4f [8388608,4194304] 0 2024-04-25T22:42:17.534 INFO:tasks.workunit.client.0.smithi057.stdout:7/740: link d6/d28/d4e/d30/d46/d73/cd0 d6/d28/d4e/d30/cf0 0 2024-04-25T22:42:17.534 INFO:tasks.workunit.client.0.smithi057.stdout:5/887: unlink d2/c19 0 2024-04-25T22:42:17.535 INFO:tasks.workunit.client.0.smithi057.stdout:7/741: chown d6/d28/d4e/d30/l3f 8187735 1 2024-04-25T22:42:17.536 INFO:tasks.workunit.client.0.smithi057.stdout:5/888: write d2/d1c/d46/d3a/f65 [143384,40184] 0 2024-04-25T22:42:17.536 INFO:tasks.workunit.client.0.smithi057.stdout:4/837: write d14/d2f/d4c/d5b/fff [3576362,100948] 0 2024-04-25T22:42:17.536 INFO:tasks.workunit.client.0.smithi057.stdout:8/772: dwrite d4/db/f34 [0,4194304] 0 2024-04-25T22:42:17.537 INFO:tasks.workunit.client.0.smithi057.stdout:7/742: read d6/f15 [3037722,85191] 0 2024-04-25T22:42:17.537 INFO:tasks.workunit.client.0.smithi057.stdout:3/756: dwrite d0/d4/f90 [0,4194304] 0 2024-04-25T22:42:17.538 INFO:tasks.workunit.client.0.smithi057.stdout:7/743: rmdir d6/d91 39 2024-04-25T22:42:17.538 INFO:tasks.workunit.client.0.smithi057.stdout:5/889: truncate d2/d6/db/fbb 748072 0 2024-04-25T22:42:17.539 INFO:tasks.workunit.client.0.smithi057.stdout:4/838: link d14/d3d/dfe/def/f108 d14/d2f/d82/f10a 0 2024-04-25T22:42:17.539 INFO:tasks.workunit.client.0.smithi057.stdout:8/773: rename d4/d5/dd2/c102 to d4/d5/d2f/dc3/c115 0 2024-04-25T22:42:17.539 INFO:tasks.workunit.client.0.smithi057.stdout:7/744: read d6/fb [2051735,17376] 0 2024-04-25T22:42:17.539 INFO:tasks.workunit.client.0.smithi057.stdout:3/757: fsync d0/d4/d7/d22/f92 0 2024-04-25T22:42:17.540 INFO:tasks.workunit.client.0.smithi057.stdout:4/839: write d14/d2f/d4c/d5b/f8f [1331605,56132] 0 2024-04-25T22:42:17.540 INFO:tasks.workunit.client.0.smithi057.stdout:5/890: truncate d2/d6/fe1 127340 0 2024-04-25T22:42:17.540 INFO:tasks.workunit.client.0.smithi057.stdout:7/745: truncate d6/f19 5360187 0 2024-04-25T22:42:17.541 INFO:tasks.workunit.client.0.smithi057.stdout:8/774: creat d4/d5/d21/f116 x:0 0 0 2024-04-25T22:42:17.541 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:17.535+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:17.541 INFO:tasks.workunit.client.0.smithi057.stdout:7/746: write d6/d28/f2c [4907824,79206] 0 2024-04-25T22:42:17.542 INFO:tasks.workunit.client.0.smithi057.stdout:3/758: unlink d0/d4/d7/d22/da0/fb7 0 2024-04-25T22:42:17.542 INFO:tasks.workunit.client.0.smithi057.stdout:4/840: symlink d14/d2f/l10b 0 2024-04-25T22:42:17.542 INFO:tasks.workunit.client.0.smithi057.stdout:3/759: chown d0/d4/d7/d26/d89/d97/dc1 30 1 2024-04-25T22:42:17.542 INFO:tasks.workunit.client.0.smithi057.stdout:5/891: mknod d2/d1c/d24/d3d/deb/df6/c116 0 2024-04-25T22:42:17.543 INFO:tasks.workunit.client.0.smithi057.stdout:7/747: write d6/f15 [103605,94666] 0 2024-04-25T22:42:17.543 INFO:tasks.workunit.client.0.smithi057.stdout:8/775: symlink d4/d5/d17/d19/d35/d83/d92/d5b/l117 0 2024-04-25T22:42:17.544 INFO:tasks.workunit.client.0.smithi057.stdout:4/841: fsync d14/d3d/dfe/def/f108 0 2024-04-25T22:42:17.544 INFO:tasks.workunit.client.0.smithi057.stdout:5/892: write d2/d1c/d46/d3a/da8/f109 [934633,54057] 0 2024-04-25T22:42:17.545 INFO:tasks.workunit.client.0.smithi057.stdout:4/842: readlink d14/d47/d5e/d5f/l79 0 2024-04-25T22:42:17.545 INFO:tasks.workunit.client.0.smithi057.stdout:8/776: creat d4/d5/d17/d19/dec/f118 x:0 0 0 2024-04-25T22:42:17.545 INFO:tasks.workunit.client.0.smithi057.stdout:9/768: dread d3/d34/d42/d28/d2d/f40 [0,4194304] 0 2024-04-25T22:42:17.546 INFO:tasks.workunit.client.0.smithi057.stdout:8/777: write d4/d5/f7 [5154362,64935] 0 2024-04-25T22:42:17.546 INFO:tasks.workunit.client.0.smithi057.stdout:4/843: creat d14/d2f/f10c x:0 0 0 2024-04-25T22:42:17.546 INFO:tasks.workunit.client.0.smithi057.stdout:7/748: getdents d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d 0 2024-04-25T22:42:17.547 INFO:tasks.workunit.client.0.smithi057.stdout:3/760: write d0/f95 [262166,11167] 0 2024-04-25T22:42:17.547 INFO:tasks.workunit.client.0.smithi057.stdout:7/749: stat d6/d28/l2b 0 2024-04-25T22:42:17.547 INFO:tasks.workunit.client.0.smithi057.stdout:4/844: creat d14/d47/d5e/d5f/f10d x:0 0 0 2024-04-25T22:42:17.548 INFO:tasks.workunit.client.0.smithi057.stdout:7/750: write d6/fcf [301455,73300] 0 2024-04-25T22:42:17.548 INFO:tasks.workunit.client.0.smithi057.stdout:8/778: fsync d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/dc8/f9b 0 2024-04-25T22:42:17.548 INFO:tasks.workunit.client.0.smithi057.stdout:3/761: write d0/d4/d7/d26/f63 [1636270,88763] 0 2024-04-25T22:42:17.550 INFO:tasks.workunit.client.0.smithi057.stdout:8/779: creat d4/dba/d111/f119 x:0 0 0 2024-04-25T22:42:17.551 INFO:tasks.workunit.client.0.smithi057.stdout:4/845: write d14/d2f/d4c/f101 [761920,58609] 0 2024-04-25T22:42:17.551 INFO:tasks.workunit.client.0.smithi057.stdout:7/751: rename d6/d28/d4e/d30/d46/d73/de4/ce8 to d6/d28/d4e/d30/d46/d73/dcb/cf1 0 2024-04-25T22:42:17.552 INFO:tasks.workunit.client.0.smithi057.stdout:8/780: link d4/d5/f4d d4/d5/d21/f11a 0 2024-04-25T22:42:17.554 INFO:tasks.workunit.client.0.smithi057.stdout:9/769: dwrite d3/d34/d42/d28/d62/d67/d6e/d7c/fcd [0,4194304] 0 2024-04-25T22:42:17.556 INFO:tasks.workunit.client.0.smithi057.stdout:6/867: sync 2024-04-25T22:42:17.556 INFO:tasks.workunit.client.0.smithi057.stdout:1/807: sync 2024-04-25T22:42:17.556 INFO:tasks.workunit.client.0.smithi057.stdout:3/762: dwrite d0/d5b/ff9 [0,4194304] 0 2024-04-25T22:42:17.556 INFO:tasks.workunit.client.0.smithi057.stdout:9/770: symlink d3/d34/d42/d28/dc1/dda/lf5 0 2024-04-25T22:42:17.557 INFO:tasks.workunit.client.0.smithi057.stdout:6/868: readlink d2/d19/d9b/df3/d31/l6c 0 2024-04-25T22:42:17.557 INFO:tasks.workunit.client.0.smithi057.stdout:8/781: truncate d4/db/fc 3775729 0 2024-04-25T22:42:17.558 INFO:tasks.workunit.client.0.smithi057.stdout:3/763: read d0/d4/d7/fb5 [9097,107469] 0 2024-04-25T22:42:17.558 INFO:tasks.workunit.client.0.smithi057.stdout:1/808: symlink d7/d65/d95/d10b/d75/dc4/df8/l10d 0 2024-04-25T22:42:17.560 INFO:tasks.workunit.client.0.smithi057.stdout:6/869: write d2/d19/d26/d4f/d95/fb6 [1506878,115536] 0 2024-04-25T22:42:17.560 INFO:tasks.workunit.client.0.smithi057.stdout:1/809: symlink d7/ddd/l10e 0 2024-04-25T22:42:17.561 INFO:tasks.workunit.client.0.smithi057.stdout:4/846: dwrite d14/d2f/d4c/d5b/db8/fe1 [0,4194304] 0 2024-04-25T22:42:17.561 INFO:tasks.workunit.client.0.smithi057.stdout:8/782: mkdir d4/db/d12/dc0/d11b 0 2024-04-25T22:42:17.562 INFO:tasks.workunit.client.0.smithi057.stdout:1/810: stat d7/dd/d16/d24/d63 0 2024-04-25T22:42:17.562 INFO:tasks.workunit.client.0.smithi057.stdout:6/870: truncate d2/d19/fcc 873082 0 2024-04-25T22:42:17.562 INFO:tasks.workunit.client.0.smithi057.stdout:8/783: symlink d4/d5/d17/d19/l11c 0 2024-04-25T22:42:17.563 INFO:tasks.workunit.client.0.smithi057.stdout:6/871: dread - d2/d19/d9b/df3/fc1 zero size 2024-04-25T22:42:17.563 INFO:tasks.workunit.client.0.smithi057.stdout:6/872: chown d2/d19/d50/d1a/f42 2000199 1 2024-04-25T22:42:17.563 INFO:tasks.workunit.client.0.smithi057.stdout:8/784: fsync d4/d5/d17/d19/d35/d83/d92/d5b/fcd 0 2024-04-25T22:42:17.564 INFO:tasks.workunit.client.0.smithi057.stdout:6/873: chown d2/d19/d49/f54 5 1 2024-04-25T22:42:17.568 INFO:tasks.workunit.client.0.smithi057.stdout:8/785: dread - d4/d5/d17/da7/f107 zero size 2024-04-25T22:42:17.570 INFO:tasks.workunit.client.0.smithi057.stdout:6/874: dread d2/d19/d9b/df3/d31/fc9 [0,4194304] 0 2024-04-25T22:42:17.570 INFO:tasks.workunit.client.0.smithi057.stdout:1/811: dwrite d7/d65/d95/d10b/d6b/fae [0,4194304] 0 2024-04-25T22:42:17.570 INFO:tasks.workunit.client.0.smithi057.stdout:3/764: dwrite d0/d4/d7/d22/fd9 [0,4194304] 0 2024-04-25T22:42:17.570 INFO:tasks.workunit.client.0.smithi057.stdout:1/812: fsync d7/dd/d16/d88/ffc 0 2024-04-25T22:42:17.571 INFO:tasks.workunit.client.0.smithi057.stdout:5/893: dread d2/d1c/d46/f27 [0,4194304] 0 2024-04-25T22:42:17.571 INFO:tasks.workunit.client.0.smithi057.stdout:2/898: sync 2024-04-25T22:42:17.572 INFO:tasks.workunit.client.0.smithi057.stdout:0/773: sync 2024-04-25T22:42:17.572 INFO:tasks.workunit.client.0.smithi057.stdout:6/875: write d2/d19/d9b/df3/f29 [4264964,59763] 0 2024-04-25T22:42:17.572 INFO:tasks.workunit.client.0.smithi057.stdout:2/899: chown d1f/d21/l23 0 1 2024-04-25T22:42:17.574 INFO:tasks.workunit.client.0.smithi057.stdout:0/774: creat d0/d3/dae/f10f x:0 0 0 2024-04-25T22:42:17.574 INFO:tasks.workunit.client.0.smithi057.stdout:6/876: symlink d2/d19/d50/l120 0 2024-04-25T22:42:17.574 INFO:tasks.workunit.client.0.smithi057.stdout:1/813: rename d7/d65/d95/d10b/d6b/cb2 to d7/dd/d16/c10f 0 2024-04-25T22:42:17.575 INFO:tasks.workunit.client.0.smithi057.stdout:5/894: creat d2/d1c/d24/d3d/deb/df6/f117 x:0 0 0 2024-04-25T22:42:17.575 INFO:tasks.workunit.client.0.smithi057.stdout:0/775: symlink d0/d3/dae/l110 0 2024-04-25T22:42:17.576 INFO:tasks.workunit.client.0.smithi057.stdout:6/877: creat d2/d19/d20/d61/dbf/f121 x:0 0 0 2024-04-25T22:42:17.576 INFO:tasks.workunit.client.0.smithi057.stdout:0/776: stat d0/l7b 0 2024-04-25T22:42:17.578 INFO:tasks.workunit.client.0.smithi057.stdout:5/895: dread - d2/d2c/db7/f111 zero size 2024-04-25T22:42:17.578 INFO:tasks.workunit.client.0.smithi057.stdout:1/814: creat d7/d65/f110 x:0 0 0 2024-04-25T22:42:17.579 INFO:tasks.workunit.client.0.smithi057.stdout:5/896: stat d2/d47/ded 0 2024-04-25T22:42:17.580 INFO:tasks.workunit.client.0.smithi057.stdout:6/878: chown d2/d19/d26/d4f/c71 104952814 1 2024-04-25T22:42:17.582 INFO:tasks.workunit.client.0.smithi057.stdout:1/815: link d7/dd/d16/d18/d31/fe8 d7/d65/d95/f111 0 2024-04-25T22:42:17.582 INFO:tasks.workunit.client.0.smithi057.stdout:3/765: dwrite d0/d4/d34/fd5 [0,4194304] 0 2024-04-25T22:42:17.583 INFO:tasks.workunit.client.0.smithi057.stdout:6/879: mkdir d2/d122 0 2024-04-25T22:42:17.583 INFO:tasks.workunit.client.0.smithi057.stdout:2/900: dwrite d1f/d34/d50/f53 [0,4194304] 0 2024-04-25T22:42:17.583 INFO:tasks.workunit.client.0.smithi057.stdout:5/897: write d2/d1c/d24/d3d/d50/d83/fe5 [544579,47278] 0 2024-04-25T22:42:17.585 INFO:tasks.workunit.client.0.smithi057.stdout:1/816: link d7/dd/d16/d24/f3a d7/dd/f112 0 2024-04-25T22:42:17.585 INFO:tasks.workunit.client.0.smithi057.stdout:3/766: readlink d0/d4/d7/d46/d30/l68 0 2024-04-25T22:42:17.585 INFO:tasks.workunit.client.0.smithi057.stdout:5/898: fdatasync d2/fe 0 2024-04-25T22:42:17.585 INFO:tasks.workunit.client.0.smithi057.stdout:6/880: creat d2/d19/d9b/df3/d31/d83/f123 x:0 0 0 2024-04-25T22:42:17.588 INFO:tasks.workunit.client.0.smithi057.stdout:6/881: unlink d2/d19/d50/d1a/db0/c100 0 2024-04-25T22:42:17.590 INFO:tasks.workunit.client.0.smithi057.stdout:1/817: rename d7/dd/d16/d18/f34 to d7/d65/d95/d10b/f113 0 2024-04-25T22:42:17.591 INFO:tasks.workunit.client.0.smithi057.stdout:7/752: dread d6/d28/f5b [0,4194304] 0 2024-04-25T22:42:17.591 INFO:tasks.workunit.client.0.smithi057.stdout:6/882: write d2/d59/ff7 [640666,49973] 0 2024-04-25T22:42:17.592 INFO:tasks.workunit.client.0.smithi057.stdout:0/777: dwrite d0/f9 [0,4194304] 0 2024-04-25T22:42:17.592 INFO:tasks.workunit.client.0.smithi057.stdout:1/818: creat d7/dd/d26/f114 x:0 0 0 2024-04-25T22:42:17.593 INFO:tasks.workunit.client.0.smithi057.stdout:0/778: chown d0/d3/d4d/d87 46 1 2024-04-25T22:42:17.593 INFO:tasks.workunit.client.0.smithi057.stdout:2/901: dwrite d1f/de7/d4d/d88/fbc [0,4194304] 0 2024-04-25T22:42:17.593 INFO:tasks.workunit.client.0.smithi057.stdout:7/753: fsync d6/d28/d4e/d30/d60/d8d/d96/d51/fa8 0 2024-04-25T22:42:17.594 INFO:tasks.workunit.client.0.smithi057.stdout:0/779: rmdir d0/d3/d3a/d3b 39 2024-04-25T22:42:17.595 INFO:tasks.workunit.client.0.smithi057.stdout:0/780: stat d0/d49/f9f 0 2024-04-25T22:42:17.595 INFO:tasks.workunit.client.0.smithi057.stdout:3/767: dwrite d0/d4/d7/d46/d30/f65 [0,4194304] 0 2024-04-25T22:42:17.596 INFO:tasks.workunit.client.0.smithi057.stdout:7/754: mknod d6/d28/d4e/d30/d60/d6f/dbf/cf2 0 2024-04-25T22:42:17.597 INFO:tasks.workunit.client.0.smithi057.stdout:0/781: readlink d0/d3/d6/d14/dd1/la2 0 2024-04-25T22:42:17.597 INFO:tasks.workunit.client.0.smithi057.stdout:3/768: chown d0/d4/d7/d46/d30/d7a 14691 1 2024-04-25T22:42:17.598 INFO:tasks.workunit.client.0.smithi057.stdout:0/782: symlink d0/d3/d6/d14/l111 0 2024-04-25T22:42:17.598 INFO:tasks.workunit.client.0.smithi057.stdout:3/769: mknod d0/d4/d34/d3c/c103 0 2024-04-25T22:42:17.600 INFO:tasks.workunit.client.0.smithi057.stdout:0/783: mknod d0/d3/d6/d14/c112 0 2024-04-25T22:42:17.600 INFO:tasks.workunit.client.0.smithi057.stdout:6/883: dwrite d2/d86/fca [0,4194304] 0 2024-04-25T22:42:17.602 INFO:tasks.workunit.client.0.smithi057.stdout:0/784: rmdir d0/d3 39 2024-04-25T22:42:17.604 INFO:tasks.workunit.client.0.smithi057.stdout:2/902: dwrite d1f/d34/f3d [0,4194304] 0 2024-04-25T22:42:17.604 INFO:tasks.workunit.client.0.smithi057.stdout:7/755: rename d6/d28/d4e/d30/l7e to d6/d28/d4e/d30/d60/d8d/d96/lf3 0 2024-04-25T22:42:17.604 INFO:tasks.workunit.client.0.smithi057.stdout:7/756: mkdir d6/d28/d4e/d30/d60/d6f/df4 0 2024-04-25T22:42:17.606 INFO:tasks.workunit.client.0.smithi057.stdout:2/903: truncate d1f/d34/d50/f131 240338 0 2024-04-25T22:42:17.606 INFO:tasks.workunit.client.0.smithi057.stdout:4/847: sync 2024-04-25T22:42:17.606 INFO:tasks.workunit.client.0.smithi057.stdout:5/899: sync 2024-04-25T22:42:17.607 INFO:tasks.workunit.client.0.smithi057.stdout:4/848: truncate d14/d2f/f10c 896284 0 2024-04-25T22:42:17.607 INFO:tasks.workunit.client.0.smithi057.stdout:7/757: creat d6/d28/d4e/d30/d46/d73/dcb/ff5 x:0 0 0 2024-04-25T22:42:17.608 INFO:tasks.workunit.client.0.smithi057.stdout:0/785: unlink d0/d3/d4d/l51 0 2024-04-25T22:42:17.608 INFO:tasks.workunit.client.0.smithi057.stdout:5/900: rename d2/d1c/d24/d3d/da7/lc3 to d2/d47/da5/dd3/l118 0 2024-04-25T22:42:17.609 INFO:tasks.workunit.client.0.smithi057.stdout:9/771: dread d3/d34/d42/d28/d62/d67/d6e/f80 [0,4194304] 0 2024-04-25T22:42:17.609 INFO:tasks.workunit.client.0.smithi057.stdout:5/901: creat d2/d47/f119 x:0 0 0 2024-04-25T22:42:17.609 INFO:tasks.workunit.client.0.smithi057.stdout:5/902: mkdir d2/d47/ded/d11a 0 2024-04-25T22:42:17.610 INFO:tasks.workunit.client.0.smithi057.stdout:5/903: rmdir d2/d1c/d24/d3d/d77 39 2024-04-25T22:42:17.611 INFO:tasks.workunit.client.0.smithi057.stdout:5/904: fsync d2/d1c/d24/f4c 0 2024-04-25T22:42:17.611 INFO:tasks.workunit.client.0.smithi057.stdout:2/904: read d1f/d21/d105/f119 [1505452,30977] 0 2024-04-25T22:42:17.611 INFO:tasks.workunit.client.0.smithi057.stdout:4/849: read d14/d5a/f64 [1706270,91191] 0 2024-04-25T22:42:17.612 INFO:tasks.workunit.client.0.smithi057.stdout:5/905: readlink d2/d47/d94/lb6 0 2024-04-25T22:42:17.612 INFO:tasks.workunit.client.0.smithi057.stdout:2/905: write d1f/d34/f7d [4730016,73216] 0 2024-04-25T22:42:17.612 INFO:tasks.workunit.client.0.smithi057.stdout:5/906: chown d2/d6/db/l45 228 1 2024-04-25T22:42:17.614 INFO:tasks.workunit.client.0.smithi057.stdout:5/907: stat d2/d1c/d24/d3d/d77/dcd/ddd/fea 0 2024-04-25T22:42:17.614 INFO:tasks.workunit.client.0.smithi057.stdout:2/906: rename d1f/d34/f7d to d1f/d34/f132 0 2024-04-25T22:42:17.615 INFO:tasks.workunit.client.0.smithi057.stdout:7/758: dwrite d6/d28/d4e/d30/d46/f90 [0,4194304] 0 2024-04-25T22:42:17.616 INFO:tasks.workunit.client.0.smithi057.stdout:2/907: creat d1f/de7/d4d/d88/f133 x:0 0 0 2024-04-25T22:42:17.617 INFO:tasks.workunit.client.0.smithi057.stdout:4/850: sync 2024-04-25T22:42:17.617 INFO:tasks.workunit.client.0.smithi057.stdout:2/908: rename d1f/de7/d4d/d88/dd9/fc8 to d1f/d21/df6/f134 0 2024-04-25T22:42:17.619 INFO:tasks.workunit.client.0.smithi057.stdout:4/851: getdents d14/d47 0 2024-04-25T22:42:17.619 INFO:tasks.workunit.client.0.smithi057.stdout:5/908: dread d2/d6/db/fb4 [0,4194304] 0 2024-04-25T22:42:17.620 INFO:tasks.workunit.client.0.smithi057.stdout:5/909: creat d2/d1c/d46/f11b x:0 0 0 2024-04-25T22:42:17.621 INFO:tasks.workunit.client.0.smithi057.stdout:2/909: write d1f/d21/d26/fad [804676,99657] 0 2024-04-25T22:42:17.623 INFO:tasks.workunit.client.0.smithi057.stdout:5/910: rename d2/d1c/d46/f11b to d2/d47/d94/f11c 0 2024-04-25T22:42:17.623 INFO:tasks.workunit.client.0.smithi057.stdout:2/910: unlink d1f/d34/ff1 0 2024-04-25T22:42:17.623 INFO:tasks.workunit.client.0.smithi057.stdout:7/759: dwrite d6/d28/d4e/d30/d60/d8d/d96/d51/f9e [0,4194304] 0 2024-04-25T22:42:17.625 INFO:tasks.workunit.client.0.smithi057.stdout:5/911: link d2/d47/f68 d2/d1c/d46/de4/f11d 0 2024-04-25T22:42:17.625 INFO:tasks.workunit.client.0.smithi057.stdout:2/911: truncate d1f/d34/f132 3578601 0 2024-04-25T22:42:17.626 INFO:tasks.workunit.client.0.smithi057.stdout:5/912: creat d2/d6/db/f11e x:0 0 0 2024-04-25T22:42:17.626 INFO:tasks.workunit.client.0.smithi057.stdout:4/852: dwrite f9 [4194304,4194304] 0 2024-04-25T22:42:17.626 INFO:tasks.workunit.client.0.smithi057.stdout:2/912: write d1f/d21/d26/d63/ff7 [2513753,85711] 0 2024-04-25T22:42:17.627 INFO:tasks.workunit.client.0.smithi057.stdout:7/760: link d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/l93 d6/d28/d4e/d30/d60/d6f/d9c/dc4/dd6/lf6 0 2024-04-25T22:42:17.627 INFO:tasks.workunit.client.0.smithi057.stdout:5/913: rmdir d2/d1c/d46/dd0 39 2024-04-25T22:42:17.628 INFO:tasks.workunit.client.0.smithi057.stdout:5/914: chown d2/d1c/d46/dd0 502569373 1 2024-04-25T22:42:17.628 INFO:tasks.workunit.client.0.smithi057.stdout:2/913: mkdir d1f/d21/d26/d63/d135 0 2024-04-25T22:42:17.628 INFO:tasks.workunit.client.0.smithi057.stdout:7/761: rmdir d6/d28/d4e/d30/d46/d73/dcb 39 2024-04-25T22:42:17.629 INFO:tasks.workunit.client.0.smithi057.stdout:2/914: write d1f/d36/f4f [523011,16536] 0 2024-04-25T22:42:17.629 INFO:tasks.workunit.client.0.smithi057.stdout:5/915: write d2/d2c/db7/f111 [74007,82060] 0 2024-04-25T22:42:17.630 INFO:tasks.workunit.client.0.smithi057.stdout:4/853: rename d14/d3d/dfe/def/l56 to d14/d5a/d67/db4/d106/l10e 0 2024-04-25T22:42:17.631 INFO:tasks.workunit.client.0.smithi057.stdout:3/770: dread d0/d4/f2d [4194304,4194304] 0 2024-04-25T22:42:17.632 INFO:tasks.workunit.client.0.smithi057.stdout:4/854: truncate d14/d47/d5e/f8e 4456380 0 2024-04-25T22:42:17.632 INFO:tasks.workunit.client.0.smithi057.stdout:5/916: rename d2/d1c/d24/d8f/c9b to d2/d91/c11f 0 2024-04-25T22:42:17.632 INFO:tasks.workunit.client.0.smithi057.stdout:4/855: chown d14/d2f/d4c/f101 56 1 2024-04-25T22:42:17.633 INFO:tasks.workunit.client.0.smithi057.stdout:5/917: creat d2/d47/da5/dd3/f120 x:0 0 0 2024-04-25T22:42:17.633 INFO:tasks.workunit.client.0.smithi057.stdout:3/771: chown d0/d4/d34/d3c/d53/d7f/dfe/lff 1486 1 2024-04-25T22:42:17.634 INFO:tasks.workunit.client.0.smithi057.stdout:5/918: chown d2/d47/d60/fa6 29595245 1 2024-04-25T22:42:17.635 INFO:tasks.workunit.client.0.smithi057.stdout:3/772: symlink d0/d4/d7/dad/l104 0 2024-04-25T22:42:17.635 INFO:tasks.workunit.client.0.smithi057.stdout:4/856: creat d14/d2f/f10f x:0 0 0 2024-04-25T22:42:17.636 INFO:tasks.workunit.client.0.smithi057.stdout:5/919: fdatasync d2/d1c/d46/d3a/da8/f109 0 2024-04-25T22:42:17.637 INFO:tasks.workunit.client.0.smithi057.stdout:1/819: dread d7/dd/d26/f73 [0,4194304] 0 2024-04-25T22:42:17.637 INFO:tasks.workunit.client.0.smithi057.stdout:3/773: mknod d0/d4/d34/d3c/d70/c105 0 2024-04-25T22:42:17.637 INFO:tasks.workunit.client.0.smithi057.stdout:4/857: dread - d14/d2f/d4c/d5b/dd8/fc6 zero size 2024-04-25T22:42:17.638 INFO:tasks.workunit.client.0.smithi057.stdout:2/915: dwrite f1b [0,4194304] 0 2024-04-25T22:42:17.638 INFO:tasks.workunit.client.0.smithi057.stdout:7/762: dwrite d6/f21 [0,4194304] 0 2024-04-25T22:42:17.638 INFO:tasks.workunit.client.0.smithi057.stdout:8/786: dread d4/d5/d17/d19/d35/d83/d92/d5b/f6b [0,4194304] 0 2024-04-25T22:42:17.638 INFO:tasks.workunit.client.0.smithi057.stdout:9/772: dread d3/d34/d42/f41 [0,4194304] 0 2024-04-25T22:42:17.641 INFO:tasks.workunit.client.0.smithi057.stdout:2/916: fdatasync d1f/de7/d4d/d88/dd9/da1/fa9 0 2024-04-25T22:42:17.642 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:17.635+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:17.642 INFO:tasks.workunit.client.0.smithi057.stdout:1/820: write d7/d65/d95/d10b/d45/dd8/ff1 [493789,46212] 0 2024-04-25T22:42:17.642 INFO:tasks.workunit.client.0.smithi057.stdout:5/920: creat d2/d47/d60/f121 x:0 0 0 2024-04-25T22:42:17.642 INFO:tasks.workunit.client.0.smithi057.stdout:9/773: creat d3/d34/d42/d5e/d83/ff6 x:0 0 0 2024-04-25T22:42:17.644 INFO:tasks.workunit.client.0.smithi057.stdout:2/917: mknod d1f/d21/c136 0 2024-04-25T22:42:17.644 INFO:tasks.workunit.client.0.smithi057.stdout:1/821: chown d7/dd/d16/d24/fd0 39223 1 2024-04-25T22:42:17.644 INFO:tasks.workunit.client.0.smithi057.stdout:7/763: creat d6/d28/d4e/d30/d46/d73/dcb/ff7 x:0 0 0 2024-04-25T22:42:17.644 INFO:tasks.workunit.client.0.smithi057.stdout:8/787: creat d4/d5/d21/f11d x:0 0 0 2024-04-25T22:42:17.644 INFO:tasks.workunit.client.0.smithi057.stdout:4/858: link d14/da9/fd5 d14/d3d/f110 0 2024-04-25T22:42:17.645 INFO:tasks.workunit.client.0.smithi057.stdout:9/774: chown d3/d34/d42/d5e/cc0 4758 1 2024-04-25T22:42:17.646 INFO:tasks.workunit.client.0.smithi057.stdout:1/822: chown d7/d65/d6a/d98/l58 11890 1 2024-04-25T22:42:17.646 INFO:tasks.workunit.client.0.smithi057.stdout:8/788: truncate d4/d5/f33 4999424 0 2024-04-25T22:42:17.646 INFO:tasks.workunit.client.0.smithi057.stdout:5/921: getdents d2/d1c/d46/d3a/da8 0 2024-04-25T22:42:17.646 INFO:tasks.workunit.client.0.smithi057.stdout:4/859: stat d14/d2f/f57 0 2024-04-25T22:42:17.646 INFO:tasks.workunit.client.0.smithi057.stdout:8/789: mknod d4/dba/d111/c11e 0 2024-04-25T22:42:17.647 INFO:tasks.workunit.client.0.smithi057.stdout:1/823: chown d7/dd/d16/d18/d31/d8f/fb3 10115578 1 2024-04-25T22:42:17.649 INFO:tasks.workunit.client.0.smithi057.stdout:5/922: dread d2/d2c/fab [0,4194304] 0 2024-04-25T22:42:17.649 INFO:tasks.workunit.client.0.smithi057.stdout:3/774: dwrite d0/d4/d34/d3c/d53/f54 [0,4194304] 0 2024-04-25T22:42:17.649 INFO:tasks.workunit.client.0.smithi057.stdout:4/860: unlink d14/d2f/d4c/d5b/dd8/l87 0 2024-04-25T22:42:17.650 INFO:tasks.workunit.client.0.smithi057.stdout:8/790: mknod d4/d5/d17/d19/d35/d83/c11f 0 2024-04-25T22:42:17.650 INFO:tasks.workunit.client.0.smithi057.stdout:9/775: link d3/d34/d42/d28/d39/c8f d3/d34/d42/d28/d62/cf7 0 2024-04-25T22:42:17.650 INFO:tasks.workunit.client.0.smithi057.stdout:1/824: rename d7/dd/d16/d24/f4f to d7/dd/d90/dbf/f115 0 2024-04-25T22:42:17.651 INFO:tasks.workunit.client.0.smithi057.stdout:5/923: write d2/d1c/d24/d3d/deb/df6/f117 [586496,67480] 0 2024-04-25T22:42:17.651 INFO:tasks.workunit.client.0.smithi057.stdout:8/791: write d4/d5/d21/f6c [887982,90534] 0 2024-04-25T22:42:17.651 INFO:tasks.workunit.client.0.smithi057.stdout:4/861: symlink d14/d5a/d67/dcc/l111 0 2024-04-25T22:42:17.653 INFO:tasks.workunit.client.0.smithi057.stdout:1/825: mknod d7/d65/d95/d10b/d45/dd8/c116 0 2024-04-25T22:42:17.654 INFO:tasks.workunit.client.0.smithi057.stdout:5/924: link d2/f10 d2/d1c/d46/d3a/f122 0 2024-04-25T22:42:17.654 INFO:tasks.workunit.client.0.smithi057.stdout:4/862: dread d14/d47/d5e/f8e [4194304,4194304] 0 2024-04-25T22:42:17.656 INFO:tasks.workunit.client.0.smithi057.stdout:8/792: mkdir d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/d120 0 2024-04-25T22:42:17.657 INFO:tasks.workunit.client.0.smithi057.stdout:1/826: rename d7/dd/d16/d24/d61/l52 to d7/d65/d6a/d98/dc5/l117 0 2024-04-25T22:42:17.657 INFO:tasks.workunit.client.0.smithi057.stdout:4/863: mkdir d14/d5a/d67/db4/d112 0 2024-04-25T22:42:17.658 INFO:tasks.workunit.client.0.smithi057.stdout:4/864: readlink d14/d2f/l43 0 2024-04-25T22:42:17.659 INFO:tasks.workunit.client.0.smithi057.stdout:8/793: rename d4/fbf to d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/dc8/f121 0 2024-04-25T22:42:17.659 INFO:tasks.workunit.client.0.smithi057.stdout:4/865: stat d14/d2f/l9f 0 2024-04-25T22:42:17.660 INFO:tasks.workunit.client.0.smithi057.stdout:4/866: rmdir d14/d47 39 2024-04-25T22:42:17.660 INFO:tasks.workunit.client.0.smithi057.stdout:4/867: dread - d14/da2/fe3 zero size 2024-04-25T22:42:17.661 INFO:tasks.workunit.client.0.smithi057.stdout:8/794: truncate d4/d5/d17/d19/d35/d83/d92/d5b/f6b 4096039 0 2024-04-25T22:42:17.663 INFO:tasks.workunit.client.0.smithi057.stdout:2/918: truncate d1f/d36/fdb 3892717 0 2024-04-25T22:42:17.663 INFO:tasks.workunit.client.0.smithi057.stdout:6/884: dread d2/d19/d9b/df3/d31/f3a [0,4194304] 0 2024-04-25T22:42:17.664 INFO:tasks.workunit.client.0.smithi057.stdout:8/795: link d4/db/d12/f3e d4/d5/d17/d19/d35/d83/f122 0 2024-04-25T22:42:17.664 INFO:tasks.workunit.client.0.smithi057.stdout:5/925: dread d2/d1c/d24/d3d/d50/d83/fe5 [0,4194304] 0 2024-04-25T22:42:17.664 INFO:tasks.workunit.client.0.smithi057.stdout:6/885: readlink d2/d19/d49/d62/l110 0 2024-04-25T22:42:17.665 INFO:tasks.workunit.client.0.smithi057.stdout:2/919: chown d1f/d36/d54/dda/fee 25828241 1 2024-04-25T22:42:17.665 INFO:tasks.workunit.client.0.smithi057.stdout:8/796: dread - d4/db/dd/d3a/d5c/d76/fbe zero size 2024-04-25T22:42:17.665 INFO:tasks.workunit.client.0.smithi057.stdout:5/926: truncate d2/d2c/db7/f111 177026 0 2024-04-25T22:42:17.665 INFO:tasks.workunit.client.0.smithi057.stdout:6/886: mknod d2/d86/d90/d106/c124 0 2024-04-25T22:42:17.666 INFO:tasks.workunit.client.0.smithi057.stdout:2/920: creat d1f/d21/d33/d10d/f137 x:0 0 0 2024-04-25T22:42:17.667 INFO:tasks.workunit.client.0.smithi057.stdout:5/927: write d2/d6/db/fbb [1198457,116045] 0 2024-04-25T22:42:17.667 INFO:tasks.workunit.client.0.smithi057.stdout:8/797: dread - d4/d5/d17/d19/d35/d83/d92/f8b zero size 2024-04-25T22:42:17.668 INFO:tasks.workunit.client.0.smithi057.stdout:2/921: dread d1f/d21/d33/f7c [0,4194304] 0 2024-04-25T22:42:17.668 INFO:tasks.workunit.client.0.smithi057.stdout:6/887: dread - d2/d19/d49/d62/d79/dad/f11e zero size 2024-04-25T22:42:17.670 INFO:tasks.workunit.client.0.smithi057.stdout:5/928: read d2/d1c/d24/d3d/d50/d83/fe5 [950747,3973] 0 2024-04-25T22:42:17.670 INFO:tasks.workunit.client.0.smithi057.stdout:3/775: write d0/d4/d7/d46/d30/f5a [1262092,21857] 0 2024-04-25T22:42:17.670 INFO:tasks.workunit.client.0.smithi057.stdout:2/922: write d1f/d36/d54/dc0/f102 [429353,11057] 0 2024-04-25T22:42:17.671 INFO:tasks.workunit.client.0.smithi057.stdout:8/798: creat d4/d5/f123 x:0 0 0 2024-04-25T22:42:17.672 INFO:tasks.workunit.client.0.smithi057.stdout:0/786: dread d0/d3/d3a/d3b/fbb [0,4194304] 0 2024-04-25T22:42:17.672 INFO:tasks.workunit.client.0.smithi057.stdout:5/929: fsync d2/d47/f8c 0 2024-04-25T22:42:17.672 INFO:tasks.workunit.client.0.smithi057.stdout:3/776: chown d0/d4/d7/dad/lca 147 1 2024-04-25T22:42:17.673 INFO:tasks.workunit.client.0.smithi057.stdout:6/888: creat d2/d19/d9b/df3/d31/d83/dba/dbe/f125 x:0 0 0 2024-04-25T22:42:17.673 INFO:tasks.workunit.client.0.smithi057.stdout:2/923: chown d1f/d21/d33/c59 598 1 2024-04-25T22:42:17.673 INFO:tasks.workunit.client.0.smithi057.stdout:7/764: dread d6/f27 [0,4194304] 0 2024-04-25T22:42:17.673 INFO:tasks.workunit.client.0.smithi057.stdout:7/765: fsync d6/f3a 0 2024-04-25T22:42:17.673 INFO:tasks.workunit.client.0.smithi057.stdout:5/930: mknod d2/d1c/c123 0 2024-04-25T22:42:17.674 INFO:tasks.workunit.client.0.smithi057.stdout:3/777: rmdir d0/d5b 39 2024-04-25T22:42:17.674 INFO:tasks.workunit.client.0.smithi057.stdout:0/787: write d0/d3/d4d/f93 [1053189,16301] 0 2024-04-25T22:42:17.674 INFO:tasks.workunit.client.0.smithi057.stdout:7/766: mkdir d6/d28/d4e/d30/d60/d6f/df8 0 2024-04-25T22:42:17.674 INFO:tasks.workunit.client.0.smithi057.stdout:6/889: write d2/d86/fac [1210378,61465] 0 2024-04-25T22:42:17.675 INFO:tasks.workunit.client.0.smithi057.stdout:5/931: mknod d2/d1c/dfd/c124 0 2024-04-25T22:42:17.675 INFO:tasks.workunit.client.0.smithi057.stdout:3/778: mkdir d0/d4/d4a/d106 0 2024-04-25T22:42:17.676 INFO:tasks.workunit.client.0.smithi057.stdout:7/767: read d6/f27 [1318510,82354] 0 2024-04-25T22:42:17.676 INFO:tasks.workunit.client.0.smithi057.stdout:8/799: mknod d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/dc8/c124 0 2024-04-25T22:42:17.676 INFO:tasks.workunit.client.0.smithi057.stdout:5/932: mkdir d2/d47/d94/d125 0 2024-04-25T22:42:17.676 INFO:tasks.workunit.client.0.smithi057.stdout:7/768: chown d6/f9 2960 1 2024-04-25T22:42:17.677 INFO:tasks.workunit.client.0.smithi057.stdout:3/779: mkdir d0/d4/d7/d46/d30/d7a/d91/d107 0 2024-04-25T22:42:17.677 INFO:tasks.workunit.client.0.smithi057.stdout:8/800: write d4/d5/d17/d19/f26 [1892538,94302] 0 2024-04-25T22:42:17.677 INFO:tasks.workunit.client.0.smithi057.stdout:5/933: chown d2/d1c/d24/d3d/da7/db2 1 1 2024-04-25T22:42:17.679 INFO:tasks.workunit.client.0.smithi057.stdout:3/780: mkdir d0/d4/d4a/dab/d108 0 2024-04-25T22:42:17.679 INFO:tasks.workunit.client.0.smithi057.stdout:7/769: mkdir d6/d28/d4e/d30/d46/d73/dcb/df9 0 2024-04-25T22:42:17.679 INFO:tasks.workunit.client.0.smithi057.stdout:8/801: read d4/db/dd/d3a/d5c/d76/f97 [1281102,55928] 0 2024-04-25T22:42:17.680 INFO:tasks.workunit.client.0.smithi057.stdout:3/781: stat d0/d4/d7/dad/lc7 0 2024-04-25T22:42:17.680 INFO:tasks.workunit.client.0.smithi057.stdout:5/934: write d2/d47/d94/f9c [824143,6248] 0 2024-04-25T22:42:17.681 INFO:tasks.workunit.client.0.smithi057.stdout:7/770: truncate d6/d28/d4e/fdd 966727 0 2024-04-25T22:42:17.681 INFO:tasks.workunit.client.0.smithi057.stdout:3/782: mkdir d0/d4/d4a/d106/d109 0 2024-04-25T22:42:17.682 INFO:tasks.workunit.client.0.smithi057.stdout:8/802: write d4/d5/d17/d19/d35/f5a [5465500,51415] 0 2024-04-25T22:42:17.682 INFO:tasks.workunit.client.0.smithi057.stdout:5/935: rename d2/d6 to d2/d6/db/d126 22 2024-04-25T22:42:17.682 INFO:tasks.workunit.client.0.smithi057.stdout:2/924: dwrite d1f/d21/d33/daa/fed [0,4194304] 0 2024-04-25T22:42:17.683 INFO:tasks.workunit.client.0.smithi057.stdout:6/890: truncate d2/d86/d90/fbc 1939479 0 2024-04-25T22:42:17.684 INFO:tasks.workunit.client.0.smithi057.stdout:7/771: chown d6/d28/d4e/d30/d60/d8d/d96/d5d 5550830 1 2024-04-25T22:42:17.684 INFO:tasks.workunit.client.0.smithi057.stdout:2/925: readlink d1f/d21/d26/d63/l9f 0 2024-04-25T22:42:17.684 INFO:tasks.workunit.client.0.smithi057.stdout:3/783: mkdir d0/d4/d7/d26/d72/d10a 0 2024-04-25T22:42:17.685 INFO:tasks.workunit.client.0.smithi057.stdout:9/776: dread d3/ff [0,4194304] 0 2024-04-25T22:42:17.685 INFO:tasks.workunit.client.0.smithi057.stdout:3/784: mknod d0/d4/d7/d26/d72/c10b 0 2024-04-25T22:42:17.685 INFO:tasks.workunit.client.0.smithi057.stdout:9/777: chown d3/f66 6417 1 2024-04-25T22:42:17.686 INFO:tasks.workunit.client.0.smithi057.stdout:2/926: truncate d1f/de7/d4d/d88/f101 1405033 0 2024-04-25T22:42:17.686 INFO:tasks.workunit.client.0.smithi057.stdout:7/772: creat d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/dd7/dd4/ffa x:0 0 0 2024-04-25T22:42:17.687 INFO:tasks.workunit.client.0.smithi057.stdout:2/927: mkdir d1f/d36/d138 0 2024-04-25T22:42:17.687 INFO:tasks.workunit.client.0.smithi057.stdout:5/936: dread - d2/d1c/d46/d3a/ff4 zero size 2024-04-25T22:42:17.688 INFO:tasks.workunit.client.0.smithi057.stdout:6/891: creat d2/d59/f126 x:0 0 0 2024-04-25T22:42:17.689 INFO:tasks.workunit.client.0.smithi057.stdout:3/785: write d0/d4/d7/d22/f55 [16383,20642] 0 2024-04-25T22:42:17.690 INFO:tasks.workunit.client.0.smithi057.stdout:9/778: link d3/d34/d42/d28/d62/d67/d6e/f80 d3/d34/d42/d28/d62/ff8 0 2024-04-25T22:42:17.690 INFO:tasks.workunit.client.0.smithi057.stdout:7/773: truncate d6/d28/d4e/d30/d46/f99 5247158 0 2024-04-25T22:42:17.691 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:17.691 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:17.692 INFO:tasks.workunit.client.0.smithi057.stdout:6/892: symlink d2/d19/d50/d1a/db0/l127 0 2024-04-25T22:42:17.692 INFO:tasks.workunit.client.0.smithi057.stdout:8/803: dwrite d4/d5/f4d [0,4194304] 0 2024-04-25T22:42:17.692 INFO:tasks.workunit.client.0.smithi057.stdout:2/928: read d1f/d21/d26/d63/ff7 [2872505,42575] 0 2024-04-25T22:42:17.692 INFO:tasks.workunit.client.0.smithi057.stdout:3/786: rename d0/f62 to d0/d4/d34/d3c/f10c 0 2024-04-25T22:42:17.693 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:17.693 INFO:tasks.workunit.client.0.smithi057.stdout:6/893: chown d2/d19/d9b/df3/d31/f33 880208258 1 2024-04-25T22:42:17.693 INFO:tasks.workunit.client.0.smithi057.stdout:3/787: stat d0/d4/d7b/d7c/de8 0 2024-04-25T22:42:17.694 INFO:tasks.workunit.client.0.smithi057.stdout:8/804: readlink d4/d5/d17/d19/d35/d83/d92/d5b/d8c/la5 0 2024-04-25T22:42:17.697 INFO:tasks.workunit.client.0.smithi057.stdout:6/894: creat d2/d19/d9b/df3/d31/d83/daa/f128 x:0 0 0 2024-04-25T22:42:17.697 INFO:tasks.workunit.client.0.smithi057.stdout:8/805: chown d4/d5/d17/d19/d35/d83/d92/fa8 758 1 2024-04-25T22:42:17.698 INFO:tasks.workunit.client.0.smithi057.stdout:9/779: dwrite d3/f70 [0,4194304] 0 2024-04-25T22:42:17.699 INFO:tasks.workunit.client.0.smithi057.stdout:7/774: dwrite d6/f27 [0,4194304] 0 2024-04-25T22:42:17.699 INFO:tasks.workunit.client.0.smithi057.stdout:9/780: write d3/f58 [924267,89360] 0 2024-04-25T22:42:17.700 INFO:tasks.workunit.client.0.smithi057.stdout:7/775: stat d6/daa/lc7 0 2024-04-25T22:42:17.700 INFO:tasks.workunit.client.0.smithi057.stdout:6/895: truncate d2/d19/d9b/df3/d31/d83/fcb 1687202 0 2024-04-25T22:42:17.701 INFO:tasks.workunit.client.0.smithi057.stdout:5/937: dread d2/d1c/d24/fd1 [0,4194304] 0 2024-04-25T22:42:17.701 INFO:tasks.workunit.client.0.smithi057.stdout:6/896: read d2/d86/fca [2886297,78244] 0 2024-04-25T22:42:17.701 INFO:tasks.workunit.client.0.smithi057.stdout:9/781: chown d3/d34/d42/d28/d62/d67/d6e/d7c/fcd 1864 1 2024-04-25T22:42:17.703 INFO:tasks.workunit.client.0.smithi057.stdout:3/788: dwrite d0/d5b/ff9 [0,4194304] 0 2024-04-25T22:42:17.705 INFO:tasks.workunit.client.0.smithi057.stdout:9/782: write d3/d34/d42/d28/d62/d67/f71 [2927032,88915] 0 2024-04-25T22:42:17.705 INFO:tasks.workunit.client.0.smithi057.stdout:5/938: getdents d2/d47/d60 0 2024-04-25T22:42:17.706 INFO:tasks.workunit.client.0.smithi057.stdout:9/783: link d3/f58 d3/d34/d42/d28/d39/db3/ff9 0 2024-04-25T22:42:17.706 INFO:tasks.workunit.client.0.smithi057.stdout:6/897: link d2/d19/d49/d62/d79/dad/f11e d2/d19/d49/d62/d79/dad/d113/f129 0 2024-04-25T22:42:17.707 INFO:tasks.workunit.client.0.smithi057.stdout:1/827: sync 2024-04-25T22:42:17.707 INFO:tasks.workunit.client.0.smithi057.stdout:4/868: sync 2024-04-25T22:42:17.708 INFO:tasks.workunit.client.0.smithi057.stdout:3/789: write d0/d4/d34/fd5 [4179037,88219] 0 2024-04-25T22:42:17.708 INFO:tasks.workunit.client.0.smithi057.stdout:1/828: creat d7/d65/d6a/f118 x:0 0 0 2024-04-25T22:42:17.708 INFO:tasks.workunit.client.0.smithi057.stdout:4/869: creat d14/d47/d5e/d5f/f113 x:0 0 0 2024-04-25T22:42:17.708 INFO:tasks.workunit.client.0.smithi057.stdout:9/784: unlink d3/d34/d42/d28/dc1/dda/ce4 0 2024-04-25T22:42:17.708 INFO:tasks.workunit.client.0.smithi057.stdout:4/870: readlink l12 0 2024-04-25T22:42:17.709 INFO:tasks.workunit.client.0.smithi057.stdout:6/898: mknod d2/d19/d9b/df3/d31/d83/daa/d10f/c12a 0 2024-04-25T22:42:17.709 INFO:tasks.workunit.client.0.smithi057.stdout:1/829: write d7/dd/d90/dbf/f107 [586446,43733] 0 2024-04-25T22:42:17.710 INFO:tasks.workunit.client.0.smithi057.stdout:4/871: dread - d14/d5a/d67/dcc/ff2 zero size 2024-04-25T22:42:17.710 INFO:tasks.workunit.client.0.smithi057.stdout:3/790: creat d0/d4/d7/d26/d89/d97/dc1/dd3/f10d x:0 0 0 2024-04-25T22:42:17.710 INFO:tasks.workunit.client.0.smithi057.stdout:1/830: fdatasync d7/dd/d26/f47 0 2024-04-25T22:42:17.711 INFO:tasks.workunit.client.0.smithi057.stdout:3/791: write d0/d11/f36 [1531713,105033] 0 2024-04-25T22:42:17.713 INFO:tasks.workunit.client.0.smithi057.stdout:3/792: fdatasync d0/d4/d7/d46/f8a 0 2024-04-25T22:42:17.713 INFO:tasks.workunit.client.0.smithi057.stdout:8/806: dread d4/d5/d17/d19/d35/d83/d92/d5b/fcd [0,4194304] 0 2024-04-25T22:42:17.714 INFO:tasks.workunit.client.0.smithi057.stdout:4/872: creat d14/d47/d5e/d5f/f114 x:0 0 0 2024-04-25T22:42:17.714 INFO:tasks.workunit.client.0.smithi057.stdout:5/939: dwrite d2/d47/da5/fef [0,4194304] 0 2024-04-25T22:42:17.715 INFO:tasks.workunit.client.0.smithi057.stdout:8/807: fdatasync d4/db/dd/d3a/f3c 0 2024-04-25T22:42:17.715 INFO:tasks.workunit.client.0.smithi057.stdout:0/788: dread d0/d3/d3a/d3b/fd0 [4194304,4194304] 0 2024-04-25T22:42:17.716 INFO:tasks.workunit.client.0.smithi057.stdout:3/793: truncate d0/d4/fd 540487 0 2024-04-25T22:42:17.716 INFO:tasks.workunit.client.0.smithi057.stdout:5/940: write d2/d1c/d24/d3d/d50/f10a [420686,73492] 0 2024-04-25T22:42:17.718 INFO:tasks.workunit.client.0.smithi057.stdout:3/794: chown d0/d4/d7b/d7c/la2 258372440 1 2024-04-25T22:42:17.718 INFO:tasks.workunit.client.0.smithi057.stdout:9/785: dwrite d3/f66 [4194304,4194304] 0 2024-04-25T22:42:17.718 INFO:tasks.workunit.client.0.smithi057.stdout:0/789: write d0/d49/f6b [4728789,51982] 0 2024-04-25T22:42:17.721 INFO:tasks.workunit.client.0.smithi057.stdout:5/941: symlink d2/d1c/d24/l127 0 2024-04-25T22:42:17.721 INFO:tasks.workunit.client.0.smithi057.stdout:9/786: chown d3/d34/d42/d28/f51 22436125 1 2024-04-25T22:42:17.721 INFO:tasks.workunit.client.0.smithi057.stdout:1/831: dwrite d7/d65/d95/d10b/d75/fb8 [0,4194304] 0 2024-04-25T22:42:17.721 INFO:tasks.workunit.client.0.smithi057.stdout:5/942: mkdir d2/d1c/dfd/d128 0 2024-04-25T22:42:17.722 INFO:tasks.workunit.client.0.smithi057.stdout:5/943: mknod d2/d1c/d24/d3d/d50/c129 0 2024-04-25T22:42:17.722 INFO:tasks.workunit.client.0.smithi057.stdout:5/944: chown d2/d47/d94/fad 10869513 1 2024-04-25T22:42:17.728 INFO:tasks.workunit.client.0.smithi057.stdout:3/795: dwrite d0/d4/f57 [0,4194304] 0 2024-04-25T22:42:17.728 INFO:tasks.workunit.client.0.smithi057.stdout:0/790: truncate d0/d3/d3a/d3b/f70 242079 0 2024-04-25T22:42:17.730 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:17.730 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:17.731 INFO:tasks.workunit.client.0.smithi057.stdout:9/787: dwrite d3/d34/d42/d28/d62/d67/f71 [0,4194304] 0 2024-04-25T22:42:17.731 INFO:tasks.workunit.client.0.smithi057.stdout:1/832: dwrite d7/d65/d6a/d98/dc5/f106 [0,4194304] 0 2024-04-25T22:42:17.732 INFO:tasks.workunit.client.0.smithi057.stdout:7/776: fdatasync f1 0 2024-04-25T22:42:17.733 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:17.733 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:17.734 INFO:tasks.workunit.client.0.smithi057.stdout:5/945: dwrite d2/d6/db/f25 [4194304,4194304] 0 2024-04-25T22:42:17.736 INFO:tasks.workunit.client.0.smithi057.stdout:5/946: creat d2/d1c/f12a x:0 0 0 2024-04-25T22:42:17.738 INFO:tasks.workunit.client.0.smithi057.stdout:4/873: dwrite d14/da9/fd5 [0,4194304] 0 2024-04-25T22:42:17.739 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:17.739 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:17.740 INFO:tasks.workunit.client.0.smithi057.stdout:4/874: readlink lb 0 2024-04-25T22:42:17.740 INFO:tasks.workunit.client.0.smithi057.stdout:0/791: truncate d0/d3/d3a/d3b/fd0 2674837 0 2024-04-25T22:42:17.740 INFO:tasks.workunit.client.0.smithi057.stdout:4/875: mknod d14/d5a/dd2/c115 0 2024-04-25T22:42:17.740 INFO:tasks.workunit.client.0.smithi057.stdout:3/796: dwrite d0/d4/d34/d3c/f5c [0,4194304] 0 2024-04-25T22:42:17.743 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:17.740+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:17.743 INFO:tasks.workunit.client.0.smithi057.stdout:3/797: mkdir d0/d4/d34/d3c/d53/d10e 0 2024-04-25T22:42:17.743 INFO:tasks.workunit.client.0.smithi057.stdout:9/788: dwrite d3/f9 [0,4194304] 0 2024-04-25T22:42:17.743 INFO:tasks.workunit.client.0.smithi057.stdout:0/792: getdents d0/d3 0 2024-04-25T22:42:17.745 INFO:tasks.workunit.client.0.smithi057.stdout:0/793: write d0/d3/f109 [422443,47256] 0 2024-04-25T22:42:17.745 INFO:tasks.workunit.client.0.smithi057.stdout:9/789: rmdir d3/d34/d42/d28/d62/d67 39 2024-04-25T22:42:17.747 INFO:tasks.workunit.client.0.smithi057.stdout:7/777: dwrite d6/d28/d4e/d30/d60/fbb [0,4194304] 0 2024-04-25T22:42:17.748 INFO:tasks.workunit.client.0.smithi057.stdout:0/794: write d0/d3/d3a/d3b/fbb [2431591,473] 0 2024-04-25T22:42:17.749 INFO:tasks.workunit.client.0.smithi057.stdout:5/947: dwrite d2/d1c/d24/f4c [0,4194304] 0 2024-04-25T22:42:17.751 INFO:tasks.workunit.client.0.smithi057.stdout:4/876: dwrite d14/d2f/d4c/d5b/daa/fb0 [0,4194304] 0 2024-04-25T22:42:17.751 INFO:tasks.workunit.client.0.smithi057.stdout:5/948: mknod d2/d47/ded/d10d/c12b 0 2024-04-25T22:42:17.751 INFO:tasks.workunit.client.0.smithi057.stdout:7/778: dread - d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/fb7 zero size 2024-04-25T22:42:17.753 INFO:tasks.workunit.client.0.smithi057.stdout:0/795: chown d0/d3/d4d/d87/d102/da3/dec/c2c 12393 1 2024-04-25T22:42:17.754 INFO:tasks.workunit.client.0.smithi057.stdout:5/949: readlink d2/d1c/d24/d3d/d77/l99 0 2024-04-25T22:42:17.754 INFO:tasks.workunit.client.0.smithi057.stdout:4/877: symlink d14/da9/db5/l116 0 2024-04-25T22:42:17.754 INFO:tasks.workunit.client.0.smithi057.stdout:3/798: dwrite d0/d4/d7/fb5 [0,4194304] 0 2024-04-25T22:42:17.754 INFO:tasks.workunit.client.0.smithi057.stdout:0/796: readlink d0/d3/d6/d14/l64 0 2024-04-25T22:42:17.758 INFO:tasks.workunit.client.0.smithi057.stdout:9/790: dwrite d3/d34/d42/d28/d39/db3/fae [0,4194304] 0 2024-04-25T22:42:17.760 INFO:tasks.workunit.client.0.smithi057.stdout:2/929: dread d1f/de7/d4d/d88/dd9/f97 [0,4194304] 0 2024-04-25T22:42:17.760 INFO:tasks.workunit.client.0.smithi057.stdout:9/791: write d3/dd8/de3/fe9 [918338,55215] 0 2024-04-25T22:42:17.761 INFO:tasks.workunit.client.0.smithi057.stdout:5/950: link d2/d6/f62 d2/d104/f12c 0 2024-04-25T22:42:17.762 INFO:tasks.workunit.client.0.smithi057.stdout:3/799: write d0/f6 [542905,62363] 0 2024-04-25T22:42:17.763 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:17.764 INFO:tasks.workunit.client.0.smithi057.stdout:2/930: read - d1f/d34/d50/df0/ff4 zero size 2024-04-25T22:42:17.764 INFO:tasks.workunit.client.0.smithi057.stdout:5/951: symlink d2/d47/ded/d10d/l12d 0 2024-04-25T22:42:17.764 INFO:tasks.workunit.client.0.smithi057.stdout:7/779: dwrite d6/d28/d4e/d30/d60/d8d/d96/f2a [0,4194304] 0 2024-04-25T22:42:17.765 INFO:tasks.workunit.client.0.smithi057.stdout:2/931: creat d1f/d21/d26/f139 x:0 0 0 2024-04-25T22:42:17.765 INFO:tasks.workunit.client.0.smithi057.stdout:3/800: creat d0/d4/d34/d3c/d53/d10e/f10f x:0 0 0 2024-04-25T22:42:17.766 INFO:tasks.workunit.client.0.smithi057.stdout:5/952: truncate d2/d1c/d24/d3d/d77/f10b 690433 0 2024-04-25T22:42:17.767 INFO:tasks.workunit.client.0.smithi057.stdout:7/780: write d6/d28/d4e/d30/d60/d8d/d96/d59/fbd [274499,70566] 0 2024-04-25T22:42:17.767 INFO:tasks.workunit.client.0.smithi057.stdout:0/797: dwrite d0/d3/d4d/f8f [0,4194304] 0 2024-04-25T22:42:17.767 INFO:tasks.workunit.client.0.smithi057.stdout:5/953: read - d2/d2c/ffb zero size 2024-04-25T22:42:17.768 INFO:tasks.workunit.client.0.smithi057.stdout:0/798: readlink d0/d3/d4d/d87/d102/da3/dec/lc4 0 2024-04-25T22:42:17.768 INFO:tasks.workunit.client.0.smithi057.stdout:7/781: mknod d6/d28/d4e/d30/d46/d73/cfb 0 2024-04-25T22:42:17.768 INFO:tasks.workunit.client.0.smithi057.stdout:5/954: write d2/d1c/d24/d3d/d50/d83/fe5 [702445,69952] 0 2024-04-25T22:42:17.769 INFO:tasks.workunit.client.0.smithi057.stdout:0/799: creat d0/d5/f113 x:0 0 0 2024-04-25T22:42:17.770 INFO:tasks.workunit.client.0.smithi057.stdout:0/800: write d0/d3/d4d/d87/fed [28086,128556] 0 2024-04-25T22:42:17.771 INFO:tasks.workunit.client.0.smithi057.stdout:0/801: creat d0/d49/d6d/f114 x:0 0 0 2024-04-25T22:42:17.771 INFO:tasks.workunit.client.0.smithi057.stdout:3/801: getdents d0/d4/d96 0 2024-04-25T22:42:17.773 INFO:tasks.workunit.client.0.smithi057.stdout:5/955: dread d2/d1c/d24/f4c [0,4194304] 0 2024-04-25T22:42:17.774 INFO:tasks.workunit.client.0.smithi057.stdout:6/899: sync 2024-04-25T22:42:17.775 INFO:tasks.workunit.client.0.smithi057.stdout:9/792: dwrite d3/d34/d42/d28/d62/ff8 [0,4194304] 0 2024-04-25T22:42:17.777 INFO:tasks.workunit.client.0.smithi057.stdout:9/793: mknod d3/d34/d42/cfa 0 2024-04-25T22:42:17.778 INFO:tasks.workunit.client.0.smithi057.stdout:6/900: link d2/d19/d9b/df3/d31/d83/cf2 d2/d19/d20/d61/dbf/c12b 0 2024-04-25T22:42:17.779 INFO:tasks.workunit.client.0.smithi057.stdout:0/802: dwrite d0/d3/d4d/d87/d102/da3/dec/f89 [4194304,4194304] 0 2024-04-25T22:42:17.781 INFO:tasks.workunit.client.0.smithi057.stdout:9/794: write d3/d34/d42/d28/d65/f9b [631090,5288] 0 2024-04-25T22:42:17.781 INFO:tasks.workunit.client.0.smithi057.stdout:3/802: dwrite d0/d4/d7/d46/d30/d7a/fd1 [0,4194304] 0 2024-04-25T22:42:17.781 INFO:tasks.workunit.client.0.smithi057.stdout:6/901: write d2/f32 [2517904,88249] 0 2024-04-25T22:42:17.783 INFO:tasks.workunit.client.0.smithi057.stdout:6/902: creat d2/d19/d9b/df3/d31/f12c x:0 0 0 2024-04-25T22:42:17.784 INFO:tasks.workunit.client.0.smithi057.stdout:3/803: mkdir d0/d4/d7/d26/d110 0 2024-04-25T22:42:17.785 INFO:tasks.workunit.client.0.smithi057.stdout:6/903: fsync d2/d19/d26/d63/fe8 0 2024-04-25T22:42:17.785 INFO:tasks.workunit.client.0.smithi057.stdout:3/804: dread d0/d4/d34/fd5 [4194304,4194304] 0 2024-04-25T22:42:17.788 INFO:tasks.workunit.client.0.smithi057.stdout:6/904: creat d2/d86/d90/d106/dda/f12d x:0 0 0 2024-04-25T22:42:17.788 INFO:tasks.workunit.client.0.smithi057.stdout:3/805: creat d0/d4/d4a/f111 x:0 0 0 2024-04-25T22:42:17.789 INFO:tasks.workunit.client.0.smithi057.stdout:0/803: dwrite d0/d49/f95 [4194304,4194304] 0 2024-04-25T22:42:17.789 INFO:tasks.workunit.client.0.smithi057.stdout:6/905: chown d2/d19/d20/f6a 3846306 1 2024-04-25T22:42:17.790 INFO:tasks.workunit.client.0.smithi057.stdout:0/804: dread - d0/d3/d6/d14/d39/f80 zero size 2024-04-25T22:42:17.792 INFO:tasks.workunit.client.0.smithi057.stdout:9/795: dwrite d3/f9 [0,4194304] 0 2024-04-25T22:42:17.793 INFO:tasks.workunit.client.0.smithi057.stdout:0/805: link d0/d49/d97/ff3 d0/d3/dae/f115 0 2024-04-25T22:42:17.795 INFO:tasks.workunit.client.0.smithi057.stdout:3/806: dwrite d0/d4/d7/d22/f55 [0,4194304] 0 2024-04-25T22:42:17.796 INFO:tasks.workunit.client.0.smithi057.stdout:0/806: mkdir d0/d3/d4d/d87/da0/d116 0 2024-04-25T22:42:17.796 INFO:tasks.workunit.client.0.smithi057.stdout:3/807: creat d0/d4/d7/d26/f112 x:0 0 0 2024-04-25T22:42:17.797 INFO:tasks.workunit.client.0.smithi057.stdout:0/807: write d0/d5/d53/f67 [291217,15411] 0 2024-04-25T22:42:17.797 INFO:tasks.workunit.client.0.smithi057.stdout:3/808: symlink d0/d4/d7/d46/d30/d7a/l113 0 2024-04-25T22:42:17.797 INFO:tasks.workunit.client.0.smithi057.stdout:0/808: creat d0/d49/f117 x:0 0 0 2024-04-25T22:42:17.798 INFO:tasks.workunit.client.0.smithi057.stdout:0/809: rename d0/d3/fdb to d0/d49/d6d/f118 0 2024-04-25T22:42:17.799 INFO:tasks.workunit.client.0.smithi057.stdout:3/809: rename d0/d4/d7/l2e to d0/d4/d7/d26/d72/d10a/l114 0 2024-04-25T22:42:17.807 INFO:tasks.workunit.client.0.smithi057.stdout:6/906: write d2/d86/fca [3625431,122841] 0 2024-04-25T22:42:17.808 INFO:tasks.workunit.client.0.smithi057.stdout:6/907: creat d2/d86/d90/d106/dda/d10b/f12e x:0 0 0 2024-04-25T22:42:17.808 INFO:tasks.workunit.client.0.smithi057.stdout:6/908: symlink d2/d19/d9b/df3/l12f 0 2024-04-25T22:42:17.811 INFO:tasks.workunit.client.0.smithi057.stdout:6/909: creat d2/d19/d9b/df3/d31/d83/f130 x:0 0 0 2024-04-25T22:42:17.811 INFO:tasks.workunit.client.0.smithi057.stdout:9/796: dwrite d3/f1a [0,4194304] 0 2024-04-25T22:42:17.812 INFO:tasks.workunit.client.0.smithi057.stdout:6/910: creat d2/d86/d90/d106/dda/d10b/d117/d11f/f131 x:0 0 0 2024-04-25T22:42:17.813 INFO:tasks.workunit.client.0.smithi057.stdout:9/797: write d3/d34/d42/d28/d62/d67/d6e/d7c/fdb [713979,29426] 0 2024-04-25T22:42:17.813 INFO:tasks.workunit.client.0.smithi057.stdout:6/911: chown d2/d19/d26/d4f/fb3 1 1 2024-04-25T22:42:17.813 INFO:tasks.workunit.client.0.smithi057.stdout:6/912: symlink d2/d19/d9b/df3/d31/l132 0 2024-04-25T22:42:17.814 INFO:tasks.workunit.client.0.smithi057.stdout:9/798: creat d3/d34/d42/d28/d39/d54/da5/ffb x:0 0 0 2024-04-25T22:42:17.815 INFO:tasks.workunit.client.0.smithi057.stdout:6/913: unlink d2/d19/d50/d1a/f42 0 2024-04-25T22:42:17.815 INFO:tasks.workunit.client.0.smithi057.stdout:9/799: write d3/d34/d42/d28/d62/d67/d6e/d7c/db8/fd0 [336520,90547] 0 2024-04-25T22:42:17.816 INFO:tasks.workunit.client.0.smithi057.stdout:6/914: symlink d2/d19/d9b/df3/d31/d83/ddf/l133 0 2024-04-25T22:42:17.818 INFO:tasks.workunit.client.0.smithi057.stdout:6/915: chown d2/d19/d9b/df3/d31/d83/dba/dbe/cdd 0 1 2024-04-25T22:42:17.818 INFO:tasks.workunit.client.0.smithi057.stdout:6/916: dread - d2/d19/d50/d1a/f4e zero size 2024-04-25T22:42:17.819 INFO:tasks.workunit.client.0.smithi057.stdout:6/917: readlink d2/d19/d20/d61/l109 0 2024-04-25T22:42:17.820 INFO:tasks.workunit.client.0.smithi057.stdout:9/800: dread d3/dd8/de3/fe9 [0,4194304] 0 2024-04-25T22:42:17.821 INFO:tasks.workunit.client.0.smithi057.stdout:3/810: symlink d0/d4/d7/d26/d72/d10a/l115 0 2024-04-25T22:42:17.821 INFO:tasks.workunit.client.0.smithi057.stdout:9/801: mknod d3/d34/d42/d5e/cfc 0 2024-04-25T22:42:17.821 INFO:tasks.workunit.client.0.smithi057.stdout:6/918: mknod d2/d19/d9b/df3/d31/d83/dba/dbe/dcf/c134 0 2024-04-25T22:42:17.822 INFO:tasks.workunit.client.0.smithi057.stdout:6/919: mknod d2/d19/d9b/df3/d31/d83/c135 0 2024-04-25T22:42:17.822 INFO:tasks.workunit.client.0.smithi057.stdout:3/811: getdents d0/d4/d7/d26/d89/d97/dc1 0 2024-04-25T22:42:17.823 INFO:tasks.workunit.client.0.smithi057.stdout:9/802: rename d3/d34/d42/d28/d39/f3a to d3/d34/d42/ffd 0 2024-04-25T22:42:17.823 INFO:tasks.workunit.client.0.smithi057.stdout:6/920: stat d2/d19/d20/d61/dbf/c12b 0 2024-04-25T22:42:17.823 INFO:tasks.workunit.client.0.smithi057.stdout:0/810: dread d0/d3/d4d/f93 [0,4194304] 0 2024-04-25T22:42:17.824 INFO:tasks.workunit.client.0.smithi057.stdout:6/921: creat d2/d19/d20/d114/f136 x:0 0 0 2024-04-25T22:42:17.824 INFO:tasks.workunit.client.0.smithi057.stdout:0/811: stat d0/d49/d6d/f8b 0 2024-04-25T22:42:17.824 INFO:tasks.workunit.client.0.smithi057.stdout:3/812: link d0/d4/d7/d26/d72/dd0/de5/ff7 d0/d4/d7/d22/f116 0 2024-04-25T22:42:17.825 INFO:tasks.workunit.client.0.smithi057.stdout:6/922: mkdir d2/d19/d9b/df3/d31/d83/ddf/d137 0 2024-04-25T22:42:17.825 INFO:tasks.workunit.client.0.smithi057.stdout:3/813: creat d0/d4/d4a/dab/f117 x:0 0 0 2024-04-25T22:42:17.825 INFO:tasks.workunit.client.0.smithi057.stdout:0/812: link d0/f30 d0/d3/d4d/d87/f119 0 2024-04-25T22:42:17.826 INFO:tasks.workunit.client.0.smithi057.stdout:6/923: creat d2/d86/d90/d106/dda/d10b/f138 x:0 0 0 2024-04-25T22:42:17.826 INFO:tasks.workunit.client.0.smithi057.stdout:6/924: chown d2/d86/d90/d106/dda 8 1 2024-04-25T22:42:17.827 INFO:tasks.workunit.client.0.smithi057.stdout:3/814: mknod d0/d4/d7/d46/d30/db9/c118 0 2024-04-25T22:42:17.827 INFO:tasks.workunit.client.0.smithi057.stdout:6/925: mknod d2/d86/c139 0 2024-04-25T22:42:17.827 INFO:tasks.workunit.client.0.smithi057.stdout:3/815: chown d0/d4/d34/d3c/d53/db1/dce/cf2 1 1 2024-04-25T22:42:17.828 INFO:tasks.workunit.client.0.smithi057.stdout:6/926: rmdir d2/d19/d49/d62/d79/dad/d113 39 2024-04-25T22:42:17.828 INFO:tasks.workunit.client.0.smithi057.stdout:0/813: truncate d0/d49/f6b 1737312 0 2024-04-25T22:42:17.829 INFO:tasks.workunit.client.0.smithi057.stdout:0/814: chown d0/d3/d4d/f81 19541 1 2024-04-25T22:42:17.829 INFO:tasks.workunit.client.0.smithi057.stdout:0/815: symlink d0/d3/d4d/d87/d102/l11a 0 2024-04-25T22:42:17.832 INFO:tasks.workunit.client.0.smithi057.stdout:0/816: link d0/d3/dae/ff0 d0/d3/d6/d83/dfa/f11b 0 2024-04-25T22:42:17.833 INFO:tasks.workunit.client.0.smithi057.stdout:1/833: dread d7/dd/d16/d18/f39 [0,4194304] 0 2024-04-25T22:42:17.834 INFO:tasks.workunit.client.0.smithi057.stdout:1/834: chown d7/d65/d95/d10b/d75/cb7 1517 1 2024-04-25T22:42:17.834 INFO:tasks.workunit.client.0.smithi057.stdout:6/927: dwrite d2/d19/d9b/df3/d31/d83/f123 [0,4194304] 0 2024-04-25T22:42:17.836 INFO:tasks.workunit.client.0.smithi057.stdout:8/808: dread d4/d5/d17/d19/d35/f5a [0,4194304] 0 2024-04-25T22:42:17.836 INFO:tasks.workunit.client.0.smithi057.stdout:6/928: rmdir d2/d86/d90/d106/dda/d10b/d117/d11f 39 2024-04-25T22:42:17.837 INFO:tasks.workunit.client.0.smithi057.stdout:6/929: fdatasync d2/d19/d26/d4f/f84 0 2024-04-25T22:42:17.837 INFO:tasks.workunit.client.0.smithi057.stdout:8/809: creat d4/d5/d2f/dc2/f125 x:0 0 0 2024-04-25T22:42:17.838 INFO:tasks.workunit.client.0.smithi057.stdout:6/930: dread - d2/d19/d49/db4/fb5 zero size 2024-04-25T22:42:17.840 INFO:tasks.workunit.client.0.smithi057.stdout:9/803: fsync d3/f1a 0 2024-04-25T22:42:17.843 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:17.840+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:17.843 INFO:tasks.workunit.client.0.smithi057.stdout:9/804: getdents d3/d34/d42/d28/d62/dcf/df3 0 2024-04-25T22:42:17.844 INFO:tasks.workunit.client.0.smithi057.stdout:8/810: dwrite d4/d5/d17/d19/f30 [0,4194304] 0 2024-04-25T22:42:17.846 INFO:tasks.workunit.client.0.smithi057.stdout:4/878: dread d14/d2f/d4c/d5b/db8/fc7 [0,4194304] 0 2024-04-25T22:42:17.846 INFO:tasks.workunit.client.0.smithi057.stdout:8/811: symlink d4/db/d12/l126 0 2024-04-25T22:42:17.846 INFO:tasks.workunit.client.0.smithi057.stdout:9/805: getdents d3/d34/d42/d28/d39/db3 0 2024-04-25T22:42:17.847 INFO:tasks.workunit.client.0.smithi057.stdout:4/879: write d14/d2f/d4c/f101 [3106264,51383] 0 2024-04-25T22:42:17.847 INFO:tasks.workunit.client.0.smithi057.stdout:8/812: dread - d4/d5/d17/fdd zero size 2024-04-25T22:42:17.848 INFO:tasks.workunit.client.0.smithi057.stdout:6/931: dwrite d2/d86/d90/d106/fe1 [0,4194304] 0 2024-04-25T22:42:17.850 INFO:tasks.workunit.client.0.smithi057.stdout:4/880: link d14/d2f/d4c/d5b/fff d14/d47/d5e/d5f/f117 0 2024-04-25T22:42:17.851 INFO:tasks.workunit.client.0.smithi057.stdout:8/813: rename d4/d5/f82 to d4/db/d12/f127 0 2024-04-25T22:42:17.852 INFO:tasks.workunit.client.0.smithi057.stdout:4/881: getdents d14/da2/da7 0 2024-04-25T22:42:17.852 INFO:tasks.workunit.client.0.smithi057.stdout:8/814: getdents d4/d5/d2f 0 2024-04-25T22:42:17.852 INFO:tasks.workunit.client.0.smithi057.stdout:6/932: truncate d2/d19/d49/d62/f8f 2042595 0 2024-04-25T22:42:17.853 INFO:tasks.workunit.client.0.smithi057.stdout:8/815: symlink d4/db/d12/l128 0 2024-04-25T22:42:17.854 INFO:tasks.workunit.client.0.smithi057.stdout:9/806: dwrite d3/d34/f43 [0,4194304] 0 2024-04-25T22:42:17.854 INFO:tasks.workunit.client.0.smithi057.stdout:6/933: creat d2/d19/d9b/df3/d31/d83/dba/dbe/f13a x:0 0 0 2024-04-25T22:42:17.854 INFO:tasks.workunit.client.0.smithi057.stdout:8/816: rename d4/d5/le7 to d4/dba/l129 0 2024-04-25T22:42:17.855 INFO:tasks.workunit.client.0.smithi057.stdout:4/882: truncate d14/d2f/fdc 951346 0 2024-04-25T22:42:17.856 INFO:tasks.workunit.client.0.smithi057.stdout:9/807: link d3/d34/d42/d28/d39/l45 d3/d34/d42/d5e/da3/lfe 0 2024-04-25T22:42:17.858 INFO:tasks.workunit.client.0.smithi057.stdout:7/782: dread d6/d28/d4e/d30/f56 [0,4194304] 0 2024-04-25T22:42:17.860 INFO:tasks.workunit.client.0.smithi057.stdout:7/783: creat d6/d28/d4e/d30/d60/ffc x:0 0 0 2024-04-25T22:42:17.861 INFO:tasks.workunit.client.0.smithi057.stdout:6/934: dwrite d2/d19/d20/d61/dbf/de2/f11a [0,4194304] 0 2024-04-25T22:42:17.863 INFO:tasks.workunit.client.0.smithi057.stdout:7/784: mkdir d6/d28/d4e/d30/d46/d73/dcb/df9/dfd 0 2024-04-25T22:42:17.863 INFO:tasks.workunit.client.0.smithi057.stdout:8/817: dwrite d4/d5/d17/d19/d35/d83/d92/d5b/d8c/ff0 [0,4194304] 0 2024-04-25T22:42:17.863 INFO:tasks.workunit.client.0.smithi057.stdout:9/808: dwrite d3/f32 [0,4194304] 0 2024-04-25T22:42:17.865 INFO:tasks.workunit.client.0.smithi057.stdout:5/956: sync 2024-04-25T22:42:17.865 INFO:tasks.workunit.client.0.smithi057.stdout:2/932: sync 2024-04-25T22:42:17.866 INFO:tasks.workunit.client.0.smithi057.stdout:3/816: sync 2024-04-25T22:42:17.866 INFO:tasks.workunit.client.0.smithi057.stdout:2/933: fsync d1f/d21/f25 0 2024-04-25T22:42:17.866 INFO:tasks.workunit.client.0.smithi057.stdout:3/817: stat d0/d4/d7/d22/lb8 0 2024-04-25T22:42:17.866 INFO:tasks.workunit.client.0.smithi057.stdout:9/809: unlink d3/d34/d42/d28/d62/d67/d6e/d7c/fcd 0 2024-04-25T22:42:17.870 INFO:tasks.workunit.client.0.smithi057.stdout:2/934: stat d1f/d21/d26/d63/d7f/d10a 0 2024-04-25T22:42:17.870 INFO:tasks.workunit.client.0.smithi057.stdout:5/957: getdents d2/d104 0 2024-04-25T22:42:17.870 INFO:tasks.workunit.client.0.smithi057.stdout:7/785: rename d6/d28/d4e/d30/d60/d6f/d9c/dc4/dd6/fe9 to d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d97/ffe 0 2024-04-25T22:42:17.871 INFO:tasks.workunit.client.0.smithi057.stdout:3/818: chown d0/d4/d7/d46/d30/d7a/lcf 12788 1 2024-04-25T22:42:17.872 INFO:tasks.workunit.client.0.smithi057.stdout:9/810: mknod d3/d34/d42/d28/d62/d67/cff 0 2024-04-25T22:42:17.874 INFO:tasks.workunit.client.0.smithi057.stdout:7/786: write d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d97/ffe [438833,95430] 0 2024-04-25T22:42:17.874 INFO:tasks.workunit.client.0.smithi057.stdout:6/935: dwrite d2/d19/f3d [0,4194304] 0 2024-04-25T22:42:17.875 INFO:tasks.workunit.client.0.smithi057.stdout:3/819: creat d0/d4/d7/d46/d30/d7a/d91/d107/f119 x:0 0 0 2024-04-25T22:42:17.875 INFO:tasks.workunit.client.0.smithi057.stdout:1/835: dread d7/fb4 [0,4194304] 0 2024-04-25T22:42:17.876 INFO:tasks.workunit.client.0.smithi057.stdout:8/818: dwrite d4/d5/f33 [0,4194304] 0 2024-04-25T22:42:17.877 INFO:tasks.workunit.client.0.smithi057.stdout:9/811: rename d3/d34/d42/d28/dc1/le6 to d3/d34/d42/d28/d39/d54/da5/l100 0 2024-04-25T22:42:17.877 INFO:tasks.workunit.client.0.smithi057.stdout:3/820: creat d0/d4/d4a/d106/f11a x:0 0 0 2024-04-25T22:42:17.877 INFO:tasks.workunit.client.0.smithi057.stdout:6/936: symlink d2/d19/d20/d61/dbf/dfb/l13b 0 2024-04-25T22:42:17.877 INFO:tasks.workunit.client.0.smithi057.stdout:2/935: dwrite d1f/d21/d26/d63/ff2 [0,4194304] 0 2024-04-25T22:42:17.878 INFO:tasks.workunit.client.0.smithi057.stdout:8/819: readlink d4/d5/d17/d19/d35/d83/la2 0 2024-04-25T22:42:17.878 INFO:tasks.workunit.client.0.smithi057.stdout:4/883: dread d14/d2f/f57 [0,4194304] 0 2024-04-25T22:42:17.878 INFO:tasks.workunit.client.0.smithi057.stdout:1/836: write d7/d65/d95/d10b/d75/f9d [478012,26702] 0 2024-04-25T22:42:17.878 INFO:tasks.workunit.client.0.smithi057.stdout:7/787: creat d6/d28/d4e/d30/d46/d73/fff x:0 0 0 2024-04-25T22:42:17.880 INFO:tasks.workunit.client.0.smithi057.stdout:4/884: write d14/d47/d62/fdd [305010,5453] 0 2024-04-25T22:42:17.880 INFO:tasks.workunit.client.0.smithi057.stdout:2/936: symlink d1f/de7/d4d/d88/dd9/dd6/l13a 0 2024-04-25T22:42:17.880 INFO:tasks.workunit.client.0.smithi057.stdout:8/820: creat d4/db/dd/d3a/d94/f12a x:0 0 0 2024-04-25T22:42:17.881 INFO:tasks.workunit.client.0.smithi057.stdout:8/821: fsync d4/d5/d17/f109 0 2024-04-25T22:42:17.881 INFO:tasks.workunit.client.0.smithi057.stdout:6/937: write d2/d19/d49/db4/fb5 [649242,96522] 0 2024-04-25T22:42:17.881 INFO:tasks.workunit.client.0.smithi057.stdout:1/837: creat d7/d65/d95/d10b/d45/dd8/f119 x:0 0 0 2024-04-25T22:42:17.882 INFO:tasks.workunit.client.0.smithi057.stdout:2/937: dread d1f/d34/d50/f131 [0,4194304] 0 2024-04-25T22:42:17.882 INFO:tasks.workunit.client.0.smithi057.stdout:8/822: mknod d4/d5/d2f/dc3/c12b 0 2024-04-25T22:42:17.883 INFO:tasks.workunit.client.0.smithi057.stdout:1/838: creat d7/dd/d16/d18/d31/d8f/f11a x:0 0 0 2024-04-25T22:42:17.884 INFO:tasks.workunit.client.0.smithi057.stdout:7/788: getdents d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/dd7 0 2024-04-25T22:42:17.884 INFO:tasks.workunit.client.0.smithi057.stdout:2/938: mkdir d1f/d36/d54/dec/dfa/d13b 0 2024-04-25T22:42:17.884 INFO:tasks.workunit.client.0.smithi057.stdout:1/839: creat d7/ddd/f11b x:0 0 0 2024-04-25T22:42:17.885 INFO:tasks.workunit.client.0.smithi057.stdout:8/823: getdents d4/d5/d2f 0 2024-04-25T22:42:17.885 INFO:tasks.workunit.client.0.smithi057.stdout:2/939: symlink d1f/d21/d26/d63/d7f/dff/l13c 0 2024-04-25T22:42:17.885 INFO:tasks.workunit.client.0.smithi057.stdout:7/789: mknod d6/d28/d4e/d30/d46/c100 0 2024-04-25T22:42:17.886 INFO:tasks.workunit.client.0.smithi057.stdout:3/821: dwrite d0/d4/d7/d46/d30/d99/fbc [0,4194304] 0 2024-04-25T22:42:17.886 INFO:tasks.workunit.client.0.smithi057.stdout:8/824: creat d4/db/dd/f12c x:0 0 0 2024-04-25T22:42:17.887 INFO:tasks.workunit.client.0.smithi057.stdout:8/825: fsync d4/db/f10f 0 2024-04-25T22:42:17.889 INFO:tasks.workunit.client.0.smithi057.stdout:7/790: getdents d6/d28/d4e/d30/d60/d8d/d96 0 2024-04-25T22:42:17.891 INFO:tasks.workunit.client.0.smithi057.stdout:7/791: rename d6/d28/d4e/d30/d46/d73/de4 to d6/d28/d4e/d30/d60/d6f/d9c/dc4/dd6/d101 0 2024-04-25T22:42:17.891 INFO:tasks.workunit.client.0.smithi057.stdout:6/938: dwrite d2/d19/d26/d63/f66 [4194304,4194304] 0 2024-04-25T22:42:17.892 INFO:tasks.workunit.client.0.smithi057.stdout:0/817: sync 2024-04-25T22:42:17.892 INFO:tasks.workunit.client.0.smithi057.stdout:5/958: sync 2024-04-25T22:42:17.892 INFO:tasks.workunit.client.0.smithi057.stdout:4/885: sync 2024-04-25T22:42:17.893 INFO:tasks.workunit.client.0.smithi057.stdout:4/886: chown d14/da9/c3f 589238 1 2024-04-25T22:42:17.893 INFO:tasks.workunit.client.0.smithi057.stdout:0/818: creat d0/d3/d4d/d87/f11c x:0 0 0 2024-04-25T22:42:17.894 INFO:tasks.workunit.client.0.smithi057.stdout:5/959: getdents d2/d47/ded/d10d 0 2024-04-25T22:42:17.894 INFO:tasks.workunit.client.0.smithi057.stdout:3/822: dread d0/d4/d7b/d7c/f9d [0,4194304] 0 2024-04-25T22:42:17.895 INFO:tasks.workunit.client.0.smithi057.stdout:0/819: symlink d0/de5/l11d 0 2024-04-25T22:42:17.895 INFO:tasks.workunit.client.0.smithi057.stdout:4/887: write d14/d2f/d4c/d5b/dd8/dbf/d85/fb6 [104187,91203] 0 2024-04-25T22:42:17.895 INFO:tasks.workunit.client.0.smithi057.stdout:5/960: write d2/d1c/d46/f66 [648320,122543] 0 2024-04-25T22:42:17.896 INFO:tasks.workunit.client.0.smithi057.stdout:4/888: stat d14/d2f/f66 0 2024-04-25T22:42:17.896 INFO:tasks.workunit.client.0.smithi057.stdout:0/820: write d0/d3/d4d/f81 [1070796,46255] 0 2024-04-25T22:42:17.896 INFO:tasks.workunit.client.0.smithi057.stdout:1/840: write d7/d4e/f9b [4587647,113264] 0 2024-04-25T22:42:17.897 INFO:tasks.workunit.client.0.smithi057.stdout:3/823: symlink d0/d4/d7b/d7c/de8/l11b 0 2024-04-25T22:42:17.897 INFO:tasks.workunit.client.0.smithi057.stdout:4/889: chown d14/d5a/d67/db4/d106/l10e 115165 1 2024-04-25T22:42:17.898 INFO:tasks.workunit.client.0.smithi057.stdout:0/821: mknod d0/d3/d6/d83/c11e 0 2024-04-25T22:42:17.898 INFO:tasks.workunit.client.0.smithi057.stdout:4/890: stat d14/d5a/d67/f71 0 2024-04-25T22:42:17.898 INFO:tasks.workunit.client.0.smithi057.stdout:8/826: write d4/db/fb2 [107918,18998] 0 2024-04-25T22:42:17.899 INFO:tasks.workunit.client.0.smithi057.stdout:7/792: truncate d6/f19 2284866 0 2024-04-25T22:42:17.900 INFO:tasks.workunit.client.0.smithi057.stdout:0/822: truncate d0/d3/dae/ff0 3904401 0 2024-04-25T22:42:17.900 INFO:tasks.workunit.client.0.smithi057.stdout:8/827: mkdir d4/dba/d111/d12d 0 2024-04-25T22:42:17.902 INFO:tasks.workunit.client.0.smithi057.stdout:7/793: creat d6/d28/d4e/d30/d46/d73/dcb/df9/dfd/f102 x:0 0 0 2024-04-25T22:42:17.905 INFO:tasks.workunit.client.0.smithi057.stdout:0/823: write d0/d3/d4d/d87/d102/da3/dec/f99 [6247134,126971] 0 2024-04-25T22:42:17.905 INFO:tasks.workunit.client.0.smithi057.stdout:0/824: sync 2024-04-25T22:42:17.906 INFO:tasks.workunit.client.0.smithi057.stdout:8/828: mknod d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/d120/c12e 0 2024-04-25T22:42:17.908 INFO:tasks.workunit.client.0.smithi057.stdout:2/940: dwrite d1f/d21/d26/d63/d7f/d86/fdf [0,4194304] 0 2024-04-25T22:42:17.908 INFO:tasks.workunit.client.0.smithi057.stdout:1/841: dwrite d7/dd/f14 [4194304,4194304] 0 2024-04-25T22:42:17.908 INFO:tasks.workunit.client.0.smithi057.stdout:3/824: dwrite d0/d4/d4a/f9a [0,4194304] 0 2024-04-25T22:42:17.909 INFO:tasks.workunit.client.0.smithi057.stdout:0/825: chown d0/d3/d6/d83/fc3 2563 1 2024-04-25T22:42:17.910 INFO:tasks.workunit.client.0.smithi057.stdout:7/794: rmdir d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/dd7/dd4/def 0 2024-04-25T22:42:17.910 INFO:tasks.workunit.client.0.smithi057.stdout:4/891: dwrite d14/d47/d62/fdd [0,4194304] 0 2024-04-25T22:42:17.912 INFO:tasks.workunit.client.0.smithi057.stdout:0/826: creat d0/d49/f11f x:0 0 0 2024-04-25T22:42:17.912 INFO:tasks.workunit.client.0.smithi057.stdout:3/825: symlink d0/d4/d7/d26/d89/d97/dc1/dd3/l11c 0 2024-04-25T22:42:17.912 INFO:tasks.workunit.client.0.smithi057.stdout:2/941: write d1f/d21/d33/d10d/f137 [273577,98599] 0 2024-04-25T22:42:17.912 INFO:tasks.workunit.client.0.smithi057.stdout:4/892: dread - d14/d2f/d4c/d5b/daa/ff4 zero size 2024-04-25T22:42:17.912 INFO:tasks.workunit.client.0.smithi057.stdout:7/795: chown d6/d28/d4e/d30/d60/d8d/d96/c62 3 1 2024-04-25T22:42:17.913 INFO:tasks.workunit.client.0.smithi057.stdout:1/842: rename d7/dd/d16/fd6 to d7/d65/d95/d10b/d6b/f11c 0 2024-04-25T22:42:17.913 INFO:tasks.workunit.client.0.smithi057.stdout:3/826: dread - d0/fa1 zero size 2024-04-25T22:42:17.914 INFO:tasks.workunit.client.0.smithi057.stdout:1/843: write d7/dd/d16/f7e [3483080,56760] 0 2024-04-25T22:42:17.914 INFO:tasks.workunit.client.0.smithi057.stdout:2/942: truncate d1f/de7/d4d/d88/faf 381914 0 2024-04-25T22:42:17.914 INFO:tasks.workunit.client.0.smithi057.stdout:3/827: creat d0/d4/d7b/d7c/de8/f11d x:0 0 0 2024-04-25T22:42:17.915 INFO:tasks.workunit.client.0.smithi057.stdout:1/844: rename d7/dd/d16/d24/d61/fa8 to d7/d65/d95/d10b/d6b/f11d 0 2024-04-25T22:42:17.916 INFO:tasks.workunit.client.0.smithi057.stdout:3/828: creat d0/d4/d7/d26/d72/f11e x:0 0 0 2024-04-25T22:42:17.916 INFO:tasks.workunit.client.0.smithi057.stdout:1/845: sync 2024-04-25T22:42:17.916 INFO:tasks.workunit.client.0.smithi057.stdout:3/829: fsync d0/d4/d34/d3c/d53/d10e/f10f 0 2024-04-25T22:42:17.917 INFO:tasks.workunit.client.0.smithi057.stdout:1/846: write d7/d65/d95/d10b/d45/ff5 [18040,24818] 0 2024-04-25T22:42:17.918 INFO:tasks.workunit.client.0.smithi057.stdout:1/847: readlink d7/dd/d16/d24/la9 0 2024-04-25T22:42:17.920 INFO:tasks.workunit.client.0.smithi057.stdout:0/827: dwrite d0/d3/d4d/d87/f11c [0,4194304] 0 2024-04-25T22:42:17.921 INFO:tasks.workunit.client.0.smithi057.stdout:0/828: dread - d0/d3/d6/d14/dd1/ff8 zero size 2024-04-25T22:42:17.922 INFO:tasks.workunit.client.0.smithi057.stdout:3/830: read d0/d4/d7/d46/d30/d7a/d91/fb2 [433915,12675] 0 2024-04-25T22:42:17.922 INFO:tasks.workunit.client.0.smithi057.stdout:0/829: rename d0/d3/d6/l101 to d0/d3/d6/d14/d39/de8/l120 0 2024-04-25T22:42:17.922 INFO:tasks.workunit.client.0.smithi057.stdout:2/943: write d1f/d21/f3e [1334180,90686] 0 2024-04-25T22:42:17.924 INFO:tasks.workunit.client.0.smithi057.stdout:3/831: stat d0/d4/fa5 0 2024-04-25T22:42:17.925 INFO:tasks.workunit.client.0.smithi057.stdout:6/939: dread d2/d86/d90/d106/dda/ff9 [0,4194304] 0 2024-04-25T22:42:17.925 INFO:tasks.workunit.client.0.smithi057.stdout:3/832: chown d0/d4/d7/d22/f55 6553 1 2024-04-25T22:42:17.925 INFO:tasks.workunit.client.0.smithi057.stdout:6/940: write d2/d19/d9b/df3/f29 [2111622,82359] 0 2024-04-25T22:42:17.925 INFO:tasks.workunit.client.0.smithi057.stdout:3/833: write d0/d4/d4a/f111 [128832,8556] 0 2024-04-25T22:42:17.927 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:17.927 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:17.927 INFO:tasks.workunit.client.0.smithi057.stdout:8/829: dread d4/d5/f33 [4194304,4194304] 0 2024-04-25T22:42:17.928 INFO:tasks.workunit.client.0.smithi057.stdout:2/944: creat d1f/de7/d4d/d88/dd9/da1/f13d x:0 0 0 2024-04-25T22:42:17.929 INFO:tasks.workunit.client.0.smithi057.stdout:8/830: rmdir d4/db/dd/d3a/d5c/d76 39 2024-04-25T22:42:17.929 INFO:tasks.workunit.client.0.smithi057.stdout:2/945: creat d1f/d34/d50/df0/f13e x:0 0 0 2024-04-25T22:42:17.931 INFO:tasks.workunit.client.0.smithi057.stdout:2/946: fsync d1f/d36/d54/f8d 0 2024-04-25T22:42:17.932 INFO:tasks.workunit.client.0.smithi057.stdout:0/830: dwrite d0/d3/d3a/d3b/fbb [4194304,4194304] 0 2024-04-25T22:42:17.934 INFO:tasks.workunit.client.0.smithi057.stdout:3/834: dwrite d0/d4/d7/d46/f8a [0,4194304] 0 2024-04-25T22:42:17.936 INFO:tasks.workunit.client.0.smithi057.stdout:6/941: dwrite d2/d19/d50/d1a/f4e [0,4194304] 0 2024-04-25T22:42:17.936 INFO:tasks.workunit.client.0.smithi057.stdout:9/812: dread d3/f66 [0,4194304] 0 2024-04-25T22:42:17.936 INFO:tasks.workunit.client.0.smithi057.stdout:0/831: rename d0/de5 to d0/d3/d3a/d121 0 2024-04-25T22:42:17.936 INFO:tasks.workunit.client.0.smithi057.stdout:3/835: mkdir d0/d6b/db6/d11f 0 2024-04-25T22:42:17.937 INFO:tasks.workunit.client.0.smithi057.stdout:6/942: chown d2/d19/d9b/df3/c72 128588910 1 2024-04-25T22:42:17.937 INFO:tasks.workunit.client.0.smithi057.stdout:9/813: unlink d3/d34/d42/d28/f72 0 2024-04-25T22:42:17.937 INFO:tasks.workunit.client.0.smithi057.stdout:0/832: mknod d0/d3/dae/c122 0 2024-04-25T22:42:17.937 INFO:tasks.workunit.client.0.smithi057.stdout:6/943: stat d2/d19/d9b/df3/d31 0 2024-04-25T22:42:17.937 INFO:tasks.workunit.client.0.smithi057.stdout:9/814: rmdir d3/d34/d42/d5e/d83 39 2024-04-25T22:42:17.938 INFO:tasks.workunit.client.0.smithi057.stdout:3/836: creat d0/d4/d7b/d8f/f120 x:0 0 0 2024-04-25T22:42:17.938 INFO:tasks.workunit.client.0.smithi057.stdout:6/944: fsync d2/d19/d50/d1a/f55 0 2024-04-25T22:42:17.940 INFO:tasks.workunit.client.0.smithi057.stdout:9/815: rename d3/d34/d42/d28/d62/d67/d6e/l8b to d3/d34/d42/d28/d2d/d7a/l101 0 2024-04-25T22:42:17.940 INFO:tasks.workunit.client.0.smithi057.stdout:8/831: read d4/d5/d17/d19/d35/d83/d92/fa8 [4450987,123378] 0 2024-04-25T22:42:17.944 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:17.940+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:17.944 INFO:tasks.workunit.client.0.smithi057.stdout:8/832: unlink d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/dc8/c124 0 2024-04-25T22:42:17.945 INFO:tasks.workunit.client.0.smithi057.stdout:3/837: dwrite d0/d4/d34/d3c/fb4 [0,4194304] 0 2024-04-25T22:42:17.948 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:17.949 INFO:tasks.workunit.client.0.smithi057.stdout:8/833: creat d4/d5/d17/d19/d35/d83/d92/d5b/d8c/f12f x:0 0 0 2024-04-25T22:42:17.949 INFO:tasks.workunit.client.0.smithi057.stdout:8/834: creat d4/dba/d10b/d10c/f130 x:0 0 0 2024-04-25T22:42:17.950 INFO:tasks.workunit.client.0.smithi057.stdout:3/838: truncate d0/d4/d7/d26/d89/d97/dc1/dd3/fed 590254 0 2024-04-25T22:42:17.950 INFO:tasks.workunit.client.0.smithi057.stdout:6/945: dwrite d2/d19/d26/fce [0,4194304] 0 2024-04-25T22:42:17.950 INFO:tasks.workunit.client.0.smithi057.stdout:9/816: dwrite d3/d34/d42/d28/d62/d67/d6e/f7d [0,4194304] 0 2024-04-25T22:42:17.952 INFO:tasks.workunit.client.0.smithi057.stdout:8/835: mkdir d4/db/dd/d3a/d5c/d76/d131 0 2024-04-25T22:42:17.954 INFO:tasks.workunit.client.0.smithi057.stdout:6/946: creat d2/d19/d9b/df3/d31/d83/dba/d11c/f13c x:0 0 0 2024-04-25T22:42:17.955 INFO:tasks.workunit.client.0.smithi057.stdout:8/836: rmdir d4/db/d12/dc0 39 2024-04-25T22:42:17.956 INFO:tasks.workunit.client.0.smithi057.stdout:6/947: write d2/f40 [453839,64574] 0 2024-04-25T22:42:17.956 INFO:tasks.workunit.client.0.smithi057.stdout:8/837: stat d4/db/fb2 0 2024-04-25T22:42:17.958 INFO:tasks.workunit.client.0.smithi057.stdout:9/817: dwrite d3/ff [0,4194304] 0 2024-04-25T22:42:17.959 INFO:tasks.workunit.client.0.smithi057.stdout:3/839: dwrite d0/d4/d7b/ff4 [0,4194304] 0 2024-04-25T22:42:17.959 INFO:tasks.workunit.client.0.smithi057.stdout:7/796: dread d6/f9b [0,4194304] 0 2024-04-25T22:42:17.959 INFO:tasks.workunit.client.0.smithi057.stdout:0/833: read d0/f2b [863774,91355] 0 2024-04-25T22:42:17.959 INFO:tasks.workunit.client.0.smithi057.stdout:6/948: chown d2/d19/d9b/df3/d31/d83/dba/d11c/f13c 4 1 2024-04-25T22:42:17.960 INFO:tasks.workunit.client.0.smithi057.stdout:4/893: dread d14/d47/d5e/f8e [0,4194304] 0 2024-04-25T22:42:17.960 INFO:tasks.workunit.client.0.smithi057.stdout:6/949: read d2/d19/d20/d61/f89 [7419784,36487] 0 2024-04-25T22:42:17.961 INFO:tasks.workunit.client.0.smithi057.stdout:8/838: fsync d4/d5/d17/d19/fdf 0 2024-04-25T22:42:17.962 INFO:tasks.workunit.client.0.smithi057.stdout:1/848: dread d7/dd/d26/f35 [0,4194304] 0 2024-04-25T22:42:17.963 INFO:tasks.workunit.client.0.smithi057.stdout:5/961: dread d2/d1c/d46/f70 [0,4194304] 0 2024-04-25T22:42:17.963 INFO:tasks.workunit.client.0.smithi057.stdout:4/894: chown d14/da9/fd5 269752294 1 2024-04-25T22:42:17.963 INFO:tasks.workunit.client.0.smithi057.stdout:5/962: chown d2/d2c/f5c 1284773 1 2024-04-25T22:42:17.964 INFO:tasks.workunit.client.0.smithi057.stdout:1/849: chown d7/dd/d16/d24/d63/fca 5068 1 2024-04-25T22:42:17.964 INFO:tasks.workunit.client.0.smithi057.stdout:4/895: fsync d14/d47/d5e/d5f/f114 0 2024-04-25T22:42:17.965 INFO:tasks.workunit.client.0.smithi057.stdout:3/840: mknod d0/d4/d7/d26/d110/c121 0 2024-04-25T22:42:17.965 INFO:tasks.workunit.client.0.smithi057.stdout:5/963: creat d2/d91/f12e x:0 0 0 2024-04-25T22:42:17.965 INFO:tasks.workunit.client.0.smithi057.stdout:9/818: link d3/d34/d42/d28/d2d/d7a/fbb d3/d34/d42/d28/d2d/dc8/f102 0 2024-04-25T22:42:17.965 INFO:tasks.workunit.client.0.smithi057.stdout:4/896: fdatasync d14/d5a/fbb 0 2024-04-25T22:42:17.965 INFO:tasks.workunit.client.0.smithi057.stdout:5/964: sync 2024-04-25T22:42:17.966 INFO:tasks.workunit.client.0.smithi057.stdout:7/797: dread d6/d28/d4e/d30/f56 [0,4194304] 0 2024-04-25T22:42:17.966 INFO:tasks.workunit.client.0.smithi057.stdout:2/947: read d1f/d21/d105/f119 [2747235,97113] 0 2024-04-25T22:42:17.966 INFO:tasks.workunit.client.0.smithi057.stdout:1/850: mkdir d7/d65/d11e 0 2024-04-25T22:42:17.966 INFO:tasks.workunit.client.0.smithi057.stdout:0/834: creat d0/d3/d3a/f123 x:0 0 0 2024-04-25T22:42:17.966 INFO:tasks.workunit.client.0.smithi057.stdout:7/798: write d6/d28/d4e/d30/d60/d6f/f94 [1440582,58793] 0 2024-04-25T22:42:17.967 INFO:tasks.workunit.client.0.smithi057.stdout:9/819: write d3/d34/d42/ffd [2151587,39192] 0 2024-04-25T22:42:17.968 INFO:tasks.workunit.client.0.smithi057.stdout:1/851: mknod d7/dd/d16/d24/d63/dc7/db0/c11f 0 2024-04-25T22:42:17.968 INFO:tasks.workunit.client.0.smithi057.stdout:2/948: read d1f/de7/f9b [4207723,10932] 0 2024-04-25T22:42:17.969 INFO:tasks.workunit.client.0.smithi057.stdout:2/949: write d1f/d36/d54/dc0/fd5 [274127,7179] 0 2024-04-25T22:42:17.971 INFO:tasks.workunit.client.0.smithi057.stdout:3/841: dwrite d0/d4/d7/d46/d30/d7a/d91/fe0 [0,4194304] 0 2024-04-25T22:42:17.972 INFO:tasks.workunit.client.0.smithi057.stdout:5/965: dwrite d2/d1c/d24/d3d/d77/fc8 [0,4194304] 0 2024-04-25T22:42:17.972 INFO:tasks.workunit.client.0.smithi057.stdout:3/842: fsync d0/d4/fa5 0 2024-04-25T22:42:17.973 INFO:tasks.workunit.client.0.smithi057.stdout:3/843: chown d0/d4/d7b/d7c/la3 96822198 1 2024-04-25T22:42:17.974 INFO:tasks.workunit.client.0.smithi057.stdout:1/852: dread d7/dd/d26/f73 [0,4194304] 0 2024-04-25T22:42:17.975 INFO:tasks.workunit.client.0.smithi057.stdout:3/844: rename d0/d4/d34/d3c/d53/d7f/fde to d0/d4/d7b/d8f/f122 0 2024-04-25T22:42:17.976 INFO:tasks.workunit.client.0.smithi057.stdout:6/950: read d2/d19/d50/ff [892463,48856] 0 2024-04-25T22:42:17.976 INFO:tasks.workunit.client.0.smithi057.stdout:2/950: dwrite d1f/d21/d26/d63/fa4 [0,4194304] 0 2024-04-25T22:42:17.976 INFO:tasks.workunit.client.0.smithi057.stdout:1/853: getdents d7/dd/d16/d24 0 2024-04-25T22:42:17.977 INFO:tasks.workunit.client.0.smithi057.stdout:4/897: dread d14/d2f/f10c [0,4194304] 0 2024-04-25T22:42:17.977 INFO:tasks.workunit.client.0.smithi057.stdout:3/845: creat d0/d4/d7/d46/d30/d7a/f123 x:0 0 0 2024-04-25T22:42:17.977 INFO:tasks.workunit.client.0.smithi057.stdout:6/951: read - d2/d19/d20/d114/f136 zero size 2024-04-25T22:42:17.978 INFO:tasks.workunit.client.0.smithi057.stdout:1/854: dread - d7/d65/d95/d10b/d75/dc4/f108 zero size 2024-04-25T22:42:17.978 INFO:tasks.workunit.client.0.smithi057.stdout:2/951: link d1f/d21/d96/fef d1f/d36/d54/f13f 0 2024-04-25T22:42:17.979 INFO:tasks.workunit.client.0.smithi057.stdout:1/855: rmdir d7/d65/d95/d10b/de1 39 2024-04-25T22:42:17.979 INFO:tasks.workunit.client.0.smithi057.stdout:2/952: rename d1f/d21/d33/d10d to d1f/d21/d26/d63/d7f/dff/d140 0 2024-04-25T22:42:17.979 INFO:tasks.workunit.client.0.smithi057.stdout:1/856: rmdir d7/dd/d16/d24/d63/ddc 39 2024-04-25T22:42:17.980 INFO:tasks.workunit.client.0.smithi057.stdout:1/857: rename d7/d65/fbd to d7/dd/d26/f120 0 2024-04-25T22:42:17.981 INFO:tasks.workunit.client.0.smithi057.stdout:1/858: chown d7/dd/c2d 2751574 1 2024-04-25T22:42:17.981 INFO:tasks.workunit.client.0.smithi057.stdout:2/953: link d1f/de7/d4d/d88/dd9/dd6/fd8 d1f/d21/d26/d63/d7f/d86/f141 0 2024-04-25T22:42:17.981 INFO:tasks.workunit.client.0.smithi057.stdout:1/859: sync 2024-04-25T22:42:17.982 INFO:tasks.workunit.client.0.smithi057.stdout:2/954: unlink d1f/d21/f78 0 2024-04-25T22:42:17.982 INFO:tasks.workunit.client.0.smithi057.stdout:2/955: sync 2024-04-25T22:42:17.982 INFO:tasks.workunit.client.0.smithi057.stdout:1/860: write d7/d65/d95/d10b/d6b/f11c [1476025,60309] 0 2024-04-25T22:42:17.982 INFO:tasks.workunit.client.0.smithi057.stdout:2/956: dread - d1f/d21/d33/daa/fe5 zero size 2024-04-25T22:42:17.983 INFO:tasks.workunit.client.0.smithi057.stdout:2/957: fdatasync d1f/d36/d54/f7a 0 2024-04-25T22:42:17.983 INFO:tasks.workunit.client.0.smithi057.stdout:2/958: stat d1f/d21/d105 0 2024-04-25T22:42:17.983 INFO:tasks.workunit.client.0.smithi057.stdout:7/799: read d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/f80 [127510,75882] 0 2024-04-25T22:42:17.984 INFO:tasks.workunit.client.0.smithi057.stdout:1/861: getdents d7/dd/d16/d18/d31 0 2024-04-25T22:42:17.984 INFO:tasks.workunit.client.0.smithi057.stdout:2/959: write f1d [4768831,47134] 0 2024-04-25T22:42:17.985 INFO:tasks.workunit.client.0.smithi057.stdout:1/862: write d7/dd/d26/f114 [808574,44765] 0 2024-04-25T22:42:17.985 INFO:tasks.workunit.client.0.smithi057.stdout:8/839: truncate d4/f49 450163 0 2024-04-25T22:42:17.985 INFO:tasks.workunit.client.0.smithi057.stdout:7/800: write d6/d28/d4e/d30/d60/d8d/d96/d59/d84/fe1 [2990356,99812] 0 2024-04-25T22:42:17.985 INFO:tasks.workunit.client.0.smithi057.stdout:0/835: truncate d0/d3/fc 386888 0 2024-04-25T22:42:17.986 INFO:tasks.workunit.client.0.smithi057.stdout:9/820: truncate d3/f29 1217774 0 2024-04-25T22:42:17.987 INFO:tasks.workunit.client.0.smithi057.stdout:8/840: creat d4/dba/f132 x:0 0 0 2024-04-25T22:42:17.987 INFO:tasks.workunit.client.0.smithi057.stdout:1/863: mkdir d7/dd/d16/d24/d63/d121 0 2024-04-25T22:42:17.987 INFO:tasks.workunit.client.0.smithi057.stdout:7/801: chown d6/d28/d4e/l38 2745215 1 2024-04-25T22:42:17.988 INFO:tasks.workunit.client.0.smithi057.stdout:8/841: chown d4/db/d72/f7d 856 1 2024-04-25T22:42:17.988 INFO:tasks.workunit.client.0.smithi057.stdout:1/864: unlink d7/d65/d95/d10b/d6b/f7b 0 2024-04-25T22:42:17.989 INFO:tasks.workunit.client.0.smithi057.stdout:7/802: dread - d6/d28/d4e/d30/d46/d73/dcb/df9/dfd/f102 zero size 2024-04-25T22:42:17.990 INFO:tasks.workunit.client.0.smithi057.stdout:1/865: readlink d7/dd/l80 0 2024-04-25T22:42:17.990 INFO:tasks.workunit.client.0.smithi057.stdout:8/842: write d4/d5/d17/fdd [142671,79766] 0 2024-04-25T22:42:17.990 INFO:tasks.workunit.client.0.smithi057.stdout:7/803: readlink d6/d28/l2b 0 2024-04-25T22:42:17.991 INFO:tasks.workunit.client.0.smithi057.stdout:5/966: dwrite d2/d104/f12c [0,4194304] 0 2024-04-25T22:42:17.991 INFO:tasks.workunit.client.0.smithi057.stdout:1/866: fdatasync d7/dd/d26/f8c 0 2024-04-25T22:42:17.991 INFO:tasks.workunit.client.0.smithi057.stdout:8/843: dread - d4/d5/d21/db0/fd4 zero size 2024-04-25T22:42:17.992 INFO:tasks.workunit.client.0.smithi057.stdout:5/967: link d2/d1c/d24/d3d/d50/d83/f9f d2/d1c/dfd/f12f 0 2024-04-25T22:42:17.994 INFO:tasks.workunit.client.0.smithi057.stdout:5/968: creat d2/d1c/d24/d3d/da7/db2/f130 x:0 0 0 2024-04-25T22:42:17.995 INFO:tasks.workunit.client.0.smithi057.stdout:0/836: dwrite d0/d3/d4d/d87/d102/fe0 [0,4194304] 0 2024-04-25T22:42:17.995 INFO:tasks.workunit.client.0.smithi057.stdout:4/898: read d14/d5a/fe9 [287959,49602] 0 2024-04-25T22:42:17.996 INFO:tasks.workunit.client.0.smithi057.stdout:0/837: dread - d0/d49/d6d/f8b zero size 2024-04-25T22:42:17.996 INFO:tasks.workunit.client.0.smithi057.stdout:4/899: write d14/da9/db5/fc1 [1102862,22397] 0 2024-04-25T22:42:17.996 INFO:tasks.workunit.client.0.smithi057.stdout:5/969: getdents d2/d2c 0 2024-04-25T22:42:17.997 INFO:tasks.workunit.client.0.smithi057.stdout:5/970: stat d2/d47/f8c 0 2024-04-25T22:42:17.998 INFO:tasks.workunit.client.0.smithi057.stdout:0/838: read - d0/d49/d97/ff3 zero size 2024-04-25T22:42:17.999 INFO:tasks.workunit.client.0.smithi057.stdout:0/839: rmdir d0/d49/d6d/dea/dfb 39 2024-04-25T22:42:17.999 INFO:tasks.workunit.client.0.smithi057.stdout:5/971: link d2/d6/c7c d2/d47/ded/c131 0 2024-04-25T22:42:17.999 INFO:tasks.workunit.client.0.smithi057.stdout:1/867: dwrite d7/d65/d95/d10b/d45/f94 [0,4194304] 0 2024-04-25T22:42:18.000 INFO:tasks.workunit.client.0.smithi057.stdout:0/840: chown d0/d3/d6/d14/dd1/la2 15847600 1 2024-04-25T22:42:18.000 INFO:tasks.workunit.client.0.smithi057.stdout:1/868: read - d7/d65/d95/f111 zero size 2024-04-25T22:42:18.001 INFO:tasks.workunit.client.0.smithi057.stdout:0/841: creat d0/d3/d4d/d87/d91/f124 x:0 0 0 2024-04-25T22:42:18.002 INFO:tasks.workunit.client.0.smithi057.stdout:1/869: fsync d7/dd/d16/d24/d63/dc7/db0/fb6 0 2024-04-25T22:42:18.002 INFO:tasks.workunit.client.0.smithi057.stdout:0/842: mknod d0/d3/d4d/d87/d91/c125 0 2024-04-25T22:42:18.003 INFO:tasks.workunit.client.0.smithi057.stdout:0/843: write d0/d3/d6/d14/d39/fe2 [298241,5041] 0 2024-04-25T22:42:18.003 INFO:tasks.workunit.client.0.smithi057.stdout:6/952: dread d2/d59/ff7 [0,4194304] 0 2024-04-25T22:42:18.003 INFO:tasks.workunit.client.0.smithi057.stdout:0/844: chown d0/d3/d6/d14/dd1/ff8 929 1 2024-04-25T22:42:18.004 INFO:tasks.workunit.client.0.smithi057.stdout:1/870: creat d7/dd/d16/d18/d31/f122 x:0 0 0 2024-04-25T22:42:18.004 INFO:tasks.workunit.client.0.smithi057.stdout:0/845: unlink d0/d3/d4d/d87/d102/da3/dec/dc8/cd2 0 2024-04-25T22:42:18.005 INFO:tasks.workunit.client.0.smithi057.stdout:0/846: mknod d0/d5/deb/c126 0 2024-04-25T22:42:18.005 INFO:tasks.workunit.client.0.smithi057.stdout:1/871: dread - d7/d65/d6a/f118 zero size 2024-04-25T22:42:18.006 INFO:tasks.workunit.client.0.smithi057.stdout:1/872: mkdir d7/dd/d16/d24/d63/dc7/d123 0 2024-04-25T22:42:18.006 INFO:tasks.workunit.client.0.smithi057.stdout:6/953: read d2/d19/d9b/df3/d31/f5f [127064,33774] 0 2024-04-25T22:42:18.007 INFO:tasks.workunit.client.0.smithi057.stdout:6/954: creat d2/d19/d9b/f13d x:0 0 0 2024-04-25T22:42:18.008 INFO:tasks.workunit.client.0.smithi057.stdout:3/846: write d0/d4/d7/d26/f43 [4486931,21693] 0 2024-04-25T22:42:18.009 INFO:tasks.workunit.client.0.smithi057.stdout:9/821: write d3/d34/d42/d28/d2d/d7a/fbb [814477,5389] 0 2024-04-25T22:42:18.009 INFO:tasks.workunit.client.0.smithi057.stdout:7/804: write d6/d28/d4e/d30/f56 [1788955,19924] 0 2024-04-25T22:42:18.009 INFO:tasks.workunit.client.0.smithi057.stdout:8/844: truncate d4/db/dd/f18 1511006 0 2024-04-25T22:42:18.010 INFO:tasks.workunit.client.0.smithi057.stdout:9/822: stat d3/f64 0 2024-04-25T22:42:18.010 INFO:tasks.workunit.client.0.smithi057.stdout:3/847: symlink d0/d4/d4a/l124 0 2024-04-25T22:42:18.011 INFO:tasks.workunit.client.0.smithi057.stdout:3/848: sync 2024-04-25T22:42:18.011 INFO:tasks.workunit.client.0.smithi057.stdout:4/900: write d14/f61 [1354820,103326] 0 2024-04-25T22:42:18.012 INFO:tasks.workunit.client.0.smithi057.stdout:2/960: dread d1f/d21/f37 [0,4194304] 0 2024-04-25T22:42:18.012 INFO:tasks.workunit.client.0.smithi057.stdout:7/805: write d6/f27 [72694,20116] 0 2024-04-25T22:42:18.013 INFO:tasks.workunit.client.0.smithi057.stdout:3/849: truncate d0/d11/f23 5069799 0 2024-04-25T22:42:18.014 INFO:tasks.workunit.client.0.smithi057.stdout:0/847: write d0/d49/f6b [232290,58750] 0 2024-04-25T22:42:18.014 INFO:tasks.workunit.client.0.smithi057.stdout:4/901: rename d14/d47/l4f to d14/d5a/d67/l118 0 2024-04-25T22:42:18.014 INFO:tasks.workunit.client.0.smithi057.stdout:7/806: symlink d6/d28/d4e/d30/l103 0 2024-04-25T22:42:18.015 INFO:tasks.workunit.client.0.smithi057.stdout:3/850: symlink d0/d6b/l125 0 2024-04-25T22:42:18.015 INFO:tasks.workunit.client.0.smithi057.stdout:2/961: rename d1f/d21/f3e to d1f/d36/d54/dc0/f142 0 2024-04-25T22:42:18.016 INFO:tasks.workunit.client.0.smithi057.stdout:1/873: dwrite d7/dd/d16/d18/f39 [0,4194304] 0 2024-04-25T22:42:18.017 INFO:tasks.workunit.client.0.smithi057.stdout:1/874: rmdir d7 39 2024-04-25T22:42:18.017 INFO:tasks.workunit.client.0.smithi057.stdout:7/807: creat d6/daa/dda/f104 x:0 0 0 2024-04-25T22:42:18.018 INFO:tasks.workunit.client.0.smithi057.stdout:7/808: readlink d6/l17 0 2024-04-25T22:42:18.018 INFO:tasks.workunit.client.0.smithi057.stdout:0/848: unlink d0/d3/d4d/d87/d91/f94 0 2024-04-25T22:42:18.019 INFO:tasks.workunit.client.0.smithi057.stdout:8/845: write d4/d5/d17/d19/d35/d83/d92/da6/fbb [410669,111367] 0 2024-04-25T22:42:18.019 INFO:tasks.workunit.client.0.smithi057.stdout:1/875: fdatasync d7/dd/f101 0 2024-04-25T22:42:18.020 INFO:tasks.workunit.client.0.smithi057.stdout:6/955: dwrite d2/d19/d50/d1a/f55 [0,4194304] 0 2024-04-25T22:42:18.021 INFO:tasks.workunit.client.0.smithi057.stdout:4/902: rmdir d14/d5a/d67/db4/d112 0 2024-04-25T22:42:18.021 INFO:tasks.workunit.client.0.smithi057.stdout:4/903: dread - d14/d2f/d4c/ff0 zero size 2024-04-25T22:42:18.022 INFO:tasks.workunit.client.0.smithi057.stdout:9/823: dwrite d3/d34/f5b [0,4194304] 0 2024-04-25T22:42:18.023 INFO:tasks.workunit.client.0.smithi057.stdout:9/824: fsync d3/d34/d42/d28/f9a 0 2024-04-25T22:42:18.024 INFO:tasks.workunit.client.0.smithi057.stdout:6/956: mkdir d2/d86/d90/d13e 0 2024-04-25T22:42:18.024 INFO:tasks.workunit.client.0.smithi057.stdout:0/849: rename d0/d3/d6/d83/fc3 to d0/d49/d97/f127 0 2024-04-25T22:42:18.024 INFO:tasks.workunit.client.0.smithi057.stdout:8/846: symlink d4/d5/d17/l133 0 2024-04-25T22:42:18.025 INFO:tasks.workunit.client.0.smithi057.stdout:0/850: rmdir d0/d49/d6d 39 2024-04-25T22:42:18.026 INFO:tasks.workunit.client.0.smithi057.stdout:9/825: chown d3/d34/f50 68848432 1 2024-04-25T22:42:18.026 INFO:tasks.workunit.client.0.smithi057.stdout:2/962: dwrite d1f/d21/d26/d63/d7f/dff/d140/f137 [0,4194304] 0 2024-04-25T22:42:18.027 INFO:tasks.workunit.client.0.smithi057.stdout:4/904: chown d14/d2f/d4c/d5b/dc3/cc4 63585 1 2024-04-25T22:42:18.027 INFO:tasks.workunit.client.0.smithi057.stdout:3/851: creat d0/d4/d4a/dab/d108/f126 x:0 0 0 2024-04-25T22:42:18.027 INFO:tasks.workunit.client.0.smithi057.stdout:6/957: fsync d2/d19/d20/f6a 0 2024-04-25T22:42:18.027 INFO:tasks.workunit.client.0.smithi057.stdout:2/963: rmdir d1f/d36/d54 39 2024-04-25T22:42:18.031 INFO:tasks.workunit.client.0.smithi057.stdout:7/809: fsync d6/d28/d4e/d30/d60/d8d/d96/d51/fa8 0 2024-04-25T22:42:18.032 INFO:tasks.workunit.client.0.smithi057.stdout:2/964: chown d1f/d21/l24 86191 1 2024-04-25T22:42:18.032 INFO:tasks.workunit.client.0.smithi057.stdout:4/905: write d14/da2/fe4 [4030983,83748] 0 2024-04-25T22:42:18.032 INFO:tasks.workunit.client.0.smithi057.stdout:8/847: write d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/fde [3897432,95525] 0 2024-04-25T22:42:18.033 INFO:tasks.workunit.client.0.smithi057.stdout:4/906: sync 2024-04-25T22:42:18.033 INFO:tasks.workunit.client.0.smithi057.stdout:6/958: creat d2/d19/d50/d1a/f13f x:0 0 0 2024-04-25T22:42:18.033 INFO:tasks.workunit.client.0.smithi057.stdout:0/851: read - d0/d3/d6/d14/d39/de8/f106 zero size 2024-04-25T22:42:18.033 INFO:tasks.workunit.client.0.smithi057.stdout:5/972: dread d2/d1c/f63 [0,4194304] 0 2024-04-25T22:42:18.034 INFO:tasks.workunit.client.0.smithi057.stdout:6/959: fdatasync d2/f4 0 2024-04-25T22:42:18.034 INFO:tasks.workunit.client.0.smithi057.stdout:9/826: mkdir d3/d34/d42/d5e/d83/def/d103 0 2024-04-25T22:42:18.034 INFO:tasks.workunit.client.0.smithi057.stdout:0/852: stat d0/d3/fd4 0 2024-04-25T22:42:18.035 INFO:tasks.workunit.client.0.smithi057.stdout:7/810: fdatasync d6/d28/d4e/d30/d60/fb5 0 2024-04-25T22:42:18.035 INFO:tasks.workunit.client.0.smithi057.stdout:1/876: dwrite d7/dd/d90/dbf/fc2 [0,4194304] 0 2024-04-25T22:42:18.035 INFO:tasks.workunit.client.0.smithi057.stdout:2/965: mknod d1f/d21/d26/d63/d7f/d86/c143 0 2024-04-25T22:42:18.035 INFO:tasks.workunit.client.0.smithi057.stdout:4/907: dread - d14/d47/d5e/d5f/f113 zero size 2024-04-25T22:42:18.037 INFO:tasks.workunit.client.0.smithi057.stdout:7/811: fsync d6/d28/d4e/d30/d60/d6f/d9c/dc4/dd6/d101/fed 0 2024-04-25T22:42:18.037 INFO:tasks.workunit.client.0.smithi057.stdout:5/973: symlink d2/d1c/d46/dd0/l132 0 2024-04-25T22:42:18.038 INFO:tasks.workunit.client.0.smithi057.stdout:5/974: sync 2024-04-25T22:42:18.038 INFO:tasks.workunit.client.0.smithi057.stdout:2/966: creat d1f/d21/df6/f144 x:0 0 0 2024-04-25T22:42:18.038 INFO:tasks.workunit.client.0.smithi057.stdout:9/827: readlink d3/d34/d42/d28/d2d/l48 0 2024-04-25T22:42:18.038 INFO:tasks.workunit.client.0.smithi057.stdout:8/848: symlink d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/l134 0 2024-04-25T22:42:18.038 INFO:tasks.workunit.client.0.smithi057.stdout:4/908: mkdir d14/d47/d5e/d119 0 2024-04-25T22:42:18.039 INFO:tasks.workunit.client.0.smithi057.stdout:1/877: rmdir d7/d65/d95/d10b/de1 39 2024-04-25T22:42:18.039 INFO:tasks.workunit.client.0.smithi057.stdout:6/960: read d2/f32 [4108811,83074] 0 2024-04-25T22:42:18.039 INFO:tasks.workunit.client.0.smithi057.stdout:2/967: fdatasync d1f/d21/d33/daa/fed 0 2024-04-25T22:42:18.039 INFO:tasks.workunit.client.0.smithi057.stdout:7/812: mkdir d6/d28/d4e/d30/d60/d6f/dbf/d105 0 2024-04-25T22:42:18.040 INFO:tasks.workunit.client.0.smithi057.stdout:9/828: dread - d3/d34/d42/d28/dc1/dda/fe0 zero size 2024-04-25T22:42:18.041 INFO:tasks.workunit.client.0.smithi057.stdout:2/968: chown d1f/d21/d26/d63/d7f/ff5 5152730 1 2024-04-25T22:42:18.041 INFO:tasks.workunit.client.0.smithi057.stdout:9/829: chown d3/d34/d42/d5e/cfc 966896530 1 2024-04-25T22:42:18.042 INFO:tasks.workunit.client.0.smithi057.stdout:2/969: fsync f11 0 2024-04-25T22:42:18.043 INFO:tasks.workunit.client.0.smithi057.stdout:4/909: write d14/f30 [1881398,10526] 0 2024-04-25T22:42:18.043 INFO:tasks.workunit.client.0.smithi057.stdout:7/813: mknod d6/c106 0 2024-04-25T22:42:18.043 INFO:tasks.workunit.client.0.smithi057.stdout:6/961: mknod d2/d19/d49/d62/d79/dad/c140 0 2024-04-25T22:42:18.044 INFO:tasks.workunit.client.0.smithi057.stdout:8/849: mkdir d4/db/d12/dc0/d11b/d135 0 2024-04-25T22:42:18.044 INFO:tasks.workunit.client.0.smithi057.stdout:0/853: dwrite d0/d49/d6d/fc9 [0,4194304] 0 2024-04-25T22:42:18.045 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:18.040+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:18.045 INFO:tasks.workunit.client.0.smithi057.stdout:9/830: mkdir d3/d34/d42/d28/d62/d67/d104 0 2024-04-25T22:42:18.045 INFO:tasks.workunit.client.0.smithi057.stdout:4/910: write d14/f61 [1462747,67947] 0 2024-04-25T22:42:18.049 INFO:tasks.workunit.client.0.smithi057.stdout:0/854: write d0/f66 [6381518,79573] 0 2024-04-25T22:42:18.049 INFO:tasks.workunit.client.0.smithi057.stdout:6/962: mkdir d2/d19/d49/d62/d79/d141 0 2024-04-25T22:42:18.049 INFO:tasks.workunit.client.0.smithi057.stdout:7/814: rmdir d6/d28/d4e/d30/d60/d8d/d96/d51/dad 39 2024-04-25T22:42:18.049 INFO:tasks.workunit.client.0.smithi057.stdout:8/850: mknod d4/d5/c136 0 2024-04-25T22:42:18.049 INFO:tasks.workunit.client.0.smithi057.stdout:2/970: rmdir d1f/d21/d26/d63/d7f/dff/d126 0 2024-04-25T22:42:18.049 INFO:tasks.workunit.client.0.smithi057.stdout:4/911: rename d14/da9/db5/ce6 to d14/d5a/d67/dcc/c11a 0 2024-04-25T22:42:18.049 INFO:tasks.workunit.client.0.smithi057.stdout:9/831: mknod d3/d34/d42/d5e/d83/df1/c105 0 2024-04-25T22:42:18.050 INFO:tasks.workunit.client.0.smithi057.stdout:6/963: creat d2/f142 x:0 0 0 2024-04-25T22:42:18.050 INFO:tasks.workunit.client.0.smithi057.stdout:1/878: dwrite d7/d65/d95/d10b/d75/f9d [0,4194304] 0 2024-04-25T22:42:18.050 INFO:tasks.workunit.client.0.smithi057.stdout:2/971: chown d1f/d36/f7b 4 1 2024-04-25T22:42:18.050 INFO:tasks.workunit.client.0.smithi057.stdout:8/851: fdatasync d4/db/dd/d3a/d94/fd7 0 2024-04-25T22:42:18.051 INFO:tasks.workunit.client.0.smithi057.stdout:0/855: creat d0/d3/d4d/d87/f128 x:0 0 0 2024-04-25T22:42:18.051 INFO:tasks.workunit.client.0.smithi057.stdout:7/815: symlink d6/d28/d4e/d30/d60/d6f/d9c/dc4/dd6/l107 0 2024-04-25T22:42:18.052 INFO:tasks.workunit.client.0.smithi057.stdout:9/832: mknod d3/d34/d42/d5e/d83/def/d103/c106 0 2024-04-25T22:42:18.052 INFO:tasks.workunit.client.0.smithi057.stdout:6/964: fdatasync d2/d19/d20/d61/dbf/dfb/f103 0 2024-04-25T22:42:18.052 INFO:tasks.workunit.client.0.smithi057.stdout:2/972: mkdir d1f/d21/d145 0 2024-04-25T22:42:18.053 INFO:tasks.workunit.client.0.smithi057.stdout:7/816: chown d6/d28/d4e/d30/d60/d8d/d96/d59/f61 209321847 1 2024-04-25T22:42:18.053 INFO:tasks.workunit.client.0.smithi057.stdout:1/879: chown d7/dd/d16/d24/d63/ddc 3 1 2024-04-25T22:42:18.053 INFO:tasks.workunit.client.0.smithi057.stdout:9/833: creat d3/f107 x:0 0 0 2024-04-25T22:42:18.054 INFO:tasks.workunit.client.0.smithi057.stdout:5/975: dwrite d2/f53 [0,4194304] 0 2024-04-25T22:42:18.055 INFO:tasks.workunit.client.0.smithi057.stdout:5/976: stat d2/d1c/d24 0 2024-04-25T22:42:18.055 INFO:tasks.workunit.client.0.smithi057.stdout:6/965: rename d2/d19/d49/d62/d79/d141 to d2/d19/d26/d4f/d95/d143 0 2024-04-25T22:42:18.056 INFO:tasks.workunit.client.0.smithi057.stdout:8/852: creat d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/f137 x:0 0 0 2024-04-25T22:42:18.056 INFO:tasks.workunit.client.0.smithi057.stdout:2/973: link d1f/de7/f81 d1f/d36/d54/f146 0 2024-04-25T22:42:18.057 INFO:tasks.workunit.client.0.smithi057.stdout:1/880: creat d7/dd/d16/d24/d63/dc7/f124 x:0 0 0 2024-04-25T22:42:18.057 INFO:tasks.workunit.client.0.smithi057.stdout:5/977: write d2/d1c/d46/d3a/da8/f109 [1335196,56168] 0 2024-04-25T22:42:18.057 INFO:tasks.workunit.client.0.smithi057.stdout:6/966: mknod d2/d86/d108/c144 0 2024-04-25T22:42:18.058 INFO:tasks.workunit.client.0.smithi057.stdout:8/853: symlink d4/d5/l138 0 2024-04-25T22:42:18.060 INFO:tasks.workunit.client.0.smithi057.stdout:6/967: write d2/d59/fd4 [651268,44126] 0 2024-04-25T22:42:18.061 INFO:tasks.workunit.client.0.smithi057.stdout:0/856: dwrite d0/f2b [4194304,4194304] 0 2024-04-25T22:42:18.062 INFO:tasks.workunit.client.0.smithi057.stdout:4/912: dwrite d14/d3d/dfe/def/f46 [4194304,4194304] 0 2024-04-25T22:42:18.062 INFO:tasks.workunit.client.0.smithi057.stdout:5/978: getdents d2/d91 0 2024-04-25T22:42:18.063 INFO:tasks.workunit.client.0.smithi057.stdout:1/881: truncate d7/d65/d95/d10b/de1/fec 418543 0 2024-04-25T22:42:18.064 INFO:tasks.workunit.client.0.smithi057.stdout:0/857: chown d0/d49/d6d/lf5 14919 1 2024-04-25T22:42:18.064 INFO:tasks.workunit.client.0.smithi057.stdout:9/834: read d3/d34/fac [550150,110433] 0 2024-04-25T22:42:18.065 INFO:tasks.workunit.client.0.smithi057.stdout:4/913: write d14/d5a/fec [615245,104089] 0 2024-04-25T22:42:18.068 INFO:tasks.workunit.client.0.smithi057.stdout:1/882: write d7/dd/d16/f1e [5001831,28789] 0 2024-04-25T22:42:18.068 INFO:tasks.workunit.client.0.smithi057.stdout:5/979: creat d2/d1c/d46/d3a/d6a/f133 x:0 0 0 2024-04-25T22:42:18.068 INFO:tasks.workunit.client.0.smithi057.stdout:0/858: write d0/d5/d53/fa7 [448089,126595] 0 2024-04-25T22:42:18.068 INFO:tasks.workunit.client.0.smithi057.stdout:9/835: symlink d3/d34/d42/l108 0 2024-04-25T22:42:18.068 INFO:tasks.workunit.client.0.smithi057.stdout:8/854: dwrite d4/db/fb2 [0,4194304] 0 2024-04-25T22:42:18.069 INFO:tasks.workunit.client.0.smithi057.stdout:5/980: fdatasync d2/d6/db/f85 0 2024-04-25T22:42:18.069 INFO:tasks.workunit.client.0.smithi057.stdout:9/836: rmdir d3/d34/d42/d5e/d83/def/d103 39 2024-04-25T22:42:18.069 INFO:tasks.workunit.client.0.smithi057.stdout:2/974: dwrite d1f/d21/d26/f139 [0,4194304] 0 2024-04-25T22:42:18.071 INFO:tasks.workunit.client.0.smithi057.stdout:1/883: dread d7/fa4 [0,4194304] 0 2024-04-25T22:42:18.071 INFO:tasks.workunit.client.0.smithi057.stdout:4/914: mknod d14/d2f/d4c/d5b/dd8/c11b 0 2024-04-25T22:42:18.072 INFO:tasks.workunit.client.0.smithi057.stdout:0/859: symlink d0/d3/d6/d83/l129 0 2024-04-25T22:42:18.072 INFO:tasks.workunit.client.0.smithi057.stdout:9/837: symlink d3/d34/d42/d28/d62/dcf/l109 0 2024-04-25T22:42:18.073 INFO:tasks.workunit.client.0.smithi057.stdout:6/968: truncate d2/f14 2463820 0 2024-04-25T22:42:18.073 INFO:tasks.workunit.client.0.smithi057.stdout:5/981: symlink d2/d47/ded/d10d/l134 0 2024-04-25T22:42:18.073 INFO:tasks.workunit.client.0.smithi057.stdout:0/860: dread - d0/d3/d4d/d87/fee zero size 2024-04-25T22:42:18.073 INFO:tasks.workunit.client.0.smithi057.stdout:2/975: creat d1f/d36/d54/dc0/f147 x:0 0 0 2024-04-25T22:42:18.074 INFO:tasks.workunit.client.0.smithi057.stdout:1/884: write d7/dd/d16/d24/d63/f66 [1191631,1261] 0 2024-04-25T22:42:18.074 INFO:tasks.workunit.client.0.smithi057.stdout:2/976: stat d1f/de7/d4d/d88/faf 0 2024-04-25T22:42:18.075 INFO:tasks.workunit.client.0.smithi057.stdout:6/969: rmdir d2/d19/d9b/df3/d31/d83 39 2024-04-25T22:42:18.075 INFO:tasks.workunit.client.0.smithi057.stdout:5/982: write d2/d6/db/f85 [1335648,130838] 0 2024-04-25T22:42:18.076 INFO:tasks.workunit.client.0.smithi057.stdout:1/885: chown d7/d65/d95/d10b/fc0 6356 1 2024-04-25T22:42:18.076 INFO:tasks.workunit.client.0.smithi057.stdout:0/861: dread - d0/d3/d4d/d87/d102/da3/dec/f8a zero size 2024-04-25T22:42:18.076 INFO:tasks.workunit.client.0.smithi057.stdout:2/977: rmdir d1f 39 2024-04-25T22:42:18.076 INFO:tasks.workunit.client.0.smithi057.stdout:8/855: dwrite d4/db/f42 [0,4194304] 0 2024-04-25T22:42:18.076 INFO:tasks.workunit.client.0.smithi057.stdout:5/983: unlink d2/d1c/d46/de4/f10e 0 2024-04-25T22:42:18.077 INFO:tasks.workunit.client.0.smithi057.stdout:6/970: write d2/d86/fac [1388405,74707] 0 2024-04-25T22:42:18.077 INFO:tasks.workunit.client.0.smithi057.stdout:0/862: rmdir d0/d3/d3a/d121 39 2024-04-25T22:42:18.079 INFO:tasks.workunit.client.0.smithi057.stdout:0/863: fdatasync d0/d49/d6d/f8b 0 2024-04-25T22:42:18.079 INFO:tasks.workunit.client.0.smithi057.stdout:8/856: write d4/d5/d17/f73 [633733,33251] 0 2024-04-25T22:42:18.079 INFO:tasks.workunit.client.0.smithi057.stdout:2/978: rename d1f/d36/d54/dec/f100 to d1f/dea/f148 0 2024-04-25T22:42:18.080 INFO:tasks.workunit.client.0.smithi057.stdout:1/886: truncate d7/d65/d6a/d98/dc5/f106 5066608 0 2024-04-25T22:42:18.080 INFO:tasks.workunit.client.0.smithi057.stdout:8/857: dread - d4/d5/d17/f109 zero size 2024-04-25T22:42:18.082 INFO:tasks.workunit.client.0.smithi057.stdout:3/852: dread d0/d4/d7b/f9f [0,4194304] 0 2024-04-25T22:42:18.083 INFO:tasks.workunit.client.0.smithi057.stdout:5/984: rename d2/d47/da5/dd3/l118 to d2/d1c/d24/d3d/deb/df6/l135 0 2024-04-25T22:42:18.084 INFO:tasks.workunit.client.0.smithi057.stdout:0/864: rmdir d0/d3/d3a/d121 39 2024-04-25T22:42:18.084 INFO:tasks.workunit.client.0.smithi057.stdout:8/858: write d4/db/dd/d3a/d94/fd7 [514923,2063] 0 2024-04-25T22:42:18.084 INFO:tasks.workunit.client.0.smithi057.stdout:4/915: dwrite d14/d2f/d4c/d5b/fca [0,4194304] 0 2024-04-25T22:42:18.086 INFO:tasks.workunit.client.0.smithi057.stdout:3/853: chown d0/d4/d7/d46/d30/d7a/fd1 2347 1 2024-04-25T22:42:18.087 INFO:tasks.workunit.client.0.smithi057.stdout:5/985: chown d2/d1c/d24/d3d/d50/fd7 4 1 2024-04-25T22:42:18.090 INFO:tasks.workunit.client.0.smithi057.stdout:0/865: creat d0/d3/d4d/d87/da0/f12a x:0 0 0 2024-04-25T22:42:18.090 INFO:tasks.workunit.client.0.smithi057.stdout:2/979: rename d1f/de7/d4d/d88/dd9/da1/f122 to d1f/de7/d4d/d88/dd9/f149 0 2024-04-25T22:42:18.090 INFO:tasks.workunit.client.0.smithi057.stdout:4/916: unlink d14/d47/d5e/d5f/f8d 0 2024-04-25T22:42:18.090 INFO:tasks.workunit.client.0.smithi057.stdout:6/971: dwrite d2/d19/d49/f54 [0,4194304] 0 2024-04-25T22:42:18.090 INFO:tasks.workunit.client.0.smithi057.stdout:4/917: unlink d14/fc2 0 2024-04-25T22:42:18.091 INFO:tasks.workunit.client.0.smithi057.stdout:5/986: mkdir d2/d47/da5/dd3/d136 0 2024-04-25T22:42:18.091 INFO:tasks.workunit.client.0.smithi057.stdout:3/854: creat d0/d4/d7/d46/d30/d99/f127 x:0 0 0 2024-04-25T22:42:18.091 INFO:tasks.workunit.client.0.smithi057.stdout:6/972: symlink d2/d19/d50/l145 0 2024-04-25T22:42:18.091 INFO:tasks.workunit.client.0.smithi057.stdout:8/859: rename d4/db/d12/l126 to d4/d5/d17/d19/d35/d83/d92/d5b/d8c/l139 0 2024-04-25T22:42:18.091 INFO:tasks.workunit.client.0.smithi057.stdout:0/866: truncate d0/d3/fcc 272869 0 2024-04-25T22:42:18.091 INFO:tasks.workunit.client.0.smithi057.stdout:1/887: dwrite d7/d65/d95/d10b/d6b/fa7 [0,4194304] 0 2024-04-25T22:42:18.091 INFO:tasks.workunit.client.0.smithi057.stdout:5/987: mkdir d2/d6/d137 0 2024-04-25T22:42:18.091 INFO:tasks.workunit.client.0.smithi057.stdout:4/918: truncate d14/f4e 852978 0 2024-04-25T22:42:18.092 INFO:tasks.workunit.client.0.smithi057.stdout:3/855: mkdir d0/d4/d7/d26/d89/d97/dc1/d128 0 2024-04-25T22:42:18.092 INFO:tasks.workunit.client.0.smithi057.stdout:6/973: truncate d2/d19/d26/d4f/f84 295159 0 2024-04-25T22:42:18.093 INFO:tasks.workunit.client.0.smithi057.stdout:0/867: truncate d0/d3/d3a/d121/f100 50572 0 2024-04-25T22:42:18.093 INFO:tasks.workunit.client.0.smithi057.stdout:3/856: write d0/d4/d7/d46/d30/d7a/f123 [353807,93127] 0 2024-04-25T22:42:18.094 INFO:tasks.workunit.client.0.smithi057.stdout:1/888: mknod d7/dd/d16/d24/d63/ddc/c125 0 2024-04-25T22:42:18.094 INFO:tasks.workunit.client.0.smithi057.stdout:0/868: mknod d0/d3/d6/d83/c12b 0 2024-04-25T22:42:18.094 INFO:tasks.workunit.client.0.smithi057.stdout:6/974: write d2/d19/d49/d62/f70 [460245,71772] 0 2024-04-25T22:42:18.095 INFO:tasks.workunit.client.0.smithi057.stdout:8/860: getdents d4/dba/d111 0 2024-04-25T22:42:18.095 INFO:tasks.workunit.client.0.smithi057.stdout:3/857: chown d0/d4/d34/d3c/d53/d7f/dfe 261837038 1 2024-04-25T22:42:18.097 INFO:tasks.workunit.client.0.smithi057.stdout:4/919: link d14/d3d/dfe/cf9 d14/d47/d5e/c11c 0 2024-04-25T22:42:18.097 INFO:tasks.workunit.client.0.smithi057.stdout:0/869: unlink d0/d3/f109 0 2024-04-25T22:42:18.097 INFO:tasks.workunit.client.0.smithi057.stdout:3/858: symlink d0/d4/d7/d46/df6/l129 0 2024-04-25T22:42:18.097 INFO:tasks.workunit.client.0.smithi057.stdout:8/861: rename d4/db/d72/f95 to d4/db/d12/dc0/d11b/f13a 0 2024-04-25T22:42:18.097 INFO:tasks.workunit.client.0.smithi057.stdout:4/920: creat d14/d2f/f11d x:0 0 0 2024-04-25T22:42:18.097 INFO:tasks.workunit.client.0.smithi057.stdout:3/859: unlink d0/d4/d4a/l5f 0 2024-04-25T22:42:18.099 INFO:tasks.workunit.client.0.smithi057.stdout:8/862: rename d4/db/c24 to d4/db/c13b 0 2024-04-25T22:42:18.100 INFO:tasks.workunit.client.0.smithi057.stdout:5/988: dread d2/d6/f3e [0,4194304] 0 2024-04-25T22:42:18.100 INFO:tasks.workunit.client.0.smithi057.stdout:3/860: link d0/d4/d34/d3c/d53/f54 d0/d4/d7/d46/d30/d99/f12a 0 2024-04-25T22:42:18.100 INFO:tasks.workunit.client.0.smithi057.stdout:8/863: stat d4/d5/d2f/f5f 0 2024-04-25T22:42:18.100 INFO:tasks.workunit.client.0.smithi057.stdout:8/864: sync 2024-04-25T22:42:18.101 INFO:tasks.workunit.client.0.smithi057.stdout:3/861: rename d0/d11/f1c to d0/d6b/db6/f12b 0 2024-04-25T22:42:18.103 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:18.103 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:18.104 INFO:tasks.workunit.client.0.smithi057.stdout:3/862: readlink d0/d4/d7b/d8f/lc4 0 2024-04-25T22:42:18.104 INFO:tasks.workunit.client.0.smithi057.stdout:7/817: dread d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/fbe [0,4194304] 0 2024-04-25T22:42:18.105 INFO:tasks.workunit.client.0.smithi057.stdout:3/863: chown d0/d4/d34/d3c/d53/d7f/lae 64900 1 2024-04-25T22:42:18.105 INFO:tasks.workunit.client.0.smithi057.stdout:8/865: rename d4/db/dd/d3a/d94/f12a to d4/db/dd/d3a/d5c/f13c 0 2024-04-25T22:42:18.105 INFO:tasks.workunit.client.0.smithi057.stdout:7/818: write d6/d28/d4e/d30/fb6 [322665,98076] 0 2024-04-25T22:42:18.105 INFO:tasks.workunit.client.0.smithi057.stdout:2/980: truncate d1f/d34/f57 2653557 0 2024-04-25T22:42:18.108 INFO:tasks.workunit.client.0.smithi057.stdout:4/921: truncate d14/d3d/dfe/def/f8b 3368957 0 2024-04-25T22:42:18.108 INFO:tasks.workunit.client.0.smithi057.stdout:3/864: symlink d0/d4/d7/d22/l12c 0 2024-04-25T22:42:18.108 INFO:tasks.workunit.client.0.smithi057.stdout:8/866: symlink d4/dba/d111/d12d/l13d 0 2024-04-25T22:42:18.108 INFO:tasks.workunit.client.0.smithi057.stdout:3/865: chown d0/d4/d4a/cbe 21269 1 2024-04-25T22:42:18.108 INFO:tasks.workunit.client.0.smithi057.stdout:4/922: mkdir d14/d2f/d4c/d5b/dc3/d11e 0 2024-04-25T22:42:18.109 INFO:tasks.workunit.client.0.smithi057.stdout:7/819: getdents d6/d28 0 2024-04-25T22:42:18.109 INFO:tasks.workunit.client.0.smithi057.stdout:5/989: dread d2/d2c/fab [0,4194304] 0 2024-04-25T22:42:18.109 INFO:tasks.workunit.client.0.smithi057.stdout:9/838: dread d3/f29 [0,4194304] 0 2024-04-25T22:42:18.109 INFO:tasks.workunit.client.0.smithi057.stdout:8/867: symlink d4/d5/dd2/l13e 0 2024-04-25T22:42:18.109 INFO:tasks.workunit.client.0.smithi057.stdout:5/990: stat d2/d2c/f81 0 2024-04-25T22:42:18.109 INFO:tasks.workunit.client.0.smithi057.stdout:4/923: write d14/d2f/f7b [48325,117920] 0 2024-04-25T22:42:18.112 INFO:tasks.workunit.client.0.smithi057.stdout:6/975: dread d2/d19/d49/d62/d79/fd7 [0,4194304] 0 2024-04-25T22:42:18.112 INFO:tasks.workunit.client.0.smithi057.stdout:7/820: creat d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/f108 x:0 0 0 2024-04-25T22:42:18.112 INFO:tasks.workunit.client.0.smithi057.stdout:5/991: write d2/d1c/f63 [5194845,120608] 0 2024-04-25T22:42:18.112 INFO:tasks.workunit.client.0.smithi057.stdout:8/868: chown d4/d5/d17/d19/d35/d83/d92/l6a 25374459 1 2024-04-25T22:42:18.112 INFO:tasks.workunit.client.0.smithi057.stdout:9/839: rename d3/d34/f43 to d3/d34/d42/d5e/da3/f10a 0 2024-04-25T22:42:18.113 INFO:tasks.workunit.client.0.smithi057.stdout:9/840: fdatasync d3/f64 0 2024-04-25T22:42:18.113 INFO:tasks.workunit.client.0.smithi057.stdout:7/821: creat d6/d88/f109 x:0 0 0 2024-04-25T22:42:18.113 INFO:tasks.workunit.client.0.smithi057.stdout:8/869: readlink d4/d5/d17/l1a 0 2024-04-25T22:42:18.113 INFO:tasks.workunit.client.0.smithi057.stdout:5/992: fdatasync d2/d1c/d46/f35 0 2024-04-25T22:42:18.113 INFO:tasks.workunit.client.0.smithi057.stdout:5/993: sync 2024-04-25T22:42:18.113 INFO:tasks.workunit.client.0.smithi057.stdout:9/841: creat d3/d34/d42/d28/d39/d54/d88/f10b x:0 0 0 2024-04-25T22:42:18.115 INFO:tasks.workunit.client.0.smithi057.stdout:5/994: readlink d2/d1c/d46/d3a/da8/lcf 0 2024-04-25T22:42:18.115 INFO:tasks.workunit.client.0.smithi057.stdout:8/870: chown d4/d5/d17/d19/d35/d83/d92/d5b/d8c/l139 15908238 1 2024-04-25T22:42:18.115 INFO:tasks.workunit.client.0.smithi057.stdout:9/842: symlink d3/d34/d42/d28/dc1/l10c 0 2024-04-25T22:42:18.115 INFO:tasks.workunit.client.0.smithi057.stdout:5/995: creat d2/d47/ded/d10d/f138 x:0 0 0 2024-04-25T22:42:18.116 INFO:tasks.workunit.client.0.smithi057.stdout:8/871: stat d4/db/dd/d3a/d94/dcf/l104 0 2024-04-25T22:42:18.117 INFO:tasks.workunit.client.0.smithi057.stdout:6/976: dread d2/f64 [0,4194304] 0 2024-04-25T22:42:18.117 INFO:tasks.workunit.client.0.smithi057.stdout:1/889: dread d7/dd/d16/d24/d63/dc7/fc3 [0,4194304] 0 2024-04-25T22:42:18.117 INFO:tasks.workunit.client.0.smithi057.stdout:9/843: rename d3/d34/d42/l108 to d3/d34/d42/d28/d39/db3/l10d 0 2024-04-25T22:42:18.117 INFO:tasks.workunit.client.0.smithi057.stdout:4/924: dwrite d14/d47/d5e/d5f/f117 [0,4194304] 0 2024-04-25T22:42:18.120 INFO:tasks.workunit.client.0.smithi057.stdout:1/890: rmdir d7/dd/d26 39 2024-04-25T22:42:18.120 INFO:tasks.workunit.client.0.smithi057.stdout:3/866: write d0/d4/d7/d22/fd9 [4299886,95647] 0 2024-04-25T22:42:18.120 INFO:tasks.workunit.client.0.smithi057.stdout:4/925: symlink d14/d2f/d4c/d5b/db8/l11f 0 2024-04-25T22:42:18.121 INFO:tasks.workunit.client.0.smithi057.stdout:7/822: getdents d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d 0 2024-04-25T22:42:18.121 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:18.123 INFO:tasks.workunit.client.0.smithi057.stdout:3/867: dread - d0/d4/d7b/d7c/de8/f11d zero size 2024-04-25T22:42:18.125 INFO:tasks.workunit.client.0.smithi057.stdout:7/823: chown d6/d28/d4e/d30/d60/c65 55 1 2024-04-25T22:42:18.125 INFO:tasks.workunit.client.0.smithi057.stdout:1/891: rename d7/d65/d95/d10b/d75/dc4/df8/l10d to d7/d65/d95/d10b/d75/dc4/l126 0 2024-04-25T22:42:18.126 INFO:tasks.workunit.client.0.smithi057.stdout:0/870: dread d0/d3/d4d/d87/d102/da3/dec/f6c [0,4194304] 0 2024-04-25T22:42:18.126 INFO:tasks.workunit.client.0.smithi057.stdout:3/868: rmdir d0/d4/d34/d3c/d53/d7f/dfe 39 2024-04-25T22:42:18.126 INFO:tasks.workunit.client.0.smithi057.stdout:5/996: dwrite d2/d47/da5/f8e [0,4194304] 0 2024-04-25T22:42:18.128 INFO:tasks.workunit.client.0.smithi057.stdout:1/892: dread - d7/dd/d16/d18/d31/fea zero size 2024-04-25T22:42:18.128 INFO:tasks.workunit.client.0.smithi057.stdout:3/869: fdatasync d0/d4/d7/d46/d30/faa 0 2024-04-25T22:42:18.129 INFO:tasks.workunit.client.0.smithi057.stdout:0/871: write d0/d3/d4d/f93 [815067,107499] 0 2024-04-25T22:42:18.129 INFO:tasks.workunit.client.0.smithi057.stdout:7/824: read d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/fbe [3355444,90755] 0 2024-04-25T22:42:18.129 INFO:tasks.workunit.client.0.smithi057.stdout:8/872: dwrite d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/dc8/f90 [0,4194304] 0 2024-04-25T22:42:18.131 INFO:tasks.workunit.client.0.smithi057.stdout:4/926: dread d14/d2f/d4c/d5b/fff [0,4194304] 0 2024-04-25T22:42:18.131 INFO:tasks.workunit.client.0.smithi057.stdout:2/981: dread f0 [0,4194304] 0 2024-04-25T22:42:18.131 INFO:tasks.workunit.client.0.smithi057.stdout:5/997: symlink d2/d1c/d24/d3d/deb/df6/l139 0 2024-04-25T22:42:18.132 INFO:tasks.workunit.client.0.smithi057.stdout:1/893: creat d7/dd/d16/f127 x:0 0 0 2024-04-25T22:42:18.132 INFO:tasks.workunit.client.0.smithi057.stdout:6/977: sync 2024-04-25T22:42:18.132 INFO:tasks.workunit.client.0.smithi057.stdout:5/998: chown d2/d1c/f63 26 1 2024-04-25T22:42:18.132 INFO:tasks.workunit.client.0.smithi057.stdout:7/825: fsync d6/d28/d4e/d30/d60/d8d/d96/d51/f83 0 2024-04-25T22:42:18.132 INFO:tasks.workunit.client.0.smithi057.stdout:0/872: mknod d0/d3/d3a/d121/c12c 0 2024-04-25T22:42:18.132 INFO:tasks.workunit.client.0.smithi057.stdout:8/873: dread - d4/d5/d17/d19/d35/d83/d92/d5b/d8c/f110 zero size 2024-04-25T22:42:18.133 INFO:tasks.workunit.client.0.smithi057.stdout:3/870: truncate d0/d4/d34/d3c/d53/d10e/f10f 815860 0 2024-04-25T22:42:18.133 INFO:tasks.workunit.client.0.smithi057.stdout:2/982: creat d1f/f14a x:0 0 0 2024-04-25T22:42:18.133 INFO:tasks.workunit.client.0.smithi057.stdout:1/894: creat d7/dd/d16/d18/d31/f128 x:0 0 0 2024-04-25T22:42:18.134 INFO:tasks.workunit.client.0.smithi057.stdout:6/978: mknod d2/d19/d20/c146 0 2024-04-25T22:42:18.135 INFO:tasks.workunit.client.0.smithi057.stdout:4/927: rename d14/d47/d5e/d5f/f117 to d14/d5a/d67/dcc/dce/f120 0 2024-04-25T22:42:18.135 INFO:tasks.workunit.client.0.smithi057.stdout:0/873: write d0/d3/d6/d14/dd1/ff8 [724107,107160] 0 2024-04-25T22:42:18.135 INFO:tasks.workunit.client.0.smithi057.stdout:1/895: mkdir d7/dd/d26/d9a/d129 0 2024-04-25T22:42:18.136 INFO:tasks.workunit.client.0.smithi057.stdout:2/983: truncate d1f/d21/d26/d63/d7f/d86/f141 1384314 0 2024-04-25T22:42:18.137 INFO:tasks.workunit.client.0.smithi057.stdout:5/999: link d2/d1c/dfd/c124 d2/d47/da5/dd3/d112/c13a 0 2024-04-25T22:42:18.137 INFO:tasks.workunit.client.0.smithi057.stdout:2/984: mknod d1f/d21/d96/d10b/c14b 0 2024-04-25T22:42:18.138 INFO:tasks.workunit.client.0.smithi057.stdout:8/874: read d4/d5/d17/f73 [297287,46502] 0 2024-04-25T22:42:18.138 INFO:tasks.workunit.client.0.smithi057.stdout:2/985: mknod d1f/de7/db1/c14c 0 2024-04-25T22:42:18.139 INFO:tasks.workunit.client.0.smithi057.stdout:2/986: fdatasync d1f/d21/d26/d63/fa4 0 2024-04-25T22:42:18.139 INFO:tasks.workunit.client.0.smithi057.stdout:6/979: dread d2/d19/d50/d1a/f55 [0,4194304] 0 2024-04-25T22:42:18.140 INFO:tasks.workunit.client.0.smithi057.stdout:9/844: dread d3/d34/d42/d28/d65/f8e [0,4194304] 0 2024-04-25T22:42:18.140 INFO:tasks.workunit.client.0.smithi057.stdout:2/987: dread - d1f/d34/d50/df0/f13e zero size 2024-04-25T22:42:18.140 INFO:tasks.workunit.client.0.smithi057.stdout:6/980: chown d2/d19/d26/d63/fe8 12563 1 2024-04-25T22:42:18.141 INFO:tasks.workunit.client.0.smithi057.stdout:9/845: chown d3/d34/d42/d28/d62/d67/d6e 1318 1 2024-04-25T22:42:18.141 INFO:tasks.workunit.client.0.smithi057.stdout:2/988: chown d1f/d36/d54/dda/fee 0 1 2024-04-25T22:42:18.144 INFO:tasks.workunit.client.0.smithi057.stdout:0/874: dwrite d0/d3/d4d/d87/f11c [0,4194304] 0 2024-04-25T22:42:18.144 INFO:tasks.workunit.client.0.smithi057.stdout:9/846: dread d3/f29 [0,4194304] 0 2024-04-25T22:42:18.145 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:18.144+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:18.146 INFO:tasks.workunit.client.0.smithi057.stdout:2/989: chown d1f/d21/d26/d63/d7f/c9c 9590 1 2024-04-25T22:42:18.147 INFO:tasks.workunit.client.0.smithi057.stdout:0/875: creat d0/d3/d6/d71/f12d x:0 0 0 2024-04-25T22:42:18.148 INFO:tasks.workunit.client.0.smithi057.stdout:8/875: dwrite d4/d5/d2f/f5f [0,4194304] 0 2024-04-25T22:42:18.149 INFO:tasks.workunit.client.0.smithi057.stdout:7/826: dwrite d6/d28/d4e/d30/f9d [0,4194304] 0 2024-04-25T22:42:18.149 INFO:tasks.workunit.client.0.smithi057.stdout:9/847: symlink d3/d34/d42/d28/d39/dbd/l10e 0 2024-04-25T22:42:18.150 INFO:tasks.workunit.client.0.smithi057.stdout:6/981: dwrite d2/d19/d9b/df3/d31/f33 [0,4194304] 0 2024-04-25T22:42:18.151 INFO:tasks.workunit.client.0.smithi057.stdout:8/876: write d4/d5/d17/d19/d35/d83/d92/d5b/f7e [3256374,36557] 0 2024-04-25T22:42:18.151 INFO:tasks.workunit.client.0.smithi057.stdout:7/827: truncate d6/d28/d4e/f8c 1734872 0 2024-04-25T22:42:18.151 INFO:tasks.workunit.client.0.smithi057.stdout:9/848: symlink d3/d34/d42/d28/d2d/d7a/l10f 0 2024-04-25T22:42:18.157 INFO:tasks.workunit.client.0.smithi057.stdout:3/871: dread d0/d4/d7/d22/da0/fa4 [4194304,4194304] 0 2024-04-25T22:42:18.157 INFO:tasks.workunit.client.0.smithi057.stdout:6/982: creat d2/d19/d26/d4f/d95/d143/f147 x:0 0 0 2024-04-25T22:42:18.158 INFO:tasks.workunit.client.0.smithi057.stdout:9/849: fsync d3/d34/d42/d28/d62/d67/d6e/d7c/fdb 0 2024-04-25T22:42:18.158 INFO:tasks.workunit.client.0.smithi057.stdout:0/876: dread d0/d49/d6d/fc9 [0,4194304] 0 2024-04-25T22:42:18.158 INFO:tasks.workunit.client.0.smithi057.stdout:3/872: dread - d0/d4/d7/d26/d89/fef zero size 2024-04-25T22:42:18.158 INFO:tasks.workunit.client.0.smithi057.stdout:0/877: dread - d0/d3/d4d/d87/da0/faf zero size 2024-04-25T22:42:18.158 INFO:tasks.workunit.client.0.smithi057.stdout:8/877: rmdir d4/d5/d17/d19/d35/d83/d92/d5b 39 2024-04-25T22:42:18.158 INFO:tasks.workunit.client.0.smithi057.stdout:2/990: write d1f/d34/f57 [1445655,114891] 0 2024-04-25T22:42:18.158 INFO:tasks.workunit.client.0.smithi057.stdout:7/828: mkdir d6/d28/d4e/d30/d60/d8d/d96/d51/d10a 0 2024-04-25T22:42:18.159 INFO:tasks.workunit.client.0.smithi057.stdout:3/873: chown d0/d4/d7/f2f 12 1 2024-04-25T22:42:18.159 INFO:tasks.workunit.client.0.smithi057.stdout:0/878: read - d0/d3/d6/d71/f12d zero size 2024-04-25T22:42:18.159 INFO:tasks.workunit.client.0.smithi057.stdout:8/878: read - d4/d5/d21/f116 zero size 2024-04-25T22:42:18.159 INFO:tasks.workunit.client.0.smithi057.stdout:7/829: dread - d6/d28/d4e/f3c zero size 2024-04-25T22:42:18.159 INFO:tasks.workunit.client.0.smithi057.stdout:1/896: sync 2024-04-25T22:42:18.159 INFO:tasks.workunit.client.0.smithi057.stdout:2/991: symlink d1f/d21/d105/l14d 0 2024-04-25T22:42:18.160 INFO:tasks.workunit.client.0.smithi057.stdout:3/874: mknod d0/d4/d7b/d7c/c12d 0 2024-04-25T22:42:18.160 INFO:tasks.workunit.client.0.smithi057.stdout:0/879: mkdir d0/d3/d3a/d121/d12e 0 2024-04-25T22:42:18.160 INFO:tasks.workunit.client.0.smithi057.stdout:2/992: creat d1f/d21/d26/d63/d7f/f14e x:0 0 0 2024-04-25T22:42:18.160 INFO:tasks.workunit.client.0.smithi057.stdout:8/879: chown d4/d5/d17/d19/d35/ce2 70449114 1 2024-04-25T22:42:18.164 INFO:tasks.workunit.client.0.smithi057.stdout:0/880: chown d0/d3/d6/f45 399 1 2024-04-25T22:42:18.164 INFO:tasks.workunit.client.0.smithi057.stdout:2/993: mkdir d1f/d21/d145/d14f 0 2024-04-25T22:42:18.164 INFO:tasks.workunit.client.0.smithi057.stdout:3/875: creat d0/d4/d7/d26/d89/d97/dc1/d128/f12e x:0 0 0 2024-04-25T22:42:18.164 INFO:tasks.workunit.client.0.smithi057.stdout:6/983: truncate d2/d19/d50/d1a/f46 123672 0 2024-04-25T22:42:18.164 INFO:tasks.workunit.client.0.smithi057.stdout:8/880: creat d4/d5/d17/d19/d35/d83/d92/da6/f13f x:0 0 0 2024-04-25T22:42:18.164 INFO:tasks.workunit.client.0.smithi057.stdout:0/881: mkdir d0/d3/d3a/d3b/d12f 0 2024-04-25T22:42:18.164 INFO:tasks.workunit.client.0.smithi057.stdout:9/850: dwrite d3/d34/d42/d5e/f76 [4194304,4194304] 0 2024-04-25T22:42:18.164 INFO:tasks.workunit.client.0.smithi057.stdout:7/830: creat d6/d28/d4e/d30/d46/d73/dcb/f10b x:0 0 0 2024-04-25T22:42:18.165 INFO:tasks.workunit.client.0.smithi057.stdout:3/876: chown d0/d4/d34/ce4 1167642 1 2024-04-25T22:42:18.165 INFO:tasks.workunit.client.0.smithi057.stdout:8/881: creat d4/d5/dd2/f140 x:0 0 0 2024-04-25T22:42:18.165 INFO:tasks.workunit.client.0.smithi057.stdout:2/994: truncate d1f/d21/d26/d63/d7f/d86/f141 1537375 0 2024-04-25T22:42:18.165 INFO:tasks.workunit.client.0.smithi057.stdout:3/877: symlink d0/d4/d7/d26/d110/l12f 0 2024-04-25T22:42:18.165 INFO:tasks.workunit.client.0.smithi057.stdout:7/831: write d6/d28/d4e/d30/fb6 [135062,96738] 0 2024-04-25T22:42:18.165 INFO:tasks.workunit.client.0.smithi057.stdout:6/984: rename d2/d19/d9b/df3/d31/d83/daa/d10f/c12a to d2/d19/d9b/df3/d31/d83/dba/c148 0 2024-04-25T22:42:18.165 INFO:tasks.workunit.client.0.smithi057.stdout:2/995: creat d1f/d36/d54/dc0/f150 x:0 0 0 2024-04-25T22:42:18.165 INFO:tasks.workunit.client.0.smithi057.stdout:3/878: write d0/d4/d7/d26/d72/fe9 [528984,27250] 0 2024-04-25T22:42:18.165 INFO:tasks.workunit.client.0.smithi057.stdout:8/882: rename d4/d5/d17/d19/d35/d83/c11f to d4/deb/c141 0 2024-04-25T22:42:18.165 INFO:tasks.workunit.client.0.smithi057.stdout:6/985: chown d2/d19/d49/d62/f102 50662964 1 2024-04-25T22:42:18.166 INFO:tasks.workunit.client.0.smithi057.stdout:6/986: fdatasync d2/d19/d26/fce 0 2024-04-25T22:42:18.166 INFO:tasks.workunit.client.0.smithi057.stdout:3/879: chown d0/d4/d34/d3c/d53/db1/dce/cf2 10 1 2024-04-25T22:42:18.167 INFO:tasks.workunit.client.0.smithi057.stdout:7/832: rename d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/lbc to d6/d28/d4e/d30/d60/d6f/d9c/dc4/l10c 0 2024-04-25T22:42:18.167 INFO:tasks.workunit.client.0.smithi057.stdout:2/996: mkdir d1f/de7/d4d/d88/dd9/da1/ddc/d151 0 2024-04-25T22:42:18.167 INFO:tasks.workunit.client.0.smithi057.stdout:8/883: symlink d4/d5/d17/d19/d35/d83/l142 0 2024-04-25T22:42:18.167 INFO:tasks.workunit.client.0.smithi057.stdout:7/833: mknod d6/d28/c10d 0 2024-04-25T22:42:18.167 INFO:tasks.workunit.client.0.smithi057.stdout:2/997: mkdir d1f/d21/d26/d152 0 2024-04-25T22:42:18.167 INFO:tasks.workunit.client.0.smithi057.stdout:6/987: rmdir d2/d19/d9b/df3/d31/d83/dba 39 2024-04-25T22:42:18.167 INFO:tasks.workunit.client.0.smithi057.stdout:8/884: symlink d4/dba/d111/d12d/l143 0 2024-04-25T22:42:18.167 INFO:tasks.workunit.client.0.smithi057.stdout:8/885: chown d4/db/dd/d3a/d5c/f13c 3547172 1 2024-04-25T22:42:18.168 INFO:tasks.workunit.client.0.smithi057.stdout:6/988: getdents d2/d19/d49/d62/d79/dad 0 2024-04-25T22:42:18.170 INFO:tasks.workunit.client.0.smithi057.stdout:1/897: read d7/dd/d26/f114 [462891,87523] 0 2024-04-25T22:42:18.170 INFO:tasks.workunit.client.0.smithi057.stdout:3/880: read d0/d4/d34/f47 [98636,52353] 0 2024-04-25T22:42:18.171 INFO:tasks.workunit.client.0.smithi057.stdout:3/881: chown d0/d4/d7/d26/d72/lc8 765345 1 2024-04-25T22:42:18.171 INFO:tasks.workunit.client.0.smithi057.stdout:2/998: dwrite d1f/de7/f3b [0,4194304] 0 2024-04-25T22:42:18.172 INFO:tasks.workunit.client.0.smithi057.stdout:3/882: write d0/d4/fa5 [475095,110572] 0 2024-04-25T22:42:18.173 INFO:tasks.workunit.client.0.smithi057.stdout:3/883: creat d0/d4/d4a/dab/d108/f130 x:0 0 0 2024-04-25T22:42:18.173 INFO:tasks.workunit.client.0.smithi057.stdout:2/999: mkdir d1f/de7/d4d/d88/dd9/d153 0 2024-04-25T22:42:18.175 INFO:tasks.workunit.client.0.smithi057.stdout:3/884: creat d0/d4/d34/d3c/d53/db1/f131 x:0 0 0 2024-04-25T22:42:18.177 INFO:tasks.workunit.client.0.smithi057.stdout:1/898: dwrite d7/dd/d90/dbf/fc2 [0,4194304] 0 2024-04-25T22:42:18.179 INFO:tasks.workunit.client.0.smithi057.stdout:1/899: stat d7/d65/d95/d10b/d6b/fa7 0 2024-04-25T22:42:18.179 INFO:tasks.workunit.client.0.smithi057.stdout:7/834: mknod d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/c10e 0 2024-04-25T22:42:18.181 INFO:tasks.workunit.client.0.smithi057.stdout:9/851: dwrite d3/f29 [0,4194304] 0 2024-04-25T22:42:18.182 INFO:tasks.workunit.client.0.smithi057.stdout:9/852: stat d3/d34/fd1 0 2024-04-25T22:42:18.184 INFO:tasks.workunit.client.0.smithi057.stdout:9/853: mkdir d3/d34/d42/d5e/da3/d110 0 2024-04-25T22:42:18.184 INFO:tasks.workunit.client.0.smithi057.stdout:6/989: dwrite d2/f14 [0,4194304] 0 2024-04-25T22:42:18.185 INFO:tasks.workunit.client.0.smithi057.stdout:3/885: read d0/d4/d7/d26/d72/fe9 [490006,73282] 0 2024-04-25T22:42:18.186 INFO:tasks.workunit.client.0.smithi057.stdout:1/900: dwrite d7/dd/d16/f127 [0,4194304] 0 2024-04-25T22:42:18.191 INFO:tasks.workunit.client.0.smithi057.stdout:4/928: dread d14/da9/f7d [0,4194304] 0 2024-04-25T22:42:18.191 INFO:tasks.workunit.client.0.smithi057.stdout:3/886: dwrite d0/d4/d7/d22/da0/fa4 [4194304,4194304] 0 2024-04-25T22:42:18.193 INFO:tasks.workunit.client.0.smithi057.stdout:3/887: creat d0/d4/d7/d46/d30/d99/f132 x:0 0 0 2024-04-25T22:42:18.193 INFO:tasks.workunit.client.0.smithi057.stdout:6/990: dread d2/d19/d9b/df3/f82 [0,4194304] 0 2024-04-25T22:42:18.193 INFO:tasks.workunit.client.0.smithi057.stdout:6/991: chown d2/d19/d9b/df3/ld8 2 1 2024-04-25T22:42:18.194 INFO:tasks.workunit.client.0.smithi057.stdout:3/888: creat d0/d4/d7/d26/f133 x:0 0 0 2024-04-25T22:42:18.194 INFO:tasks.workunit.client.0.smithi057.stdout:6/992: fsync d2/f40 0 2024-04-25T22:42:18.194 INFO:tasks.workunit.client.0.smithi057.stdout:4/929: mknod d14/d2f/d4c/d5b/dd8/c121 0 2024-04-25T22:42:18.195 INFO:tasks.workunit.client.0.smithi057.stdout:4/930: readlink d14/l15 0 2024-04-25T22:42:18.195 INFO:tasks.workunit.client.0.smithi057.stdout:3/889: truncate d0/d4/d7/d26/f56 995812 0 2024-04-25T22:42:18.195 INFO:tasks.workunit.client.0.smithi057.stdout:6/993: creat d2/d122/f149 x:0 0 0 2024-04-25T22:42:18.195 INFO:tasks.workunit.client.0.smithi057.stdout:4/931: rmdir d14/d3d 39 2024-04-25T22:42:18.198 INFO:tasks.workunit.client.0.smithi057.stdout:7/835: truncate d6/d28/f42 827312 0 2024-04-25T22:42:18.199 INFO:tasks.workunit.client.0.smithi057.stdout:6/994: mkdir d2/d19/d50/d91/d14a 0 2024-04-25T22:42:18.200 INFO:tasks.workunit.client.0.smithi057.stdout:3/890: read d0/d4/d4a/f67 [601815,117271] 0 2024-04-25T22:42:18.200 INFO:tasks.workunit.client.0.smithi057.stdout:7/836: symlink d6/d28/d4e/d30/d46/d73/dcb/df9/l10f 0 2024-04-25T22:42:18.202 INFO:tasks.workunit.client.0.smithi057.stdout:4/932: dwrite d14/d47/d62/fdd [0,4194304] 0 2024-04-25T22:42:18.203 INFO:tasks.workunit.client.0.smithi057.stdout:6/995: dread d2/d59/fd4 [0,4194304] 0 2024-04-25T22:42:18.205 INFO:tasks.workunit.client.0.smithi057.stdout:4/933: rename d14/l2a to d14/d5a/d67/l122 0 2024-04-25T22:42:18.206 INFO:tasks.workunit.client.0.smithi057.stdout:9/854: dread d3/dd8/de3/fe9 [0,4194304] 0 2024-04-25T22:42:18.206 INFO:tasks.workunit.client.0.smithi057.stdout:6/996: symlink d2/d19/d9b/df3/d31/d83/dba/dbe/dcf/l14b 0 2024-04-25T22:42:18.207 INFO:tasks.workunit.client.0.smithi057.stdout:3/891: dwrite d0/f95 [0,4194304] 0 2024-04-25T22:42:18.208 INFO:tasks.workunit.client.0.smithi057.stdout:9/855: dread - d3/d34/d42/d28/d39/db3/fdc zero size 2024-04-25T22:42:18.208 INFO:tasks.workunit.client.0.smithi057.stdout:7/837: dwrite d6/d28/f5b [0,4194304] 0 2024-04-25T22:42:18.208 INFO:tasks.workunit.client.0.smithi057.stdout:3/892: write d0/d11/fdd [70683,130966] 0 2024-04-25T22:42:18.209 INFO:tasks.workunit.client.0.smithi057.stdout:6/997: link d2/d19/cc4 d2/d19/d9b/df3/d31/d83/dba/dbe/c14c 0 2024-04-25T22:42:18.211 INFO:tasks.workunit.client.0.smithi057.stdout:6/998: symlink d2/d19/d50/d91/l14d 0 2024-04-25T22:42:18.212 INFO:tasks.workunit.client.0.smithi057.stdout:6/999: mkdir d2/d19/d26/d4f/d95/d143/d14e 0 2024-04-25T22:42:18.212 INFO:tasks.workunit.client.0.smithi057.stdout:4/934: dwrite d14/d5a/f64 [0,4194304] 0 2024-04-25T22:42:18.215 INFO:tasks.workunit.client.0.smithi057.stdout:4/935: write d14/d3d/f110 [4936704,15956] 0 2024-04-25T22:42:18.216 INFO:tasks.workunit.client.0.smithi057.stdout:4/936: write d14/d47/f59 [3397049,25315] 0 2024-04-25T22:42:18.217 INFO:tasks.workunit.client.0.smithi057.stdout:4/937: creat d14/d2f/d82/f123 x:0 0 0 2024-04-25T22:42:18.217 INFO:tasks.workunit.client.0.smithi057.stdout:4/938: unlink d14/f39 0 2024-04-25T22:42:18.218 INFO:tasks.workunit.client.0.smithi057.stdout:4/939: truncate d14/d2f/f10f 193876 0 2024-04-25T22:42:18.218 INFO:tasks.workunit.client.0.smithi057.stdout:4/940: symlink d14/d3d/l124 0 2024-04-25T22:42:18.219 INFO:tasks.workunit.client.0.smithi057.stdout:4/941: rmdir d14/d47/d5e 39 2024-04-25T22:42:18.220 INFO:tasks.workunit.client.0.smithi057.stdout:4/942: write d14/d2f/f54 [9277220,18233] 0 2024-04-25T22:42:18.220 INFO:tasks.workunit.client.0.smithi057.stdout:4/943: chown d14/d47/d5e/d5f/l79 2673 1 2024-04-25T22:42:18.221 INFO:tasks.workunit.client.0.smithi057.stdout:4/944: chown d14/d2f/d4c/d5b/dd8/dbf/d85/fa1 28621 1 2024-04-25T22:42:18.222 INFO:tasks.workunit.client.0.smithi057.stdout:4/945: mknod d14/d2f/d4c/d5b/dc3/d11e/c125 0 2024-04-25T22:42:18.223 INFO:tasks.workunit.client.0.smithi057.stdout:0/882: sync 2024-04-25T22:42:18.223 INFO:tasks.workunit.client.0.smithi057.stdout:0/883: readlink d0/d3/d4d/d87/d102/da3/dec/l7c 0 2024-04-25T22:42:18.224 INFO:tasks.workunit.client.0.smithi057.stdout:7/838: truncate d6/d28/d4e/d30/d60/d8d/d96/f7f 2207581 0 2024-04-25T22:42:18.225 INFO:tasks.workunit.client.0.smithi057.stdout:9/856: dwrite d3/d34/d42/d28/d39/d54/fcb [0,4194304] 0 2024-04-25T22:42:18.226 INFO:tasks.workunit.client.0.smithi057.stdout:0/884: getdents d0/d3/d6/d71 0 2024-04-25T22:42:18.227 INFO:tasks.workunit.client.0.smithi057.stdout:9/857: unlink d3/d34/d42/d28/f8a 0 2024-04-25T22:42:18.227 INFO:tasks.workunit.client.0.smithi057.stdout:7/839: creat d6/d28/d4e/d30/d46/d73/dcb/df9/dfd/f110 x:0 0 0 2024-04-25T22:42:18.229 INFO:tasks.workunit.client.0.smithi057.stdout:4/946: dwrite d14/d2f/d4c/d5b/fff [8388608,4194304] 0 2024-04-25T22:42:18.230 INFO:tasks.workunit.client.0.smithi057.stdout:4/947: creat d14/d5a/d67/d109/f126 x:0 0 0 2024-04-25T22:42:18.230 INFO:tasks.workunit.client.0.smithi057.stdout:4/948: fsync d14/d5a/d67/fcf 0 2024-04-25T22:42:18.236 INFO:tasks.workunit.client.0.smithi057.stdout:8/886: dread d4/db/d72/f7d [0,4194304] 0 2024-04-25T22:42:18.236 INFO:tasks.workunit.client.0.smithi057.stdout:4/949: dread d14/d2f/f10f [0,4194304] 0 2024-04-25T22:42:18.237 INFO:tasks.workunit.client.0.smithi057.stdout:8/887: creat d4/d5/d2f/dc2/f144 x:0 0 0 2024-04-25T22:42:18.237 INFO:tasks.workunit.client.0.smithi057.stdout:4/950: chown d14/da9/f98 17575 1 2024-04-25T22:42:18.237 INFO:tasks.workunit.client.0.smithi057.stdout:8/888: rmdir d4/d5/dd2 39 2024-04-25T22:42:18.238 INFO:tasks.workunit.client.0.smithi057.stdout:4/951: creat d14/d2f/d4c/d5b/dd8/dbf/d85/f127 x:0 0 0 2024-04-25T22:42:18.239 INFO:tasks.workunit.client.0.smithi057.stdout:4/952: read d14/d47/f9e [1753145,39758] 0 2024-04-25T22:42:18.240 INFO:tasks.workunit.client.0.smithi057.stdout:4/953: write d14/d2f/fdc [147309,25699] 0 2024-04-25T22:42:18.241 INFO:tasks.workunit.client.0.smithi057.stdout:4/954: chown d14/da9/f7d 47 1 2024-04-25T22:42:18.241 INFO:tasks.workunit.client.0.smithi057.stdout:4/955: mknod d14/d3d/c128 0 2024-04-25T22:42:18.242 INFO:tasks.workunit.client.0.smithi057.stdout:4/956: write d14/d5a/fa6 [73,27956] 0 2024-04-25T22:42:18.245 INFO:tasks.workunit.client.0.smithi057.stdout:8/889: dread d4/f4f [0,4194304] 0 2024-04-25T22:42:18.246 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:18.244+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:18.247 INFO:tasks.workunit.client.0.smithi057.stdout:8/890: write d4/d5/d17/d19/d35/d83/d92/d5b/d8c/f12f [1035194,50860] 0 2024-04-25T22:42:18.248 INFO:tasks.workunit.client.0.smithi057.stdout:8/891: chown d4/d5/d21/f88 18 1 2024-04-25T22:42:18.248 INFO:tasks.workunit.client.0.smithi057.stdout:4/957: dwrite d14/f16 [0,4194304] 0 2024-04-25T22:42:18.248 INFO:tasks.workunit.client.0.smithi057.stdout:8/892: write d4/db/fb2 [2959355,118128] 0 2024-04-25T22:42:18.250 INFO:tasks.workunit.client.0.smithi057.stdout:4/958: link d14/d47/cb2 d14/d2f/d4c/d5b/dd8/c129 0 2024-04-25T22:42:18.251 INFO:tasks.workunit.client.0.smithi057.stdout:4/959: mknod d14/da9/c12a 0 2024-04-25T22:42:18.252 INFO:tasks.workunit.client.0.smithi057.stdout:4/960: mknod d14/d3d/c12b 0 2024-04-25T22:42:18.252 INFO:tasks.workunit.client.0.smithi057.stdout:7/840: dread d6/d28/d4e/f31 [0,4194304] 0 2024-04-25T22:42:18.253 INFO:tasks.workunit.client.0.smithi057.stdout:4/961: rmdir d14/d47/d5e/d119 0 2024-04-25T22:42:18.255 INFO:tasks.workunit.client.0.smithi057.stdout:7/841: rename d6/d28/d4e/d30/f5a to d6/d28/d4e/f111 0 2024-04-25T22:42:18.255 INFO:tasks.workunit.client.0.smithi057.stdout:8/893: dwrite d4/d5/d21/db0/fd4 [0,4194304] 0 2024-04-25T22:42:18.255 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:42:18.256 INFO:tasks.workunit.client.0.smithi057.stdout:8/894: mknod d4/deb/c145 0 2024-04-25T22:42:18.257 INFO:tasks.workunit.client.0.smithi057.stdout:7/842: rename d6/d28/d4e/d30/d60/ffc to d6/d28/d4e/d30/d60/d8d/d96/d51/f112 0 2024-04-25T22:42:18.257 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:18.257 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:18.260 INFO:tasks.workunit.client.0.smithi057.stdout:9/858: dread d3/d34/fac [0,4194304] 0 2024-04-25T22:42:18.262 INFO:tasks.workunit.client.0.smithi057.stdout:8/895: dwrite d4/d5/d17/d19/d35/d83/d92/da6/fb5 [0,4194304] 0 2024-04-25T22:42:18.263 INFO:tasks.workunit.client.0.smithi057.stdout:8/896: symlink d4/db/dd/l146 0 2024-04-25T22:42:18.263 INFO:tasks.workunit.client.0.smithi057.stdout:8/897: creat d4/deb/f147 x:0 0 0 2024-04-25T22:42:18.264 INFO:tasks.workunit.client.0.smithi057.stdout:8/898: stat d4/db/dd/d3a/d94/fd7 0 2024-04-25T22:42:18.265 INFO:tasks.workunit.client.0.smithi057.stdout:8/899: write d4/d5/d21/db0/f62 [4966179,96438] 0 2024-04-25T22:42:18.266 INFO:tasks.workunit.client.0.smithi057.stdout:8/900: read - d4/d5/d17/d19/d35/d83/d92/da6/f13f zero size 2024-04-25T22:42:18.267 INFO:tasks.workunit.client.0.smithi057.stdout:9/859: dwrite d3/d34/d42/d28/f68 [0,4194304] 0 2024-04-25T22:42:18.267 INFO:tasks.workunit.client.0.smithi057.stdout:8/901: mknod d4/d5/d21/c148 0 2024-04-25T22:42:18.272 INFO:tasks.workunit.client.0.smithi057.stdout:3/893: sync 2024-04-25T22:42:18.272 INFO:tasks.workunit.client.0.smithi057.stdout:1/901: sync 2024-04-25T22:42:18.272 INFO:tasks.workunit.client.0.smithi057.stdout:0/885: sync 2024-04-25T22:42:18.274 INFO:tasks.workunit.client.0.smithi057.stdout:1/902: write d7/f6f [54005,54966] 0 2024-04-25T22:42:18.275 INFO:tasks.workunit.client.0.smithi057.stdout:0/886: chown d0/f66 0 1 2024-04-25T22:42:18.275 INFO:tasks.workunit.client.0.smithi057.stdout:9/860: dwrite d3/d34/d42/d28/d62/d67/f82 [0,4194304] 0 2024-04-25T22:42:18.276 INFO:tasks.workunit.client.0.smithi057.stdout:8/902: dwrite d4/d5/d17/d19/d35/d83/d92/d5b/fcd [0,4194304] 0 2024-04-25T22:42:18.277 INFO:tasks.workunit.client.0.smithi057.stdout:1/903: write d7/d65/d95/d10b/d45/f72 [2986341,55058] 0 2024-04-25T22:42:18.277 INFO:tasks.workunit.client.0.smithi057.stdout:8/903: dread - d4/db/fb9 zero size 2024-04-25T22:42:18.277 INFO:tasks.workunit.client.0.smithi057.stdout:1/904: unlink d7/d65/f110 0 2024-04-25T22:42:18.279 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:18.279 INFO:tasks.workunit.client.0.smithi057.stdout:1/905: fsync d7/dd/d26/d9a/fcd 0 2024-04-25T22:42:18.283 INFO:tasks.workunit.client.0.smithi057.stdout:9/861: dwrite d3/f24 [4194304,4194304] 0 2024-04-25T22:42:18.284 INFO:tasks.workunit.client.0.smithi057.stdout:9/862: write d3/d34/d42/d28/f6f [1233523,85796] 0 2024-04-25T22:42:18.285 INFO:tasks.workunit.client.0.smithi057.stdout:9/863: mknod d3/d34/d42/d28/c111 0 2024-04-25T22:42:18.287 INFO:tasks.workunit.client.0.smithi057.stdout:3/894: write d0/d4/d4a/f67 [1117863,46233] 0 2024-04-25T22:42:18.287 INFO:tasks.workunit.client.0.smithi057.stdout:1/906: dwrite d7/d65/d6a/d98/dc5/f106 [0,4194304] 0 2024-04-25T22:42:18.287 INFO:tasks.workunit.client.0.smithi057.stdout:3/895: chown d0/d4/d7/d26/d72/fe9 1024520 1 2024-04-25T22:42:18.289 INFO:tasks.workunit.client.0.smithi057.stdout:9/864: creat d3/d34/d42/d28/d62/dcf/df3/f112 x:0 0 0 2024-04-25T22:42:18.289 INFO:tasks.workunit.client.0.smithi057.stdout:3/896: creat d0/d4/d7/d26/d89/f134 x:0 0 0 2024-04-25T22:42:18.289 INFO:tasks.workunit.client.0.smithi057.stdout:1/907: rmdir d7/d65/d95/d10b/d75/dc4/df8 0 2024-04-25T22:42:18.289 INFO:tasks.workunit.client.0.smithi057.stdout:3/897: rmdir d0/d4/d96 39 2024-04-25T22:42:18.290 INFO:tasks.workunit.client.0.smithi057.stdout:1/908: chown d7/d4e/f96 60880678 1 2024-04-25T22:42:18.290 INFO:tasks.workunit.client.0.smithi057.stdout:9/865: mknod d3/d34/d42/d28/d39/d54/d88/c113 0 2024-04-25T22:42:18.290 INFO:tasks.workunit.client.0.smithi057.stdout:3/898: readlink d0/d4/d7/d26/d72/d10a/l115 0 2024-04-25T22:42:18.291 INFO:tasks.workunit.client.0.smithi057.stdout:3/899: fdatasync d0/d4/d34/fd5 0 2024-04-25T22:42:18.291 INFO:tasks.workunit.client.0.smithi057.stdout:9/866: mkdir d3/d98/d114 0 2024-04-25T22:42:18.292 INFO:tasks.workunit.client.0.smithi057.stdout:3/900: creat d0/d4/d34/d3c/d70/dc0/f135 x:0 0 0 2024-04-25T22:42:18.297 INFO:tasks.workunit.client.0.smithi057.stdout:7/843: dread d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/f82 [0,4194304] 0 2024-04-25T22:42:18.298 INFO:tasks.workunit.client.0.smithi057.stdout:9/867: dwrite d3/d34/d42/d5e/f76 [4194304,4194304] 0 2024-04-25T22:42:18.298 INFO:tasks.workunit.client.0.smithi057.stdout:1/909: dwrite d7/d65/d95/d10b/d6b/f11c [0,4194304] 0 2024-04-25T22:42:18.299 INFO:tasks.workunit.client.0.smithi057.stdout:3/901: dwrite d0/d4/d34/f64 [4194304,4194304] 0 2024-04-25T22:42:18.300 INFO:tasks.workunit.client.0.smithi057.stdout:1/910: stat d7/dd/d16/d24/ce 0 2024-04-25T22:42:18.301 INFO:tasks.workunit.client.0.smithi057.stdout:9/868: rename d3/d34/d42/d28/d39/d54/da5 to d3/d34/d42/d28/d2d/d7a/d115 0 2024-04-25T22:42:18.301 INFO:tasks.workunit.client.0.smithi057.stdout:7/844: write d6/fb [2160242,79229] 0 2024-04-25T22:42:18.301 INFO:tasks.workunit.client.0.smithi057.stdout:1/911: creat d7/dd/d16/d18/d31/da2/f12a x:0 0 0 2024-04-25T22:42:18.303 INFO:tasks.workunit.client.0.smithi057.stdout:9/869: rename d3/d34/d42/d5e/da3/ld5 to d3/d34/d42/d5e/d83/l116 0 2024-04-25T22:42:18.303 INFO:tasks.workunit.client.0.smithi057.stdout:1/912: symlink d7/d65/d95/d10b/d75/dc4/l12b 0 2024-04-25T22:42:18.303 INFO:tasks.workunit.client.0.smithi057.stdout:9/870: fdatasync d3/d34/d42/d28/d2d/d7a/fbb 0 2024-04-25T22:42:18.304 INFO:tasks.workunit.client.0.smithi057.stdout:7/845: rename d6/d28/d4e/d30/d60/d6f/d9c/dc4/dd6/lf6 to d6/d28/d4e/d30/d60/d6f/l113 0 2024-04-25T22:42:18.305 INFO:tasks.workunit.client.0.smithi057.stdout:7/846: chown d6/d28/d4e/d30/d60/d8d/d96/d5d 1659139 1 2024-04-25T22:42:18.306 INFO:tasks.workunit.client.0.smithi057.stdout:1/913: truncate d7/dd/d16/d24/f3a 6736921 0 2024-04-25T22:42:18.306 INFO:tasks.workunit.client.0.smithi057.stdout:9/871: fdatasync d3/d34/d42/d28/d39/d54/d88/fb1 0 2024-04-25T22:42:18.306 INFO:tasks.workunit.client.0.smithi057.stdout:4/962: dread d14/da9/f75 [0,4194304] 0 2024-04-25T22:42:18.307 INFO:tasks.workunit.client.0.smithi057.stdout:4/963: dread - d14/d2f/d4c/d5b/dd8/dbf/fee zero size 2024-04-25T22:42:18.307 INFO:tasks.workunit.client.0.smithi057.stdout:9/872: write d3/d34/d42/d28/d39/db3/fae [2249673,47197] 0 2024-04-25T22:42:18.309 INFO:tasks.workunit.client.0.smithi057.stdout:7/847: rename d6/d28/d4e/d30/d60/d8d/d96/d51/c7b to d6/d28/d4e/d30/d60/d8d/d96/d51/c114 0 2024-04-25T22:42:18.309 INFO:tasks.workunit.client.0.smithi057.stdout:9/873: creat d3/d34/d42/d28/d62/f117 x:0 0 0 2024-04-25T22:42:18.312 INFO:tasks.workunit.client.0.smithi057.stdout:1/914: truncate d7/dd/d16/d24/d63/ddc/ffb 1563851 0 2024-04-25T22:42:18.313 INFO:tasks.workunit.client.0.smithi057.stdout:8/904: dread d4/d5/d2f/f41 [0,4194304] 0 2024-04-25T22:42:18.313 INFO:tasks.workunit.client.0.smithi057.stdout:4/964: dwrite d14/d47/d62/f6a [0,4194304] 0 2024-04-25T22:42:18.314 INFO:tasks.workunit.client.0.smithi057.stdout:8/905: fsync d4/d5/d2f/f5f 0 2024-04-25T22:42:18.314 INFO:tasks.workunit.client.0.smithi057.stdout:1/915: chown d7/dd/d16/d18/d31/da2/f12a 56715198 1 2024-04-25T22:42:18.315 INFO:tasks.workunit.client.0.smithi057.stdout:4/965: chown d14/d5a/d67/dcc/l111 439479 1 2024-04-25T22:42:18.315 INFO:tasks.workunit.client.0.smithi057.stdout:3/902: dread d0/d4/d7/d46/d30/d7a/f123 [0,4194304] 0 2024-04-25T22:42:18.315 INFO:tasks.workunit.client.0.smithi057.stdout:7/848: truncate d6/d28/d4e/d30/d60/d8d/d96/d51/f9e 2706415 0 2024-04-25T22:42:18.316 INFO:tasks.workunit.client.0.smithi057.stdout:4/966: mknod d14/d5a/d67/db4/c12c 0 2024-04-25T22:42:18.316 INFO:tasks.workunit.client.0.smithi057.stdout:8/906: creat d4/db/dd/d3a/d5c/f149 x:0 0 0 2024-04-25T22:42:18.317 INFO:tasks.workunit.client.0.smithi057.stdout:8/907: stat d4/f43 0 2024-04-25T22:42:18.317 INFO:tasks.workunit.client.0.smithi057.stdout:9/874: dwrite d3/d34/d42/d28/d62/d67/f94 [0,4194304] 0 2024-04-25T22:42:18.318 INFO:tasks.workunit.client.0.smithi057.stdout:7/849: write d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/dd7/dd4/ffa [732965,26018] 0 2024-04-25T22:42:18.318 INFO:tasks.workunit.client.0.smithi057.stdout:4/967: unlink d14/d47/d5e/f77 0 2024-04-25T22:42:18.318 INFO:tasks.workunit.client.0.smithi057.stdout:8/908: write d4/d5/d21/f11a [1708262,80801] 0 2024-04-25T22:42:18.318 INFO:tasks.workunit.client.0.smithi057.stdout:3/903: rename d0/d4/d4a/dab/d108 to d0/d4/d7/d26/d72/dd0/d136 0 2024-04-25T22:42:18.319 INFO:tasks.workunit.client.0.smithi057.stdout:4/968: stat d14/d2f/le8 0 2024-04-25T22:42:18.319 INFO:tasks.workunit.client.0.smithi057.stdout:4/969: readlink d14/d3d/l124 0 2024-04-25T22:42:18.320 INFO:tasks.workunit.client.0.smithi057.stdout:8/909: symlink d4/db/dd/d3a/d94/dcf/df7/l14a 0 2024-04-25T22:42:18.320 INFO:tasks.workunit.client.0.smithi057.stdout:3/904: mkdir d0/d4/d7/d26/d89/d97/dc1/d128/d137 0 2024-04-25T22:42:18.322 INFO:tasks.workunit.client.0.smithi057.stdout:3/905: write d0/d4/d7/d46/d30/d7a/d91/fe0 [2823918,72044] 0 2024-04-25T22:42:18.322 INFO:tasks.workunit.client.0.smithi057.stdout:8/910: getdents d4/d5/d21/db0 0 2024-04-25T22:42:18.322 INFO:tasks.workunit.client.0.smithi057.stdout:9/875: dread d3/d34/d42/d28/d65/f8e [4194304,4194304] 0 2024-04-25T22:42:18.322 INFO:tasks.workunit.client.0.smithi057.stdout:9/876: fdatasync d3/f29 0 2024-04-25T22:42:18.322 INFO:tasks.workunit.client.0.smithi057.stdout:3/906: dread - d0/d4/d7/d46/d30/d99/f127 zero size 2024-04-25T22:42:18.323 INFO:tasks.workunit.client.0.smithi057.stdout:8/911: unlink d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/fc5 0 2024-04-25T22:42:18.324 INFO:tasks.workunit.client.0.smithi057.stdout:3/907: chown d0/d4/d34/d3c/d53/d10e/f10f 1226323 1 2024-04-25T22:42:18.325 INFO:tasks.workunit.client.0.smithi057.stdout:9/877: getdents d3/d34/d42/d28/d62/dcf 0 2024-04-25T22:42:18.325 INFO:tasks.workunit.client.0.smithi057.stdout:9/878: stat d3/l4b 0 2024-04-25T22:42:18.325 INFO:tasks.workunit.client.0.smithi057.stdout:3/908: write d0/d4/fa5 [482409,21726] 0 2024-04-25T22:42:18.326 INFO:tasks.workunit.client.0.smithi057.stdout:7/850: dwrite d6/d28/d4e/d30/d60/fbb [0,4194304] 0 2024-04-25T22:42:18.327 INFO:tasks.workunit.client.0.smithi057.stdout:9/879: rmdir d3/d34/d42/d28/d39/d54/d88 39 2024-04-25T22:42:18.327 INFO:tasks.workunit.client.0.smithi057.stdout:3/909: symlink d0/d4/d4a/d106/d109/l138 0 2024-04-25T22:42:18.328 INFO:tasks.workunit.client.0.smithi057.stdout:9/880: stat d3/d34/d42/d5e/d83/ca4 0 2024-04-25T22:42:18.329 INFO:tasks.workunit.client.0.smithi057.stdout:9/881: mkdir d3/d34/d42/d5e/d83/d118 0 2024-04-25T22:42:18.329 INFO:tasks.workunit.client.0.smithi057.stdout:7/851: rename d6/d28/d4e/d30/l103 to d6/d28/d4e/d30/d46/d73/d98/l115 0 2024-04-25T22:42:18.330 INFO:tasks.workunit.client.0.smithi057.stdout:4/970: dread d14/d2f/f7b [0,4194304] 0 2024-04-25T22:42:18.330 INFO:tasks.workunit.client.0.smithi057.stdout:4/971: chown d14/l1e 1591890 1 2024-04-25T22:42:18.331 INFO:tasks.workunit.client.0.smithi057.stdout:7/852: stat d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/f82 0 2024-04-25T22:42:18.331 INFO:tasks.workunit.client.0.smithi057.stdout:9/882: creat d3/d34/d42/d28/d62/d67/d6e/f119 x:0 0 0 2024-04-25T22:42:18.331 INFO:tasks.workunit.client.0.smithi057.stdout:4/972: creat d14/d3d/dfe/def/f12d x:0 0 0 2024-04-25T22:42:18.333 INFO:tasks.workunit.client.0.smithi057.stdout:8/912: dwrite d4/d5/d17/fb1 [0,4194304] 0 2024-04-25T22:42:18.334 INFO:tasks.workunit.client.0.smithi057.stdout:7/853: truncate d6/d28/d4e/d30/d60/d8d/d96/d51/f83 1514633 0 2024-04-25T22:42:18.335 INFO:tasks.workunit.client.0.smithi057.stdout:8/913: rename d4/db/dd/d3a/fa4 to d4/d5/d17/d19/d35/d83/d92/da6/f14b 0 2024-04-25T22:42:18.336 INFO:tasks.workunit.client.0.smithi057.stdout:7/854: creat d6/d28/d4e/d30/d60/d6f/d9c/dc4/dd6/f116 x:0 0 0 2024-04-25T22:42:18.337 INFO:tasks.workunit.client.0.smithi057.stdout:8/914: mknod d4/db/d12/dc0/d11b/c14c 0 2024-04-25T22:42:18.338 INFO:tasks.workunit.client.0.smithi057.stdout:8/915: rmdir d4/db/d12/dc0 39 2024-04-25T22:42:18.338 INFO:tasks.workunit.client.0.smithi057.stdout:9/883: dwrite d3/d34/fd1 [0,4194304] 0 2024-04-25T22:42:18.338 INFO:tasks.workunit.client.0.smithi057.stdout:7/855: rename d6/d28/d4e/d30/d60/d6f/d9c/lb9 to d6/d28/d4e/d30/d60/d6f/dbf/l117 0 2024-04-25T22:42:18.340 INFO:tasks.workunit.client.0.smithi057.stdout:8/916: mkdir d4/db/d72/d14d 0 2024-04-25T22:42:18.345 INFO:tasks.workunit.client.0.smithi057.stdout:1/916: dread d7/d65/d95/d10b/f113 [0,4194304] 0 2024-04-25T22:42:18.346 INFO:tasks.workunit.client.0.smithi057.stdout:1/917: chown d7/dd/d16/d18/f39 2304 1 2024-04-25T22:42:18.346 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:18.344+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:18.349 INFO:tasks.workunit.client.0.smithi057.stdout:7/856: dwrite d6/d28/d4e/d30/f43 [0,4194304] 0 2024-04-25T22:42:18.349 INFO:tasks.workunit.client.0.smithi057.stdout:1/918: dread d7/d65/d95/d10b/d45/f48 [0,4194304] 0 2024-04-25T22:42:18.349 INFO:tasks.workunit.client.0.smithi057.stdout:8/917: dwrite d4/db/fc [0,4194304] 0 2024-04-25T22:42:18.349 INFO:tasks.workunit.client.0.smithi057.stdout:9/884: dread d3/d34/d42/d28/d65/f9b [0,4194304] 0 2024-04-25T22:42:18.350 INFO:tasks.workunit.client.0.smithi057.stdout:1/919: chown d7/dd/d16/d88 0 1 2024-04-25T22:42:18.350 INFO:tasks.workunit.client.0.smithi057.stdout:7/857: dread - d6/d28/d4e/d30/d46/d73/dcb/df9/dfd/f102 zero size 2024-04-25T22:42:18.351 INFO:tasks.workunit.client.0.smithi057.stdout:8/918: chown d4/db/d12/dc0/d11b/d135 26189 1 2024-04-25T22:42:18.351 INFO:tasks.workunit.client.0.smithi057.stdout:1/920: mknod d7/dd/d26/c12c 0 2024-04-25T22:42:18.351 INFO:tasks.workunit.client.0.smithi057.stdout:9/885: creat d3/d34/d42/d28/d62/d67/f11a x:0 0 0 2024-04-25T22:42:18.353 INFO:tasks.workunit.client.0.smithi057.stdout:7/858: fdatasync d6/d28/d4e/d30/d60/d6f/d9c/dc4/dd6/d101/fed 0 2024-04-25T22:42:18.353 INFO:tasks.workunit.client.0.smithi057.stdout:8/919: rename d4/db/d12/f4e to d4/d5/d17/d19/dec/f14e 0 2024-04-25T22:42:18.354 INFO:tasks.workunit.client.0.smithi057.stdout:8/920: dread - d4/d5/dd2/fdc zero size 2024-04-25T22:42:18.354 INFO:tasks.workunit.client.0.smithi057.stdout:7/859: mknod d6/d28/d4e/d30/d60/d8d/d96/d5d/c118 0 2024-04-25T22:42:18.355 INFO:tasks.workunit.client.0.smithi057.stdout:4/973: dread d14/d2f/d4c/fa8 [0,4194304] 0 2024-04-25T22:42:18.357 INFO:tasks.workunit.client.0.smithi057.stdout:8/921: creat d4/db/dd/d3a/f14f x:0 0 0 2024-04-25T22:42:18.357 INFO:tasks.workunit.client.0.smithi057.stdout:1/921: creat d7/dd/d26/d9a/d129/f12d x:0 0 0 2024-04-25T22:42:18.358 INFO:tasks.workunit.client.0.smithi057.stdout:4/974: dread d14/d3d/dfe/def/f108 [0,4194304] 0 2024-04-25T22:42:18.359 INFO:tasks.workunit.client.0.smithi057.stdout:9/886: dread d3/d34/d42/d28/d62/d67/f94 [0,4194304] 0 2024-04-25T22:42:18.360 INFO:tasks.workunit.client.0.smithi057.stdout:8/922: rename d4/d5/d17/d19/d35/d83/d92/f8b to d4/db/dd/d3a/d94/f150 0 2024-04-25T22:42:18.362 INFO:tasks.workunit.client.0.smithi057.stdout:3/910: dread d0/d4/d7/d46/d30/d7a/fd1 [0,4194304] 0 2024-04-25T22:42:18.362 INFO:tasks.workunit.client.0.smithi057.stdout:8/923: mknod d4/d5/d17/d19/d35/d83/d92/d5b/d8c/c151 0 2024-04-25T22:42:18.362 INFO:tasks.workunit.client.0.smithi057.stdout:7/860: dwrite d6/d28/d4e/d30/fb6 [0,4194304] 0 2024-04-25T22:42:18.363 INFO:tasks.workunit.client.0.smithi057.stdout:3/911: creat d0/d4/d4a/d106/f139 x:0 0 0 2024-04-25T22:42:18.364 INFO:tasks.workunit.client.0.smithi057.stdout:7/861: readlink d6/d28/d4e/d30/d60/d6f/dbf/lea 0 2024-04-25T22:42:18.364 INFO:tasks.workunit.client.0.smithi057.stdout:3/912: dread - d0/d4/d7b/d7c/de8/f11d zero size 2024-04-25T22:42:18.365 INFO:tasks.workunit.client.0.smithi057.stdout:4/975: dread d14/d2f/d4c/d5b/fff [0,4194304] 0 2024-04-25T22:42:18.366 INFO:tasks.workunit.client.0.smithi057.stdout:3/913: mkdir d0/d11/d13a 0 2024-04-25T22:42:18.368 INFO:tasks.workunit.client.0.smithi057.stdout:3/914: rename d0/d4/d34/d3c/c85 to d0/d4/d34/c13b 0 2024-04-25T22:42:18.370 INFO:tasks.workunit.client.0.smithi057.stdout:1/922: write d7/dd/d16/d24/f3a [103181,118219] 0 2024-04-25T22:42:18.370 INFO:tasks.workunit.client.0.smithi057.stdout:4/976: dwrite d14/d47/d5e/d5f/f10d [0,4194304] 0 2024-04-25T22:42:18.371 INFO:tasks.workunit.client.0.smithi057.stdout:4/977: fdatasync d14/d2f/f66 0 2024-04-25T22:42:18.371 INFO:tasks.workunit.client.0.smithi057.stdout:1/923: symlink d7/d65/d95/l12e 0 2024-04-25T22:42:18.371 INFO:tasks.workunit.client.0.smithi057.stdout:4/978: mknod d14/d5a/d67/dcc/c12e 0 2024-04-25T22:42:18.372 INFO:tasks.workunit.client.0.smithi057.stdout:1/924: unlink d7/dd/f112 0 2024-04-25T22:42:18.372 INFO:tasks.workunit.client.0.smithi057.stdout:8/924: write d4/db/dd/f18 [2375951,129195] 0 2024-04-25T22:42:18.373 INFO:tasks.workunit.client.0.smithi057.stdout:4/979: read d14/da9/f7d [2715043,91306] 0 2024-04-25T22:42:18.373 INFO:tasks.workunit.client.0.smithi057.stdout:1/925: mkdir d7/dd/d16/d24/d63/d121/d12f 0 2024-04-25T22:42:18.373 INFO:tasks.workunit.client.0.smithi057.stdout:0/887: sync 2024-04-25T22:42:18.374 INFO:tasks.workunit.client.0.smithi057.stdout:4/980: stat d14/d2f/d4c/d5b/daa/c107 0 2024-04-25T22:42:18.374 INFO:tasks.workunit.client.0.smithi057.stdout:8/925: rename d4/d5/d21/f11a to d4/d5/d17/d19/d35/f152 0 2024-04-25T22:42:18.375 INFO:tasks.workunit.client.0.smithi057.stdout:1/926: write d7/dd/d16/d24/d61/f53 [238321,15099] 0 2024-04-25T22:42:18.375 INFO:tasks.workunit.client.0.smithi057.stdout:1/927: chown d7/dd/d16/c68 47617097 1 2024-04-25T22:42:18.376 INFO:tasks.workunit.client.0.smithi057.stdout:8/926: dread - d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/f137 zero size 2024-04-25T22:42:18.379 INFO:tasks.workunit.client.0.smithi057.stdout:8/927: link d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/dc8/f9b d4/d5/d17/d19/d35/d83/d92/d5b/d8c/de9/f153 0 2024-04-25T22:42:18.380 INFO:tasks.workunit.client.0.smithi057.stdout:0/888: dwrite d0/d3/d4d/fd9 [0,4194304] 0 2024-04-25T22:42:18.382 INFO:tasks.workunit.client.0.smithi057.stdout:1/928: dwrite d7/f6f [0,4194304] 0 2024-04-25T22:42:18.388 INFO:tasks.workunit.client.0.smithi057.stdout:1/929: dwrite d7/d65/d6a/f118 [0,4194304] 0 2024-04-25T22:42:18.390 INFO:tasks.workunit.client.0.smithi057.stdout:1/930: symlink d7/dd/l130 0 2024-04-25T22:42:18.390 INFO:tasks.workunit.client.0.smithi057.stdout:9/887: dread d3/f32 [0,4194304] 0 2024-04-25T22:42:18.391 INFO:tasks.workunit.client.0.smithi057.stdout:1/931: fsync d7/dd/d16/d24/f3a 0 2024-04-25T22:42:18.391 INFO:tasks.workunit.client.0.smithi057.stdout:9/888: creat d3/d34/d42/d28/d62/f11b x:0 0 0 2024-04-25T22:42:18.392 INFO:tasks.workunit.client.0.smithi057.stdout:1/932: chown d7/f92 141 1 2024-04-25T22:42:18.392 INFO:tasks.workunit.client.0.smithi057.stdout:9/889: rmdir d3/d34/d42/d28/d39 39 2024-04-25T22:42:18.393 INFO:tasks.workunit.client.0.smithi057.stdout:1/933: creat d7/d65/d95/d10b/d75/f131 x:0 0 0 2024-04-25T22:42:18.393 INFO:tasks.workunit.client.0.smithi057.stdout:9/890: creat d3/d34/d42/d28/d39/dbd/f11c x:0 0 0 2024-04-25T22:42:18.394 INFO:tasks.workunit.client.0.smithi057.stdout:1/934: rename d7/dd/d26/c43 to d7/d65/d6a/c132 0 2024-04-25T22:42:18.394 INFO:tasks.workunit.client.0.smithi057.stdout:9/891: write d3/ff [4341954,9232] 0 2024-04-25T22:42:18.395 INFO:tasks.workunit.client.0.smithi057.stdout:9/892: symlink d3/d34/d42/d28/d2d/l11d 0 2024-04-25T22:42:18.396 INFO:tasks.workunit.client.0.smithi057.stdout:9/893: rmdir d3/d34/d42/d28/d62 39 2024-04-25T22:42:18.396 INFO:tasks.workunit.client.0.smithi057.stdout:9/894: readlink l2 0 2024-04-25T22:42:18.402 INFO:tasks.workunit.client.0.smithi057.stdout:9/895: dwrite d3/d34/d42/d28/d39/d54/fc9 [0,4194304] 0 2024-04-25T22:42:18.403 INFO:tasks.workunit.client.0.smithi057.stdout:1/935: getdents d7/d65/d6a 0 2024-04-25T22:42:18.403 INFO:tasks.workunit.client.0.smithi057.stdout:9/896: dread - d3/dd8/de3/ff0 zero size 2024-04-25T22:42:18.404 INFO:tasks.workunit.client.0.smithi057.stdout:1/936: write d7/dd/d26/ff4 [2511679,22104] 0 2024-04-25T22:42:18.404 INFO:tasks.workunit.client.0.smithi057.stdout:9/897: stat d3/lcc 0 2024-04-25T22:42:18.404 INFO:tasks.workunit.client.0.smithi057.stdout:1/937: mknod d7/d65/d11e/c133 0 2024-04-25T22:42:18.405 INFO:tasks.workunit.client.0.smithi057.stdout:9/898: write d3/d34/d42/d28/d39/d54/fcb [4466486,109110] 0 2024-04-25T22:42:18.405 INFO:tasks.workunit.client.0.smithi057.stdout:1/938: unlink d7/d65/d95/d10b/d75/cb7 0 2024-04-25T22:42:18.406 INFO:tasks.workunit.client.0.smithi057.stdout:9/899: write d3/d34/d42/d5e/f76 [7403295,91755] 0 2024-04-25T22:42:18.406 INFO:tasks.workunit.client.0.smithi057.stdout:1/939: readlink d7/dd/d26/l84 0 2024-04-25T22:42:18.406 INFO:tasks.workunit.client.0.smithi057.stdout:1/940: symlink d7/l134 0 2024-04-25T22:42:18.407 INFO:tasks.workunit.client.0.smithi057.stdout:1/941: chown d7/dd/d16/f36 129817 1 2024-04-25T22:42:18.407 INFO:tasks.workunit.client.0.smithi057.stdout:1/942: chown d7/d65/d95/d10b/d45/dd8/f119 15622 1 2024-04-25T22:42:18.412 INFO:tasks.workunit.client.0.smithi057.stdout:0/889: dread d0/d5/fcd [0,4194304] 0 2024-04-25T22:42:18.412 INFO:tasks.workunit.client.0.smithi057.stdout:1/943: rename d7/d65/d11e to d7/dd/d16/d24/d135 0 2024-04-25T22:42:18.412 INFO:tasks.workunit.client.0.smithi057.stdout:9/900: truncate d3/f24 3716123 0 2024-04-25T22:42:18.413 INFO:tasks.workunit.client.0.smithi057.stdout:1/944: fdatasync d7/dd/d26/d9a/d129/f12d 0 2024-04-25T22:42:18.413 INFO:tasks.workunit.client.0.smithi057.stdout:0/890: rmdir d0/d3/d6/d14/d39 39 2024-04-25T22:42:18.413 INFO:tasks.workunit.client.0.smithi057.stdout:1/945: write d7/ddd/f11b [536430,125857] 0 2024-04-25T22:42:18.413 INFO:tasks.workunit.client.0.smithi057.stdout:0/891: dread - d0/d3/d4d/d87/da0/fde zero size 2024-04-25T22:42:18.419 INFO:tasks.workunit.client.0.smithi057.stdout:8/928: dread d4/db/d12/f3e [0,4194304] 0 2024-04-25T22:42:18.421 INFO:tasks.workunit.client.0.smithi057.stdout:0/892: dwrite d0/f2d [4194304,4194304] 0 2024-04-25T22:42:18.421 INFO:tasks.workunit.client.0.smithi057.stdout:1/946: dwrite d7/dd/d16/d18/d31/d8f/f11a [0,4194304] 0 2024-04-25T22:42:18.422 INFO:tasks.workunit.client.0.smithi057.stdout:0/893: fsync d0/d49/f48 0 2024-04-25T22:42:18.422 INFO:tasks.workunit.client.0.smithi057.stdout:1/947: stat d7/dd/d16/d18/c5a 0 2024-04-25T22:42:18.423 INFO:tasks.workunit.client.0.smithi057.stdout:0/894: dread - d0/d3/d6/d71/f12d zero size 2024-04-25T22:42:18.423 INFO:tasks.workunit.client.0.smithi057.stdout:1/948: creat d7/d65/d6a/d98/f136 x:0 0 0 2024-04-25T22:42:18.424 INFO:tasks.workunit.client.0.smithi057.stdout:0/895: creat d0/d3/d4d/f130 x:0 0 0 2024-04-25T22:42:18.427 INFO:tasks.workunit.client.0.smithi057.stdout:0/896: link d0/d3/d6/d83/dfa/f11b d0/d3/d6/d14/d39/f131 0 2024-04-25T22:42:18.428 INFO:tasks.workunit.client.0.smithi057.stdout:8/929: dwrite d4/d5/d17/d19/d35/d83/d92/d5b/d8c/f12f [0,4194304] 0 2024-04-25T22:42:18.429 INFO:tasks.workunit.client.0.smithi057.stdout:9/901: dread d3/d34/d42/d28/dc1/fc2 [0,4194304] 0 2024-04-25T22:42:18.429 INFO:tasks.workunit.client.0.smithi057.stdout:0/897: mknod d0/d49/c132 0 2024-04-25T22:42:18.431 INFO:tasks.workunit.client.0.smithi057.stdout:8/930: rename d4/db/dd/d3a/d5c/d76/d131 to d4/d5/d21/db0/d154 0 2024-04-25T22:42:18.431 INFO:tasks.workunit.client.0.smithi057.stdout:0/898: rmdir d0/d3/d4d/d87/d102/da3/dec/dc8 39 2024-04-25T22:42:18.432 INFO:tasks.workunit.client.0.smithi057.stdout:1/949: dwrite d7/dd/d16/d88/ff3 [0,4194304] 0 2024-04-25T22:42:18.433 INFO:tasks.workunit.client.0.smithi057.stdout:8/931: chown d4/d5/d2f/dc2/f144 207176 1 2024-04-25T22:42:18.433 INFO:tasks.workunit.client.0.smithi057.stdout:0/899: dread - d0/d49/d6d/f74 zero size 2024-04-25T22:42:18.433 INFO:tasks.workunit.client.0.smithi057.stdout:1/950: truncate d7/dd/d26/f35 3445780 0 2024-04-25T22:42:18.434 INFO:tasks.workunit.client.0.smithi057.stdout:1/951: symlink d7/l137 0 2024-04-25T22:42:18.434 INFO:tasks.workunit.client.0.smithi057.stdout:8/932: symlink d4/db/dd/d3a/d94/dcf/df7/l155 0 2024-04-25T22:42:18.435 INFO:tasks.workunit.client.0.smithi057.stdout:8/933: write d4/db/d12/dc0/d11b/f13a [816158,13204] 0 2024-04-25T22:42:18.436 INFO:tasks.workunit.client.0.smithi057.stdout:1/952: fsync d7/dd/d16/d18/d31/fea 0 2024-04-25T22:42:18.436 INFO:tasks.workunit.client.0.smithi057.stdout:8/934: creat d4/d5/d2f/dc2/f156 x:0 0 0 2024-04-25T22:42:18.437 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:18.437 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:18.439 INFO:tasks.workunit.client.0.smithi057.stdout:3/915: sync 2024-04-25T22:42:18.439 INFO:tasks.workunit.client.0.smithi057.stdout:7/862: sync 2024-04-25T22:42:18.440 INFO:tasks.workunit.client.0.smithi057.stdout:7/863: write d6/f27 [1975887,69832] 0 2024-04-25T22:42:18.441 INFO:tasks.workunit.client.0.smithi057.stdout:9/902: dread d3/d34/d42/f41 [0,4194304] 0 2024-04-25T22:42:18.442 INFO:tasks.workunit.client.0.smithi057.stdout:3/916: creat d0/d4/d7/d26/d72/dd0/de5/f13c x:0 0 0 2024-04-25T22:42:18.443 INFO:tasks.workunit.client.0.smithi057.stdout:7/864: read d6/f21 [4683662,76851] 0 2024-04-25T22:42:18.443 INFO:tasks.workunit.client.0.smithi057.stdout:9/903: chown d3/d34/d42/d28/d62/ca9 34328945 1 2024-04-25T22:42:18.443 INFO:tasks.workunit.client.0.smithi057.stdout:1/953: dwrite d7/d65/d6a/fd1 [0,4194304] 0 2024-04-25T22:42:18.444 INFO:tasks.workunit.client.0.smithi057.stdout:3/917: truncate d0/f1b 916840 0 2024-04-25T22:42:18.445 INFO:tasks.workunit.client.0.smithi057.stdout:7/865: symlink d6/d28/d4e/d30/d46/l119 0 2024-04-25T22:42:18.445 INFO:tasks.workunit.client.0.smithi057.stdout:8/935: dwrite d4/db/dd/fae [0,4194304] 0 2024-04-25T22:42:18.446 INFO:tasks.workunit.client.0.smithi057.stdout:1/954: write d7/dd/d16/d18/f23 [1019155,11134] 0 2024-04-25T22:42:18.447 INFO:tasks.workunit.client.0.smithi057.stdout:9/904: write d3/d34/d42/d28/d62/d67/d6e/d7c/fdb [1787940,87488] 0 2024-04-25T22:42:18.447 INFO:tasks.workunit.client.0.smithi057.stdout:3/918: truncate d0/d4/d4a/f111 505638 0 2024-04-25T22:42:18.448 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:18.444+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:18.448 INFO:tasks.workunit.client.0.smithi057.stdout:8/936: creat d4/d5/d2f/dc2/f157 x:0 0 0 2024-04-25T22:42:18.448 INFO:tasks.workunit.client.0.smithi057.stdout:3/919: truncate d0/fa1 116856 0 2024-04-25T22:42:18.448 INFO:tasks.workunit.client.0.smithi057.stdout:8/937: write d4/d5/d2f/dc2/f157 [137896,6997] 0 2024-04-25T22:42:18.449 INFO:tasks.workunit.client.0.smithi057.stdout:7/866: mknod d6/d28/d4e/d30/d60/d8d/d96/d51/dad/c11a 0 2024-04-25T22:42:18.449 INFO:tasks.workunit.client.0.smithi057.stdout:3/920: chown d0/d5b/caf 7702 1 2024-04-25T22:42:18.449 INFO:tasks.workunit.client.0.smithi057.stdout:1/955: link d7/d65/d6a/d98/l83 d7/dd/d90/l138 0 2024-04-25T22:42:18.449 INFO:tasks.workunit.client.0.smithi057.stdout:8/938: write d4/d5/d17/d19/fca [1135017,59491] 0 2024-04-25T22:42:18.449 INFO:tasks.workunit.client.0.smithi057.stdout:9/905: creat d3/d34/d42/d28/d39/d54/f11e x:0 0 0 2024-04-25T22:42:18.450 INFO:tasks.workunit.client.0.smithi057.stdout:7/867: chown d6/d28/d4e/d30/d60/d6f/d9c/lca 3266886 1 2024-04-25T22:42:18.450 INFO:tasks.workunit.client.0.smithi057.stdout:3/921: chown d0/d4/d7/d22/da0/fa4 11863 1 2024-04-25T22:42:18.451 INFO:tasks.workunit.client.0.smithi057.stdout:3/922: chown d0/d4/d34/d3c/d70/feb 3701605 1 2024-04-25T22:42:18.451 INFO:tasks.workunit.client.0.smithi057.stdout:7/868: rename d6/l17 to d6/d28/d4e/d30/d60/d6f/dbf/l11b 0 2024-04-25T22:42:18.451 INFO:tasks.workunit.client.0.smithi057.stdout:8/939: dread - d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/f112 zero size 2024-04-25T22:42:18.453 INFO:tasks.workunit.client.0.smithi057.stdout:3/923: link d0/d4/fa5 d0/d4/d34/d3c/d53/d7f/dfe/f13d 0 2024-04-25T22:42:18.460 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:18.461 INFO:tasks.workunit.client.0.smithi057.stdout:8/940: truncate d4/f5e 4337923 0 2024-04-25T22:42:18.462 INFO:tasks.workunit.client.0.smithi057.stdout:7/869: write d6/f14 [2081547,44628] 0 2024-04-25T22:42:18.462 INFO:tasks.workunit.client.0.smithi057.stdout:8/941: chown d4/db/d12/l8a 14 1 2024-04-25T22:42:18.462 INFO:tasks.workunit.client.0.smithi057.stdout:8/942: dread - d4/db/dd/d3a/d5c/f149 zero size 2024-04-25T22:42:18.462 INFO:tasks.workunit.client.0.smithi057.stdout:7/870: mkdir d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/dd7/dd4/d11c 0 2024-04-25T22:42:18.462 INFO:tasks.workunit.client.0.smithi057.stdout:8/943: write d4/db/dd/d3a/f14f [49037,23263] 0 2024-04-25T22:42:18.462 INFO:tasks.workunit.client.0.smithi057.stdout:7/871: symlink d6/d91/l11d 0 2024-04-25T22:42:18.467 INFO:tasks.workunit.client.0.smithi057.stdout:4/981: sync 2024-04-25T22:42:18.468 INFO:tasks.workunit.client.0.smithi057.stdout:4/982: dread - d14/d47/d5e/d5f/f113 zero size 2024-04-25T22:42:18.468 INFO:tasks.workunit.client.0.smithi057.stdout:9/906: dread d3/f5f [0,4194304] 0 2024-04-25T22:42:18.469 INFO:tasks.workunit.client.0.smithi057.stdout:7/872: dwrite d6/d28/d4e/d30/d46/d73/dcb/ff7 [0,4194304] 0 2024-04-25T22:42:18.470 INFO:tasks.workunit.client.0.smithi057.stdout:7/873: fsync d6/fcf 0 2024-04-25T22:42:18.472 INFO:tasks.workunit.client.0.smithi057.stdout:7/874: write d6/d28/d4e/d30/d60/d8d/d96/d51/fe2 [153371,79684] 0 2024-04-25T22:42:18.472 INFO:tasks.workunit.client.0.smithi057.stdout:7/875: chown d6/fcf 11 1 2024-04-25T22:42:18.474 INFO:tasks.workunit.client.0.smithi057.stdout:7/876: mkdir d6/d28/d4e/d30/d60/d6f/d9c/d11e 0 2024-04-25T22:42:18.474 INFO:tasks.workunit.client.0.smithi057.stdout:7/877: write d6/d28/d4e/d30/d46/d73/fff [105068,82023] 0 2024-04-25T22:42:18.475 INFO:tasks.workunit.client.0.smithi057.stdout:4/983: truncate d14/d2f/d4c/d5b/f8f 2171579 0 2024-04-25T22:42:18.476 INFO:tasks.workunit.client.0.smithi057.stdout:7/878: creat d6/dd2/f11f x:0 0 0 2024-04-25T22:42:18.477 INFO:tasks.workunit.client.0.smithi057.stdout:1/956: dread d7/dd/d90/dbf/fc2 [0,4194304] 0 2024-04-25T22:42:18.477 INFO:tasks.workunit.client.0.smithi057.stdout:3/924: dread d0/d4/f90 [0,4194304] 0 2024-04-25T22:42:18.478 INFO:tasks.workunit.client.0.smithi057.stdout:7/879: getdents d6/d28/d4e/d30/d60/d6f/dbf 0 2024-04-25T22:42:18.479 INFO:tasks.workunit.client.0.smithi057.stdout:3/925: getdents d0/d4/d7/d26/d110 0 2024-04-25T22:42:18.479 INFO:tasks.workunit.client.0.smithi057.stdout:3/926: chown d0/d4/d7/d26/d72/c10b 2 1 2024-04-25T22:42:18.480 INFO:tasks.workunit.client.0.smithi057.stdout:7/880: link d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/f80 d6/d28/d4e/d30/d60/d8d/d96/d51/f120 0 2024-04-25T22:42:18.480 INFO:tasks.workunit.client.0.smithi057.stdout:3/927: write d0/d4/d7/d46/d30/f65 [5365329,66971] 0 2024-04-25T22:42:18.482 INFO:tasks.workunit.client.0.smithi057.stdout:7/881: link d6/d28/d4e/fd8 d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/ddf/f121 0 2024-04-25T22:42:18.482 INFO:tasks.workunit.client.0.smithi057.stdout:3/928: dread d0/d4/d7/d46/d30/d7a/d91/fb2 [0,4194304] 0 2024-04-25T22:42:18.483 INFO:tasks.workunit.client.0.smithi057.stdout:1/957: truncate d7/dd/d16/f1e 572095 0 2024-04-25T22:42:18.484 INFO:tasks.workunit.client.0.smithi057.stdout:1/958: chown d7/d65/d6a/d98 246391 1 2024-04-25T22:42:18.485 INFO:tasks.workunit.client.0.smithi057.stdout:1/959: write d7/d65/d95/d10b/d45/f72 [1849178,13308] 0 2024-04-25T22:42:18.486 INFO:tasks.workunit.client.0.smithi057.stdout:7/882: dread d6/d28/d4e/d30/d60/fbb [0,4194304] 0 2024-04-25T22:42:18.488 INFO:tasks.workunit.client.0.smithi057.stdout:7/883: rename d6/d28/d4e/d30/d46/c5c to d6/d28/d4e/d30/d60/da7/c122 0 2024-04-25T22:42:18.488 INFO:tasks.workunit.client.0.smithi057.stdout:7/884: readlink d6/d91/l11d 0 2024-04-25T22:42:18.489 INFO:tasks.workunit.client.0.smithi057.stdout:1/960: dread d7/dd/d16/d88/ff3 [0,4194304] 0 2024-04-25T22:42:18.489 INFO:tasks.workunit.client.0.smithi057.stdout:7/885: mknod d6/d28/d4e/d30/d60/d6f/c123 0 2024-04-25T22:42:18.489 INFO:tasks.workunit.client.0.smithi057.stdout:7/886: chown d6/daa 15 1 2024-04-25T22:42:18.490 INFO:tasks.workunit.client.0.smithi057.stdout:7/887: chown d6/daa/dda/f104 247 1 2024-04-25T22:42:18.491 INFO:tasks.workunit.client.0.smithi057.stdout:7/888: fdatasync d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/f108 0 2024-04-25T22:42:18.492 INFO:tasks.workunit.client.0.smithi057.stdout:1/961: read d7/dd/d16/d24/d61/f53 [3806045,48340] 0 2024-04-25T22:42:18.493 INFO:tasks.workunit.client.0.smithi057.stdout:1/962: rmdir d7/d65 39 2024-04-25T22:42:18.493 INFO:tasks.workunit.client.0.smithi057.stdout:7/889: link d6/d28/d4e/d30/d60/d8d/d96/d51/c85 d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d97/c124 0 2024-04-25T22:42:18.493 INFO:tasks.workunit.client.0.smithi057.stdout:4/984: dread d14/d2f/d4c/d5b/db8/fc7 [0,4194304] 0 2024-04-25T22:42:18.494 INFO:tasks.workunit.client.0.smithi057.stdout:4/985: chown d14/d47/d62/fdd 0 1 2024-04-25T22:42:18.494 INFO:tasks.workunit.client.0.smithi057.stdout:1/963: write d7/d65/d95/d10b/d75/dc4/f108 [601932,2371] 0 2024-04-25T22:42:18.495 INFO:tasks.workunit.client.0.smithi057.stdout:4/986: mknod d14/d47/c12f 0 2024-04-25T22:42:18.495 INFO:tasks.workunit.client.0.smithi057.stdout:7/890: rename d6/d28/d4e/d30/d60/d8d/d96/f7f to d6/d28/d4e/d30/d60/d8d/d96/d51/dad/f125 0 2024-04-25T22:42:18.495 INFO:tasks.workunit.client.0.smithi057.stdout:1/964: unlink d7/dd/d90/dbf/f105 0 2024-04-25T22:42:18.496 INFO:tasks.workunit.client.0.smithi057.stdout:4/987: rename d14/d47/d5e/d5f/l79 to d14/d2f/d4c/d5b/db8/l130 0 2024-04-25T22:42:18.496 INFO:tasks.workunit.client.0.smithi057.stdout:1/965: symlink d7/dd/d16/d24/d63/dc7/d123/l139 0 2024-04-25T22:42:18.497 INFO:tasks.workunit.client.0.smithi057.stdout:7/891: truncate d6/d28/d4e/d30/d60/d8d/d96/d59/fbd 1062577 0 2024-04-25T22:42:18.497 INFO:tasks.workunit.client.0.smithi057.stdout:1/966: symlink d7/d65/d6a/d98/l13a 0 2024-04-25T22:42:18.498 INFO:tasks.workunit.client.0.smithi057.stdout:1/967: fsync d7/dd/d16/d18/f70 0 2024-04-25T22:42:18.499 INFO:tasks.workunit.client.0.smithi057.stdout:1/968: stat d7/d65/fe5 0 2024-04-25T22:42:18.499 INFO:tasks.workunit.client.0.smithi057.stdout:7/892: mkdir d6/d28/d4e/d30/d60/d6f/df4/d126 0 2024-04-25T22:42:18.500 INFO:tasks.workunit.client.0.smithi057.stdout:7/893: creat d6/d28/d4e/d30/d60/d8d/d96/d51/d10a/f127 x:0 0 0 2024-04-25T22:42:18.502 INFO:tasks.workunit.client.0.smithi057.stdout:7/894: getdents d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d 0 2024-04-25T22:42:18.503 INFO:tasks.workunit.client.0.smithi057.stdout:7/895: readlink d6/d28/d4e/d30/d60/d6f/dbf/l117 0 2024-04-25T22:42:18.503 INFO:tasks.workunit.client.0.smithi057.stdout:1/969: truncate d7/d65/d95/d10b/d6b/fc9 413239 0 2024-04-25T22:42:18.504 INFO:tasks.workunit.client.0.smithi057.stdout:1/970: dread - d7/dd/d16/d18/d31/f128 zero size 2024-04-25T22:42:18.505 INFO:tasks.workunit.client.0.smithi057.stdout:1/971: chown d7/d65/d6a/d98/l13a 1439962260 1 2024-04-25T22:42:18.506 INFO:tasks.workunit.client.0.smithi057.stdout:4/988: dread d14/d2f/d4c/d5b/f93 [0,4194304] 0 2024-04-25T22:42:18.506 INFO:tasks.workunit.client.0.smithi057.stdout:1/972: creat d7/dd/d16/d104/f13b x:0 0 0 2024-04-25T22:42:18.506 INFO:tasks.workunit.client.0.smithi057.stdout:1/973: rmdir d7/d65/d6a/d98/dc5 39 2024-04-25T22:42:18.507 INFO:tasks.workunit.client.0.smithi057.stdout:4/989: rename d14/d2f/d82/lcb to d14/d5a/d67/db4/dd3/l131 0 2024-04-25T22:42:18.508 INFO:tasks.workunit.client.0.smithi057.stdout:1/974: link d7/d65/d95/l12e d7/d65/d95/d10b/de1/l13c 0 2024-04-25T22:42:18.509 INFO:tasks.workunit.client.0.smithi057.stdout:4/990: dread d14/d2f/d4c/fa8 [0,4194304] 0 2024-04-25T22:42:18.509 INFO:tasks.workunit.client.0.smithi057.stdout:7/896: dwrite d6/d28/d4e/d30/d60/d8d/d96/d59/f61 [0,4194304] 0 2024-04-25T22:42:18.511 INFO:tasks.workunit.client.0.smithi057.stdout:4/991: rename d14/d5a/fe9 to d14/d3d/dfe/def/f132 0 2024-04-25T22:42:18.511 INFO:tasks.workunit.client.0.smithi057.stdout:7/897: mkdir d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/da2/d128 0 2024-04-25T22:42:18.511 INFO:tasks.workunit.client.0.smithi057.stdout:1/975: read d7/dd/d16/f7e [1023252,27461] 0 2024-04-25T22:42:18.512 INFO:tasks.workunit.client.0.smithi057.stdout:7/898: chown d6/d28/d4e/d30/d46/d73/cfb 5 1 2024-04-25T22:42:18.512 INFO:tasks.workunit.client.0.smithi057.stdout:4/992: link d14/d2f/d4c/d5b/dd8/ld7 d14/d2f/l133 0 2024-04-25T22:42:18.513 INFO:tasks.workunit.client.0.smithi057.stdout:1/976: read d7/d65/d95/d10b/de1/fec [5854,86611] 0 2024-04-25T22:42:18.513 INFO:tasks.workunit.client.0.smithi057.stdout:7/899: symlink d6/d28/d4e/d30/d60/l129 0 2024-04-25T22:42:18.513 INFO:tasks.workunit.client.0.smithi057.stdout:1/977: chown d7/d65/d95/d10b/d6b/f11c 5675 1 2024-04-25T22:42:18.514 INFO:tasks.workunit.client.0.smithi057.stdout:1/978: creat d7/dd/d16/d24/d63/dc7/d123/f13d x:0 0 0 2024-04-25T22:42:18.515 INFO:tasks.workunit.client.0.smithi057.stdout:1/979: rename d7/dd/d16/d18/d31/d8f/f11a to d7/dd/d26/f13e 0 2024-04-25T22:42:18.516 INFO:tasks.workunit.client.0.smithi057.stdout:1/980: chown d7/ddd/l10e 0 1 2024-04-25T22:42:18.516 INFO:tasks.workunit.client.0.smithi057.stdout:0/900: sync 2024-04-25T22:42:18.517 INFO:tasks.workunit.client.0.smithi057.stdout:0/901: mknod d0/d3/d3a/c133 0 2024-04-25T22:42:18.518 INFO:tasks.workunit.client.0.smithi057.stdout:0/902: write d0/d5/d53/f9d [1001032,125737] 0 2024-04-25T22:42:18.519 INFO:tasks.workunit.client.0.smithi057.stdout:7/900: dwrite d6/dd2/f11f [0,4194304] 0 2024-04-25T22:42:18.520 INFO:tasks.workunit.client.0.smithi057.stdout:0/903: read d0/d3/d4d/d87/d102/da3/dec/f89 [4797676,1767] 0 2024-04-25T22:42:18.521 INFO:tasks.workunit.client.0.smithi057.stdout:7/901: rename d6/d28/d4e/d30/d60/fb5 to d6/d88/f12a 0 2024-04-25T22:42:18.522 INFO:tasks.workunit.client.0.smithi057.stdout:0/904: link d0/d3/f4 d0/d5/f134 0 2024-04-25T22:42:18.522 INFO:tasks.workunit.client.0.smithi057.stdout:0/905: chown d0/d3/d4d/d87/da0 31196 1 2024-04-25T22:42:18.523 INFO:tasks.workunit.client.0.smithi057.stdout:0/906: chown d0/d3/d6/d14/dd1/ff8 12842881 1 2024-04-25T22:42:18.524 INFO:tasks.workunit.client.0.smithi057.stdout:7/902: getdents d6/d88 0 2024-04-25T22:42:18.525 INFO:tasks.workunit.client.0.smithi057.stdout:7/903: read - d6/d28/d4e/d30/d60/d8d/d96/d5d/f6a zero size 2024-04-25T22:42:18.527 INFO:tasks.workunit.client.0.smithi057.stdout:1/981: dwrite d7/d65/d95/d10b/d6b/fc9 [0,4194304] 0 2024-04-25T22:42:18.527 INFO:tasks.workunit.client.0.smithi057.stdout:7/904: mknod d6/d28/d4e/d30/d60/d6f/d9c/dc4/dd6/d101/c12b 0 2024-04-25T22:42:18.528 INFO:tasks.workunit.client.0.smithi057.stdout:0/907: dread d0/d49/f9e [4194304,4194304] 0 2024-04-25T22:42:18.528 INFO:tasks.workunit.client.0.smithi057.stdout:7/905: write d6/fb [3633404,67101] 0 2024-04-25T22:42:18.529 INFO:tasks.workunit.client.0.smithi057.stdout:4/993: dread d14/da9/db5/fc8 [4194304,4194304] 0 2024-04-25T22:42:18.529 INFO:tasks.workunit.client.0.smithi057.stdout:7/906: creat d6/d28/d4e/d30/d60/d6f/d9c/f12c x:0 0 0 2024-04-25T22:42:18.530 INFO:tasks.workunit.client.0.smithi057.stdout:0/908: dread d0/d3/d6/fe3 [0,4194304] 0 2024-04-25T22:42:18.530 INFO:tasks.workunit.client.0.smithi057.stdout:4/994: dread - d14/d2f/d82/f123 zero size 2024-04-25T22:42:18.530 INFO:tasks.workunit.client.0.smithi057.stdout:4/995: chown d14/d5a/d67 1688848 1 2024-04-25T22:42:18.533 INFO:tasks.workunit.client.0.smithi057.stdout:1/982: write d7/d65/d95/d10b/f113 [231106,50245] 0 2024-04-25T22:42:18.536 INFO:tasks.workunit.client.0.smithi057.stdout:0/909: dwrite d0/f2b [8388608,4194304] 0 2024-04-25T22:42:18.536 INFO:tasks.workunit.client.0.smithi057.stdout:4/996: dwrite d14/f20 [0,4194304] 0 2024-04-25T22:42:18.537 INFO:tasks.workunit.client.0.smithi057.stdout:4/997: chown d14/d2f/d4c/d5b/fff 106467174 1 2024-04-25T22:42:18.538 INFO:tasks.workunit.client.0.smithi057.stdout:4/998: stat d14/d5a/c76 0 2024-04-25T22:42:18.538 INFO:tasks.workunit.client.0.smithi057.stdout:0/910: getdents d0/d3/d4d/df4 0 2024-04-25T22:42:18.538 INFO:tasks.workunit.client.0.smithi057.stdout:1/983: truncate d7/d65/d95/d10b/d6b/f11c 3024753 0 2024-04-25T22:42:18.538 INFO:tasks.workunit.client.0.smithi057.stdout:4/999: fdatasync d14/da9/f55 0 2024-04-25T22:42:18.539 INFO:tasks.workunit.client.0.smithi057.stdout:0/911: creat d0/d5/d53/f135 x:0 0 0 2024-04-25T22:42:18.539 INFO:tasks.workunit.client.0.smithi057.stdout:1/984: creat d7/dd/d26/d9a/f13f x:0 0 0 2024-04-25T22:42:18.539 INFO:tasks.workunit.client.0.smithi057.stdout:0/912: dread - d0/d49/f9f zero size 2024-04-25T22:42:18.540 INFO:tasks.workunit.client.0.smithi057.stdout:1/985: chown d7/dd/d16/d24/fdb 3444 1 2024-04-25T22:42:18.540 INFO:tasks.workunit.client.0.smithi057.stdout:0/913: write d0/d5/f7f [5189842,92983] 0 2024-04-25T22:42:18.540 INFO:tasks.workunit.client.0.smithi057.stdout:1/986: write d7/d65/d6a/d98/f51 [5099285,79283] 0 2024-04-25T22:42:18.543 INFO:tasks.workunit.client.0.smithi057.stdout:0/914: write d0/d3/d6/d83/dfa/f11b [2498691,77382] 0 2024-04-25T22:42:18.544 INFO:tasks.workunit.client.0.smithi057.stdout:0/915: creat d0/d3/d4d/d87/da0/f136 x:0 0 0 2024-04-25T22:42:18.544 INFO:tasks.workunit.client.0.smithi057.stdout:0/916: truncate d0/d5/f113 814488 0 2024-04-25T22:42:18.547 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:18.544+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:18.551 INFO:tasks.workunit.client.0.smithi057.stdout:0/917: dread d0/d3/d3a/d3b/f70 [0,4194304] 0 2024-04-25T22:42:18.558 INFO:tasks.workunit.client.0.smithi057.stdout:0/918: dread d0/d3/d4d/f1d [0,4194304] 0 2024-04-25T22:42:18.559 INFO:tasks.workunit.client.0.smithi057.stdout:0/919: rename d0/d3 to d0/d3/d4d/d87/da0/d116/d137 22 2024-04-25T22:42:18.560 INFO:tasks.workunit.client.0.smithi057.stdout:0/920: mknod d0/d3/d4d/d87/da0/c138 0 2024-04-25T22:42:18.561 INFO:tasks.workunit.client.0.smithi057.stdout:0/921: truncate d0/d3/d4d/d87/da0/faf 275257 0 2024-04-25T22:42:18.562 INFO:tasks.workunit.client.0.smithi057.stdout:0/922: truncate d0/d3/d6/fe3 998834 0 2024-04-25T22:42:18.568 INFO:tasks.workunit.client.0.smithi057.stdout:0/923: dread d0/d5/d53/fef [0,4194304] 0 2024-04-25T22:42:18.572 INFO:tasks.workunit.client.0.smithi057.stdout:0/924: dread d0/d3/d6/fe3 [0,4194304] 0 2024-04-25T22:42:18.573 INFO:tasks.workunit.client.0.smithi057.stdout:1/987: dread d7/dd/d16/d24/d61/f53 [0,4194304] 0 2024-04-25T22:42:18.578 INFO:tasks.workunit.client.0.smithi057.stdout:0/925: dwrite d0/d49/d6d/fc9 [0,4194304] 0 2024-04-25T22:42:18.579 INFO:tasks.workunit.client.0.smithi057.stdout:0/926: symlink d0/d3/d6/d14/l139 0 2024-04-25T22:42:18.581 INFO:tasks.workunit.client.0.smithi057.stdout:0/927: creat d0/d3/d4d/d87/da0/d116/f13a x:0 0 0 2024-04-25T22:42:18.582 INFO:tasks.workunit.client.0.smithi057.stdout:0/928: write d0/d3/dae/f10f [1005638,45325] 0 2024-04-25T22:42:18.585 INFO:tasks.workunit.client.0.smithi057.stdout:3/929: sync 2024-04-25T22:42:18.585 INFO:tasks.workunit.client.0.smithi057.stdout:9/907: sync 2024-04-25T22:42:18.585 INFO:tasks.workunit.client.0.smithi057.stdout:8/944: sync 2024-04-25T22:42:18.585 INFO:tasks.workunit.client.0.smithi057.stdout:7/907: sync 2024-04-25T22:42:18.586 INFO:tasks.workunit.client.0.smithi057.stdout:8/945: chown d4/db/d72/c84 51416461 1 2024-04-25T22:42:18.586 INFO:tasks.workunit.client.0.smithi057.stdout:3/930: write d0/d4/d34/f64 [5895933,129268] 0 2024-04-25T22:42:18.587 INFO:tasks.workunit.client.0.smithi057.stdout:3/931: chown d0/l1a 10890122 1 2024-04-25T22:42:18.588 INFO:tasks.workunit.client.0.smithi057.stdout:8/946: rename d4/d5/d17/d19/d35/faf to d4/dba/d10b/d10c/f158 0 2024-04-25T22:42:18.588 INFO:tasks.workunit.client.0.smithi057.stdout:8/947: mknod d4/db/dd/c159 0 2024-04-25T22:42:18.589 INFO:tasks.workunit.client.0.smithi057.stdout:8/948: write d4/db/dd/f20 [2147500,124249] 0 2024-04-25T22:42:18.591 INFO:tasks.workunit.client.0.smithi057.stdout:8/949: creat d4/d5/d17/d19/d35/f15a x:0 0 0 2024-04-25T22:42:18.591 INFO:tasks.workunit.client.0.smithi057.stdout:9/908: dwrite d3/d34/d42/d28/f9a [0,4194304] 0 2024-04-25T22:42:18.592 INFO:tasks.workunit.client.0.smithi057.stdout:9/909: write d3/f107 [211876,37809] 0 2024-04-25T22:42:18.593 INFO:tasks.workunit.client.0.smithi057.stdout:8/950: rename d4/d5/dd2/fda to d4/db/dd/f15b 0 2024-04-25T22:42:18.594 INFO:tasks.workunit.client.0.smithi057.stdout:8/951: readlink d4/db/dd/d3a/d5c/l81 0 2024-04-25T22:42:18.597 INFO:tasks.workunit.client.0.smithi057.stdout:1/988: dread d7/d65/d95/d10b/d75/fb8 [0,4194304] 0 2024-04-25T22:42:18.600 INFO:tasks.workunit.client.0.smithi057.stdout:9/910: dwrite d3/d34/d42/d28/d62/d67/d6e/f7d [0,4194304] 0 2024-04-25T22:42:18.600 INFO:tasks.workunit.client.0.smithi057.stdout:8/952: dwrite d4/db/dd/d3a/d5c/f44 [0,4194304] 0 2024-04-25T22:42:18.602 INFO:tasks.workunit.client.0.smithi057.stdout:9/911: creat d3/d34/d42/d5e/d83/df1/f11f x:0 0 0 2024-04-25T22:42:18.604 INFO:tasks.workunit.client.0.smithi057.stdout:9/912: write d3/d34/d42/d28/d65/f9b [1061932,114703] 0 2024-04-25T22:42:18.604 INFO:tasks.workunit.client.0.smithi057.stdout:1/989: dwrite d7/dd/d16/d24/f2e [0,4194304] 0 2024-04-25T22:42:18.606 INFO:tasks.workunit.client.0.smithi057.stdout:9/913: mkdir d3/d34/d42/d28/d39/d54/d88/d120 0 2024-04-25T22:42:18.606 INFO:tasks.workunit.client.0.smithi057.stdout:9/914: chown d3/d34/d42/d28/d39/db3/fae 60070777 1 2024-04-25T22:42:18.610 INFO:tasks.workunit.client.0.smithi057.stdout:1/990: dwrite d7/d65/d6a/fad [0,4194304] 0 2024-04-25T22:42:18.611 INFO:tasks.workunit.client.0.smithi057.stdout:1/991: truncate d7/dd/d16/d88/f8b 2362767 0 2024-04-25T22:42:18.611 INFO:tasks.workunit.client.0.smithi057.stdout:1/992: chown d7/d65/c86 2 1 2024-04-25T22:42:18.613 INFO:tasks.workunit.client.0.smithi057.stdout:1/993: truncate d7/dd/d26/f114 1648891 0 2024-04-25T22:42:18.613 INFO:tasks.workunit.client.0.smithi057.stdout:1/994: creat d7/dd/d16/d24/d63/dc7/d123/f140 x:0 0 0 2024-04-25T22:42:18.614 INFO:tasks.workunit.client.0.smithi057.stdout:1/995: fdatasync d7/d65/d95/d10b/d45/dd8/f102 0 2024-04-25T22:42:18.615 INFO:tasks.workunit.client.0.smithi057.stdout:1/996: truncate d7/d65/d95/d10b/d45/dd8/f119 852828 0 2024-04-25T22:42:18.616 INFO:tasks.workunit.client.0.smithi057.stdout:1/997: rmdir d7/d65/d95/d10b/d45 39 2024-04-25T22:42:18.616 INFO:tasks.workunit.client.0.smithi057.stdout:1/998: fsync d7/dd/d16/d18/d31/da2/f12a 0 2024-04-25T22:42:18.619 INFO:tasks.workunit.client.0.smithi057.stdout:1/999: link d7/dd/d16/d18/d31/l76 d7/dd/d26/d9a/l141 0 2024-04-25T22:42:18.623 INFO:tasks.workunit.client.0.smithi057.stdout:3/932: dread d0/d4/d7/d22/f59 [0,4194304] 0 2024-04-25T22:42:18.624 INFO:tasks.workunit.client.0.smithi057.stdout:3/933: mknod d0/d4/d7b/d8f/c13e 0 2024-04-25T22:42:18.625 INFO:tasks.workunit.client.0.smithi057.stdout:3/934: creat d0/d4/d7/d26/f13f x:0 0 0 2024-04-25T22:42:18.625 INFO:tasks.workunit.client.0.smithi057.stdout:3/935: rmdir d0/d4/d7/d26 39 2024-04-25T22:42:18.626 INFO:tasks.workunit.client.0.smithi057.stdout:0/929: sync 2024-04-25T22:42:18.626 INFO:tasks.workunit.client.0.smithi057.stdout:9/915: sync 2024-04-25T22:42:18.626 INFO:tasks.workunit.client.0.smithi057.stdout:3/936: chown d0/d4/d4a/f111 68836 1 2024-04-25T22:42:18.626 INFO:tasks.workunit.client.0.smithi057.stdout:9/916: symlink d3/l121 0 2024-04-25T22:42:18.627 INFO:tasks.workunit.client.0.smithi057.stdout:3/937: creat d0/d4/d7/d26/d72/dd0/d136/f140 x:0 0 0 2024-04-25T22:42:18.628 INFO:tasks.workunit.client.0.smithi057.stdout:0/930: getdents d0/d3/d4d/d87/d102/da3/dec/dc8 0 2024-04-25T22:42:18.628 INFO:tasks.workunit.client.0.smithi057.stdout:9/917: link d3/d34/d42/d28/lb9 d3/d34/d42/d28/d62/d67/d6e/l122 0 2024-04-25T22:42:18.629 INFO:tasks.workunit.client.0.smithi057.stdout:3/938: dread - d0/d4/d7/d46/d30/d99/f127 zero size 2024-04-25T22:42:18.630 INFO:tasks.workunit.client.0.smithi057.stdout:7/908: dread d6/f15 [0,4194304] 0 2024-04-25T22:42:18.632 INFO:tasks.workunit.client.0.smithi057.stdout:7/909: dread - d6/d28/d4e/d30/d46/d73/dcb/f10b zero size 2024-04-25T22:42:18.636 INFO:tasks.workunit.client.0.smithi057.stdout:9/918: dwrite d3/d34/d42/d28/d39/d54/d88/f10b [0,4194304] 0 2024-04-25T22:42:18.636 INFO:tasks.workunit.client.0.smithi057.stdout:3/939: dwrite d0/d4/d34/d3c/f8c [0,4194304] 0 2024-04-25T22:42:18.636 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:18.637 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:18.638 INFO:tasks.workunit.client.0.smithi057.stdout:9/919: mkdir d3/d98/d114/d123 0 2024-04-25T22:42:18.640 INFO:tasks.workunit.client.0.smithi057.stdout:3/940: truncate d0/d4/d7/d46/d30/faa 2360595 0 2024-04-25T22:42:18.641 INFO:tasks.workunit.client.0.smithi057.stdout:7/910: dwrite d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/dd7/dd4/ffa [0,4194304] 0 2024-04-25T22:42:18.642 INFO:tasks.workunit.client.0.smithi057.stdout:3/941: write d0/d6b/db6/ff5 [2605985,44994] 0 2024-04-25T22:42:18.643 INFO:tasks.workunit.client.0.smithi057.stdout:7/911: dread - d6/daa/dda/f104 zero size 2024-04-25T22:42:18.644 INFO:tasks.workunit.client.0.smithi057.stdout:7/912: mknod d6/d28/d4e/d30/d60/d6f/d9c/dc4/c12d 0 2024-04-25T22:42:18.644 INFO:tasks.workunit.client.0.smithi057.stdout:3/942: rename d0/d4/d4a/l124 to d0/d4/d7/d26/d89/l141 0 2024-04-25T22:42:18.645 INFO:tasks.workunit.client.0.smithi057.stdout:3/943: write d0/f6 [1356264,33456] 0 2024-04-25T22:42:18.645 INFO:tasks.workunit.client.0.smithi057.stdout:7/913: stat d6/d28/d4e/d30/d60/d8d/d96/d5d/c76 0 2024-04-25T22:42:18.646 INFO:tasks.workunit.client.0.smithi057.stdout:3/944: write d0/d4/d7/d26/f112 [979273,98011] 0 2024-04-25T22:42:18.646 INFO:tasks.workunit.client.0.smithi057.stdout:9/920: read d3/d34/d42/d28/d62/d67/d6e/f77 [156806,80034] 0 2024-04-25T22:42:18.647 INFO:tasks.workunit.client.0.smithi057.stdout:3/945: unlink d0/d4/d7/d26/d110/c121 0 2024-04-25T22:42:18.648 INFO:tasks.workunit.client.0.smithi057.stdout:3/946: fsync d0/d4/d7b/d8f/f102 0 2024-04-25T22:42:18.648 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:18.643+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:18.649 INFO:tasks.workunit.client.0.smithi057.stdout:3/947: mknod d0/d4/d4a/d106/d109/c142 0 2024-04-25T22:42:18.652 INFO:tasks.workunit.client.0.smithi057.stdout:7/914: dwrite d6/d28/d4e/f2d [4194304,4194304] 0 2024-04-25T22:42:18.654 INFO:tasks.workunit.client.0.smithi057.stdout:9/921: dwrite d3/dd8/de3/fe9 [0,4194304] 0 2024-04-25T22:42:18.655 INFO:tasks.workunit.client.0.smithi057.stdout:7/915: chown d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d97 466545666 1 2024-04-25T22:42:18.655 INFO:tasks.workunit.client.0.smithi057.stdout:9/922: dread - d3/d34/d42/ff2 zero size 2024-04-25T22:42:18.657 INFO:tasks.workunit.client.0.smithi057.stdout:3/948: dwrite d0/d4/d7b/f9f [0,4194304] 0 2024-04-25T22:42:18.657 INFO:tasks.workunit.client.0.smithi057.stdout:7/916: creat d6/d28/d4e/d30/d60/d8d/d96/d51/f12e x:0 0 0 2024-04-25T22:42:18.658 INFO:tasks.workunit.client.0.smithi057.stdout:3/949: stat d0/d4/d7/d46/d30/d7a/d91/d107/f119 0 2024-04-25T22:42:18.659 INFO:tasks.workunit.client.0.smithi057.stdout:3/950: chown d0/d4/d34/f64 246 1 2024-04-25T22:42:18.660 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:18.667 INFO:tasks.workunit.client.0.smithi057.stdout:7/917: read d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/f80 [351223,47606] 0 2024-04-25T22:42:18.668 INFO:tasks.workunit.client.0.smithi057.stdout:9/923: dread d3/d34/d42/d28/d39/d54/fcb [4194304,4194304] 0 2024-04-25T22:42:18.669 INFO:tasks.workunit.client.0.smithi057.stdout:9/924: dread d3/d34/d42/f41 [0,4194304] 0 2024-04-25T22:42:18.670 INFO:tasks.workunit.client.0.smithi057.stdout:9/925: unlink d3/l59 0 2024-04-25T22:42:18.670 INFO:tasks.workunit.client.0.smithi057.stdout:9/926: rename d3/d34/d42/ffd to d3/d34/d42/d28/d39/db3/f124 0 2024-04-25T22:42:18.671 INFO:tasks.workunit.client.0.smithi057.stdout:9/927: read - d3/d34/d42/d28/d62/dcf/df3/f112 zero size 2024-04-25T22:42:18.672 INFO:tasks.workunit.client.0.smithi057.stdout:9/928: creat d3/d34/d42/d28/d39/f125 x:0 0 0 2024-04-25T22:42:18.672 INFO:tasks.workunit.client.0.smithi057.stdout:9/929: stat d3/d34/d42/d28/d65/f9b 0 2024-04-25T22:42:18.673 INFO:tasks.workunit.client.0.smithi057.stdout:9/930: write d3/d34/d42/d28/d39/db3/fdc [690118,13484] 0 2024-04-25T22:42:18.674 INFO:tasks.workunit.client.0.smithi057.stdout:9/931: write d3/f66 [1606397,97615] 0 2024-04-25T22:42:18.675 INFO:tasks.workunit.client.0.smithi057.stdout:9/932: symlink d3/d34/d42/d28/d2d/d9c/l126 0 2024-04-25T22:42:18.676 INFO:tasks.workunit.client.0.smithi057.stdout:3/951: truncate d0/d4/d7/d46/d30/d99/fbc 3076440 0 2024-04-25T22:42:18.676 INFO:tasks.workunit.client.0.smithi057.stdout:3/952: dread - d0/d4/d7/d26/f13f zero size 2024-04-25T22:42:18.677 INFO:tasks.workunit.client.0.smithi057.stdout:3/953: rename d0/d4/d34/d3c/d53/db1 to d0/d4/d7/d26/d89/d143 0 2024-04-25T22:42:18.682 INFO:tasks.workunit.client.0.smithi057.stdout:3/954: dwrite d0/d4/d7/d46/f3a [0,4194304] 0 2024-04-25T22:42:18.683 INFO:tasks.workunit.client.0.smithi057.stdout:3/955: symlink d0/d4/d7/d46/d30/db9/l144 0 2024-04-25T22:42:18.684 INFO:tasks.workunit.client.0.smithi057.stdout:3/956: unlink d0/d4/d7/d22/l35 0 2024-04-25T22:42:18.685 INFO:tasks.workunit.client.0.smithi057.stdout:9/933: truncate d3/d34/d42/d28/d62/d67/d6e/d7c/f97 980042 0 2024-04-25T22:42:18.686 INFO:tasks.workunit.client.0.smithi057.stdout:3/957: unlink d0/d4/d7/d46/d30/f9b 0 2024-04-25T22:42:18.686 INFO:tasks.workunit.client.0.smithi057.stdout:3/958: stat d0/d5b 0 2024-04-25T22:42:18.687 INFO:tasks.workunit.client.0.smithi057.stdout:9/934: rename d3/d34/d42/d28/d62/d67/d6e/d7c/db8/ldf to d3/d34/d42/d28/dc1/l127 0 2024-04-25T22:42:18.687 INFO:tasks.workunit.client.0.smithi057.stdout:8/953: dread d4/d5/f4d [0,4194304] 0 2024-04-25T22:42:18.688 INFO:tasks.workunit.client.0.smithi057.stdout:9/935: mknod d3/d34/d42/d28/d62/d67/d104/c128 0 2024-04-25T22:42:18.688 INFO:tasks.workunit.client.0.smithi057.stdout:3/959: creat d0/d4/d34/d3c/d70/dc0/f145 x:0 0 0 2024-04-25T22:42:18.689 INFO:tasks.workunit.client.0.smithi057.stdout:8/954: write d4/db/fc [3641264,111938] 0 2024-04-25T22:42:18.690 INFO:tasks.workunit.client.0.smithi057.stdout:8/955: readlink d4/d5/d17/d19/d35/d83/d92/d5b/d8c/la5 0 2024-04-25T22:42:18.694 INFO:tasks.workunit.client.0.smithi057.stdout:8/956: getdents d4/dba/d10b/d10c 0 2024-04-25T22:42:18.694 INFO:tasks.workunit.client.0.smithi057.stdout:8/957: write d4/db/dd/f18 [2804918,20584] 0 2024-04-25T22:42:18.694 INFO:tasks.workunit.client.0.smithi057.stdout:8/958: mkdir d4/d5/d17/d19/d15c 0 2024-04-25T22:42:18.694 INFO:tasks.workunit.client.0.smithi057.stdout:7/918: sync 2024-04-25T22:42:18.694 INFO:tasks.workunit.client.0.smithi057.stdout:9/936: dwrite d3/d34/d42/d28/d62/f117 [0,4194304] 0 2024-04-25T22:42:18.695 INFO:tasks.workunit.client.0.smithi057.stdout:8/959: truncate d4/db/dd/d3a/f100 875661 0 2024-04-25T22:42:18.695 INFO:tasks.workunit.client.0.smithi057.stdout:7/919: creat d6/d28/d4e/d30/d60/d6f/d9c/d11e/f12f x:0 0 0 2024-04-25T22:42:18.696 INFO:tasks.workunit.client.0.smithi057.stdout:8/960: mknod d4/d5/d17/d19/d35/c15d 0 2024-04-25T22:42:18.696 INFO:tasks.workunit.client.0.smithi057.stdout:7/920: symlink d6/d28/d4e/d30/d60/d6f/l130 0 2024-04-25T22:42:18.697 INFO:tasks.workunit.client.0.smithi057.stdout:7/921: rename d6/d28/d4e to d6/d28/d4e/d30/d60/d6f/d131 22 2024-04-25T22:42:18.697 INFO:tasks.workunit.client.0.smithi057.stdout:8/961: chown d4/d5/d17/d19/d35/d83/d92/d5b/d8c/ff0 1956986 1 2024-04-25T22:42:18.697 INFO:tasks.workunit.client.0.smithi057.stdout:7/922: dread - d6/d28/d4e/fd8 zero size 2024-04-25T22:42:18.698 INFO:tasks.workunit.client.0.smithi057.stdout:0/931: dread d0/d3/d4d/f37 [0,4194304] 0 2024-04-25T22:42:18.698 INFO:tasks.workunit.client.0.smithi057.stdout:8/962: write d4/db/d12/dc0/ffd [10361,108539] 0 2024-04-25T22:42:18.699 INFO:tasks.workunit.client.0.smithi057.stdout:0/932: fdatasync d0/d3/d4d/f81 0 2024-04-25T22:42:18.699 INFO:tasks.workunit.client.0.smithi057.stdout:8/963: chown d4/dba/le5 235057 1 2024-04-25T22:42:18.699 INFO:tasks.workunit.client.0.smithi057.stdout:8/964: fdatasync d4/db/dd/d3a/d94/f150 0 2024-04-25T22:42:18.704 INFO:tasks.workunit.client.0.smithi057.stdout:8/965: dwrite d4/db/d12/fe4 [4194304,4194304] 0 2024-04-25T22:42:18.706 INFO:tasks.workunit.client.0.smithi057.stdout:8/966: getdents d4/d5/d17/d19/d35/d83/d92/d5b/d8c/de9 0 2024-04-25T22:42:18.707 INFO:tasks.workunit.client.0.smithi057.stdout:0/933: dread d0/d3/d4d/d87/fba [0,4194304] 0 2024-04-25T22:42:18.707 INFO:tasks.workunit.client.0.smithi057.stdout:8/967: readlink d4/d5/d21/db0/led 0 2024-04-25T22:42:18.711 INFO:tasks.workunit.client.0.smithi057.stdout:9/937: write d3/d34/d42/d28/f85 [83643,85969] 0 2024-04-25T22:42:18.713 INFO:tasks.workunit.client.0.smithi057.stdout:9/938: link d3/d34/d42/d28/d62/d67/d6e/d7c/db8/fd0 d3/d34/f129 0 2024-04-25T22:42:18.713 INFO:tasks.workunit.client.0.smithi057.stdout:9/939: readlink d3/d34/d42/d28/d2d/d7a/l10f 0 2024-04-25T22:42:18.714 INFO:tasks.workunit.client.0.smithi057.stdout:0/934: truncate d0/d49/f6b 1017318 0 2024-04-25T22:42:18.714 INFO:tasks.workunit.client.0.smithi057.stdout:8/968: truncate d4/db/dd/d3a/d5c/f44 789545 0 2024-04-25T22:42:18.715 INFO:tasks.workunit.client.0.smithi057.stdout:9/940: getdents d3/d34/d42/d28/d62 0 2024-04-25T22:42:18.715 INFO:tasks.workunit.client.0.smithi057.stdout:0/935: dread - d0/d3/d4d/d87/d102/da3/dec/f8a zero size 2024-04-25T22:42:18.716 INFO:tasks.workunit.client.0.smithi057.stdout:0/936: unlink d0/d3/d4d/fd9 0 2024-04-25T22:42:18.716 INFO:tasks.workunit.client.0.smithi057.stdout:8/969: rename d4/db/d12/f127 to d4/d5/d17/f15e 0 2024-04-25T22:42:18.716 INFO:tasks.workunit.client.0.smithi057.stdout:9/941: link d3/d34/d42/d28/d62/d67/cff d3/d98/db0/c12a 0 2024-04-25T22:42:18.716 INFO:tasks.workunit.client.0.smithi057.stdout:8/970: fsync d4/db/f10f 0 2024-04-25T22:42:18.717 INFO:tasks.workunit.client.0.smithi057.stdout:0/937: creat d0/d3/d4d/d87/d91/f13b x:0 0 0 2024-04-25T22:42:18.717 INFO:tasks.workunit.client.0.smithi057.stdout:8/971: creat d4/d5/d2f/dc2/f15f x:0 0 0 2024-04-25T22:42:18.717 INFO:tasks.workunit.client.0.smithi057.stdout:9/942: mknod d3/d34/d42/d5e/d83/d118/c12b 0 2024-04-25T22:42:18.718 INFO:tasks.workunit.client.0.smithi057.stdout:8/972: chown d4/d5/d17/d19/d35/d83/d92/d5b/d8c/de9 624 1 2024-04-25T22:42:18.719 INFO:tasks.workunit.client.0.smithi057.stdout:8/973: stat d4/d5/d17/d19/d35/d83/d92/d5b/d8c/f110 0 2024-04-25T22:42:18.724 INFO:tasks.workunit.client.0.smithi057.stdout:8/974: dwrite d4/db/dd/ff6 [0,4194304] 0 2024-04-25T22:42:18.725 INFO:tasks.workunit.client.0.smithi057.stdout:8/975: readlink d4/deb/lf2 0 2024-04-25T22:42:18.725 INFO:tasks.workunit.client.0.smithi057.stdout:7/923: dread d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/fe6 [0,4194304] 0 2024-04-25T22:42:18.726 INFO:tasks.workunit.client.0.smithi057.stdout:3/960: sync 2024-04-25T22:42:18.726 INFO:tasks.workunit.client.0.smithi057.stdout:9/943: sync 2024-04-25T22:42:18.727 INFO:tasks.workunit.client.0.smithi057.stdout:7/924: creat d6/d28/d4e/d30/d60/da7/f132 x:0 0 0 2024-04-25T22:42:18.728 INFO:tasks.workunit.client.0.smithi057.stdout:9/944: mkdir d3/d34/d42/d28/d65/d12c 0 2024-04-25T22:42:18.728 INFO:tasks.workunit.client.0.smithi057.stdout:9/945: creat d3/d98/d114/f12d x:0 0 0 2024-04-25T22:42:18.729 INFO:tasks.workunit.client.0.smithi057.stdout:7/925: symlink d6/d28/d4e/d30/d60/d8d/d96/l133 0 2024-04-25T22:42:18.730 INFO:tasks.workunit.client.0.smithi057.stdout:9/946: creat d3/d34/d42/d28/d65/f12e x:0 0 0 2024-04-25T22:42:18.730 INFO:tasks.workunit.client.0.smithi057.stdout:7/926: mkdir d6/d28/d4e/d30/d46/d134 0 2024-04-25T22:42:18.731 INFO:tasks.workunit.client.0.smithi057.stdout:9/947: mkdir d3/d34/d42/d5e/d83/df1/d12f 0 2024-04-25T22:42:18.732 INFO:tasks.workunit.client.0.smithi057.stdout:7/927: fsync d6/d28/d4e/d30/d60/d8d/d96/d51/fa8 0 2024-04-25T22:42:18.733 INFO:tasks.workunit.client.0.smithi057.stdout:3/961: dwrite d0/d4/fa5 [0,4194304] 0 2024-04-25T22:42:18.733 INFO:tasks.workunit.client.0.smithi057.stdout:8/976: dwrite d4/d5/d17/d19/fa1 [0,4194304] 0 2024-04-25T22:42:18.733 INFO:tasks.workunit.client.0.smithi057.stdout:9/948: creat d3/d34/d42/d28/d2d/d7a/f130 x:0 0 0 2024-04-25T22:42:18.734 INFO:tasks.workunit.client.0.smithi057.stdout:7/928: dread - d6/d28/d4e/d30/d60/d6f/d9c/d11e/f12f zero size 2024-04-25T22:42:18.734 INFO:tasks.workunit.client.0.smithi057.stdout:3/962: mknod d0/d4/d7/d46/c146 0 2024-04-25T22:42:18.735 INFO:tasks.workunit.client.0.smithi057.stdout:8/977: symlink d4/d5/d17/l160 0 2024-04-25T22:42:18.735 INFO:tasks.workunit.client.0.smithi057.stdout:9/949: rmdir d3/d34/d42/d28/d2d/d9c 39 2024-04-25T22:42:18.736 INFO:tasks.workunit.client.0.smithi057.stdout:0/938: dread d0/d5/f32 [0,4194304] 0 2024-04-25T22:42:18.736 INFO:tasks.workunit.client.0.smithi057.stdout:8/978: write d4/d5/d2f/ff5 [86507,28656] 0 2024-04-25T22:42:18.736 INFO:tasks.workunit.client.0.smithi057.stdout:3/963: getdents d0/d4/d7/d26/d72/d10a 0 2024-04-25T22:42:18.737 INFO:tasks.workunit.client.0.smithi057.stdout:0/939: fsync d0/d5/fcd 0 2024-04-25T22:42:18.737 INFO:tasks.workunit.client.0.smithi057.stdout:7/929: getdents d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d97 0 2024-04-25T22:42:18.737 INFO:tasks.workunit.client.0.smithi057.stdout:0/940: write d0/d3/d3a/d3b/fbb [5121279,59306] 0 2024-04-25T22:42:18.739 INFO:tasks.workunit.client.0.smithi057.stdout:9/950: creat d3/d34/d42/d28/d62/d67/d6e/d7c/db8/f131 x:0 0 0 2024-04-25T22:42:18.739 INFO:tasks.workunit.client.0.smithi057.stdout:3/964: mknod d0/d4/d7/d26/d110/c147 0 2024-04-25T22:42:18.739 INFO:tasks.workunit.client.0.smithi057.stdout:0/941: dread - d0/d3/d4d/d87/fee zero size 2024-04-25T22:42:18.739 INFO:tasks.workunit.client.0.smithi057.stdout:3/965: dread - d0/d4/d34/d3c/d53/ff8 zero size 2024-04-25T22:42:18.740 INFO:tasks.workunit.client.0.smithi057.stdout:8/979: creat d4/db/d12/f161 x:0 0 0 2024-04-25T22:42:18.741 INFO:tasks.workunit.client.0.smithi057.stdout:0/942: symlink d0/d5/d53/l13c 0 2024-04-25T22:42:18.741 INFO:tasks.workunit.client.0.smithi057.stdout:7/930: getdents d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d97 0 2024-04-25T22:42:18.741 INFO:tasks.workunit.client.0.smithi057.stdout:8/980: readlink d4/db/dd/d3a/d71/l93 0 2024-04-25T22:42:18.741 INFO:tasks.workunit.client.0.smithi057.stdout:9/951: creat d3/d34/d42/d5e/d83/def/d103/f132 x:0 0 0 2024-04-25T22:42:18.742 INFO:tasks.workunit.client.0.smithi057.stdout:3/966: creat d0/d4/d7/dad/db3/f148 x:0 0 0 2024-04-25T22:42:18.742 INFO:tasks.workunit.client.0.smithi057.stdout:7/931: symlink d6/d28/d4e/d30/l135 0 2024-04-25T22:42:18.743 INFO:tasks.workunit.client.0.smithi057.stdout:9/952: mknod d3/dd8/c133 0 2024-04-25T22:42:18.743 INFO:tasks.workunit.client.0.smithi057.stdout:0/943: truncate d0/d3/d3a/d121/f100 962639 0 2024-04-25T22:42:18.743 INFO:tasks.workunit.client.0.smithi057.stdout:3/967: chown d0/d4/d7/d46/f84 99 1 2024-04-25T22:42:18.743 INFO:tasks.workunit.client.0.smithi057.stdout:7/932: mkdir d6/d28/d4e/d30/d60/d6f/d136 0 2024-04-25T22:42:18.743 INFO:tasks.workunit.client.0.smithi057.stdout:0/944: mkdir d0/d3/d4d/d87/d102/d13d 0 2024-04-25T22:42:18.744 INFO:tasks.workunit.client.0.smithi057.stdout:9/953: getdents d3/d34/d42/d28/dc1/dda 0 2024-04-25T22:42:18.744 INFO:tasks.workunit.client.0.smithi057.stdout:0/945: readlink d0/d3/d3a/d121/l11d 0 2024-04-25T22:42:18.744 INFO:tasks.workunit.client.0.smithi057.stdout:7/933: getdents d6/d28/d4e/d30/d60/d6f/d9c/d11e 0 2024-04-25T22:42:18.745 INFO:tasks.workunit.client.0.smithi057.stdout:7/934: symlink d6/d28/d4e/d30/d46/d73/dcb/df9/dfd/l137 0 2024-04-25T22:42:18.747 INFO:tasks.workunit.client.0.smithi057.stdout:7/935: getdents d6/d28/d4e/d30/d60/d6f/d9c/dc4/dd6/d101 0 2024-04-25T22:42:18.747 INFO:tasks.workunit.client.0.smithi057.stdout:9/954: write d3/f24 [394403,68144] 0 2024-04-25T22:42:18.748 INFO:tasks.workunit.client.0.smithi057.stdout:0/946: sync 2024-04-25T22:42:18.748 INFO:tasks.workunit.client.0.smithi057.stdout:7/936: symlink d6/d28/d4e/d30/d60/d8d/d96/d51/dad/da6/l138 0 2024-04-25T22:42:18.748 INFO:tasks.workunit.client.0.smithi057.stdout:0/947: creat d0/d3/d6/d14/f13e x:0 0 0 2024-04-25T22:42:18.749 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:18.743+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:18.749 INFO:tasks.workunit.client.0.smithi057.stdout:7/937: symlink d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/l139 0 2024-04-25T22:42:18.749 INFO:tasks.workunit.client.0.smithi057.stdout:0/948: mknod d0/d3/d3a/c13f 0 2024-04-25T22:42:18.750 INFO:tasks.workunit.client.0.smithi057.stdout:0/949: chown d0/d3/d4d/d87/d91/cd3 829441210 1 2024-04-25T22:42:18.751 INFO:tasks.workunit.client.0.smithi057.stdout:0/950: readlink d0/d3/d6/d14/dd1/la2 0 2024-04-25T22:42:18.752 INFO:tasks.workunit.client.0.smithi057.stdout:0/951: mknod d0/d49/d6d/dea/dfb/c140 0 2024-04-25T22:42:18.753 INFO:tasks.workunit.client.0.smithi057.stdout:9/955: dwrite d3/d34/d42/d28/d39/db3/fdc [0,4194304] 0 2024-04-25T22:42:18.756 INFO:tasks.workunit.client.0.smithi057.stdout:9/956: link d3/d34/d42/d28/d2d/d7a/l10f d3/d34/d42/d28/d39/dbd/l134 0 2024-04-25T22:42:18.758 INFO:tasks.workunit.client.0.smithi057.stdout:9/957: mknod d3/d34/d42/d28/d2d/c135 0 2024-04-25T22:42:18.758 INFO:tasks.workunit.client.0.smithi057.stdout:0/952: dwrite d0/d3/d4d/f8f [0,4194304] 0 2024-04-25T22:42:18.764 INFO:tasks.workunit.client.0.smithi057.stdout:9/958: dwrite d3/d34/f5b [0,4194304] 0 2024-04-25T22:42:18.765 INFO:tasks.workunit.client.0.smithi057.stdout:0/953: dwrite d0/d3/d4d/f35 [4194304,4194304] 0 2024-04-25T22:42:18.765 INFO:tasks.workunit.client.0.smithi057.stdout:9/959: write d3/d34/d42/ff2 [478310,43613] 0 2024-04-25T22:42:18.766 INFO:tasks.workunit.client.0.smithi057.stdout:0/954: rename d0/d3/d6/d14/d39/fe2 to d0/d5/f141 0 2024-04-25T22:42:18.767 INFO:tasks.workunit.client.0.smithi057.stdout:9/960: link d3/d34/d42/d28/d2d/c135 d3/dd8/de3/c136 0 2024-04-25T22:42:18.767 INFO:tasks.workunit.client.0.smithi057.stdout:9/961: sync 2024-04-25T22:42:18.768 INFO:tasks.workunit.client.0.smithi057.stdout:3/968: dread d0/d4/d7/d46/d30/d99/f12a [0,4194304] 0 2024-04-25T22:42:18.769 INFO:tasks.workunit.client.0.smithi057.stdout:9/962: write d3/d34/d42/d28/d39/db3/ff9 [1746890,54965] 0 2024-04-25T22:42:18.770 INFO:tasks.workunit.client.0.smithi057.stdout:3/969: fdatasync d0/d4/d7/d22/f92 0 2024-04-25T22:42:18.770 INFO:tasks.workunit.client.0.smithi057.stdout:0/955: dread d0/d3/d3a/d121/f100 [0,4194304] 0 2024-04-25T22:42:18.770 INFO:tasks.workunit.client.0.smithi057.stdout:9/963: chown d3/d34/d42/d28/d65/f9b 55378999 1 2024-04-25T22:42:18.770 INFO:tasks.workunit.client.0.smithi057.stdout:8/981: dread d4/d5/d21/f4c [0,4194304] 0 2024-04-25T22:42:18.771 INFO:tasks.workunit.client.0.smithi057.stdout:0/956: chown d0/d49/f9e 115277 1 2024-04-25T22:42:18.771 INFO:tasks.workunit.client.0.smithi057.stdout:9/964: stat d3/d34/d42/d28/d39/d54 0 2024-04-25T22:42:18.771 INFO:tasks.workunit.client.0.smithi057.stdout:0/957: chown d0/d3/d6/d14/l8e 968 1 2024-04-25T22:42:18.772 INFO:tasks.workunit.client.0.smithi057.stdout:8/982: unlink d4/d5/d17/d19/d35/d83/d92/d5b/d8c/db7/dc8/f9b 0 2024-04-25T22:42:18.773 INFO:tasks.workunit.client.0.smithi057.stdout:0/958: creat d0/d3/d3a/d121/d12e/f142 x:0 0 0 2024-04-25T22:42:18.773 INFO:tasks.workunit.client.0.smithi057.stdout:8/983: mknod d4/d5/d17/d19/d35/c162 0 2024-04-25T22:42:18.774 INFO:tasks.workunit.client.0.smithi057.stdout:0/959: unlink d0/fe1 0 2024-04-25T22:42:18.774 INFO:tasks.workunit.client.0.smithi057.stdout:0/960: chown d0/d3/d3a/c13f 437 1 2024-04-25T22:42:18.775 INFO:tasks.workunit.client.0.smithi057.stdout:0/961: mknod d0/d3/d3a/d121/d12e/c143 0 2024-04-25T22:42:18.776 INFO:tasks.workunit.client.0.smithi057.stdout:0/962: mknod d0/d49/d6d/dea/c144 0 2024-04-25T22:42:18.777 INFO:tasks.workunit.client.0.smithi057.stdout:0/963: chown d0/d3/f4 3615057 1 2024-04-25T22:42:18.778 INFO:tasks.workunit.client.0.smithi057.stdout:9/965: dread d3/d34/d42/d28/d39/db3/ff9 [0,4194304] 0 2024-04-25T22:42:18.780 INFO:tasks.workunit.client.0.smithi057.stdout:0/964: unlink d0/d5/d53/fa7 0 2024-04-25T22:42:18.780 INFO:tasks.workunit.client.0.smithi057.stdout:9/966: unlink d3/d34/d42/d5e/d83/ca4 0 2024-04-25T22:42:18.780 INFO:tasks.workunit.client.0.smithi057.stdout:8/984: dwrite d4/db/dd/d3a/f3c [4194304,4194304] 0 2024-04-25T22:42:18.781 INFO:tasks.workunit.client.0.smithi057.stdout:9/967: rename d3/d34/d42/d5e/da3 to d3/d34/d42/d28/d39/d54/d88/d120/d137 0 2024-04-25T22:42:18.787 INFO:tasks.workunit.client.0.smithi057.stdout:3/970: dread d0/d4/d7/d26/f43 [0,4194304] 0 2024-04-25T22:42:18.787 INFO:tasks.workunit.client.0.smithi057.stdout:0/965: dwrite d0/d3/d6/d83/fad [4194304,4194304] 0 2024-04-25T22:42:18.787 INFO:tasks.workunit.client.0.smithi057.stdout:8/985: dwrite d4/db/dd/d3a/f14f [0,4194304] 0 2024-04-25T22:42:18.788 INFO:tasks.workunit.client.0.smithi057.stdout:8/986: unlink d4/db/c13b 0 2024-04-25T22:42:18.789 INFO:tasks.workunit.client.0.smithi057.stdout:0/966: read d0/d3/d4d/d87/fba [110417,27923] 0 2024-04-25T22:42:18.790 INFO:tasks.workunit.client.0.smithi057.stdout:3/971: creat d0/d4/d7/d26/d72/dd0/de5/f149 x:0 0 0 2024-04-25T22:42:18.790 INFO:tasks.workunit.client.0.smithi057.stdout:0/967: fsync d0/d3/d4d/d87/da0/d116/f13a 0 2024-04-25T22:42:18.790 INFO:tasks.workunit.client.0.smithi057.stdout:9/968: dwrite d3/f64 [0,4194304] 0 2024-04-25T22:42:18.791 INFO:tasks.workunit.client.0.smithi057.stdout:3/972: fsync d0/d4/d7/d26/d72/dd0/de5/f13c 0 2024-04-25T22:42:18.792 INFO:tasks.workunit.client.0.smithi057.stdout:3/973: creat d0/d4/d7/d26/d72/dd0/d136/f14a x:0 0 0 2024-04-25T22:42:18.793 INFO:tasks.workunit.client.0.smithi057.stdout:9/969: chown d3/d34/fd1 6 1 2024-04-25T22:42:18.794 INFO:tasks.workunit.client.0.smithi057.stdout:3/974: link d0/d4/fc2 d0/d4/d7/d26/d89/d97/dc1/d128/f14b 0 2024-04-25T22:42:18.796 INFO:tasks.workunit.client.0.smithi057.stdout:3/975: symlink d0/d4/d4a/d106/d109/l14c 0 2024-04-25T22:42:18.796 INFO:tasks.workunit.client.0.smithi057.stdout:3/976: dread - d0/d4/d7/d26/f133 zero size 2024-04-25T22:42:18.800 INFO:tasks.workunit.client.0.smithi057.stdout:8/987: truncate d4/d5/d17/fce 3796254 0 2024-04-25T22:42:18.800 INFO:tasks.workunit.client.0.smithi057.stdout:8/988: sync 2024-04-25T22:42:18.802 INFO:tasks.workunit.client.0.smithi057.stdout:8/989: creat d4/d5/f163 x:0 0 0 2024-04-25T22:42:18.802 INFO:tasks.workunit.client.0.smithi057.stdout:8/990: dread - d4/dba/f114 zero size 2024-04-25T22:42:18.803 INFO:tasks.workunit.client.0.smithi057.stdout:3/977: dwrite d0/d11/f1e [0,4194304] 0 2024-04-25T22:42:18.803 INFO:tasks.workunit.client.0.smithi057.stdout:0/968: dwrite d0/d3/d3a/d121/f100 [0,4194304] 0 2024-04-25T22:42:18.803 INFO:tasks.workunit.client.0.smithi057.stdout:8/991: fdatasync d4/deb/f147 0 2024-04-25T22:42:18.804 INFO:tasks.workunit.client.0.smithi057.stdout:3/978: fsync d0/d4/d7/d26/d72/dd0/de5/f13c 0 2024-04-25T22:42:18.804 INFO:tasks.workunit.client.0.smithi057.stdout:8/992: dread - d4/deb/f147 zero size 2024-04-25T22:42:18.804 INFO:tasks.workunit.client.0.smithi057.stdout:0/969: creat d0/d3/d3a/d121/d12e/f145 x:0 0 0 2024-04-25T22:42:18.805 INFO:tasks.workunit.client.0.smithi057.stdout:3/979: write d0/d4/d34/d3c/d53/d7f/dfe/f13d [1986246,65211] 0 2024-04-25T22:42:18.805 INFO:tasks.workunit.client.0.smithi057.stdout:3/980: sync 2024-04-25T22:42:18.805 INFO:tasks.workunit.client.0.smithi057.stdout:0/970: chown d0/d49/d97/cb3 197 1 2024-04-25T22:42:18.806 INFO:tasks.workunit.client.0.smithi057.stdout:8/993: mknod d4/d5/d17/d19/d35/d83/d92/d5b/d8c/c164 0 2024-04-25T22:42:18.806 INFO:tasks.workunit.client.0.smithi057.stdout:0/971: write d0/d3/d6/f90 [675012,24124] 0 2024-04-25T22:42:18.807 INFO:tasks.workunit.client.0.smithi057.stdout:3/981: fdatasync d0/d4/d7/d46/d30/d99/f12a 0 2024-04-25T22:42:18.808 INFO:tasks.workunit.client.0.smithi057.stdout:8/994: readlink d4/dba/d111/d12d/l13d 0 2024-04-25T22:42:18.811 INFO:tasks.workunit.client.0.smithi057.stdout:7/938: dread d6/d28/d4e/d30/d60/d8d/d96/fc3 [0,4194304] 0 2024-04-25T22:42:18.812 INFO:tasks.workunit.client.0.smithi057.stdout:7/939: mknod d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d97/c13a 0 2024-04-25T22:42:18.814 INFO:tasks.workunit.client.0.smithi057.stdout:7/940: creat d6/d28/d4e/d30/d60/d8d/d96/d51/d10a/f13b x:0 0 0 2024-04-25T22:42:18.814 INFO:tasks.workunit.client.0.smithi057.stdout:0/972: dread d0/d3/d4d/d87/fed [0,4194304] 0 2024-04-25T22:42:18.815 INFO:tasks.workunit.client.0.smithi057.stdout:0/973: creat d0/d3/d3a/d121/d12e/f146 x:0 0 0 2024-04-25T22:42:18.816 INFO:tasks.workunit.client.0.smithi057.stdout:7/941: creat d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/f13c x:0 0 0 2024-04-25T22:42:18.816 INFO:tasks.workunit.client.0.smithi057.stdout:0/974: stat d0/d3/d4d/d87/da0/d116/f13a 0 2024-04-25T22:42:18.816 INFO:tasks.workunit.client.0.smithi057.stdout:0/975: readlink d0/d3/d4d/d87/d102/l11a 0 2024-04-25T22:42:18.817 INFO:tasks.workunit.client.0.smithi057.stdout:0/976: readlink d0/d5/l54 0 2024-04-25T22:42:18.818 INFO:tasks.workunit.client.0.smithi057.stdout:0/977: read d0/d3/d6/f59 [3379700,98969] 0 2024-04-25T22:42:18.819 INFO:tasks.workunit.client.0.smithi057.stdout:0/978: creat d0/d49/d97/f147 x:0 0 0 2024-04-25T22:42:18.820 INFO:tasks.workunit.client.0.smithi057.stdout:0/979: mkdir d0/d49/d6d/dea/d148 0 2024-04-25T22:42:18.820 INFO:tasks.workunit.client.0.smithi057.stdout:0/980: dread - d0/d49/d6d/f8b zero size 2024-04-25T22:42:18.821 INFO:tasks.workunit.client.0.smithi057.stdout:0/981: rmdir d0/d5/deb 39 2024-04-25T22:42:18.822 INFO:tasks.workunit.client.0.smithi057.stdout:7/942: dwrite d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d97/ffe [0,4194304] 0 2024-04-25T22:42:18.823 INFO:tasks.workunit.client.0.smithi057.stdout:7/943: write d6/fb [658626,63402] 0 2024-04-25T22:42:18.823 INFO:tasks.workunit.client.0.smithi057.stdout:0/982: rename d0/d3/d6/d14/l60 to d0/d3/d6/d14/d39/de8/l149 0 2024-04-25T22:42:18.823 INFO:tasks.workunit.client.0.smithi057.stdout:7/944: stat d6/d28/d4e/d30/d60/d8d/d96/d51/f12e 0 2024-04-25T22:42:18.825 INFO:tasks.workunit.client.0.smithi057.stdout:0/983: getdents d0/d3/d6/d14/d39 0 2024-04-25T22:42:18.825 INFO:tasks.workunit.client.0.smithi057.stdout:7/945: symlink d6/d28/d4e/d30/d60/d6f/d136/l13d 0 2024-04-25T22:42:18.826 INFO:tasks.workunit.client.0.smithi057.stdout:0/984: chown d0/d3/fcc 2695 1 2024-04-25T22:42:18.827 INFO:tasks.workunit.client.0.smithi057.stdout:7/946: creat d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/dd7/dd4/f13e x:0 0 0 2024-04-25T22:42:18.827 INFO:tasks.workunit.client.0.smithi057.stdout:0/985: symlink d0/d3/d6/d14/dd1/l14a 0 2024-04-25T22:42:18.828 INFO:tasks.workunit.client.0.smithi057.stdout:0/986: dread - d0/d3/d3a/d3b/fa9 zero size 2024-04-25T22:42:18.828 INFO:tasks.workunit.client.0.smithi057.stdout:7/947: dread - d6/d28/d4e/d30/d46/d73/dcb/ff5 zero size 2024-04-25T22:42:18.828 INFO:tasks.workunit.client.0.smithi057.stdout:0/987: chown d0/d3/f4 20056 1 2024-04-25T22:42:18.829 INFO:tasks.workunit.client.0.smithi057.stdout:0/988: symlink d0/d3/d3a/l14b 0 2024-04-25T22:42:18.829 INFO:tasks.workunit.client.0.smithi057.stdout:3/982: dread d0/f1b [0,4194304] 0 2024-04-25T22:42:18.830 INFO:tasks.workunit.client.0.smithi057.stdout:0/989: read - d0/d3/d3a/d3b/f73 zero size 2024-04-25T22:42:18.830 INFO:tasks.workunit.client.0.smithi057.stdout:0/990: fdatasync d0/d3/fcc 0 2024-04-25T22:42:18.830 INFO:tasks.workunit.client.0.smithi057.stdout:3/983: dread - d0/d4/d7/d22/f116 zero size 2024-04-25T22:42:18.831 INFO:tasks.workunit.client.0.smithi057.stdout:0/991: symlink d0/d3/l14c 0 2024-04-25T22:42:18.831 INFO:tasks.workunit.client.0.smithi057.stdout:3/984: fsync d0/d4/d7/d46/d30/d99/f127 0 2024-04-25T22:42:18.832 INFO:tasks.workunit.client.0.smithi057.stdout:0/992: fsync d0/d5/d53/f135 0 2024-04-25T22:42:18.832 INFO:tasks.workunit.client.0.smithi057.stdout:8/995: dread d4/db/dd/d3a/f66 [0,4194304] 0 2024-04-25T22:42:18.832 INFO:tasks.workunit.client.0.smithi057.stdout:3/985: creat d0/d4/d4a/dab/f14d x:0 0 0 2024-04-25T22:42:18.833 INFO:tasks.workunit.client.0.smithi057.stdout:8/996: unlink d4/deb/c103 0 2024-04-25T22:42:18.833 INFO:tasks.workunit.client.0.smithi057.stdout:0/993: creat d0/f14d x:0 0 0 2024-04-25T22:42:18.833 INFO:tasks.workunit.client.0.smithi057.stdout:7/948: write d6/f4b [233259,22274] 0 2024-04-25T22:42:18.833 INFO:tasks.workunit.client.0.smithi057.stdout:3/986: creat d0/d4/d7/d46/f14e x:0 0 0 2024-04-25T22:42:18.834 INFO:tasks.workunit.client.0.smithi057.stdout:0/994: unlink d0/d3/d4d/d87/f11c 0 2024-04-25T22:42:18.835 INFO:tasks.workunit.client.0.smithi057.stdout:3/987: creat d0/d4/d7/d46/d30/d7a/d91/f14f x:0 0 0 2024-04-25T22:42:18.835 INFO:tasks.workunit.client.0.smithi057.stdout:7/949: creat d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/f13f x:0 0 0 2024-04-25T22:42:18.835 INFO:tasks.workunit.client.0.smithi057.stdout:8/997: rename d4/db/dd/d3a/d94/dcf/df7 to d4/d5/d17/d19/d35/d83/d92/d5b/d8c/de9/d165 0 2024-04-25T22:42:18.836 INFO:tasks.workunit.client.0.smithi057.stdout:3/988: rename d0/d4/d34/f4b to d0/d4/d7/d46/d30/d7a/f150 0 2024-04-25T22:42:18.837 INFO:tasks.workunit.client.0.smithi057.stdout:7/950: rename d6/d28/d4e/d30/d46/lb8 to d6/d28/d4e/d30/d60/d8d/d96/d59/l140 0 2024-04-25T22:42:18.837 INFO:tasks.workunit.client.0.smithi057.stdout:8/998: write d4/db/dd/d3a/d5c/f149 [984093,123538] 0 2024-04-25T22:42:18.839 INFO:tasks.workunit.client.0.smithi057.stdout:9/970: dread d3/d34/d42/d28/d62/d67/f82 [0,4194304] 0 2024-04-25T22:42:18.839 INFO:tasks.workunit.client.0.smithi057.stdout:7/951: mkdir d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/da2/d141 0 2024-04-25T22:42:18.839 INFO:tasks.workunit.client.0.smithi057.stdout:7/952: sync 2024-04-25T22:42:18.839 INFO:tasks.workunit.client.0.smithi057.stdout:9/971: creat d3/f138 x:0 0 0 2024-04-25T22:42:18.840 INFO:tasks.workunit.client.0.smithi057.stdout:8/999: dread d4/d5/d17/da7/fc6 [0,4194304] 0 2024-04-25T22:42:18.840 INFO:tasks.workunit.client.0.smithi057.stdout:7/953: write d6/d28/d4e/f2d [5437148,49904] 0 2024-04-25T22:42:18.840 INFO:tasks.workunit.client.0.smithi057.stdout:0/995: dread d0/d5/d53/f67 [0,4194304] 0 2024-04-25T22:42:18.840 INFO:tasks.workunit.client.0.smithi057.stdout:3/989: dread d0/d4/d7/d46/f3a [0,4194304] 0 2024-04-25T22:42:18.841 INFO:tasks.workunit.client.0.smithi057.stdout:3/990: rmdir d0/d4/d7b/d8f 39 2024-04-25T22:42:18.842 INFO:tasks.workunit.client.0.smithi057.stdout:7/954: rename d6/d28/d4e/d30/d60/d6f/d9c/dc4/dd6/f116 to d6/d28/d4e/d30/d60/d8d/d96/d59/d84/f142 0 2024-04-25T22:42:18.843 INFO:tasks.workunit.client.0.smithi057.stdout:0/996: mknod d0/d3/c14e 0 2024-04-25T22:42:18.844 INFO:tasks.workunit.client.0.smithi057.stdout:7/955: fdatasync d6/d28/d4e/d30/d60/d6f/d9c/dc4/dd6/d101/fed 0 2024-04-25T22:42:18.844 INFO:tasks.workunit.client.0.smithi057.stdout:0/997: symlink d0/d3/d3a/d3b/d12f/l14f 0 2024-04-25T22:42:18.846 INFO:tasks.workunit.client.0.smithi057.stdout:7/956: creat d6/d28/d4e/d30/d46/d73/dcb/df9/dfd/f143 x:0 0 0 2024-04-25T22:42:18.846 INFO:tasks.workunit.client.0.smithi057.stdout:9/972: dwrite d3/d34/d42/d28/d62/dcf/df3/f112 [0,4194304] 0 2024-04-25T22:42:18.847 INFO:tasks.workunit.client.0.smithi057.stdout:3/991: dwrite d0/d4/f90 [0,4194304] 0 2024-04-25T22:42:18.848 INFO:tasks.workunit.client.0.smithi057.stdout:7/957: mkdir d6/d28/d4e/d30/d60/da7/d144 0 2024-04-25T22:42:18.848 INFO:tasks.workunit.client.0.smithi057.stdout:9/973: mkdir d3/d34/d139 0 2024-04-25T22:42:18.849 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:18.844+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:18.849 INFO:tasks.workunit.client.0.smithi057.stdout:9/974: creat d3/d34/d42/d5e/d83/df1/d12f/f13a x:0 0 0 2024-04-25T22:42:18.850 INFO:tasks.workunit.client.0.smithi057.stdout:9/975: read - d3/d34/fb2 zero size 2024-04-25T22:42:18.851 INFO:tasks.workunit.client.0.smithi057.stdout:0/998: dwrite d0/d3/d6/d14/d39/de8/f106 [0,4194304] 0 2024-04-25T22:42:18.852 INFO:tasks.workunit.client.0.smithi057.stdout:9/976: unlink d3/d34/d42/d28/d2d/dc8/f102 0 2024-04-25T22:42:18.852 INFO:tasks.workunit.client.0.smithi057.stdout:0/999: fsync d0/d5/d53/f69 0 2024-04-25T22:42:18.854 INFO:tasks.workunit.client.0.smithi057.stdout:7/958: dwrite d6/d28/f2c [0,4194304] 0 2024-04-25T22:42:18.855 INFO:tasks.workunit.client.0.smithi057.stdout:7/959: truncate d6/f9b 4327637 0 2024-04-25T22:42:18.855 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:18.856 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:18.856 INFO:tasks.workunit.client.0.smithi057.stdout:7/960: stat d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/f108 0 2024-04-25T22:42:18.858 INFO:tasks.workunit.client.0.smithi057.stdout:7/961: getdents d6/d28 0 2024-04-25T22:42:18.860 INFO:tasks.workunit.client.0.smithi057.stdout:7/962: fdatasync d6/d28/d4e/d30/d60/d6f/d9c/dc4/fcc 0 2024-04-25T22:42:18.860 INFO:tasks.workunit.client.0.smithi057.stdout:3/992: truncate d0/d4/d7/d22/da0/fa4 6200280 0 2024-04-25T22:42:18.860 INFO:tasks.workunit.client.0.smithi057.stdout:3/993: write d0/d4/d7/d26/d72/dd0/de5/f149 [567451,80516] 0 2024-04-25T22:42:18.860 INFO:tasks.workunit.client.0.smithi057.stdout:7/963: symlink d6/d28/d4e/d30/d60/d6f/df4/l145 0 2024-04-25T22:42:18.861 INFO:tasks.workunit.client.0.smithi057.stdout:3/994: mkdir d0/d6b/db6/d151 0 2024-04-25T22:42:18.861 INFO:tasks.workunit.client.0.smithi057.stdout:7/964: mkdir d6/d28/d4e/d30/d60/d6f/df4/d126/d146 0 2024-04-25T22:42:18.861 INFO:tasks.workunit.client.0.smithi057.stdout:3/995: rename d0/d4/d7/dad/lca to d0/d4/d7b/l152 0 2024-04-25T22:42:18.862 INFO:tasks.workunit.client.0.smithi057.stdout:3/996: stat d0/d4/d7/d26/d72/dd0/de5/cec 0 2024-04-25T22:42:18.862 INFO:tasks.workunit.client.0.smithi057.stdout:9/977: chown d3/d34/d42/d28/d2d/d7a/fbb 5617 1 2024-04-25T22:42:18.862 INFO:tasks.workunit.client.0.smithi057.stdout:9/978: fdatasync d3/d34/d42/d28/d2d/d7a/f9d 0 2024-04-25T22:42:18.863 INFO:tasks.workunit.client.0.smithi057.stdout:9/979: chown d3/d34/d42/ff2 1878254421 1 2024-04-25T22:42:18.864 INFO:tasks.workunit.client.0.smithi057.stdout:9/980: write d3/d34/f73 [2065020,14755] 0 2024-04-25T22:42:18.866 INFO:tasks.workunit.client.0.smithi057.stdout:7/965: dwrite d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/fe6 [0,4194304] 0 2024-04-25T22:42:18.867 INFO:tasks.workunit.client.0.smithi057.stdout:7/966: fdatasync d6/d28/d4e/f31 0 2024-04-25T22:42:18.868 INFO:tasks.workunit.client.0.smithi057.stdout:7/967: write d6/fb [926515,55056] 0 2024-04-25T22:42:18.869 INFO:tasks.workunit.client.0.smithi057.stdout:3/997: dwrite d0/d4/d7/d22/f116 [0,4194304] 0 2024-04-25T22:42:18.870 INFO:tasks.workunit.client.0.smithi057.stdout:7/968: link d6/d28/d4e/d30/d60/d8d/d96/d5d/f6a d6/d28/d4e/d30/d60/d6f/d9c/dc4/f147 0 2024-04-25T22:42:18.871 INFO:tasks.workunit.client.0.smithi057.stdout:3/998: write d0/d4/d7/d26/f13f [288785,18820] 0 2024-04-25T22:42:18.871 INFO:tasks.workunit.client.0.smithi057.stdout:7/969: chown d6/d28/d4e/d30/d46/d73/dcb 5 1 2024-04-25T22:42:18.871 INFO:tasks.workunit.client.0.smithi057.stdout:3/999: chown d0/d4/d7/d26/c45 958435951 1 2024-04-25T22:42:18.872 INFO:tasks.workunit.client.0.smithi057.stdout:9/981: read d3/d34/d42/d28/d39/d54/fcb [3895997,26625] 0 2024-04-25T22:42:18.872 INFO:tasks.workunit.client.0.smithi057.stdout:7/970: read d6/d28/d4e/d30/d60/d8d/d96/d59/f61 [278898,21486] 0 2024-04-25T22:42:18.873 INFO:tasks.workunit.client.0.smithi057.stdout:9/982: creat d3/d34/d42/d28/d39/d54/f13b x:0 0 0 2024-04-25T22:42:18.873 INFO:tasks.workunit.client.0.smithi057.stdout:9/983: creat d3/d34/d42/d5e/d83/d118/f13c x:0 0 0 2024-04-25T22:42:18.874 INFO:tasks.workunit.client.0.smithi057.stdout:7/971: chown d6/d28/d4e/d30/d60/d8d/fc1 828 1 2024-04-25T22:42:18.879 INFO:tasks.workunit.client.0.smithi057.stdout:9/984: dwrite d3/d34/d42/d28/f68 [0,4194304] 0 2024-04-25T22:42:18.880 INFO:tasks.workunit.client.0.smithi057.stdout:9/985: dread - d3/d34/d42/d28/d62/d67/d6e/d7c/db8/f131 zero size 2024-04-25T22:42:18.881 INFO:tasks.workunit.client.0.smithi057.stdout:9/986: mknod d3/d34/d42/d5e/d83/def/d103/c13d 0 2024-04-25T22:42:18.882 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:18.883 INFO:tasks.workunit.client.0.smithi057.stdout:9/987: truncate d3/d34/d42/d28/d2d/d9c/fee 61695 0 2024-04-25T22:42:18.884 INFO:tasks.workunit.client.0.smithi057.stdout:7/972: dread d6/d28/d4e/d30/d60/d8d/d96/d59/fbd [0,4194304] 0 2024-04-25T22:42:18.884 INFO:tasks.workunit.client.0.smithi057.stdout:9/988: truncate d3/d34/d42/d28/d39/d54/ff4 895876 0 2024-04-25T22:42:18.884 INFO:tasks.workunit.client.0.smithi057.stdout:7/973: chown d6/d28/d4e/d30/d60/d8d/d96/d59/fbd 524033 1 2024-04-25T22:42:18.885 INFO:tasks.workunit.client.0.smithi057.stdout:7/974: fdatasync d6/d28/d4e/d30/d60/d6f/d9c/dc4/dd6/d101/fed 0 2024-04-25T22:42:18.885 INFO:tasks.workunit.client.0.smithi057.stdout:9/989: mknod d3/d34/d42/d28/d65/dd7/c13e 0 2024-04-25T22:42:18.886 INFO:tasks.workunit.client.0.smithi057.stdout:7/975: rmdir d6/d28/d4e 39 2024-04-25T22:42:18.887 INFO:tasks.workunit.client.0.smithi057.stdout:7/976: fsync d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/f82 0 2024-04-25T22:42:18.888 INFO:tasks.workunit.client.0.smithi057.stdout:7/977: write d6/d28/d4e/d30/d60/fbb [3592105,123634] 0 2024-04-25T22:42:18.888 INFO:tasks.workunit.client.0.smithi057.stdout:7/978: write d6/d28/d4e/f8c [2286800,41055] 0 2024-04-25T22:42:18.889 INFO:tasks.workunit.client.0.smithi057.stdout:7/979: creat d6/d28/d4e/d30/d60/d8d/d96/d59/d84/f148 x:0 0 0 2024-04-25T22:42:18.890 INFO:tasks.workunit.client.0.smithi057.stdout:7/980: mknod d6/d28/d4e/d30/d60/d6f/c149 0 2024-04-25T22:42:18.890 INFO:tasks.workunit.client.0.smithi057.stdout:7/981: write d6/f54 [7036071,100627] 0 2024-04-25T22:42:18.891 INFO:tasks.workunit.client.0.smithi057.stdout:7/982: dread - d6/d28/d4e/d30/d60/fe3 zero size 2024-04-25T22:42:18.892 INFO:tasks.workunit.client.0.smithi057.stdout:7/983: getdents d6/d28/d4e/d30 0 2024-04-25T22:42:18.893 INFO:tasks.workunit.client.0.smithi057.stdout:7/984: symlink d6/d28/d4e/d30/d60/d8d/d96/d51/l14a 0 2024-04-25T22:42:18.908 INFO:tasks.workunit.client.0.smithi057.stdout:9/990: dread d3/d34/f50 [0,4194304] 0 2024-04-25T22:42:18.909 INFO:tasks.workunit.client.0.smithi057.stdout:9/991: truncate d3/d34/d42/d28/d2d/d7a/d115/fc7 882747 0 2024-04-25T22:42:18.910 INFO:tasks.workunit.client.0.smithi057.stdout:9/992: unlink d3/d34/d42/d5e/d83/def/d103/c106 0 2024-04-25T22:42:18.912 INFO:tasks.workunit.client.0.smithi057.stdout:7/985: dread d6/f3a [0,4194304] 0 2024-04-25T22:42:18.913 INFO:tasks.workunit.client.0.smithi057.stdout:7/986: mkdir d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/da2/d14b 0 2024-04-25T22:42:18.914 INFO:tasks.workunit.client.0.smithi057.stdout:7/987: mknod d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/dd7/c14c 0 2024-04-25T22:42:18.915 INFO:tasks.workunit.client.0.smithi057.stdout:7/988: write d6/d28/d4e/d30/f9d [2720717,108757] 0 2024-04-25T22:42:18.916 INFO:tasks.workunit.client.0.smithi057.stdout:9/993: dwrite d3/d34/d42/d28/d39/d54/fbe [0,4194304] 0 2024-04-25T22:42:18.916 INFO:tasks.workunit.client.0.smithi057.stdout:7/989: creat d6/d28/d4e/d30/d60/d8d/d96/d5d/f14d x:0 0 0 2024-04-25T22:42:18.917 INFO:tasks.workunit.client.0.smithi057.stdout:9/994: mkdir d3/d34/d42/d28/d39/d54/d88/d120/d137/d13f 0 2024-04-25T22:42:18.918 INFO:tasks.workunit.client.0.smithi057.stdout:7/990: rename d6/d28/d4e/d30/d46/l119 to d6/d28/d4e/d30/d60/d6f/d136/l14e 0 2024-04-25T22:42:18.918 INFO:tasks.workunit.client.0.smithi057.stdout:9/995: fdatasync d3/d34/d42/d28/d39/f125 0 2024-04-25T22:42:18.919 INFO:tasks.workunit.client.0.smithi057.stdout:9/996: chown d3/d34/d42/d28/d39/d54/d88/d120/d137/fe2 3413 1 2024-04-25T22:42:18.920 INFO:tasks.workunit.client.0.smithi057.stdout:9/997: creat d3/d34/d42/d28/d2d/d7a/d115/f140 x:0 0 0 2024-04-25T22:42:18.922 INFO:tasks.workunit.client.0.smithi057.stdout:7/991: rename d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/dd7/dd4/ffa to d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/da2/d128/f14f 0 2024-04-25T22:42:18.922 INFO:tasks.workunit.client.0.smithi057.stdout:9/998: symlink d3/d34/d42/d28/d62/d67/d6e/d7c/db8/l141 0 2024-04-25T22:42:18.922 INFO:tasks.workunit.client.0.smithi057.stdout:9/999: chown d3/f5f 62336 1 2024-04-25T22:42:18.927 INFO:tasks.workunit.client.0.smithi057.stdout:7/992: dwrite d6/d28/d4e/d30/d60/d6f/d9c/dc4/fcc [0,4194304] 0 2024-04-25T22:42:18.928 INFO:tasks.workunit.client.0.smithi057.stdout:7/993: symlink d6/d28/d4e/d30/d46/d134/l150 0 2024-04-25T22:42:18.950 INFO:tasks.workunit.client.0.smithi057.stdout:7/994: dread d6/d28/f41 [0,4194304] 0 2024-04-25T22:42:18.950 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:18.948+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:18.951 INFO:tasks.workunit.client.0.smithi057.stdout:7/995: getdents d6/d28/d4e/d30/d60/d8d/d96/d51/dad/da6 0 2024-04-25T22:42:18.952 INFO:tasks.workunit.client.0.smithi057.stdout:7/996: mknod d6/d28/d4e/d30/d60/d8d/d96/d51/d5f/d7d/da2/d14b/c151 0 2024-04-25T22:42:18.953 INFO:tasks.workunit.client.0.smithi057.stdout:7/997: creat d6/d28/d4e/d30/d60/d8d/f152 x:0 0 0 2024-04-25T22:42:18.954 INFO:tasks.workunit.client.0.smithi057.stdout:7/998: getdents d6/d91 0 2024-04-25T22:42:18.955 INFO:tasks.workunit.client.0.smithi057.stdout:7/999: mkdir d6/d28/d4e/d30/d46/d73/dcb/df9/d153 0 2024-04-25T22:42:18.957 INFO:tasks.workunit.client.0.smithi057.stderr:+ rm -rf -- ./tmp.NQ9Lo7tXV9 2024-04-25T22:42:19.014 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:19.014 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:19.029 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:19.074 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:19.075+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:19.152 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:19.148+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:19.152 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:19.152 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:19.167 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:19.253 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:19.248+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:19.260 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is unset 2024-04-25T22:42:19.333 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:19.333 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:19.347 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:19.394 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:19.392+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:19.455 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:19.451+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:19.479 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:19.479 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:19.492 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:19.556 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:19.551+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:19.650 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:19.651 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:19.657 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:19.652+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:19.666 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:19.740 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:42:19.758 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:19.756+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:19.834 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:19.834 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:19.849 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:19.898 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:19.899+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:19.903 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:19.904 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:19.904 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:19.922 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:19.923 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:19.926 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:19.926 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:19.960 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:19.960+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:19.995 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:19.995 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:19.996 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:42:19.996 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:20.011 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:20.102 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:20.103+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:20.161 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:20.160+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:20.185 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:20.185 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:20.185 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:42:20.186 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:42:20.186 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:20.201 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:20.262 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:20.260+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:20.363 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:20.360+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:20.385 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:20.385 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:20.385 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:20.386 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:20.386 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.386 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:20.386 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:20.386 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 125.785278361, 2024-04-25T22:42:20.386 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:20.386 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:20.386 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:20.386 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.386 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:20.386 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.386 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:20.387 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:20.387 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.387 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.387 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.387 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:20.387 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:20.387 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.387 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.387 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.387 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:20.387 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:20.387 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:20.387 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.387 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.387 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:20.388 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:20.388 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:20.388 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.388 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.388 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:20.388 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:20.388 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:20.388 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.388 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.388 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.388 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:20.388 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:20.388 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.389 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.389 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:20.389 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:20.389 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.389 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:20.389 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:20.389 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:20.389 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.389 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.389 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:20.389 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:20.389 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.390 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:20.390 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:20.390 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:20.390 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.390 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.390 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:20.390 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:20.390 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:20.390 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.390 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.390 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:20.390 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:20.390 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:20.390 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.391 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.391 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.391 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:20.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:20.391 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.391 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.391 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:20.391 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:20.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:20.391 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.391 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.391 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:20.391 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:20.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:20.392 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.392 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.392 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.392 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.392 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.392 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:20.392 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:20.392 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 125.78514110499999, 2024-04-25T22:42:20.392 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:20.392 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:20.392 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:20.392 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.392 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:20.392 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.393 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:20.393 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:20.393 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.393 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.393 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.393 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:20.393 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:20.393 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.393 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.393 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.393 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:20.393 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:20.393 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:20.393 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.393 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.393 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:20.394 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:20.394 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:20.394 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.394 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.394 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:20.394 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:20.394 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:20.394 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.394 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.394 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.394 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:20.394 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:20.394 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.394 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.395 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.395 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:20.395 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:20.395 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.395 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.395 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:20.395 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:20.395 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:20.395 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.395 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.395 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.395 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:20.395 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:20.395 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.395 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.396 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:20.396 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:20.396 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:20.396 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.396 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.396 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:20.396 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:20.396 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:20.396 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.396 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.396 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:20.396 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:20.396 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:20.396 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.396 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.396 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.397 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:20.397 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:20.397 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.397 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.397 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:20.397 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:20.397 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:20.397 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.397 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.397 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:20.397 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:20.397 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:20.397 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.397 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.398 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.398 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.398 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.398 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:20.398 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:20.398 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 125.784880937, 2024-04-25T22:42:20.398 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:20.398 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:20.398 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:20.398 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.398 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:20.398 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.398 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:20.398 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:20.398 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.399 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.399 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.399 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:20.399 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:20.399 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.399 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.399 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.399 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:20.399 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:20.399 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:20.399 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.399 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.399 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:20.399 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:20.399 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:20.400 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.400 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.400 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:20.400 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:20.400 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:20.400 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.400 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.400 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.400 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:20.400 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:20.400 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.400 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.400 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.400 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:20.400 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:20.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.401 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.401 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:20.401 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:20.401 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:20.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.401 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.401 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.401 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:20.401 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:20.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.401 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.401 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:20.401 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:20.401 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:20.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.402 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:20.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:20.402 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:20.402 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.402 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:20.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:20.402 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:20.402 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.402 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:20.403 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:20.403 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.403 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.403 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:20.403 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:20.403 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:20.403 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.403 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.403 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:20.403 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:20.403 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:20.403 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.403 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.403 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.403 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.403 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.404 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:20.404 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:20.404 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 125.784715738, 2024-04-25T22:42:20.404 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:20.404 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:20.404 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:20.404 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:20.404 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:20.404 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.404 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:20.404 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:20.404 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.404 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.404 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.404 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:20.404 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:20.405 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.405 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.405 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.405 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:20.405 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:20.405 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:20.405 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.405 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.405 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:20.405 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:20.405 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:20.405 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.405 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.405 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:20.406 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:20.406 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:20.406 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.406 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.406 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.406 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:20.406 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:20.406 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.406 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.406 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.406 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:20.406 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:20.406 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.406 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.407 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:20.407 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:20.407 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:20.407 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.407 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.407 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.407 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:20.407 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:20.407 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.407 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.407 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:20.407 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:20.407 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:20.407 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.408 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.408 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:20.408 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:20.408 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:20.408 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.408 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.408 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.408 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.408 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.408 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:20.408 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:20.408 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 125.78465007600001, 2024-04-25T22:42:20.408 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:20.408 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:20.408 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:20.408 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:20.409 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:20.409 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.409 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:20.409 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:20.409 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.409 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.409 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.409 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:20.409 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:20.409 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.409 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.409 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.409 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:20.409 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:20.410 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:20.410 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.410 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.410 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:20.410 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:20.410 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:20.410 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.410 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.410 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:20.410 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:20.410 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:20.410 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.410 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.410 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.411 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:20.411 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:20.411 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.411 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.411 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.411 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:20.411 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:20.411 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.411 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.411 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:20.411 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:20.411 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:20.411 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.411 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.411 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.411 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:20.412 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:20.412 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.412 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:20.412 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:20.412 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:20.412 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.412 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:20.412 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:20.412 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:20.412 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.412 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.412 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.412 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.413 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.413 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10700 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:20.413 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:20.413 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 7.8617828589999998, 2024-04-25T22:42:20.413 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066789482999999997, 2024-04-25T22:42:20.413 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:20.413 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:20.413 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.413 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:20.413 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:20.413 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.413 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10700 2024-04-25T22:42:20.413 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.413 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:20.413 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.414 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:20.414 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:20.414 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.414 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.414 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.414 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:20.414 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:20.414 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.414 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.414 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.414 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:20.414 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519112+0000", 2024-04-25T22:42:20.414 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1399999999999998e-06 2024-04-25T22:42:20.414 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.415 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.415 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:20.415 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527187+0000", 2024-04-25T22:42:20.415 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080748899999999995 2024-04-25T22:42:20.415 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.415 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.415 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:20.415 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527232+0000", 2024-04-25T22:42:20.415 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4895999999999998e-05 2024-04-25T22:42:20.415 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.415 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.415 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.415 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527259+0000", 2024-04-25T22:42:20.415 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7331999999999999e-05 2024-04-25T22:42:20.415 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.415 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.416 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.416 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529418+0000", 2024-04-25T22:42:20.416 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002158765 2024-04-25T22:42:20.416 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.416 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.416 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:20.416 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529572+0000", 2024-04-25T22:42:20.416 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015438499999999999 2024-04-25T22:42:20.416 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.416 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.416 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:20.416 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529762+0000", 2024-04-25T22:42:20.416 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018998100000000001 2024-04-25T22:42:20.416 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.416 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.416 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:20.417 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.548359+0000", 2024-04-25T22:42:20.417 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018596444 2024-04-25T22:42:20.417 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.417 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.417 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.417 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585801+0000", 2024-04-25T22:42:20.417 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.037442469999999999 2024-04-25T22:42:20.417 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.417 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.417 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:20.417 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585847+0000", 2024-04-25T22:42:20.417 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5565000000000002e-05 2024-04-25T22:42:20.417 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.417 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.417 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:20.417 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585899+0000", 2024-04-25T22:42:20.418 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2614999999999997e-05 2024-04-25T22:42:20.418 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.418 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.418 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.418 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.418 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.418 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10714 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:20.418 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:20.418 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 7.8281018959999997, 2024-04-25T22:42:20.418 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.048080623000000003, 2024-04-25T22:42:20.418 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:20.418 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:20.418 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.419 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:20.419 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:20.419 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.419 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10714 2024-04-25T22:42:20.419 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.419 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:20.419 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.419 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:20.419 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:20.419 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.419 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.419 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.419 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:20.419 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:20.419 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.420 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.420 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.420 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:20.420 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552792+0000", 2024-04-25T22:42:20.420 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:42:20.420 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.420 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.420 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:20.420 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559915+0000", 2024-04-25T22:42:20.420 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071231690000000004 2024-04-25T22:42:20.420 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.420 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.420 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:20.420 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559932+0000", 2024-04-25T22:42:20.420 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7169000000000001e-05 2024-04-25T22:42:20.421 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.421 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.421 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.421 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559942+0000", 2024-04-25T22:42:20.421 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0261999999999999e-05 2024-04-25T22:42:20.421 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.421 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.421 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.421 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560018+0000", 2024-04-25T22:42:20.421 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5358000000000006e-05 2024-04-25T22:42:20.421 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.421 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.421 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:20.421 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560118+0000", 2024-04-25T22:42:20.422 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000100911 2024-04-25T22:42:20.422 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.422 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.422 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:20.422 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560281+0000", 2024-04-25T22:42:20.422 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016288500000000001 2024-04-25T22:42:20.422 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.422 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.422 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:20.422 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.579740+0000", 2024-04-25T22:42:20.422 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019458598000000001 2024-04-25T22:42:20.422 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.422 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.422 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.422 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600484+0000", 2024-04-25T22:42:20.423 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020744483000000001 2024-04-25T22:42:20.423 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.423 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.423 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:20.423 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600664+0000", 2024-04-25T22:42:20.423 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017953899999999999 2024-04-25T22:42:20.423 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.423 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.423 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:20.423 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600871+0000", 2024-04-25T22:42:20.423 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020737199999999999 2024-04-25T22:42:20.423 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.423 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.423 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.423 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.424 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.424 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10813 4.17 4:e8010137:::100000030b0.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:20.424 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:20.424 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 7.6331528899999999, 2024-04-25T22:42:20.424 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.047503799999999999, 2024-04-25T22:42:20.424 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:20.424 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:20.424 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.424 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:20.424 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:20.424 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.424 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10813 2024-04-25T22:42:20.424 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.424 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:20.424 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.424 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:20.425 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:20.425 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.425 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.425 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.425 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:20.425 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:20.425 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.425 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.425 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.425 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:20.425 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747741+0000", 2024-04-25T22:42:20.425 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1119999999999999e-06 2024-04-25T22:42:20.425 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.425 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.426 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:20.426 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752366+0000", 2024-04-25T22:42:20.426 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046253240000000001 2024-04-25T22:42:20.426 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.426 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.426 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:20.426 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752382+0000", 2024-04-25T22:42:20.426 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5639999999999999e-05 2024-04-25T22:42:20.426 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.426 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.426 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.426 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752393+0000", 2024-04-25T22:42:20.426 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1626e-05 2024-04-25T22:42:20.426 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.426 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.426 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.427 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752459+0000", 2024-04-25T22:42:20.427 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5309999999999996e-05 2024-04-25T22:42:20.427 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.427 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.427 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:20.427 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752529+0000", 2024-04-25T22:42:20.427 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0543000000000005e-05 2024-04-25T22:42:20.427 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.427 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.427 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:20.427 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752637+0000", 2024-04-25T22:42:20.427 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010788799999999999 2024-04-25T22:42:20.427 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.427 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.427 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:20.428 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760295+0000", 2024-04-25T22:42:20.428 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076583290000000002 2024-04-25T22:42:20.428 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.428 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.428 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.428 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.794990+0000", 2024-04-25T22:42:20.428 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034694317000000002 2024-04-25T22:42:20.428 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.428 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.428 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:20.428 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795097+0000", 2024-04-25T22:42:20.428 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010768999999999999 2024-04-25T22:42:20.428 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.428 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.428 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:20.428 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795243+0000", 2024-04-25T22:42:20.429 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000146021 2024-04-25T22:42:20.429 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.429 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.429 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.429 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.429 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.429 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10816 4.17 4:e8010137:::100000030b0.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:20.429 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:20.429 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 7.6278234300000003, 2024-04-25T22:42:20.429 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042406530999999997, 2024-04-25T22:42:20.429 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:20.429 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:20.429 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.429 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:20.429 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:20.430 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.430 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10816 2024-04-25T22:42:20.430 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.430 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:20.430 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.430 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:20.430 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:20.430 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.430 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.430 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.430 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:20.430 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:20.430 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.430 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.431 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.431 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:20.431 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753070+0000", 2024-04-25T22:42:20.431 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9800000000000002e-07 2024-04-25T22:42:20.431 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.431 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.431 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:20.431 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753288+0000", 2024-04-25T22:42:20.431 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000217789 2024-04-25T22:42:20.431 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.431 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.431 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:20.431 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753301+0000", 2024-04-25T22:42:20.431 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2764e-05 2024-04-25T22:42:20.431 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.432 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.432 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.432 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753310+0000", 2024-04-25T22:42:20.432 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:42:20.432 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.432 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.432 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.432 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758240+0000", 2024-04-25T22:42:20.432 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049304910000000004 2024-04-25T22:42:20.432 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.432 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.432 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:20.432 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758374+0000", 2024-04-25T22:42:20.432 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000133428 2024-04-25T22:42:20.432 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.432 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.433 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:20.433 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758576+0000", 2024-04-25T22:42:20.433 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020177899999999999 2024-04-25T22:42:20.433 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.433 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.433 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:20.433 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760626+0000", 2024-04-25T22:42:20.433 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0020501489999999998 2024-04-25T22:42:20.433 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.433 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.433 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.433 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795329+0000", 2024-04-25T22:42:20.433 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034703352999999999 2024-04-25T22:42:20.433 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.433 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.434 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:20.434 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795414+0000", 2024-04-25T22:42:20.434 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5292999999999998e-05 2024-04-25T22:42:20.434 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.434 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.434 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:20.434 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795476+0000", 2024-04-25T22:42:20.434 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1206999999999999e-05 2024-04-25T22:42:20.434 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.434 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.434 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.434 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.434 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.434 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10914 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:20.435 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:20.435 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 7.4270230479999997, 2024-04-25T22:42:20.435 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044452984000000001, 2024-04-25T22:42:20.435 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:20.435 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:20.435 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.435 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:20.435 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:20.435 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.435 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10914 2024-04-25T22:42:20.435 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.435 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:20.435 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.435 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:20.435 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:20.436 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.436 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.436 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.436 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:20.436 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:20.436 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.436 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.436 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.436 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:20.436 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953871+0000", 2024-04-25T22:42:20.436 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1829999999999999e-06 2024-04-25T22:42:20.436 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.436 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.436 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:20.436 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.962992+0000", 2024-04-25T22:42:20.437 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091217409999999992 2024-04-25T22:42:20.437 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.437 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.437 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:20.437 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963027+0000", 2024-04-25T22:42:20.437 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4229e-05 2024-04-25T22:42:20.437 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.437 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.437 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.437 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963042+0000", 2024-04-25T22:42:20.437 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5152e-05 2024-04-25T22:42:20.437 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.437 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.437 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.438 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963143+0000", 2024-04-25T22:42:20.438 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101171 2024-04-25T22:42:20.438 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.438 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.438 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:20.438 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963269+0000", 2024-04-25T22:42:20.438 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012623499999999999 2024-04-25T22:42:20.438 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.438 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.438 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:20.438 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963453+0000", 2024-04-25T22:42:20.438 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018357900000000001 2024-04-25T22:42:20.438 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.438 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.439 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:20.439 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998133+0000", 2024-04-25T22:42:20.439 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034679789000000003 2024-04-25T22:42:20.439 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.439 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.439 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.439 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998220+0000", 2024-04-25T22:42:20.439 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7153999999999999e-05 2024-04-25T22:42:20.439 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.439 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.439 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:20.439 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998278+0000", 2024-04-25T22:42:20.439 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8035000000000003e-05 2024-04-25T22:42:20.439 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.439 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.440 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:20.440 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998323+0000", 2024-04-25T22:42:20.440 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4715999999999997e-05 2024-04-25T22:42:20.440 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.440 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.440 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.440 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.440 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.440 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10919 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:20.440 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:20.440 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 7.406711767, 2024-04-25T22:42:20.440 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044010552000000001, 2024-04-25T22:42:20.440 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:20.440 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:20.440 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.441 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:20.441 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:20.441 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.441 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10919 2024-04-25T22:42:20.441 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.441 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:20.441 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.441 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:20.441 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:20.441 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.441 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.441 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.441 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:20.441 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:20.441 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.441 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.442 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.442 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:20.442 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:20.442 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8100000000000003e-07 2024-04-25T22:42:20.442 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.442 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.442 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:20.442 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980221+0000", 2024-04-25T22:42:20.442 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060397230000000003 2024-04-25T22:42:20.442 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.442 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.442 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:20.442 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980242+0000", 2024-04-25T22:42:20.442 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1373e-05 2024-04-25T22:42:20.442 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.443 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980252+0000", 2024-04-25T22:42:20.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9990000000000003e-06 2024-04-25T22:42:20.443 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.443 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981303+0000", 2024-04-25T22:42:20.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010501670000000001 2024-04-25T22:42:20.443 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.443 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:20.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981444+0000", 2024-04-25T22:42:20.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014123799999999999 2024-04-25T22:42:20.443 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:20.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981585+0000", 2024-04-25T22:42:20.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014071999999999999 2024-04-25T22:42:20.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:20.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003640+0000", 2024-04-25T22:42:20.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022055113000000001 2024-04-25T22:42:20.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018070+0000", 2024-04-25T22:42:20.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014430877 2024-04-25T22:42:20.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:20.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018138+0000", 2024-04-25T22:42:20.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7743000000000005e-05 2024-04-25T22:42:20.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:20.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018191+0000", 2024-04-25T22:42:20.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3118000000000002e-05 2024-04-25T22:42:20.445 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.445 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.445 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.445 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:12632 4.a e64/17 4:506aad5d:::1000000310f.00000000:head v 64'203, mlcod=64'201)", 2024-04-25T22:42:20.446 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:20.446 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.7373633719999999, 2024-04-25T22:42:20.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041913617, 2024-04-25T22:42:20.446 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:20.446 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:20.446 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.446 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:20.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.446 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:20.446 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:20.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.446 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.446 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:20.446 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:20.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.447 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.447 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:20.447 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643531+0000", 2024-04-25T22:42:20.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.497e-06 2024-04-25T22:42:20.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.447 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.447 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:20.447 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650159+0000", 2024-04-25T22:42:20.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066287059999999998 2024-04-25T22:42:20.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.447 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.447 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:20.447 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650185+0000", 2024-04-25T22:42:20.448 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5646000000000001e-05 2024-04-25T22:42:20.448 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.448 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.448 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.448 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650205+0000", 2024-04-25T22:42:20.448 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9720000000000001e-05 2024-04-25T22:42:20.448 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.448 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.448 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.448 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650521+0000", 2024-04-25T22:42:20.448 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00031590699999999998 2024-04-25T22:42:20.448 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.448 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.448 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:20.448 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650574+0000", 2024-04-25T22:42:20.449 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3192000000000002e-05 2024-04-25T22:42:20.449 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.449 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:20.449 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685374+0000", 2024-04-25T22:42:20.449 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034799902000000001 2024-04-25T22:42:20.449 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.449 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:20.449 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685443+0000", 2024-04-25T22:42:20.449 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9047000000000005e-05 2024-04-25T22:42:20.449 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.449 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.449 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.449 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.450 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12644 4.11 4:8893db93:::100000034c2.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:20.450 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:20.450 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.7289544819999998, 2024-04-25T22:42:20.450 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045039497999999997, 2024-04-25T22:42:20.450 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:20.450 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:20.450 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.450 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:20.450 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:20.450 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.450 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12644 2024-04-25T22:42:20.450 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.450 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:20.451 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.451 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:20.451 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:20.451 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.451 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.451 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.451 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:20.451 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:20.451 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.451 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.451 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.451 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:20.451 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651940+0000", 2024-04-25T22:42:20.451 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.013e-06 2024-04-25T22:42:20.452 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:20.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659663+0000", 2024-04-25T22:42:20.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077228150000000001 2024-04-25T22:42:20.452 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:20.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659694+0000", 2024-04-25T22:42:20.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1112999999999998e-05 2024-04-25T22:42:20.452 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659715+0000", 2024-04-25T22:42:20.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1053e-05 2024-04-25T22:42:20.453 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.453 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.453 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.453 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659842+0000", 2024-04-25T22:42:20.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012738100000000001 2024-04-25T22:42:20.453 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.453 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.453 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:20.453 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660068+0000", 2024-04-25T22:42:20.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000225746 2024-04-25T22:42:20.453 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.453 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.453 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:20.453 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660307+0000", 2024-04-25T22:42:20.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000238352 2024-04-25T22:42:20.454 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.454 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.454 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:20.454 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.683776+0000", 2024-04-25T22:42:20.454 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023469891999999999 2024-04-25T22:42:20.454 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.454 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.454 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.454 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696810+0000", 2024-04-25T22:42:20.454 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013033385999999999 2024-04-25T22:42:20.454 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.454 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.454 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:20.454 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696904+0000", 2024-04-25T22:42:20.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3820000000000006e-05 2024-04-25T22:42:20.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.455 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:20.455 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696978+0000", 2024-04-25T22:42:20.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3926999999999999e-05 2024-04-25T22:42:20.455 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.455 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.455 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.455 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12645 4.2d 4:b45456a9:::10000003241.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:20.455 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:20.455 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.7211339949999998, 2024-04-25T22:42:20.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.043099660999999997, 2024-04-25T22:42:20.455 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:20.456 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:20.456 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.456 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:20.456 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:20.456 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.456 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12645 2024-04-25T22:42:20.456 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.456 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:20.456 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.456 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:20.456 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:20.456 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.456 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.456 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.456 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:20.456 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:20.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.457 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.457 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.457 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:20.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659761+0000", 2024-04-25T22:42:20.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8459999999999999e-06 2024-04-25T22:42:20.457 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.457 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.457 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:20.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666663+0000", 2024-04-25T22:42:20.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0069017080000000003 2024-04-25T22:42:20.457 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.457 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.457 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:20.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666684+0000", 2024-04-25T22:42:20.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0706000000000001e-05 2024-04-25T22:42:20.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.458 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.458 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.458 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666700+0000", 2024-04-25T22:42:20.458 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5985999999999999e-05 2024-04-25T22:42:20.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.458 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.458 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.458 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666914+0000", 2024-04-25T22:42:20.458 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000213861 2024-04-25T22:42:20.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.458 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.458 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:20.458 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.667082+0000", 2024-04-25T22:42:20.458 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016809 2024-04-25T22:42:20.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.459 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.459 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:20.459 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702598+0000", 2024-04-25T22:42:20.459 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035515962999999998 2024-04-25T22:42:20.459 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.459 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.459 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:20.459 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702705+0000", 2024-04-25T22:42:20.459 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010689800000000001 2024-04-25T22:42:20.459 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.459 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.459 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:20.459 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702858+0000", 2024-04-25T22:42:20.459 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015360300000000001 2024-04-25T22:42:20.459 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.459 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.460 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.460 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.460 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.460 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12829 4.3b 4:de8bdadd:::100000033c7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:20.460 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:20.460 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.49287408, 2024-04-25T22:42:20.460 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042457306, 2024-04-25T22:42:20.460 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:20.460 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:20.460 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.460 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:20.460 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:20.460 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.460 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12829 2024-04-25T22:42:20.460 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.461 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:20.461 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.461 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:20.461 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:20.461 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.461 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.461 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.461 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:20.461 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:20.461 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.461 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.461 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.461 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:20.461 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888019+0000", 2024-04-25T22:42:20.461 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3300000000000002e-07 2024-04-25T22:42:20.461 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.461 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.462 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:20.462 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891638+0000", 2024-04-25T22:42:20.462 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036189109999999998 2024-04-25T22:42:20.462 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.462 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.462 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:20.462 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891661+0000", 2024-04-25T22:42:20.462 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3345000000000001e-05 2024-04-25T22:42:20.462 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.462 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.462 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.462 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891671+0000", 2024-04-25T22:42:20.462 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0115000000000001e-05 2024-04-25T22:42:20.462 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.463 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891737+0000", 2024-04-25T22:42:20.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5600999999999998e-05 2024-04-25T22:42:20.463 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.463 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:20.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891856+0000", 2024-04-25T22:42:20.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011881 2024-04-25T22:42:20.463 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.463 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:20.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930251+0000", 2024-04-25T22:42:20.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.038395141000000001 2024-04-25T22:42:20.463 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.464 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.464 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:20.464 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930389+0000", 2024-04-25T22:42:20.464 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013849000000000001 2024-04-25T22:42:20.464 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.464 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.464 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:20.464 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930476+0000", 2024-04-25T22:42:20.464 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6360000000000007e-05 2024-04-25T22:42:20.464 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.464 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.464 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.464 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.464 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.464 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13009 4.1e 4:78728bd7:::100000033a5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:20.464 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:20.465 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.2909870679999997, 2024-04-25T22:42:20.465 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049997452999999997, 2024-04-25T22:42:20.465 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:20.465 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:20.465 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.465 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:20.465 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:20.465 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.465 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13009 2024-04-25T22:42:20.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.465 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:20.465 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.465 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:20.465 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:20.465 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.466 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.466 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:20.466 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:20.466 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.466 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.466 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.466 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:20.466 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:20.466 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4799999999999997e-07 2024-04-25T22:42:20.466 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.466 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.466 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:20.466 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097105+0000", 2024-04-25T22:42:20.466 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071984060000000001 2024-04-25T22:42:20.466 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.467 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.467 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:20.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097118+0000", 2024-04-25T22:42:20.467 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2865e-05 2024-04-25T22:42:20.467 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.467 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.467 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097127+0000", 2024-04-25T22:42:20.467 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8449999999999998e-06 2024-04-25T22:42:20.467 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.467 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.467 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097174+0000", 2024-04-25T22:42:20.467 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6084000000000001e-05 2024-04-25T22:42:20.467 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.468 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.468 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:20.468 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097232+0000", 2024-04-25T22:42:20.468 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8928999999999998e-05 2024-04-25T22:42:20.468 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.468 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.468 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:20.468 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097309+0000", 2024-04-25T22:42:20.468 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7014999999999994e-05 2024-04-25T22:42:20.468 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.468 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.468 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:20.468 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.108708+0000", 2024-04-25T22:42:20.468 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011398233000000001 2024-04-25T22:42:20.468 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.469 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.469 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.469 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139793+0000", 2024-04-25T22:42:20.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031084856000000001 2024-04-25T22:42:20.469 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.469 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.469 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:20.469 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139848+0000", 2024-04-25T22:42:20.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5464000000000003e-05 2024-04-25T22:42:20.469 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.469 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.469 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:20.469 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139903+0000", 2024-04-25T22:42:20.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4907999999999997e-05 2024-04-25T22:42:20.469 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.469 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.470 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.470 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.470 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.470 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13318 4.16 4:6810bf9e:::10000003259.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:20.470 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:20.470 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 3.9204127099999999, 2024-04-25T22:42:20.470 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057538179000000002, 2024-04-25T22:42:20.470 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:20.470 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:20.470 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.470 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:20.470 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:20.470 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.470 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13318 2024-04-25T22:42:20.470 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.470 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:20.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:20.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:20.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.471 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:20.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:20.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.471 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:20.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460481+0000", 2024-04-25T22:42:20.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:42:20.471 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:20.472 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466775+0000", 2024-04-25T22:42:20.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062944239999999999 2024-04-25T22:42:20.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:20.472 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466787+0000", 2024-04-25T22:42:20.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1688999999999999e-05 2024-04-25T22:42:20.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.472 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466793+0000", 2024-04-25T22:42:20.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7209999999999999e-06 2024-04-25T22:42:20.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.473 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466845+0000", 2024-04-25T22:42:20.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2166999999999997e-05 2024-04-25T22:42:20.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.473 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:20.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466912+0000", 2024-04-25T22:42:20.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7016999999999999e-05 2024-04-25T22:42:20.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.473 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:20.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.467020+0000", 2024-04-25T22:42:20.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010827699999999999 2024-04-25T22:42:20.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.474 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:20.474 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.476718+0000", 2024-04-25T22:42:20.474 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0096980439999999994 2024-04-25T22:42:20.474 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.474 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.474 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517860+0000", 2024-04-25T22:42:20.474 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041141847000000002 2024-04-25T22:42:20.474 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.474 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:20.474 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517924+0000", 2024-04-25T22:42:20.474 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3997000000000004e-05 2024-04-25T22:42:20.474 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.475 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:20.475 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.518018+0000", 2024-04-25T22:42:20.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4139000000000001e-05 2024-04-25T22:42:20.475 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.475 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.475 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.475 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.475 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.475 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13328 4.16 4:6a9ab238:::1000000339b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:20.475 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:20.475 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 3.9014997249999999, 2024-04-25T22:42:20.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057072695999999999, 2024-04-25T22:42:20.475 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:20.475 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:20.475 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.475 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:20.476 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:20.476 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.476 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13328 2024-04-25T22:42:20.476 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.476 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:20.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.476 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:20.476 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:20.476 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.476 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.476 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:20.476 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:20.476 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:20.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479395+0000", 2024-04-25T22:42:20.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2859999999999998e-06 2024-04-25T22:42:20.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:20.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486667+0000", 2024-04-25T22:42:20.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072715599999999998 2024-04-25T22:42:20.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:20.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486677+0000", 2024-04-25T22:42:20.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0305e-05 2024-04-25T22:42:20.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.478 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.478 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486683+0000", 2024-04-25T22:42:20.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5300000000000004e-06 2024-04-25T22:42:20.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.478 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.478 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486768+0000", 2024-04-25T22:42:20.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5725999999999999e-05 2024-04-25T22:42:20.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.478 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:20.478 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486905+0000", 2024-04-25T22:42:20.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013696699999999999 2024-04-25T22:42:20.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:20.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.487121+0000", 2024-04-25T22:42:20.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021615299999999999 2024-04-25T22:42:20.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:20.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.509675+0000", 2024-04-25T22:42:20.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022553225999999999 2024-04-25T22:42:20.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536355+0000", 2024-04-25T22:42:20.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026680855 2024-04-25T22:42:20.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.480 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.480 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:20.480 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536401+0000", 2024-04-25T22:42:20.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5649000000000003e-05 2024-04-25T22:42:20.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.480 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.480 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:20.480 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536466+0000", 2024-04-25T22:42:20.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4438999999999997e-05 2024-04-25T22:42:20.480 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.480 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.480 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.480 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.480 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13329 4.26 4:64e005a2:::10000003483.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:20.481 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:20.481 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 3.8941913260000001, 2024-04-25T22:42:20.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066502845000000005, 2024-04-25T22:42:20.481 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:20.481 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:20.481 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.481 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:20.481 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:20.481 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.481 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13329 2024-04-25T22:42:20.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.481 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:20.481 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.481 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:20.481 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:20.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.482 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.482 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:20.482 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:20.482 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.482 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.482 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.482 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:20.482 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486703+0000", 2024-04-25T22:42:20.482 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3909999999999999e-06 2024-04-25T22:42:20.482 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.482 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.482 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:20.482 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494612+0000", 2024-04-25T22:42:20.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0079096670000000004 2024-04-25T22:42:20.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:20.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494626+0000", 2024-04-25T22:42:20.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3263e-05 2024-04-25T22:42:20.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494637+0000", 2024-04-25T22:42:20.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.171e-05 2024-04-25T22:42:20.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494720+0000", 2024-04-25T22:42:20.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2767000000000002e-05 2024-04-25T22:42:20.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.484 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:20.484 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494834+0000", 2024-04-25T22:42:20.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011387699999999999 2024-04-25T22:42:20.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.484 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:20.484 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494998+0000", 2024-04-25T22:42:20.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016390799999999999 2024-04-25T22:42:20.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.484 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:20.484 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517407+0000", 2024-04-25T22:42:20.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022409068000000001 2024-04-25T22:42:20.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.485 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.485 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553040+0000", 2024-04-25T22:42:20.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035633155 2024-04-25T22:42:20.485 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.485 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:20.485 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553140+0000", 2024-04-25T22:42:20.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9623000000000005e-05 2024-04-25T22:42:20.485 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.485 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:20.485 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553204+0000", 2024-04-25T22:42:20.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4416000000000001e-05 2024-04-25T22:42:20.485 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.485 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.486 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.486 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.486 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.486 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13399 4.16 4:6bb7cc3a:::10000003648.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:20.486 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:20.486 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 3.8208255260000001, 2024-04-25T22:42:20.486 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045625003999999997, 2024-04-25T22:42:20.486 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:20.486 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:20.486 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.486 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:20.486 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:20.486 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.486 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13399 2024-04-25T22:42:20.486 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.487 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:20.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:20.487 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:20.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.487 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:20.487 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:20.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:20.487 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:20.487 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560068+0000", 2024-04-25T22:42:20.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:42:20.487 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.488 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:20.488 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576902+0000", 2024-04-25T22:42:20.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016833806 2024-04-25T22:42:20.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.488 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:20.488 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576916+0000", 2024-04-25T22:42:20.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3648e-05 2024-04-25T22:42:20.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.488 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.488 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576927+0000", 2024-04-25T22:42:20.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0992000000000001e-05 2024-04-25T22:42:20.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:20.489 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577026+0000", 2024-04-25T22:42:20.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9116000000000004e-05 2024-04-25T22:42:20.489 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:20.489 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577203+0000", 2024-04-25T22:42:20.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017700499999999999 2024-04-25T22:42:20.489 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:20.489 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577336+0000", 2024-04-25T22:42:20.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013340800000000001 2024-04-25T22:42:20.489 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:20.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.589077+0000", 2024-04-25T22:42:20.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011741151 2024-04-25T22:42:20.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605436+0000", 2024-04-25T22:42:20.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016359146000000001 2024-04-25T22:42:20.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:20.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605493+0000", 2024-04-25T22:42:20.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7067000000000001e-05 2024-04-25T22:42:20.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:20.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:20.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:20.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605692+0000", 2024-04-25T22:42:20.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00019855799999999999 2024-04-25T22:42:20.491 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.491 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.491 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.491 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:20.491 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:20.491 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:20.492 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:20.493 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:20.492+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:20.593 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:20.591+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:20.623 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:20.623 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:20.624 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:42:20.624 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:20.637 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:20.694 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:20.691+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:20.786 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:20.786 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:20.787 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:42:20.787 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:42:20.787 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:20.794 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:20.791+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:20.800 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:20.895 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:20.895+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:20.920 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:42:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:42:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.321138365, 2024-04-25T22:42:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:42:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:20.920 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:42:20.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:42:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:42:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:42:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:42:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:42:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:42:20.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:42:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:42:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:42:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:42:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:42:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:42:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:42:20.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:42:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:42:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:42:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:42:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:42:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:42:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:42:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:42:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:42:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:42:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:42:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:42:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.321030052, 2024-04-25T22:42:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:42:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:42:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:42:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:42:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:42:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:42:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:42:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:42:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:42:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:42:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:42:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:42:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:42:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:42:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:42:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:42:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:42:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:42:20.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:42:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:42:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:42:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:42:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:42:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:42:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:42:20.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:42:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:42:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.320963396, 2024-04-25T22:42:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:42:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:20.931 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:20.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:42:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:42:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:42:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:42:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:42:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:42:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:42:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:42:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:42:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:42:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:42:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:42:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:42:20.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:42:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:42:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:42:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:42:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:42:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:42:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:42:20.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:42:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:42:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:42:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:42:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:42:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:42:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:20.936 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.3208728, 2024-04-25T22:42:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:42:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:42:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:42:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:42:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:42:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:42:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:42:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:42:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:42:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:42:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:42:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:42:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:42:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:42:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:42:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:42:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:42:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:42:20.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:42:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:42:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:42:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:42:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:42:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:42:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:42:20.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:42:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:42:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.320808227, 2024-04-25T22:42:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:42:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:20.942 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:42:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:42:20.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:42:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:42:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:42:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:42:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:42:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:42:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:42:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:42:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:42:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:42:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:42:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:42:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:42:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:42:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:42:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:42:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:42:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:20.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:42:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:42:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:42:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:42:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:42:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:42:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.947 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.32074280400001, 2024-04-25T22:42:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:42:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:20.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:42:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:42:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:42:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:42:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:42:20.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:42:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:42:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:42:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:42:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:42:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:42:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:42:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:42:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:42:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:42:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:42:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:42:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:42:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:42:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:42:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:42:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:42:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:42:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:20.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:42:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:42:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 126.32046226999999, 2024-04-25T22:42:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:42:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:42:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:42:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:42:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:42:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:42:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:42:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:42:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:42:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:42:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:42:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:42:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:42:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:42:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:42:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:42:20.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:42:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:42:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:42:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:42:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:42:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:42:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:42:20.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:42:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:42:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:42:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:42:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10678 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:20.958 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.4291775310000006, 2024-04-25T22:42:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050477795999999998, 2024-04-25T22:42:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10678 2024-04-25T22:42:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488127+0000", 2024-04-25T22:42:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.716e-06 2024-04-25T22:42:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496392+0000", 2024-04-25T22:42:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082651500000000006 2024-04-25T22:42:20.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496428+0000", 2024-04-25T22:42:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5441999999999997e-05 2024-04-25T22:42:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496451+0000", 2024-04-25T22:42:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3529000000000001e-05 2024-04-25T22:42:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496601+0000", 2024-04-25T22:42:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014935600000000001 2024-04-25T22:42:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496856+0000", 2024-04-25T22:42:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025537900000000002 2024-04-25T22:42:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.497206+0000", 2024-04-25T22:42:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000350599 2024-04-25T22:42:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538231+0000", 2024-04-25T22:42:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041024146999999997 2024-04-25T22:42:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538298+0000", 2024-04-25T22:42:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7688000000000007e-05 2024-04-25T22:42:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538467+0000", 2024-04-25T22:42:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000168178 2024-04-25T22:42:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538603+0000", 2024-04-25T22:42:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013661200000000001 2024-04-25T22:42:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:20.963 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10692 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.4125877370000008, 2024-04-25T22:42:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.061242408999999998, 2024-04-25T22:42:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10692 2024-04-25T22:42:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:20.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504717+0000", 2024-04-25T22:42:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6199999999999999e-06 2024-04-25T22:42:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:20.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511770+0000", 2024-04-25T22:42:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0070530929999999999 2024-04-25T22:42:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511810+0000", 2024-04-25T22:42:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0635e-05 2024-04-25T22:42:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511837+0000", 2024-04-25T22:42:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6423000000000001e-05 2024-04-25T22:42:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520096+0000", 2024-04-25T22:42:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082593730000000004 2024-04-25T22:42:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520345+0000", 2024-04-25T22:42:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024908800000000001 2024-04-25T22:42:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520794+0000", 2024-04-25T22:42:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000449023 2024-04-25T22:42:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538675+0000", 2024-04-25T22:42:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017880991999999998 2024-04-25T22:42:20.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565761+0000", 2024-04-25T22:42:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027085260999999999 2024-04-25T22:42:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565892+0000", 2024-04-25T22:42:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013152300000000001 2024-04-25T22:42:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565958+0000", 2024-04-25T22:42:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5377999999999996e-05 2024-04-25T22:42:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:20.968 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10693 4.2c 4:36971e45:::100000030bd.00000001:head [write 971225~86041] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.4054093749999996, 2024-04-25T22:42:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054529782999999998, 2024-04-25T22:42:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10693 2024-04-25T22:42:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:20.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511897+0000", 2024-04-25T22:42:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2499999999999998e-06 2024-04-25T22:42:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512094+0000", 2024-04-25T22:42:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019700100000000001 2024-04-25T22:42:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512121+0000", 2024-04-25T22:42:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7288999999999999e-05 2024-04-25T22:42:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512137+0000", 2024-04-25T22:42:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.592e-05 2024-04-25T22:42:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.533845+0000", 2024-04-25T22:42:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021707595999999999 2024-04-25T22:42:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534176+0000", 2024-04-25T22:42:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033187000000000001 2024-04-25T22:42:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534626+0000", 2024-04-25T22:42:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00045008599999999999 2024-04-25T22:42:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.539165+0000", 2024-04-25T22:42:20.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045386380000000002 2024-04-25T22:42:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566169+0000", 2024-04-25T22:42:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027004199 2024-04-25T22:42:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566317+0000", 2024-04-25T22:42:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014747999999999999 2024-04-25T22:42:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566423+0000", 2024-04-25T22:42:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010645399999999999 2024-04-25T22:42:20.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10696 4.2b 4:d56d2a96:::100000030c3.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.4037017299999999, 2024-04-25T22:42:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052282190999999999, 2024-04-25T22:42:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:20.974 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10696 2024-04-25T22:42:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513603+0000", 2024-04-25T22:42:20.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.283e-06 2024-04-25T22:42:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518647+0000", 2024-04-25T22:42:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050440859999999997 2024-04-25T22:42:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518672+0000", 2024-04-25T22:42:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4468e-05 2024-04-25T22:42:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518691+0000", 2024-04-25T22:42:20.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9213999999999999e-05 2024-04-25T22:42:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518806+0000", 2024-04-25T22:42:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115296 2024-04-25T22:42:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519011+0000", 2024-04-25T22:42:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020445700000000001 2024-04-25T22:42:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519207+0000", 2024-04-25T22:42:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000196431 2024-04-25T22:42:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531309+0000", 2024-04-25T22:42:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012101694 2024-04-25T22:42:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565622+0000", 2024-04-25T22:42:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034312976000000002 2024-04-25T22:42:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565769+0000", 2024-04-25T22:42:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014715900000000001 2024-04-25T22:42:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565883+0000", 2024-04-25T22:42:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000114127 2024-04-25T22:42:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10701 4.a 4:51b6a63a:::100000030f2.00000000:head [write 0~3014656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.3922577199999999, 2024-04-25T22:42:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047414393999999999, 2024-04-25T22:42:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.979 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10701 2024-04-25T22:42:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525048+0000", 2024-04-25T22:42:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0819999999999999e-06 2024-04-25T22:42:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531709+0000", 2024-04-25T22:42:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066610929999999999 2024-04-25T22:42:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531751+0000", 2024-04-25T22:42:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1650000000000003e-05 2024-04-25T22:42:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531788+0000", 2024-04-25T22:42:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7305000000000003e-05 2024-04-25T22:42:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531943+0000", 2024-04-25T22:42:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015500600000000001 2024-04-25T22:42:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532086+0000", 2024-04-25T22:42:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014238599999999999 2024-04-25T22:42:20.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532295+0000", 2024-04-25T22:42:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020922000000000001 2024-04-25T22:42:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.545987+0000", 2024-04-25T22:42:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013692582999999999 2024-04-25T22:42:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572315+0000", 2024-04-25T22:42:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026327488 2024-04-25T22:42:20.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572381+0000", 2024-04-25T22:42:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5609000000000002e-05 2024-04-25T22:42:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572460+0000", 2024-04-25T22:42:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8972000000000002e-05 2024-04-25T22:42:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:10700 4.11 e63/57 4:88409fbf:::100000030ec.00000000:head v 63'193, mlcod=62'191)", 2024-04-25T22:42:20.984 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.3814282640000002, 2024-04-25T22:42:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050517667000000002, 2024-04-25T22:42:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:20.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535876+0000", 2024-04-25T22:42:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0300000000000001e-06 2024-04-25T22:42:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565275+0000", 2024-04-25T22:42:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029399033000000001 2024-04-25T22:42:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565358+0000", 2024-04-25T22:42:20.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3403000000000001e-05 2024-04-25T22:42:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565380+0000", 2024-04-25T22:42:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1761999999999999e-05 2024-04-25T22:42:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565505+0000", 2024-04-25T22:42:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000125153 2024-04-25T22:42:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565550+0000", 2024-04-25T22:42:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5479000000000003e-05 2024-04-25T22:42:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586328+0000", 2024-04-25T22:42:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020777982 2024-04-25T22:42:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586392+0000", 2024-04-25T22:42:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3825000000000006e-05 2024-04-25T22:42:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12632 4.a 4:506aad5d:::1000000310f.00000000:head [write 0~4194304 [2@2043125]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:20.988 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.2823731379999996, 2024-04-25T22:42:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051574097999999999, 2024-04-25T22:42:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12632 2024-04-25T22:42:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634932+0000", 2024-04-25T22:42:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1600000000000001e-06 2024-04-25T22:42:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642614+0000", 2024-04-25T22:42:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076823000000000004 2024-04-25T22:42:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642660+0000", 2024-04-25T22:42:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6016000000000001e-05 2024-04-25T22:42:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642686+0000", 2024-04-25T22:42:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5491999999999999e-05 2024-04-25T22:42:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642870+0000", 2024-04-25T22:42:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000184045 2024-04-25T22:42:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643122+0000", 2024-04-25T22:42:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025242299999999999 2024-04-25T22:42:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643634+0000", 2024-04-25T22:42:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051145800000000001 2024-04-25T22:42:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.682287+0000", 2024-04-25T22:42:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038653342 2024-04-25T22:42:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686419+0000", 2024-04-25T22:42:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0041325169999999996 2024-04-25T22:42:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686464+0000", 2024-04-25T22:42:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4171000000000001e-05 2024-04-25T22:42:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686504+0000", 2024-04-25T22:42:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0173999999999999e-05 2024-04-25T22:42:20.993 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12691 4.39 4:9d0d8843:::100000030ef.00000000:head [write 0~4194304 [3@92787]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.1866520490000001, 2024-04-25T22:42:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045521998000000001, 2024-04-25T22:42:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12691 2024-04-25T22:42:20.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730653+0000", 2024-04-25T22:42:20.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1799999999999999e-06 2024-04-25T22:42:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738136+0000", 2024-04-25T22:42:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0074832789999999998 2024-04-25T22:42:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738169+0000", 2024-04-25T22:42:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3115999999999999e-05 2024-04-25T22:42:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738190+0000", 2024-04-25T22:42:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1060000000000002e-05 2024-04-25T22:42:20.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738264+0000", 2024-04-25T22:42:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3150000000000003e-05 2024-04-25T22:42:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738333+0000", 2024-04-25T22:42:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9314999999999996e-05 2024-04-25T22:42:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738425+0000", 2024-04-25T22:42:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2498999999999996e-05 2024-04-25T22:42:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.745181+0000", 2024-04-25T22:42:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067553240000000001 2024-04-25T22:42:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776101+0000", 2024-04-25T22:42:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.030920033 2024-04-25T22:42:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776140+0000", 2024-04-25T22:42:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9706999999999998e-05 2024-04-25T22:42:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776173+0000", 2024-04-25T22:42:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2335000000000001e-05 2024-04-25T22:42:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12813 4.18 4:1945bfc2:::10000003578.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.0481285680000001, 2024-04-25T22:42:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054261216000000001, 2024-04-25T22:42:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:20.999 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12813 2024-04-25T22:42:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869175+0000", 2024-04-25T22:42:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3200000000000005e-07 2024-04-25T22:42:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872980+0000", 2024-04-25T22:42:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038049720000000002 2024-04-25T22:42:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872988+0000", 2024-04-25T22:42:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5429999999999994e-06 2024-04-25T22:42:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872993+0000", 2024-04-25T22:42:21.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8570000000000003e-06 2024-04-25T22:42:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873054+0000", 2024-04-25T22:42:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0801000000000003e-05 2024-04-25T22:42:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873140+0000", 2024-04-25T22:42:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6236999999999994e-05 2024-04-25T22:42:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873271+0000", 2024-04-25T22:42:21.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130541 2024-04-25T22:42:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.884240+0000", 2024-04-25T22:42:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010969527 2024-04-25T22:42:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923308+0000", 2024-04-25T22:42:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039067317999999997 2024-04-25T22:42:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923373+0000", 2024-04-25T22:42:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5055000000000006e-05 2024-04-25T22:42:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923436+0000", 2024-04-25T22:42:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2732999999999997e-05 2024-04-25T22:42:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13328 4.16 e65/54 4:6a9ab238:::1000000339b.00000000:head v 65'186, mlcod=65'183)", 2024-04-25T22:42:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.4276685000000002, 2024-04-25T22:42:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.046438762000000001, 2024-04-25T22:42:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.004 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:21.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:21.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489637+0000", 2024-04-25T22:42:21.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.357e-06 2024-04-25T22:42:21.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496055+0000", 2024-04-25T22:42:21.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0064181380000000003 2024-04-25T22:42:21.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496074+0000", 2024-04-25T22:42:21.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8904000000000001e-05 2024-04-25T22:42:21.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496085+0000", 2024-04-25T22:42:21.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1245e-05 2024-04-25T22:42:21.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496169+0000", 2024-04-25T22:42:21.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3974000000000006e-05 2024-04-25T22:42:21.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496203+0000", 2024-04-25T22:42:21.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3679000000000001e-05 2024-04-25T22:42:21.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:21.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536002+0000", 2024-04-25T22:42:21.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039799569 2024-04-25T22:42:21.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:21.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536073+0000", 2024-04-25T22:42:21.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0895999999999993e-05 2024-04-25T22:42:21.008 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.008 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.008 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.008 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13338 4.e 4:737b94c2:::1000000338a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:21.008 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:21.008 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.421527985, 2024-04-25T22:42:21.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047911849999999999, 2024-04-25T22:42:21.008 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.008 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.008 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.008 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:21.008 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:21.009 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:21.009 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13338 2024-04-25T22:42:21.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.009 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:21.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:21.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495776+0000", 2024-04-25T22:42:21.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2399999999999996e-07 2024-04-25T22:42:21.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503748+0000", 2024-04-25T22:42:21.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079725479999999994 2024-04-25T22:42:21.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503940+0000", 2024-04-25T22:42:21.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000191249 2024-04-25T22:42:21.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504061+0000", 2024-04-25T22:42:21.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120982 2024-04-25T22:42:21.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515564+0000", 2024-04-25T22:42:21.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011503342999999999 2024-04-25T22:42:21.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515799+0000", 2024-04-25T22:42:21.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000235138 2024-04-25T22:42:21.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:21.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543419+0000", 2024-04-25T22:42:21.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027620167000000001 2024-04-25T22:42:21.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:21.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543522+0000", 2024-04-25T22:42:21.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010254100000000001 2024-04-25T22:42:21.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:21.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543687+0000", 2024-04-25T22:42:21.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016495799999999999 2024-04-25T22:42:21.012 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.012 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.012 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.013 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13329 4.26 e65/57 4:64e005a2:::10000003483.00000000:head v 65'226, mlcod=64'224)", 2024-04-25T22:42:21.013 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:21.013 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.4209253039999998, 2024-04-25T22:42:21.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048871456000000001, 2024-04-25T22:42:21.013 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.013 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.013 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.013 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:21.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:21.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496379+0000", 2024-04-25T22:42:21.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1480000000000001e-06 2024-04-25T22:42:21.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504870+0000", 2024-04-25T22:42:21.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0084917880000000001 2024-04-25T22:42:21.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504888+0000", 2024-04-25T22:42:21.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7365999999999999e-05 2024-04-25T22:42:21.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504899+0000", 2024-04-25T22:42:21.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1516e-05 2024-04-25T22:42:21.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515953+0000", 2024-04-25T22:42:21.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011054074000000001 2024-04-25T22:42:21.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515993+0000", 2024-04-25T22:42:21.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9854999999999997e-05 2024-04-25T22:42:21.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:21.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545191+0000", 2024-04-25T22:42:21.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029197323000000001 2024-04-25T22:42:21.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:21.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545249+0000", 2024-04-25T22:42:21.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8386e-05 2024-04-25T22:42:21.016 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.016 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.016 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.016 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13713 4.2b 4:d574dbff:::100000031d0.00000001:head [write 0~4194304 [2@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:21.016 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:21.016 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.0087391859999997, 2024-04-25T22:42:21.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047324328999999998, 2024-04-25T22:42:21.017 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.017 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.017 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.017 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:21.017 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:21.017 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:21.017 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13713 2024-04-25T22:42:21.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.017 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:21.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:21.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908565+0000", 2024-04-25T22:42:21.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.694e-06 2024-04-25T22:42:21.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916170+0000", 2024-04-25T22:42:21.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076041720000000002 2024-04-25T22:42:21.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916200+0000", 2024-04-25T22:42:21.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0463999999999998e-05 2024-04-25T22:42:21.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916209+0000", 2024-04-25T22:42:21.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3079999999999997e-06 2024-04-25T22:42:21.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916297+0000", 2024-04-25T22:42:21.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8159999999999996e-05 2024-04-25T22:42:21.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916554+0000", 2024-04-25T22:42:21.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025661800000000002 2024-04-25T22:42:21.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:21.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916794+0000", 2024-04-25T22:42:21.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024013999999999999 2024-04-25T22:42:21.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:21.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.933120+0000", 2024-04-25T22:42:21.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016325559 2024-04-25T22:42:21.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:21.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955612+0000", 2024-04-25T22:42:21.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022491786 2024-04-25T22:42:21.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:21.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955797+0000", 2024-04-25T22:42:21.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018533699999999999 2024-04-25T22:42:21.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:21.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955888+0000", 2024-04-25T22:42:21.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1090999999999999e-05 2024-04-25T22:42:21.021 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.021 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.021 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.021 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.021 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.022 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:21.023 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:21.023 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:21.023+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:21.124 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:21.123+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:21.155 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:21.155 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:21.156 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:42:21.156 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:21.170 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:21.259 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:21.259+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:21.279 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:42:21.326 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:21.323+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:21.346 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:21.346 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:21.346 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:42:21.346 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:42:21.346 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:21.357 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:21.446 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:21.447+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:21.528 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:21.527+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:21.533 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:21.534 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:21.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:21.534 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:21.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.534 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:21.534 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:21.535 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 126.93356900000001, 2024-04-25T22:42:21.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:21.535 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:21.535 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:21.535 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.535 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:21.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:21.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:21.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:21.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:21.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:21.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:21.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:21.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:21.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:21.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:21.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:21.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:21.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:21.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:21.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:21.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:21.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:21.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:21.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:21.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:21.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:21.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:21.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:21.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:21.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:21.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:21.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:21.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:21.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:21.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:21.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:21.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:21.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:21.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:21.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:21.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:21.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:21.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:21.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:21.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:21.540 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.541 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.541 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.541 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:21.541 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:21.541 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 126.933431744, 2024-04-25T22:42:21.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:21.541 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:21.541 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:21.541 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.541 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:21.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:21.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:21.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:21.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:21.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:21.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:21.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:21.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:21.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:21.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:21.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:21.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:21.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:21.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:21.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:21.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:21.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:21.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:21.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:21.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:21.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:21.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:21.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:21.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:21.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:21.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:21.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:21.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:21.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:21.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:21.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:21.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:21.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:21.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:21.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:21.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:21.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:21.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:21.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:21.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:21.547 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.547 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.547 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.548 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:21.548 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:21.548 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 126.93317157600001, 2024-04-25T22:42:21.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:21.548 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:21.548 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:21.548 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.548 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:21.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:21.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:21.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:21.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:21.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:21.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:21.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:21.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:21.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:21.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:21.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.550 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:21.550 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:21.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:21.550 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.550 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.550 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.550 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:21.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:21.550 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.550 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.550 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.550 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:21.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:21.550 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.550 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:21.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:21.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:21.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:21.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:21.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:21.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:21.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:21.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:21.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:21.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:21.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:21.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:21.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:21.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:21.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:21.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:21.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:21.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:21.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:21.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:21.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:21.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:21.553 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.553 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.553 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.553 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:21.553 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:21.553 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 126.933006377, 2024-04-25T22:42:21.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:21.553 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:21.554 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:21.554 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:21.554 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:21.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:21.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:21.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:21.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:21.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:21.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:21.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:21.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:21.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:21.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:21.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:21.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:21.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:21.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.555 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.555 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:21.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:21.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:21.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:21.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:21.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:21.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:21.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:21.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:21.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:21.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:21.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:21.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:21.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:21.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:21.557 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.557 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.557 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.557 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:21.557 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:21.557 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 126.932940715, 2024-04-25T22:42:21.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:21.558 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:21.558 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:21.558 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:21.558 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:21.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:21.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:21.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:21.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:21.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:21.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:21.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:21.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:21.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:21.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:21.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:21.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:21.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:21.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:21.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:21.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:21.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:21.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:21.560 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:21.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:21.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.560 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:21.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:21.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:21.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:21.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:21.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:21.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:21.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:21.561 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.561 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.561 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.562 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10700 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:21.562 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:21.562 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 9.0100734980000006, 2024-04-25T22:42:21.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066789482999999997, 2024-04-25T22:42:21.562 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:21.562 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:21.562 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.562 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:21.562 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:21.563 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:21.563 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10700 2024-04-25T22:42:21.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.563 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:21.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:21.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:21.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:21.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:21.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:21.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519112+0000", 2024-04-25T22:42:21.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1399999999999998e-06 2024-04-25T22:42:21.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:21.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527187+0000", 2024-04-25T22:42:21.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080748899999999995 2024-04-25T22:42:21.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:21.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527232+0000", 2024-04-25T22:42:21.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4895999999999998e-05 2024-04-25T22:42:21.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527259+0000", 2024-04-25T22:42:21.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7331999999999999e-05 2024-04-25T22:42:21.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529418+0000", 2024-04-25T22:42:21.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002158765 2024-04-25T22:42:21.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:21.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529572+0000", 2024-04-25T22:42:21.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015438499999999999 2024-04-25T22:42:21.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:21.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529762+0000", 2024-04-25T22:42:21.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018998100000000001 2024-04-25T22:42:21.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:21.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.548359+0000", 2024-04-25T22:42:21.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018596444 2024-04-25T22:42:21.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:21.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585801+0000", 2024-04-25T22:42:21.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.037442469999999999 2024-04-25T22:42:21.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:21.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585847+0000", 2024-04-25T22:42:21.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5565000000000002e-05 2024-04-25T22:42:21.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:21.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585899+0000", 2024-04-25T22:42:21.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2614999999999997e-05 2024-04-25T22:42:21.568 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.568 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.568 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.568 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10714 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:21.568 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:21.568 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 8.9763925350000004, 2024-04-25T22:42:21.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.048080623000000003, 2024-04-25T22:42:21.568 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:21.569 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:21.569 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.569 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:21.569 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:21.569 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:21.569 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10714 2024-04-25T22:42:21.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.569 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:21.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:21.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:21.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:21.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:21.570 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.570 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.570 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:21.570 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552792+0000", 2024-04-25T22:42:21.570 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:42:21.570 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.570 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:21.570 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559915+0000", 2024-04-25T22:42:21.570 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071231690000000004 2024-04-25T22:42:21.570 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.570 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:21.570 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559932+0000", 2024-04-25T22:42:21.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7169000000000001e-05 2024-04-25T22:42:21.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559942+0000", 2024-04-25T22:42:21.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0261999999999999e-05 2024-04-25T22:42:21.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560018+0000", 2024-04-25T22:42:21.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5358000000000006e-05 2024-04-25T22:42:21.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:21.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560118+0000", 2024-04-25T22:42:21.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000100911 2024-04-25T22:42:21.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:21.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560281+0000", 2024-04-25T22:42:21.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016288500000000001 2024-04-25T22:42:21.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:21.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.579740+0000", 2024-04-25T22:42:21.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019458598000000001 2024-04-25T22:42:21.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:21.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600484+0000", 2024-04-25T22:42:21.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020744483000000001 2024-04-25T22:42:21.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:21.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600664+0000", 2024-04-25T22:42:21.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017953899999999999 2024-04-25T22:42:21.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:21.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600871+0000", 2024-04-25T22:42:21.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020737199999999999 2024-04-25T22:42:21.573 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.573 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.573 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.573 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10813 4.17 4:e8010137:::100000030b0.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:21.573 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:21.573 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 8.7814435290000006, 2024-04-25T22:42:21.574 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.047503799999999999, 2024-04-25T22:42:21.574 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:21.574 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:21.574 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.574 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:21.574 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:21.574 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:21.574 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10813 2024-04-25T22:42:21.574 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.574 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:21.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.574 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:21.574 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:21.574 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.574 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:21.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:21.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:21.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747741+0000", 2024-04-25T22:42:21.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1119999999999999e-06 2024-04-25T22:42:21.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:21.575 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752366+0000", 2024-04-25T22:42:21.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046253240000000001 2024-04-25T22:42:21.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.575 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:21.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752382+0000", 2024-04-25T22:42:21.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5639999999999999e-05 2024-04-25T22:42:21.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752393+0000", 2024-04-25T22:42:21.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1626e-05 2024-04-25T22:42:21.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752459+0000", 2024-04-25T22:42:21.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5309999999999996e-05 2024-04-25T22:42:21.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:21.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752529+0000", 2024-04-25T22:42:21.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0543000000000005e-05 2024-04-25T22:42:21.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:21.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752637+0000", 2024-04-25T22:42:21.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010788799999999999 2024-04-25T22:42:21.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:21.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760295+0000", 2024-04-25T22:42:21.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076583290000000002 2024-04-25T22:42:21.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:21.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.794990+0000", 2024-04-25T22:42:21.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034694317000000002 2024-04-25T22:42:21.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:21.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795097+0000", 2024-04-25T22:42:21.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010768999999999999 2024-04-25T22:42:21.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:21.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795243+0000", 2024-04-25T22:42:21.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000146021 2024-04-25T22:42:21.578 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.578 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.578 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.579 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10816 4.17 4:e8010137:::100000030b0.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:21.579 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:21.579 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 8.7761140690000001, 2024-04-25T22:42:21.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042406530999999997, 2024-04-25T22:42:21.579 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:21.579 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:21.579 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.579 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:21.579 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:21.579 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:21.579 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10816 2024-04-25T22:42:21.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.579 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:21.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:21.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:21.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:21.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:21.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:21.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753070+0000", 2024-04-25T22:42:21.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9800000000000002e-07 2024-04-25T22:42:21.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:21.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753288+0000", 2024-04-25T22:42:21.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000217789 2024-04-25T22:42:21.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:21.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753301+0000", 2024-04-25T22:42:21.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2764e-05 2024-04-25T22:42:21.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.581 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753310+0000", 2024-04-25T22:42:21.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:42:21.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758240+0000", 2024-04-25T22:42:21.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049304910000000004 2024-04-25T22:42:21.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:21.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758374+0000", 2024-04-25T22:42:21.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000133428 2024-04-25T22:42:21.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:21.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758576+0000", 2024-04-25T22:42:21.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020177899999999999 2024-04-25T22:42:21.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:21.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760626+0000", 2024-04-25T22:42:21.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0020501489999999998 2024-04-25T22:42:21.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:21.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795329+0000", 2024-04-25T22:42:21.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034703352999999999 2024-04-25T22:42:21.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:21.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795414+0000", 2024-04-25T22:42:21.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5292999999999998e-05 2024-04-25T22:42:21.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:21.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795476+0000", 2024-04-25T22:42:21.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1206999999999999e-05 2024-04-25T22:42:21.585 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.585 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.585 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.586 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.586 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10914 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:21.586 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:21.586 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 8.5753136869999995, 2024-04-25T22:42:21.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044452984000000001, 2024-04-25T22:42:21.587 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:21.587 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:21.587 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.587 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:21.587 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:21.587 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:21.587 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10914 2024-04-25T22:42:21.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.587 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:21.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:21.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:21.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:21.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:21.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:21.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953871+0000", 2024-04-25T22:42:21.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1829999999999999e-06 2024-04-25T22:42:21.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:21.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.962992+0000", 2024-04-25T22:42:21.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091217409999999992 2024-04-25T22:42:21.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:21.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963027+0000", 2024-04-25T22:42:21.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4229e-05 2024-04-25T22:42:21.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963042+0000", 2024-04-25T22:42:21.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5152e-05 2024-04-25T22:42:21.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963143+0000", 2024-04-25T22:42:21.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101171 2024-04-25T22:42:21.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:21.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963269+0000", 2024-04-25T22:42:21.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012623499999999999 2024-04-25T22:42:21.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:21.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963453+0000", 2024-04-25T22:42:21.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018357900000000001 2024-04-25T22:42:21.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:21.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998133+0000", 2024-04-25T22:42:21.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034679789000000003 2024-04-25T22:42:21.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.591 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:21.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998220+0000", 2024-04-25T22:42:21.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7153999999999999e-05 2024-04-25T22:42:21.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.591 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:21.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998278+0000", 2024-04-25T22:42:21.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8035000000000003e-05 2024-04-25T22:42:21.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.591 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:21.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998323+0000", 2024-04-25T22:42:21.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4715999999999997e-05 2024-04-25T22:42:21.592 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.592 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.592 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.592 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.592 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.592 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10919 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:21.592 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:21.592 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 8.5550024059999998, 2024-04-25T22:42:21.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044010552000000001, 2024-04-25T22:42:21.592 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:21.592 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:21.592 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.592 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:21.592 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:21.592 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:21.593 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10919 2024-04-25T22:42:21.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.593 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:21.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:21.593 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:21.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:21.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:21.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:21.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:21.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8100000000000003e-07 2024-04-25T22:42:21.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:21.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980221+0000", 2024-04-25T22:42:21.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060397230000000003 2024-04-25T22:42:21.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:21.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980242+0000", 2024-04-25T22:42:21.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1373e-05 2024-04-25T22:42:21.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980252+0000", 2024-04-25T22:42:21.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9990000000000003e-06 2024-04-25T22:42:21.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981303+0000", 2024-04-25T22:42:21.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010501670000000001 2024-04-25T22:42:21.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:21.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981444+0000", 2024-04-25T22:42:21.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014123799999999999 2024-04-25T22:42:21.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:21.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981585+0000", 2024-04-25T22:42:21.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014071999999999999 2024-04-25T22:42:21.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:21.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003640+0000", 2024-04-25T22:42:21.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022055113000000001 2024-04-25T22:42:21.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:21.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018070+0000", 2024-04-25T22:42:21.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014430877 2024-04-25T22:42:21.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:21.598 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018138+0000", 2024-04-25T22:42:21.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7743000000000005e-05 2024-04-25T22:42:21.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.598 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:21.598 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018191+0000", 2024-04-25T22:42:21.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3118000000000002e-05 2024-04-25T22:42:21.598 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.598 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.598 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.599 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:12632 4.a e64/17 4:506aad5d:::1000000310f.00000000:head v 64'203, mlcod=64'201)", 2024-04-25T22:42:21.599 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:21.599 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 5.8856540109999997, 2024-04-25T22:42:21.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041913617, 2024-04-25T22:42:21.599 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:21.599 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:21.599 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.599 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:21.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:21.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:21.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:21.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:21.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:21.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643531+0000", 2024-04-25T22:42:21.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.497e-06 2024-04-25T22:42:21.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:21.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650159+0000", 2024-04-25T22:42:21.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066287059999999998 2024-04-25T22:42:21.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:21.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650185+0000", 2024-04-25T22:42:21.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5646000000000001e-05 2024-04-25T22:42:21.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650205+0000", 2024-04-25T22:42:21.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9720000000000001e-05 2024-04-25T22:42:21.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650521+0000", 2024-04-25T22:42:21.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00031590699999999998 2024-04-25T22:42:21.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:21.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650574+0000", 2024-04-25T22:42:21.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3192000000000002e-05 2024-04-25T22:42:21.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:21.602 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685374+0000", 2024-04-25T22:42:21.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034799902000000001 2024-04-25T22:42:21.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:21.602 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685443+0000", 2024-04-25T22:42:21.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9047000000000005e-05 2024-04-25T22:42:21.602 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.602 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.602 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.603 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12644 4.11 4:8893db93:::100000034c2.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:21.603 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:21.603 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 5.8772451209999996, 2024-04-25T22:42:21.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045039497999999997, 2024-04-25T22:42:21.603 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:21.603 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:21.603 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.603 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:21.603 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:21.603 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:21.603 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12644 2024-04-25T22:42:21.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.603 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:21.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:21.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:21.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:21.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:21.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:21.604 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651940+0000", 2024-04-25T22:42:21.604 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.013e-06 2024-04-25T22:42:21.604 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.604 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.604 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:21.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659663+0000", 2024-04-25T22:42:21.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077228150000000001 2024-04-25T22:42:21.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.605 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:21.605 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659694+0000", 2024-04-25T22:42:21.605 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1112999999999998e-05 2024-04-25T22:42:21.605 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.605 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.605 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.606 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659715+0000", 2024-04-25T22:42:21.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1053e-05 2024-04-25T22:42:21.606 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.606 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.606 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659842+0000", 2024-04-25T22:42:21.606 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012738100000000001 2024-04-25T22:42:21.606 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.606 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.606 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:21.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660068+0000", 2024-04-25T22:42:21.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000225746 2024-04-25T22:42:21.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:21.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660307+0000", 2024-04-25T22:42:21.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000238352 2024-04-25T22:42:21.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.607 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.607 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:21.607 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.683776+0000", 2024-04-25T22:42:21.607 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023469891999999999 2024-04-25T22:42:21.607 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:21.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696810+0000", 2024-04-25T22:42:21.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013033385999999999 2024-04-25T22:42:21.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:21.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696904+0000", 2024-04-25T22:42:21.608 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3820000000000006e-05 2024-04-25T22:42:21.608 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.608 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.608 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:21.608 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696978+0000", 2024-04-25T22:42:21.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3926999999999999e-05 2024-04-25T22:42:21.609 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.609 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.609 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.609 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.609 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.609 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12645 4.2d 4:b45456a9:::10000003241.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:21.609 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:21.609 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 5.8694246339999996, 2024-04-25T22:42:21.609 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.043099660999999997, 2024-04-25T22:42:21.609 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:21.609 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:21.609 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.609 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:21.609 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:21.609 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:21.610 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12645 2024-04-25T22:42:21.610 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.610 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:21.610 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.610 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:21.610 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:21.610 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.610 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:21.611 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:21.611 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.611 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.611 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.611 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:21.612 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659761+0000", 2024-04-25T22:42:21.612 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8459999999999999e-06 2024-04-25T22:42:21.612 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.612 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.612 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:21.612 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666663+0000", 2024-04-25T22:42:21.612 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0069017080000000003 2024-04-25T22:42:21.612 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.612 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.613 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:21.613 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666684+0000", 2024-04-25T22:42:21.613 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0706000000000001e-05 2024-04-25T22:42:21.613 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.613 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.613 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.613 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666700+0000", 2024-04-25T22:42:21.613 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5985999999999999e-05 2024-04-25T22:42:21.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.614 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666914+0000", 2024-04-25T22:42:21.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000213861 2024-04-25T22:42:21.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.614 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:21.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.667082+0000", 2024-04-25T22:42:21.614 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016809 2024-04-25T22:42:21.614 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.614 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.614 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:21.614 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702598+0000", 2024-04-25T22:42:21.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035515962999999998 2024-04-25T22:42:21.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.615 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:21.615 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702705+0000", 2024-04-25T22:42:21.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010689800000000001 2024-04-25T22:42:21.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.615 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:21.615 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702858+0000", 2024-04-25T22:42:21.615 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015360300000000001 2024-04-25T22:42:21.615 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.615 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.615 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.615 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.615 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.615 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12829 4.3b 4:de8bdadd:::100000033c7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:21.616 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:21.616 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 5.6411647189999998, 2024-04-25T22:42:21.616 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042457306, 2024-04-25T22:42:21.616 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:21.616 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:21.616 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.616 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:21.616 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:21.616 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:21.616 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12829 2024-04-25T22:42:21.616 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.616 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:21.616 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.616 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:21.616 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:21.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.617 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.617 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:21.617 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:21.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.617 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.617 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:21.617 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888019+0000", 2024-04-25T22:42:21.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3300000000000002e-07 2024-04-25T22:42:21.617 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.617 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:21.617 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891638+0000", 2024-04-25T22:42:21.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036189109999999998 2024-04-25T22:42:21.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:21.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891661+0000", 2024-04-25T22:42:21.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3345000000000001e-05 2024-04-25T22:42:21.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891671+0000", 2024-04-25T22:42:21.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0115000000000001e-05 2024-04-25T22:42:21.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891737+0000", 2024-04-25T22:42:21.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5600999999999998e-05 2024-04-25T22:42:21.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:21.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891856+0000", 2024-04-25T22:42:21.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011881 2024-04-25T22:42:21.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:21.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930251+0000", 2024-04-25T22:42:21.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.038395141000000001 2024-04-25T22:42:21.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:21.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930389+0000", 2024-04-25T22:42:21.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013849000000000001 2024-04-25T22:42:21.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:21.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930476+0000", 2024-04-25T22:42:21.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6360000000000007e-05 2024-04-25T22:42:21.621 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.621 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.621 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.621 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13009 4.1e 4:78728bd7:::100000033a5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:21.621 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:21.621 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 5.4392777070000005, 2024-04-25T22:42:21.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049997452999999997, 2024-04-25T22:42:21.621 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:21.621 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:21.622 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.622 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:21.622 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:21.622 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:21.622 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13009 2024-04-25T22:42:21.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.622 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:21.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:21.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:21.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:21.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:21.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.623 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:21.623 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:21.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4799999999999997e-07 2024-04-25T22:42:21.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.623 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:21.623 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097105+0000", 2024-04-25T22:42:21.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071984060000000001 2024-04-25T22:42:21.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.623 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:21.623 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097118+0000", 2024-04-25T22:42:21.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2865e-05 2024-04-25T22:42:21.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097127+0000", 2024-04-25T22:42:21.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8449999999999998e-06 2024-04-25T22:42:21.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097174+0000", 2024-04-25T22:42:21.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6084000000000001e-05 2024-04-25T22:42:21.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:21.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097232+0000", 2024-04-25T22:42:21.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8928999999999998e-05 2024-04-25T22:42:21.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:21.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097309+0000", 2024-04-25T22:42:21.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7014999999999994e-05 2024-04-25T22:42:21.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:21.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.108708+0000", 2024-04-25T22:42:21.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011398233000000001 2024-04-25T22:42:21.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:21.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139793+0000", 2024-04-25T22:42:21.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031084856000000001 2024-04-25T22:42:21.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.626 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:21.626 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139848+0000", 2024-04-25T22:42:21.626 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5464000000000003e-05 2024-04-25T22:42:21.626 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.626 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.626 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:21.626 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139903+0000", 2024-04-25T22:42:21.626 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4907999999999997e-05 2024-04-25T22:42:21.626 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.626 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.626 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.626 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.626 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.626 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13318 4.16 4:6810bf9e:::10000003259.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:21.627 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:21.627 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 5.0687033489999997, 2024-04-25T22:42:21.627 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057538179000000002, 2024-04-25T22:42:21.627 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:21.627 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:21.627 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.627 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:21.627 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:21.628 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:21.628 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13318 2024-04-25T22:42:21.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.628 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:21.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.628 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:21.628 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:21.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.628 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:21.628 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:21.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.629 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:21.629 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460481+0000", 2024-04-25T22:42:21.629 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:42:21.629 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.629 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.629 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:21.629 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466775+0000", 2024-04-25T22:42:21.629 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062944239999999999 2024-04-25T22:42:21.629 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.629 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.629 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:21.629 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466787+0000", 2024-04-25T22:42:21.629 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1688999999999999e-05 2024-04-25T22:42:21.629 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.629 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.629 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.630 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466793+0000", 2024-04-25T22:42:21.630 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7209999999999999e-06 2024-04-25T22:42:21.630 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.630 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.630 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.630 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466845+0000", 2024-04-25T22:42:21.630 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2166999999999997e-05 2024-04-25T22:42:21.630 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:21.631 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466912+0000", 2024-04-25T22:42:21.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7016999999999999e-05 2024-04-25T22:42:21.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:21.631 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.467020+0000", 2024-04-25T22:42:21.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010827699999999999 2024-04-25T22:42:21.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:21.631 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.476718+0000", 2024-04-25T22:42:21.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0096980439999999994 2024-04-25T22:42:21.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.632 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:21.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517860+0000", 2024-04-25T22:42:21.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041141847000000002 2024-04-25T22:42:21.632 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.632 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:21.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517924+0000", 2024-04-25T22:42:21.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3997000000000004e-05 2024-04-25T22:42:21.632 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.632 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:21.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.518018+0000", 2024-04-25T22:42:21.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4139000000000001e-05 2024-04-25T22:42:21.632 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.632 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.633 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.633 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.633 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13328 4.16 4:6a9ab238:::1000000339b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:21.633 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:21.633 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 5.0497903639999997, 2024-04-25T22:42:21.633 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057072695999999999, 2024-04-25T22:42:21.633 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:21.633 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:21.633 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.633 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:21.633 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:21.633 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:21.633 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13328 2024-04-25T22:42:21.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.633 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:21.634 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.634 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:21.634 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:21.634 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.634 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.634 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.634 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:21.634 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:21.634 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.634 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.634 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.634 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:21.634 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479395+0000", 2024-04-25T22:42:21.634 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2859999999999998e-06 2024-04-25T22:42:21.634 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.634 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.635 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:21.635 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486667+0000", 2024-04-25T22:42:21.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072715599999999998 2024-04-25T22:42:21.635 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.635 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:21.635 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486677+0000", 2024-04-25T22:42:21.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0305e-05 2024-04-25T22:42:21.635 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.635 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.635 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486683+0000", 2024-04-25T22:42:21.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5300000000000004e-06 2024-04-25T22:42:21.635 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.635 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.636 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486768+0000", 2024-04-25T22:42:21.636 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5725999999999999e-05 2024-04-25T22:42:21.636 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.636 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.636 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:21.636 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486905+0000", 2024-04-25T22:42:21.636 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013696699999999999 2024-04-25T22:42:21.636 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.636 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.636 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:21.636 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.487121+0000", 2024-04-25T22:42:21.636 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021615299999999999 2024-04-25T22:42:21.636 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.636 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.636 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:21.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.509675+0000", 2024-04-25T22:42:21.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022553225999999999 2024-04-25T22:42:21.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:21.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536355+0000", 2024-04-25T22:42:21.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026680855 2024-04-25T22:42:21.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:21.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536401+0000", 2024-04-25T22:42:21.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5649000000000003e-05 2024-04-25T22:42:21.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:21.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536466+0000", 2024-04-25T22:42:21.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4438999999999997e-05 2024-04-25T22:42:21.638 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.638 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.638 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.638 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13329 4.26 4:64e005a2:::10000003483.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:21.638 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:21.638 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 5.0424819650000003, 2024-04-25T22:42:21.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066502845000000005, 2024-04-25T22:42:21.638 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:21.638 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:21.638 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.638 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:21.638 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:21.639 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:21.639 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13329 2024-04-25T22:42:21.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.639 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:21.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:21.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:21.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:21.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:21.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:21.640 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486703+0000", 2024-04-25T22:42:21.640 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3909999999999999e-06 2024-04-25T22:42:21.640 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.640 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:21.640 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494612+0000", 2024-04-25T22:42:21.640 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0079096670000000004 2024-04-25T22:42:21.640 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.640 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:21.640 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494626+0000", 2024-04-25T22:42:21.640 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3263e-05 2024-04-25T22:42:21.640 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.640 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.640 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494637+0000", 2024-04-25T22:42:21.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.171e-05 2024-04-25T22:42:21.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494720+0000", 2024-04-25T22:42:21.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2767000000000002e-05 2024-04-25T22:42:21.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:21.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494834+0000", 2024-04-25T22:42:21.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011387699999999999 2024-04-25T22:42:21.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:21.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494998+0000", 2024-04-25T22:42:21.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016390799999999999 2024-04-25T22:42:21.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:21.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517407+0000", 2024-04-25T22:42:21.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022409068000000001 2024-04-25T22:42:21.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:21.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553040+0000", 2024-04-25T22:42:21.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035633155 2024-04-25T22:42:21.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:21.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553140+0000", 2024-04-25T22:42:21.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9623000000000005e-05 2024-04-25T22:42:21.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:21.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553204+0000", 2024-04-25T22:42:21.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4416000000000001e-05 2024-04-25T22:42:21.643 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.643 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.643 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.643 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13399 4.16 4:6bb7cc3a:::10000003648.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:21.643 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:21.643 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4.969116165, 2024-04-25T22:42:21.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045625003999999997, 2024-04-25T22:42:21.643 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:21.643 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:21.644 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.644 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:21.644 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:21.644 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:21.644 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13399 2024-04-25T22:42:21.644 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.644 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:21.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.644 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:21.644 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:21.644 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.644 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.645 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:21.645 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:21.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:21.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.645 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:21.645 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560068+0000", 2024-04-25T22:42:21.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:42:21.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.645 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:21.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576902+0000", 2024-04-25T22:42:21.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016833806 2024-04-25T22:42:21.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.646 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:21.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576916+0000", 2024-04-25T22:42:21.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3648e-05 2024-04-25T22:42:21.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576927+0000", 2024-04-25T22:42:21.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0992000000000001e-05 2024-04-25T22:42:21.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:21.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577026+0000", 2024-04-25T22:42:21.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9116000000000004e-05 2024-04-25T22:42:21.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.648 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:21.648 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577203+0000", 2024-04-25T22:42:21.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017700499999999999 2024-04-25T22:42:21.648 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.648 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:21.648 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577336+0000", 2024-04-25T22:42:21.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013340800000000001 2024-04-25T22:42:21.648 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.648 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:21.648 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.589077+0000", 2024-04-25T22:42:21.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011741151 2024-04-25T22:42:21.648 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:21.649 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605436+0000", 2024-04-25T22:42:21.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016359146000000001 2024-04-25T22:42:21.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:21.649 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605493+0000", 2024-04-25T22:42:21.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7067000000000001e-05 2024-04-25T22:42:21.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:21.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:21.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:21.649 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605692+0000", 2024-04-25T22:42:21.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00019855799999999999 2024-04-25T22:42:21.649 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.649 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.649 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.650 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:21.650 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:21.650 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:21.651 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:21.651+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:21.651 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:21.754 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:21.751+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:21.832 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:21.832 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4524 4.8 4:11b4a9d5:::1000000391f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-25T22:42:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.829823+0000", 2024-04-25T22:42:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0019830519999999999, 2024-04-25T22:42:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020083470000000002, 2024-04-25T22:42:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:21.833 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.829823+0000", 2024-04-25T22:42:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.829823+0000", 2024-04-25T22:42:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.829824+0000", 2024-04-25T22:42:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2900000000000002e-07 2024-04-25T22:42:21.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.829828+0000", 2024-04-25T22:42:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.228e-06 2024-04-25T22:42:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.829837+0000", 2024-04-25T22:42:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6060000000000003e-06 2024-04-25T22:42:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.829843+0000", 2024-04-25T22:42:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9850000000000003e-06 2024-04-25T22:42:21.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.829990+0000", 2024-04-25T22:42:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000147391 2024-04-25T22:42:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830095+0000", 2024-04-25T22:42:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010477899999999999 2024-04-25T22:42:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4525 4.32 4:4c6906d7:::10000003922.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-25T22:42:21.836 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.829859+0000", 2024-04-25T22:42:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.001947254, 2024-04-25T22:42:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020402789999999999, 2024-04-25T22:42:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.829859+0000", 2024-04-25T22:42:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.829859+0000", 2024-04-25T22:42:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.829860+0000", 2024-04-25T22:42:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:42:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.829862+0000", 2024-04-25T22:42:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4430000000000002e-06 2024-04-25T22:42:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.829870+0000", 2024-04-25T22:42:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9149999999999996e-06 2024-04-25T22:42:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.829875+0000", 2024-04-25T22:42:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.344e-06 2024-04-25T22:42:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830996+0000", 2024-04-25T22:42:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00112061 2024-04-25T22:42:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831120+0000", 2024-04-25T22:42:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123795 2024-04-25T22:42:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.840 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4527 4.a 4:52d176d9:::10000003924.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-25T22:42:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.829884+0000", 2024-04-25T22:42:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0019220979999999999, 2024-04-25T22:42:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020519729999999999, 2024-04-25T22:42:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:21.841 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.829884+0000", 2024-04-25T22:42:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.829884+0000", 2024-04-25T22:42:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.829885+0000", 2024-04-25T22:42:21.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4799999999999999e-07 2024-04-25T22:42:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.829887+0000", 2024-04-25T22:42:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1600000000000001e-06 2024-04-25T22:42:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.829893+0000", 2024-04-25T22:42:21.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3389999999999998e-06 2024-04-25T22:42:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.829898+0000", 2024-04-25T22:42:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1580000000000004e-06 2024-04-25T22:42:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831248+0000", 2024-04-25T22:42:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013493680000000001 2024-04-25T22:42:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831365+0000", 2024-04-25T22:42:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011756600000000001 2024-04-25T22:42:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4528 3.13 3:cc49be44:::10000003925.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-25T22:42:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.830097+0000", 2024-04-25T22:42:21.845 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.001709063, 2024-04-25T22:42:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001884099, 2024-04-25T22:42:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830097+0000", 2024-04-25T22:42:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830097+0000", 2024-04-25T22:42:21.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830098+0000", 2024-04-25T22:42:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:42:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830102+0000", 2024-04-25T22:42:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0350000000000003e-06 2024-04-25T22:42:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830111+0000", 2024-04-25T22:42:21.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6759999999999996e-06 2024-04-25T22:42:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830118+0000", 2024-04-25T22:42:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1770000000000001e-06 2024-04-25T22:42:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830176+0000", 2024-04-25T22:42:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8097999999999998e-05 2024-04-25T22:42:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830302+0000", 2024-04-25T22:42:21.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126081 2024-04-25T22:42:21.849 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.849 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.849 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.849 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing(4.11 epoch 66/57 rep_tid 8494 entries 66'282 (0'0) error 4:8aa406ee:::10000003929.00000000:head by mds.0.3:4530 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 66'280)", 2024-04-25T22:42:21.849 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.830762+0000", 2024-04-25T22:42:21.849 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0010443270000000001, 2024-04-25T22:42:21.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001295301, 2024-04-25T22:42:21.850 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.850 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.850 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-25T22:42:21.850 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830762+0000", 2024-04-25T22:42:21.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830762+0000", 2024-04-25T22:42:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830763+0000", 2024-04-25T22:42:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5599999999999995e-07 2024-04-25T22:42:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830769+0000", 2024-04-25T22:42:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3430000000000001e-06 2024-04-25T22:42:21.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830783+0000", 2024-04-25T22:42:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4403000000000001e-05 2024-04-25T22:42:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830795+0000", 2024-04-25T22:42:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1799e-05 2024-04-25T22:42:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830898+0000", 2024-04-25T22:42:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010260900000000001 2024-04-25T22:42:21.852 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4503 4.22 4:45414928:::10000003330.00000002:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-25T22:42:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.825934+0000", 2024-04-25T22:42:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0058723100000000004, 2024-04-25T22:42:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00618346, 2024-04-25T22:42:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:21.853 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.825934+0000", 2024-04-25T22:42:21.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.825934+0000", 2024-04-25T22:42:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.825935+0000", 2024-04-25T22:42:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.51e-07 2024-04-25T22:42:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.825947+0000", 2024-04-25T22:42:21.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2716e-05 2024-04-25T22:42:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.825972+0000", 2024-04-25T22:42:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4595000000000001e-05 2024-04-25T22:42:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.825978+0000", 2024-04-25T22:42:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3230000000000003e-06 2024-04-25T22:42:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.826575+0000", 2024-04-25T22:42:21.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00059707499999999997 2024-04-25T22:42:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.826699+0000", 2024-04-25T22:42:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123931 2024-04-25T22:42:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4532 4.e 4:7267778b:::10000003934.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-25T22:42:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.830829+0000", 2024-04-25T22:42:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00097777400000000005, 2024-04-25T22:42:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013517850000000001, 2024-04-25T22:42:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.857 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830829+0000", 2024-04-25T22:42:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830829+0000", 2024-04-25T22:42:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830830+0000", 2024-04-25T22:42:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1999999999999998e-07 2024-04-25T22:42:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830834+0000", 2024-04-25T22:42:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9940000000000002e-06 2024-04-25T22:42:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830852+0000", 2024-04-25T22:42:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7948000000000002e-05 2024-04-25T22:42:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830858+0000", 2024-04-25T22:42:21.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6869999999999997e-06 2024-04-25T22:42:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830907+0000", 2024-04-25T22:42:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8341999999999999e-05 2024-04-25T22:42:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831035+0000", 2024-04-25T22:42:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012887900000000001 2024-04-25T22:42:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.860 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4505 4.d 4:b15a01fa:::10000003331.00000001:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-25T22:42:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.826014+0000", 2024-04-25T22:42:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0057919959999999998, 2024-04-25T22:42:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062296180000000001, 2024-04-25T22:42:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.826014+0000", 2024-04-25T22:42:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.826014+0000", 2024-04-25T22:42:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.826015+0000", 2024-04-25T22:42:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4999999999999998e-07 2024-04-25T22:42:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.826017+0000", 2024-04-25T22:42:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.719e-06 2024-04-25T22:42:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.826028+0000", 2024-04-25T22:42:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1218e-05 2024-04-25T22:42:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.826033+0000", 2024-04-25T22:42:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1449999999999999e-06 2024-04-25T22:42:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.826120+0000", 2024-04-25T22:42:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6969e-05 2024-04-25T22:42:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.826201+0000", 2024-04-25T22:42:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0916999999999998e-05 2024-04-25T22:42:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4533 4.24 4:25062cdb:::10000003938.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-25T22:42:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.830876+0000", 2024-04-25T22:42:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00093064099999999996, 2024-04-25T22:42:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0014301470000000001, 2024-04-25T22:42:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.865 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830876+0000", 2024-04-25T22:42:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830876+0000", 2024-04-25T22:42:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830876+0000", 2024-04-25T22:42:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5300000000000004e-07 2024-04-25T22:42:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830879+0000", 2024-04-25T22:42:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5909999999999998e-06 2024-04-25T22:42:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830886+0000", 2024-04-25T22:42:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1670000000000002e-06 2024-04-25T22:42:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830891+0000", 2024-04-25T22:42:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2240000000000003e-06 2024-04-25T22:42:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831172+0000", 2024-04-25T22:42:21.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028078599999999999 2024-04-25T22:42:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831740+0000", 2024-04-25T22:42:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056778999999999998 2024-04-25T22:42:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4535 4.30 4:0fad8b11:::1000000393a.00000001:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-25T22:42:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.830900+0000", 2024-04-25T22:42:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00090652699999999996, 2024-04-25T22:42:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0014700970000000001, 2024-04-25T22:42:21.869 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830900+0000", 2024-04-25T22:42:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830900+0000", 2024-04-25T22:42:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830900+0000", 2024-04-25T22:42:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3700000000000001e-07 2024-04-25T22:42:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830903+0000", 2024-04-25T22:42:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7700000000000002e-06 2024-04-25T22:42:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830910+0000", 2024-04-25T22:42:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.601e-06 2024-04-25T22:42:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830916+0000", 2024-04-25T22:42:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8810000000000001e-06 2024-04-25T22:42:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.830986+0000", 2024-04-25T22:42:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0389000000000007e-05 2024-04-25T22:42:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831120+0000", 2024-04-25T22:42:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013447200000000001 2024-04-25T22:42:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(mds.0.3:4534 4.0 e66/57 4:018891bb:::1000000393a.00000000:head v 66'203, mlcod=66'201)", 2024-04-25T22:42:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.831273+0000", 2024-04-25T22:42:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00053364799999999996, 2024-04-25T22:42:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011608790000000001, 2024-04-25T22:42:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831273+0000", 2024-04-25T22:42:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831273+0000", 2024-04-25T22:42:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831273+0000", 2024-04-25T22:42:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1200000000000003e-07 2024-04-25T22:42:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831282+0000", 2024-04-25T22:42:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1750000000000005e-06 2024-04-25T22:42:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831290+0000", 2024-04-25T22:42:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2330000000000006e-06 2024-04-25T22:42:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831296+0000", 2024-04-25T22:42:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9909999999999999e-06 2024-04-25T22:42:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831449+0000", 2024-04-25T22:42:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015334600000000001 2024-04-25T22:42:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831467+0000", 2024-04-25T22:42:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7808e-05 2024-04-25T22:42:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4539 4.1a 4:5a7c7242:::10000003953.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-25T22:42:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.831867+0000", 2024-04-25T22:42:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.999939, 2024-04-25T22:42:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00063096599999999995, 2024-04-25T22:42:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831867+0000", 2024-04-25T22:42:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831867+0000", 2024-04-25T22:42:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831868+0000", 2024-04-25T22:42:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.92e-07 2024-04-25T22:42:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831873+0000", 2024-04-25T22:42:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5929999999999999e-06 2024-04-25T22:42:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831881+0000", 2024-04-25T22:42:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2670000000000006e-06 2024-04-25T22:42:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831888+0000", 2024-04-25T22:42:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9940000000000003e-06 2024-04-25T22:42:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832205+0000", 2024-04-25T22:42:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00031732400000000001 2024-04-25T22:42:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832322+0000", 2024-04-25T22:42:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000116703 2024-04-25T22:42:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4541 4.25 4:a4cca8f2:::10000003958.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-25T22:42:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.831900+0000", 2024-04-25T22:42:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9999065, 2024-04-25T22:42:21.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00066172099999999999, 2024-04-25T22:42:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-25T22:42:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831900+0000", 2024-04-25T22:42:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831900+0000", 2024-04-25T22:42:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831900+0000", 2024-04-25T22:42:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4400000000000001e-07 2024-04-25T22:42:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831902+0000", 2024-04-25T22:42:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.956e-06 2024-04-25T22:42:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831909+0000", 2024-04-25T22:42:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3369999999999996e-06 2024-04-25T22:42:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.831914+0000", 2024-04-25T22:42:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3020000000000002e-06 2024-04-25T22:42:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832401+0000", 2024-04-25T22:42:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000487412 2024-04-25T22:42:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4513 4.a 4:53b9bbce:::10000003342.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-25T22:42:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.828198+0000", 2024-04-25T22:42:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0036080460000000002, 2024-04-25T22:42:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004413335, 2024-04-25T22:42:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.828198+0000", 2024-04-25T22:42:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.828198+0000", 2024-04-25T22:42:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.828199+0000", 2024-04-25T22:42:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0049999999999999e-06 2024-04-25T22:42:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.828204+0000", 2024-04-25T22:42:21.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.454e-06 2024-04-25T22:42:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.828216+0000", 2024-04-25T22:42:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2573e-05 2024-04-25T22:42:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.828225+0000", 2024-04-25T22:42:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1319999999999994e-06 2024-04-25T22:42:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.828368+0000", 2024-04-25T22:42:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143547 2024-04-25T22:42:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.828440+0000", 2024-04-25T22:42:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1394000000000001e-05 2024-04-25T22:42:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.828531+0000", 2024-04-25T22:42:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1599000000000002e-05 2024-04-25T22:42:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832172+0000", 2024-04-25T22:42:21.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036407520000000001 2024-04-25T22:42:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832522+0000", 2024-04-25T22:42:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00034963799999999999 2024-04-25T22:42:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832570+0000", 2024-04-25T22:42:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8319000000000003e-05 2024-04-25T22:42:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832612+0000", 2024-04-25T22:42:21.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1922000000000003e-05 2024-04-25T22:42:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing_reply(3.13 epoch 66/16 rep_tid 8885 lcod 66'484)", 2024-04-25T22:42:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.832051+0000", 2024-04-25T22:42:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9997554, 2024-04-25T22:42:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00063967799999999997, 2024-04-25T22:42:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-25T22:42:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832051+0000", 2024-04-25T22:42:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832051+0000", 2024-04-25T22:42:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832052+0000", 2024-04-25T22:42:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3200000000000005e-07 2024-04-25T22:42:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832056+0000", 2024-04-25T22:42:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8489999999999999e-06 2024-04-25T22:42:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832064+0000", 2024-04-25T22:42:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5660000000000007e-06 2024-04-25T22:42:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832070+0000", 2024-04-25T22:42:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0059999999999998e-06 2024-04-25T22:42:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832119+0000", 2024-04-25T22:42:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8912999999999997e-05 2024-04-25T22:42:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4543 4.24 4:27530715:::1000000395f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-25T22:42:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.832182+0000", 2024-04-25T22:42:21.892 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9996243, 2024-04-25T22:42:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00057366199999999996, 2024-04-25T22:42:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832182+0000", 2024-04-25T22:42:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832182+0000", 2024-04-25T22:42:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832183+0000", 2024-04-25T22:42:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8999999999999996e-07 2024-04-25T22:42:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832186+0000", 2024-04-25T22:42:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2899999999999998e-06 2024-04-25T22:42:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832194+0000", 2024-04-25T22:42:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4649999999999997e-06 2024-04-25T22:42:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832201+0000", 2024-04-25T22:42:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8560000000000001e-06 2024-04-25T22:42:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832324+0000", 2024-04-25T22:42:21.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123029 2024-04-25T22:42:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832464+0000", 2024-04-25T22:42:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014066 2024-04-25T22:42:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4544 3.11 3:8e1f5003:::10000003961.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-25T22:42:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.832218+0000", 2024-04-25T22:42:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.999588, 2024-04-25T22:42:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00059998099999999997, 2024-04-25T22:42:21.896 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832218+0000", 2024-04-25T22:42:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832218+0000", 2024-04-25T22:42:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832219+0000", 2024-04-25T22:42:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5000000000000003e-07 2024-04-25T22:42:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832222+0000", 2024-04-25T22:42:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9270000000000001e-06 2024-04-25T22:42:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832228+0000", 2024-04-25T22:42:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5030000000000002e-06 2024-04-25T22:42:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832234+0000", 2024-04-25T22:42:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2719999999999997e-06 2024-04-25T22:42:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832298+0000", 2024-04-25T22:42:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3793000000000004e-05 2024-04-25T22:42:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832439+0000", 2024-04-25T22:42:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000141454 2024-04-25T22:42:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4545 4.3d 4:bc433bba:::10000003962.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-25T22:42:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.832242+0000", 2024-04-25T22:42:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9995642, 2024-04-25T22:42:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00065709799999999995, 2024-04-25T22:42:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:21.900 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832242+0000", 2024-04-25T22:42:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832242+0000", 2024-04-25T22:42:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832243+0000", 2024-04-25T22:42:21.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1099999999999995e-07 2024-04-25T22:42:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832245+0000", 2024-04-25T22:42:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0260000000000002e-06 2024-04-25T22:42:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832251+0000", 2024-04-25T22:42:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0279999999999997e-06 2024-04-25T22:42:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832256+0000", 2024-04-25T22:42:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1379999999999998e-06 2024-04-25T22:42:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832530+0000", 2024-04-25T22:42:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027437499999999999 2024-04-25T22:42:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832706+0000", 2024-04-25T22:42:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017537400000000001 2024-04-25T22:42:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.903 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "pg_update_log_missing_reply(4.30 epoch 66/17 rep_tid 8889 lcod 66'205)", 2024-04-25T22:42:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.832561+0000", 2024-04-25T22:42:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9992452, 2024-04-25T22:42:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00041791300000000001, 2024-04-25T22:42:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-25T22:42:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832561+0000", 2024-04-25T22:42:21.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832561+0000", 2024-04-25T22:42:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832562+0000", 2024-04-25T22:42:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0299999999999999e-07 2024-04-25T22:42:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832569+0000", 2024-04-25T22:42:21.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4679999999999997e-06 2024-04-25T22:42:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832584+0000", 2024-04-25T22:42:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5696e-05 2024-04-25T22:42:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832592+0000", 2024-04-25T22:42:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3420000000000002e-06 2024-04-25T22:42:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4548 4.32 4.833023b2 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-25T22:42:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.832693+0000", 2024-04-25T22:42:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9991136, 2024-04-25T22:42:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00034087499999999998, 2024-04-25T22:42:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-25T22:42:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832693+0000", 2024-04-25T22:42:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832693+0000", 2024-04-25T22:42:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832694+0000", 2024-04-25T22:42:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3399999999999997e-07 2024-04-25T22:42:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832698+0000", 2024-04-25T22:42:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4939999999999997e-06 2024-04-25T22:42:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832709+0000", 2024-04-25T22:42:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0803e-05 2024-04-25T22:42:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832718+0000", 2024-04-25T22:42:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2560000000000008e-06 2024-04-25T22:42:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.909 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:4549 4.2 4:40f6b3cc:::1000000396e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-04-25T22:42:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:21.832730+0000", 2024-04-25T22:42:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9990764, 2024-04-25T22:42:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00034140899999999998, 2024-04-25T22:42:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832730+0000", 2024-04-25T22:42:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832730+0000", 2024-04-25T22:42:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832731+0000", 2024-04-25T22:42:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1799999999999995e-07 2024-04-25T22:42:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832733+0000", 2024-04-25T22:42:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4590000000000001e-06 2024-04-25T22:42:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832741+0000", 2024-04-25T22:42:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3019999999999997e-06 2024-04-25T22:42:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832746+0000", 2024-04-25T22:42:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4759999999999997e-06 2024-04-25T22:42:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.832920+0000", 2024-04-25T22:42:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017366500000000001 2024-04-25T22:42:21.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:21.833034+0000", 2024-04-25T22:42:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011463699999999999 2024-04-25T22:42:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-25T22:42:21.913 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 21 2024-04-25T22:42:21.913 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:21.915 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:21.915+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:21.915 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:21.927 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:42:22.015 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:22.015+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:22.084 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:22.085 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:22.085 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:22.086 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:22.086 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:22.101 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:22.108 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:22.108 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:22.111 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:22.111 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:22.145 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:22.143+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:22.216 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:22.211+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:22.221 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:22.221 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:22.238 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:22.271 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is unset 2024-04-25T22:42:22.316 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:22.311+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:22.370 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:22.370 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:22.385 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:22.417 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~47s 2024-04-25T22:42:22.417 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:22.415+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:22.454 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T22:42:22.454 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T22:42:22.507 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:22.507 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:22.518 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:22.515+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:22.521 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:22.619 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:22.615+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:22.637 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:22.637 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:22.652 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:22.722 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:22.719+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:22.822 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:22.819+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:22.827 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:22.827 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:22.847 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:22.922 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:22.919+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:22.961 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:22.962 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:22.976 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:23.023 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:23.023+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:23.124 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:23.119+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:23.142 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:23.142 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:23.156 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:23.225 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:23.219+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:23.290 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:23.290 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:23.305 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:23.326 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:23.323+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:23.426 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:23.423+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:23.429 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:23.429 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:23.444 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:23.528 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:23.523+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:23.569 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:23.570 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:23.584 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:23.628 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:23.627+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:23.729 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:23.729 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:23.729 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:23.727+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:23.748 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:23.829 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:23.827+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:23.894 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:23.894 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:23.909 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:23.929 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:23.927+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:24.029 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:24.029 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:24.030 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:24.027+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:24.043 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:24.112 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:42:24.130 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:24.127+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:24.175 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:24.175 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:24.190 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:24.234 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:24.235+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:24.256 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:24.257 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:24.257 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:24.276 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:24.277 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:24.280 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:24.280 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:24.292 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:42:24.313 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:24.313 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:24.313 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:42:24.313 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:42:24.314 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:24.327 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:24.332 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:24.327+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:24.432 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:24.427+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:24.494 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:24.494 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:24.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:24.494 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:24.494 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.494 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:24.494 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:24.494 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 129.89687727500001, 2024-04-25T22:42:24.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:24.494 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:24.495 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:24.495 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:24.495 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:24.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:24.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:24.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:24.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:24.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:24.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:24.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:24.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:24.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:24.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:24.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:24.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:24.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:24.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:24.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:24.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:24.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:24.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:24.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:24.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:24.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:24.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:24.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:24.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:24.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:24.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:24.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:24.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:24.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:24.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:24.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:24.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:24.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:24.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:24.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:24.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:24.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:24.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:24.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.500 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:24.500 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:24.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:24.500 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.500 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.500 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.500 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:24.500 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:24.500 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 129.89674001899999, 2024-04-25T22:42:24.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:24.501 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:24.501 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:24.501 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:24.501 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:24.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:24.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:24.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:24.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:24.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:24.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:24.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:24.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:24.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:24.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:24.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:24.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:24.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:24.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:24.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:24.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:24.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:24.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:24.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:24.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:24.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:24.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:24.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:24.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:24.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:24.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:24.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:24.504 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:24.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:24.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.505 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:24.505 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:24.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:24.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.505 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:24.505 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:24.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:24.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.505 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:24.505 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:24.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:24.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:24.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:24.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:24.506 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.506 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.506 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.506 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:24.506 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:24.506 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 129.89647985100001, 2024-04-25T22:42:24.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:24.507 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:24.507 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:24.507 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:24.507 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:24.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:24.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:24.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:24.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:24.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:24.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:24.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:24.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:24.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:24.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:24.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:24.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:24.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:24.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:24.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:24.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:24.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.509 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.509 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:24.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:24.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:24.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:24.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:24.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:24.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:24.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:24.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:24.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:24.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:24.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:24.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:24.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:24.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:24.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:24.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:24.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:24.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:24.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:24.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:24.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:24.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:24.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:24.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:24.513 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.513 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.513 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.513 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:24.513 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:24.513 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 129.896314652, 2024-04-25T22:42:24.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:24.513 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:24.513 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:24.513 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:24.513 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:24.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:24.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:24.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:24.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:24.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:24.514 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:24.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:24.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:24.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:24.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:24.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:24.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:24.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:24.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:24.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:24.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:24.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:24.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:24.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:24.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:24.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:24.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:24.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:24.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:24.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:24.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:24.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:24.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:24.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:24.517 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.517 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.517 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.517 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:24.517 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:24.518 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 129.89624899, 2024-04-25T22:42:24.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:24.518 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:24.518 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:24.518 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:24.518 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:24.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:24.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:24.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:24.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:24.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:24.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:24.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:24.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:24.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:24.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:24.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:24.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:24.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:24.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:24.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:24.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:24.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:24.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:24.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:24.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:24.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:24.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:24.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:24.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:24.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:24.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:24.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:24.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:24.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:24.521 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.522 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.522 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.522 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10700 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:24.522 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:24.522 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 11.973381773, 2024-04-25T22:42:24.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066789482999999997, 2024-04-25T22:42:24.522 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:24.522 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:24.522 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:24.522 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:24.522 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:24.522 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:24.522 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10700 2024-04-25T22:42:24.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.523 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:24.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:24.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:24.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:24.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:24.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:24.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519112+0000", 2024-04-25T22:42:24.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1399999999999998e-06 2024-04-25T22:42:24.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:24.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527187+0000", 2024-04-25T22:42:24.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080748899999999995 2024-04-25T22:42:24.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:24.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527232+0000", 2024-04-25T22:42:24.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4895999999999998e-05 2024-04-25T22:42:24.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:24.524 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527259+0000", 2024-04-25T22:42:24.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7331999999999999e-05 2024-04-25T22:42:24.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529418+0000", 2024-04-25T22:42:24.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002158765 2024-04-25T22:42:24.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:24.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529572+0000", 2024-04-25T22:42:24.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015438499999999999 2024-04-25T22:42:24.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:24.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529762+0000", 2024-04-25T22:42:24.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018998100000000001 2024-04-25T22:42:24.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:24.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.548359+0000", 2024-04-25T22:42:24.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018596444 2024-04-25T22:42:24.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:24.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585801+0000", 2024-04-25T22:42:24.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.037442469999999999 2024-04-25T22:42:24.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:24.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585847+0000", 2024-04-25T22:42:24.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5565000000000002e-05 2024-04-25T22:42:24.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:24.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585899+0000", 2024-04-25T22:42:24.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2614999999999997e-05 2024-04-25T22:42:24.527 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.527 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.527 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.527 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10714 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:24.527 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:24.527 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 11.93970081, 2024-04-25T22:42:24.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.048080623000000003, 2024-04-25T22:42:24.527 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:24.528 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:24.528 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:24.528 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:24.528 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:24.528 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:24.528 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10714 2024-04-25T22:42:24.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.528 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:24.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:24.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:24.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:24.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:24.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:24.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552792+0000", 2024-04-25T22:42:24.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:42:24.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:24.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559915+0000", 2024-04-25T22:42:24.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071231690000000004 2024-04-25T22:42:24.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.529 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:24.530 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559932+0000", 2024-04-25T22:42:24.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7169000000000001e-05 2024-04-25T22:42:24.530 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:24.530 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559942+0000", 2024-04-25T22:42:24.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0261999999999999e-05 2024-04-25T22:42:24.530 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.530 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560018+0000", 2024-04-25T22:42:24.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5358000000000006e-05 2024-04-25T22:42:24.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:24.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560118+0000", 2024-04-25T22:42:24.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000100911 2024-04-25T22:42:24.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:24.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560281+0000", 2024-04-25T22:42:24.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016288500000000001 2024-04-25T22:42:24.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:24.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.579740+0000", 2024-04-25T22:42:24.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019458598000000001 2024-04-25T22:42:24.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:24.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600484+0000", 2024-04-25T22:42:24.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020744483000000001 2024-04-25T22:42:24.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:24.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600664+0000", 2024-04-25T22:42:24.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017953899999999999 2024-04-25T22:42:24.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:24.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600871+0000", 2024-04-25T22:42:24.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020737199999999999 2024-04-25T22:42:24.532 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.532 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.533 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.533 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10813 4.17 4:e8010137:::100000030b0.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:24.533 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:24.533 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 11.744751804, 2024-04-25T22:42:24.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.047503799999999999, 2024-04-25T22:42:24.533 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:24.533 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:24.533 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:24.533 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:24.533 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:24.533 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:24.533 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10813 2024-04-25T22:42:24.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.533 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:24.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:24.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:24.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:24.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:24.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:24.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747741+0000", 2024-04-25T22:42:24.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1119999999999999e-06 2024-04-25T22:42:24.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:24.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752366+0000", 2024-04-25T22:42:24.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046253240000000001 2024-04-25T22:42:24.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:24.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752382+0000", 2024-04-25T22:42:24.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5639999999999999e-05 2024-04-25T22:42:24.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:24.535 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752393+0000", 2024-04-25T22:42:24.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1626e-05 2024-04-25T22:42:24.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752459+0000", 2024-04-25T22:42:24.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5309999999999996e-05 2024-04-25T22:42:24.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:24.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752529+0000", 2024-04-25T22:42:24.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0543000000000005e-05 2024-04-25T22:42:24.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:24.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752637+0000", 2024-04-25T22:42:24.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010788799999999999 2024-04-25T22:42:24.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:24.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760295+0000", 2024-04-25T22:42:24.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076583290000000002 2024-04-25T22:42:24.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:24.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.794990+0000", 2024-04-25T22:42:24.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034694317000000002 2024-04-25T22:42:24.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:24.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795097+0000", 2024-04-25T22:42:24.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010768999999999999 2024-04-25T22:42:24.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:24.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795243+0000", 2024-04-25T22:42:24.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000146021 2024-04-25T22:42:24.538 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.538 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.538 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.538 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10816 4.17 4:e8010137:::100000030b0.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:24.538 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:24.538 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 11.739422343999999, 2024-04-25T22:42:24.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042406530999999997, 2024-04-25T22:42:24.538 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:24.538 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:24.538 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:24.538 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:24.539 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:24.539 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:24.539 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10816 2024-04-25T22:42:24.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.539 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:24.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:24.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:24.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:24.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:24.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:24.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753070+0000", 2024-04-25T22:42:24.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9800000000000002e-07 2024-04-25T22:42:24.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:24.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753288+0000", 2024-04-25T22:42:24.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000217789 2024-04-25T22:42:24.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.540 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:24.540 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753301+0000", 2024-04-25T22:42:24.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2764e-05 2024-04-25T22:42:24.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:24.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753310+0000", 2024-04-25T22:42:24.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:42:24.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758240+0000", 2024-04-25T22:42:24.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049304910000000004 2024-04-25T22:42:24.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:24.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758374+0000", 2024-04-25T22:42:24.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000133428 2024-04-25T22:42:24.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:24.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758576+0000", 2024-04-25T22:42:24.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020177899999999999 2024-04-25T22:42:24.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:24.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760626+0000", 2024-04-25T22:42:24.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0020501489999999998 2024-04-25T22:42:24.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:24.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795329+0000", 2024-04-25T22:42:24.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034703352999999999 2024-04-25T22:42:24.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:24.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795414+0000", 2024-04-25T22:42:24.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5292999999999998e-05 2024-04-25T22:42:24.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:24.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795476+0000", 2024-04-25T22:42:24.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1206999999999999e-05 2024-04-25T22:42:24.543 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.543 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.543 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.544 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10914 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:24.544 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:24.544 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 11.538621962000001, 2024-04-25T22:42:24.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044452984000000001, 2024-04-25T22:42:24.544 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:24.544 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:24.544 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:24.544 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:24.544 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:24.544 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:24.544 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10914 2024-04-25T22:42:24.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.545 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:24.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:24.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:24.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:24.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:24.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:24.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953871+0000", 2024-04-25T22:42:24.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1829999999999999e-06 2024-04-25T22:42:24.545 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:24.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.962992+0000", 2024-04-25T22:42:24.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091217409999999992 2024-04-25T22:42:24.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:24.546 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963027+0000", 2024-04-25T22:42:24.546 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4229e-05 2024-04-25T22:42:24.546 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.546 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.546 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:24.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963042+0000", 2024-04-25T22:42:24.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5152e-05 2024-04-25T22:42:24.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963143+0000", 2024-04-25T22:42:24.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101171 2024-04-25T22:42:24.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.547 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.547 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:24.547 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963269+0000", 2024-04-25T22:42:24.547 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012623499999999999 2024-04-25T22:42:24.547 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:24.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963453+0000", 2024-04-25T22:42:24.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018357900000000001 2024-04-25T22:42:24.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:24.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998133+0000", 2024-04-25T22:42:24.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034679789000000003 2024-04-25T22:42:24.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.548 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:24.548 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998220+0000", 2024-04-25T22:42:24.548 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7153999999999999e-05 2024-04-25T22:42:24.548 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.548 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:24.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998278+0000", 2024-04-25T22:42:24.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8035000000000003e-05 2024-04-25T22:42:24.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.549 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:24.549 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998323+0000", 2024-04-25T22:42:24.549 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4715999999999997e-05 2024-04-25T22:42:24.549 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.549 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.549 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.549 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.549 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.549 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10919 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:24.550 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:24.550 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 11.518310680999999, 2024-04-25T22:42:24.550 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044010552000000001, 2024-04-25T22:42:24.550 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:24.550 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:24.550 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:24.550 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:24.550 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:24.550 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:24.550 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10919 2024-04-25T22:42:24.550 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.550 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:24.550 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:24.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:24.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:24.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:24.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:24.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:24.551 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8100000000000003e-07 2024-04-25T22:42:24.551 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.551 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.551 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:24.551 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980221+0000", 2024-04-25T22:42:24.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060397230000000003 2024-04-25T22:42:24.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:24.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980242+0000", 2024-04-25T22:42:24.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1373e-05 2024-04-25T22:42:24.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:24.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980252+0000", 2024-04-25T22:42:24.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9990000000000003e-06 2024-04-25T22:42:24.552 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.552 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.552 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.552 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981303+0000", 2024-04-25T22:42:24.552 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010501670000000001 2024-04-25T22:42:24.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:24.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981444+0000", 2024-04-25T22:42:24.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014123799999999999 2024-04-25T22:42:24.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:24.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981585+0000", 2024-04-25T22:42:24.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014071999999999999 2024-04-25T22:42:24.553 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.553 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.553 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:24.553 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003640+0000", 2024-04-25T22:42:24.553 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022055113000000001 2024-04-25T22:42:24.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:24.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018070+0000", 2024-04-25T22:42:24.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014430877 2024-04-25T22:42:24.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:24.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018138+0000", 2024-04-25T22:42:24.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7743000000000005e-05 2024-04-25T22:42:24.554 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.554 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.554 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:24.554 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018191+0000", 2024-04-25T22:42:24.554 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3118000000000002e-05 2024-04-25T22:42:24.555 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.555 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.555 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.555 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.555 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.555 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:12632 4.a e64/17 4:506aad5d:::1000000310f.00000000:head v 64'203, mlcod=64'201)", 2024-04-25T22:42:24.555 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:24.555 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 8.8489622860000008, 2024-04-25T22:42:24.555 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041913617, 2024-04-25T22:42:24.555 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:24.555 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:24.555 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:24.556 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:24.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:24.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:24.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:24.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:24.556 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.556 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.556 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.556 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:24.556 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643531+0000", 2024-04-25T22:42:24.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.497e-06 2024-04-25T22:42:24.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:24.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650159+0000", 2024-04-25T22:42:24.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066287059999999998 2024-04-25T22:42:24.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.557 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:24.557 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650185+0000", 2024-04-25T22:42:24.557 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5646000000000001e-05 2024-04-25T22:42:24.557 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.557 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:24.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650205+0000", 2024-04-25T22:42:24.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9720000000000001e-05 2024-04-25T22:42:24.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650521+0000", 2024-04-25T22:42:24.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00031590699999999998 2024-04-25T22:42:24.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.558 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.558 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:24.558 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650574+0000", 2024-04-25T22:42:24.558 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3192000000000002e-05 2024-04-25T22:42:24.558 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:24.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685374+0000", 2024-04-25T22:42:24.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034799902000000001 2024-04-25T22:42:24.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.559 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.559 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:24.559 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685443+0000", 2024-04-25T22:42:24.559 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9047000000000005e-05 2024-04-25T22:42:24.559 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.559 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.559 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.559 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.560 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12644 4.11 4:8893db93:::100000034c2.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:24.560 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:24.560 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 8.8405533960000007, 2024-04-25T22:42:24.560 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045039497999999997, 2024-04-25T22:42:24.560 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:24.560 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:24.560 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:24.560 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:24.560 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:24.560 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:24.560 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12644 2024-04-25T22:42:24.560 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.560 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:24.560 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:24.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:24.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:24.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:24.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.561 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.561 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:24.561 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651940+0000", 2024-04-25T22:42:24.561 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.013e-06 2024-04-25T22:42:24.561 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:24.562 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659663+0000", 2024-04-25T22:42:24.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077228150000000001 2024-04-25T22:42:24.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:24.562 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659694+0000", 2024-04-25T22:42:24.562 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1112999999999998e-05 2024-04-25T22:42:24.562 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.562 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.562 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:24.562 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659715+0000", 2024-04-25T22:42:24.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1053e-05 2024-04-25T22:42:24.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659842+0000", 2024-04-25T22:42:24.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012738100000000001 2024-04-25T22:42:24.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:24.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660068+0000", 2024-04-25T22:42:24.563 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000225746 2024-04-25T22:42:24.563 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.563 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.563 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:24.563 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660307+0000", 2024-04-25T22:42:24.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000238352 2024-04-25T22:42:24.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:24.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.683776+0000", 2024-04-25T22:42:24.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023469891999999999 2024-04-25T22:42:24.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:24.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696810+0000", 2024-04-25T22:42:24.564 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013033385999999999 2024-04-25T22:42:24.564 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.564 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.564 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:24.564 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696904+0000", 2024-04-25T22:42:24.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3820000000000006e-05 2024-04-25T22:42:24.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.565 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:24.565 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696978+0000", 2024-04-25T22:42:24.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3926999999999999e-05 2024-04-25T22:42:24.565 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.565 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.565 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.565 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.565 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.565 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12645 4.2d 4:b45456a9:::10000003241.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:24.565 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:24.565 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 8.8327329090000006, 2024-04-25T22:42:24.565 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.043099660999999997, 2024-04-25T22:42:24.565 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:24.566 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:24.566 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:24.566 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:24.566 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:24.566 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:24.566 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12645 2024-04-25T22:42:24.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.566 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:24.566 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.566 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:24.566 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:24.566 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.566 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:24.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:24.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:24.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659761+0000", 2024-04-25T22:42:24.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8459999999999999e-06 2024-04-25T22:42:24.567 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.567 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.567 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:24.567 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666663+0000", 2024-04-25T22:42:24.567 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0069017080000000003 2024-04-25T22:42:24.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:24.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666684+0000", 2024-04-25T22:42:24.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0706000000000001e-05 2024-04-25T22:42:24.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:24.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666700+0000", 2024-04-25T22:42:24.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5985999999999999e-05 2024-04-25T22:42:24.568 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.568 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.568 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.568 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666914+0000", 2024-04-25T22:42:24.568 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000213861 2024-04-25T22:42:24.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:24.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.667082+0000", 2024-04-25T22:42:24.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016809 2024-04-25T22:42:24.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:24.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702598+0000", 2024-04-25T22:42:24.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035515962999999998 2024-04-25T22:42:24.569 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.569 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.569 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:24.569 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702705+0000", 2024-04-25T22:42:24.569 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010689800000000001 2024-04-25T22:42:24.570 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.570 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:24.570 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702858+0000", 2024-04-25T22:42:24.570 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015360300000000001 2024-04-25T22:42:24.570 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.570 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.570 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.570 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.570 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.570 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12829 4.3b 4:de8bdadd:::100000033c7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:24.570 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:24.570 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 8.604472994, 2024-04-25T22:42:24.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042457306, 2024-04-25T22:42:24.571 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:24.571 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:24.571 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:24.571 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:24.571 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:24.571 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:24.571 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12829 2024-04-25T22:42:24.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.571 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:24.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.571 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:24.571 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:24.571 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.571 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.571 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:24.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:24.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:24.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888019+0000", 2024-04-25T22:42:24.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3300000000000002e-07 2024-04-25T22:42:24.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:24.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891638+0000", 2024-04-25T22:42:24.572 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036189109999999998 2024-04-25T22:42:24.572 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.572 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.572 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:24.572 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891661+0000", 2024-04-25T22:42:24.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3345000000000001e-05 2024-04-25T22:42:24.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:24.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891671+0000", 2024-04-25T22:42:24.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0115000000000001e-05 2024-04-25T22:42:24.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891737+0000", 2024-04-25T22:42:24.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5600999999999998e-05 2024-04-25T22:42:24.573 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.573 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.573 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:24.573 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891856+0000", 2024-04-25T22:42:24.573 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011881 2024-04-25T22:42:24.574 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.574 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:24.574 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930251+0000", 2024-04-25T22:42:24.574 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.038395141000000001 2024-04-25T22:42:24.574 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.574 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:24.574 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930389+0000", 2024-04-25T22:42:24.574 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013849000000000001 2024-04-25T22:42:24.574 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.574 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.574 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:24.574 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930476+0000", 2024-04-25T22:42:24.574 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6360000000000007e-05 2024-04-25T22:42:24.574 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.575 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.575 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.575 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.575 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.575 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13009 4.1e 4:78728bd7:::100000033a5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:24.575 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:24.575 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 8.4025859819999997, 2024-04-25T22:42:24.575 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049997452999999997, 2024-04-25T22:42:24.575 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:24.575 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:24.575 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:24.575 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:24.575 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:24.575 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:24.575 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13009 2024-04-25T22:42:24.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.576 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:24.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:24.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:24.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:24.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:24.576 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.576 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.576 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.576 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:24.576 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:24.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4799999999999997e-07 2024-04-25T22:42:24.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:24.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097105+0000", 2024-04-25T22:42:24.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071984060000000001 2024-04-25T22:42:24.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:24.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097118+0000", 2024-04-25T22:42:24.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2865e-05 2024-04-25T22:42:24.577 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.577 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.577 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:24.577 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097127+0000", 2024-04-25T22:42:24.577 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8449999999999998e-06 2024-04-25T22:42:24.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097174+0000", 2024-04-25T22:42:24.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6084000000000001e-05 2024-04-25T22:42:24.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:24.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097232+0000", 2024-04-25T22:42:24.578 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8928999999999998e-05 2024-04-25T22:42:24.578 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.578 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.578 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:24.578 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097309+0000", 2024-04-25T22:42:24.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7014999999999994e-05 2024-04-25T22:42:24.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:24.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.108708+0000", 2024-04-25T22:42:24.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011398233000000001 2024-04-25T22:42:24.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:24.579 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139793+0000", 2024-04-25T22:42:24.579 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031084856000000001 2024-04-25T22:42:24.579 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.579 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.579 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:24.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139848+0000", 2024-04-25T22:42:24.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5464000000000003e-05 2024-04-25T22:42:24.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.580 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:24.580 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139903+0000", 2024-04-25T22:42:24.580 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4907999999999997e-05 2024-04-25T22:42:24.580 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.580 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.580 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.580 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.580 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.580 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13318 4.16 4:6810bf9e:::10000003259.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:24.580 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:24.581 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 8.0320116240000008, 2024-04-25T22:42:24.581 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057538179000000002, 2024-04-25T22:42:24.581 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:24.581 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:24.581 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:24.581 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:24.581 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:24.581 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:24.581 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13318 2024-04-25T22:42:24.581 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.581 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:24.581 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.581 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:24.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:24.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:24.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:24.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:24.582 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460481+0000", 2024-04-25T22:42:24.582 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:42:24.582 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.582 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.582 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:24.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466775+0000", 2024-04-25T22:42:24.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062944239999999999 2024-04-25T22:42:24.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:24.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466787+0000", 2024-04-25T22:42:24.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1688999999999999e-05 2024-04-25T22:42:24.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:24.583 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466793+0000", 2024-04-25T22:42:24.583 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7209999999999999e-06 2024-04-25T22:42:24.583 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.583 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.583 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466845+0000", 2024-04-25T22:42:24.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2166999999999997e-05 2024-04-25T22:42:24.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:24.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466912+0000", 2024-04-25T22:42:24.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7016999999999999e-05 2024-04-25T22:42:24.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:24.584 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.467020+0000", 2024-04-25T22:42:24.584 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010827699999999999 2024-04-25T22:42:24.584 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.584 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.584 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:24.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.476718+0000", 2024-04-25T22:42:24.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0096980439999999994 2024-04-25T22:42:24.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:24.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517860+0000", 2024-04-25T22:42:24.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041141847000000002 2024-04-25T22:42:24.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.585 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.585 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:24.585 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517924+0000", 2024-04-25T22:42:24.585 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3997000000000004e-05 2024-04-25T22:42:24.585 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.586 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:24.586 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.518018+0000", 2024-04-25T22:42:24.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4139000000000001e-05 2024-04-25T22:42:24.586 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.586 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.586 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.586 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.586 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.586 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13328 4.16 4:6a9ab238:::1000000339b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:24.586 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:24.586 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 8.0130986390000007, 2024-04-25T22:42:24.586 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057072695999999999, 2024-04-25T22:42:24.587 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:24.587 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:24.587 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:24.587 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:24.587 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:24.587 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:24.587 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13328 2024-04-25T22:42:24.587 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.587 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:24.587 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.587 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:24.587 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:24.587 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:24.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:24.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:24.588 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479395+0000", 2024-04-25T22:42:24.588 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2859999999999998e-06 2024-04-25T22:42:24.588 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.588 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.588 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:24.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486667+0000", 2024-04-25T22:42:24.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072715599999999998 2024-04-25T22:42:24.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:24.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486677+0000", 2024-04-25T22:42:24.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0305e-05 2024-04-25T22:42:24.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:24.589 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486683+0000", 2024-04-25T22:42:24.589 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5300000000000004e-06 2024-04-25T22:42:24.589 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.589 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.589 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486768+0000", 2024-04-25T22:42:24.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5725999999999999e-05 2024-04-25T22:42:24.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:24.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486905+0000", 2024-04-25T22:42:24.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013696699999999999 2024-04-25T22:42:24.590 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.590 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.590 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:24.590 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.487121+0000", 2024-04-25T22:42:24.590 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021615299999999999 2024-04-25T22:42:24.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.591 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:24.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.509675+0000", 2024-04-25T22:42:24.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022553225999999999 2024-04-25T22:42:24.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.591 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:24.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536355+0000", 2024-04-25T22:42:24.591 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026680855 2024-04-25T22:42:24.591 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.591 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.591 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:24.591 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536401+0000", 2024-04-25T22:42:24.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5649000000000003e-05 2024-04-25T22:42:24.592 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.592 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.592 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:24.592 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536466+0000", 2024-04-25T22:42:24.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4438999999999997e-05 2024-04-25T22:42:24.592 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.592 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.592 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.592 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.592 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.592 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13329 4.26 4:64e005a2:::10000003483.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:24.592 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:24.592 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 8.0057902399999996, 2024-04-25T22:42:24.592 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066502845000000005, 2024-04-25T22:42:24.593 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:24.593 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:24.593 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:24.593 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:24.593 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:24.593 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:24.593 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13329 2024-04-25T22:42:24.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.593 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:24.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.593 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:24.593 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:24.593 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.593 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.593 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:24.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:24.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:24.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486703+0000", 2024-04-25T22:42:24.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3909999999999999e-06 2024-04-25T22:42:24.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.594 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:24.594 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494612+0000", 2024-04-25T22:42:24.594 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0079096670000000004 2024-04-25T22:42:24.594 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.594 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:24.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494626+0000", 2024-04-25T22:42:24.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3263e-05 2024-04-25T22:42:24.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:24.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494637+0000", 2024-04-25T22:42:24.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.171e-05 2024-04-25T22:42:24.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.595 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494720+0000", 2024-04-25T22:42:24.595 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2767000000000002e-05 2024-04-25T22:42:24.595 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.595 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.595 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:24.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494834+0000", 2024-04-25T22:42:24.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011387699999999999 2024-04-25T22:42:24.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:24.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494998+0000", 2024-04-25T22:42:24.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016390799999999999 2024-04-25T22:42:24.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:24.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517407+0000", 2024-04-25T22:42:24.596 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022409068000000001 2024-04-25T22:42:24.596 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.596 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.596 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:24.596 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553040+0000", 2024-04-25T22:42:24.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035633155 2024-04-25T22:42:24.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:24.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553140+0000", 2024-04-25T22:42:24.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9623000000000005e-05 2024-04-25T22:42:24.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.597 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.597 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:24.597 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553204+0000", 2024-04-25T22:42:24.597 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4416000000000001e-05 2024-04-25T22:42:24.597 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.597 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.597 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.597 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.598 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.598 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13399 4.16 4:6bb7cc3a:::10000003648.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:24.598 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:24.598 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 7.9324244400000001, 2024-04-25T22:42:24.598 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045625003999999997, 2024-04-25T22:42:24.598 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:24.598 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:24.598 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:24.598 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:24.598 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:24.598 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:24.598 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13399 2024-04-25T22:42:24.598 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.599 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:24.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:24.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:24.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:24.599 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:24.599 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:24.599 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.599 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.599 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:24.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560068+0000", 2024-04-25T22:42:24.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:42:24.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:24.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576902+0000", 2024-04-25T22:42:24.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016833806 2024-04-25T22:42:24.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:24.600 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576916+0000", 2024-04-25T22:42:24.600 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3648e-05 2024-04-25T22:42:24.600 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.600 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.600 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:24.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576927+0000", 2024-04-25T22:42:24.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0992000000000001e-05 2024-04-25T22:42:24.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:24.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577026+0000", 2024-04-25T22:42:24.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9116000000000004e-05 2024-04-25T22:42:24.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:24.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577203+0000", 2024-04-25T22:42:24.601 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017700499999999999 2024-04-25T22:42:24.601 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.601 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.601 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:24.601 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577336+0000", 2024-04-25T22:42:24.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013340800000000001 2024-04-25T22:42:24.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:24.602 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.589077+0000", 2024-04-25T22:42:24.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011741151 2024-04-25T22:42:24.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.602 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:24.602 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605436+0000", 2024-04-25T22:42:24.602 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016359146000000001 2024-04-25T22:42:24.602 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.602 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:24.603 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605493+0000", 2024-04-25T22:42:24.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7067000000000001e-05 2024-04-25T22:42:24.603 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:24.603 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:24.603 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:24.603 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605692+0000", 2024-04-25T22:42:24.603 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00019855799999999999 2024-04-25T22:42:24.603 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.603 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.603 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.603 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:24.603 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:24.603 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:24.605 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:24.605 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:24.599+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:24.706 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:24.703+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:24.743 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:24.743 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:24.743 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:42:24.743 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:24.758 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:24.806 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:24.807+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:24.907 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:24.907+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:24.934 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:24.935 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:24.935 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:42:24.935 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:42:24.935 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:24.949 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:25.008 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:25.003+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:25.076 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:25.076 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:42:25.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:42:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.47736526599999, 2024-04-25T22:42:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:42:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:25.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:42:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:42:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:42:25.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:42:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:42:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:42:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:42:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:42:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:42:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:42:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:42:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:42:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:42:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:42:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:25.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:42:25.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:42:25.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:25.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:42:25.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:42:25.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:42:25.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:42:25.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:42:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:42:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:42:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:42:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:42:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:42:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.082 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.47725695299999, 2024-04-25T22:42:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:42:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:42:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:42:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:42:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:42:25.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:42:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:42:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:42:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:42:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:42:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:42:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:42:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:42:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:42:25.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:42:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:42:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:42:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:42:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:42:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:42:25.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:42:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:42:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:42:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:42:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:42:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:42:25.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:42:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.47719029699999, 2024-04-25T22:42:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:42:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:42:25.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:42:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:42:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:42:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:42:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:42:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:42:25.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:42:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:42:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:42:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:42:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:42:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:42:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:42:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:42:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:42:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:42:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:42:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:42:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:42:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:42:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:42:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:42:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:42:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:25.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:42:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:42:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.47709970099999, 2024-04-25T22:42:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:42:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:25.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:42:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:42:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:42:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:42:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:42:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:42:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:42:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:42:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:42:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:42:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:42:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:42:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:42:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:42:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:42:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:42:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:42:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:42:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:42:25.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:42:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:42:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:42:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:42:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:42:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:42:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:42:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.47703512800001, 2024-04-25T22:42:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:42:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.101 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:42:25.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:42:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:42:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:42:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:42:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:42:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:42:25.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:42:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:42:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:42:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:42:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:42:25.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:42:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:42:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:42:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:42:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:42:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:42:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:42:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:42:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:42:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:42:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:42:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:42:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:42:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.47696970499999, 2024-04-25T22:42:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:42:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.107 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:42:25.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:42:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:42:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:42:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:42:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:42:25.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:42:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:42:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:42:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:42:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:42:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:42:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:42:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:42:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:42:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:42:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:42:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:42:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:42:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:42:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:42:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:42:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:42:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:42:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:42:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 130.476689171, 2024-04-25T22:42:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:42:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:25.113 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:42:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:42:25.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:25.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:42:25.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:42:25.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:25.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:42:25.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:42:25.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:42:25.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:42:25.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:42:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:42:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:42:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:42:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:42:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:42:25.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:42:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:42:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:42:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:42:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:42:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:42:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:42:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:42:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:42:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:42:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:42:25.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:42:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10678 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.585404432000001, 2024-04-25T22:42:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050477795999999998, 2024-04-25T22:42:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:25.119 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10678 2024-04-25T22:42:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488127+0000", 2024-04-25T22:42:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.716e-06 2024-04-25T22:42:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496392+0000", 2024-04-25T22:42:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082651500000000006 2024-04-25T22:42:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496428+0000", 2024-04-25T22:42:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5441999999999997e-05 2024-04-25T22:42:25.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496451+0000", 2024-04-25T22:42:25.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3529000000000001e-05 2024-04-25T22:42:25.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496601+0000", 2024-04-25T22:42:25.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014935600000000001 2024-04-25T22:42:25.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:25.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496856+0000", 2024-04-25T22:42:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025537900000000002 2024-04-25T22:42:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.497206+0000", 2024-04-25T22:42:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000350599 2024-04-25T22:42:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538231+0000", 2024-04-25T22:42:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041024146999999997 2024-04-25T22:42:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:25.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538298+0000", 2024-04-25T22:42:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7688000000000007e-05 2024-04-25T22:42:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538467+0000", 2024-04-25T22:42:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000168178 2024-04-25T22:42:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538603+0000", 2024-04-25T22:42:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013661200000000001 2024-04-25T22:42:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10692 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.568814637999999, 2024-04-25T22:42:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.061242408999999998, 2024-04-25T22:42:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10692 2024-04-25T22:42:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:25.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504717+0000", 2024-04-25T22:42:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6199999999999999e-06 2024-04-25T22:42:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511770+0000", 2024-04-25T22:42:25.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0070530929999999999 2024-04-25T22:42:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511810+0000", 2024-04-25T22:42:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0635e-05 2024-04-25T22:42:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511837+0000", 2024-04-25T22:42:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6423000000000001e-05 2024-04-25T22:42:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520096+0000", 2024-04-25T22:42:25.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082593730000000004 2024-04-25T22:42:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520345+0000", 2024-04-25T22:42:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024908800000000001 2024-04-25T22:42:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520794+0000", 2024-04-25T22:42:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000449023 2024-04-25T22:42:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538675+0000", 2024-04-25T22:42:25.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017880991999999998 2024-04-25T22:42:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565761+0000", 2024-04-25T22:42:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027085260999999999 2024-04-25T22:42:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565892+0000", 2024-04-25T22:42:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013152300000000001 2024-04-25T22:42:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565958+0000", 2024-04-25T22:42:25.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5377999999999996e-05 2024-04-25T22:42:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10693 4.2c 4:36971e45:::100000030bd.00000001:head [write 971225~86041] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.561636276, 2024-04-25T22:42:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054529782999999998, 2024-04-25T22:42:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.130 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10693 2024-04-25T22:42:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511897+0000", 2024-04-25T22:42:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2499999999999998e-06 2024-04-25T22:42:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512094+0000", 2024-04-25T22:42:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019700100000000001 2024-04-25T22:42:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512121+0000", 2024-04-25T22:42:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7288999999999999e-05 2024-04-25T22:42:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512137+0000", 2024-04-25T22:42:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.592e-05 2024-04-25T22:42:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.533845+0000", 2024-04-25T22:42:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021707595999999999 2024-04-25T22:42:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534176+0000", 2024-04-25T22:42:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033187000000000001 2024-04-25T22:42:25.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534626+0000", 2024-04-25T22:42:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00045008599999999999 2024-04-25T22:42:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.539165+0000", 2024-04-25T22:42:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045386380000000002 2024-04-25T22:42:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566169+0000", 2024-04-25T22:42:25.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027004199 2024-04-25T22:42:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566317+0000", 2024-04-25T22:42:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014747999999999999 2024-04-25T22:42:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566423+0000", 2024-04-25T22:42:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010645399999999999 2024-04-25T22:42:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10696 4.2b 4:d56d2a96:::100000030c3.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.559928631, 2024-04-25T22:42:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052282190999999999, 2024-04-25T22:42:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10696 2024-04-25T22:42:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:25.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513603+0000", 2024-04-25T22:42:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.283e-06 2024-04-25T22:42:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518647+0000", 2024-04-25T22:42:25.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050440859999999997 2024-04-25T22:42:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518672+0000", 2024-04-25T22:42:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4468e-05 2024-04-25T22:42:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518691+0000", 2024-04-25T22:42:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9213999999999999e-05 2024-04-25T22:42:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518806+0000", 2024-04-25T22:42:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115296 2024-04-25T22:42:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519011+0000", 2024-04-25T22:42:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020445700000000001 2024-04-25T22:42:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519207+0000", 2024-04-25T22:42:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000196431 2024-04-25T22:42:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531309+0000", 2024-04-25T22:42:25.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012101694 2024-04-25T22:42:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565622+0000", 2024-04-25T22:42:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034312976000000002 2024-04-25T22:42:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565769+0000", 2024-04-25T22:42:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014715900000000001 2024-04-25T22:42:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565883+0000", 2024-04-25T22:42:25.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000114127 2024-04-25T22:42:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10701 4.a 4:51b6a63a:::100000030f2.00000000:head [write 0~3014656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.548484621, 2024-04-25T22:42:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047414393999999999, 2024-04-25T22:42:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.141 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10701 2024-04-25T22:42:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525048+0000", 2024-04-25T22:42:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0819999999999999e-06 2024-04-25T22:42:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531709+0000", 2024-04-25T22:42:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066610929999999999 2024-04-25T22:42:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531751+0000", 2024-04-25T22:42:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1650000000000003e-05 2024-04-25T22:42:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531788+0000", 2024-04-25T22:42:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7305000000000003e-05 2024-04-25T22:42:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531943+0000", 2024-04-25T22:42:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015500600000000001 2024-04-25T22:42:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532086+0000", 2024-04-25T22:42:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014238599999999999 2024-04-25T22:42:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532295+0000", 2024-04-25T22:42:25.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020922000000000001 2024-04-25T22:42:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.545987+0000", 2024-04-25T22:42:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013692582999999999 2024-04-25T22:42:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572315+0000", 2024-04-25T22:42:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026327488 2024-04-25T22:42:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572381+0000", 2024-04-25T22:42:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5609000000000002e-05 2024-04-25T22:42:25.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572460+0000", 2024-04-25T22:42:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8972000000000002e-05 2024-04-25T22:42:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:10700 4.11 e63/57 4:88409fbf:::100000030ec.00000000:head v 63'193, mlcod=62'191)", 2024-04-25T22:42:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.537655165, 2024-04-25T22:42:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050517667000000002, 2024-04-25T22:42:25.146 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:25.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535876+0000", 2024-04-25T22:42:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0300000000000001e-06 2024-04-25T22:42:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565275+0000", 2024-04-25T22:42:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029399033000000001 2024-04-25T22:42:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565358+0000", 2024-04-25T22:42:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3403000000000001e-05 2024-04-25T22:42:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565380+0000", 2024-04-25T22:42:25.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1761999999999999e-05 2024-04-25T22:42:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565505+0000", 2024-04-25T22:42:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000125153 2024-04-25T22:42:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565550+0000", 2024-04-25T22:42:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5479000000000003e-05 2024-04-25T22:42:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586328+0000", 2024-04-25T22:42:25.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020777982 2024-04-25T22:42:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586392+0000", 2024-04-25T22:42:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3825000000000006e-05 2024-04-25T22:42:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12632 4.a 4:506aad5d:::1000000310f.00000000:head [write 0~4194304 [2@2043125]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.4386000390000007, 2024-04-25T22:42:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051574097999999999, 2024-04-25T22:42:25.150 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12632 2024-04-25T22:42:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:25.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634932+0000", 2024-04-25T22:42:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1600000000000001e-06 2024-04-25T22:42:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642614+0000", 2024-04-25T22:42:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076823000000000004 2024-04-25T22:42:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:25.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642660+0000", 2024-04-25T22:42:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6016000000000001e-05 2024-04-25T22:42:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642686+0000", 2024-04-25T22:42:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5491999999999999e-05 2024-04-25T22:42:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642870+0000", 2024-04-25T22:42:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000184045 2024-04-25T22:42:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643122+0000", 2024-04-25T22:42:25.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025242299999999999 2024-04-25T22:42:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643634+0000", 2024-04-25T22:42:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051145800000000001 2024-04-25T22:42:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.682287+0000", 2024-04-25T22:42:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038653342 2024-04-25T22:42:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686419+0000", 2024-04-25T22:42:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0041325169999999996 2024-04-25T22:42:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686464+0000", 2024-04-25T22:42:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4171000000000001e-05 2024-04-25T22:42:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686504+0000", 2024-04-25T22:42:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0173999999999999e-05 2024-04-25T22:42:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.155 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12691 4.39 4:9d0d8843:::100000030ef.00000000:head [write 0~4194304 [3@92787]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.3428789499999993, 2024-04-25T22:42:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045521998000000001, 2024-04-25T22:42:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12691 2024-04-25T22:42:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:25.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730653+0000", 2024-04-25T22:42:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1799999999999999e-06 2024-04-25T22:42:25.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738136+0000", 2024-04-25T22:42:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0074832789999999998 2024-04-25T22:42:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738169+0000", 2024-04-25T22:42:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3115999999999999e-05 2024-04-25T22:42:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738190+0000", 2024-04-25T22:42:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1060000000000002e-05 2024-04-25T22:42:25.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738264+0000", 2024-04-25T22:42:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3150000000000003e-05 2024-04-25T22:42:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738333+0000", 2024-04-25T22:42:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9314999999999996e-05 2024-04-25T22:42:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738425+0000", 2024-04-25T22:42:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2498999999999996e-05 2024-04-25T22:42:25.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.745181+0000", 2024-04-25T22:42:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067553240000000001 2024-04-25T22:42:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776101+0000", 2024-04-25T22:42:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.030920033 2024-04-25T22:42:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776140+0000", 2024-04-25T22:42:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9706999999999998e-05 2024-04-25T22:42:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776173+0000", 2024-04-25T22:42:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2335000000000001e-05 2024-04-25T22:42:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12813 4.18 4:1945bfc2:::10000003578.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.2043554689999993, 2024-04-25T22:42:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054261216000000001, 2024-04-25T22:42:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.161 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12813 2024-04-25T22:42:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:25.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869175+0000", 2024-04-25T22:42:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3200000000000005e-07 2024-04-25T22:42:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872980+0000", 2024-04-25T22:42:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038049720000000002 2024-04-25T22:42:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872988+0000", 2024-04-25T22:42:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5429999999999994e-06 2024-04-25T22:42:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872993+0000", 2024-04-25T22:42:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8570000000000003e-06 2024-04-25T22:42:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873054+0000", 2024-04-25T22:42:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0801000000000003e-05 2024-04-25T22:42:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873140+0000", 2024-04-25T22:42:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6236999999999994e-05 2024-04-25T22:42:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873271+0000", 2024-04-25T22:42:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130541 2024-04-25T22:42:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.884240+0000", 2024-04-25T22:42:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010969527 2024-04-25T22:42:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923308+0000", 2024-04-25T22:42:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039067317999999997 2024-04-25T22:42:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923373+0000", 2024-04-25T22:42:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5055000000000006e-05 2024-04-25T22:42:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923436+0000", 2024-04-25T22:42:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2732999999999997e-05 2024-04-25T22:42:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13328 4.16 e65/54 4:6a9ab238:::1000000339b.00000000:head v 65'186, mlcod=65'183)", 2024-04-25T22:42:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.5838954009999995, 2024-04-25T22:42:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.046438762000000001, 2024-04-25T22:42:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489637+0000", 2024-04-25T22:42:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.357e-06 2024-04-25T22:42:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496055+0000", 2024-04-25T22:42:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0064181380000000003 2024-04-25T22:42:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496074+0000", 2024-04-25T22:42:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8904000000000001e-05 2024-04-25T22:42:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496085+0000", 2024-04-25T22:42:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1245e-05 2024-04-25T22:42:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496169+0000", 2024-04-25T22:42:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3974000000000006e-05 2024-04-25T22:42:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:25.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496203+0000", 2024-04-25T22:42:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3679000000000001e-05 2024-04-25T22:42:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536002+0000", 2024-04-25T22:42:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039799569 2024-04-25T22:42:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536073+0000", 2024-04-25T22:42:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0895999999999993e-05 2024-04-25T22:42:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13338 4.e 4:737b94c2:::1000000338a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.5777548859999992, 2024-04-25T22:42:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047911849999999999, 2024-04-25T22:42:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13338 2024-04-25T22:42:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:25.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495776+0000", 2024-04-25T22:42:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2399999999999996e-07 2024-04-25T22:42:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503748+0000", 2024-04-25T22:42:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079725479999999994 2024-04-25T22:42:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503940+0000", 2024-04-25T22:42:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000191249 2024-04-25T22:42:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504061+0000", 2024-04-25T22:42:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120982 2024-04-25T22:42:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515564+0000", 2024-04-25T22:42:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011503342999999999 2024-04-25T22:42:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515799+0000", 2024-04-25T22:42:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000235138 2024-04-25T22:42:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543419+0000", 2024-04-25T22:42:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027620167000000001 2024-04-25T22:42:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543522+0000", 2024-04-25T22:42:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010254100000000001 2024-04-25T22:42:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543687+0000", 2024-04-25T22:42:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016495799999999999 2024-04-25T22:42:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13329 4.26 e65/57 4:64e005a2:::10000003483.00000000:head v 65'226, mlcod=64'224)", 2024-04-25T22:42:25.175 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.5771522050000009, 2024-04-25T22:42:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048871456000000001, 2024-04-25T22:42:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:25.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496379+0000", 2024-04-25T22:42:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1480000000000001e-06 2024-04-25T22:42:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504870+0000", 2024-04-25T22:42:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0084917880000000001 2024-04-25T22:42:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504888+0000", 2024-04-25T22:42:25.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7365999999999999e-05 2024-04-25T22:42:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504899+0000", 2024-04-25T22:42:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1516e-05 2024-04-25T22:42:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515953+0000", 2024-04-25T22:42:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011054074000000001 2024-04-25T22:42:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515993+0000", 2024-04-25T22:42:25.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9854999999999997e-05 2024-04-25T22:42:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545191+0000", 2024-04-25T22:42:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029197323000000001 2024-04-25T22:42:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545249+0000", 2024-04-25T22:42:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8386e-05 2024-04-25T22:42:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13713 4.2b 4:d574dbff:::100000031d0.00000001:head [write 0~4194304 [2@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.1649660869999998, 2024-04-25T22:42:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047324328999999998, 2024-04-25T22:42:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13713 2024-04-25T22:42:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908565+0000", 2024-04-25T22:42:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.694e-06 2024-04-25T22:42:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916170+0000", 2024-04-25T22:42:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076041720000000002 2024-04-25T22:42:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916200+0000", 2024-04-25T22:42:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0463999999999998e-05 2024-04-25T22:42:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916209+0000", 2024-04-25T22:42:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3079999999999997e-06 2024-04-25T22:42:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916297+0000", 2024-04-25T22:42:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8159999999999996e-05 2024-04-25T22:42:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916554+0000", 2024-04-25T22:42:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025661800000000002 2024-04-25T22:42:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916794+0000", 2024-04-25T22:42:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024013999999999999 2024-04-25T22:42:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:25.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.933120+0000", 2024-04-25T22:42:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016325559 2024-04-25T22:42:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955612+0000", 2024-04-25T22:42:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022491786 2024-04-25T22:42:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955797+0000", 2024-04-25T22:42:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018533699999999999 2024-04-25T22:42:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:25.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955888+0000", 2024-04-25T22:42:25.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1090999999999999e-05 2024-04-25T22:42:25.185 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.185 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.185 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.185 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:25.185 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:25.185 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:25.186 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:25.187 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:25.187+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:25.288 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:25.283+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:25.300 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is set 2024-04-25T22:42:25.321 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:25.321 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:25.321 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:42:25.321 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:25.336 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:25.388 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:25.387+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:25.452 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:25.452 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:25.453 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:42:25.453 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:42:25.453 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:25.466 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:25.490 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:25.487+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:25.590 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:25.587+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:25.637 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:25.637 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:25.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:25.637 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:25.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.637 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:25.637 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:25.637 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 131.03802778599999, 2024-04-25T22:42:25.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:25.637 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:25.638 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:25.638 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.638 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:25.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:25.638 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:25.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:25.638 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:25.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:25.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:25.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:25.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:25.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:25.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:25.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:25.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:25.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:25.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.640 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.640 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:25.640 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:25.640 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.640 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.640 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:25.640 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:25.640 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.640 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:25.640 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:25.640 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:25.640 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:25.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:25.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:25.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:25.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:25.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:25.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:25.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:25.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:25.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:25.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:25.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:25.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:25.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:25.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:25.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:25.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:25.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:25.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:25.643 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.643 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.643 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.643 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:25.643 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:25.643 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 131.03789053, 2024-04-25T22:42:25.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:25.643 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:25.643 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:25.643 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.644 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:25.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.644 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:25.644 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:25.644 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.644 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.644 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:25.644 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:25.644 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.644 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.644 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:25.644 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:25.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:25.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.645 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:25.645 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:25.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:25.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.645 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:25.645 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:25.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:25.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.645 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:25.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:25.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.646 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:25.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:25.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.646 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:25.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:25.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:25.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:25.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:25.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:25.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:25.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:25.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:25.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:25.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:25.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.648 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:25.648 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:25.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:25.648 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.648 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.648 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:25.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:25.648 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.648 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:25.648 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:25.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:25.648 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:25.649 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:25.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:25.649 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.649 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.649 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.649 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:25.649 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:25.649 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 131.03763036199999, 2024-04-25T22:42:25.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:25.649 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:25.649 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:25.649 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.649 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:25.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.650 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:25.650 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:25.650 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.650 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.650 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.650 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:25.650 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:25.650 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.650 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.650 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.650 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:25.650 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:25.650 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:25.651 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.651 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.651 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:25.651 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:25.651 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:25.651 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.651 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.651 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:25.651 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:25.651 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:25.651 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.651 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.651 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.651 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:25.651 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:25.651 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:25.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:25.652 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:25.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:25.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:25.652 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:25.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:25.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:25.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:25.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:25.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:25.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:25.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:25.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:25.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:25.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:25.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:25.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:25.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:25.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:25.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:25.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:25.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:25.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:25.655 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.655 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.655 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.655 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:25.655 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:25.655 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 131.03746516300001, 2024-04-25T22:42:25.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:25.655 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:25.655 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:25.655 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:25.656 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:25.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:25.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:25.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:25.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:25.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:25.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:25.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:25.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.657 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:25.657 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:25.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:25.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.657 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:25.657 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:25.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:25.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.657 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.657 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:25.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:25.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:25.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:25.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:25.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:25.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:25.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:25.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:25.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:25.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:25.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:25.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:25.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:25.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:25.659 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.659 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.659 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.660 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:25.660 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:25.660 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 131.03739950100001, 2024-04-25T22:42:25.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:25.660 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:25.660 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:25.660 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:25.660 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:25.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:25.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:25.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.660 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:25.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:25.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:25.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:25.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:25.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:25.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:25.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:25.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:25.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:25.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:25.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.662 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.662 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:25.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:25.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.662 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.662 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:25.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:25.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.662 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:25.663 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:25.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:25.663 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.663 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.663 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:25.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:25.663 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.663 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:25.663 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:25.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:25.663 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:25.664 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:25.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:25.664 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.664 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.664 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.664 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.664 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10700 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:25.664 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:25.664 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 13.114532283999999, 2024-04-25T22:42:25.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066789482999999997, 2024-04-25T22:42:25.664 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:25.664 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:25.665 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.665 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:25.665 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:25.665 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.665 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10700 2024-04-25T22:42:25.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.665 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:25.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:25.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:25.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:25.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:25.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:25.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519112+0000", 2024-04-25T22:42:25.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1399999999999998e-06 2024-04-25T22:42:25.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:25.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527187+0000", 2024-04-25T22:42:25.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080748899999999995 2024-04-25T22:42:25.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:25.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527232+0000", 2024-04-25T22:42:25.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4895999999999998e-05 2024-04-25T22:42:25.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527259+0000", 2024-04-25T22:42:25.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7331999999999999e-05 2024-04-25T22:42:25.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529418+0000", 2024-04-25T22:42:25.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002158765 2024-04-25T22:42:25.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.668 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:25.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529572+0000", 2024-04-25T22:42:25.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015438499999999999 2024-04-25T22:42:25.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.668 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:25.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529762+0000", 2024-04-25T22:42:25.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018998100000000001 2024-04-25T22:42:25.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.668 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:25.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.548359+0000", 2024-04-25T22:42:25.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018596444 2024-04-25T22:42:25.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585801+0000", 2024-04-25T22:42:25.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.037442469999999999 2024-04-25T22:42:25.669 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:25.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585847+0000", 2024-04-25T22:42:25.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5565000000000002e-05 2024-04-25T22:42:25.669 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:25.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585899+0000", 2024-04-25T22:42:25.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2614999999999997e-05 2024-04-25T22:42:25.669 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.670 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.670 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.670 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.670 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.670 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10714 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:25.670 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:25.670 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 13.080851321000001, 2024-04-25T22:42:25.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.048080623000000003, 2024-04-25T22:42:25.670 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:25.670 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:25.670 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.670 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:25.670 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:25.670 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.670 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10714 2024-04-25T22:42:25.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.671 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:25.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:25.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:25.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:25.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:25.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:25.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552792+0000", 2024-04-25T22:42:25.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:42:25.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:25.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559915+0000", 2024-04-25T22:42:25.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071231690000000004 2024-04-25T22:42:25.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:25.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559932+0000", 2024-04-25T22:42:25.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7169000000000001e-05 2024-04-25T22:42:25.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559942+0000", 2024-04-25T22:42:25.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0261999999999999e-05 2024-04-25T22:42:25.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560018+0000", 2024-04-25T22:42:25.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5358000000000006e-05 2024-04-25T22:42:25.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:25.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560118+0000", 2024-04-25T22:42:25.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000100911 2024-04-25T22:42:25.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:25.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560281+0000", 2024-04-25T22:42:25.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016288500000000001 2024-04-25T22:42:25.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:25.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.579740+0000", 2024-04-25T22:42:25.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019458598000000001 2024-04-25T22:42:25.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600484+0000", 2024-04-25T22:42:25.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020744483000000001 2024-04-25T22:42:25.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:25.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600664+0000", 2024-04-25T22:42:25.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017953899999999999 2024-04-25T22:42:25.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.675 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:25.675 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600871+0000", 2024-04-25T22:42:25.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020737199999999999 2024-04-25T22:42:25.675 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.675 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.675 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.675 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10813 4.17 4:e8010137:::100000030b0.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:25.675 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:25.675 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.885902314999999, 2024-04-25T22:42:25.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.047503799999999999, 2024-04-25T22:42:25.675 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:25.676 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:25.676 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.676 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:25.676 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:25.676 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.676 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10813 2024-04-25T22:42:25.676 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.676 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:25.676 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.676 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:25.676 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:25.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.676 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.676 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.677 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:25.677 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:25.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.677 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:25.677 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747741+0000", 2024-04-25T22:42:25.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1119999999999999e-06 2024-04-25T22:42:25.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.677 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:25.677 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752366+0000", 2024-04-25T22:42:25.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046253240000000001 2024-04-25T22:42:25.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:25.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752382+0000", 2024-04-25T22:42:25.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5639999999999999e-05 2024-04-25T22:42:25.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752393+0000", 2024-04-25T22:42:25.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1626e-05 2024-04-25T22:42:25.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752459+0000", 2024-04-25T22:42:25.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5309999999999996e-05 2024-04-25T22:42:25.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:25.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752529+0000", 2024-04-25T22:42:25.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0543000000000005e-05 2024-04-25T22:42:25.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:25.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752637+0000", 2024-04-25T22:42:25.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010788799999999999 2024-04-25T22:42:25.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:25.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760295+0000", 2024-04-25T22:42:25.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076583290000000002 2024-04-25T22:42:25.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.794990+0000", 2024-04-25T22:42:25.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034694317000000002 2024-04-25T22:42:25.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:25.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795097+0000", 2024-04-25T22:42:25.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010768999999999999 2024-04-25T22:42:25.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:25.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795243+0000", 2024-04-25T22:42:25.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000146021 2024-04-25T22:42:25.681 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.681 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.681 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.681 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10816 4.17 4:e8010137:::100000030b0.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:25.681 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:25.681 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.880572855, 2024-04-25T22:42:25.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042406530999999997, 2024-04-25T22:42:25.681 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:25.681 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:25.681 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.681 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:25.681 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:25.682 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.682 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10816 2024-04-25T22:42:25.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.682 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:25.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:25.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:25.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:25.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:25.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.683 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:25.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753070+0000", 2024-04-25T22:42:25.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9800000000000002e-07 2024-04-25T22:42:25.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.683 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:25.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753288+0000", 2024-04-25T22:42:25.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000217789 2024-04-25T22:42:25.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.683 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:25.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753301+0000", 2024-04-25T22:42:25.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2764e-05 2024-04-25T22:42:25.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.684 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.684 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753310+0000", 2024-04-25T22:42:25.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:42:25.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.684 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.684 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758240+0000", 2024-04-25T22:42:25.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049304910000000004 2024-04-25T22:42:25.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.684 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.684 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:25.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758374+0000", 2024-04-25T22:42:25.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000133428 2024-04-25T22:42:25.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.684 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:25.685 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758576+0000", 2024-04-25T22:42:25.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020177899999999999 2024-04-25T22:42:25.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:25.685 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760626+0000", 2024-04-25T22:42:25.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0020501489999999998 2024-04-25T22:42:25.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.685 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795329+0000", 2024-04-25T22:42:25.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034703352999999999 2024-04-25T22:42:25.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:25.686 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795414+0000", 2024-04-25T22:42:25.686 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5292999999999998e-05 2024-04-25T22:42:25.686 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.686 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.686 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:25.686 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795476+0000", 2024-04-25T22:42:25.686 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1206999999999999e-05 2024-04-25T22:42:25.686 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.686 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.686 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.686 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.686 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.686 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10914 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:25.686 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:25.686 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.679772473, 2024-04-25T22:42:25.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044452984000000001, 2024-04-25T22:42:25.687 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:25.687 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:25.687 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.687 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:25.687 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:25.687 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.687 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10914 2024-04-25T22:42:25.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.687 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:25.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:25.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:25.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:25.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:25.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:25.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953871+0000", 2024-04-25T22:42:25.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1829999999999999e-06 2024-04-25T22:42:25.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:25.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.962992+0000", 2024-04-25T22:42:25.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091217409999999992 2024-04-25T22:42:25.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:25.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963027+0000", 2024-04-25T22:42:25.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4229e-05 2024-04-25T22:42:25.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963042+0000", 2024-04-25T22:42:25.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5152e-05 2024-04-25T22:42:25.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963143+0000", 2024-04-25T22:42:25.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101171 2024-04-25T22:42:25.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.690 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:25.690 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963269+0000", 2024-04-25T22:42:25.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012623499999999999 2024-04-25T22:42:25.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.690 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:25.690 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963453+0000", 2024-04-25T22:42:25.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018357900000000001 2024-04-25T22:42:25.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.690 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:25.690 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998133+0000", 2024-04-25T22:42:25.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034679789000000003 2024-04-25T22:42:25.691 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.691 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.691 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.691 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998220+0000", 2024-04-25T22:42:25.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7153999999999999e-05 2024-04-25T22:42:25.691 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.691 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.691 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:25.691 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998278+0000", 2024-04-25T22:42:25.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8035000000000003e-05 2024-04-25T22:42:25.691 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.691 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.691 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:25.691 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998323+0000", 2024-04-25T22:42:25.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4715999999999997e-05 2024-04-25T22:42:25.691 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.692 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.692 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.692 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10919 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:25.692 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:25.692 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.659461192, 2024-04-25T22:42:25.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044010552000000001, 2024-04-25T22:42:25.692 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:25.692 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:25.692 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.692 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:25.692 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:25.692 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.693 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10919 2024-04-25T22:42:25.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.693 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:25.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:25.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:25.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:25.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:25.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.694 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:25.694 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:25.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8100000000000003e-07 2024-04-25T22:42:25.694 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.694 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.694 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:25.694 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980221+0000", 2024-04-25T22:42:25.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060397230000000003 2024-04-25T22:42:25.694 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.694 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.694 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:25.694 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980242+0000", 2024-04-25T22:42:25.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1373e-05 2024-04-25T22:42:25.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.695 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.695 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980252+0000", 2024-04-25T22:42:25.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9990000000000003e-06 2024-04-25T22:42:25.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.695 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.695 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981303+0000", 2024-04-25T22:42:25.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010501670000000001 2024-04-25T22:42:25.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.695 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:25.695 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981444+0000", 2024-04-25T22:42:25.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014123799999999999 2024-04-25T22:42:25.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:25.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981585+0000", 2024-04-25T22:42:25.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014071999999999999 2024-04-25T22:42:25.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:25.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003640+0000", 2024-04-25T22:42:25.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022055113000000001 2024-04-25T22:42:25.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018070+0000", 2024-04-25T22:42:25.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014430877 2024-04-25T22:42:25.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:25.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018138+0000", 2024-04-25T22:42:25.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7743000000000005e-05 2024-04-25T22:42:25.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:25.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018191+0000", 2024-04-25T22:42:25.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3118000000000002e-05 2024-04-25T22:42:25.697 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.697 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.697 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.697 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:12632 4.a e64/17 4:506aad5d:::1000000310f.00000000:head v 64'203, mlcod=64'201)", 2024-04-25T22:42:25.698 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:25.698 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 9.9901127970000001, 2024-04-25T22:42:25.698 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041913617, 2024-04-25T22:42:25.698 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:25.698 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:25.698 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.698 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:25.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.698 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:25.698 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:25.698 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.698 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.698 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:25.698 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:25.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.699 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.699 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.699 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:25.699 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643531+0000", 2024-04-25T22:42:25.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.497e-06 2024-04-25T22:42:25.699 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.699 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.699 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:25.699 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650159+0000", 2024-04-25T22:42:25.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066287059999999998 2024-04-25T22:42:25.699 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.699 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.700 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:25.700 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650185+0000", 2024-04-25T22:42:25.700 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5646000000000001e-05 2024-04-25T22:42:25.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.700 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.700 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650205+0000", 2024-04-25T22:42:25.700 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9720000000000001e-05 2024-04-25T22:42:25.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.700 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.700 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650521+0000", 2024-04-25T22:42:25.700 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00031590699999999998 2024-04-25T22:42:25.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:25.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650574+0000", 2024-04-25T22:42:25.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3192000000000002e-05 2024-04-25T22:42:25.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:25.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685374+0000", 2024-04-25T22:42:25.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034799902000000001 2024-04-25T22:42:25.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:25.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685443+0000", 2024-04-25T22:42:25.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9047000000000005e-05 2024-04-25T22:42:25.702 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.702 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.702 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.702 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12644 4.11 4:8893db93:::100000034c2.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:25.702 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:25.702 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 9.981703907, 2024-04-25T22:42:25.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045039497999999997, 2024-04-25T22:42:25.702 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:25.702 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:25.702 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.702 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:25.702 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:25.703 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.703 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12644 2024-04-25T22:42:25.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.703 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:25.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:25.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:25.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:25.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:25.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.704 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:25.704 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651940+0000", 2024-04-25T22:42:25.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.013e-06 2024-04-25T22:42:25.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.704 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:25.704 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659663+0000", 2024-04-25T22:42:25.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077228150000000001 2024-04-25T22:42:25.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.704 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:25.704 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659694+0000", 2024-04-25T22:42:25.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1112999999999998e-05 2024-04-25T22:42:25.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.705 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.705 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.705 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659715+0000", 2024-04-25T22:42:25.705 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1053e-05 2024-04-25T22:42:25.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.705 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.705 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.705 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659842+0000", 2024-04-25T22:42:25.705 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012738100000000001 2024-04-25T22:42:25.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.705 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.705 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:25.705 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660068+0000", 2024-04-25T22:42:25.705 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000225746 2024-04-25T22:42:25.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:25.706 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660307+0000", 2024-04-25T22:42:25.706 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000238352 2024-04-25T22:42:25.706 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:25.706 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.683776+0000", 2024-04-25T22:42:25.706 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023469891999999999 2024-04-25T22:42:25.706 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.706 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696810+0000", 2024-04-25T22:42:25.706 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013033385999999999 2024-04-25T22:42:25.706 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.707 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:25.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696904+0000", 2024-04-25T22:42:25.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3820000000000006e-05 2024-04-25T22:42:25.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.707 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:25.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696978+0000", 2024-04-25T22:42:25.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3926999999999999e-05 2024-04-25T22:42:25.707 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.707 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.707 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.708 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12645 4.2d 4:b45456a9:::10000003241.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:25.708 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:25.708 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 9.9738834199999999, 2024-04-25T22:42:25.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.043099660999999997, 2024-04-25T22:42:25.708 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:25.708 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:25.708 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.708 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:25.708 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:25.708 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.708 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12645 2024-04-25T22:42:25.708 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.708 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:25.708 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:25.709 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:25.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:25.709 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:25.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:25.709 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659761+0000", 2024-04-25T22:42:25.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8459999999999999e-06 2024-04-25T22:42:25.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.710 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:25.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666663+0000", 2024-04-25T22:42:25.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0069017080000000003 2024-04-25T22:42:25.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.710 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:25.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666684+0000", 2024-04-25T22:42:25.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0706000000000001e-05 2024-04-25T22:42:25.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.710 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666700+0000", 2024-04-25T22:42:25.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5985999999999999e-05 2024-04-25T22:42:25.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.711 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.711 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.711 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666914+0000", 2024-04-25T22:42:25.711 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000213861 2024-04-25T22:42:25.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.711 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.711 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:25.711 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.667082+0000", 2024-04-25T22:42:25.711 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016809 2024-04-25T22:42:25.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.711 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.711 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:25.711 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702598+0000", 2024-04-25T22:42:25.711 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035515962999999998 2024-04-25T22:42:25.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:25.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702705+0000", 2024-04-25T22:42:25.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010689800000000001 2024-04-25T22:42:25.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:25.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702858+0000", 2024-04-25T22:42:25.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015360300000000001 2024-04-25T22:42:25.712 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.712 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.712 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.713 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12829 4.3b 4:de8bdadd:::100000033c7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:25.713 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:25.713 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 9.7456235049999993, 2024-04-25T22:42:25.713 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042457306, 2024-04-25T22:42:25.713 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:25.713 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:25.713 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.713 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:25.713 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:25.713 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.713 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12829 2024-04-25T22:42:25.713 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.713 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:25.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.713 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:25.714 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:25.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.714 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:25.714 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:25.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.714 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:25.714 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888019+0000", 2024-04-25T22:42:25.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3300000000000002e-07 2024-04-25T22:42:25.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:25.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891638+0000", 2024-04-25T22:42:25.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036189109999999998 2024-04-25T22:42:25.715 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:25.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891661+0000", 2024-04-25T22:42:25.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3345000000000001e-05 2024-04-25T22:42:25.715 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891671+0000", 2024-04-25T22:42:25.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0115000000000001e-05 2024-04-25T22:42:25.715 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.716 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.716 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891737+0000", 2024-04-25T22:42:25.716 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5600999999999998e-05 2024-04-25T22:42:25.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.716 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:25.716 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891856+0000", 2024-04-25T22:42:25.716 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011881 2024-04-25T22:42:25.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.716 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:25.716 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930251+0000", 2024-04-25T22:42:25.716 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.038395141000000001 2024-04-25T22:42:25.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:25.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930389+0000", 2024-04-25T22:42:25.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013849000000000001 2024-04-25T22:42:25.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:25.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930476+0000", 2024-04-25T22:42:25.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6360000000000007e-05 2024-04-25T22:42:25.717 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.717 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.717 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.718 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13009 4.1e 4:78728bd7:::100000033a5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:25.718 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:25.718 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 9.5437364930000008, 2024-04-25T22:42:25.718 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049997452999999997, 2024-04-25T22:42:25.718 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:25.718 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:25.718 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.718 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:25.718 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:25.718 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.718 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13009 2024-04-25T22:42:25.718 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.718 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:25.718 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.718 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:25.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:25.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:25.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:25.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:25.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:25.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4799999999999997e-07 2024-04-25T22:42:25.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.720 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:25.720 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097105+0000", 2024-04-25T22:42:25.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071984060000000001 2024-04-25T22:42:25.720 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.720 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:25.720 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097118+0000", 2024-04-25T22:42:25.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2865e-05 2024-04-25T22:42:25.720 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.720 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.720 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097127+0000", 2024-04-25T22:42:25.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8449999999999998e-06 2024-04-25T22:42:25.720 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097174+0000", 2024-04-25T22:42:25.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6084000000000001e-05 2024-04-25T22:42:25.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:25.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097232+0000", 2024-04-25T22:42:25.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8928999999999998e-05 2024-04-25T22:42:25.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:25.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097309+0000", 2024-04-25T22:42:25.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7014999999999994e-05 2024-04-25T22:42:25.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:25.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.108708+0000", 2024-04-25T22:42:25.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011398233000000001 2024-04-25T22:42:25.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139793+0000", 2024-04-25T22:42:25.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031084856000000001 2024-04-25T22:42:25.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:25.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139848+0000", 2024-04-25T22:42:25.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5464000000000003e-05 2024-04-25T22:42:25.723 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.723 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:25.723 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139903+0000", 2024-04-25T22:42:25.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4907999999999997e-05 2024-04-25T22:42:25.723 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.723 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.723 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.723 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.723 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13318 4.16 4:6810bf9e:::10000003259.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:25.723 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:25.723 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 9.1731621350000001, 2024-04-25T22:42:25.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057538179000000002, 2024-04-25T22:42:25.723 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:25.724 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:25.724 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.724 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:25.724 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:25.724 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.724 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13318 2024-04-25T22:42:25.724 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.724 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:25.724 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.724 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:25.724 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:25.724 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.724 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.724 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:25.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:25.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:25.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460481+0000", 2024-04-25T22:42:25.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:42:25.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:25.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466775+0000", 2024-04-25T22:42:25.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062944239999999999 2024-04-25T22:42:25.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:25.726 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466787+0000", 2024-04-25T22:42:25.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1688999999999999e-05 2024-04-25T22:42:25.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.726 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466793+0000", 2024-04-25T22:42:25.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7209999999999999e-06 2024-04-25T22:42:25.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.726 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466845+0000", 2024-04-25T22:42:25.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2166999999999997e-05 2024-04-25T22:42:25.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:25.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466912+0000", 2024-04-25T22:42:25.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7016999999999999e-05 2024-04-25T22:42:25.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:25.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.467020+0000", 2024-04-25T22:42:25.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010827699999999999 2024-04-25T22:42:25.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:25.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.476718+0000", 2024-04-25T22:42:25.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0096980439999999994 2024-04-25T22:42:25.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517860+0000", 2024-04-25T22:42:25.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041141847000000002 2024-04-25T22:42:25.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:25.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517924+0000", 2024-04-25T22:42:25.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3997000000000004e-05 2024-04-25T22:42:25.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:25.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.518018+0000", 2024-04-25T22:42:25.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4139000000000001e-05 2024-04-25T22:42:25.729 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.729 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.729 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.729 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.729 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.729 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13328 4.16 4:6a9ab238:::1000000339b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:25.729 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:25.729 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 9.1542491500000001, 2024-04-25T22:42:25.729 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057072695999999999, 2024-04-25T22:42:25.729 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:25.729 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:25.729 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.729 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:25.729 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:25.730 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.730 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13328 2024-04-25T22:42:25.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.730 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:25.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:25.730 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:25.730 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:25.730 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:25.730 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.731 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.731 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:25.731 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479395+0000", 2024-04-25T22:42:25.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2859999999999998e-06 2024-04-25T22:42:25.731 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.731 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.731 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:25.731 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486667+0000", 2024-04-25T22:42:25.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072715599999999998 2024-04-25T22:42:25.731 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.731 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.731 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:25.731 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486677+0000", 2024-04-25T22:42:25.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0305e-05 2024-04-25T22:42:25.732 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.732 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.732 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486683+0000", 2024-04-25T22:42:25.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5300000000000004e-06 2024-04-25T22:42:25.732 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.732 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.732 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486768+0000", 2024-04-25T22:42:25.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5725999999999999e-05 2024-04-25T22:42:25.732 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.732 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:25.732 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486905+0000", 2024-04-25T22:42:25.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013696699999999999 2024-04-25T22:42:25.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:25.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.487121+0000", 2024-04-25T22:42:25.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021615299999999999 2024-04-25T22:42:25.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:25.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.509675+0000", 2024-04-25T22:42:25.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022553225999999999 2024-04-25T22:42:25.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536355+0000", 2024-04-25T22:42:25.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026680855 2024-04-25T22:42:25.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:25.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536401+0000", 2024-04-25T22:42:25.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5649000000000003e-05 2024-04-25T22:42:25.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:25.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536466+0000", 2024-04-25T22:42:25.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4438999999999997e-05 2024-04-25T22:42:25.734 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.734 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.734 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.735 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13329 4.26 4:64e005a2:::10000003483.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:25.735 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:25.735 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 9.1469407510000007, 2024-04-25T22:42:25.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066502845000000005, 2024-04-25T22:42:25.735 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:25.735 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:25.735 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.735 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:25.735 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:25.735 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.735 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13329 2024-04-25T22:42:25.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.735 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:25.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:25.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:25.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:25.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:25.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:25.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486703+0000", 2024-04-25T22:42:25.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3909999999999999e-06 2024-04-25T22:42:25.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:25.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494612+0000", 2024-04-25T22:42:25.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0079096670000000004 2024-04-25T22:42:25.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:25.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494626+0000", 2024-04-25T22:42:25.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3263e-05 2024-04-25T22:42:25.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494637+0000", 2024-04-25T22:42:25.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.171e-05 2024-04-25T22:42:25.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494720+0000", 2024-04-25T22:42:25.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2767000000000002e-05 2024-04-25T22:42:25.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:25.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494834+0000", 2024-04-25T22:42:25.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011387699999999999 2024-04-25T22:42:25.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:25.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494998+0000", 2024-04-25T22:42:25.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016390799999999999 2024-04-25T22:42:25.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:25.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517407+0000", 2024-04-25T22:42:25.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022409068000000001 2024-04-25T22:42:25.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553040+0000", 2024-04-25T22:42:25.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035633155 2024-04-25T22:42:25.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:25.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553140+0000", 2024-04-25T22:42:25.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9623000000000005e-05 2024-04-25T22:42:25.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:25.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553204+0000", 2024-04-25T22:42:25.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4416000000000001e-05 2024-04-25T22:42:25.740 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.740 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.740 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.740 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13399 4.16 4:6bb7cc3a:::10000003648.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:25.740 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:25.740 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 9.0735749509999994, 2024-04-25T22:42:25.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045625003999999997, 2024-04-25T22:42:25.741 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:25.741 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:25.741 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:25.741 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:25.741 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:25.741 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:25.741 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13399 2024-04-25T22:42:25.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.741 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:25.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:25.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:25.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:25.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:25.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:25.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:25.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560068+0000", 2024-04-25T22:42:25.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:42:25.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:25.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576902+0000", 2024-04-25T22:42:25.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016833806 2024-04-25T22:42:25.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:25.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576916+0000", 2024-04-25T22:42:25.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3648e-05 2024-04-25T22:42:25.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:25.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576927+0000", 2024-04-25T22:42:25.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0992000000000001e-05 2024-04-25T22:42:25.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:25.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577026+0000", 2024-04-25T22:42:25.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9116000000000004e-05 2024-04-25T22:42:25.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:25.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577203+0000", 2024-04-25T22:42:25.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017700499999999999 2024-04-25T22:42:25.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:25.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577336+0000", 2024-04-25T22:42:25.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013340800000000001 2024-04-25T22:42:25.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:25.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.589077+0000", 2024-04-25T22:42:25.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011741151 2024-04-25T22:42:25.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:25.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605436+0000", 2024-04-25T22:42:25.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016359146000000001 2024-04-25T22:42:25.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:25.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605493+0000", 2024-04-25T22:42:25.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7067000000000001e-05 2024-04-25T22:42:25.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:25.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:25.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:25.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605692+0000", 2024-04-25T22:42:25.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00019855799999999999 2024-04-25T22:42:25.746 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.746 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.746 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.746 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:25.746 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:25.746 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:25.747 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:25.748 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:25.747+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:25.848 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:25.847+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:25.905 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:42:25.906 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:25.920 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:25.949 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:25.947+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:26.036 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:26.037 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:26.037 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:42:26.037 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:42:26.037 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:26.049 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:26.047+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:26.052 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:26.150 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:26.147+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:26.225 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:42:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:42:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 131.62636691500001, 2024-04-25T22:42:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:42:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:26.226 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:42:26.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:42:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:42:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:42:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:42:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:42:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:42:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:42:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:42:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:42:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:42:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:42:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:42:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:42:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:42:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:42:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:42:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:42:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:42:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:42:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:42:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:42:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:42:26.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:42:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:42:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:42:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 131.62625860200001, 2024-04-25T22:42:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:42:26.232 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:26.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:42:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:42:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:42:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:42:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:42:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:42:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:42:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:42:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:42:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:42:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:42:26.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:42:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:42:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:42:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:42:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:42:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:26.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:42:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:42:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:42:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:42:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:42:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:42:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:26.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:42:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:42:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:42:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:42:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:26.238 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 131.62619194600001, 2024-04-25T22:42:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:42:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:26.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:26.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:26.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:42:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:42:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:42:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:42:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:42:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:42:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:42:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:42:26.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:42:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:42:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:42:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:42:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:42:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:42:26.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:26.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:42:26.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:42:26.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:26.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:42:26.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:42:26.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:26.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:42:26.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:42:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:42:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:42:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:42:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:42:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:26.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:42:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:42:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 131.62610135, 2024-04-25T22:42:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:42:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:26.247 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:26.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:42:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:42:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:42:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:42:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:42:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:42:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:42:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:42:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:42:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:42:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:42:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:42:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:42:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:42:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:42:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:42:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:42:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:42:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:42:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:42:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:42:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:42:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:42:26.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:42:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:42:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:42:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 131.626036777, 2024-04-25T22:42:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:42:26.253 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:42:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:42:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:42:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:42:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:42:26.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:42:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:42:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:42:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:42:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:26.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:42:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:42:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:42:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:42:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:42:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:42:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:42:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:42:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:42:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:42:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:42:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:42:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:42:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:42:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:42:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:42:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.259 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 131.625971354, 2024-04-25T22:42:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:42:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:42:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:42:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:42:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:42:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:42:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:42:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:42:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:42:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:42:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:42:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:42:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:42:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:42:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:42:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:42:26.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:42:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:42:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:42:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:42:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:42:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:42:26.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:42:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:42:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:42:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:42:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.265 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 131.62569081999999, 2024-04-25T22:42:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:42:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:26.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:42:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:42:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:42:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:42:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:42:26.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:42:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:42:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:42:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:42:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:42:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:42:26.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:42:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:42:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:42:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:42:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:42:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:42:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:42:26.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:42:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:42:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:42:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:42:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:42:26.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:42:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:42:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:42:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10678 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.734406080999999, 2024-04-25T22:42:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050477795999999998, 2024-04-25T22:42:26.271 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10678 2024-04-25T22:42:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488127+0000", 2024-04-25T22:42:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.716e-06 2024-04-25T22:42:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496392+0000", 2024-04-25T22:42:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082651500000000006 2024-04-25T22:42:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496428+0000", 2024-04-25T22:42:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5441999999999997e-05 2024-04-25T22:42:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496451+0000", 2024-04-25T22:42:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3529000000000001e-05 2024-04-25T22:42:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496601+0000", 2024-04-25T22:42:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014935600000000001 2024-04-25T22:42:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496856+0000", 2024-04-25T22:42:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025537900000000002 2024-04-25T22:42:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.497206+0000", 2024-04-25T22:42:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000350599 2024-04-25T22:42:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538231+0000", 2024-04-25T22:42:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041024146999999997 2024-04-25T22:42:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538298+0000", 2024-04-25T22:42:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7688000000000007e-05 2024-04-25T22:42:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538467+0000", 2024-04-25T22:42:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000168178 2024-04-25T22:42:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538603+0000", 2024-04-25T22:42:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013661200000000001 2024-04-25T22:42:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.276 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10692 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.717816287, 2024-04-25T22:42:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.061242408999999998, 2024-04-25T22:42:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10692 2024-04-25T22:42:26.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:26.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504717+0000", 2024-04-25T22:42:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6199999999999999e-06 2024-04-25T22:42:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511770+0000", 2024-04-25T22:42:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0070530929999999999 2024-04-25T22:42:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511810+0000", 2024-04-25T22:42:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0635e-05 2024-04-25T22:42:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511837+0000", 2024-04-25T22:42:26.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6423000000000001e-05 2024-04-25T22:42:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520096+0000", 2024-04-25T22:42:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082593730000000004 2024-04-25T22:42:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520345+0000", 2024-04-25T22:42:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024908800000000001 2024-04-25T22:42:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:26.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520794+0000", 2024-04-25T22:42:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000449023 2024-04-25T22:42:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538675+0000", 2024-04-25T22:42:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017880991999999998 2024-04-25T22:42:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565761+0000", 2024-04-25T22:42:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027085260999999999 2024-04-25T22:42:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:26.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565892+0000", 2024-04-25T22:42:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013152300000000001 2024-04-25T22:42:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565958+0000", 2024-04-25T22:42:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5377999999999996e-05 2024-04-25T22:42:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10693 4.2c 4:36971e45:::100000030bd.00000001:head [write 971225~86041] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:26.282 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.710637925, 2024-04-25T22:42:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054529782999999998, 2024-04-25T22:42:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10693 2024-04-25T22:42:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:26.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511897+0000", 2024-04-25T22:42:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2499999999999998e-06 2024-04-25T22:42:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:26.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512094+0000", 2024-04-25T22:42:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019700100000000001 2024-04-25T22:42:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512121+0000", 2024-04-25T22:42:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7288999999999999e-05 2024-04-25T22:42:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512137+0000", 2024-04-25T22:42:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.592e-05 2024-04-25T22:42:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.533845+0000", 2024-04-25T22:42:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021707595999999999 2024-04-25T22:42:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534176+0000", 2024-04-25T22:42:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033187000000000001 2024-04-25T22:42:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534626+0000", 2024-04-25T22:42:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00045008599999999999 2024-04-25T22:42:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:26.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.539165+0000", 2024-04-25T22:42:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045386380000000002 2024-04-25T22:42:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566169+0000", 2024-04-25T22:42:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027004199 2024-04-25T22:42:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566317+0000", 2024-04-25T22:42:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014747999999999999 2024-04-25T22:42:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:26.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566423+0000", 2024-04-25T22:42:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010645399999999999 2024-04-25T22:42:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10696 4.2b 4:d56d2a96:::100000030c3.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.708930280000001, 2024-04-25T22:42:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052282190999999999, 2024-04-25T22:42:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:26.288 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10696 2024-04-25T22:42:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513603+0000", 2024-04-25T22:42:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.283e-06 2024-04-25T22:42:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518647+0000", 2024-04-25T22:42:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050440859999999997 2024-04-25T22:42:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518672+0000", 2024-04-25T22:42:26.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4468e-05 2024-04-25T22:42:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518691+0000", 2024-04-25T22:42:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9213999999999999e-05 2024-04-25T22:42:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518806+0000", 2024-04-25T22:42:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115296 2024-04-25T22:42:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519011+0000", 2024-04-25T22:42:26.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020445700000000001 2024-04-25T22:42:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519207+0000", 2024-04-25T22:42:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000196431 2024-04-25T22:42:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531309+0000", 2024-04-25T22:42:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012101694 2024-04-25T22:42:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:26.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565622+0000", 2024-04-25T22:42:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034312976000000002 2024-04-25T22:42:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565769+0000", 2024-04-25T22:42:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014715900000000001 2024-04-25T22:42:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565883+0000", 2024-04-25T22:42:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000114127 2024-04-25T22:42:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.293 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10701 4.a 4:51b6a63a:::100000030f2.00000000:head [write 0~3014656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.697486270000001, 2024-04-25T22:42:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047414393999999999, 2024-04-25T22:42:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:26.294 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10701 2024-04-25T22:42:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:26.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525048+0000", 2024-04-25T22:42:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0819999999999999e-06 2024-04-25T22:42:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531709+0000", 2024-04-25T22:42:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066610929999999999 2024-04-25T22:42:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:26.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531751+0000", 2024-04-25T22:42:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1650000000000003e-05 2024-04-25T22:42:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531788+0000", 2024-04-25T22:42:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7305000000000003e-05 2024-04-25T22:42:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531943+0000", 2024-04-25T22:42:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015500600000000001 2024-04-25T22:42:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532086+0000", 2024-04-25T22:42:26.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014238599999999999 2024-04-25T22:42:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532295+0000", 2024-04-25T22:42:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020922000000000001 2024-04-25T22:42:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.545987+0000", 2024-04-25T22:42:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013692582999999999 2024-04-25T22:42:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572315+0000", 2024-04-25T22:42:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026327488 2024-04-25T22:42:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572381+0000", 2024-04-25T22:42:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5609000000000002e-05 2024-04-25T22:42:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572460+0000", 2024-04-25T22:42:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8972000000000002e-05 2024-04-25T22:42:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:10700 4.11 e63/57 4:88409fbf:::100000030ec.00000000:head v 63'193, mlcod=62'191)", 2024-04-25T22:42:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.686656813999999, 2024-04-25T22:42:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050517667000000002, 2024-04-25T22:42:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535876+0000", 2024-04-25T22:42:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0300000000000001e-06 2024-04-25T22:42:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565275+0000", 2024-04-25T22:42:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029399033000000001 2024-04-25T22:42:26.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565358+0000", 2024-04-25T22:42:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3403000000000001e-05 2024-04-25T22:42:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565380+0000", 2024-04-25T22:42:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1761999999999999e-05 2024-04-25T22:42:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565505+0000", 2024-04-25T22:42:26.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000125153 2024-04-25T22:42:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565550+0000", 2024-04-25T22:42:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5479000000000003e-05 2024-04-25T22:42:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586328+0000", 2024-04-25T22:42:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020777982 2024-04-25T22:42:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586392+0000", 2024-04-25T22:42:26.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3825000000000006e-05 2024-04-25T22:42:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12632 4.a 4:506aad5d:::1000000310f.00000000:head [write 0~4194304 [2@2043125]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 10.587601687999999, 2024-04-25T22:42:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051574097999999999, 2024-04-25T22:42:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:26.304 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12632 2024-04-25T22:42:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634932+0000", 2024-04-25T22:42:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1600000000000001e-06 2024-04-25T22:42:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642614+0000", 2024-04-25T22:42:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076823000000000004 2024-04-25T22:42:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642660+0000", 2024-04-25T22:42:26.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6016000000000001e-05 2024-04-25T22:42:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642686+0000", 2024-04-25T22:42:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5491999999999999e-05 2024-04-25T22:42:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642870+0000", 2024-04-25T22:42:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000184045 2024-04-25T22:42:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643122+0000", 2024-04-25T22:42:26.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025242299999999999 2024-04-25T22:42:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643634+0000", 2024-04-25T22:42:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051145800000000001 2024-04-25T22:42:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.682287+0000", 2024-04-25T22:42:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038653342 2024-04-25T22:42:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:26.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686419+0000", 2024-04-25T22:42:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0041325169999999996 2024-04-25T22:42:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686464+0000", 2024-04-25T22:42:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4171000000000001e-05 2024-04-25T22:42:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686504+0000", 2024-04-25T22:42:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0173999999999999e-05 2024-04-25T22:42:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12691 4.39 4:9d0d8843:::100000030ef.00000000:head [write 0~4194304 [3@92787]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 10.491880599, 2024-04-25T22:42:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045521998000000001, 2024-04-25T22:42:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12691 2024-04-25T22:42:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.310 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730653+0000", 2024-04-25T22:42:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1799999999999999e-06 2024-04-25T22:42:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738136+0000", 2024-04-25T22:42:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0074832789999999998 2024-04-25T22:42:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738169+0000", 2024-04-25T22:42:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3115999999999999e-05 2024-04-25T22:42:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738190+0000", 2024-04-25T22:42:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1060000000000002e-05 2024-04-25T22:42:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738264+0000", 2024-04-25T22:42:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3150000000000003e-05 2024-04-25T22:42:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738333+0000", 2024-04-25T22:42:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9314999999999996e-05 2024-04-25T22:42:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738425+0000", 2024-04-25T22:42:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2498999999999996e-05 2024-04-25T22:42:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:26.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.745181+0000", 2024-04-25T22:42:26.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067553240000000001 2024-04-25T22:42:26.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:26.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776101+0000", 2024-04-25T22:42:26.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.030920033 2024-04-25T22:42:26.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:26.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776140+0000", 2024-04-25T22:42:26.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9706999999999998e-05 2024-04-25T22:42:26.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:26.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776173+0000", 2024-04-25T22:42:26.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2335000000000001e-05 2024-04-25T22:42:26.315 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.315 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.315 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.315 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12813 4.18 4:1945bfc2:::10000003578.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:26.315 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:26.315 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 10.353357118, 2024-04-25T22:42:26.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054261216000000001, 2024-04-25T22:42:26.315 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:26.316 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:26.316 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:26.316 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:26.316 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:26.316 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:26.316 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12813 2024-04-25T22:42:26.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.316 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:26.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:26.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:26.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:26.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:26.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:26.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869175+0000", 2024-04-25T22:42:26.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3200000000000005e-07 2024-04-25T22:42:26.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:26.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872980+0000", 2024-04-25T22:42:26.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038049720000000002 2024-04-25T22:42:26.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:26.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872988+0000", 2024-04-25T22:42:26.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5429999999999994e-06 2024-04-25T22:42:26.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:26.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872993+0000", 2024-04-25T22:42:26.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8570000000000003e-06 2024-04-25T22:42:26.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873054+0000", 2024-04-25T22:42:26.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0801000000000003e-05 2024-04-25T22:42:26.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:26.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873140+0000", 2024-04-25T22:42:26.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6236999999999994e-05 2024-04-25T22:42:26.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:26.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873271+0000", 2024-04-25T22:42:26.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130541 2024-04-25T22:42:26.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:26.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.884240+0000", 2024-04-25T22:42:26.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010969527 2024-04-25T22:42:26.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:26.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923308+0000", 2024-04-25T22:42:26.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039067317999999997 2024-04-25T22:42:26.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:26.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923373+0000", 2024-04-25T22:42:26.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5055000000000006e-05 2024-04-25T22:42:26.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:26.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923436+0000", 2024-04-25T22:42:26.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2732999999999997e-05 2024-04-25T22:42:26.320 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.320 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.320 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.320 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13328 4.16 e65/54 4:6a9ab238:::1000000339b.00000000:head v 65'186, mlcod=65'183)", 2024-04-25T22:42:26.321 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:26.321 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.73289705, 2024-04-25T22:42:26.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.046438762000000001, 2024-04-25T22:42:26.321 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:26.321 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:26.321 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:26.321 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:26.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:26.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:26.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:26.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:26.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:26.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489637+0000", 2024-04-25T22:42:26.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.357e-06 2024-04-25T22:42:26.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:26.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496055+0000", 2024-04-25T22:42:26.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0064181380000000003 2024-04-25T22:42:26.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:26.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496074+0000", 2024-04-25T22:42:26.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8904000000000001e-05 2024-04-25T22:42:26.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:26.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496085+0000", 2024-04-25T22:42:26.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1245e-05 2024-04-25T22:42:26.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496169+0000", 2024-04-25T22:42:26.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3974000000000006e-05 2024-04-25T22:42:26.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:26.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496203+0000", 2024-04-25T22:42:26.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3679000000000001e-05 2024-04-25T22:42:26.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:26.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536002+0000", 2024-04-25T22:42:26.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039799569 2024-04-25T22:42:26.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:26.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536073+0000", 2024-04-25T22:42:26.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0895999999999993e-05 2024-04-25T22:42:26.324 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.324 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.324 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.324 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13338 4.e 4:737b94c2:::1000000338a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:26.325 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:26.325 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.7267565349999998, 2024-04-25T22:42:26.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047911849999999999, 2024-04-25T22:42:26.325 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:26.325 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:26.325 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:26.325 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:26.325 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:26.325 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:26.325 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13338 2024-04-25T22:42:26.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.325 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:26.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:26.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:26.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:26.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:26.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:26.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495776+0000", 2024-04-25T22:42:26.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2399999999999996e-07 2024-04-25T22:42:26.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:26.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503748+0000", 2024-04-25T22:42:26.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079725479999999994 2024-04-25T22:42:26.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:26.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503940+0000", 2024-04-25T22:42:26.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000191249 2024-04-25T22:42:26.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:26.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504061+0000", 2024-04-25T22:42:26.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120982 2024-04-25T22:42:26.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515564+0000", 2024-04-25T22:42:26.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011503342999999999 2024-04-25T22:42:26.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:26.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515799+0000", 2024-04-25T22:42:26.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000235138 2024-04-25T22:42:26.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:26.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543419+0000", 2024-04-25T22:42:26.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027620167000000001 2024-04-25T22:42:26.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:26.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543522+0000", 2024-04-25T22:42:26.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010254100000000001 2024-04-25T22:42:26.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:26.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543687+0000", 2024-04-25T22:42:26.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016495799999999999 2024-04-25T22:42:26.329 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.329 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.329 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.329 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13329 4.26 e65/57 4:64e005a2:::10000003483.00000000:head v 65'226, mlcod=64'224)", 2024-04-25T22:42:26.329 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:26.330 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.7261538539999997, 2024-04-25T22:42:26.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048871456000000001, 2024-04-25T22:42:26.330 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:26.330 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:26.330 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:26.330 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:26.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:26.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:26.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:26.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:26.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:26.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496379+0000", 2024-04-25T22:42:26.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1480000000000001e-06 2024-04-25T22:42:26.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:26.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504870+0000", 2024-04-25T22:42:26.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0084917880000000001 2024-04-25T22:42:26.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:26.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504888+0000", 2024-04-25T22:42:26.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7365999999999999e-05 2024-04-25T22:42:26.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:26.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504899+0000", 2024-04-25T22:42:26.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1516e-05 2024-04-25T22:42:26.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515953+0000", 2024-04-25T22:42:26.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011054074000000001 2024-04-25T22:42:26.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:26.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515993+0000", 2024-04-25T22:42:26.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9854999999999997e-05 2024-04-25T22:42:26.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:26.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545191+0000", 2024-04-25T22:42:26.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029197323000000001 2024-04-25T22:42:26.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:26.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545249+0000", 2024-04-25T22:42:26.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8386e-05 2024-04-25T22:42:26.333 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.333 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.333 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.334 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13713 4.2b 4:d574dbff:::100000031d0.00000001:head [write 0~4194304 [2@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:26.334 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:26.334 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.3139677360000004, 2024-04-25T22:42:26.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047324328999999998, 2024-04-25T22:42:26.334 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:26.334 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:26.334 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:26.334 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:26.334 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:26.334 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:26.334 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13713 2024-04-25T22:42:26.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.334 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:26.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:26.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:26.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:26.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:26.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:26.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:26.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908565+0000", 2024-04-25T22:42:26.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.694e-06 2024-04-25T22:42:26.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:26.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916170+0000", 2024-04-25T22:42:26.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076041720000000002 2024-04-25T22:42:26.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:26.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916200+0000", 2024-04-25T22:42:26.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0463999999999998e-05 2024-04-25T22:42:26.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:26.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916209+0000", 2024-04-25T22:42:26.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3079999999999997e-06 2024-04-25T22:42:26.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:26.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916297+0000", 2024-04-25T22:42:26.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8159999999999996e-05 2024-04-25T22:42:26.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:26.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916554+0000", 2024-04-25T22:42:26.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025661800000000002 2024-04-25T22:42:26.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:26.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916794+0000", 2024-04-25T22:42:26.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024013999999999999 2024-04-25T22:42:26.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:26.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.933120+0000", 2024-04-25T22:42:26.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016325559 2024-04-25T22:42:26.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:26.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955612+0000", 2024-04-25T22:42:26.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022491786 2024-04-25T22:42:26.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:26.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955797+0000", 2024-04-25T22:42:26.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018533699999999999 2024-04-25T22:42:26.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:26.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:26.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:26.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955888+0000", 2024-04-25T22:42:26.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1090999999999999e-05 2024-04-25T22:42:26.339 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.339 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.339 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.339 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:26.339 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:26.339 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:26.340 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:42:26.341 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:26.339+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:26.341 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:26.441 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:26.439+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:26.479 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:26.479 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:26.479 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:42:26.479 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:26.494 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:26.495 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:26.495 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:26.515 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:26.515 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:26.518 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:26.519 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:26.542 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:26.543+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:26.617 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:26.617 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:26.632 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:26.643 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:26.639+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:26.744 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:26.743+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:26.823 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:26.824 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:26.845 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:26.839+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:26.846 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:26.946 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:26.943+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:27.000 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:27.000 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:27.014 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:27.047 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:27.047+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:27.148 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:27.143+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:27.173 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:27.173 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:27.188 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:27.249 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:27.247+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:27.321 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:42:27.351 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:27.352 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:27.352 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:27.347+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:27.365 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:27.452 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:27.451+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:27.502 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:27.502 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:27.517 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:27.553 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:27.551+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:27.654 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:27.651+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:27.684 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:27.685 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:27.699 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:27.755 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:27.755+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:27.856 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:27.855+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:27.858 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:27.859 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:27.878 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:27.957 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:27.955+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:27.997 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:27.997 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:28.011 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:28.057 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:28.055+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:28.134 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:28.134 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:28.149 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:28.189 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:28.187+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:28.223 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~53s 2024-04-25T22:42:28.258 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:28.259+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:28.315 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:28.315 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:28.331 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:28.344 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is set 2024-04-25T22:42:28.378 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:28.379+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:28.458 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:28.458 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:28.460 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:28.459+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:28.473 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:28.519 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:42:28.562 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:28.563+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:28.645 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:28.645 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:28.660 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:28.672 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:28.672 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:28.672 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:28.692 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:28.692 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:28.695 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:28.695 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:28.703 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:28.703+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:28.762 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:28.759+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:28.860 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 134.262733884, 2024-04-25T22:42:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:28.860 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:28.861 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:28.862 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:28.863 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.864 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.865 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 134.26259662800001, 2024-04-25T22:42:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.866 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.867 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:28.868 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:28.869 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:28.870 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 134.26233646, 2024-04-25T22:42:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:28.871 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:28.872 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.874 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.875 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 134.26217126099999, 2024-04-25T22:42:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:28.877 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:28.878 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:28.879 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.881 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 134.26210559899999, 2024-04-25T22:42:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:28.882 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:28.883 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:28.884 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:28.885 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10700 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 16.339238382000001, 2024-04-25T22:42:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066789482999999997, 2024-04-25T22:42:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:28.886 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10700 2024-04-25T22:42:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.887 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519112+0000", 2024-04-25T22:42:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1399999999999998e-06 2024-04-25T22:42:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527187+0000", 2024-04-25T22:42:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080748899999999995 2024-04-25T22:42:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527232+0000", 2024-04-25T22:42:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4895999999999998e-05 2024-04-25T22:42:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.888 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527259+0000", 2024-04-25T22:42:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7331999999999999e-05 2024-04-25T22:42:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529418+0000", 2024-04-25T22:42:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002158765 2024-04-25T22:42:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529572+0000", 2024-04-25T22:42:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015438499999999999 2024-04-25T22:42:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.889 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529762+0000", 2024-04-25T22:42:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018998100000000001 2024-04-25T22:42:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.548359+0000", 2024-04-25T22:42:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018596444 2024-04-25T22:42:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585801+0000", 2024-04-25T22:42:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.037442469999999999 2024-04-25T22:42:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.890 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585847+0000", 2024-04-25T22:42:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5565000000000002e-05 2024-04-25T22:42:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585899+0000", 2024-04-25T22:42:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2614999999999997e-05 2024-04-25T22:42:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10714 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:28.891 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 16.305557418999999, 2024-04-25T22:42:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.048080623000000003, 2024-04-25T22:42:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10714 2024-04-25T22:42:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:28.892 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552792+0000", 2024-04-25T22:42:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:42:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559915+0000", 2024-04-25T22:42:28.893 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071231690000000004 2024-04-25T22:42:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559932+0000", 2024-04-25T22:42:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7169000000000001e-05 2024-04-25T22:42:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559942+0000", 2024-04-25T22:42:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0261999999999999e-05 2024-04-25T22:42:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560018+0000", 2024-04-25T22:42:28.894 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5358000000000006e-05 2024-04-25T22:42:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560118+0000", 2024-04-25T22:42:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000100911 2024-04-25T22:42:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560281+0000", 2024-04-25T22:42:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016288500000000001 2024-04-25T22:42:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.579740+0000", 2024-04-25T22:42:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019458598000000001 2024-04-25T22:42:28.895 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600484+0000", 2024-04-25T22:42:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020744483000000001 2024-04-25T22:42:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600664+0000", 2024-04-25T22:42:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017953899999999999 2024-04-25T22:42:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600871+0000", 2024-04-25T22:42:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020737199999999999 2024-04-25T22:42:28.896 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10813 4.17 4:e8010137:::100000030b0.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 16.110608413000001, 2024-04-25T22:42:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.047503799999999999, 2024-04-25T22:42:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:28.897 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10813 2024-04-25T22:42:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:28.898 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747741+0000", 2024-04-25T22:42:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1119999999999999e-06 2024-04-25T22:42:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752366+0000", 2024-04-25T22:42:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046253240000000001 2024-04-25T22:42:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752382+0000", 2024-04-25T22:42:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5639999999999999e-05 2024-04-25T22:42:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:28.899 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752393+0000", 2024-04-25T22:42:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1626e-05 2024-04-25T22:42:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752459+0000", 2024-04-25T22:42:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5309999999999996e-05 2024-04-25T22:42:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752529+0000", 2024-04-25T22:42:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0543000000000005e-05 2024-04-25T22:42:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.900 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752637+0000", 2024-04-25T22:42:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010788799999999999 2024-04-25T22:42:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760295+0000", 2024-04-25T22:42:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076583290000000002 2024-04-25T22:42:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.794990+0000", 2024-04-25T22:42:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034694317000000002 2024-04-25T22:42:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795097+0000", 2024-04-25T22:42:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010768999999999999 2024-04-25T22:42:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795243+0000", 2024-04-25T22:42:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000146021 2024-04-25T22:42:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10816 4.17 4:e8010137:::100000030b0.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:28.902 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 16.105278952999999, 2024-04-25T22:42:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042406530999999997, 2024-04-25T22:42:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10816 2024-04-25T22:42:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:28.903 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753070+0000", 2024-04-25T22:42:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9800000000000002e-07 2024-04-25T22:42:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753288+0000", 2024-04-25T22:42:28.904 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000217789 2024-04-25T22:42:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753301+0000", 2024-04-25T22:42:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2764e-05 2024-04-25T22:42:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753310+0000", 2024-04-25T22:42:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:42:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758240+0000", 2024-04-25T22:42:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049304910000000004 2024-04-25T22:42:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758374+0000", 2024-04-25T22:42:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000133428 2024-04-25T22:42:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758576+0000", 2024-04-25T22:42:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020177899999999999 2024-04-25T22:42:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760626+0000", 2024-04-25T22:42:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0020501489999999998 2024-04-25T22:42:28.906 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795329+0000", 2024-04-25T22:42:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034703352999999999 2024-04-25T22:42:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795414+0000", 2024-04-25T22:42:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5292999999999998e-05 2024-04-25T22:42:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795476+0000", 2024-04-25T22:42:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1206999999999999e-05 2024-04-25T22:42:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.907 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10914 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 15.904478571, 2024-04-25T22:42:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044452984000000001, 2024-04-25T22:42:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10914 2024-04-25T22:42:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.908 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953871+0000", 2024-04-25T22:42:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1829999999999999e-06 2024-04-25T22:42:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.909 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.962992+0000", 2024-04-25T22:42:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091217409999999992 2024-04-25T22:42:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963027+0000", 2024-04-25T22:42:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4229e-05 2024-04-25T22:42:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963042+0000", 2024-04-25T22:42:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5152e-05 2024-04-25T22:42:28.910 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963143+0000", 2024-04-25T22:42:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101171 2024-04-25T22:42:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963269+0000", 2024-04-25T22:42:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012623499999999999 2024-04-25T22:42:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963453+0000", 2024-04-25T22:42:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018357900000000001 2024-04-25T22:42:28.911 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998133+0000", 2024-04-25T22:42:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034679789000000003 2024-04-25T22:42:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998220+0000", 2024-04-25T22:42:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7153999999999999e-05 2024-04-25T22:42:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998278+0000", 2024-04-25T22:42:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8035000000000003e-05 2024-04-25T22:42:28.912 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998323+0000", 2024-04-25T22:42:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4715999999999997e-05 2024-04-25T22:42:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10919 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 15.884167290000001, 2024-04-25T22:42:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044010552000000001, 2024-04-25T22:42:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:28.913 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10919 2024-04-25T22:42:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:28.914 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8100000000000003e-07 2024-04-25T22:42:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980221+0000", 2024-04-25T22:42:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060397230000000003 2024-04-25T22:42:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980242+0000", 2024-04-25T22:42:28.915 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1373e-05 2024-04-25T22:42:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980252+0000", 2024-04-25T22:42:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9990000000000003e-06 2024-04-25T22:42:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981303+0000", 2024-04-25T22:42:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010501670000000001 2024-04-25T22:42:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981444+0000", 2024-04-25T22:42:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014123799999999999 2024-04-25T22:42:28.916 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981585+0000", 2024-04-25T22:42:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014071999999999999 2024-04-25T22:42:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003640+0000", 2024-04-25T22:42:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022055113000000001 2024-04-25T22:42:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018070+0000", 2024-04-25T22:42:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014430877 2024-04-25T22:42:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.917 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018138+0000", 2024-04-25T22:42:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7743000000000005e-05 2024-04-25T22:42:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018191+0000", 2024-04-25T22:42:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3118000000000002e-05 2024-04-25T22:42:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:12632 4.a e64/17 4:506aad5d:::1000000310f.00000000:head v 64'203, mlcod=64'201)", 2024-04-25T22:42:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 13.214818895000001, 2024-04-25T22:42:28.918 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041913617, 2024-04-25T22:42:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.919 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643531+0000", 2024-04-25T22:42:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.497e-06 2024-04-25T22:42:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650159+0000", 2024-04-25T22:42:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066287059999999998 2024-04-25T22:42:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650185+0000", 2024-04-25T22:42:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5646000000000001e-05 2024-04-25T22:42:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.920 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650205+0000", 2024-04-25T22:42:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9720000000000001e-05 2024-04-25T22:42:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650521+0000", 2024-04-25T22:42:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00031590699999999998 2024-04-25T22:42:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650574+0000", 2024-04-25T22:42:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3192000000000002e-05 2024-04-25T22:42:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685374+0000", 2024-04-25T22:42:28.921 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034799902000000001 2024-04-25T22:42:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685443+0000", 2024-04-25T22:42:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9047000000000005e-05 2024-04-25T22:42:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12644 4.11 4:8893db93:::100000034c2.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 13.206410005, 2024-04-25T22:42:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045039497999999997, 2024-04-25T22:42:28.922 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12644 2024-04-25T22:42:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:28.923 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651940+0000", 2024-04-25T22:42:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.013e-06 2024-04-25T22:42:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659663+0000", 2024-04-25T22:42:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077228150000000001 2024-04-25T22:42:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659694+0000", 2024-04-25T22:42:28.924 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1112999999999998e-05 2024-04-25T22:42:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659715+0000", 2024-04-25T22:42:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1053e-05 2024-04-25T22:42:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659842+0000", 2024-04-25T22:42:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012738100000000001 2024-04-25T22:42:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660068+0000", 2024-04-25T22:42:28.925 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000225746 2024-04-25T22:42:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660307+0000", 2024-04-25T22:42:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000238352 2024-04-25T22:42:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.683776+0000", 2024-04-25T22:42:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023469891999999999 2024-04-25T22:42:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696810+0000", 2024-04-25T22:42:28.926 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013033385999999999 2024-04-25T22:42:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696904+0000", 2024-04-25T22:42:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3820000000000006e-05 2024-04-25T22:42:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696978+0000", 2024-04-25T22:42:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3926999999999999e-05 2024-04-25T22:42:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12645 4.2d 4:b45456a9:::10000003241.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 13.198589518, 2024-04-25T22:42:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.043099660999999997, 2024-04-25T22:42:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12645 2024-04-25T22:42:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:28.928 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659761+0000", 2024-04-25T22:42:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8459999999999999e-06 2024-04-25T22:42:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666663+0000", 2024-04-25T22:42:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0069017080000000003 2024-04-25T22:42:28.929 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:28.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666684+0000", 2024-04-25T22:42:28.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0706000000000001e-05 2024-04-25T22:42:28.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:28.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666700+0000", 2024-04-25T22:42:28.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5985999999999999e-05 2024-04-25T22:42:28.930 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.930 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.930 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.930 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666914+0000", 2024-04-25T22:42:28.930 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000213861 2024-04-25T22:42:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.667082+0000", 2024-04-25T22:42:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016809 2024-04-25T22:42:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702598+0000", 2024-04-25T22:42:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035515962999999998 2024-04-25T22:42:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702705+0000", 2024-04-25T22:42:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010689800000000001 2024-04-25T22:42:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.931 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702858+0000", 2024-04-25T22:42:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015360300000000001 2024-04-25T22:42:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12829 4.3b 4:de8bdadd:::100000033c7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.970329603, 2024-04-25T22:42:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042457306, 2024-04-25T22:42:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:28.932 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12829 2024-04-25T22:42:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888019+0000", 2024-04-25T22:42:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3300000000000002e-07 2024-04-25T22:42:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891638+0000", 2024-04-25T22:42:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036189109999999998 2024-04-25T22:42:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891661+0000", 2024-04-25T22:42:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3345000000000001e-05 2024-04-25T22:42:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.934 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891671+0000", 2024-04-25T22:42:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0115000000000001e-05 2024-04-25T22:42:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891737+0000", 2024-04-25T22:42:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5600999999999998e-05 2024-04-25T22:42:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891856+0000", 2024-04-25T22:42:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011881 2024-04-25T22:42:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.935 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930251+0000", 2024-04-25T22:42:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.038395141000000001 2024-04-25T22:42:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930389+0000", 2024-04-25T22:42:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013849000000000001 2024-04-25T22:42:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930476+0000", 2024-04-25T22:42:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6360000000000007e-05 2024-04-25T22:42:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.936 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13009 4.1e 4:78728bd7:::100000033a5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.768442590999999, 2024-04-25T22:42:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049997452999999997, 2024-04-25T22:42:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13009 2024-04-25T22:42:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.937 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4799999999999997e-07 2024-04-25T22:42:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.938 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097105+0000", 2024-04-25T22:42:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071984060000000001 2024-04-25T22:42:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097118+0000", 2024-04-25T22:42:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2865e-05 2024-04-25T22:42:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097127+0000", 2024-04-25T22:42:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8449999999999998e-06 2024-04-25T22:42:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.939 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097174+0000", 2024-04-25T22:42:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6084000000000001e-05 2024-04-25T22:42:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097232+0000", 2024-04-25T22:42:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8928999999999998e-05 2024-04-25T22:42:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097309+0000", 2024-04-25T22:42:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7014999999999994e-05 2024-04-25T22:42:28.940 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.108708+0000", 2024-04-25T22:42:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011398233000000001 2024-04-25T22:42:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139793+0000", 2024-04-25T22:42:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031084856000000001 2024-04-25T22:42:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139848+0000", 2024-04-25T22:42:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5464000000000003e-05 2024-04-25T22:42:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.941 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139903+0000", 2024-04-25T22:42:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4907999999999997e-05 2024-04-25T22:42:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13318 4.16 4:6810bf9e:::10000003259.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.397868233000001, 2024-04-25T22:42:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057538179000000002, 2024-04-25T22:42:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:28.942 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13318 2024-04-25T22:42:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:28.943 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460481+0000", 2024-04-25T22:42:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:42:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466775+0000", 2024-04-25T22:42:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062944239999999999 2024-04-25T22:42:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466787+0000", 2024-04-25T22:42:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1688999999999999e-05 2024-04-25T22:42:28.944 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466793+0000", 2024-04-25T22:42:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7209999999999999e-06 2024-04-25T22:42:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466845+0000", 2024-04-25T22:42:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2166999999999997e-05 2024-04-25T22:42:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466912+0000", 2024-04-25T22:42:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7016999999999999e-05 2024-04-25T22:42:28.945 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.467020+0000", 2024-04-25T22:42:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010827699999999999 2024-04-25T22:42:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.476718+0000", 2024-04-25T22:42:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0096980439999999994 2024-04-25T22:42:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517860+0000", 2024-04-25T22:42:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041141847000000002 2024-04-25T22:42:28.946 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517924+0000", 2024-04-25T22:42:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3997000000000004e-05 2024-04-25T22:42:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.518018+0000", 2024-04-25T22:42:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4139000000000001e-05 2024-04-25T22:42:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.947 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13328 4.16 4:6a9ab238:::1000000339b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.378955248, 2024-04-25T22:42:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057072695999999999, 2024-04-25T22:42:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13328 2024-04-25T22:42:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:28.948 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479395+0000", 2024-04-25T22:42:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2859999999999998e-06 2024-04-25T22:42:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486667+0000", 2024-04-25T22:42:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072715599999999998 2024-04-25T22:42:28.949 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486677+0000", 2024-04-25T22:42:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0305e-05 2024-04-25T22:42:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486683+0000", 2024-04-25T22:42:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5300000000000004e-06 2024-04-25T22:42:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486768+0000", 2024-04-25T22:42:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5725999999999999e-05 2024-04-25T22:42:28.950 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486905+0000", 2024-04-25T22:42:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013696699999999999 2024-04-25T22:42:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.487121+0000", 2024-04-25T22:42:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021615299999999999 2024-04-25T22:42:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.509675+0000", 2024-04-25T22:42:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022553225999999999 2024-04-25T22:42:28.951 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536355+0000", 2024-04-25T22:42:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026680855 2024-04-25T22:42:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536401+0000", 2024-04-25T22:42:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5649000000000003e-05 2024-04-25T22:42:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536466+0000", 2024-04-25T22:42:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4438999999999997e-05 2024-04-25T22:42:28.952 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13329 4.26 4:64e005a2:::10000003483.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.371646848999999, 2024-04-25T22:42:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066502845000000005, 2024-04-25T22:42:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13329 2024-04-25T22:42:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486703+0000", 2024-04-25T22:42:28.954 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3909999999999999e-06 2024-04-25T22:42:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494612+0000", 2024-04-25T22:42:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0079096670000000004 2024-04-25T22:42:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494626+0000", 2024-04-25T22:42:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3263e-05 2024-04-25T22:42:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494637+0000", 2024-04-25T22:42:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.171e-05 2024-04-25T22:42:28.955 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494720+0000", 2024-04-25T22:42:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2767000000000002e-05 2024-04-25T22:42:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494834+0000", 2024-04-25T22:42:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011387699999999999 2024-04-25T22:42:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494998+0000", 2024-04-25T22:42:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016390799999999999 2024-04-25T22:42:28.956 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517407+0000", 2024-04-25T22:42:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022409068000000001 2024-04-25T22:42:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553040+0000", 2024-04-25T22:42:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035633155 2024-04-25T22:42:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553140+0000", 2024-04-25T22:42:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9623000000000005e-05 2024-04-25T22:42:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.957 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553204+0000", 2024-04-25T22:42:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4416000000000001e-05 2024-04-25T22:42:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13399 4.16 4:6bb7cc3a:::10000003648.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 12.298281049, 2024-04-25T22:42:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045625003999999997, 2024-04-25T22:42:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:28.958 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13399 2024-04-25T22:42:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:28.959 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560068+0000", 2024-04-25T22:42:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:42:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576902+0000", 2024-04-25T22:42:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016833806 2024-04-25T22:42:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576916+0000", 2024-04-25T22:42:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3648e-05 2024-04-25T22:42:28.960 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576927+0000", 2024-04-25T22:42:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0992000000000001e-05 2024-04-25T22:42:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577026+0000", 2024-04-25T22:42:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9116000000000004e-05 2024-04-25T22:42:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577203+0000", 2024-04-25T22:42:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017700499999999999 2024-04-25T22:42:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.961 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577336+0000", 2024-04-25T22:42:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013340800000000001 2024-04-25T22:42:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.589077+0000", 2024-04-25T22:42:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011741151 2024-04-25T22:42:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605436+0000", 2024-04-25T22:42:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016359146000000001 2024-04-25T22:42:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.962 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:28.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605493+0000", 2024-04-25T22:42:28.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7067000000000001e-05 2024-04-25T22:42:28.963 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:28.963 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:28.963 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:28.963 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605692+0000", 2024-04-25T22:42:28.963 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00019855799999999999 2024-04-25T22:42:28.963 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.963 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.963 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.963 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:28.963 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:28.963 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:28.964 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:28.965 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:28.959+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:29.065 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:29.063+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:29.086 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:29.086 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:29.086 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:42:29.086 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:29.100 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:29.166 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:29.163+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:29.226 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:42:29.226 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:42:29.226 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:29.241 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:29.285 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:29.283+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:29.358 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:29.358 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:42:29.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:42:29.358 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:29.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.358 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:29.358 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:29.358 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 134.76124049699999, 2024-04-25T22:42:29.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:42:29.359 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:29.359 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:29.359 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:29.359 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:29.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:29.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:29.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:29.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:29.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:29.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:42:29.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:42:29.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:29.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:42:29.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:42:29.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:29.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:42:29.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:42:29.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:29.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:42:29.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:42:29.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:42:29.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:42:29.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:29.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:42:29.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:42:29.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:42:29.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:42:29.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:29.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:42:29.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:42:29.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:29.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:42:29.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:42:29.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:29.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:42:29.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:42:29.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:29.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:42:29.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:42:29.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:29.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:42:29.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:42:29.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:29.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:42:29.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:42:29.364 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.364 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.364 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.364 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:29.364 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:29.364 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 134.76113218399999, 2024-04-25T22:42:29.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:42:29.364 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:29.364 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:29.364 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:29.364 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:29.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:29.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:29.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:29.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:29.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:29.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:42:29.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:42:29.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:29.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:42:29.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:42:29.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:29.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:42:29.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:42:29.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:29.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:42:29.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:42:29.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:42:29.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:42:29.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:29.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:42:29.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:42:29.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:42:29.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:42:29.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:29.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:42:29.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:42:29.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:29.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:42:29.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:42:29.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:29.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:42:29.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:42:29.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:29.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:42:29.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:42:29.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:29.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:42:29.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:42:29.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:29.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:42:29.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:42:29.369 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.369 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.369 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.370 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:29.370 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:29.370 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 134.76106552799999, 2024-04-25T22:42:29.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:42:29.370 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:29.370 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:29.370 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:29.370 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:29.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:29.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:29.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:29.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:29.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:29.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:42:29.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:42:29.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:29.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:42:29.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:42:29.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:29.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:42:29.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:42:29.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:29.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:42:29.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:42:29.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:42:29.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:42:29.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:29.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:42:29.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:42:29.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:42:29.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:42:29.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:29.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:42:29.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:42:29.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:29.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:42:29.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:42:29.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:29.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:42:29.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:42:29.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:29.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:42:29.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:42:29.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:29.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:42:29.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:42:29.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:29.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:42:29.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:42:29.375 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.375 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.375 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.375 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:29.375 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:29.375 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 134.76097493200001, 2024-04-25T22:42:29.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:42:29.375 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:29.376 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:29.376 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:29.376 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:29.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:29.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:29.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:29.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:29.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:29.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:42:29.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:42:29.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:29.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:42:29.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:42:29.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:29.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:42:29.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:42:29.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:29.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:42:29.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:42:29.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:42:29.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:42:29.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:29.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:42:29.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:42:29.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:42:29.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:42:29.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:29.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:42:29.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:42:29.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:29.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:42:29.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:42:29.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:29.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:42:29.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:42:29.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:29.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:42:29.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:42:29.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:29.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:42:29.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:42:29.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:29.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:42:29.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:42:29.380 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.380 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.380 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.381 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:29.381 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:29.381 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 134.76091035900001, 2024-04-25T22:42:29.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:42:29.381 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:29.381 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:29.381 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:29.381 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:29.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:29.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:29.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:29.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:29.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:29.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:42:29.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:42:29.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:29.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:42:29.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:42:29.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:29.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:42:29.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:42:29.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:29.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:42:29.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:42:29.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:29.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:42:29.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:29.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:42:29.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:42:29.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:42:29.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:42:29.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:29.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:42:29.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:42:29.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:29.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:42:29.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:42:29.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:29.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:42:29.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:42:29.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:29.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:42:29.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:42:29.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:29.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:42:29.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:42:29.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:29.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:42:29.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:42:29.386 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.386 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.386 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.387 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:29.387 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:29.387 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 134.76084493600001, 2024-04-25T22:42:29.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:42:29.387 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:29.387 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:29.387 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:29.387 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:29.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:29.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:29.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:29.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:29.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:29.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:42:29.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:29.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:29.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:42:29.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:42:29.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:29.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:42:29.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:42:29.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:29.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:42:29.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:42:29.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:42:29.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:42:29.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:29.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:42:29.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:42:29.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:42:29.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:42:29.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:29.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:42:29.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:42:29.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:29.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:42:29.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:42:29.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:29.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:42:29.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:42:29.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:29.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:42:29.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:42:29.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:29.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:42:29.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:42:29.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:29.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:42:29.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:42:29.392 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.392 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.392 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.392 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:29.392 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:29.392 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 134.760564402, 2024-04-25T22:42:29.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:42:29.393 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:29.393 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:29.393 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:29.393 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:29.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:29.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:29.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:29.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:29.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:29.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:42:29.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:42:29.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:29.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:42:29.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:42:29.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:29.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:42:29.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:42:29.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:29.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:42:29.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:42:29.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:42:29.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:42:29.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:29.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:42:29.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:42:29.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:42:29.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:42:29.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:29.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:42:29.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:42:29.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:29.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:42:29.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:42:29.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:29.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:42:29.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:42:29.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:29.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:42:29.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:42:29.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:29.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:42:29.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:42:29.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:29.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:42:29.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:42:29.397 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.398 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.398 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.398 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10678 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:29.398 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:29.398 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.869279663, 2024-04-25T22:42:29.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050477795999999998, 2024-04-25T22:42:29.398 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:29.398 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:29.398 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:29.398 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:29.398 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:29.398 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:29.399 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10678 2024-04-25T22:42:29.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.399 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:29.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:29.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:29.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:29.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:29.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:29.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488127+0000", 2024-04-25T22:42:29.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.716e-06 2024-04-25T22:42:29.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:29.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496392+0000", 2024-04-25T22:42:29.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082651500000000006 2024-04-25T22:42:29.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:29.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496428+0000", 2024-04-25T22:42:29.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5441999999999997e-05 2024-04-25T22:42:29.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:29.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496451+0000", 2024-04-25T22:42:29.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3529000000000001e-05 2024-04-25T22:42:29.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496601+0000", 2024-04-25T22:42:29.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014935600000000001 2024-04-25T22:42:29.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:29.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496856+0000", 2024-04-25T22:42:29.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025537900000000002 2024-04-25T22:42:29.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:29.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.497206+0000", 2024-04-25T22:42:29.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000350599 2024-04-25T22:42:29.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:29.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538231+0000", 2024-04-25T22:42:29.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041024146999999997 2024-04-25T22:42:29.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:29.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538298+0000", 2024-04-25T22:42:29.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7688000000000007e-05 2024-04-25T22:42:29.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:29.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538467+0000", 2024-04-25T22:42:29.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000168178 2024-04-25T22:42:29.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:29.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538603+0000", 2024-04-25T22:42:29.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013661200000000001 2024-04-25T22:42:29.403 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.403 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.403 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.403 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10692 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:29.403 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:29.403 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.852689868999999, 2024-04-25T22:42:29.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.061242408999999998, 2024-04-25T22:42:29.404 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:29.404 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:29.404 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:29.404 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:29.404 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:29.404 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:29.404 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10692 2024-04-25T22:42:29.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.404 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:29.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:29.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:29.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:29.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:29.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:29.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504717+0000", 2024-04-25T22:42:29.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6199999999999999e-06 2024-04-25T22:42:29.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:29.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511770+0000", 2024-04-25T22:42:29.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0070530929999999999 2024-04-25T22:42:29.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:29.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511810+0000", 2024-04-25T22:42:29.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0635e-05 2024-04-25T22:42:29.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:29.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511837+0000", 2024-04-25T22:42:29.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6423000000000001e-05 2024-04-25T22:42:29.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520096+0000", 2024-04-25T22:42:29.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082593730000000004 2024-04-25T22:42:29.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.407 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:29.407 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520345+0000", 2024-04-25T22:42:29.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024908800000000001 2024-04-25T22:42:29.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.407 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:29.407 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520794+0000", 2024-04-25T22:42:29.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000449023 2024-04-25T22:42:29.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.407 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:29.407 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538675+0000", 2024-04-25T22:42:29.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017880991999999998 2024-04-25T22:42:29.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:29.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565761+0000", 2024-04-25T22:42:29.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027085260999999999 2024-04-25T22:42:29.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:29.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565892+0000", 2024-04-25T22:42:29.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013152300000000001 2024-04-25T22:42:29.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:29.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565958+0000", 2024-04-25T22:42:29.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5377999999999996e-05 2024-04-25T22:42:29.409 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.409 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.409 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.409 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10693 4.2c 4:36971e45:::100000030bd.00000001:head [write 971225~86041] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:29.409 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:29.409 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.845511507000001, 2024-04-25T22:42:29.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054529782999999998, 2024-04-25T22:42:29.409 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:29.409 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:29.409 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:29.409 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:29.409 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:29.409 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:29.409 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10693 2024-04-25T22:42:29.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.410 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:29.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:29.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:29.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:29.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:29.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:29.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511897+0000", 2024-04-25T22:42:29.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2499999999999998e-06 2024-04-25T22:42:29.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:29.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512094+0000", 2024-04-25T22:42:29.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019700100000000001 2024-04-25T22:42:29.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:29.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512121+0000", 2024-04-25T22:42:29.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7288999999999999e-05 2024-04-25T22:42:29.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:29.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512137+0000", 2024-04-25T22:42:29.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.592e-05 2024-04-25T22:42:29.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.533845+0000", 2024-04-25T22:42:29.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021707595999999999 2024-04-25T22:42:29.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:29.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534176+0000", 2024-04-25T22:42:29.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033187000000000001 2024-04-25T22:42:29.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:29.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534626+0000", 2024-04-25T22:42:29.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00045008599999999999 2024-04-25T22:42:29.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:29.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.539165+0000", 2024-04-25T22:42:29.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045386380000000002 2024-04-25T22:42:29.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:29.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566169+0000", 2024-04-25T22:42:29.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027004199 2024-04-25T22:42:29.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:29.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566317+0000", 2024-04-25T22:42:29.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014747999999999999 2024-04-25T22:42:29.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:29.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566423+0000", 2024-04-25T22:42:29.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010645399999999999 2024-04-25T22:42:29.414 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.414 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.414 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.414 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10696 4.2b 4:d56d2a96:::100000030c3.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:29.414 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:29.414 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.843803862000001, 2024-04-25T22:42:29.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052282190999999999, 2024-04-25T22:42:29.415 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:29.415 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:29.415 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:29.415 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:29.415 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:29.415 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:29.415 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10696 2024-04-25T22:42:29.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.415 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:29.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:29.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:29.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:29.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:29.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:29.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513603+0000", 2024-04-25T22:42:29.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.283e-06 2024-04-25T22:42:29.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:29.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518647+0000", 2024-04-25T22:42:29.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050440859999999997 2024-04-25T22:42:29.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:29.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518672+0000", 2024-04-25T22:42:29.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4468e-05 2024-04-25T22:42:29.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:29.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518691+0000", 2024-04-25T22:42:29.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9213999999999999e-05 2024-04-25T22:42:29.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518806+0000", 2024-04-25T22:42:29.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115296 2024-04-25T22:42:29.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:29.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519011+0000", 2024-04-25T22:42:29.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020445700000000001 2024-04-25T22:42:29.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:29.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519207+0000", 2024-04-25T22:42:29.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000196431 2024-04-25T22:42:29.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:29.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531309+0000", 2024-04-25T22:42:29.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012101694 2024-04-25T22:42:29.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:29.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565622+0000", 2024-04-25T22:42:29.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034312976000000002 2024-04-25T22:42:29.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:29.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565769+0000", 2024-04-25T22:42:29.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014715900000000001 2024-04-25T22:42:29.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:29.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565883+0000", 2024-04-25T22:42:29.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000114127 2024-04-25T22:42:29.419 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.419 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.419 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.420 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10701 4.a 4:51b6a63a:::100000030f2.00000000:head [write 0~3014656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:29.420 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:29.420 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.832359852, 2024-04-25T22:42:29.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047414393999999999, 2024-04-25T22:42:29.420 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:29.420 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:29.420 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:29.420 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:29.420 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:29.420 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:29.420 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10701 2024-04-25T22:42:29.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.420 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:29.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:29.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:29.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:29.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:29.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:29.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525048+0000", 2024-04-25T22:42:29.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0819999999999999e-06 2024-04-25T22:42:29.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:29.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531709+0000", 2024-04-25T22:42:29.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066610929999999999 2024-04-25T22:42:29.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:29.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531751+0000", 2024-04-25T22:42:29.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1650000000000003e-05 2024-04-25T22:42:29.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:29.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531788+0000", 2024-04-25T22:42:29.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7305000000000003e-05 2024-04-25T22:42:29.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531943+0000", 2024-04-25T22:42:29.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015500600000000001 2024-04-25T22:42:29.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:29.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532086+0000", 2024-04-25T22:42:29.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014238599999999999 2024-04-25T22:42:29.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:29.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532295+0000", 2024-04-25T22:42:29.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020922000000000001 2024-04-25T22:42:29.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:29.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.545987+0000", 2024-04-25T22:42:29.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013692582999999999 2024-04-25T22:42:29.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:29.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572315+0000", 2024-04-25T22:42:29.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026327488 2024-04-25T22:42:29.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:29.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572381+0000", 2024-04-25T22:42:29.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5609000000000002e-05 2024-04-25T22:42:29.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:29.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572460+0000", 2024-04-25T22:42:29.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8972000000000002e-05 2024-04-25T22:42:29.424 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.424 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.424 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.425 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:10700 4.11 e63/57 4:88409fbf:::100000030ec.00000000:head v 63'193, mlcod=62'191)", 2024-04-25T22:42:29.425 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:29.425 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.821530396, 2024-04-25T22:42:29.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050517667000000002, 2024-04-25T22:42:29.425 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:29.425 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:29.425 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:29.425 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:29.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:29.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:29.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:29.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:29.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:29.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535876+0000", 2024-04-25T22:42:29.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0300000000000001e-06 2024-04-25T22:42:29.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:29.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565275+0000", 2024-04-25T22:42:29.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029399033000000001 2024-04-25T22:42:29.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:29.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565358+0000", 2024-04-25T22:42:29.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3403000000000001e-05 2024-04-25T22:42:29.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:29.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565380+0000", 2024-04-25T22:42:29.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1761999999999999e-05 2024-04-25T22:42:29.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565505+0000", 2024-04-25T22:42:29.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000125153 2024-04-25T22:42:29.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:29.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565550+0000", 2024-04-25T22:42:29.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5479000000000003e-05 2024-04-25T22:42:29.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:29.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586328+0000", 2024-04-25T22:42:29.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020777982 2024-04-25T22:42:29.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:29.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586392+0000", 2024-04-25T22:42:29.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3825000000000006e-05 2024-04-25T22:42:29.428 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.428 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.428 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.429 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12632 4.a 4:506aad5d:::1000000310f.00000000:head [write 0~4194304 [2@2043125]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:29.429 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:29.429 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.72247527, 2024-04-25T22:42:29.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051574097999999999, 2024-04-25T22:42:29.429 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:29.429 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:29.429 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:29.429 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:29.429 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:29.429 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:29.429 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12632 2024-04-25T22:42:29.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.429 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:29.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:29.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:29.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:29.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:29.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:29.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634932+0000", 2024-04-25T22:42:29.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1600000000000001e-06 2024-04-25T22:42:29.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:29.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642614+0000", 2024-04-25T22:42:29.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076823000000000004 2024-04-25T22:42:29.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:29.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642660+0000", 2024-04-25T22:42:29.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6016000000000001e-05 2024-04-25T22:42:29.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:29.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642686+0000", 2024-04-25T22:42:29.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5491999999999999e-05 2024-04-25T22:42:29.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642870+0000", 2024-04-25T22:42:29.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000184045 2024-04-25T22:42:29.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:29.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643122+0000", 2024-04-25T22:42:29.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025242299999999999 2024-04-25T22:42:29.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:29.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643634+0000", 2024-04-25T22:42:29.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051145800000000001 2024-04-25T22:42:29.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:29.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.682287+0000", 2024-04-25T22:42:29.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038653342 2024-04-25T22:42:29.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:29.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686419+0000", 2024-04-25T22:42:29.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0041325169999999996 2024-04-25T22:42:29.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:29.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686464+0000", 2024-04-25T22:42:29.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4171000000000001e-05 2024-04-25T22:42:29.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:29.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686504+0000", 2024-04-25T22:42:29.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0173999999999999e-05 2024-04-25T22:42:29.433 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.433 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.433 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.434 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12691 4.39 4:9d0d8843:::100000030ef.00000000:head [write 0~4194304 [3@92787]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:29.434 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:29.434 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.626754181000001, 2024-04-25T22:42:29.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045521998000000001, 2024-04-25T22:42:29.434 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:29.434 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:29.434 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:29.434 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:29.434 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:29.434 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:29.434 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12691 2024-04-25T22:42:29.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.434 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:29.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:29.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:29.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:29.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:29.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:29.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730653+0000", 2024-04-25T22:42:29.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1799999999999999e-06 2024-04-25T22:42:29.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:29.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738136+0000", 2024-04-25T22:42:29.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0074832789999999998 2024-04-25T22:42:29.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:29.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738169+0000", 2024-04-25T22:42:29.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3115999999999999e-05 2024-04-25T22:42:29.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:29.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738190+0000", 2024-04-25T22:42:29.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1060000000000002e-05 2024-04-25T22:42:29.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738264+0000", 2024-04-25T22:42:29.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3150000000000003e-05 2024-04-25T22:42:29.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:29.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738333+0000", 2024-04-25T22:42:29.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9314999999999996e-05 2024-04-25T22:42:29.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:29.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738425+0000", 2024-04-25T22:42:29.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2498999999999996e-05 2024-04-25T22:42:29.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:29.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.745181+0000", 2024-04-25T22:42:29.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067553240000000001 2024-04-25T22:42:29.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:29.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776101+0000", 2024-04-25T22:42:29.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.030920033 2024-04-25T22:42:29.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:29.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776140+0000", 2024-04-25T22:42:29.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9706999999999998e-05 2024-04-25T22:42:29.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:29.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776173+0000", 2024-04-25T22:42:29.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2335000000000001e-05 2024-04-25T22:42:29.438 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.438 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.438 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.439 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12813 4.18 4:1945bfc2:::10000003578.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:29.439 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:29.439 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.488230700000001, 2024-04-25T22:42:29.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054261216000000001, 2024-04-25T22:42:29.439 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:29.439 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:29.439 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:29.439 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:29.439 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:29.439 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:29.439 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12813 2024-04-25T22:42:29.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.439 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:29.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:29.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:29.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:29.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:29.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:29.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869175+0000", 2024-04-25T22:42:29.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3200000000000005e-07 2024-04-25T22:42:29.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:29.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872980+0000", 2024-04-25T22:42:29.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038049720000000002 2024-04-25T22:42:29.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:29.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872988+0000", 2024-04-25T22:42:29.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5429999999999994e-06 2024-04-25T22:42:29.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:29.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872993+0000", 2024-04-25T22:42:29.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8570000000000003e-06 2024-04-25T22:42:29.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873054+0000", 2024-04-25T22:42:29.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0801000000000003e-05 2024-04-25T22:42:29.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:29.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873140+0000", 2024-04-25T22:42:29.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6236999999999994e-05 2024-04-25T22:42:29.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:29.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873271+0000", 2024-04-25T22:42:29.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130541 2024-04-25T22:42:29.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:29.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.884240+0000", 2024-04-25T22:42:29.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010969527 2024-04-25T22:42:29.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:29.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923308+0000", 2024-04-25T22:42:29.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039067317999999997 2024-04-25T22:42:29.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:29.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923373+0000", 2024-04-25T22:42:29.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5055000000000006e-05 2024-04-25T22:42:29.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:29.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923436+0000", 2024-04-25T22:42:29.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2732999999999997e-05 2024-04-25T22:42:29.443 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.444 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.444 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.444 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13328 4.16 e65/54 4:6a9ab238:::1000000339b.00000000:head v 65'186, mlcod=65'183)", 2024-04-25T22:42:29.444 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:29.444 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.867770631999999, 2024-04-25T22:42:29.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.046438762000000001, 2024-04-25T22:42:29.444 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:29.444 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:29.444 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:29.444 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:29.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:29.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:29.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:29.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:29.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:29.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489637+0000", 2024-04-25T22:42:29.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.357e-06 2024-04-25T22:42:29.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:29.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496055+0000", 2024-04-25T22:42:29.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0064181380000000003 2024-04-25T22:42:29.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:29.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496074+0000", 2024-04-25T22:42:29.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8904000000000001e-05 2024-04-25T22:42:29.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:29.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496085+0000", 2024-04-25T22:42:29.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1245e-05 2024-04-25T22:42:29.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496169+0000", 2024-04-25T22:42:29.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3974000000000006e-05 2024-04-25T22:42:29.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:29.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496203+0000", 2024-04-25T22:42:29.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3679000000000001e-05 2024-04-25T22:42:29.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:29.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536002+0000", 2024-04-25T22:42:29.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039799569 2024-04-25T22:42:29.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:29.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536073+0000", 2024-04-25T22:42:29.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0895999999999993e-05 2024-04-25T22:42:29.447 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.447 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.447 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.448 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13338 4.e 4:737b94c2:::1000000338a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:29.448 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:29.448 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.861630117000001, 2024-04-25T22:42:29.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047911849999999999, 2024-04-25T22:42:29.448 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:29.448 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:29.448 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:29.448 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:29.448 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:29.448 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:29.448 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13338 2024-04-25T22:42:29.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.448 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:29.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:29.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:29.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:29.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:29.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:29.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495776+0000", 2024-04-25T22:42:29.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2399999999999996e-07 2024-04-25T22:42:29.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:29.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503748+0000", 2024-04-25T22:42:29.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079725479999999994 2024-04-25T22:42:29.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:29.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503940+0000", 2024-04-25T22:42:29.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000191249 2024-04-25T22:42:29.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:29.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504061+0000", 2024-04-25T22:42:29.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120982 2024-04-25T22:42:29.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515564+0000", 2024-04-25T22:42:29.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011503342999999999 2024-04-25T22:42:29.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:29.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515799+0000", 2024-04-25T22:42:29.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000235138 2024-04-25T22:42:29.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:29.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543419+0000", 2024-04-25T22:42:29.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027620167000000001 2024-04-25T22:42:29.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:29.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543522+0000", 2024-04-25T22:42:29.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010254100000000001 2024-04-25T22:42:29.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:29.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543687+0000", 2024-04-25T22:42:29.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016495799999999999 2024-04-25T22:42:29.452 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.452 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.452 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.452 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13329 4.26 e65/57 4:64e005a2:::10000003483.00000000:head v 65'226, mlcod=64'224)", 2024-04-25T22:42:29.452 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:29.452 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.861027436000001, 2024-04-25T22:42:29.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048871456000000001, 2024-04-25T22:42:29.452 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:29.452 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:29.452 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:29.453 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:29.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:29.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:29.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:29.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:29.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:29.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496379+0000", 2024-04-25T22:42:29.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1480000000000001e-06 2024-04-25T22:42:29.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:29.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504870+0000", 2024-04-25T22:42:29.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0084917880000000001 2024-04-25T22:42:29.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:29.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504888+0000", 2024-04-25T22:42:29.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7365999999999999e-05 2024-04-25T22:42:29.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:29.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504899+0000", 2024-04-25T22:42:29.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1516e-05 2024-04-25T22:42:29.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515953+0000", 2024-04-25T22:42:29.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011054074000000001 2024-04-25T22:42:29.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:29.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515993+0000", 2024-04-25T22:42:29.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9854999999999997e-05 2024-04-25T22:42:29.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:29.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545191+0000", 2024-04-25T22:42:29.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029197323000000001 2024-04-25T22:42:29.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:29.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545249+0000", 2024-04-25T22:42:29.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8386e-05 2024-04-25T22:42:29.456 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.456 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.456 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.456 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13713 4.2b 4:d574dbff:::100000031d0.00000001:head [write 0~4194304 [2@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:29.456 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:29.456 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.448841317999999, 2024-04-25T22:42:29.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047324328999999998, 2024-04-25T22:42:29.456 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:29.456 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:29.456 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:29.456 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:29.456 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:29.456 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:29.456 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13713 2024-04-25T22:42:29.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.457 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:29.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:29.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:29.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:29.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:29.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:29.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:29.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908565+0000", 2024-04-25T22:42:29.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.694e-06 2024-04-25T22:42:29.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:29.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916170+0000", 2024-04-25T22:42:29.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076041720000000002 2024-04-25T22:42:29.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:29.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916200+0000", 2024-04-25T22:42:29.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0463999999999998e-05 2024-04-25T22:42:29.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:29.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916209+0000", 2024-04-25T22:42:29.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3079999999999997e-06 2024-04-25T22:42:29.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:29.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916297+0000", 2024-04-25T22:42:29.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8159999999999996e-05 2024-04-25T22:42:29.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:29.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916554+0000", 2024-04-25T22:42:29.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025661800000000002 2024-04-25T22:42:29.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:29.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916794+0000", 2024-04-25T22:42:29.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024013999999999999 2024-04-25T22:42:29.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:29.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.933120+0000", 2024-04-25T22:42:29.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016325559 2024-04-25T22:42:29.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:29.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955612+0000", 2024-04-25T22:42:29.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022491786 2024-04-25T22:42:29.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:29.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955797+0000", 2024-04-25T22:42:29.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018533699999999999 2024-04-25T22:42:29.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:29.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:29.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:29.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955888+0000", 2024-04-25T22:42:29.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1090999999999999e-05 2024-04-25T22:42:29.461 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.461 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.461 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.461 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:29.461 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:29.461 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:29.462 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:29.463 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:29.459+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:29.563 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:29.563+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:29.595 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:29.595 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:29.595 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:42:29.595 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:29.609 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:29.703 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:29.703+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:29.765 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:29.763+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:29.793 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:29.793 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:29.793 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:42:29.793 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:42:29.793 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:29.814 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:29.902 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:29.903+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:29.967 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:29.967+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:30.003 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:30.003 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:30.003 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:30.003 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:30.003 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.003 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:30.003 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:30.004 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 135.40652536299999, 2024-04-25T22:42:30.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:30.004 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.004 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.004 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.004 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:30.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.004 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.004 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.004 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.004 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:30.004 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:30.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:30.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:30.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:30.005 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.005 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.005 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.005 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:30.005 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:30.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:30.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:30.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:30.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:30.006 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.006 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.006 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:30.006 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:30.006 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:30.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.007 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:30.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:30.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.007 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:30.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:30.007 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.007 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.007 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:30.007 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:30.007 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:30.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:30.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:30.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:30.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:30.008 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.008 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.008 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:30.008 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:30.008 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:30.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.009 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:30.009 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:30.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:30.009 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.009 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.009 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.009 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.009 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.009 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:30.009 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:30.009 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 135.406388107, 2024-04-25T22:42:30.009 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:30.009 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.010 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.010 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.010 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:30.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.010 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:30.010 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.010 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.010 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.010 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:30.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:30.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:30.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:30.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.011 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:30.011 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:30.011 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.011 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.011 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:30.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:30.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:30.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:30.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.012 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:30.012 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:30.012 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:30.012 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.012 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:30.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:30.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:30.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:30.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.013 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:30.013 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:30.013 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:30.013 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.013 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:30.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:30.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:30.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:30.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.014 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.014 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:30.014 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:30.014 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:30.014 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.015 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:30.015 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:30.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:30.015 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.015 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.015 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.015 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.015 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.015 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:30.015 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:30.015 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 135.40612793899999, 2024-04-25T22:42:30.015 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:30.015 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.015 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.016 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.016 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.016 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.016 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:30.016 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.016 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.016 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:30.016 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.016 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.016 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.016 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.016 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:30.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:30.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.017 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:30.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:30.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.017 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:30.017 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:30.017 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.017 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.017 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.017 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:30.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:30.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.018 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:30.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:30.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:30.018 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:30.018 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:30.018 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.018 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.018 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.019 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:30.019 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:30.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.019 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.019 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.019 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:30.019 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:30.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.019 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.019 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:30.019 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:30.019 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:30.019 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.019 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.019 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:30.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:30.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:30.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:30.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:30.020 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:30.020 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:30.020 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.020 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.020 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:30.021 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:30.021 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:30.021 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.021 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.021 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.021 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.021 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.021 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:30.021 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:30.021 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 135.40596274000001, 2024-04-25T22:42:30.021 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:30.021 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.021 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.021 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:30.021 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.022 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:30.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.022 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:30.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.022 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.022 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.022 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.022 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:30.022 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:30.023 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.023 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.023 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.023 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:30.023 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:30.023 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.023 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.023 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.023 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:30.023 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:30.023 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.023 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.023 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.023 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:30.023 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:30.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.024 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.024 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.024 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:30.024 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:30.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.024 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.024 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:30.024 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:30.024 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:30.024 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.024 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.024 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.025 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:30.025 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:30.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.025 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.025 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.025 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:30.025 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:30.025 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.025 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.025 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:30.025 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:30.025 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:30.025 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.025 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.025 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.026 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.026 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:30.026 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:30.026 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 135.40589707800001, 2024-04-25T22:42:30.026 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:30.026 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.026 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.026 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:30.026 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.026 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.026 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.026 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:30.026 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.026 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.027 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.027 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.027 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:30.027 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.027 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.027 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.027 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:30.027 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:30.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.027 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.027 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.027 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:30.027 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:30.027 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:30.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:30.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:30.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:30.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.028 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.028 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:30.028 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:30.028 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.028 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:30.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:30.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:30.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:30.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:30.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.029 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.029 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:30.029 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:30.029 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.029 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.030 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:30.030 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:30.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:30.030 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.030 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.030 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.030 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.030 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.030 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10700 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:30.030 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:30.030 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 17.483029860999999, 2024-04-25T22:42:30.030 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066789482999999997, 2024-04-25T22:42:30.030 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.030 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.031 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.031 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:30.031 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:30.031 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.031 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10700 2024-04-25T22:42:30.031 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.031 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.031 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.031 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.031 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:30.031 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.031 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.031 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.031 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.031 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:30.032 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.032 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.032 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.032 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.032 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519112+0000", 2024-04-25T22:42:30.032 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1399999999999998e-06 2024-04-25T22:42:30.032 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.032 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.032 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.032 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527187+0000", 2024-04-25T22:42:30.032 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080748899999999995 2024-04-25T22:42:30.032 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.032 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.032 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.032 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527232+0000", 2024-04-25T22:42:30.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4895999999999998e-05 2024-04-25T22:42:30.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527259+0000", 2024-04-25T22:42:30.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7331999999999999e-05 2024-04-25T22:42:30.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529418+0000", 2024-04-25T22:42:30.033 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002158765 2024-04-25T22:42:30.033 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.033 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.033 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.033 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529572+0000", 2024-04-25T22:42:30.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015438499999999999 2024-04-25T22:42:30.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:30.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529762+0000", 2024-04-25T22:42:30.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018998100000000001 2024-04-25T22:42:30.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.548359+0000", 2024-04-25T22:42:30.034 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018596444 2024-04-25T22:42:30.034 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.034 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.034 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.034 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585801+0000", 2024-04-25T22:42:30.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.037442469999999999 2024-04-25T22:42:30.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.035 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:30.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585847+0000", 2024-04-25T22:42:30.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5565000000000002e-05 2024-04-25T22:42:30.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.035 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.035 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:30.035 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585899+0000", 2024-04-25T22:42:30.035 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2614999999999997e-05 2024-04-25T22:42:30.035 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.035 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.035 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.035 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.036 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.036 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10714 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:30.036 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:30.036 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 17.449348898, 2024-04-25T22:42:30.036 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.048080623000000003, 2024-04-25T22:42:30.036 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.036 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.036 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.036 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:30.036 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:30.036 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.036 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10714 2024-04-25T22:42:30.036 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.036 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.036 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.037 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:30.037 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.037 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:30.037 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.037 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552792+0000", 2024-04-25T22:42:30.037 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:42:30.037 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.037 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.037 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559915+0000", 2024-04-25T22:42:30.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071231690000000004 2024-04-25T22:42:30.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.038 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559932+0000", 2024-04-25T22:42:30.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7169000000000001e-05 2024-04-25T22:42:30.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.038 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.038 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559942+0000", 2024-04-25T22:42:30.038 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0261999999999999e-05 2024-04-25T22:42:30.038 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.038 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.039 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.039 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560018+0000", 2024-04-25T22:42:30.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5358000000000006e-05 2024-04-25T22:42:30.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.039 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.039 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.039 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560118+0000", 2024-04-25T22:42:30.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000100911 2024-04-25T22:42:30.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.039 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.039 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:30.039 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560281+0000", 2024-04-25T22:42:30.039 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016288500000000001 2024-04-25T22:42:30.039 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.039 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.040 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.579740+0000", 2024-04-25T22:42:30.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019458598000000001 2024-04-25T22:42:30.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.040 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600484+0000", 2024-04-25T22:42:30.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020744483000000001 2024-04-25T22:42:30.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.040 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:30.040 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600664+0000", 2024-04-25T22:42:30.040 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017953899999999999 2024-04-25T22:42:30.040 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.040 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.041 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:30.041 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600871+0000", 2024-04-25T22:42:30.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020737199999999999 2024-04-25T22:42:30.041 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.041 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.041 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.041 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.041 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.041 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10813 4.17 4:e8010137:::100000030b0.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:30.041 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:30.041 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 17.254399891999999, 2024-04-25T22:42:30.041 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.047503799999999999, 2024-04-25T22:42:30.041 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.041 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.041 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.041 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:30.042 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:30.042 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.042 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10813 2024-04-25T22:42:30.042 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.042 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.042 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.042 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.042 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:30.042 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.042 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.042 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.042 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.042 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:30.042 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.043 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.043 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.043 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747741+0000", 2024-04-25T22:42:30.043 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1119999999999999e-06 2024-04-25T22:42:30.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.043 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.043 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.043 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752366+0000", 2024-04-25T22:42:30.043 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046253240000000001 2024-04-25T22:42:30.043 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.043 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.043 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.043 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752382+0000", 2024-04-25T22:42:30.044 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5639999999999999e-05 2024-04-25T22:42:30.044 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.044 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.044 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.044 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752393+0000", 2024-04-25T22:42:30.044 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1626e-05 2024-04-25T22:42:30.044 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.044 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.044 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.044 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752459+0000", 2024-04-25T22:42:30.044 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5309999999999996e-05 2024-04-25T22:42:30.044 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.044 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.044 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.044 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752529+0000", 2024-04-25T22:42:30.044 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0543000000000005e-05 2024-04-25T22:42:30.045 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.045 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.045 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:30.045 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752637+0000", 2024-04-25T22:42:30.045 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010788799999999999 2024-04-25T22:42:30.045 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.045 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.045 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.045 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760295+0000", 2024-04-25T22:42:30.045 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076583290000000002 2024-04-25T22:42:30.045 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.045 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.045 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.045 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.794990+0000", 2024-04-25T22:42:30.045 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034694317000000002 2024-04-25T22:42:30.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.046 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.046 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:30.046 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795097+0000", 2024-04-25T22:42:30.046 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010768999999999999 2024-04-25T22:42:30.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.046 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.046 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:30.046 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795243+0000", 2024-04-25T22:42:30.046 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000146021 2024-04-25T22:42:30.046 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.046 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.046 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.046 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.047 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.047 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10816 4.17 4:e8010137:::100000030b0.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:30.047 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:30.047 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 17.249070432, 2024-04-25T22:42:30.047 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042406530999999997, 2024-04-25T22:42:30.047 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.047 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.047 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.047 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:30.047 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:30.047 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.047 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10816 2024-04-25T22:42:30.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.048 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.048 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.048 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.048 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:30.048 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.048 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.048 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.048 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:30.048 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.048 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.049 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.049 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753070+0000", 2024-04-25T22:42:30.049 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9800000000000002e-07 2024-04-25T22:42:30.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.049 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.049 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753288+0000", 2024-04-25T22:42:30.049 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000217789 2024-04-25T22:42:30.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.049 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.049 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.049 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753301+0000", 2024-04-25T22:42:30.049 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2764e-05 2024-04-25T22:42:30.049 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.050 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753310+0000", 2024-04-25T22:42:30.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:42:30.050 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.050 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758240+0000", 2024-04-25T22:42:30.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049304910000000004 2024-04-25T22:42:30.050 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.050 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.050 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.050 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758374+0000", 2024-04-25T22:42:30.050 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000133428 2024-04-25T22:42:30.050 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.051 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.051 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:30.051 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758576+0000", 2024-04-25T22:42:30.051 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020177899999999999 2024-04-25T22:42:30.051 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.051 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.051 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.051 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760626+0000", 2024-04-25T22:42:30.051 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0020501489999999998 2024-04-25T22:42:30.051 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.051 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.051 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.051 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795329+0000", 2024-04-25T22:42:30.051 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034703352999999999 2024-04-25T22:42:30.051 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.052 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:30.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795414+0000", 2024-04-25T22:42:30.052 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5292999999999998e-05 2024-04-25T22:42:30.052 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.052 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:30.052 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795476+0000", 2024-04-25T22:42:30.052 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1206999999999999e-05 2024-04-25T22:42:30.052 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.052 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.052 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.052 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.052 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.052 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10914 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:30.052 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:30.053 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 17.048270049999999, 2024-04-25T22:42:30.053 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044452984000000001, 2024-04-25T22:42:30.053 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.053 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.053 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.053 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:30.053 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:30.053 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.053 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10914 2024-04-25T22:42:30.053 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.053 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.053 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.053 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.053 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:30.053 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.054 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.054 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.054 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.054 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:30.054 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.054 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.054 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.054 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.054 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953871+0000", 2024-04-25T22:42:30.054 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1829999999999999e-06 2024-04-25T22:42:30.054 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.054 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.054 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.054 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.962992+0000", 2024-04-25T22:42:30.055 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091217409999999992 2024-04-25T22:42:30.055 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.055 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.055 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.055 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963027+0000", 2024-04-25T22:42:30.055 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4229e-05 2024-04-25T22:42:30.055 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.055 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.055 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.055 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963042+0000", 2024-04-25T22:42:30.055 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5152e-05 2024-04-25T22:42:30.055 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.055 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.055 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.055 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963143+0000", 2024-04-25T22:42:30.056 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101171 2024-04-25T22:42:30.056 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.056 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.056 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.056 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963269+0000", 2024-04-25T22:42:30.056 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012623499999999999 2024-04-25T22:42:30.056 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.056 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.056 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:30.056 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963453+0000", 2024-04-25T22:42:30.056 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018357900000000001 2024-04-25T22:42:30.056 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.056 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.056 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.057 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998133+0000", 2024-04-25T22:42:30.057 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034679789000000003 2024-04-25T22:42:30.057 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.057 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.057 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.057 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998220+0000", 2024-04-25T22:42:30.057 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7153999999999999e-05 2024-04-25T22:42:30.057 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.057 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.057 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:30.057 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998278+0000", 2024-04-25T22:42:30.057 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8035000000000003e-05 2024-04-25T22:42:30.057 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.057 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.057 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:30.058 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998323+0000", 2024-04-25T22:42:30.058 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4715999999999997e-05 2024-04-25T22:42:30.058 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.058 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.058 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.058 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.058 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.058 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10919 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:30.058 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:30.058 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 17.027958769000001, 2024-04-25T22:42:30.058 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044010552000000001, 2024-04-25T22:42:30.058 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.058 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.058 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.059 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:30.059 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:30.059 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.059 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10919 2024-04-25T22:42:30.059 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.059 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.059 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.059 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.059 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:30.059 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.059 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.059 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.059 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.059 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:30.060 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.060 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.060 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.060 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.060 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:30.060 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8100000000000003e-07 2024-04-25T22:42:30.060 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.060 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.060 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.060 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980221+0000", 2024-04-25T22:42:30.060 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060397230000000003 2024-04-25T22:42:30.060 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.060 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.060 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.061 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980242+0000", 2024-04-25T22:42:30.061 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1373e-05 2024-04-25T22:42:30.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.061 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.061 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.061 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980252+0000", 2024-04-25T22:42:30.061 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9990000000000003e-06 2024-04-25T22:42:30.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.061 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.061 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.061 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981303+0000", 2024-04-25T22:42:30.061 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010501670000000001 2024-04-25T22:42:30.061 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.061 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.061 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.062 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981444+0000", 2024-04-25T22:42:30.062 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014123799999999999 2024-04-25T22:42:30.062 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.062 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.062 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:30.062 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981585+0000", 2024-04-25T22:42:30.062 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014071999999999999 2024-04-25T22:42:30.062 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.062 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.062 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.062 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003640+0000", 2024-04-25T22:42:30.062 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022055113000000001 2024-04-25T22:42:30.062 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.062 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.063 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.063 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018070+0000", 2024-04-25T22:42:30.063 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014430877 2024-04-25T22:42:30.063 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.063 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.063 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:30.063 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018138+0000", 2024-04-25T22:42:30.063 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7743000000000005e-05 2024-04-25T22:42:30.063 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.063 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.063 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:30.063 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018191+0000", 2024-04-25T22:42:30.063 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3118000000000002e-05 2024-04-25T22:42:30.063 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.063 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.063 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.064 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.064 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.064 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:12632 4.a e64/17 4:506aad5d:::1000000310f.00000000:head v 64'203, mlcod=64'201)", 2024-04-25T22:42:30.064 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:30.064 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 14.358610374, 2024-04-25T22:42:30.064 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041913617, 2024-04-25T22:42:30.064 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.064 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.064 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.064 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.064 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.064 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.064 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:30.064 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.064 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.064 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.065 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.065 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:30.065 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.065 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.065 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.065 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.065 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643531+0000", 2024-04-25T22:42:30.065 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.497e-06 2024-04-25T22:42:30.065 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.065 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.065 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.065 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650159+0000", 2024-04-25T22:42:30.065 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066287059999999998 2024-04-25T22:42:30.065 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.065 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.066 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.066 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650185+0000", 2024-04-25T22:42:30.066 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5646000000000001e-05 2024-04-25T22:42:30.066 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.066 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.066 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.066 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650205+0000", 2024-04-25T22:42:30.066 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9720000000000001e-05 2024-04-25T22:42:30.066 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.066 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.066 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.066 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650521+0000", 2024-04-25T22:42:30.066 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00031590699999999998 2024-04-25T22:42:30.066 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.066 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.067 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.067 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650574+0000", 2024-04-25T22:42:30.067 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3192000000000002e-05 2024-04-25T22:42:30.067 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.067 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.067 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:30.067 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685374+0000", 2024-04-25T22:42:30.067 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034799902000000001 2024-04-25T22:42:30.067 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.067 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.067 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:30.067 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685443+0000", 2024-04-25T22:42:30.067 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9047000000000005e-05 2024-04-25T22:42:30.067 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.067 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.067 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.068 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.068 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.068 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12644 4.11 4:8893db93:::100000034c2.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:30.068 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:30.068 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 14.350201483999999, 2024-04-25T22:42:30.068 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045039497999999997, 2024-04-25T22:42:30.068 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.068 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.068 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.068 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:30.068 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:30.068 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.068 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12644 2024-04-25T22:42:30.068 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.069 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.069 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.069 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.069 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:30.069 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.069 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.069 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.069 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.069 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:30.069 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.069 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.069 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.069 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.069 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651940+0000", 2024-04-25T22:42:30.069 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.013e-06 2024-04-25T22:42:30.070 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.070 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.070 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.070 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659663+0000", 2024-04-25T22:42:30.070 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077228150000000001 2024-04-25T22:42:30.070 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.070 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.070 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.070 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659694+0000", 2024-04-25T22:42:30.070 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1112999999999998e-05 2024-04-25T22:42:30.070 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.070 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.070 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.070 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659715+0000", 2024-04-25T22:42:30.071 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1053e-05 2024-04-25T22:42:30.071 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.071 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.071 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.071 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659842+0000", 2024-04-25T22:42:30.071 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012738100000000001 2024-04-25T22:42:30.071 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.071 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.071 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.071 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660068+0000", 2024-04-25T22:42:30.071 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000225746 2024-04-25T22:42:30.071 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.071 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.071 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:30.072 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660307+0000", 2024-04-25T22:42:30.072 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000238352 2024-04-25T22:42:30.072 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.072 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.072 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.072 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.683776+0000", 2024-04-25T22:42:30.072 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023469891999999999 2024-04-25T22:42:30.072 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.072 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.072 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.072 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696810+0000", 2024-04-25T22:42:30.072 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013033385999999999 2024-04-25T22:42:30.072 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.072 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.072 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:30.072 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696904+0000", 2024-04-25T22:42:30.073 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3820000000000006e-05 2024-04-25T22:42:30.073 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.073 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.073 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:30.073 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696978+0000", 2024-04-25T22:42:30.073 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3926999999999999e-05 2024-04-25T22:42:30.073 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.073 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.073 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.073 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.073 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.073 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12645 4.2d 4:b45456a9:::10000003241.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:30.073 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:30.073 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 14.342380996999999, 2024-04-25T22:42:30.074 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.043099660999999997, 2024-04-25T22:42:30.074 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.074 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.074 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.074 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:30.074 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:30.074 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.074 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12645 2024-04-25T22:42:30.074 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.074 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.074 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.074 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.074 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:30.074 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.074 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.075 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.075 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.075 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:30.075 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.075 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.075 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.075 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.075 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659761+0000", 2024-04-25T22:42:30.075 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8459999999999999e-06 2024-04-25T22:42:30.075 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.075 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.075 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.075 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666663+0000", 2024-04-25T22:42:30.075 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0069017080000000003 2024-04-25T22:42:30.075 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.075 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.076 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.076 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666684+0000", 2024-04-25T22:42:30.076 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0706000000000001e-05 2024-04-25T22:42:30.076 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.076 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.076 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.076 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666700+0000", 2024-04-25T22:42:30.076 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5985999999999999e-05 2024-04-25T22:42:30.076 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.076 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.076 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.076 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666914+0000", 2024-04-25T22:42:30.076 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000213861 2024-04-25T22:42:30.076 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.076 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.076 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.077 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.667082+0000", 2024-04-25T22:42:30.077 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016809 2024-04-25T22:42:30.077 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.077 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.077 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.077 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702598+0000", 2024-04-25T22:42:30.077 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035515962999999998 2024-04-25T22:42:30.077 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.077 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.077 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:30.077 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702705+0000", 2024-04-25T22:42:30.077 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010689800000000001 2024-04-25T22:42:30.077 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.077 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.077 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:30.078 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702858+0000", 2024-04-25T22:42:30.078 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015360300000000001 2024-04-25T22:42:30.078 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.078 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.078 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.078 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.078 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.078 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12829 4.3b 4:de8bdadd:::100000033c7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:30.078 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:30.078 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 14.114121082, 2024-04-25T22:42:30.078 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042457306, 2024-04-25T22:42:30.078 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.078 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.078 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.078 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:30.079 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:30.079 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.079 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12829 2024-04-25T22:42:30.079 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.079 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.079 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.079 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.079 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:30.079 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.079 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.079 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.079 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.079 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:30.079 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.079 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.079 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.080 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.080 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888019+0000", 2024-04-25T22:42:30.080 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3300000000000002e-07 2024-04-25T22:42:30.080 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.080 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.080 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.080 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891638+0000", 2024-04-25T22:42:30.080 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036189109999999998 2024-04-25T22:42:30.080 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.080 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.080 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.080 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891661+0000", 2024-04-25T22:42:30.080 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3345000000000001e-05 2024-04-25T22:42:30.080 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.080 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.081 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.081 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891671+0000", 2024-04-25T22:42:30.081 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0115000000000001e-05 2024-04-25T22:42:30.081 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.081 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.081 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.081 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891737+0000", 2024-04-25T22:42:30.081 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5600999999999998e-05 2024-04-25T22:42:30.081 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.081 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.081 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.081 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891856+0000", 2024-04-25T22:42:30.081 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011881 2024-04-25T22:42:30.081 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.082 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.082 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.082 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930251+0000", 2024-04-25T22:42:30.082 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.038395141000000001 2024-04-25T22:42:30.082 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.082 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.082 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:30.082 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930389+0000", 2024-04-25T22:42:30.082 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013849000000000001 2024-04-25T22:42:30.082 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.082 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.082 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:30.082 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930476+0000", 2024-04-25T22:42:30.082 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6360000000000007e-05 2024-04-25T22:42:30.082 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.083 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.083 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.083 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.083 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.083 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13009 4.1e 4:78728bd7:::100000033a5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:30.083 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:30.083 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 13.91223407, 2024-04-25T22:42:30.083 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049997452999999997, 2024-04-25T22:42:30.083 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.083 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.083 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.083 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:30.083 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:30.083 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.083 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13009 2024-04-25T22:42:30.083 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.084 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.084 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.084 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.084 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:30.084 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.084 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.084 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.084 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.084 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:30.084 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.084 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.084 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.084 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.084 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:30.084 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4799999999999997e-07 2024-04-25T22:42:30.085 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.085 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.085 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.085 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097105+0000", 2024-04-25T22:42:30.085 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071984060000000001 2024-04-25T22:42:30.085 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.085 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.085 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.085 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097118+0000", 2024-04-25T22:42:30.085 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2865e-05 2024-04-25T22:42:30.085 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.085 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.085 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.085 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097127+0000", 2024-04-25T22:42:30.085 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8449999999999998e-06 2024-04-25T22:42:30.085 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.086 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.086 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.086 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097174+0000", 2024-04-25T22:42:30.086 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6084000000000001e-05 2024-04-25T22:42:30.086 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.086 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.086 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.086 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097232+0000", 2024-04-25T22:42:30.086 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8928999999999998e-05 2024-04-25T22:42:30.086 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.086 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.086 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:30.086 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097309+0000", 2024-04-25T22:42:30.086 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7014999999999994e-05 2024-04-25T22:42:30.086 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.087 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.087 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.087 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.108708+0000", 2024-04-25T22:42:30.087 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011398233000000001 2024-04-25T22:42:30.087 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.087 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.087 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.087 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139793+0000", 2024-04-25T22:42:30.087 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031084856000000001 2024-04-25T22:42:30.087 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.087 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.087 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:30.087 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139848+0000", 2024-04-25T22:42:30.087 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5464000000000003e-05 2024-04-25T22:42:30.088 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.088 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.088 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:30.088 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139903+0000", 2024-04-25T22:42:30.088 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4907999999999997e-05 2024-04-25T22:42:30.088 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.088 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.088 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.088 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.088 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.088 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13318 4.16 4:6810bf9e:::10000003259.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:30.088 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:30.088 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 13.541659712, 2024-04-25T22:42:30.088 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057538179000000002, 2024-04-25T22:42:30.089 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.089 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.089 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.089 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:30.089 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:30.089 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.089 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13318 2024-04-25T22:42:30.089 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.089 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.089 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.089 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.089 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:30.089 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.089 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.089 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.089 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.090 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:30.090 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.090 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.090 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.090 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.090 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460481+0000", 2024-04-25T22:42:30.090 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:42:30.090 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.090 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.090 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.090 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466775+0000", 2024-04-25T22:42:30.090 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062944239999999999 2024-04-25T22:42:30.090 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.090 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.090 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.091 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466787+0000", 2024-04-25T22:42:30.091 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1688999999999999e-05 2024-04-25T22:42:30.091 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.091 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.091 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.091 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466793+0000", 2024-04-25T22:42:30.091 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7209999999999999e-06 2024-04-25T22:42:30.091 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.091 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.091 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.091 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466845+0000", 2024-04-25T22:42:30.091 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2166999999999997e-05 2024-04-25T22:42:30.091 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.091 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.091 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.092 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466912+0000", 2024-04-25T22:42:30.092 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7016999999999999e-05 2024-04-25T22:42:30.092 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.092 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.092 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:30.092 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.467020+0000", 2024-04-25T22:42:30.092 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010827699999999999 2024-04-25T22:42:30.092 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.092 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.092 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.092 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.476718+0000", 2024-04-25T22:42:30.092 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0096980439999999994 2024-04-25T22:42:30.092 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.092 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.092 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.092 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517860+0000", 2024-04-25T22:42:30.093 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041141847000000002 2024-04-25T22:42:30.093 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.093 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.093 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:30.093 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517924+0000", 2024-04-25T22:42:30.093 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3997000000000004e-05 2024-04-25T22:42:30.093 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.093 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.093 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:30.093 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.518018+0000", 2024-04-25T22:42:30.093 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4139000000000001e-05 2024-04-25T22:42:30.093 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.093 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.093 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.093 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.093 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.094 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13328 4.16 4:6a9ab238:::1000000339b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:30.094 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:30.094 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 13.522746726999999, 2024-04-25T22:42:30.094 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057072695999999999, 2024-04-25T22:42:30.094 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.094 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.094 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.094 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:30.094 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:30.094 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.094 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13328 2024-04-25T22:42:30.094 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.094 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.094 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.095 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.095 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:30.095 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.095 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.095 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.095 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.095 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:30.095 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.095 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.095 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.095 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.095 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479395+0000", 2024-04-25T22:42:30.095 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2859999999999998e-06 2024-04-25T22:42:30.095 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.095 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486667+0000", 2024-04-25T22:42:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072715599999999998 2024-04-25T22:42:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486677+0000", 2024-04-25T22:42:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0305e-05 2024-04-25T22:42:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486683+0000", 2024-04-25T22:42:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5300000000000004e-06 2024-04-25T22:42:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.096 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486768+0000", 2024-04-25T22:42:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5725999999999999e-05 2024-04-25T22:42:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486905+0000", 2024-04-25T22:42:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013696699999999999 2024-04-25T22:42:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.487121+0000", 2024-04-25T22:42:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021615299999999999 2024-04-25T22:42:30.097 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.098 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.098 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.098 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.509675+0000", 2024-04-25T22:42:30.098 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022553225999999999 2024-04-25T22:42:30.098 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.098 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.098 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.098 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536355+0000", 2024-04-25T22:42:30.098 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026680855 2024-04-25T22:42:30.098 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.098 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.098 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:30.098 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536401+0000", 2024-04-25T22:42:30.098 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5649000000000003e-05 2024-04-25T22:42:30.099 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.099 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.099 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:30.099 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536466+0000", 2024-04-25T22:42:30.099 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4438999999999997e-05 2024-04-25T22:42:30.099 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.099 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.099 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.099 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.099 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.099 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13329 4.26 4:64e005a2:::10000003483.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:30.099 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:30.099 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 13.515438328, 2024-04-25T22:42:30.099 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066502845000000005, 2024-04-25T22:42:30.099 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.099 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.100 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.100 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:30.100 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:30.100 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.100 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13329 2024-04-25T22:42:30.100 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.100 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.100 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.100 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.100 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:30.100 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.100 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.100 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.100 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.100 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:30.100 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.100 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.101 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.101 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.101 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486703+0000", 2024-04-25T22:42:30.101 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3909999999999999e-06 2024-04-25T22:42:30.101 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.101 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.101 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.101 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494612+0000", 2024-04-25T22:42:30.101 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0079096670000000004 2024-04-25T22:42:30.101 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.101 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.101 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.101 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494626+0000", 2024-04-25T22:42:30.101 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3263e-05 2024-04-25T22:42:30.101 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.102 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.102 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.102 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494637+0000", 2024-04-25T22:42:30.102 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.171e-05 2024-04-25T22:42:30.102 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.102 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.102 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.102 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494720+0000", 2024-04-25T22:42:30.102 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2767000000000002e-05 2024-04-25T22:42:30.102 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.102 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.102 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.102 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494834+0000", 2024-04-25T22:42:30.102 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011387699999999999 2024-04-25T22:42:30.103 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.103 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.103 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:30.103 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494998+0000", 2024-04-25T22:42:30.103 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016390799999999999 2024-04-25T22:42:30.103 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.103 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.103 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.103 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517407+0000", 2024-04-25T22:42:30.103 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022409068000000001 2024-04-25T22:42:30.103 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.103 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.103 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.103 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553040+0000", 2024-04-25T22:42:30.103 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035633155 2024-04-25T22:42:30.104 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.104 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.104 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:30.104 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553140+0000", 2024-04-25T22:42:30.104 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9623000000000005e-05 2024-04-25T22:42:30.104 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.104 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.104 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:30.104 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553204+0000", 2024-04-25T22:42:30.104 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4416000000000001e-05 2024-04-25T22:42:30.104 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.104 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.104 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.104 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.105 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.105 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13399 4.16 4:6bb7cc3a:::10000003648.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:30.105 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:30.105 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 13.442072528000001, 2024-04-25T22:42:30.105 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045625003999999997, 2024-04-25T22:42:30.105 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.105 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.105 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.105 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:30.105 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:30.105 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.105 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13399 2024-04-25T22:42:30.105 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.105 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.106 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.106 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.106 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:30.106 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.106 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.106 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.106 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.106 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:30.106 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.106 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.106 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.106 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.106 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560068+0000", 2024-04-25T22:42:30.106 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:42:30.106 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.107 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.107 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.107 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576902+0000", 2024-04-25T22:42:30.107 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016833806 2024-04-25T22:42:30.107 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.107 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.107 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.107 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576916+0000", 2024-04-25T22:42:30.107 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3648e-05 2024-04-25T22:42:30.107 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.107 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.107 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.107 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576927+0000", 2024-04-25T22:42:30.107 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0992000000000001e-05 2024-04-25T22:42:30.107 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.107 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.108 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.108 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577026+0000", 2024-04-25T22:42:30.108 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9116000000000004e-05 2024-04-25T22:42:30.108 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.108 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.108 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.108 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577203+0000", 2024-04-25T22:42:30.108 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017700499999999999 2024-04-25T22:42:30.108 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.108 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.108 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:30.108 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577336+0000", 2024-04-25T22:42:30.108 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013340800000000001 2024-04-25T22:42:30.108 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.108 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.109 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.109 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.589077+0000", 2024-04-25T22:42:30.109 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011741151 2024-04-25T22:42:30.109 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.109 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.109 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.109 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605436+0000", 2024-04-25T22:42:30.109 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016359146000000001 2024-04-25T22:42:30.109 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.109 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.109 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:30.109 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605493+0000", 2024-04-25T22:42:30.109 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7067000000000001e-05 2024-04-25T22:42:30.109 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.109 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.109 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:30.110 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605692+0000", 2024-04-25T22:42:30.110 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00019855799999999999 2024-04-25T22:42:30.110 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.110 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.110 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.110 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.110 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.110 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:30.112 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:30.112 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:30.107+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:30.212 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:30.211+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:30.244 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:30.244 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:30.245 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:42:30.245 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:30.258 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:30.313 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:30.311+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:30.366 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:42:30.381 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:30.381 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:30.381 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:42:30.381 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:42:30.381 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:30.395 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:30.414 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:30.415+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:30.515 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:30.515+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:30.522 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:42:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:42:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 135.92326742700001, 2024-04-25T22:42:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:42:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:42:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:42:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:42:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:42:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:42:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:42:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:42:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:42:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:42:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:42:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:42:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:42:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:42:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:42:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:42:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:42:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:42:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:42:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:42:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:42:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:42:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:42:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:42:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:42:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:42:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:42:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 135.92315911399999, 2024-04-25T22:42:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:42:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:42:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:42:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:42:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:42:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:42:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:42:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:42:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:42:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:42:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:42:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:42:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:42:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:42:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:42:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:42:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:42:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:42:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:42:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:42:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:42:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:42:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:42:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:42:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:42:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:42:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:42:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 135.92309245800001, 2024-04-25T22:42:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:42:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:42:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:42:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:42:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:42:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:42:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:42:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:42:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:42:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:42:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:42:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:42:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:42:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:42:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:42:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:42:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:42:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:42:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:42:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:42:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:42:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:42:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:42:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:42:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:42:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:42:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:42:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 135.92300186200001, 2024-04-25T22:42:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:42:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:42:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:42:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:42:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:42:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:42:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:42:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:42:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:42:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:42:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:42:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:42:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:42:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:42:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:42:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:42:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:42:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:42:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:42:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:42:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:42:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:42:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:42:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:42:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:42:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:42:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:42:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 135.922937289, 2024-04-25T22:42:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:42:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:42:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:42:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:42:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:42:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:42:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:42:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:42:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:42:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:42:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:42:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:42:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:42:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:42:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:42:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:42:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:42:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:42:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:42:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:42:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:42:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:42:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:42:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:42:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:42:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:42:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 135.92287186600001, 2024-04-25T22:42:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:42:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:42:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:42:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:42:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:42:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:42:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:42:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:42:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:42:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:42:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:42:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:42:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:42:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:42:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:30.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:42:30.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:42:30.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:30.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:42:30.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:42:30.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:30.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:42:30.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:42:30.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:42:30.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:42:30.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:30.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:42:30.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:42:30.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:30.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:42:30.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:42:30.555 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.555 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.555 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.556 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:30.556 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:30.556 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 135.922591332, 2024-04-25T22:42:30.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:42:30.556 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:30.556 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:30.556 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.556 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:30.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:30.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:30.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:30.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:30.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:30.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:42:30.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:42:30.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:30.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:42:30.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:42:30.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:30.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:42:30.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:42:30.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:42:30.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:42:30.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:42:30.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:42:30.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:30.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:42:30.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:42:30.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:42:30.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:42:30.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:30.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:42:30.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:42:30.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:30.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:42:30.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:42:30.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:42:30.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:42:30.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:30.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:42:30.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:42:30.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:30.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:42:30.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:42:30.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:30.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:42:30.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:42:30.561 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.561 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.561 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.561 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10678 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:30.561 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:30.561 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 18.031306593, 2024-04-25T22:42:30.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050477795999999998, 2024-04-25T22:42:30.561 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:30.561 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:30.561 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.562 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:30.562 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:30.562 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.562 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10678 2024-04-25T22:42:30.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.562 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:30.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:30.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:30.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:30.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:30.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:30.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488127+0000", 2024-04-25T22:42:30.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.716e-06 2024-04-25T22:42:30.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:30.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496392+0000", 2024-04-25T22:42:30.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082651500000000006 2024-04-25T22:42:30.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:30.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496428+0000", 2024-04-25T22:42:30.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5441999999999997e-05 2024-04-25T22:42:30.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496451+0000", 2024-04-25T22:42:30.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3529000000000001e-05 2024-04-25T22:42:30.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496601+0000", 2024-04-25T22:42:30.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014935600000000001 2024-04-25T22:42:30.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:30.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496856+0000", 2024-04-25T22:42:30.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025537900000000002 2024-04-25T22:42:30.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:30.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.497206+0000", 2024-04-25T22:42:30.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000350599 2024-04-25T22:42:30.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538231+0000", 2024-04-25T22:42:30.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041024146999999997 2024-04-25T22:42:30.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:30.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538298+0000", 2024-04-25T22:42:30.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7688000000000007e-05 2024-04-25T22:42:30.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:30.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538467+0000", 2024-04-25T22:42:30.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000168178 2024-04-25T22:42:30.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:30.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538603+0000", 2024-04-25T22:42:30.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013661200000000001 2024-04-25T22:42:30.566 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.566 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.566 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.566 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10692 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:30.566 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:30.566 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 18.014716798999999, 2024-04-25T22:42:30.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.061242408999999998, 2024-04-25T22:42:30.566 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:30.567 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:30.567 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.567 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:30.567 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:30.567 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.567 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10692 2024-04-25T22:42:30.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.567 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:30.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:30.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:30.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:30.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:30.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:30.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504717+0000", 2024-04-25T22:42:30.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6199999999999999e-06 2024-04-25T22:42:30.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:30.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511770+0000", 2024-04-25T22:42:30.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0070530929999999999 2024-04-25T22:42:30.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:30.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511810+0000", 2024-04-25T22:42:30.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0635e-05 2024-04-25T22:42:30.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511837+0000", 2024-04-25T22:42:30.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6423000000000001e-05 2024-04-25T22:42:30.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520096+0000", 2024-04-25T22:42:30.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082593730000000004 2024-04-25T22:42:30.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:30.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520345+0000", 2024-04-25T22:42:30.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024908800000000001 2024-04-25T22:42:30.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:30.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520794+0000", 2024-04-25T22:42:30.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000449023 2024-04-25T22:42:30.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:30.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538675+0000", 2024-04-25T22:42:30.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017880991999999998 2024-04-25T22:42:30.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565761+0000", 2024-04-25T22:42:30.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027085260999999999 2024-04-25T22:42:30.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:30.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565892+0000", 2024-04-25T22:42:30.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013152300000000001 2024-04-25T22:42:30.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:30.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565958+0000", 2024-04-25T22:42:30.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5377999999999996e-05 2024-04-25T22:42:30.571 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.571 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.571 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.571 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10693 4.2c 4:36971e45:::100000030bd.00000001:head [write 971225~86041] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:30.571 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:30.571 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 18.007538437000001, 2024-04-25T22:42:30.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054529782999999998, 2024-04-25T22:42:30.571 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:30.572 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:30.572 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.572 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:30.572 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:30.572 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.572 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10693 2024-04-25T22:42:30.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.572 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:30.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:30.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:30.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:30.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:30.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:30.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511897+0000", 2024-04-25T22:42:30.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2499999999999998e-06 2024-04-25T22:42:30.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:30.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512094+0000", 2024-04-25T22:42:30.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019700100000000001 2024-04-25T22:42:30.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:30.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512121+0000", 2024-04-25T22:42:30.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7288999999999999e-05 2024-04-25T22:42:30.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512137+0000", 2024-04-25T22:42:30.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.592e-05 2024-04-25T22:42:30.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.533845+0000", 2024-04-25T22:42:30.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021707595999999999 2024-04-25T22:42:30.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:30.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534176+0000", 2024-04-25T22:42:30.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033187000000000001 2024-04-25T22:42:30.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:30.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534626+0000", 2024-04-25T22:42:30.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00045008599999999999 2024-04-25T22:42:30.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:30.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.539165+0000", 2024-04-25T22:42:30.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045386380000000002 2024-04-25T22:42:30.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566169+0000", 2024-04-25T22:42:30.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027004199 2024-04-25T22:42:30.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:30.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566317+0000", 2024-04-25T22:42:30.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014747999999999999 2024-04-25T22:42:30.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:30.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566423+0000", 2024-04-25T22:42:30.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010645399999999999 2024-04-25T22:42:30.576 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.576 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.576 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.576 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10696 4.2b 4:d56d2a96:::100000030c3.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:30.576 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:30.577 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 18.005830792000001, 2024-04-25T22:42:30.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052282190999999999, 2024-04-25T22:42:30.577 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:30.577 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:30.577 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.577 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:30.577 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:30.577 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.577 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10696 2024-04-25T22:42:30.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.577 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:30.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:30.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:30.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:30.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:30.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:30.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513603+0000", 2024-04-25T22:42:30.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.283e-06 2024-04-25T22:42:30.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:30.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518647+0000", 2024-04-25T22:42:30.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050440859999999997 2024-04-25T22:42:30.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:30.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518672+0000", 2024-04-25T22:42:30.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4468e-05 2024-04-25T22:42:30.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518691+0000", 2024-04-25T22:42:30.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9213999999999999e-05 2024-04-25T22:42:30.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518806+0000", 2024-04-25T22:42:30.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115296 2024-04-25T22:42:30.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:30.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519011+0000", 2024-04-25T22:42:30.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020445700000000001 2024-04-25T22:42:30.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:30.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519207+0000", 2024-04-25T22:42:30.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000196431 2024-04-25T22:42:30.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:30.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531309+0000", 2024-04-25T22:42:30.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012101694 2024-04-25T22:42:30.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565622+0000", 2024-04-25T22:42:30.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034312976000000002 2024-04-25T22:42:30.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:30.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565769+0000", 2024-04-25T22:42:30.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014715900000000001 2024-04-25T22:42:30.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:30.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565883+0000", 2024-04-25T22:42:30.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000114127 2024-04-25T22:42:30.581 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.581 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.581 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.581 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10701 4.a 4:51b6a63a:::100000030f2.00000000:head [write 0~3014656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:30.582 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:30.582 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.994386781999999, 2024-04-25T22:42:30.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047414393999999999, 2024-04-25T22:42:30.582 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:30.582 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:30.582 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.582 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:30.582 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:30.582 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.582 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10701 2024-04-25T22:42:30.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.582 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:30.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:30.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:30.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:30.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:30.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:30.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525048+0000", 2024-04-25T22:42:30.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0819999999999999e-06 2024-04-25T22:42:30.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:30.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531709+0000", 2024-04-25T22:42:30.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066610929999999999 2024-04-25T22:42:30.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:30.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531751+0000", 2024-04-25T22:42:30.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1650000000000003e-05 2024-04-25T22:42:30.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531788+0000", 2024-04-25T22:42:30.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7305000000000003e-05 2024-04-25T22:42:30.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531943+0000", 2024-04-25T22:42:30.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015500600000000001 2024-04-25T22:42:30.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:30.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532086+0000", 2024-04-25T22:42:30.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014238599999999999 2024-04-25T22:42:30.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:30.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532295+0000", 2024-04-25T22:42:30.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020922000000000001 2024-04-25T22:42:30.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:30.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.545987+0000", 2024-04-25T22:42:30.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013692582999999999 2024-04-25T22:42:30.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572315+0000", 2024-04-25T22:42:30.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026327488 2024-04-25T22:42:30.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:30.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572381+0000", 2024-04-25T22:42:30.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5609000000000002e-05 2024-04-25T22:42:30.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:30.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572460+0000", 2024-04-25T22:42:30.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8972000000000002e-05 2024-04-25T22:42:30.586 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.586 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.586 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.587 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:10700 4.11 e63/57 4:88409fbf:::100000030ec.00000000:head v 63'193, mlcod=62'191)", 2024-04-25T22:42:30.587 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:30.587 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.983557326, 2024-04-25T22:42:30.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050517667000000002, 2024-04-25T22:42:30.587 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:30.587 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:30.587 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.587 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:30.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:30.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:30.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:30.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:30.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:30.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535876+0000", 2024-04-25T22:42:30.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0300000000000001e-06 2024-04-25T22:42:30.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:30.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565275+0000", 2024-04-25T22:42:30.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029399033000000001 2024-04-25T22:42:30.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:30.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565358+0000", 2024-04-25T22:42:30.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3403000000000001e-05 2024-04-25T22:42:30.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565380+0000", 2024-04-25T22:42:30.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1761999999999999e-05 2024-04-25T22:42:30.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565505+0000", 2024-04-25T22:42:30.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000125153 2024-04-25T22:42:30.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:30.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565550+0000", 2024-04-25T22:42:30.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5479000000000003e-05 2024-04-25T22:42:30.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:30.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586328+0000", 2024-04-25T22:42:30.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020777982 2024-04-25T22:42:30.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:30.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586392+0000", 2024-04-25T22:42:30.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3825000000000006e-05 2024-04-25T22:42:30.590 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.590 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.590 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.591 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12632 4.a 4:506aad5d:::1000000310f.00000000:head [write 0~4194304 [2@2043125]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:30.591 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:30.591 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.8845022, 2024-04-25T22:42:30.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051574097999999999, 2024-04-25T22:42:30.591 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:30.591 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:30.591 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.591 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:30.591 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:30.591 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.591 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12632 2024-04-25T22:42:30.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.592 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:30.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:30.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:30.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:30.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:30.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:30.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634932+0000", 2024-04-25T22:42:30.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1600000000000001e-06 2024-04-25T22:42:30.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:30.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642614+0000", 2024-04-25T22:42:30.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076823000000000004 2024-04-25T22:42:30.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:30.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642660+0000", 2024-04-25T22:42:30.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6016000000000001e-05 2024-04-25T22:42:30.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642686+0000", 2024-04-25T22:42:30.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5491999999999999e-05 2024-04-25T22:42:30.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642870+0000", 2024-04-25T22:42:30.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000184045 2024-04-25T22:42:30.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:30.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643122+0000", 2024-04-25T22:42:30.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025242299999999999 2024-04-25T22:42:30.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:30.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643634+0000", 2024-04-25T22:42:30.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051145800000000001 2024-04-25T22:42:30.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:30.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.682287+0000", 2024-04-25T22:42:30.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038653342 2024-04-25T22:42:30.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686419+0000", 2024-04-25T22:42:30.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0041325169999999996 2024-04-25T22:42:30.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:30.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686464+0000", 2024-04-25T22:42:30.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4171000000000001e-05 2024-04-25T22:42:30.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:30.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686504+0000", 2024-04-25T22:42:30.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0173999999999999e-05 2024-04-25T22:42:30.596 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.596 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.596 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.596 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12691 4.39 4:9d0d8843:::100000030ef.00000000:head [write 0~4194304 [3@92787]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:30.596 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:30.596 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.788781111, 2024-04-25T22:42:30.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045521998000000001, 2024-04-25T22:42:30.596 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:30.596 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:30.596 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.596 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:30.596 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:30.596 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.596 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12691 2024-04-25T22:42:30.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.597 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:30.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:30.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:30.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:30.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:30.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:30.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730653+0000", 2024-04-25T22:42:30.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1799999999999999e-06 2024-04-25T22:42:30.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:30.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738136+0000", 2024-04-25T22:42:30.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0074832789999999998 2024-04-25T22:42:30.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:30.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738169+0000", 2024-04-25T22:42:30.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3115999999999999e-05 2024-04-25T22:42:30.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738190+0000", 2024-04-25T22:42:30.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1060000000000002e-05 2024-04-25T22:42:30.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738264+0000", 2024-04-25T22:42:30.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3150000000000003e-05 2024-04-25T22:42:30.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:30.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738333+0000", 2024-04-25T22:42:30.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9314999999999996e-05 2024-04-25T22:42:30.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:30.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738425+0000", 2024-04-25T22:42:30.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2498999999999996e-05 2024-04-25T22:42:30.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:30.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.745181+0000", 2024-04-25T22:42:30.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067553240000000001 2024-04-25T22:42:30.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776101+0000", 2024-04-25T22:42:30.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.030920033 2024-04-25T22:42:30.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:30.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776140+0000", 2024-04-25T22:42:30.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9706999999999998e-05 2024-04-25T22:42:30.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:30.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776173+0000", 2024-04-25T22:42:30.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2335000000000001e-05 2024-04-25T22:42:30.601 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.601 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.601 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.601 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12813 4.18 4:1945bfc2:::10000003578.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:30.601 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:30.601 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.65025763, 2024-04-25T22:42:30.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054261216000000001, 2024-04-25T22:42:30.601 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:30.601 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:30.601 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.601 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:30.602 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:30.602 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.602 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12813 2024-04-25T22:42:30.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.602 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:30.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:30.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:30.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:30.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:30.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:30.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869175+0000", 2024-04-25T22:42:30.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3200000000000005e-07 2024-04-25T22:42:30.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:30.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872980+0000", 2024-04-25T22:42:30.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038049720000000002 2024-04-25T22:42:30.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:30.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872988+0000", 2024-04-25T22:42:30.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5429999999999994e-06 2024-04-25T22:42:30.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872993+0000", 2024-04-25T22:42:30.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8570000000000003e-06 2024-04-25T22:42:30.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873054+0000", 2024-04-25T22:42:30.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0801000000000003e-05 2024-04-25T22:42:30.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:30.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873140+0000", 2024-04-25T22:42:30.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6236999999999994e-05 2024-04-25T22:42:30.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:30.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873271+0000", 2024-04-25T22:42:30.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130541 2024-04-25T22:42:30.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:30.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.884240+0000", 2024-04-25T22:42:30.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010969527 2024-04-25T22:42:30.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923308+0000", 2024-04-25T22:42:30.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039067317999999997 2024-04-25T22:42:30.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:30.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923373+0000", 2024-04-25T22:42:30.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5055000000000006e-05 2024-04-25T22:42:30.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:30.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923436+0000", 2024-04-25T22:42:30.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2732999999999997e-05 2024-04-25T22:42:30.606 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.606 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.606 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.606 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13328 4.16 e65/54 4:6a9ab238:::1000000339b.00000000:head v 65'186, mlcod=65'183)", 2024-04-25T22:42:30.606 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:30.606 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.029797562000001, 2024-04-25T22:42:30.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.046438762000000001, 2024-04-25T22:42:30.607 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:30.607 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:30.607 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.607 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:30.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:30.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:30.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:30.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:30.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:30.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489637+0000", 2024-04-25T22:42:30.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.357e-06 2024-04-25T22:42:30.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:30.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496055+0000", 2024-04-25T22:42:30.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0064181380000000003 2024-04-25T22:42:30.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:30.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496074+0000", 2024-04-25T22:42:30.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8904000000000001e-05 2024-04-25T22:42:30.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496085+0000", 2024-04-25T22:42:30.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1245e-05 2024-04-25T22:42:30.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496169+0000", 2024-04-25T22:42:30.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3974000000000006e-05 2024-04-25T22:42:30.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:30.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496203+0000", 2024-04-25T22:42:30.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3679000000000001e-05 2024-04-25T22:42:30.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:30.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536002+0000", 2024-04-25T22:42:30.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039799569 2024-04-25T22:42:30.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:30.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536073+0000", 2024-04-25T22:42:30.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0895999999999993e-05 2024-04-25T22:42:30.610 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.610 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.610 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.610 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13338 4.e 4:737b94c2:::1000000338a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:30.610 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:30.610 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.023657047, 2024-04-25T22:42:30.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047911849999999999, 2024-04-25T22:42:30.610 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:30.610 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:30.611 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.611 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:30.611 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:30.611 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.611 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13338 2024-04-25T22:42:30.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.611 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:30.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:30.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:30.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:30.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:30.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:30.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495776+0000", 2024-04-25T22:42:30.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2399999999999996e-07 2024-04-25T22:42:30.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:30.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503748+0000", 2024-04-25T22:42:30.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079725479999999994 2024-04-25T22:42:30.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:30.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503940+0000", 2024-04-25T22:42:30.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000191249 2024-04-25T22:42:30.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504061+0000", 2024-04-25T22:42:30.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120982 2024-04-25T22:42:30.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515564+0000", 2024-04-25T22:42:30.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011503342999999999 2024-04-25T22:42:30.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:30.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515799+0000", 2024-04-25T22:42:30.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000235138 2024-04-25T22:42:30.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:30.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543419+0000", 2024-04-25T22:42:30.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027620167000000001 2024-04-25T22:42:30.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:30.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543522+0000", 2024-04-25T22:42:30.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010254100000000001 2024-04-25T22:42:30.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:30.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543687+0000", 2024-04-25T22:42:30.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016495799999999999 2024-04-25T22:42:30.615 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.615 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.615 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.615 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13329 4.26 e65/57 4:64e005a2:::10000003483.00000000:head v 65'226, mlcod=64'224)", 2024-04-25T22:42:30.615 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:30.615 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.023054366, 2024-04-25T22:42:30.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048871456000000001, 2024-04-25T22:42:30.615 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:30.615 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:30.615 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.615 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:30.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:30.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:30.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:30.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:30.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:30.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496379+0000", 2024-04-25T22:42:30.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1480000000000001e-06 2024-04-25T22:42:30.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:30.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504870+0000", 2024-04-25T22:42:30.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0084917880000000001 2024-04-25T22:42:30.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:30.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504888+0000", 2024-04-25T22:42:30.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7365999999999999e-05 2024-04-25T22:42:30.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504899+0000", 2024-04-25T22:42:30.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1516e-05 2024-04-25T22:42:30.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515953+0000", 2024-04-25T22:42:30.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011054074000000001 2024-04-25T22:42:30.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:30.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515993+0000", 2024-04-25T22:42:30.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9854999999999997e-05 2024-04-25T22:42:30.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:30.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545191+0000", 2024-04-25T22:42:30.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029197323000000001 2024-04-25T22:42:30.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:30.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545249+0000", 2024-04-25T22:42:30.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8386e-05 2024-04-25T22:42:30.618 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.618 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.619 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.619 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13713 4.2b 4:d574dbff:::100000031d0.00000001:head [write 0~4194304 [2@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:30.619 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:30.619 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.610868247999999, 2024-04-25T22:42:30.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047324328999999998, 2024-04-25T22:42:30.619 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:30.619 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:30.619 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:30.619 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:30.619 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:30.619 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:30.619 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13713 2024-04-25T22:42:30.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.619 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:30.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:30.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:30.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:30.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:30.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:30.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:30.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908565+0000", 2024-04-25T22:42:30.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.694e-06 2024-04-25T22:42:30.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:30.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916170+0000", 2024-04-25T22:42:30.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076041720000000002 2024-04-25T22:42:30.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:30.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916200+0000", 2024-04-25T22:42:30.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0463999999999998e-05 2024-04-25T22:42:30.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916209+0000", 2024-04-25T22:42:30.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3079999999999997e-06 2024-04-25T22:42:30.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:30.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916297+0000", 2024-04-25T22:42:30.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8159999999999996e-05 2024-04-25T22:42:30.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:30.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916554+0000", 2024-04-25T22:42:30.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025661800000000002 2024-04-25T22:42:30.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:30.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916794+0000", 2024-04-25T22:42:30.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024013999999999999 2024-04-25T22:42:30.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:30.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.933120+0000", 2024-04-25T22:42:30.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016325559 2024-04-25T22:42:30.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955612+0000", 2024-04-25T22:42:30.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022491786 2024-04-25T22:42:30.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:30.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955797+0000", 2024-04-25T22:42:30.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018533699999999999 2024-04-25T22:42:30.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:30.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:30.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:30.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955888+0000", 2024-04-25T22:42:30.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1090999999999999e-05 2024-04-25T22:42:30.624 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.624 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.624 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.624 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:30.624 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:30.624 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:30.625 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:30.625 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:30.619+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:30.696 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:42:30.726 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:30.723+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:30.769 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:30.769 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:30.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.769 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:13917 4.30 e69/17 4:0c48387b:::1000000058a.00000000:head v 69'328, mlcod=69'326)", 2024-04-25T22:42:30.769 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.766607+0000", 2024-04-25T22:42:30.769 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.00093305999999999999, 2024-04-25T22:42:30.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00095536299999999998, 2024-04-25T22:42:30.769 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.769 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.769 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:30.769 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.770 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766607+0000", 2024-04-25T22:42:30.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.770 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766607+0000", 2024-04-25T22:42:30.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.770 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.770 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766608+0000", 2024-04-25T22:42:30.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4000000000000001e-07 2024-04-25T22:42:30.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.770 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766613+0000", 2024-04-25T22:42:30.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9349999999999999e-06 2024-04-25T22:42:30.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766626+0000", 2024-04-25T22:42:30.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2738999999999999e-05 2024-04-25T22:42:30.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766639+0000", 2024-04-25T22:42:30.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2994e-05 2024-04-25T22:42:30.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766802+0000", 2024-04-25T22:42:30.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016314699999999999 2024-04-25T22:42:30.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766846+0000", 2024-04-25T22:42:30.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.3736000000000003e-05 2024-04-25T22:42:30.772 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.772 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.772 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.772 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:13921 4.2b e69/17)", 2024-04-25T22:42:30.772 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.766674+0000", 2024-04-25T22:42:30.772 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.00086624599999999999, 2024-04-25T22:42:30.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00094667700000000004, 2024-04-25T22:42:30.773 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.773 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.773 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "queued for pg", 2024-04-25T22:42:30.773 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766674+0000", 2024-04-25T22:42:30.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766674+0000", 2024-04-25T22:42:30.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766674+0000", 2024-04-25T22:42:30.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.23e-07 2024-04-25T22:42:30.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766680+0000", 2024-04-25T22:42:30.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9070000000000004e-06 2024-04-25T22:42:30.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766694+0000", 2024-04-25T22:42:30.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3764999999999999e-05 2024-04-25T22:42:30.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.775 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766704+0000", 2024-04-25T22:42:30.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.029e-05 2024-04-25T22:42:30.775 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.775 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.775 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.775 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.775 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.775 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:13901 4.b 4:d2ebf73f:::1000000057a.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-25T22:42:30.775 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.758165+0000", 2024-04-25T22:42:30.775 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0093752109999999996, 2024-04-25T22:42:30.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0095096950000000003, 2024-04-25T22:42:30.775 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.775 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.775 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:42:30.776 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.758165+0000", 2024-04-25T22:42:30.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.758165+0000", 2024-04-25T22:42:30.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.776 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.776 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.758166+0000", 2024-04-25T22:42:30.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2100000000000001e-06 2024-04-25T22:42:30.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.758172+0000", 2024-04-25T22:42:30.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7459999999999997e-06 2024-04-25T22:42:30.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.758193+0000", 2024-04-25T22:42:30.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1177000000000001e-05 2024-04-25T22:42:30.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.758209+0000", 2024-04-25T22:42:30.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6443000000000002e-05 2024-04-25T22:42:30.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.778 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.758273+0000", 2024-04-25T22:42:30.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3548999999999998e-05 2024-04-25T22:42:30.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.778 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.758401+0000", 2024-04-25T22:42:30.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000127639 2024-04-25T22:42:30.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:30.778 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.758512+0000", 2024-04-25T22:42:30.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000111582 2024-04-25T22:42:30.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:30.779 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.764345+0000", 2024-04-25T22:42:30.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0058331549999999996 2024-04-25T22:42:30.779 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.779 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.779 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.779 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767679+0000", 2024-04-25T22:42:30.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0033333239999999999 2024-04-25T22:42:30.779 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.779 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.779 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.779 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.779 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.779 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:13918 4.38 e69/17 4:1f58a783:::1000000058b.00000000:head v 69'332, mlcod=69'330)", 2024-04-25T22:42:30.779 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.766725+0000", 2024-04-25T22:42:30.779 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.00081447099999999999, 2024-04-25T22:42:30.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010250929999999999, 2024-04-25T22:42:30.780 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.780 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.780 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:30.780 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.780 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.780 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766725+0000", 2024-04-25T22:42:30.780 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.780 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.780 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766725+0000", 2024-04-25T22:42:30.780 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.780 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.780 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766726+0000", 2024-04-25T22:42:30.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2600000000000002e-07 2024-04-25T22:42:30.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766741+0000", 2024-04-25T22:42:30.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4741e-05 2024-04-25T22:42:30.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766756+0000", 2024-04-25T22:42:30.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5536000000000002e-05 2024-04-25T22:42:30.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766766+0000", 2024-04-25T22:42:30.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7559999999999994e-06 2024-04-25T22:42:30.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767577+0000", 2024-04-25T22:42:30.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00081137199999999998 2024-04-25T22:42:30.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767625+0000", 2024-04-25T22:42:30.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.7973000000000003e-05 2024-04-25T22:42:30.782 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.782 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.782 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.783 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:13925 4.a e69/17 4:50fb5d6a:::10000000592.00000000:head v 69'382, mlcod=69'379)", 2024-04-25T22:42:30.783 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.766782+0000", 2024-04-25T22:42:30.783 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.00075829000000000001, 2024-04-25T22:42:30.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010325930000000001, 2024-04-25T22:42:30.783 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.783 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.783 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:30.783 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766782+0000", 2024-04-25T22:42:30.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766782+0000", 2024-04-25T22:42:30.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.784 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766782+0000", 2024-04-25T22:42:30.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1600000000000001e-07 2024-04-25T22:42:30.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.784 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766788+0000", 2024-04-25T22:42:30.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.6459999999999998e-06 2024-04-25T22:42:30.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.784 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766815+0000", 2024-04-25T22:42:30.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.6707999999999999e-05 2024-04-25T22:42:30.785 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.785 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.785 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766824+0000", 2024-04-25T22:42:30.785 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.302e-06 2024-04-25T22:42:30.785 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.785 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.785 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767338+0000", 2024-04-25T22:42:30.785 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00051448200000000003 2024-04-25T22:42:30.785 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.785 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.785 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767379+0000", 2024-04-25T22:42:30.785 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0342000000000001e-05 2024-04-25T22:42:30.786 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.786 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.786 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.786 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:13926 4.c e69/17 4:3299dce4:::10000000593.00000000:head v 69'368, mlcod=69'366)", 2024-04-25T22:42:30.786 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.766839+0000", 2024-04-25T22:42:30.786 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.00070058100000000003, 2024-04-25T22:42:30.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010365070000000001, 2024-04-25T22:42:30.786 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.786 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.786 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:30.786 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766839+0000", 2024-04-25T22:42:30.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766839+0000", 2024-04-25T22:42:30.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766840+0000", 2024-04-25T22:42:30.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4799999999999999e-07 2024-04-25T22:42:30.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.787 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.787 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766845+0000", 2024-04-25T22:42:30.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4399999999999996e-06 2024-04-25T22:42:30.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766858+0000", 2024-04-25T22:42:30.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2977e-05 2024-04-25T22:42:30.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766869+0000", 2024-04-25T22:42:30.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0892e-05 2024-04-25T22:42:30.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766919+0000", 2024-04-25T22:42:30.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0296000000000001e-05 2024-04-25T22:42:30.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.789 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766938+0000", 2024-04-25T22:42:30.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8518000000000001e-05 2024-04-25T22:42:30.789 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.789 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.789 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.789 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:13903 4.0 4:01fe1433:::1000000057c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-25T22:42:30.789 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.758549+0000", 2024-04-25T22:42:30.789 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0089907900000000002, 2024-04-25T22:42:30.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0093920930000000007, 2024-04-25T22:42:30.789 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.789 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.789 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:42:30.790 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.790 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.790 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.758549+0000", 2024-04-25T22:42:30.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.790 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.790 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.790 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.758549+0000", 2024-04-25T22:42:30.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.790 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.790 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.790 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.758551+0000", 2024-04-25T22:42:30.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.846e-06 2024-04-25T22:42:30.790 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.791 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.791 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.791 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.758559+0000", 2024-04-25T22:42:30.791 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0600000000000008e-06 2024-04-25T22:42:30.791 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.791 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.791 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.791 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.758586+0000", 2024-04-25T22:42:30.791 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7042999999999998e-05 2024-04-25T22:42:30.791 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.791 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.791 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.791 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.758606+0000", 2024-04-25T22:42:30.791 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9769999999999999e-05 2024-04-25T22:42:30.791 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.791 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.791 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.759881+0000", 2024-04-25T22:42:30.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001275008 2024-04-25T22:42:30.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.760201+0000", 2024-04-25T22:42:30.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032020200000000001 2024-04-25T22:42:30.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:30.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.760470+0000", 2024-04-25T22:42:30.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000269232 2024-04-25T22:42:30.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.762370+0000", 2024-04-25T22:42:30.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0018994249999999999 2024-04-25T22:42:30.793 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.793 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.793 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.793 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.793 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.793 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:13932 4.10 4.a8f7810 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-25T22:42:30.793 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.766957+0000", 2024-04-25T22:42:30.793 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.00058304199999999998, 2024-04-25T22:42:30.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001050437, 2024-04-25T22:42:30.793 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.793 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.793 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "queued for pg", 2024-04-25T22:42:30.793 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.793 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.793 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.794 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766957+0000", 2024-04-25T22:42:30.794 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.794 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.794 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.794 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.794 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766957+0000", 2024-04-25T22:42:30.794 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.794 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.794 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.794 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.794 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766958+0000", 2024-04-25T22:42:30.794 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3519999999999999e-06 2024-04-25T22:42:30.794 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.794 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.794 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.794 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766964+0000", 2024-04-25T22:42:30.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9900000000000002e-06 2024-04-25T22:42:30.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.795 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.795 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766985+0000", 2024-04-25T22:42:30.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1044999999999999e-05 2024-04-25T22:42:30.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.795 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.795 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766998+0000", 2024-04-25T22:42:30.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2964e-05 2024-04-25T22:42:30.795 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.795 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.795 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.796 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.796 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:13933 3.1e 3:7fc53a09:::1000000059a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-25T22:42:30.796 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.767018+0000", 2024-04-25T22:42:30.796 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.00052233100000000001, 2024-04-25T22:42:30.796 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010373439999999999, 2024-04-25T22:42:30.796 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.796 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.796 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:30.796 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.796 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.796 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.796 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767018+0000", 2024-04-25T22:42:30.796 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.796 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.796 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.796 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767018+0000", 2024-04-25T22:42:30.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.797 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767019+0000", 2024-04-25T22:42:30.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7300000000000004e-07 2024-04-25T22:42:30.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.797 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767023+0000", 2024-04-25T22:42:30.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0350000000000003e-06 2024-04-25T22:42:30.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.797 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767038+0000", 2024-04-25T22:42:30.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5122e-05 2024-04-25T22:42:30.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767049+0000", 2024-04-25T22:42:30.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1644999999999999e-05 2024-04-25T22:42:30.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767290+0000", 2024-04-25T22:42:30.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00024022 2024-04-25T22:42:30.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767433+0000", 2024-04-25T22:42:30.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014342700000000001 2024-04-25T22:42:30.799 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.799 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.799 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.799 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.799 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.799 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:13936 4.3e 4:7deeda02:::1000000059d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-25T22:42:30.799 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.767082+0000", 2024-04-25T22:42:30.799 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.000458364, 2024-04-25T22:42:30.799 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010343609999999999, 2024-04-25T22:42:30.799 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.799 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.799 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:30.799 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.799 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.799 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.799 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767082+0000", 2024-04-25T22:42:30.799 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767082+0000", 2024-04-25T22:42:30.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767083+0000", 2024-04-25T22:42:30.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.139e-06 2024-04-25T22:42:30.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767088+0000", 2024-04-25T22:42:30.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1490000000000002e-06 2024-04-25T22:42:30.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.801 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.801 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767104+0000", 2024-04-25T22:42:30.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5858999999999998e-05 2024-04-25T22:42:30.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.801 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.801 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767116+0000", 2024-04-25T22:42:30.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1992e-05 2024-04-25T22:42:30.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.801 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.801 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767445+0000", 2024-04-25T22:42:30.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032936700000000001 2024-04-25T22:42:30.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.802 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.802 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767739+0000", 2024-04-25T22:42:30.802 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029346199999999998 2024-04-25T22:42:30.802 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.802 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.802 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.802 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.802 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.802 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:13937 4.26 4:6478fd6e:::1000000059e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-25T22:42:30.802 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.768026+0000", 2024-04-25T22:42:30.802 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4294967295.9995141, 2024-04-25T22:42:30.802 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000154974, 2024-04-25T22:42:30.802 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.802 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.803 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "reached pg", 2024-04-25T22:42:30.803 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.803 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.768026+0000", 2024-04-25T22:42:30.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.803 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.803 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.768026+0000", 2024-04-25T22:42:30.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.803 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.803 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.768027+0000", 2024-04-25T22:42:30.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6080000000000001e-06 2024-04-25T22:42:30.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.804 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.804 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.768036+0000", 2024-04-25T22:42:30.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5860000000000005e-06 2024-04-25T22:42:30.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.804 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.804 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.768058+0000", 2024-04-25T22:42:30.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1948999999999999e-05 2024-04-25T22:42:30.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.804 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.804 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.768075+0000", 2024-04-25T22:42:30.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7056999999999999e-05 2024-04-25T22:42:30.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.805 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.768139+0000", 2024-04-25T22:42:30.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4270000000000006e-05 2024-04-25T22:42:30.805 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.805 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.805 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.805 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:13939 4.26 4.4aa14566 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-25T22:42:30.805 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.768112+0000", 2024-04-25T22:42:30.805 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4294967295.9994283, 2024-04-25T22:42:30.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012495400000000001, 2024-04-25T22:42:30.806 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.806 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.806 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "queued for pg", 2024-04-25T22:42:30.806 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.806 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.806 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.768112+0000", 2024-04-25T22:42:30.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.806 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.806 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.768112+0000", 2024-04-25T22:42:30.807 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.807 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.807 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.807 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.768113+0000", 2024-04-25T22:42:30.807 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.173e-06 2024-04-25T22:42:30.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.807 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.807 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.807 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.768118+0000", 2024-04-25T22:42:30.807 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.1390000000000003e-06 2024-04-25T22:42:30.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.807 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.807 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.807 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.768133+0000", 2024-04-25T22:42:30.807 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5063e-05 2024-04-25T22:42:30.808 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.808 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.808 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.808 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.768144+0000", 2024-04-25T22:42:30.808 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1507e-05 2024-04-25T22:42:30.808 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.808 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.808 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.808 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.808 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.808 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:13940 4.1c 4.b1c02adc (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-25T22:42:30.808 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.768162+0000", 2024-04-25T22:42:30.808 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 4294967295.9993782, 2024-04-25T22:42:30.808 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012725, 2024-04-25T22:42:30.809 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.809 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.809 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "queued for pg", 2024-04-25T22:42:30.809 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.809 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.809 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.768162+0000", 2024-04-25T22:42:30.809 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.809 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.809 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.809 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.768162+0000", 2024-04-25T22:42:30.809 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.809 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.810 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.810 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.768163+0000", 2024-04-25T22:42:30.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9000000000000005e-07 2024-04-25T22:42:30.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.810 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.810 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.768167+0000", 2024-04-25T22:42:30.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.0849999999999999e-06 2024-04-25T22:42:30.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.810 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.810 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.768181+0000", 2024-04-25T22:42:30.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3879e-05 2024-04-25T22:42:30.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.811 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.811 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.768192+0000", 2024-04-25T22:42:30.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1285e-05 2024-04-25T22:42:30.811 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.811 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.811 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.811 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.811 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:13914 4.26 4:6460b86e:::10000000587.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-25T22:42:30.811 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.762731+0000", 2024-04-25T22:42:30.811 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0048093659999999998, 2024-04-25T22:42:30.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0056107290000000001, 2024-04-25T22:42:30.811 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.811 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.812 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:42:30.812 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.762731+0000", 2024-04-25T22:42:30.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.762731+0000", 2024-04-25T22:42:30.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.762733+0000", 2024-04-25T22:42:30.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.4169999999999999e-06 2024-04-25T22:42:30.813 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.813 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.813 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.813 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.762744+0000", 2024-04-25T22:42:30.813 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.082e-05 2024-04-25T22:42:30.813 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.813 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.813 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.813 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.762773+0000", 2024-04-25T22:42:30.813 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8799999999999999e-05 2024-04-25T22:42:30.813 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.813 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.813 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.813 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.762794+0000", 2024-04-25T22:42:30.813 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1009000000000002e-05 2024-04-25T22:42:30.814 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.814 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.814 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.814 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.763050+0000", 2024-04-25T22:42:30.814 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025635000000000002 2024-04-25T22:42:30.814 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.814 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.814 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.814 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.763166+0000", 2024-04-25T22:42:30.814 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000116004 2024-04-25T22:42:30.814 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.814 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.814 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:30.814 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.763265+0000", 2024-04-25T22:42:30.815 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8717999999999999e-05 2024-04-25T22:42:30.815 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.815 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.815 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.815 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766314+0000", 2024-04-25T22:42:30.815 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.003049033 2024-04-25T22:42:30.815 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.815 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.815 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.815 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.815 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.815 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:13920 4.33 4:ce493e16:::1000000058d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-25T22:42:30.815 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.762898+0000", 2024-04-25T22:42:30.815 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0046420649999999999, 2024-04-25T22:42:30.815 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0055202660000000002, 2024-04-25T22:42:30.815 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.816 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.816 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:30.816 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.816 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.816 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.762898+0000", 2024-04-25T22:42:30.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.816 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.816 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.762898+0000", 2024-04-25T22:42:30.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.816 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.817 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.762899+0000", 2024-04-25T22:42:30.817 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.477e-06 2024-04-25T22:42:30.817 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.817 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.817 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.817 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.762905+0000", 2024-04-25T22:42:30.817 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8629999999999996e-06 2024-04-25T22:42:30.817 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.817 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.817 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.817 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.762923+0000", 2024-04-25T22:42:30.817 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8006999999999999e-05 2024-04-25T22:42:30.817 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.817 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.817 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.817 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.762938+0000", 2024-04-25T22:42:30.818 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5233e-05 2024-04-25T22:42:30.818 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.818 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.818 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.818 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.763759+0000", 2024-04-25T22:42:30.818 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00082034499999999999 2024-04-25T22:42:30.818 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.818 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.818 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.818 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.763883+0000", 2024-04-25T22:42:30.818 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012405700000000001 2024-04-25T22:42:30.818 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.818 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.818 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:13923 4.29 4:96dd4079:::10000000590.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-25T22:42:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.763768+0000", 2024-04-25T22:42:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0037717229999999998, 2024-04-25T22:42:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0047077990000000004, 2024-04-25T22:42:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "waiting for sub ops", 2024-04-25T22:42:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.763768+0000", 2024-04-25T22:42:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.819 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.763768+0000", 2024-04-25T22:42:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.763770+0000", 2024-04-25T22:42:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7150000000000001e-06 2024-04-25T22:42:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.763778+0000", 2024-04-25T22:42:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.3969999999999994e-06 2024-04-25T22:42:30.820 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.763801+0000", 2024-04-25T22:42:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2257999999999999e-05 2024-04-25T22:42:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.763817+0000", 2024-04-25T22:42:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:42:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.763958+0000", 2024-04-25T22:42:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014092299999999999 2024-04-25T22:42:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.764285+0000", 2024-04-25T22:42:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00032697299999999999 2024-04-25T22:42:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.764555+0000", 2024-04-25T22:42:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027014900000000002 2024-04-25T22:42:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.767285+0000", 2024-04-25T22:42:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0027297319999999999 2024-04-25T22:42:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.822 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:13924 4.33 4:cc2577c0:::10000000591.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-25T22:42:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.764250+0000", 2024-04-25T22:42:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.003290397, 2024-04-25T22:42:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0042984520000000003, 2024-04-25T22:42:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.764250+0000", 2024-04-25T22:42:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.764250+0000", 2024-04-25T22:42:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.764251+0000", 2024-04-25T22:42:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.342e-06 2024-04-25T22:42:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.764258+0000", 2024-04-25T22:42:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7970000000000003e-06 2024-04-25T22:42:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.764275+0000", 2024-04-25T22:42:30.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7711999999999999e-05 2024-04-25T22:42:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.764289+0000", 2024-04-25T22:42:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3716999999999999e-05 2024-04-25T22:42:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.764474+0000", 2024-04-25T22:42:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000184771 2024-04-25T22:42:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.764786+0000", 2024-04-25T22:42:30.825 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000311825 2024-04-25T22:42:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:13928 4.33 4:cf777813:::10000000595.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-25T22:42:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.764310+0000", 2024-04-25T22:42:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.003230129, 2024-04-25T22:42:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0042941940000000003, 2024-04-25T22:42:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.826 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.764310+0000", 2024-04-25T22:42:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.764310+0000", 2024-04-25T22:42:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.764311+0000", 2024-04-25T22:42:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.051e-06 2024-04-25T22:42:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.764316+0000", 2024-04-25T22:42:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8289999999999998e-06 2024-04-25T22:42:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.764331+0000", 2024-04-25T22:42:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5088e-05 2024-04-25T22:42:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.764343+0000", 2024-04-25T22:42:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.172e-05 2024-04-25T22:42:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.765688+0000", 2024-04-25T22:42:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0013452340000000001 2024-04-25T22:42:30.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.765836+0000", 2024-04-25T22:42:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000148651 2024-04-25T22:42:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:13931 4.3e 4:7d5ac2fe:::10000000598.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-25T22:42:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.765214+0000", 2024-04-25T22:42:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0023256090000000002, 2024-04-25T22:42:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0034515470000000001, 2024-04-25T22:42:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.829 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.765214+0000", 2024-04-25T22:42:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.765214+0000", 2024-04-25T22:42:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.765215+0000", 2024-04-25T22:42:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0189999999999999e-06 2024-04-25T22:42:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.765220+0000", 2024-04-25T22:42:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6349999999999997e-06 2024-04-25T22:42:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.765231+0000", 2024-04-25T22:42:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1088e-05 2024-04-25T22:42:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.765238+0000", 2024-04-25T22:42:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3599999999999998e-06 2024-04-25T22:42:30.831 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766292+0000", 2024-04-25T22:42:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001053822 2024-04-25T22:42:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766409+0000", 2024-04-25T22:42:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000116731 2024-04-25T22:42:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:13916 4.35 e69/17 4:ada89ac8:::10000000589.00000000:head v 69'299, mlcod=69'297)", 2024-04-25T22:42:30.832 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.766415+0000", 2024-04-25T22:42:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.00112498, 2024-04-25T22:42:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0023120760000000001, 2024-04-25T22:42:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766415+0000", 2024-04-25T22:42:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766415+0000", 2024-04-25T22:42:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766416+0000", 2024-04-25T22:42:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.9100000000000003e-07 2024-04-25T22:42:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766424+0000", 2024-04-25T22:42:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7440000000000007e-06 2024-04-25T22:42:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766439+0000", 2024-04-25T22:42:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5017999999999999e-05 2024-04-25T22:42:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766450+0000", 2024-04-25T22:42:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1117e-05 2024-04-25T22:42:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766556+0000", 2024-04-25T22:42:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000106838 2024-04-25T22:42:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766603+0000", 2024-04-25T22:42:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6122999999999999e-05 2024-04-25T22:42:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.835 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:13912 4.1a e69/17 4:588e7c75:::10000000585.00000000:head v 69'328, mlcod=69'325)", 2024-04-25T22:42:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.766478+0000", 2024-04-25T22:42:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.001061813, 2024-04-25T22:42:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0023082760000000002, 2024-04-25T22:42:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766478+0000", 2024-04-25T22:42:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766478+0000", 2024-04-25T22:42:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766479+0000", 2024-04-25T22:42:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9699999999999996e-07 2024-04-25T22:42:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766486+0000", 2024-04-25T22:42:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.413e-06 2024-04-25T22:42:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.837 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766501+0000", 2024-04-25T22:42:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4562000000000001e-05 2024-04-25T22:42:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766511+0000", 2024-04-25T22:42:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0244999999999999e-05 2024-04-25T22:42:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766595+0000", 2024-04-25T22:42:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4463999999999996e-05 2024-04-25T22:42:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766638+0000", 2024-04-25T22:42:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.2511e-05 2024-04-25T22:42:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:13915 4.20 e69/17 4:042027bb:::10000000588.00000000:head v 69'345, mlcod=69'343)", 2024-04-25T22:42:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:30.766542+0000", 2024-04-25T22:42:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.00099810799999999994, 2024-04-25T22:42:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0023055689999999999, 2024-04-25T22:42:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:30.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766542+0000", 2024-04-25T22:42:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766542+0000", 2024-04-25T22:42:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766543+0000", 2024-04-25T22:42:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7999999999999995e-07 2024-04-25T22:42:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:30.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766556+0000", 2024-04-25T22:42:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3784000000000001e-05 2024-04-25T22:42:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766572+0000", 2024-04-25T22:42:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766582+0000", 2024-04-25T22:42:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.6819999999999998e-06 2024-04-25T22:42:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766696+0000", 2024-04-25T22:42:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000114391 2024-04-25T22:42:30.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:30.766745+0000", 2024-04-25T22:42:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.9523e-05 2024-04-25T22:42:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-25T22:42:30.842 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 22 2024-04-25T22:42:30.842 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:30.843 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:30.844 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:30.844 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:30.844 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:30.845 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:30.839+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:30.860 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:30.861 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:30.864 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:30.864 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:30.944 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:30.939+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:31.006 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:31.006 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:31.021 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:31.044 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:31.039+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:31.145 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:31.143+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:31.147 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:31.147 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:31.161 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:31.245 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:31.243+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:31.297 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:31.297 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:31.312 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:31.353 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:31.351+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:31.396 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is unset 2024-04-25T22:42:31.447 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:31.447+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:31.482 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:31.482 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:31.496 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:31.547 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:31.543+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:31.621 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:31.621 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:31.636 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:31.682 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:31.683+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:31.748 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:31.747+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:31.773 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:31.773 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:31.792 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:31.878 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:31.879+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:31.950 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:31.947+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:31.962 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:31.962 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:31.977 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:32.066 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:32.067+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:32.147 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:32.147 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:32.151 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:32.147+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:32.162 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:32.252 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:32.247+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:32.298 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:32.298 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:32.314 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:32.361 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:32.359+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:32.453 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:32.451+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:32.485 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:32.485 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:32.500 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:32.586 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:32.583+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:32.655 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:32.651+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:32.671 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:32.671 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:32.686 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:32.756 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:32.751+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:32.842 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:32.843 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:32.857 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:32.851+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:32.864 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:32.864 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:42:32.958 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:32.955+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:33.000 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:33.000 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:33.009 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:33.010 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:33.010 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:33.015 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:33.027 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:33.027 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:33.030 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:33.031 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:33.059 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:33.055+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:33.143 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:33.143 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:33.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:33.144 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:33.144 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.144 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:33.144 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:33.144 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 138.54472198299999, 2024-04-25T22:42:33.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:33.144 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.144 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.144 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.144 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.144 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.144 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.144 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:33.144 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.145 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:33.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.145 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:33.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:33.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.145 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.145 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.145 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:33.145 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:33.145 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.146 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.146 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.146 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:33.146 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:33.146 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.146 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.146 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.146 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:33.146 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:33.146 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.146 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.146 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.146 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:33.146 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:33.147 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.147 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.147 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:33.147 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:33.147 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:33.147 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.147 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.147 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.147 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:33.147 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:33.147 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.147 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.147 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:33.147 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:33.147 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:33.147 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:33.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:33.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:33.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:33.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:33.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:33.148 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.148 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.148 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.148 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:33.148 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:33.149 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.149 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:33.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:33.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:33.149 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.149 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:33.149 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:33.149 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:33.149 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.149 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.149 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.149 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.149 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.149 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:33.150 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:33.150 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 138.544584727, 2024-04-25T22:42:33.150 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:33.150 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.150 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.150 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.150 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.150 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.150 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.150 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:33.150 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.150 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.150 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.150 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.150 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:33.151 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.151 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.151 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:33.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:33.154 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:33.154 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:33.154 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.154 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.154 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.154 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:33.155 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:33.155 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.155 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.155 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.155 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:33.155 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:33.155 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.155 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.155 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.155 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:33.155 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:33.155 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.155 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.155 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:33.155 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:33.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:33.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.156 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:33.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:33.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:33.156 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:33.156 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:33.156 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.156 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.156 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:33.156 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:33.157 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:33.157 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.157 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.157 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:33.157 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:33.157 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:33.157 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.157 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.157 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.157 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:33.157 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:33.157 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.157 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.157 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:33.157 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:33.157 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:33.157 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.158 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.158 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:33.158 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:33.158 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:33.158 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.158 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.158 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.158 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.158 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.158 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:33.158 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:33.158 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 138.54432455899999, 2024-04-25T22:42:33.158 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:33.158 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.158 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.158 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.159 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:33.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.159 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:33.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.159 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.159 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.159 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.159 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:33.159 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:33.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.160 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.160 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:33.160 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:33.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.160 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.160 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:33.160 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:33.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.160 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.160 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:33.160 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:33.160 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.160 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:33.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:33.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:33.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:33.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:33.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.161 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:33.161 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:33.161 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.161 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.161 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:33.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:33.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:33.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:33.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:33.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:33.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:33.162 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:33.162 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:33.162 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.162 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.162 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.163 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:33.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:33.163 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.163 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:33.163 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:33.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:33.163 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.163 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.163 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:33.163 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:33.163 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:33.163 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.163 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.163 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.163 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.164 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:33.164 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:33.164 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 138.54415936000001, 2024-04-25T22:42:33.164 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:33.164 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.164 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.164 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:33.164 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.164 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.164 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:33.164 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.164 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.164 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.164 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:33.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:33.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:33.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:33.165 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:33.165 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.165 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.165 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.165 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:33.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:33.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:33.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:33.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:33.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:33.166 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.166 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.166 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:33.166 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:33.166 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:33.167 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.167 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.167 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:33.167 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:33.167 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.167 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:33.167 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:33.167 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:33.167 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.167 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.167 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:33.167 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:33.167 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:33.168 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.168 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.168 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.168 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.168 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.168 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:33.168 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:33.168 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 138.54409369800001, 2024-04-25T22:42:33.168 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:33.168 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.168 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.168 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:33.168 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.168 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.168 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.168 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:33.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:33.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:33.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:33.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.169 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.169 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.169 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:33.169 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:33.169 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:33.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:33.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:33.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:33.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.170 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.170 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.170 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:33.170 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:33.170 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:33.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:33.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:33.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:33.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:33.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:33.171 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:33.171 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:33.171 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.171 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.171 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:33.172 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:33.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:33.172 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.172 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.172 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.172 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.172 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.172 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10700 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:33.172 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:33.172 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.621226481000001, 2024-04-25T22:42:33.172 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066789482999999997, 2024-04-25T22:42:33.172 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.172 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.172 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.172 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:33.172 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:33.173 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.173 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10700 2024-04-25T22:42:33.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.173 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:33.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.173 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:33.173 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.173 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.173 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.173 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519112+0000", 2024-04-25T22:42:33.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1399999999999998e-06 2024-04-25T22:42:33.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527187+0000", 2024-04-25T22:42:33.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080748899999999995 2024-04-25T22:42:33.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527232+0000", 2024-04-25T22:42:33.174 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4895999999999998e-05 2024-04-25T22:42:33.174 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.174 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.174 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.174 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527259+0000", 2024-04-25T22:42:33.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7331999999999999e-05 2024-04-25T22:42:33.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529418+0000", 2024-04-25T22:42:33.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002158765 2024-04-25T22:42:33.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:33.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529572+0000", 2024-04-25T22:42:33.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015438499999999999 2024-04-25T22:42:33.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.175 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:33.175 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529762+0000", 2024-04-25T22:42:33.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018998100000000001 2024-04-25T22:42:33.175 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:33.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.548359+0000", 2024-04-25T22:42:33.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018596444 2024-04-25T22:42:33.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585801+0000", 2024-04-25T22:42:33.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.037442469999999999 2024-04-25T22:42:33.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:33.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585847+0000", 2024-04-25T22:42:33.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5565000000000002e-05 2024-04-25T22:42:33.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:33.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585899+0000", 2024-04-25T22:42:33.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2614999999999997e-05 2024-04-25T22:42:33.177 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.177 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.177 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.177 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10714 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:33.177 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:33.177 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.587545517999999, 2024-04-25T22:42:33.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.048080623000000003, 2024-04-25T22:42:33.177 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.177 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.177 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.177 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:33.178 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:33.178 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.178 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10714 2024-04-25T22:42:33.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.178 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:33.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:33.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552792+0000", 2024-04-25T22:42:33.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:42:33.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559915+0000", 2024-04-25T22:42:33.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071231690000000004 2024-04-25T22:42:33.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559932+0000", 2024-04-25T22:42:33.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7169000000000001e-05 2024-04-25T22:42:33.179 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.179 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.179 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.180 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559942+0000", 2024-04-25T22:42:33.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0261999999999999e-05 2024-04-25T22:42:33.180 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.180 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.180 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.180 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560018+0000", 2024-04-25T22:42:33.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5358000000000006e-05 2024-04-25T22:42:33.180 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.180 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.180 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:33.180 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560118+0000", 2024-04-25T22:42:33.180 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000100911 2024-04-25T22:42:33.180 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.180 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.180 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:33.180 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560281+0000", 2024-04-25T22:42:33.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016288500000000001 2024-04-25T22:42:33.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:33.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.579740+0000", 2024-04-25T22:42:33.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019458598000000001 2024-04-25T22:42:33.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600484+0000", 2024-04-25T22:42:33.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020744483000000001 2024-04-25T22:42:33.181 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.181 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.181 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:33.181 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600664+0000", 2024-04-25T22:42:33.181 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017953899999999999 2024-04-25T22:42:33.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.182 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:33.182 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600871+0000", 2024-04-25T22:42:33.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020737199999999999 2024-04-25T22:42:33.182 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.182 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.182 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.182 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.182 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.182 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10813 4.17 4:e8010137:::100000030b0.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:33.182 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:33.182 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.392596512000001, 2024-04-25T22:42:33.182 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.047503799999999999, 2024-04-25T22:42:33.182 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.182 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.182 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.183 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:33.183 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:33.183 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.183 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10813 2024-04-25T22:42:33.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.183 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:33.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.183 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.183 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.183 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:33.183 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.183 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.184 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.184 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747741+0000", 2024-04-25T22:42:33.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1119999999999999e-06 2024-04-25T22:42:33.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.184 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.184 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752366+0000", 2024-04-25T22:42:33.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046253240000000001 2024-04-25T22:42:33.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.184 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.184 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752382+0000", 2024-04-25T22:42:33.184 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5639999999999999e-05 2024-04-25T22:42:33.184 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.184 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752393+0000", 2024-04-25T22:42:33.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1626e-05 2024-04-25T22:42:33.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752459+0000", 2024-04-25T22:42:33.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5309999999999996e-05 2024-04-25T22:42:33.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:33.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752529+0000", 2024-04-25T22:42:33.185 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0543000000000005e-05 2024-04-25T22:42:33.185 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.185 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.185 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:33.185 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752637+0000", 2024-04-25T22:42:33.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010788799999999999 2024-04-25T22:42:33.186 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:33.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760295+0000", 2024-04-25T22:42:33.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076583290000000002 2024-04-25T22:42:33.186 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.794990+0000", 2024-04-25T22:42:33.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034694317000000002 2024-04-25T22:42:33.186 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.186 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.186 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:33.186 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795097+0000", 2024-04-25T22:42:33.186 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010768999999999999 2024-04-25T22:42:33.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.187 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:33.187 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795243+0000", 2024-04-25T22:42:33.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000146021 2024-04-25T22:42:33.187 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.187 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.187 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.187 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.187 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.187 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10816 4.17 4:e8010137:::100000030b0.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:33.187 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:33.187 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.387267051999999, 2024-04-25T22:42:33.187 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042406530999999997, 2024-04-25T22:42:33.187 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.187 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.188 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.188 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:33.188 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:33.188 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.188 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10816 2024-04-25T22:42:33.188 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.188 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.188 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.188 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.188 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:33.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.188 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.188 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.188 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.188 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:33.188 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753070+0000", 2024-04-25T22:42:33.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9800000000000002e-07 2024-04-25T22:42:33.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753288+0000", 2024-04-25T22:42:33.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000217789 2024-04-25T22:42:33.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.189 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.189 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753301+0000", 2024-04-25T22:42:33.189 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2764e-05 2024-04-25T22:42:33.189 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.189 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753310+0000", 2024-04-25T22:42:33.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:42:33.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758240+0000", 2024-04-25T22:42:33.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049304910000000004 2024-04-25T22:42:33.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:33.190 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758374+0000", 2024-04-25T22:42:33.190 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000133428 2024-04-25T22:42:33.190 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.190 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.190 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:33.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758576+0000", 2024-04-25T22:42:33.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020177899999999999 2024-04-25T22:42:33.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:33.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760626+0000", 2024-04-25T22:42:33.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0020501489999999998 2024-04-25T22:42:33.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795329+0000", 2024-04-25T22:42:33.191 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034703352999999999 2024-04-25T22:42:33.191 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.191 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.191 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:33.191 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795414+0000", 2024-04-25T22:42:33.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5292999999999998e-05 2024-04-25T22:42:33.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.192 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:33.192 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795476+0000", 2024-04-25T22:42:33.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1206999999999999e-05 2024-04-25T22:42:33.192 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.192 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.192 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.192 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.192 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.192 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10914 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:33.192 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:33.192 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.186466670000001, 2024-04-25T22:42:33.192 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044452984000000001, 2024-04-25T22:42:33.193 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.193 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.193 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.193 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:33.193 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:33.193 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.193 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10914 2024-04-25T22:42:33.193 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.193 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.193 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.193 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:33.193 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.193 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.193 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.193 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:33.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953871+0000", 2024-04-25T22:42:33.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1829999999999999e-06 2024-04-25T22:42:33.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.194 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.962992+0000", 2024-04-25T22:42:33.194 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091217409999999992 2024-04-25T22:42:33.194 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.194 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.194 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963027+0000", 2024-04-25T22:42:33.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4229e-05 2024-04-25T22:42:33.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963042+0000", 2024-04-25T22:42:33.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5152e-05 2024-04-25T22:42:33.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963143+0000", 2024-04-25T22:42:33.195 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101171 2024-04-25T22:42:33.195 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.195 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.195 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:33.195 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963269+0000", 2024-04-25T22:42:33.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012623499999999999 2024-04-25T22:42:33.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:33.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963453+0000", 2024-04-25T22:42:33.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018357900000000001 2024-04-25T22:42:33.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:33.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998133+0000", 2024-04-25T22:42:33.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034679789000000003 2024-04-25T22:42:33.196 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.196 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.196 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.196 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998220+0000", 2024-04-25T22:42:33.196 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7153999999999999e-05 2024-04-25T22:42:33.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:33.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998278+0000", 2024-04-25T22:42:33.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8035000000000003e-05 2024-04-25T22:42:33.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.197 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:33.197 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998323+0000", 2024-04-25T22:42:33.197 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4715999999999997e-05 2024-04-25T22:42:33.197 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.197 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.197 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.197 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.197 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.197 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10919 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:33.198 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:33.198 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.166155389, 2024-04-25T22:42:33.198 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044010552000000001, 2024-04-25T22:42:33.198 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.198 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.198 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.198 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:33.198 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:33.198 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.198 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10919 2024-04-25T22:42:33.198 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.198 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.198 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:33.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.199 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:33.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.199 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.199 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.199 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:33.199 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8100000000000003e-07 2024-04-25T22:42:33.199 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.199 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.200 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980221+0000", 2024-04-25T22:42:33.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060397230000000003 2024-04-25T22:42:33.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.200 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980242+0000", 2024-04-25T22:42:33.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1373e-05 2024-04-25T22:42:33.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.200 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.200 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980252+0000", 2024-04-25T22:42:33.200 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9990000000000003e-06 2024-04-25T22:42:33.200 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.200 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981303+0000", 2024-04-25T22:42:33.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010501670000000001 2024-04-25T22:42:33.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:33.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981444+0000", 2024-04-25T22:42:33.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014123799999999999 2024-04-25T22:42:33.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:33.201 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981585+0000", 2024-04-25T22:42:33.201 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014071999999999999 2024-04-25T22:42:33.201 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.201 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.201 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:33.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003640+0000", 2024-04-25T22:42:33.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022055113000000001 2024-04-25T22:42:33.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018070+0000", 2024-04-25T22:42:33.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014430877 2024-04-25T22:42:33.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:33.202 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018138+0000", 2024-04-25T22:42:33.202 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7743000000000005e-05 2024-04-25T22:42:33.202 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.202 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.202 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:33.203 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018191+0000", 2024-04-25T22:42:33.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3118000000000002e-05 2024-04-25T22:42:33.203 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.203 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.203 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.203 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.203 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:12632 4.a e64/17 4:506aad5d:::1000000310f.00000000:head v 64'203, mlcod=64'201)", 2024-04-25T22:42:33.203 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:33.203 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 17.496806994, 2024-04-25T22:42:33.203 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041913617, 2024-04-25T22:42:33.203 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.203 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.203 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.203 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.203 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:33.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:33.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.204 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643531+0000", 2024-04-25T22:42:33.204 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.497e-06 2024-04-25T22:42:33.204 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.204 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.204 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650159+0000", 2024-04-25T22:42:33.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066287059999999998 2024-04-25T22:42:33.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650185+0000", 2024-04-25T22:42:33.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5646000000000001e-05 2024-04-25T22:42:33.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.205 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650205+0000", 2024-04-25T22:42:33.205 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9720000000000001e-05 2024-04-25T22:42:33.205 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.205 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.205 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650521+0000", 2024-04-25T22:42:33.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00031590699999999998 2024-04-25T22:42:33.206 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:33.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650574+0000", 2024-04-25T22:42:33.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3192000000000002e-05 2024-04-25T22:42:33.206 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:33.206 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685374+0000", 2024-04-25T22:42:33.206 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034799902000000001 2024-04-25T22:42:33.206 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.206 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.206 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:33.207 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685443+0000", 2024-04-25T22:42:33.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9047000000000005e-05 2024-04-25T22:42:33.207 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.207 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.207 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.207 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.207 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.207 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12644 4.11 4:8893db93:::100000034c2.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:33.207 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:33.207 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 17.488398104000002, 2024-04-25T22:42:33.207 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045039497999999997, 2024-04-25T22:42:33.207 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.207 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.207 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.207 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:33.208 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:33.208 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.208 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12644 2024-04-25T22:42:33.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.208 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.208 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:33.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.208 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.208 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:33.208 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.208 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.208 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651940+0000", 2024-04-25T22:42:33.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.013e-06 2024-04-25T22:42:33.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659663+0000", 2024-04-25T22:42:33.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077228150000000001 2024-04-25T22:42:33.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.209 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659694+0000", 2024-04-25T22:42:33.209 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1112999999999998e-05 2024-04-25T22:42:33.209 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.209 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.209 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659715+0000", 2024-04-25T22:42:33.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1053e-05 2024-04-25T22:42:33.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659842+0000", 2024-04-25T22:42:33.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012738100000000001 2024-04-25T22:42:33.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:33.210 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660068+0000", 2024-04-25T22:42:33.210 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000225746 2024-04-25T22:42:33.210 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.210 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.210 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:33.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660307+0000", 2024-04-25T22:42:33.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000238352 2024-04-25T22:42:33.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:33.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.683776+0000", 2024-04-25T22:42:33.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023469891999999999 2024-04-25T22:42:33.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.211 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696810+0000", 2024-04-25T22:42:33.211 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013033385999999999 2024-04-25T22:42:33.211 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.211 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.211 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:33.212 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696904+0000", 2024-04-25T22:42:33.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3820000000000006e-05 2024-04-25T22:42:33.212 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.212 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:33.212 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696978+0000", 2024-04-25T22:42:33.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3926999999999999e-05 2024-04-25T22:42:33.212 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.212 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.212 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.212 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.212 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.212 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12645 4.2d 4:b45456a9:::10000003241.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:33.212 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:33.212 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 17.480577617000002, 2024-04-25T22:42:33.212 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.043099660999999997, 2024-04-25T22:42:33.213 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.213 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.213 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.213 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:33.213 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:33.213 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.213 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12645 2024-04-25T22:42:33.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.213 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.213 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:33.213 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.213 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.213 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.213 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.214 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:33.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.214 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.214 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659761+0000", 2024-04-25T22:42:33.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8459999999999999e-06 2024-04-25T22:42:33.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.214 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.214 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666663+0000", 2024-04-25T22:42:33.214 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0069017080000000003 2024-04-25T22:42:33.214 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.214 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.215 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666684+0000", 2024-04-25T22:42:33.215 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0706000000000001e-05 2024-04-25T22:42:33.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.215 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666700+0000", 2024-04-25T22:42:33.215 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5985999999999999e-05 2024-04-25T22:42:33.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.215 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.215 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666914+0000", 2024-04-25T22:42:33.215 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000213861 2024-04-25T22:42:33.215 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.215 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:33.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.667082+0000", 2024-04-25T22:42:33.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016809 2024-04-25T22:42:33.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:33.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702598+0000", 2024-04-25T22:42:33.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035515962999999998 2024-04-25T22:42:33.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:33.216 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702705+0000", 2024-04-25T22:42:33.216 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010689800000000001 2024-04-25T22:42:33.216 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.216 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.216 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:33.217 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702858+0000", 2024-04-25T22:42:33.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015360300000000001 2024-04-25T22:42:33.217 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.217 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.217 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.217 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.217 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.217 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12829 4.3b 4:de8bdadd:::100000033c7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:33.217 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:33.217 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 17.252317701999999, 2024-04-25T22:42:33.217 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042457306, 2024-04-25T22:42:33.217 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.217 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.217 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.217 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:33.218 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:33.218 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.218 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12829 2024-04-25T22:42:33.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.218 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:33.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.218 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.218 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.218 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.218 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:33.218 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888019+0000", 2024-04-25T22:42:33.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3300000000000002e-07 2024-04-25T22:42:33.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891638+0000", 2024-04-25T22:42:33.219 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036189109999999998 2024-04-25T22:42:33.219 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.219 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.219 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.219 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891661+0000", 2024-04-25T22:42:33.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3345000000000001e-05 2024-04-25T22:42:33.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891671+0000", 2024-04-25T22:42:33.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0115000000000001e-05 2024-04-25T22:42:33.220 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.220 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.220 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.220 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891737+0000", 2024-04-25T22:42:33.220 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5600999999999998e-05 2024-04-25T22:42:33.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.221 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:33.221 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891856+0000", 2024-04-25T22:42:33.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011881 2024-04-25T22:42:33.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.221 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:33.221 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930251+0000", 2024-04-25T22:42:33.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.038395141000000001 2024-04-25T22:42:33.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.221 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.221 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:33.221 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930389+0000", 2024-04-25T22:42:33.221 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013849000000000001 2024-04-25T22:42:33.221 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.222 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:33.222 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930476+0000", 2024-04-25T22:42:33.222 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6360000000000007e-05 2024-04-25T22:42:33.222 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.222 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.222 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.222 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.222 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.222 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13009 4.1e 4:78728bd7:::100000033a5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:33.222 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:33.222 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 17.050430689999999, 2024-04-25T22:42:33.222 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049997452999999997, 2024-04-25T22:42:33.222 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.223 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.223 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.223 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:33.223 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:33.223 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.223 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13009 2024-04-25T22:42:33.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.223 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.223 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:33.223 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.223 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.223 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.223 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:33.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:33.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4799999999999997e-07 2024-04-25T22:42:33.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.224 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097105+0000", 2024-04-25T22:42:33.224 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071984060000000001 2024-04-25T22:42:33.224 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.224 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.224 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097118+0000", 2024-04-25T22:42:33.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2865e-05 2024-04-25T22:42:33.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097127+0000", 2024-04-25T22:42:33.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8449999999999998e-06 2024-04-25T22:42:33.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097174+0000", 2024-04-25T22:42:33.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6084000000000001e-05 2024-04-25T22:42:33.225 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.225 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.225 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:33.225 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097232+0000", 2024-04-25T22:42:33.225 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8928999999999998e-05 2024-04-25T22:42:33.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:33.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097309+0000", 2024-04-25T22:42:33.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7014999999999994e-05 2024-04-25T22:42:33.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:33.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.108708+0000", 2024-04-25T22:42:33.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011398233000000001 2024-04-25T22:42:33.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.226 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.226 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.226 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139793+0000", 2024-04-25T22:42:33.226 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031084856000000001 2024-04-25T22:42:33.226 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.227 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.227 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:33.227 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139848+0000", 2024-04-25T22:42:33.227 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5464000000000003e-05 2024-04-25T22:42:33.227 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.227 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.227 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:33.227 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139903+0000", 2024-04-25T22:42:33.227 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4907999999999997e-05 2024-04-25T22:42:33.227 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.227 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.227 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.227 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.227 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.227 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13318 4.16 4:6810bf9e:::10000003259.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:33.228 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:33.228 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 16.679856332, 2024-04-25T22:42:33.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057538179000000002, 2024-04-25T22:42:33.228 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.228 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.228 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.228 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:33.228 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:33.228 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.228 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13318 2024-04-25T22:42:33.228 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.228 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.228 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.228 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.228 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:33.228 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:33.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460481+0000", 2024-04-25T22:42:33.229 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:42:33.229 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.229 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.229 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.229 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466775+0000", 2024-04-25T22:42:33.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062944239999999999 2024-04-25T22:42:33.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466787+0000", 2024-04-25T22:42:33.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1688999999999999e-05 2024-04-25T22:42:33.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466793+0000", 2024-04-25T22:42:33.230 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7209999999999999e-06 2024-04-25T22:42:33.230 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.230 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.230 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.230 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466845+0000", 2024-04-25T22:42:33.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2166999999999997e-05 2024-04-25T22:42:33.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:33.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466912+0000", 2024-04-25T22:42:33.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7016999999999999e-05 2024-04-25T22:42:33.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:33.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.467020+0000", 2024-04-25T22:42:33.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010827699999999999 2024-04-25T22:42:33.231 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.231 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.231 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:33.231 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.476718+0000", 2024-04-25T22:42:33.231 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0096980439999999994 2024-04-25T22:42:33.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517860+0000", 2024-04-25T22:42:33.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041141847000000002 2024-04-25T22:42:33.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:33.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517924+0000", 2024-04-25T22:42:33.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3997000000000004e-05 2024-04-25T22:42:33.232 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.232 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.232 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:33.232 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.518018+0000", 2024-04-25T22:42:33.232 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4139000000000001e-05 2024-04-25T22:42:33.232 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.233 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.233 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.233 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.233 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.233 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13328 4.16 4:6a9ab238:::1000000339b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:33.233 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:33.233 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 16.660943347, 2024-04-25T22:42:33.233 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057072695999999999, 2024-04-25T22:42:33.233 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.233 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.233 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.233 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:33.233 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:33.233 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.233 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13328 2024-04-25T22:42:33.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.234 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:33.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:33.234 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.234 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.234 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.234 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.234 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479395+0000", 2024-04-25T22:42:33.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2859999999999998e-06 2024-04-25T22:42:33.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486667+0000", 2024-04-25T22:42:33.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072715599999999998 2024-04-25T22:42:33.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486677+0000", 2024-04-25T22:42:33.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0305e-05 2024-04-25T22:42:33.235 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.235 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.235 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.235 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486683+0000", 2024-04-25T22:42:33.235 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5300000000000004e-06 2024-04-25T22:42:33.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486768+0000", 2024-04-25T22:42:33.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5725999999999999e-05 2024-04-25T22:42:33.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:33.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486905+0000", 2024-04-25T22:42:33.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013696699999999999 2024-04-25T22:42:33.236 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.236 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.236 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:33.236 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.487121+0000", 2024-04-25T22:42:33.236 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021615299999999999 2024-04-25T22:42:33.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:33.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.509675+0000", 2024-04-25T22:42:33.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022553225999999999 2024-04-25T22:42:33.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536355+0000", 2024-04-25T22:42:33.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026680855 2024-04-25T22:42:33.237 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.237 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.237 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:33.237 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536401+0000", 2024-04-25T22:42:33.237 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5649000000000003e-05 2024-04-25T22:42:33.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.238 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:33.238 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536466+0000", 2024-04-25T22:42:33.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4438999999999997e-05 2024-04-25T22:42:33.238 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.238 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.238 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.238 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.238 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.238 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13329 4.26 4:64e005a2:::10000003483.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:33.238 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:33.238 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 16.653634948000001, 2024-04-25T22:42:33.238 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066502845000000005, 2024-04-25T22:42:33.238 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.239 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.239 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.239 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:33.239 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:33.239 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.239 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13329 2024-04-25T22:42:33.239 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.239 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.239 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:33.239 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.239 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.239 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.239 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:33.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486703+0000", 2024-04-25T22:42:33.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3909999999999999e-06 2024-04-25T22:42:33.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.240 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494612+0000", 2024-04-25T22:42:33.240 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0079096670000000004 2024-04-25T22:42:33.240 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.240 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.240 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494626+0000", 2024-04-25T22:42:33.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3263e-05 2024-04-25T22:42:33.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494637+0000", 2024-04-25T22:42:33.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.171e-05 2024-04-25T22:42:33.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.241 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494720+0000", 2024-04-25T22:42:33.241 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2767000000000002e-05 2024-04-25T22:42:33.241 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.241 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.241 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:33.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494834+0000", 2024-04-25T22:42:33.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011387699999999999 2024-04-25T22:42:33.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:33.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494998+0000", 2024-04-25T22:42:33.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016390799999999999 2024-04-25T22:42:33.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:33.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517407+0000", 2024-04-25T22:42:33.242 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022409068000000001 2024-04-25T22:42:33.242 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.242 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.242 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.242 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553040+0000", 2024-04-25T22:42:33.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035633155 2024-04-25T22:42:33.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:33.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553140+0000", 2024-04-25T22:42:33.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9623000000000005e-05 2024-04-25T22:42:33.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.243 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:33.243 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553204+0000", 2024-04-25T22:42:33.243 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4416000000000001e-05 2024-04-25T22:42:33.243 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.243 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.243 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.243 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.243 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13399 4.16 4:6bb7cc3a:::10000003648.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 16.580269147999999, 2024-04-25T22:42:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045625003999999997, 2024-04-25T22:42:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13399 2024-04-25T22:42:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.244 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560068+0000", 2024-04-25T22:42:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:42:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.245 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576902+0000", 2024-04-25T22:42:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016833806 2024-04-25T22:42:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576916+0000", 2024-04-25T22:42:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3648e-05 2024-04-25T22:42:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576927+0000", 2024-04-25T22:42:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0992000000000001e-05 2024-04-25T22:42:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:33.246 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577026+0000", 2024-04-25T22:42:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9116000000000004e-05 2024-04-25T22:42:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577203+0000", 2024-04-25T22:42:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017700499999999999 2024-04-25T22:42:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577336+0000", 2024-04-25T22:42:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013340800000000001 2024-04-25T22:42:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.247 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.589077+0000", 2024-04-25T22:42:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011741151 2024-04-25T22:42:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605436+0000", 2024-04-25T22:42:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016359146000000001 2024-04-25T22:42:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605493+0000", 2024-04-25T22:42:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7067000000000001e-05 2024-04-25T22:42:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.248 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:33.249 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605692+0000", 2024-04-25T22:42:33.249 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00019855799999999999 2024-04-25T22:42:33.249 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.249 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.249 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.249 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.249 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.249 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:33.250 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:33.251+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:33.251 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:33.351 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:33.347+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:33.386 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:33.386 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:16405 3.5 3:a055a6fb:::200.0000001d:head [write 1247080~12969 [fadvise_dontneed] in=12969b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e70)", 2024-04-25T22:42:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:33.384454+0000", 2024-04-25T22:42:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0033147039999999999, 2024-04-25T22:42:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0033704130000000001, 2024-04-25T22:42:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.384454+0000", 2024-04-25T22:42:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.384454+0000", 2024-04-25T22:42:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.384456+0000", 2024-04-25T22:42:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2000000000000001e-06 2024-04-25T22:42:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.384481+0000", 2024-04-25T22:42:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4196e-05 2024-04-25T22:42:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.384510+0000", 2024-04-25T22:42:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9405999999999999e-05 2024-04-25T22:42:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.384524+0000", 2024-04-25T22:42:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.429e-05 2024-04-25T22:42:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.384650+0000", 2024-04-25T22:42:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012574400000000001 2024-04-25T22:42:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.384874+0000", 2024-04-25T22:42:33.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022413199999999999 2024-04-25T22:42:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.385209+0000", 2024-04-25T22:42:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033534800000000002 2024-04-25T22:42:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.387237+0000", 2024-04-25T22:42:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020271180000000001 2024-04-25T22:42:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.387643+0000", 2024-04-25T22:42:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040619300000000001 2024-04-25T22:42:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.387806+0000", 2024-04-25T22:42:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016324300000000001 2024-04-25T22:42:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(mds.0.3:16405 3.5 e70/16 ondisk, result = 0)", 2024-04-25T22:42:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:33.387443+0000", 2024-04-25T22:42:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00032605999999999998, 2024-04-25T22:42:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000559273, 2024-04-25T22:42:33.391 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-25T22:42:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.387443+0000", 2024-04-25T22:42:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.387443+0000", 2024-04-25T22:42:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.387444+0000", 2024-04-25T22:42:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5659999999999999e-06 2024-04-25T22:42:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.387453+0000", 2024-04-25T22:42:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8240000000000006e-06 2024-04-25T22:42:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.387476+0000", 2024-04-25T22:42:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2918999999999999e-05 2024-04-25T22:42:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.387488+0000", 2024-04-25T22:42:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2267e-05 2024-04-25T22:42:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.387605+0000", 2024-04-25T22:42:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000116137 2024-04-25T22:42:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.387627+0000", 2024-04-25T22:42:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2549999999999999e-05 2024-04-25T22:42:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:33.388005+0000", 2024-04-25T22:42:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00037767299999999997 2024-04-25T22:42:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-25T22:42:33.395 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 2 2024-04-25T22:42:33.395 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:33.403 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:33.416 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:42:33.489 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:33.487+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:33.553 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:33.551+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:33.572 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:33.572 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:33.572 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:42:33.572 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:42:33.572 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:33.587 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:33.673 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:33.671+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:33.755 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:33.755+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:33.760 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:33.760 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:42:33.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:42:33.760 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:33.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.761 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:33.761 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:33.761 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 139.16181588800001, 2024-04-25T22:42:33.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:42:33.761 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.761 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.761 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.761 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:33.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:33.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:42:33.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:42:33.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:42:33.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:42:33.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:42:33.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:42:33.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:42:33.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:42:33.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:42:33.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:42:33.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:33.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:42:33.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:42:33.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:42:33.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:42:33.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:42:33.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:42:33.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:33.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:42:33.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:42:33.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:42:33.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:42:33.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:33.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:42:33.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:42:33.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:42:33.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:42:33.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:42:33.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:42:33.766 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.766 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.766 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.766 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:33.766 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:33.766 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 139.16170757500001, 2024-04-25T22:42:33.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:42:33.766 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.766 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.766 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.767 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:33.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:33.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:42:33.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:42:33.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:42:33.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:42:33.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:42:33.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:42:33.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:42:33.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:42:33.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:42:33.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:42:33.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:33.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:42:33.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:42:33.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:42:33.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:42:33.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:42:33.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:42:33.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:33.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:42:33.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:42:33.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:42:33.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:42:33.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:33.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:42:33.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:42:33.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:42:33.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:42:33.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:42:33.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:42:33.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.771 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.771 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:33.771 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:33.772 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 139.16164091900001, 2024-04-25T22:42:33.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:42:33.772 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.772 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.772 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.772 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:33.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:33.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:42:33.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:42:33.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:42:33.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:42:33.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:42:33.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:42:33.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:42:33.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:42:33.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:42:33.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:42:33.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:33.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:42:33.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:42:33.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:42:33.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:42:33.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:42:33.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:42:33.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:33.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:42:33.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:42:33.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:42:33.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:42:33.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:33.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:42:33.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:42:33.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:42:33.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:42:33.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:42:33.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:42:33.777 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.777 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.777 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.777 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:33.777 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:33.777 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 139.161550323, 2024-04-25T22:42:33.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:42:33.777 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.777 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.777 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.777 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:33.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:33.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:42:33.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:42:33.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:42:33.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:42:33.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:42:33.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:42:33.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:42:33.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:42:33.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:42:33.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:42:33.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:33.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:42:33.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:42:33.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:42:33.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:42:33.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:42:33.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:42:33.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:33.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:42:33.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:42:33.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:33.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:42:33.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:42:33.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:42:33.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:42:33.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:42:33.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:42:33.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:42:33.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:42:33.782 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.782 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.782 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.782 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:33.782 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:33.782 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 139.16148575, 2024-04-25T22:42:33.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:42:33.782 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.783 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.783 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.783 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:33.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:33.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:42:33.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:42:33.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:42:33.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:42:33.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:42:33.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:42:33.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:42:33.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:42:33.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:33.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:42:33.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:33.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:42:33.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:42:33.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:42:33.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:42:33.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:42:33.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:42:33.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:33.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:42:33.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:42:33.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:42:33.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:42:33.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:33.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:42:33.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:42:33.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:42:33.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:42:33.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:42:33.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:42:33.787 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.787 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.788 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.788 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:33.788 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:33.788 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 139.161420327, 2024-04-25T22:42:33.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:42:33.788 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.788 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.788 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.788 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:33.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:33.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:42:33.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:33.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:42:33.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:42:33.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:42:33.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:42:33.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:42:33.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:42:33.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:42:33.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:42:33.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:33.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:42:33.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:42:33.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:42:33.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:42:33.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:42:33.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:42:33.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:33.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:42:33.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:42:33.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:33.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:42:33.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:42:33.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:42:33.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:42:33.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:42:33.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:42:33.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:42:33.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:42:33.793 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.793 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.793 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.793 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:33.793 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:33.793 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 139.16113979299999, 2024-04-25T22:42:33.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:42:33.793 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.793 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.793 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.794 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:33.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:33.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:42:33.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:42:33.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:42:33.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:42:33.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:42:33.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:42:33.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:42:33.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:42:33.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:42:33.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:42:33.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:33.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:42:33.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:42:33.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:42:33.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:42:33.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:42:33.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:42:33.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:33.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:42:33.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:42:33.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:42:33.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:42:33.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:33.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:42:33.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:42:33.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:42:33.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:42:33.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:42:33.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:42:33.798 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.798 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.798 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.799 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10678 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:33.799 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:33.799 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.269855054000001, 2024-04-25T22:42:33.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050477795999999998, 2024-04-25T22:42:33.799 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.799 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.799 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.799 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:33.799 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:33.799 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.799 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10678 2024-04-25T22:42:33.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.799 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:33.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:33.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488127+0000", 2024-04-25T22:42:33.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.716e-06 2024-04-25T22:42:33.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496392+0000", 2024-04-25T22:42:33.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082651500000000006 2024-04-25T22:42:33.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496428+0000", 2024-04-25T22:42:33.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5441999999999997e-05 2024-04-25T22:42:33.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496451+0000", 2024-04-25T22:42:33.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3529000000000001e-05 2024-04-25T22:42:33.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496601+0000", 2024-04-25T22:42:33.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014935600000000001 2024-04-25T22:42:33.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496856+0000", 2024-04-25T22:42:33.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025537900000000002 2024-04-25T22:42:33.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:33.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.497206+0000", 2024-04-25T22:42:33.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000350599 2024-04-25T22:42:33.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538231+0000", 2024-04-25T22:42:33.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041024146999999997 2024-04-25T22:42:33.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:33.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538298+0000", 2024-04-25T22:42:33.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7688000000000007e-05 2024-04-25T22:42:33.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538467+0000", 2024-04-25T22:42:33.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000168178 2024-04-25T22:42:33.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538603+0000", 2024-04-25T22:42:33.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013661200000000001 2024-04-25T22:42:33.803 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.803 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.803 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.803 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10692 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:33.804 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:33.804 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.253265259999999, 2024-04-25T22:42:33.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.061242408999999998, 2024-04-25T22:42:33.804 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.804 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.804 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.804 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:33.804 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:33.804 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.804 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10692 2024-04-25T22:42:33.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.804 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:33.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:33.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504717+0000", 2024-04-25T22:42:33.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6199999999999999e-06 2024-04-25T22:42:33.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511770+0000", 2024-04-25T22:42:33.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0070530929999999999 2024-04-25T22:42:33.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511810+0000", 2024-04-25T22:42:33.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0635e-05 2024-04-25T22:42:33.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511837+0000", 2024-04-25T22:42:33.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6423000000000001e-05 2024-04-25T22:42:33.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520096+0000", 2024-04-25T22:42:33.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082593730000000004 2024-04-25T22:42:33.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520345+0000", 2024-04-25T22:42:33.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024908800000000001 2024-04-25T22:42:33.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:33.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520794+0000", 2024-04-25T22:42:33.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000449023 2024-04-25T22:42:33.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:33.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538675+0000", 2024-04-25T22:42:33.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017880991999999998 2024-04-25T22:42:33.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565761+0000", 2024-04-25T22:42:33.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027085260999999999 2024-04-25T22:42:33.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565892+0000", 2024-04-25T22:42:33.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013152300000000001 2024-04-25T22:42:33.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565958+0000", 2024-04-25T22:42:33.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5377999999999996e-05 2024-04-25T22:42:33.808 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.808 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.808 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.808 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10693 4.2c 4:36971e45:::100000030bd.00000001:head [write 971225~86041] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:33.808 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:33.809 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.246086898000001, 2024-04-25T22:42:33.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054529782999999998, 2024-04-25T22:42:33.809 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.809 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.809 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.809 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:33.809 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:33.809 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.809 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10693 2024-04-25T22:42:33.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.809 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:33.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:33.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511897+0000", 2024-04-25T22:42:33.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2499999999999998e-06 2024-04-25T22:42:33.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512094+0000", 2024-04-25T22:42:33.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019700100000000001 2024-04-25T22:42:33.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512121+0000", 2024-04-25T22:42:33.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7288999999999999e-05 2024-04-25T22:42:33.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512137+0000", 2024-04-25T22:42:33.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.592e-05 2024-04-25T22:42:33.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.533845+0000", 2024-04-25T22:42:33.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021707595999999999 2024-04-25T22:42:33.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534176+0000", 2024-04-25T22:42:33.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033187000000000001 2024-04-25T22:42:33.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:33.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534626+0000", 2024-04-25T22:42:33.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00045008599999999999 2024-04-25T22:42:33.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:33.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.539165+0000", 2024-04-25T22:42:33.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045386380000000002 2024-04-25T22:42:33.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566169+0000", 2024-04-25T22:42:33.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027004199 2024-04-25T22:42:33.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566317+0000", 2024-04-25T22:42:33.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014747999999999999 2024-04-25T22:42:33.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566423+0000", 2024-04-25T22:42:33.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010645399999999999 2024-04-25T22:42:33.813 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.813 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.813 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.813 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10696 4.2b 4:d56d2a96:::100000030c3.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:33.813 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:33.813 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.244379253000002, 2024-04-25T22:42:33.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052282190999999999, 2024-04-25T22:42:33.814 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.814 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.814 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.814 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:33.814 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:33.814 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.814 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10696 2024-04-25T22:42:33.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.814 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:33.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:33.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513603+0000", 2024-04-25T22:42:33.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.283e-06 2024-04-25T22:42:33.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518647+0000", 2024-04-25T22:42:33.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050440859999999997 2024-04-25T22:42:33.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518672+0000", 2024-04-25T22:42:33.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4468e-05 2024-04-25T22:42:33.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518691+0000", 2024-04-25T22:42:33.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9213999999999999e-05 2024-04-25T22:42:33.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518806+0000", 2024-04-25T22:42:33.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115296 2024-04-25T22:42:33.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519011+0000", 2024-04-25T22:42:33.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020445700000000001 2024-04-25T22:42:33.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:33.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519207+0000", 2024-04-25T22:42:33.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000196431 2024-04-25T22:42:33.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:33.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531309+0000", 2024-04-25T22:42:33.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012101694 2024-04-25T22:42:33.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565622+0000", 2024-04-25T22:42:33.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034312976000000002 2024-04-25T22:42:33.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565769+0000", 2024-04-25T22:42:33.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014715900000000001 2024-04-25T22:42:33.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565883+0000", 2024-04-25T22:42:33.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000114127 2024-04-25T22:42:33.818 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.818 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.818 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.818 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10701 4.a 4:51b6a63a:::100000030f2.00000000:head [write 0~3014656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:33.818 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:33.818 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.232935243, 2024-04-25T22:42:33.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047414393999999999, 2024-04-25T22:42:33.818 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.819 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.819 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.819 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:33.819 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:33.819 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.819 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10701 2024-04-25T22:42:33.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.819 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:33.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:33.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525048+0000", 2024-04-25T22:42:33.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0819999999999999e-06 2024-04-25T22:42:33.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531709+0000", 2024-04-25T22:42:33.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066610929999999999 2024-04-25T22:42:33.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531751+0000", 2024-04-25T22:42:33.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1650000000000003e-05 2024-04-25T22:42:33.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531788+0000", 2024-04-25T22:42:33.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7305000000000003e-05 2024-04-25T22:42:33.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531943+0000", 2024-04-25T22:42:33.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015500600000000001 2024-04-25T22:42:33.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532086+0000", 2024-04-25T22:42:33.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014238599999999999 2024-04-25T22:42:33.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:33.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532295+0000", 2024-04-25T22:42:33.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020922000000000001 2024-04-25T22:42:33.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:33.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.545987+0000", 2024-04-25T22:42:33.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013692582999999999 2024-04-25T22:42:33.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572315+0000", 2024-04-25T22:42:33.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026327488 2024-04-25T22:42:33.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572381+0000", 2024-04-25T22:42:33.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5609000000000002e-05 2024-04-25T22:42:33.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572460+0000", 2024-04-25T22:42:33.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8972000000000002e-05 2024-04-25T22:42:33.823 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.823 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.824 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.824 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:10700 4.11 e63/57 4:88409fbf:::100000030ec.00000000:head v 63'193, mlcod=62'191)", 2024-04-25T22:42:33.824 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:33.824 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.222105787, 2024-04-25T22:42:33.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050517667000000002, 2024-04-25T22:42:33.824 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.824 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.824 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.824 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:33.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:33.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535876+0000", 2024-04-25T22:42:33.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0300000000000001e-06 2024-04-25T22:42:33.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565275+0000", 2024-04-25T22:42:33.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029399033000000001 2024-04-25T22:42:33.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565358+0000", 2024-04-25T22:42:33.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3403000000000001e-05 2024-04-25T22:42:33.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565380+0000", 2024-04-25T22:42:33.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1761999999999999e-05 2024-04-25T22:42:33.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565505+0000", 2024-04-25T22:42:33.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000125153 2024-04-25T22:42:33.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565550+0000", 2024-04-25T22:42:33.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5479000000000003e-05 2024-04-25T22:42:33.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586328+0000", 2024-04-25T22:42:33.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020777982 2024-04-25T22:42:33.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586392+0000", 2024-04-25T22:42:33.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3825000000000006e-05 2024-04-25T22:42:33.827 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.827 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.827 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.827 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12632 4.a 4:506aad5d:::1000000310f.00000000:head [write 0~4194304 [2@2043125]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:33.828 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:33.828 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 18.123050661000001, 2024-04-25T22:42:33.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051574097999999999, 2024-04-25T22:42:33.828 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.828 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.828 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.828 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:33.828 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:33.828 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.828 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12632 2024-04-25T22:42:33.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.828 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:33.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:33.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634932+0000", 2024-04-25T22:42:33.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1600000000000001e-06 2024-04-25T22:42:33.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642614+0000", 2024-04-25T22:42:33.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076823000000000004 2024-04-25T22:42:33.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642660+0000", 2024-04-25T22:42:33.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6016000000000001e-05 2024-04-25T22:42:33.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642686+0000", 2024-04-25T22:42:33.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5491999999999999e-05 2024-04-25T22:42:33.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642870+0000", 2024-04-25T22:42:33.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000184045 2024-04-25T22:42:33.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643122+0000", 2024-04-25T22:42:33.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025242299999999999 2024-04-25T22:42:33.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:33.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643634+0000", 2024-04-25T22:42:33.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051145800000000001 2024-04-25T22:42:33.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:33.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.682287+0000", 2024-04-25T22:42:33.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038653342 2024-04-25T22:42:33.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686419+0000", 2024-04-25T22:42:33.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0041325169999999996 2024-04-25T22:42:33.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686464+0000", 2024-04-25T22:42:33.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4171000000000001e-05 2024-04-25T22:42:33.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686504+0000", 2024-04-25T22:42:33.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0173999999999999e-05 2024-04-25T22:42:33.832 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.832 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.832 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.832 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12691 4.39 4:9d0d8843:::100000030ef.00000000:head [write 0~4194304 [3@92787]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:33.832 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:33.832 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 18.027329571999999, 2024-04-25T22:42:33.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045521998000000001, 2024-04-25T22:42:33.833 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.833 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.833 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.833 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:33.833 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:33.833 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.833 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12691 2024-04-25T22:42:33.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.833 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:33.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:33.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730653+0000", 2024-04-25T22:42:33.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1799999999999999e-06 2024-04-25T22:42:33.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738136+0000", 2024-04-25T22:42:33.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0074832789999999998 2024-04-25T22:42:33.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738169+0000", 2024-04-25T22:42:33.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3115999999999999e-05 2024-04-25T22:42:33.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738190+0000", 2024-04-25T22:42:33.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1060000000000002e-05 2024-04-25T22:42:33.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738264+0000", 2024-04-25T22:42:33.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3150000000000003e-05 2024-04-25T22:42:33.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738333+0000", 2024-04-25T22:42:33.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9314999999999996e-05 2024-04-25T22:42:33.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:33.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738425+0000", 2024-04-25T22:42:33.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2498999999999996e-05 2024-04-25T22:42:33.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:33.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.745181+0000", 2024-04-25T22:42:33.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067553240000000001 2024-04-25T22:42:33.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776101+0000", 2024-04-25T22:42:33.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.030920033 2024-04-25T22:42:33.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776140+0000", 2024-04-25T22:42:33.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9706999999999998e-05 2024-04-25T22:42:33.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776173+0000", 2024-04-25T22:42:33.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2335000000000001e-05 2024-04-25T22:42:33.837 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.837 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.837 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.837 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12813 4.18 4:1945bfc2:::10000003578.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:33.838 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:33.838 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.888806090999999, 2024-04-25T22:42:33.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054261216000000001, 2024-04-25T22:42:33.838 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.838 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.838 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.838 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:33.838 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:33.838 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.838 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12813 2024-04-25T22:42:33.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.838 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:33.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:33.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869175+0000", 2024-04-25T22:42:33.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3200000000000005e-07 2024-04-25T22:42:33.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872980+0000", 2024-04-25T22:42:33.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038049720000000002 2024-04-25T22:42:33.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872988+0000", 2024-04-25T22:42:33.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5429999999999994e-06 2024-04-25T22:42:33.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872993+0000", 2024-04-25T22:42:33.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8570000000000003e-06 2024-04-25T22:42:33.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873054+0000", 2024-04-25T22:42:33.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0801000000000003e-05 2024-04-25T22:42:33.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873140+0000", 2024-04-25T22:42:33.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6236999999999994e-05 2024-04-25T22:42:33.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:33.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873271+0000", 2024-04-25T22:42:33.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130541 2024-04-25T22:42:33.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:33.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.884240+0000", 2024-04-25T22:42:33.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010969527 2024-04-25T22:42:33.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923308+0000", 2024-04-25T22:42:33.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039067317999999997 2024-04-25T22:42:33.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923373+0000", 2024-04-25T22:42:33.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5055000000000006e-05 2024-04-25T22:42:33.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923436+0000", 2024-04-25T22:42:33.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2732999999999997e-05 2024-04-25T22:42:33.842 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.842 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.842 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.842 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13328 4.16 e65/54 4:6a9ab238:::1000000339b.00000000:head v 65'186, mlcod=65'183)", 2024-04-25T22:42:33.843 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:33.843 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.268346022999999, 2024-04-25T22:42:33.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.046438762000000001, 2024-04-25T22:42:33.843 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.843 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.843 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.843 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:33.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:33.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489637+0000", 2024-04-25T22:42:33.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.357e-06 2024-04-25T22:42:33.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496055+0000", 2024-04-25T22:42:33.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0064181380000000003 2024-04-25T22:42:33.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496074+0000", 2024-04-25T22:42:33.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8904000000000001e-05 2024-04-25T22:42:33.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496085+0000", 2024-04-25T22:42:33.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1245e-05 2024-04-25T22:42:33.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496169+0000", 2024-04-25T22:42:33.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3974000000000006e-05 2024-04-25T22:42:33.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496203+0000", 2024-04-25T22:42:33.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3679000000000001e-05 2024-04-25T22:42:33.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536002+0000", 2024-04-25T22:42:33.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039799569 2024-04-25T22:42:33.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536073+0000", 2024-04-25T22:42:33.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0895999999999993e-05 2024-04-25T22:42:33.846 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.846 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.846 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.846 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13338 4.e 4:737b94c2:::1000000338a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:33.846 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:33.846 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.262205508000001, 2024-04-25T22:42:33.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047911849999999999, 2024-04-25T22:42:33.847 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.847 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.847 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.847 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:33.847 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:33.847 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.847 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13338 2024-04-25T22:42:33.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.847 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:33.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:33.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495776+0000", 2024-04-25T22:42:33.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2399999999999996e-07 2024-04-25T22:42:33.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503748+0000", 2024-04-25T22:42:33.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079725479999999994 2024-04-25T22:42:33.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503940+0000", 2024-04-25T22:42:33.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000191249 2024-04-25T22:42:33.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504061+0000", 2024-04-25T22:42:33.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120982 2024-04-25T22:42:33.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515564+0000", 2024-04-25T22:42:33.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011503342999999999 2024-04-25T22:42:33.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515799+0000", 2024-04-25T22:42:33.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000235138 2024-04-25T22:42:33.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:33.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543419+0000", 2024-04-25T22:42:33.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027620167000000001 2024-04-25T22:42:33.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543522+0000", 2024-04-25T22:42:33.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010254100000000001 2024-04-25T22:42:33.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543687+0000", 2024-04-25T22:42:33.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016495799999999999 2024-04-25T22:42:33.850 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.850 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.850 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.851 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13329 4.26 e65/57 4:64e005a2:::10000003483.00000000:head v 65'226, mlcod=64'224)", 2024-04-25T22:42:33.851 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:33.851 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.261602827000001, 2024-04-25T22:42:33.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048871456000000001, 2024-04-25T22:42:33.851 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.851 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.851 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.851 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:33.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:33.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496379+0000", 2024-04-25T22:42:33.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1480000000000001e-06 2024-04-25T22:42:33.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504870+0000", 2024-04-25T22:42:33.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0084917880000000001 2024-04-25T22:42:33.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504888+0000", 2024-04-25T22:42:33.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7365999999999999e-05 2024-04-25T22:42:33.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504899+0000", 2024-04-25T22:42:33.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1516e-05 2024-04-25T22:42:33.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515953+0000", 2024-04-25T22:42:33.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011054074000000001 2024-04-25T22:42:33.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515993+0000", 2024-04-25T22:42:33.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9854999999999997e-05 2024-04-25T22:42:33.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545191+0000", 2024-04-25T22:42:33.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029197323000000001 2024-04-25T22:42:33.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545249+0000", 2024-04-25T22:42:33.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8386e-05 2024-04-25T22:42:33.854 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.854 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.854 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.855 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13713 4.2b 4:d574dbff:::100000031d0.00000001:head [write 0~4194304 [2@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:33.855 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:33.855 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.849416709, 2024-04-25T22:42:33.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047324328999999998, 2024-04-25T22:42:33.855 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:33.855 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:33.855 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:33.855 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:33.855 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:33.855 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:33.855 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13713 2024-04-25T22:42:33.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.855 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:33.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:33.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:33.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:33.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:33.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:33.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:33.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908565+0000", 2024-04-25T22:42:33.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.694e-06 2024-04-25T22:42:33.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:33.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916170+0000", 2024-04-25T22:42:33.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076041720000000002 2024-04-25T22:42:33.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:33.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916200+0000", 2024-04-25T22:42:33.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0463999999999998e-05 2024-04-25T22:42:33.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916209+0000", 2024-04-25T22:42:33.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3079999999999997e-06 2024-04-25T22:42:33.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:33.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916297+0000", 2024-04-25T22:42:33.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8159999999999996e-05 2024-04-25T22:42:33.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:33.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916554+0000", 2024-04-25T22:42:33.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025661800000000002 2024-04-25T22:42:33.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:33.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916794+0000", 2024-04-25T22:42:33.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024013999999999999 2024-04-25T22:42:33.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:33.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.933120+0000", 2024-04-25T22:42:33.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016325559 2024-04-25T22:42:33.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:33.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955612+0000", 2024-04-25T22:42:33.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022491786 2024-04-25T22:42:33.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:33.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955797+0000", 2024-04-25T22:42:33.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018533699999999999 2024-04-25T22:42:33.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:33.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:33.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:33.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955888+0000", 2024-04-25T22:42:33.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1090999999999999e-05 2024-04-25T22:42:33.859 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.859 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.859 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.859 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:33.859 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:33.860 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:33.861 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:33.861 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:33.855+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:33.961 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:33.959+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:33.997 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:33.997 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:33.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.997 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(mds.0.3:17262 3.5 e70/16)", 2024-04-25T22:42:33.997 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:33.997088+0000", 2024-04-25T22:42:33.997 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 7.8720999999999994e-05, 2024-04-25T22:42:33.997 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000103423, 2024-04-25T22:42:33.997 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:33.997 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:33.997 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "queued for pg", 2024-04-25T22:42:33.997 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:33.997 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.997 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:33.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:33.997088+0000", 2024-04-25T22:42:33.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:33.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:33.997088+0000", 2024-04-25T22:42:33.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:33.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.998 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:33.998 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:33.997089+0000", 2024-04-25T22:42:33.998 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.243e-06 2024-04-25T22:42:33.998 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.998 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:33.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:33.997119+0000", 2024-04-25T22:42:33.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.0392999999999999e-05 2024-04-25T22:42:33.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:33.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:33.997140+0000", 2024-04-25T22:42:33.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0554e-05 2024-04-25T22:42:33.999 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:33.999 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:33.999 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:33.999 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:33.997157+0000", 2024-04-25T22:42:33.999 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7501999999999999e-05 2024-04-25T22:42:33.999 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:33.999 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:33.999 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.000 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.000 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-25T22:42:34.000 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 1 2024-04-25T22:42:34.000 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:34.011 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:34.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~59s 2024-04-25T22:42:34.062 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:34.063+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:34.134 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:34.134 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:34.135 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:42:34.135 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:42:34.135 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:34.149 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:34.190 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:34.191+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:34.264 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:34.259+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:34.319 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:34.319 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:34.319 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:34.320 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:34.320 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.320 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:34.320 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:34.320 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 139.72078748600001, 2024-04-25T22:42:34.320 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:34.320 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:34.320 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:34.320 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.320 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:34.320 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.320 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:34.320 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:34.320 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.320 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.321 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.321 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:34.321 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:34.321 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.321 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.321 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.321 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:34.321 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:34.321 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:34.321 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.321 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.321 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:34.321 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:34.321 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:34.321 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.321 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.322 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:34.322 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:34.322 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:34.322 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.322 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.322 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.322 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:34.322 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:34.322 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.322 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.322 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.322 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:34.322 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:34.322 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.323 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.323 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:34.323 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:34.323 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:34.323 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.323 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.323 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.323 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:34.323 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:34.323 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.323 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.323 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:34.323 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:34.323 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:34.323 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.323 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.324 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:34.324 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:34.324 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:34.324 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.324 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.324 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:34.324 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:34.324 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:34.324 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.324 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.324 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.324 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:34.324 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:34.324 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.324 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.325 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:34.325 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:34.325 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:34.325 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.325 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.325 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:34.325 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:34.325 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:34.325 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.325 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.325 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.325 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.325 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.325 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:34.325 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:34.326 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 139.72065022999999, 2024-04-25T22:42:34.326 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:34.326 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:34.326 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:34.326 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.326 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:34.326 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.326 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:34.326 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:34.326 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.326 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.326 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.326 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:34.326 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:34.327 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.327 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.327 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.327 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:34.327 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:34.327 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:34.327 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.327 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.327 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:34.327 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:34.327 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:34.327 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.327 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.327 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:34.327 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:34.327 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:34.327 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.328 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.328 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.328 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:34.328 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:34.328 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.328 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.328 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.328 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:34.328 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:34.328 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.328 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.328 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:34.328 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:34.328 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:34.328 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.328 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.328 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:34.330 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:34.330 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.330 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.330 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.330 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:34.330 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:34.330 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.330 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.330 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:34.330 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:34.330 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:34.330 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.330 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.330 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:34.330 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:34.331 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:34.331 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.331 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.331 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.331 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.331 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.331 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:34.331 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:34.331 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 139.72039006200001, 2024-04-25T22:42:34.331 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:34.331 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:34.331 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:34.331 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.331 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:34.331 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.332 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:34.332 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:34.332 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.332 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.332 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.332 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:34.332 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:34.332 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.332 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.332 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.332 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:34.332 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:34.332 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:34.332 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.332 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.333 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:34.333 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:34.333 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:34.333 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.333 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.333 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:34.333 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:34.333 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:34.333 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.333 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.333 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.333 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:34.333 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:34.333 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.333 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.333 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.334 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:34.334 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:34.334 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.334 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.334 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:34.334 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:34.334 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:34.334 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.334 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.334 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.334 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:34.334 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:34.334 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.334 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.335 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:34.335 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:34.335 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:34.335 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.335 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.335 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:34.335 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:34.335 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:34.335 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.335 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.335 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:34.335 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:34.335 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:34.335 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.335 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.335 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.336 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:34.336 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:34.336 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.336 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.336 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:34.336 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:34.336 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:34.336 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.336 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.336 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:34.336 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:34.336 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:34.336 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.336 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.336 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.337 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.337 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.337 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:34.337 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:34.337 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 139.720224863, 2024-04-25T22:42:34.337 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:34.337 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:34.337 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:34.337 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:34.337 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:34.337 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.337 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:34.337 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:34.337 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.337 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.337 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.338 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:34.338 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:34.338 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.338 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.338 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.338 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:34.338 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:34.338 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:34.338 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.338 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.338 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:34.338 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:34.338 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:34.338 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.339 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.339 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:34.339 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:34.339 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:34.339 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.339 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.339 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.339 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:34.339 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:34.339 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.339 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.339 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.339 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:34.339 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:34.339 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.339 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.340 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:34.340 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:34.340 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:34.340 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.340 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.340 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.340 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:34.340 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:34.340 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.340 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.340 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:34.340 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:34.340 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:34.340 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.340 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.340 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:34.341 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:34.341 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:34.341 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.341 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.341 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.341 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.341 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.341 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:34.341 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:34.341 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 139.720159201, 2024-04-25T22:42:34.341 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:34.341 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:34.341 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:34.341 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:34.341 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:34.341 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.342 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:34.342 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:34.342 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.342 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.342 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.342 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:34.342 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:34.342 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.342 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.342 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.342 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:34.342 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:34.342 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:34.342 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.342 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.343 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:34.343 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:34.343 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:34.343 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.343 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.343 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:34.343 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:34.343 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:34.343 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.343 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.343 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.343 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:34.343 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:34.343 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.343 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.343 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.344 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:34.344 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:34.344 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.344 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.344 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:34.344 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:34.344 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:34.344 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.344 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.344 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.344 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:34.344 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:34.344 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.344 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.345 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:34.345 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:34.345 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:34.345 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.345 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.345 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:34.345 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:34.345 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:34.345 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.345 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.345 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.345 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.345 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.345 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10700 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:34.345 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:34.345 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 21.797291984000001, 2024-04-25T22:42:34.346 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066789482999999997, 2024-04-25T22:42:34.346 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:34.346 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:34.346 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.346 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:34.346 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:34.346 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:34.346 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10700 2024-04-25T22:42:34.346 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.346 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:34.346 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.346 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:34.346 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:34.346 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.346 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.347 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.347 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:34.347 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:34.347 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.347 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.347 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.347 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:34.347 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519112+0000", 2024-04-25T22:42:34.347 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1399999999999998e-06 2024-04-25T22:42:34.347 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.347 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.347 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:34.347 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527187+0000", 2024-04-25T22:42:34.347 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080748899999999995 2024-04-25T22:42:34.347 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.348 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.348 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:34.348 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527232+0000", 2024-04-25T22:42:34.348 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4895999999999998e-05 2024-04-25T22:42:34.348 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.348 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.348 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.348 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527259+0000", 2024-04-25T22:42:34.348 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7331999999999999e-05 2024-04-25T22:42:34.348 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.348 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.348 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.348 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529418+0000", 2024-04-25T22:42:34.348 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002158765 2024-04-25T22:42:34.348 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.348 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.348 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:34.349 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529572+0000", 2024-04-25T22:42:34.349 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015438499999999999 2024-04-25T22:42:34.349 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.349 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.349 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:34.349 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529762+0000", 2024-04-25T22:42:34.349 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018998100000000001 2024-04-25T22:42:34.349 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.349 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.349 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:34.349 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.548359+0000", 2024-04-25T22:42:34.349 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018596444 2024-04-25T22:42:34.349 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.349 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.349 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.350 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585801+0000", 2024-04-25T22:42:34.350 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.037442469999999999 2024-04-25T22:42:34.350 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.350 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.350 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:34.350 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585847+0000", 2024-04-25T22:42:34.350 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5565000000000002e-05 2024-04-25T22:42:34.350 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.350 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.350 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:34.350 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585899+0000", 2024-04-25T22:42:34.350 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2614999999999997e-05 2024-04-25T22:42:34.350 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.350 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.351 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.351 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.351 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.351 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10714 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:34.351 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:34.351 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 21.763611020999999, 2024-04-25T22:42:34.351 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.048080623000000003, 2024-04-25T22:42:34.351 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:34.351 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:34.351 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.351 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:34.351 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:34.351 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:34.351 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10714 2024-04-25T22:42:34.351 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.351 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:34.351 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.352 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:34.352 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:34.352 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.352 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.352 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.352 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:34.352 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:34.352 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.352 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.352 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.352 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:34.352 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552792+0000", 2024-04-25T22:42:34.352 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:42:34.352 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.352 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.353 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:34.353 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559915+0000", 2024-04-25T22:42:34.353 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071231690000000004 2024-04-25T22:42:34.353 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.353 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.353 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:34.353 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559932+0000", 2024-04-25T22:42:34.353 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7169000000000001e-05 2024-04-25T22:42:34.353 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.353 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.353 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.353 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559942+0000", 2024-04-25T22:42:34.353 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0261999999999999e-05 2024-04-25T22:42:34.353 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.353 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.353 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.354 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560018+0000", 2024-04-25T22:42:34.354 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5358000000000006e-05 2024-04-25T22:42:34.354 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.354 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.354 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:34.354 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560118+0000", 2024-04-25T22:42:34.354 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000100911 2024-04-25T22:42:34.354 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.354 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.354 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:34.354 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560281+0000", 2024-04-25T22:42:34.354 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016288500000000001 2024-04-25T22:42:34.354 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.354 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.355 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:34.355 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.579740+0000", 2024-04-25T22:42:34.355 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019458598000000001 2024-04-25T22:42:34.355 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.355 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.355 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.355 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600484+0000", 2024-04-25T22:42:34.355 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020744483000000001 2024-04-25T22:42:34.355 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.355 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.355 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:34.355 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600664+0000", 2024-04-25T22:42:34.355 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017953899999999999 2024-04-25T22:42:34.355 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.355 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.355 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:34.356 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600871+0000", 2024-04-25T22:42:34.356 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020737199999999999 2024-04-25T22:42:34.356 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.356 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.356 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.356 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.356 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.356 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10813 4.17 4:e8010137:::100000030b0.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:34.356 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:34.356 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 21.568662015000001, 2024-04-25T22:42:34.356 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.047503799999999999, 2024-04-25T22:42:34.356 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:34.356 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:34.356 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.356 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:34.356 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:34.357 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:34.357 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10813 2024-04-25T22:42:34.357 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.357 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:34.357 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.357 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:34.357 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:34.357 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.357 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.357 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.357 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:34.357 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:34.357 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.357 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.357 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.358 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:34.358 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747741+0000", 2024-04-25T22:42:34.358 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1119999999999999e-06 2024-04-25T22:42:34.358 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.358 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.358 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:34.358 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752366+0000", 2024-04-25T22:42:34.358 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046253240000000001 2024-04-25T22:42:34.358 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.358 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.358 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:34.358 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752382+0000", 2024-04-25T22:42:34.358 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5639999999999999e-05 2024-04-25T22:42:34.358 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.358 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.359 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.359 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752393+0000", 2024-04-25T22:42:34.359 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1626e-05 2024-04-25T22:42:34.359 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.359 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.359 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.359 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752459+0000", 2024-04-25T22:42:34.359 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5309999999999996e-05 2024-04-25T22:42:34.359 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.359 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.359 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:34.359 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752529+0000", 2024-04-25T22:42:34.359 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0543000000000005e-05 2024-04-25T22:42:34.359 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.359 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.359 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:34.360 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752637+0000", 2024-04-25T22:42:34.360 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010788799999999999 2024-04-25T22:42:34.360 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.360 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.360 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:34.360 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760295+0000", 2024-04-25T22:42:34.360 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076583290000000002 2024-04-25T22:42:34.360 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.360 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.360 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.360 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.794990+0000", 2024-04-25T22:42:34.360 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034694317000000002 2024-04-25T22:42:34.360 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.360 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.360 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:34.360 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795097+0000", 2024-04-25T22:42:34.361 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010768999999999999 2024-04-25T22:42:34.361 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.361 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.361 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:34.361 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795243+0000", 2024-04-25T22:42:34.361 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000146021 2024-04-25T22:42:34.361 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.361 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.361 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.361 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.361 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.361 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10816 4.17 4:e8010137:::100000030b0.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:34.361 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:34.361 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 21.563332554999999, 2024-04-25T22:42:34.361 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042406530999999997, 2024-04-25T22:42:34.361 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:34.361 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:34.362 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.362 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:34.362 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:34.362 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:34.362 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10816 2024-04-25T22:42:34.362 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.362 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:34.362 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.362 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:34.362 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:34.362 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.362 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.362 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.362 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:34.362 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:34.363 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.363 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.363 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.363 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:34.363 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753070+0000", 2024-04-25T22:42:34.363 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9800000000000002e-07 2024-04-25T22:42:34.363 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.363 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.363 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:34.363 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753288+0000", 2024-04-25T22:42:34.363 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000217789 2024-04-25T22:42:34.363 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.363 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.363 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:34.363 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753301+0000", 2024-04-25T22:42:34.364 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2764e-05 2024-04-25T22:42:34.364 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.364 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.364 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.364 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753310+0000", 2024-04-25T22:42:34.364 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:42:34.364 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.364 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.364 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.364 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758240+0000", 2024-04-25T22:42:34.364 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049304910000000004 2024-04-25T22:42:34.364 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.364 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.364 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:34.364 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758374+0000", 2024-04-25T22:42:34.364 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000133428 2024-04-25T22:42:34.364 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.365 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.365 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:34.365 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758576+0000", 2024-04-25T22:42:34.365 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020177899999999999 2024-04-25T22:42:34.365 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.365 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.365 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:34.365 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760626+0000", 2024-04-25T22:42:34.365 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0020501489999999998 2024-04-25T22:42:34.365 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.365 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.365 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.365 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795329+0000", 2024-04-25T22:42:34.365 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034703352999999999 2024-04-25T22:42:34.365 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.365 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.365 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:34.366 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795414+0000", 2024-04-25T22:42:34.366 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5292999999999998e-05 2024-04-25T22:42:34.366 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.366 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.366 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:34.366 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795476+0000", 2024-04-25T22:42:34.366 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1206999999999999e-05 2024-04-25T22:42:34.366 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.366 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.366 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.366 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.366 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.366 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10914 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:34.366 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:34.366 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 21.362532173000002, 2024-04-25T22:42:34.367 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044452984000000001, 2024-04-25T22:42:34.367 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:34.367 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:34.367 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.367 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:34.367 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:34.367 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:34.367 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10914 2024-04-25T22:42:34.367 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.367 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:34.367 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.367 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:34.367 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:34.367 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.367 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.367 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.368 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:34.368 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:34.368 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.368 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.368 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.368 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:34.368 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953871+0000", 2024-04-25T22:42:34.368 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1829999999999999e-06 2024-04-25T22:42:34.368 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.368 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.368 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:34.368 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.962992+0000", 2024-04-25T22:42:34.368 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091217409999999992 2024-04-25T22:42:34.368 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.368 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.368 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:34.368 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963027+0000", 2024-04-25T22:42:34.369 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4229e-05 2024-04-25T22:42:34.369 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.369 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.369 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.369 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963042+0000", 2024-04-25T22:42:34.369 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5152e-05 2024-04-25T22:42:34.369 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.369 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.369 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.369 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963143+0000", 2024-04-25T22:42:34.369 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101171 2024-04-25T22:42:34.369 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.369 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.369 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:34.369 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963269+0000", 2024-04-25T22:42:34.370 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012623499999999999 2024-04-25T22:42:34.370 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.370 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.370 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:34.370 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963453+0000", 2024-04-25T22:42:34.370 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018357900000000001 2024-04-25T22:42:34.370 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.370 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.370 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:34.370 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998133+0000", 2024-04-25T22:42:34.370 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034679789000000003 2024-04-25T22:42:34.370 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.370 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.370 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.370 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998220+0000", 2024-04-25T22:42:34.370 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7153999999999999e-05 2024-04-25T22:42:34.371 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.371 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.371 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:34.371 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998278+0000", 2024-04-25T22:42:34.371 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8035000000000003e-05 2024-04-25T22:42:34.371 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.371 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.371 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:34.371 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998323+0000", 2024-04-25T22:42:34.371 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4715999999999997e-05 2024-04-25T22:42:34.371 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.371 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.371 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.371 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.371 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.371 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10919 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:34.372 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:34.372 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 21.342220892, 2024-04-25T22:42:34.372 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044010552000000001, 2024-04-25T22:42:34.372 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:34.372 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:34.372 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.372 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:34.372 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:34.372 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:34.372 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10919 2024-04-25T22:42:34.372 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.372 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:34.372 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.372 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:34.372 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:34.372 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.373 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.373 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.373 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:34.373 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:34.373 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.373 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.373 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.373 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:34.373 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:34.373 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8100000000000003e-07 2024-04-25T22:42:34.373 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.373 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.373 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:34.373 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980221+0000", 2024-04-25T22:42:34.373 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060397230000000003 2024-04-25T22:42:34.373 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.373 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.374 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:34.374 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980242+0000", 2024-04-25T22:42:34.374 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1373e-05 2024-04-25T22:42:34.374 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.374 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.374 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.374 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980252+0000", 2024-04-25T22:42:34.374 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9990000000000003e-06 2024-04-25T22:42:34.374 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.374 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.374 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.374 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981303+0000", 2024-04-25T22:42:34.374 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010501670000000001 2024-04-25T22:42:34.374 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.374 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.375 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:34.375 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981444+0000", 2024-04-25T22:42:34.375 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014123799999999999 2024-04-25T22:42:34.375 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.375 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.375 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:34.375 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981585+0000", 2024-04-25T22:42:34.375 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014071999999999999 2024-04-25T22:42:34.375 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.375 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.375 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:34.375 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003640+0000", 2024-04-25T22:42:34.375 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022055113000000001 2024-04-25T22:42:34.375 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.375 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.375 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.375 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018070+0000", 2024-04-25T22:42:34.376 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014430877 2024-04-25T22:42:34.376 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.376 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.376 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:34.376 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018138+0000", 2024-04-25T22:42:34.376 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7743000000000005e-05 2024-04-25T22:42:34.376 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.376 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.376 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:34.376 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018191+0000", 2024-04-25T22:42:34.376 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3118000000000002e-05 2024-04-25T22:42:34.376 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.376 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.376 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.376 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.376 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.377 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:12632 4.a e64/17 4:506aad5d:::1000000310f.00000000:head v 64'203, mlcod=64'201)", 2024-04-25T22:42:34.377 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:34.377 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 18.672872497, 2024-04-25T22:42:34.377 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041913617, 2024-04-25T22:42:34.377 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:34.377 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:34.377 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.377 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:34.377 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.377 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:34.377 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:34.377 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.377 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.377 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.377 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:34.377 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:34.378 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.378 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.378 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.378 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:34.378 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643531+0000", 2024-04-25T22:42:34.378 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.497e-06 2024-04-25T22:42:34.378 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.378 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.378 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:34.378 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650159+0000", 2024-04-25T22:42:34.378 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066287059999999998 2024-04-25T22:42:34.378 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.378 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.378 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:34.378 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650185+0000", 2024-04-25T22:42:34.379 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5646000000000001e-05 2024-04-25T22:42:34.379 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.379 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.379 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.379 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650205+0000", 2024-04-25T22:42:34.379 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9720000000000001e-05 2024-04-25T22:42:34.379 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.379 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.379 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.379 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650521+0000", 2024-04-25T22:42:34.379 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00031590699999999998 2024-04-25T22:42:34.379 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.379 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.379 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:34.379 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650574+0000", 2024-04-25T22:42:34.379 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3192000000000002e-05 2024-04-25T22:42:34.379 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.380 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.380 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:34.380 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685374+0000", 2024-04-25T22:42:34.380 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034799902000000001 2024-04-25T22:42:34.380 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.380 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.380 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:34.380 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685443+0000", 2024-04-25T22:42:34.380 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9047000000000005e-05 2024-04-25T22:42:34.380 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.380 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.380 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.380 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.380 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.380 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12644 4.11 4:8893db93:::100000034c2.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:34.380 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:34.380 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 18.664463606999998, 2024-04-25T22:42:34.381 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045039497999999997, 2024-04-25T22:42:34.381 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:34.381 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:34.381 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.381 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:34.381 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:34.381 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:34.381 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12644 2024-04-25T22:42:34.381 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.381 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:34.381 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.381 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:34.381 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:34.381 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.381 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.381 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.382 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:34.382 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:34.382 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.382 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.382 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.382 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:34.382 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651940+0000", 2024-04-25T22:42:34.382 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.013e-06 2024-04-25T22:42:34.382 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.382 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.382 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:34.382 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659663+0000", 2024-04-25T22:42:34.382 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077228150000000001 2024-04-25T22:42:34.382 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.382 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.382 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:34.383 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659694+0000", 2024-04-25T22:42:34.383 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1112999999999998e-05 2024-04-25T22:42:34.383 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.383 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.383 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.383 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659715+0000", 2024-04-25T22:42:34.383 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1053e-05 2024-04-25T22:42:34.383 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.383 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.383 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.383 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659842+0000", 2024-04-25T22:42:34.383 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012738100000000001 2024-04-25T22:42:34.383 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.383 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.383 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:34.383 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660068+0000", 2024-04-25T22:42:34.384 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000225746 2024-04-25T22:42:34.384 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.384 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.384 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:34.384 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660307+0000", 2024-04-25T22:42:34.384 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000238352 2024-04-25T22:42:34.384 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.384 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.384 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:34.384 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.683776+0000", 2024-04-25T22:42:34.384 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023469891999999999 2024-04-25T22:42:34.384 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.384 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.384 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.384 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696810+0000", 2024-04-25T22:42:34.384 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013033385999999999 2024-04-25T22:42:34.384 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.385 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.385 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:34.385 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696904+0000", 2024-04-25T22:42:34.385 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3820000000000006e-05 2024-04-25T22:42:34.385 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.385 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.385 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:34.385 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696978+0000", 2024-04-25T22:42:34.385 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3926999999999999e-05 2024-04-25T22:42:34.385 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.385 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.385 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.385 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.385 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.385 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12645 4.2d 4:b45456a9:::10000003241.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:34.385 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:34.386 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 18.656643119999998, 2024-04-25T22:42:34.386 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.043099660999999997, 2024-04-25T22:42:34.386 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:34.386 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:34.386 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.386 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:34.386 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:34.386 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:34.386 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12645 2024-04-25T22:42:34.386 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.386 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:34.386 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.386 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:34.386 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:34.386 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.387 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.387 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.387 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:34.387 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:34.387 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.387 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.387 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.387 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:34.387 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659761+0000", 2024-04-25T22:42:34.387 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8459999999999999e-06 2024-04-25T22:42:34.387 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.387 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.387 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:34.387 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666663+0000", 2024-04-25T22:42:34.387 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0069017080000000003 2024-04-25T22:42:34.387 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.387 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.388 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:34.388 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666684+0000", 2024-04-25T22:42:34.388 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0706000000000001e-05 2024-04-25T22:42:34.388 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.388 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.388 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.388 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666700+0000", 2024-04-25T22:42:34.388 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5985999999999999e-05 2024-04-25T22:42:34.388 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.388 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.388 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.388 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666914+0000", 2024-04-25T22:42:34.388 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000213861 2024-04-25T22:42:34.388 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.388 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.388 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:34.388 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.667082+0000", 2024-04-25T22:42:34.389 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016809 2024-04-25T22:42:34.389 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.389 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:34.389 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702598+0000", 2024-04-25T22:42:34.389 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035515962999999998 2024-04-25T22:42:34.389 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.389 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:34.389 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702705+0000", 2024-04-25T22:42:34.389 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010689800000000001 2024-04-25T22:42:34.389 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.389 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.389 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:34.389 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702858+0000", 2024-04-25T22:42:34.389 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015360300000000001 2024-04-25T22:42:34.389 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.390 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.390 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.390 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.390 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.390 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12829 4.3b 4:de8bdadd:::100000033c7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:34.390 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:34.390 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 18.428383204999999, 2024-04-25T22:42:34.390 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042457306, 2024-04-25T22:42:34.390 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:34.390 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:34.390 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.390 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:34.390 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:34.390 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:34.390 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12829 2024-04-25T22:42:34.390 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.390 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:34.391 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.391 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:34.391 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:34.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.391 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.391 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.391 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:34.391 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:34.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.391 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.391 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.391 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:34.391 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888019+0000", 2024-04-25T22:42:34.391 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3300000000000002e-07 2024-04-25T22:42:34.391 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.391 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.392 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:34.392 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891638+0000", 2024-04-25T22:42:34.392 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036189109999999998 2024-04-25T22:42:34.392 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.392 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.392 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:34.392 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891661+0000", 2024-04-25T22:42:34.392 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3345000000000001e-05 2024-04-25T22:42:34.392 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.392 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.392 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.392 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891671+0000", 2024-04-25T22:42:34.392 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0115000000000001e-05 2024-04-25T22:42:34.392 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.392 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.392 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.392 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891737+0000", 2024-04-25T22:42:34.393 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5600999999999998e-05 2024-04-25T22:42:34.393 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.393 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.393 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:34.393 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891856+0000", 2024-04-25T22:42:34.393 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011881 2024-04-25T22:42:34.393 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.393 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.393 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:34.393 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930251+0000", 2024-04-25T22:42:34.393 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.038395141000000001 2024-04-25T22:42:34.393 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.393 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.393 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:34.393 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930389+0000", 2024-04-25T22:42:34.393 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013849000000000001 2024-04-25T22:42:34.394 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.394 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.394 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:34.394 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930476+0000", 2024-04-25T22:42:34.394 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6360000000000007e-05 2024-04-25T22:42:34.394 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.394 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.394 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.394 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.394 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.394 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13009 4.1e 4:78728bd7:::100000033a5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:34.394 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:34.394 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 18.226496192999999, 2024-04-25T22:42:34.394 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049997452999999997, 2024-04-25T22:42:34.394 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:34.395 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:34.395 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.395 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:34.395 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:34.395 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:34.395 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13009 2024-04-25T22:42:34.395 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.395 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:34.395 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.395 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:34.395 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:34.395 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.395 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.395 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.395 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:34.395 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:34.395 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4799999999999997e-07 2024-04-25T22:42:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097105+0000", 2024-04-25T22:42:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071984060000000001 2024-04-25T22:42:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097118+0000", 2024-04-25T22:42:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2865e-05 2024-04-25T22:42:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097127+0000", 2024-04-25T22:42:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8449999999999998e-06 2024-04-25T22:42:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097174+0000", 2024-04-25T22:42:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6084000000000001e-05 2024-04-25T22:42:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097232+0000", 2024-04-25T22:42:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8928999999999998e-05 2024-04-25T22:42:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:34.398 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097309+0000", 2024-04-25T22:42:34.398 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7014999999999994e-05 2024-04-25T22:42:34.398 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.398 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.398 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:34.398 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.108708+0000", 2024-04-25T22:42:34.398 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011398233000000001 2024-04-25T22:42:34.398 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.398 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.398 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.398 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139793+0000", 2024-04-25T22:42:34.398 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031084856000000001 2024-04-25T22:42:34.398 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.398 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.398 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:34.399 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139848+0000", 2024-04-25T22:42:34.399 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5464000000000003e-05 2024-04-25T22:42:34.399 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.399 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.399 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:34.399 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139903+0000", 2024-04-25T22:42:34.399 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4907999999999997e-05 2024-04-25T22:42:34.399 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.399 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.399 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.399 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.399 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.399 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13318 4.16 4:6810bf9e:::10000003259.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:34.399 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:34.399 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 17.855921835, 2024-04-25T22:42:34.399 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057538179000000002, 2024-04-25T22:42:34.399 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:34.400 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:34.400 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.400 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:34.400 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:34.400 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:34.400 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13318 2024-04-25T22:42:34.400 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.400 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:34.400 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.400 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:34.400 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:34.400 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.400 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.400 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.400 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:34.400 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:34.400 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.401 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.401 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:34.401 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460481+0000", 2024-04-25T22:42:34.401 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:42:34.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.401 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.401 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:34.401 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466775+0000", 2024-04-25T22:42:34.401 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062944239999999999 2024-04-25T22:42:34.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.401 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.401 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:34.401 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466787+0000", 2024-04-25T22:42:34.401 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1688999999999999e-05 2024-04-25T22:42:34.401 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.402 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466793+0000", 2024-04-25T22:42:34.402 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7209999999999999e-06 2024-04-25T22:42:34.402 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.402 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466845+0000", 2024-04-25T22:42:34.402 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2166999999999997e-05 2024-04-25T22:42:34.402 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.402 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.402 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:34.402 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466912+0000", 2024-04-25T22:42:34.402 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7016999999999999e-05 2024-04-25T22:42:34.402 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.403 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.403 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:34.403 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.467020+0000", 2024-04-25T22:42:34.403 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010827699999999999 2024-04-25T22:42:34.403 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.403 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.403 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:34.403 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.476718+0000", 2024-04-25T22:42:34.403 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0096980439999999994 2024-04-25T22:42:34.403 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.403 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.403 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.403 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517860+0000", 2024-04-25T22:42:34.403 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041141847000000002 2024-04-25T22:42:34.403 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.403 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.403 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:34.404 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517924+0000", 2024-04-25T22:42:34.404 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3997000000000004e-05 2024-04-25T22:42:34.404 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.404 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.404 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:34.404 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.518018+0000", 2024-04-25T22:42:34.404 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4139000000000001e-05 2024-04-25T22:42:34.404 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.404 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.404 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.404 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.404 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.404 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13328 4.16 4:6a9ab238:::1000000339b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:34.404 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:34.404 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 17.83700885, 2024-04-25T22:42:34.404 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057072695999999999, 2024-04-25T22:42:34.404 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:34.405 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:34.405 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.405 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:34.405 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:34.405 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:34.405 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13328 2024-04-25T22:42:34.405 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.405 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:34.405 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.405 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:34.405 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:34.405 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.405 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.405 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.405 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:34.405 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:34.406 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.406 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.406 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.406 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:34.406 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479395+0000", 2024-04-25T22:42:34.406 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2859999999999998e-06 2024-04-25T22:42:34.406 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.406 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.406 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:34.406 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486667+0000", 2024-04-25T22:42:34.406 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072715599999999998 2024-04-25T22:42:34.406 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.406 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.406 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:34.406 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486677+0000", 2024-04-25T22:42:34.407 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0305e-05 2024-04-25T22:42:34.407 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.407 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.407 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.407 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486683+0000", 2024-04-25T22:42:34.407 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5300000000000004e-06 2024-04-25T22:42:34.407 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.407 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.407 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.407 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486768+0000", 2024-04-25T22:42:34.407 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5725999999999999e-05 2024-04-25T22:42:34.407 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.407 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.407 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:34.407 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486905+0000", 2024-04-25T22:42:34.407 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013696699999999999 2024-04-25T22:42:34.408 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.408 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.408 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:34.408 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.487121+0000", 2024-04-25T22:42:34.408 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021615299999999999 2024-04-25T22:42:34.408 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.408 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.408 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:34.408 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.509675+0000", 2024-04-25T22:42:34.408 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022553225999999999 2024-04-25T22:42:34.408 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.408 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.408 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.408 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536355+0000", 2024-04-25T22:42:34.408 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026680855 2024-04-25T22:42:34.408 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.408 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.409 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:34.409 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536401+0000", 2024-04-25T22:42:34.409 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5649000000000003e-05 2024-04-25T22:42:34.409 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.409 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.409 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:34.409 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536466+0000", 2024-04-25T22:42:34.409 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4438999999999997e-05 2024-04-25T22:42:34.409 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.409 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.409 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.409 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.409 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.409 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13329 4.26 4:64e005a2:::10000003483.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:34.409 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:34.409 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 17.829700451000001, 2024-04-25T22:42:34.410 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066502845000000005, 2024-04-25T22:42:34.410 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:34.410 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:34.410 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.410 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:34.410 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:34.410 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:34.410 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13329 2024-04-25T22:42:34.410 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.410 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:34.410 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.410 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:34.410 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:34.410 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.411 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.411 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.411 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:34.411 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:34.411 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.411 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.411 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.411 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:34.411 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486703+0000", 2024-04-25T22:42:34.411 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3909999999999999e-06 2024-04-25T22:42:34.411 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.411 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.411 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:34.411 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494612+0000", 2024-04-25T22:42:34.411 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0079096670000000004 2024-04-25T22:42:34.411 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.412 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:34.412 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494626+0000", 2024-04-25T22:42:34.412 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3263e-05 2024-04-25T22:42:34.412 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.412 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.412 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494637+0000", 2024-04-25T22:42:34.412 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.171e-05 2024-04-25T22:42:34.412 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.412 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.412 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494720+0000", 2024-04-25T22:42:34.412 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2767000000000002e-05 2024-04-25T22:42:34.412 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.412 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.413 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:34.413 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494834+0000", 2024-04-25T22:42:34.413 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011387699999999999 2024-04-25T22:42:34.413 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.413 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.413 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:34.413 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494998+0000", 2024-04-25T22:42:34.413 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016390799999999999 2024-04-25T22:42:34.413 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.413 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.413 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:34.413 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517407+0000", 2024-04-25T22:42:34.413 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022409068000000001 2024-04-25T22:42:34.413 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.413 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.413 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.414 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553040+0000", 2024-04-25T22:42:34.414 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035633155 2024-04-25T22:42:34.414 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.414 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.414 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:34.414 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553140+0000", 2024-04-25T22:42:34.414 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9623000000000005e-05 2024-04-25T22:42:34.414 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.414 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.414 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:34.414 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553204+0000", 2024-04-25T22:42:34.414 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4416000000000001e-05 2024-04-25T22:42:34.414 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.414 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.414 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.415 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.415 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.415 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13399 4.16 4:6bb7cc3a:::10000003648.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:34.415 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:34.415 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 17.756334651, 2024-04-25T22:42:34.415 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045625003999999997, 2024-04-25T22:42:34.415 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:34.415 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:34.415 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.415 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:34.415 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:34.415 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:34.415 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13399 2024-04-25T22:42:34.415 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.415 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:34.415 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.416 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:34.416 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:34.416 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.416 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.416 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.416 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:34.416 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:34.416 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:34.416 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.416 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.416 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:34.416 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560068+0000", 2024-04-25T22:42:34.416 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:42:34.416 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.416 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.416 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:34.417 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576902+0000", 2024-04-25T22:42:34.417 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016833806 2024-04-25T22:42:34.417 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.417 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.417 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:34.417 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576916+0000", 2024-04-25T22:42:34.417 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3648e-05 2024-04-25T22:42:34.417 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.417 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.417 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.417 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576927+0000", 2024-04-25T22:42:34.417 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0992000000000001e-05 2024-04-25T22:42:34.417 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.417 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.417 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:34.418 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577026+0000", 2024-04-25T22:42:34.418 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9116000000000004e-05 2024-04-25T22:42:34.418 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.418 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.418 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:34.418 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577203+0000", 2024-04-25T22:42:34.418 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017700499999999999 2024-04-25T22:42:34.418 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.418 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.418 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:34.418 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577336+0000", 2024-04-25T22:42:34.418 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013340800000000001 2024-04-25T22:42:34.418 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.418 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.418 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:34.419 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.589077+0000", 2024-04-25T22:42:34.419 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011741151 2024-04-25T22:42:34.419 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.419 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.419 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.419 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605436+0000", 2024-04-25T22:42:34.419 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016359146000000001 2024-04-25T22:42:34.419 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.419 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.419 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:34.419 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605493+0000", 2024-04-25T22:42:34.419 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7067000000000001e-05 2024-04-25T22:42:34.419 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:34.419 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:34.419 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:34.419 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605692+0000", 2024-04-25T22:42:34.419 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00019855799999999999 2024-04-25T22:42:34.420 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.420 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.420 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.420 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:34.420 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:34.420 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:34.421 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is unset 2024-04-25T22:42:34.421 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:34.422 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:34.415+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:34.522 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:34.519+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:34.557 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:34.558 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:34.558 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:42:34.558 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:34.571 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:34.661 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:34.659+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:34.724 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:34.719+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:34.734 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:34.734 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:34.734 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:42:34.735 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:42:34.735 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:34.748 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:34.837 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:34.835+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:34.926 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:34.923+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:34.940 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:34.940 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:42:34.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:42:34.940 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:34.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.940 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:34.940 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:34.940 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 140.34189315500001, 2024-04-25T22:42:34.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:42:34.940 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:34.940 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:34.941 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.941 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:34.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:34.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:34.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:34.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:34.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:34.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:42:34.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:42:34.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:34.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:42:34.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:42:34.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:34.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:42:34.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:42:34.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:42:34.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:42:34.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:34.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:42:34.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:42:34.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:34.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:42:34.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:42:34.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:34.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:42:34.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:42:34.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:34.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:42:34.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:42:34.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:34.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:42:34.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:42:34.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:42:34.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:42:34.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:34.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:42:34.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:42:34.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:34.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:42:34.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:42:34.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:34.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:42:34.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:42:34.945 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.945 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:34.945 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.946 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:34.946 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:34.946 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 140.34178484200001, 2024-04-25T22:42:34.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:42:34.946 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:34.946 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:34.946 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.946 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:34.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:34.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:34.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:34.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:34.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:34.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:42:34.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:42:34.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:34.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:42:34.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:42:34.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:34.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:42:34.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:42:34.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:42:34.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:42:34.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:34.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:42:34.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:42:34.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:34.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:42:34.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:42:34.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:34.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:42:34.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:42:34.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:34.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:42:34.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:42:34.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:34.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:42:34.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:42:34.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:42:34.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:42:34.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:34.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:42:34.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:42:34.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:34.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:42:34.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:42:34.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:34.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:42:34.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:42:34.951 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.951 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:34.951 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.951 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:34.951 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:34.951 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 140.34171818600001, 2024-04-25T22:42:34.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:42:34.951 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:34.951 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:34.951 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.951 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:34.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:34.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:34.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:34.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:34.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:34.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:42:34.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:42:34.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:34.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:42:34.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:42:34.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:34.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:42:34.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:42:34.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:42:34.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:42:34.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:34.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:42:34.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:42:34.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:34.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:42:34.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:42:34.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:34.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:42:34.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:42:34.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:34.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:42:34.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:42:34.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:34.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:42:34.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:42:34.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:42:34.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:42:34.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:34.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:42:34.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:42:34.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:34.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:42:34.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:42:34.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:34.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:42:34.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:42:34.956 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.956 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:34.956 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.956 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:34.956 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:34.957 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 140.34162759, 2024-04-25T22:42:34.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:42:34.957 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:34.957 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:34.957 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.957 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:34.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:34.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:34.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:34.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:34.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:34.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:42:34.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:42:34.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:34.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:42:34.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:42:34.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:34.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:42:34.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:42:34.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:42:34.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:42:34.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:34.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:42:34.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:42:34.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:34.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:42:34.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:42:34.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:34.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:42:34.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:42:34.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:34.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:42:34.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:42:34.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:34.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:42:34.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:42:34.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:34.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:42:34.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:42:34.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:42:34.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:42:34.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:34.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:42:34.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:42:34.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:34.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:42:34.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:42:34.961 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.962 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:34.962 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.962 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:34.962 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:34.962 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 140.341563017, 2024-04-25T22:42:34.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:42:34.962 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:34.962 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:34.962 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.962 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:34.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:34.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:34.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:34.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:34.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:34.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:42:34.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:42:34.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:34.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:42:34.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:42:34.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:34.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:42:34.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:42:34.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:42:34.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:42:34.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:34.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:34.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:42:34.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:34.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:42:34.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:42:34.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:34.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:42:34.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:42:34.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:34.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:42:34.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:42:34.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:34.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:42:34.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:42:34.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:42:34.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:42:34.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:34.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:42:34.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:42:34.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:34.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:42:34.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:42:34.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:34.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:42:34.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:42:34.967 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.967 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:34.967 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.967 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:34.967 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:34.968 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 140.341497594, 2024-04-25T22:42:34.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:42:34.968 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:34.968 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:34.968 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.968 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:34.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:34.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:34.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:34.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:34.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:34.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:42:34.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:34.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:34.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:42:34.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:42:34.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:34.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:42:34.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:42:34.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:42:34.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:42:34.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:34.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:42:34.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:42:34.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:34.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:42:34.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:42:34.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:34.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:42:34.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:42:34.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:34.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:42:34.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:42:34.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:34.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:42:34.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:42:34.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:34.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:42:34.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:42:34.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:42:34.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:42:34.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:34.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:42:34.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:42:34.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:34.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:42:34.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:42:34.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.973 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:34.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.973 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:34.973 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:34.973 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 140.34121705999999, 2024-04-25T22:42:34.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:42:34.973 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:34.973 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:34.973 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.973 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:34.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:34.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:34.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:34.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:34.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:34.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:42:34.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:42:34.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:34.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:42:34.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:42:34.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:34.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:42:34.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:42:34.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:42:34.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:42:34.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:34.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:42:34.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:42:34.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:34.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:42:34.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:42:34.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:34.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:42:34.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:42:34.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:34.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:42:34.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:42:34.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:34.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:42:34.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:42:34.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:42:34.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:42:34.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:34.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:42:34.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:42:34.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:34.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:42:34.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:42:34.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:34.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:42:34.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:42:34.978 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.978 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:34.978 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.978 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10678 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:34.978 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:34.978 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.449932320999999, 2024-04-25T22:42:34.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050477795999999998, 2024-04-25T22:42:34.979 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:34.979 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:34.979 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.979 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:34.979 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:34.979 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:34.979 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10678 2024-04-25T22:42:34.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.979 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:34.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:34.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:34.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:34.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:34.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:34.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488127+0000", 2024-04-25T22:42:34.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.716e-06 2024-04-25T22:42:34.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:34.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496392+0000", 2024-04-25T22:42:34.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082651500000000006 2024-04-25T22:42:34.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:34.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496428+0000", 2024-04-25T22:42:34.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5441999999999997e-05 2024-04-25T22:42:34.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496451+0000", 2024-04-25T22:42:34.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3529000000000001e-05 2024-04-25T22:42:34.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:34.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496601+0000", 2024-04-25T22:42:34.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014935600000000001 2024-04-25T22:42:34.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:34.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496856+0000", 2024-04-25T22:42:34.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025537900000000002 2024-04-25T22:42:34.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:34.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.497206+0000", 2024-04-25T22:42:34.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000350599 2024-04-25T22:42:34.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538231+0000", 2024-04-25T22:42:34.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041024146999999997 2024-04-25T22:42:34.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:34.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538298+0000", 2024-04-25T22:42:34.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7688000000000007e-05 2024-04-25T22:42:34.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:34.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538467+0000", 2024-04-25T22:42:34.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000168178 2024-04-25T22:42:34.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:34.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538603+0000", 2024-04-25T22:42:34.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013661200000000001 2024-04-25T22:42:34.983 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.983 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:34.983 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.983 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10692 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:34.984 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:34.984 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.433342527000001, 2024-04-25T22:42:34.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.061242408999999998, 2024-04-25T22:42:34.984 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:34.984 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:34.984 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.984 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:34.984 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:34.984 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:34.984 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10692 2024-04-25T22:42:34.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.984 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:34.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:34.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:34.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:34.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:34.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:34.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504717+0000", 2024-04-25T22:42:34.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6199999999999999e-06 2024-04-25T22:42:34.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:34.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511770+0000", 2024-04-25T22:42:34.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0070530929999999999 2024-04-25T22:42:34.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:34.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511810+0000", 2024-04-25T22:42:34.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0635e-05 2024-04-25T22:42:34.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511837+0000", 2024-04-25T22:42:34.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6423000000000001e-05 2024-04-25T22:42:34.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:34.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520096+0000", 2024-04-25T22:42:34.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082593730000000004 2024-04-25T22:42:34.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:34.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520345+0000", 2024-04-25T22:42:34.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024908800000000001 2024-04-25T22:42:34.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:34.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520794+0000", 2024-04-25T22:42:34.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000449023 2024-04-25T22:42:34.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:34.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538675+0000", 2024-04-25T22:42:34.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017880991999999998 2024-04-25T22:42:34.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565761+0000", 2024-04-25T22:42:34.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027085260999999999 2024-04-25T22:42:34.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:34.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565892+0000", 2024-04-25T22:42:34.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013152300000000001 2024-04-25T22:42:34.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:34.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565958+0000", 2024-04-25T22:42:34.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5377999999999996e-05 2024-04-25T22:42:34.988 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.988 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:34.988 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.989 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10693 4.2c 4:36971e45:::100000030bd.00000001:head [write 971225~86041] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:34.989 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:34.989 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.426164164999999, 2024-04-25T22:42:34.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054529782999999998, 2024-04-25T22:42:34.989 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:34.989 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:34.989 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.989 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:34.989 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:34.989 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:34.989 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10693 2024-04-25T22:42:34.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.989 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:34.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:34.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:34.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:34.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:34.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:34.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511897+0000", 2024-04-25T22:42:34.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2499999999999998e-06 2024-04-25T22:42:34.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:34.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512094+0000", 2024-04-25T22:42:34.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019700100000000001 2024-04-25T22:42:34.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:34.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512121+0000", 2024-04-25T22:42:34.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7288999999999999e-05 2024-04-25T22:42:34.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512137+0000", 2024-04-25T22:42:34.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.592e-05 2024-04-25T22:42:34.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:34.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.533845+0000", 2024-04-25T22:42:34.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021707595999999999 2024-04-25T22:42:34.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:34.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534176+0000", 2024-04-25T22:42:34.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033187000000000001 2024-04-25T22:42:34.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:34.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534626+0000", 2024-04-25T22:42:34.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00045008599999999999 2024-04-25T22:42:34.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:34.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.539165+0000", 2024-04-25T22:42:34.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045386380000000002 2024-04-25T22:42:34.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566169+0000", 2024-04-25T22:42:34.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027004199 2024-04-25T22:42:34.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:34.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566317+0000", 2024-04-25T22:42:34.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014747999999999999 2024-04-25T22:42:34.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:34.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566423+0000", 2024-04-25T22:42:34.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010645399999999999 2024-04-25T22:42:34.993 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.993 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:34.993 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.994 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10696 4.2b 4:d56d2a96:::100000030c3.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:34.994 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:34.994 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.42445652, 2024-04-25T22:42:34.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052282190999999999, 2024-04-25T22:42:34.994 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:34.994 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:34.994 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.994 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:34.994 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:34.994 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:34.994 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10696 2024-04-25T22:42:34.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.994 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:34.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:34.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:34.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:34.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:34.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:34.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:34.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513603+0000", 2024-04-25T22:42:34.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.283e-06 2024-04-25T22:42:34.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:34.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518647+0000", 2024-04-25T22:42:34.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050440859999999997 2024-04-25T22:42:34.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:34.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518672+0000", 2024-04-25T22:42:34.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4468e-05 2024-04-25T22:42:34.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:34.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518691+0000", 2024-04-25T22:42:34.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9213999999999999e-05 2024-04-25T22:42:34.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:34.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518806+0000", 2024-04-25T22:42:34.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115296 2024-04-25T22:42:34.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:34.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519011+0000", 2024-04-25T22:42:34.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020445700000000001 2024-04-25T22:42:34.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:34.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519207+0000", 2024-04-25T22:42:34.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000196431 2024-04-25T22:42:34.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:34.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531309+0000", 2024-04-25T22:42:34.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012101694 2024-04-25T22:42:34.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:34.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565622+0000", 2024-04-25T22:42:34.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034312976000000002 2024-04-25T22:42:34.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:34.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565769+0000", 2024-04-25T22:42:34.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014715900000000001 2024-04-25T22:42:34.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:34.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565883+0000", 2024-04-25T22:42:34.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000114127 2024-04-25T22:42:34.998 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.999 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:34.999 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:34.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:34.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:34.999 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10701 4.a 4:51b6a63a:::100000030f2.00000000:head [write 0~3014656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:34.999 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:34.999 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.413012510000001, 2024-04-25T22:42:34.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047414393999999999, 2024-04-25T22:42:34.999 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:34.999 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:34.999 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:34.999 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:34.999 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:34.999 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:34.999 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10701 2024-04-25T22:42:34.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.000 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:35.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:35.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:35.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:35.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:35.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:35.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:35.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:35.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525048+0000", 2024-04-25T22:42:35.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0819999999999999e-06 2024-04-25T22:42:35.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:35.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531709+0000", 2024-04-25T22:42:35.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066610929999999999 2024-04-25T22:42:35.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:35.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531751+0000", 2024-04-25T22:42:35.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1650000000000003e-05 2024-04-25T22:42:35.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:35.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531788+0000", 2024-04-25T22:42:35.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7305000000000003e-05 2024-04-25T22:42:35.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:35.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531943+0000", 2024-04-25T22:42:35.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015500600000000001 2024-04-25T22:42:35.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:35.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532086+0000", 2024-04-25T22:42:35.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014238599999999999 2024-04-25T22:42:35.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:35.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532295+0000", 2024-04-25T22:42:35.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020922000000000001 2024-04-25T22:42:35.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:35.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.545987+0000", 2024-04-25T22:42:35.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013692582999999999 2024-04-25T22:42:35.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:35.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572315+0000", 2024-04-25T22:42:35.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026327488 2024-04-25T22:42:35.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:35.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572381+0000", 2024-04-25T22:42:35.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5609000000000002e-05 2024-04-25T22:42:35.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:35.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572460+0000", 2024-04-25T22:42:35.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8972000000000002e-05 2024-04-25T22:42:35.004 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:35.004 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:35.004 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:35.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.004 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:10700 4.11 e63/57 4:88409fbf:::100000030ec.00000000:head v 63'193, mlcod=62'191)", 2024-04-25T22:42:35.004 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:35.004 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.402183053999998, 2024-04-25T22:42:35.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050517667000000002, 2024-04-25T22:42:35.004 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:35.004 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:35.004 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:35.004 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:35.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:35.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:35.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:35.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:35.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:35.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:35.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:35.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535876+0000", 2024-04-25T22:42:35.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0300000000000001e-06 2024-04-25T22:42:35.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:35.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565275+0000", 2024-04-25T22:42:35.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029399033000000001 2024-04-25T22:42:35.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:35.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565358+0000", 2024-04-25T22:42:35.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3403000000000001e-05 2024-04-25T22:42:35.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:35.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565380+0000", 2024-04-25T22:42:35.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1761999999999999e-05 2024-04-25T22:42:35.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:35.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565505+0000", 2024-04-25T22:42:35.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000125153 2024-04-25T22:42:35.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:35.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565550+0000", 2024-04-25T22:42:35.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5479000000000003e-05 2024-04-25T22:42:35.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:35.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586328+0000", 2024-04-25T22:42:35.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020777982 2024-04-25T22:42:35.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:35.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586392+0000", 2024-04-25T22:42:35.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3825000000000006e-05 2024-04-25T22:42:35.008 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:35.008 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:35.008 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:35.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.008 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12632 4.a 4:506aad5d:::1000000310f.00000000:head [write 0~4194304 [2@2043125]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:35.008 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:35.008 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 19.303127927999999, 2024-04-25T22:42:35.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051574097999999999, 2024-04-25T22:42:35.008 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:35.008 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:35.008 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:35.008 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:35.008 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:35.008 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:35.008 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12632 2024-04-25T22:42:35.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.009 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:35.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:35.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:35.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:35.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:35.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:35.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:35.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:35.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634932+0000", 2024-04-25T22:42:35.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1600000000000001e-06 2024-04-25T22:42:35.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:35.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642614+0000", 2024-04-25T22:42:35.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076823000000000004 2024-04-25T22:42:35.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:35.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642660+0000", 2024-04-25T22:42:35.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6016000000000001e-05 2024-04-25T22:42:35.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:35.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642686+0000", 2024-04-25T22:42:35.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5491999999999999e-05 2024-04-25T22:42:35.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:35.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642870+0000", 2024-04-25T22:42:35.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000184045 2024-04-25T22:42:35.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:35.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643122+0000", 2024-04-25T22:42:35.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025242299999999999 2024-04-25T22:42:35.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:35.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643634+0000", 2024-04-25T22:42:35.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051145800000000001 2024-04-25T22:42:35.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:35.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.682287+0000", 2024-04-25T22:42:35.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038653342 2024-04-25T22:42:35.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:35.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686419+0000", 2024-04-25T22:42:35.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0041325169999999996 2024-04-25T22:42:35.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:35.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686464+0000", 2024-04-25T22:42:35.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4171000000000001e-05 2024-04-25T22:42:35.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:35.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686504+0000", 2024-04-25T22:42:35.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0173999999999999e-05 2024-04-25T22:42:35.013 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:35.013 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:35.013 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:35.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.013 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12691 4.39 4:9d0d8843:::100000030ef.00000000:head [write 0~4194304 [3@92787]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:35.013 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:35.013 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 19.207406839000001, 2024-04-25T22:42:35.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045521998000000001, 2024-04-25T22:42:35.013 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:35.013 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:35.013 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:35.013 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:35.014 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:35.014 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:35.014 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12691 2024-04-25T22:42:35.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.014 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:35.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:35.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:35.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:35.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:35.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:35.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:35.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:35.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730653+0000", 2024-04-25T22:42:35.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1799999999999999e-06 2024-04-25T22:42:35.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:35.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738136+0000", 2024-04-25T22:42:35.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0074832789999999998 2024-04-25T22:42:35.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:35.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738169+0000", 2024-04-25T22:42:35.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3115999999999999e-05 2024-04-25T22:42:35.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:35.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738190+0000", 2024-04-25T22:42:35.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1060000000000002e-05 2024-04-25T22:42:35.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:35.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738264+0000", 2024-04-25T22:42:35.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3150000000000003e-05 2024-04-25T22:42:35.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:35.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738333+0000", 2024-04-25T22:42:35.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9314999999999996e-05 2024-04-25T22:42:35.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:35.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738425+0000", 2024-04-25T22:42:35.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2498999999999996e-05 2024-04-25T22:42:35.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:35.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.745181+0000", 2024-04-25T22:42:35.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067553240000000001 2024-04-25T22:42:35.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:35.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776101+0000", 2024-04-25T22:42:35.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.030920033 2024-04-25T22:42:35.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:35.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776140+0000", 2024-04-25T22:42:35.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9706999999999998e-05 2024-04-25T22:42:35.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:35.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776173+0000", 2024-04-25T22:42:35.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2335000000000001e-05 2024-04-25T22:42:35.018 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:35.018 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:35.018 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:35.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.018 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12813 4.18 4:1945bfc2:::10000003578.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:35.018 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:35.018 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 19.068883358000001, 2024-04-25T22:42:35.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054261216000000001, 2024-04-25T22:42:35.018 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:35.019 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:35.019 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:35.019 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:35.019 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:35.019 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:35.019 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12813 2024-04-25T22:42:35.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.019 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:35.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:35.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:35.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:35.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:35.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:35.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:35.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:35.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869175+0000", 2024-04-25T22:42:35.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3200000000000005e-07 2024-04-25T22:42:35.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:35.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872980+0000", 2024-04-25T22:42:35.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038049720000000002 2024-04-25T22:42:35.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:35.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872988+0000", 2024-04-25T22:42:35.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5429999999999994e-06 2024-04-25T22:42:35.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:35.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872993+0000", 2024-04-25T22:42:35.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8570000000000003e-06 2024-04-25T22:42:35.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:35.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873054+0000", 2024-04-25T22:42:35.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0801000000000003e-05 2024-04-25T22:42:35.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:35.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873140+0000", 2024-04-25T22:42:35.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6236999999999994e-05 2024-04-25T22:42:35.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:35.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873271+0000", 2024-04-25T22:42:35.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130541 2024-04-25T22:42:35.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:35.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.884240+0000", 2024-04-25T22:42:35.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010969527 2024-04-25T22:42:35.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:35.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923308+0000", 2024-04-25T22:42:35.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039067317999999997 2024-04-25T22:42:35.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:35.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923373+0000", 2024-04-25T22:42:35.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5055000000000006e-05 2024-04-25T22:42:35.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:35.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923436+0000", 2024-04-25T22:42:35.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2732999999999997e-05 2024-04-25T22:42:35.023 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:35.023 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:35.023 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:35.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.024 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13328 4.16 e65/54 4:6a9ab238:::1000000339b.00000000:head v 65'186, mlcod=65'183)", 2024-04-25T22:42:35.024 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:35.024 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 18.448423290000001, 2024-04-25T22:42:35.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.046438762000000001, 2024-04-25T22:42:35.024 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:35.024 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:35.024 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:35.024 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:35.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:35.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:35.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:35.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:35.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:35.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:35.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:35.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489637+0000", 2024-04-25T22:42:35.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.357e-06 2024-04-25T22:42:35.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:35.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496055+0000", 2024-04-25T22:42:35.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0064181380000000003 2024-04-25T22:42:35.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:35.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496074+0000", 2024-04-25T22:42:35.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8904000000000001e-05 2024-04-25T22:42:35.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:35.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496085+0000", 2024-04-25T22:42:35.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1245e-05 2024-04-25T22:42:35.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:35.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496169+0000", 2024-04-25T22:42:35.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3974000000000006e-05 2024-04-25T22:42:35.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:35.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496203+0000", 2024-04-25T22:42:35.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3679000000000001e-05 2024-04-25T22:42:35.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:35.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536002+0000", 2024-04-25T22:42:35.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039799569 2024-04-25T22:42:35.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:35.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536073+0000", 2024-04-25T22:42:35.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0895999999999993e-05 2024-04-25T22:42:35.027 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:35.027 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:35.028 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:35.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.028 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13338 4.e 4:737b94c2:::1000000338a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:35.028 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:35.028 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 18.442282774999999, 2024-04-25T22:42:35.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047911849999999999, 2024-04-25T22:42:35.028 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:35.028 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:35.028 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:35.028 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:35.028 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:35.028 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:35.028 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13338 2024-04-25T22:42:35.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.028 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:35.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:35.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:35.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:35.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:35.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:35.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:35.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:35.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495776+0000", 2024-04-25T22:42:35.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2399999999999996e-07 2024-04-25T22:42:35.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:35.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503748+0000", 2024-04-25T22:42:35.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079725479999999994 2024-04-25T22:42:35.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:35.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503940+0000", 2024-04-25T22:42:35.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000191249 2024-04-25T22:42:35.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:35.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504061+0000", 2024-04-25T22:42:35.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120982 2024-04-25T22:42:35.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:35.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515564+0000", 2024-04-25T22:42:35.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011503342999999999 2024-04-25T22:42:35.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:35.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515799+0000", 2024-04-25T22:42:35.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000235138 2024-04-25T22:42:35.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:35.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543419+0000", 2024-04-25T22:42:35.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027620167000000001 2024-04-25T22:42:35.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:35.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543522+0000", 2024-04-25T22:42:35.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010254100000000001 2024-04-25T22:42:35.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:35.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543687+0000", 2024-04-25T22:42:35.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016495799999999999 2024-04-25T22:42:35.032 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:35.032 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:35.032 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:35.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.032 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13329 4.26 e65/57 4:64e005a2:::10000003483.00000000:head v 65'226, mlcod=64'224)", 2024-04-25T22:42:35.032 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:35.032 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 18.441680093999999, 2024-04-25T22:42:35.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048871456000000001, 2024-04-25T22:42:35.033 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:35.033 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:35.033 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:35.033 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:35.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:35.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:35.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:35.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:35.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:35.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:35.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:35.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496379+0000", 2024-04-25T22:42:35.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1480000000000001e-06 2024-04-25T22:42:35.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:35.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504870+0000", 2024-04-25T22:42:35.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0084917880000000001 2024-04-25T22:42:35.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:35.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504888+0000", 2024-04-25T22:42:35.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7365999999999999e-05 2024-04-25T22:42:35.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:35.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504899+0000", 2024-04-25T22:42:35.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1516e-05 2024-04-25T22:42:35.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:35.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515953+0000", 2024-04-25T22:42:35.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011054074000000001 2024-04-25T22:42:35.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:35.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515993+0000", 2024-04-25T22:42:35.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9854999999999997e-05 2024-04-25T22:42:35.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:35.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545191+0000", 2024-04-25T22:42:35.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029197323000000001 2024-04-25T22:42:35.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:35.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545249+0000", 2024-04-25T22:42:35.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8386e-05 2024-04-25T22:42:35.036 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:35.036 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:35.036 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:35.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.036 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13713 4.2b 4:d574dbff:::100000031d0.00000001:head [write 0~4194304 [2@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:35.036 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:35.036 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 18.029493976000001, 2024-04-25T22:42:35.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047324328999999998, 2024-04-25T22:42:35.036 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:35.036 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:35.037 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:35.037 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:35.037 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:35.037 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:35.037 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13713 2024-04-25T22:42:35.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.037 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:35.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:35.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:35.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:35.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:35.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:35.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:35.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:35.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908565+0000", 2024-04-25T22:42:35.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.694e-06 2024-04-25T22:42:35.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:35.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916170+0000", 2024-04-25T22:42:35.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076041720000000002 2024-04-25T22:42:35.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:35.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916200+0000", 2024-04-25T22:42:35.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0463999999999998e-05 2024-04-25T22:42:35.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:35.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916209+0000", 2024-04-25T22:42:35.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3079999999999997e-06 2024-04-25T22:42:35.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:35.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916297+0000", 2024-04-25T22:42:35.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8159999999999996e-05 2024-04-25T22:42:35.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:35.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916554+0000", 2024-04-25T22:42:35.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025661800000000002 2024-04-25T22:42:35.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:35.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916794+0000", 2024-04-25T22:42:35.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024013999999999999 2024-04-25T22:42:35.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:35.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.933120+0000", 2024-04-25T22:42:35.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016325559 2024-04-25T22:42:35.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:35.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955612+0000", 2024-04-25T22:42:35.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022491786 2024-04-25T22:42:35.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:35.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955797+0000", 2024-04-25T22:42:35.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018533699999999999 2024-04-25T22:42:35.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:35.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:35.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:35.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955888+0000", 2024-04-25T22:42:35.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1090999999999999e-05 2024-04-25T22:42:35.041 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:35.041 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:35.041 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:35.041 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:35.041 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:35.041 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:35.042 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:42:35.043 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:35.043 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:35.043+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:35.143 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:35.143+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:35.175 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:35.175 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:35.175 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:35.175 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:17995 3.1a 3:5d7bf03a:::200.0000001e:head [write 2058284~19336 [fadvise_dontneed] in=19336b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e71)", 2024-04-25T22:42:35.175 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:35.173600+0000", 2024-04-25T22:42:35.175 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 0.0021486980000000001, 2024-04-25T22:42:35.175 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0021967110000000001, 2024-04-25T22:42:35.176 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:35.176 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:35.176 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:35.176 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:35.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:35.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:35.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:35.173600+0000", 2024-04-25T22:42:35.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:35.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:35.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:35.176 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:35.176 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:35.173600+0000", 2024-04-25T22:42:35.176 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:35.176 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:35.176 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:35.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:35.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:35.173601+0000", 2024-04-25T22:42:35.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2160000000000001e-06 2024-04-25T22:42:35.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:35.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:35.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:35.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:35.173618+0000", 2024-04-25T22:42:35.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7125e-05 2024-04-25T22:42:35.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:35.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:35.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:35.177 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:35.173634+0000", 2024-04-25T22:42:35.177 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6212999999999999e-05 2024-04-25T22:42:35.177 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:35.177 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:35.177 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:35.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:35.173643+0000", 2024-04-25T22:42:35.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3409999999999992e-06 2024-04-25T22:42:35.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:35.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:35.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:35.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:35.173753+0000", 2024-04-25T22:42:35.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000109821 2024-04-25T22:42:35.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:35.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:35.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:35.178 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:35.173883+0000", 2024-04-25T22:42:35.178 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000129438 2024-04-25T22:42:35.178 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:35.178 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:35.178 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:35.179 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:35.175732+0000", 2024-04-25T22:42:35.179 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.001849161 2024-04-25T22:42:35.179 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:35.179 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:35.179 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:35.179 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:35.179 INFO:teuthology.orchestra.run.smithi188.stdout: ], 2024-04-25T22:42:35.179 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 1 2024-04-25T22:42:35.179 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:35.189 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:35.197 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:35.198 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:35.198 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:35.219 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:35.219 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:35.222 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:35.223 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:35.282 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:35.283+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:35.344 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:35.343+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:35.363 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:35.363 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:35.371 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-25T22:42:35.371 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T22:42:35.378 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:35.466 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:35.467+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:35.545 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:35.539+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:35.546 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:35.546 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:35.560 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:35.645 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:35.643+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:35.668 DEBUG:teuthology.parallel:result is None 2024-04-25T22:42:35.669 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T22:42:35.686 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T22:42:35.687 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T22:42:35.698 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T22:42:35.698 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:42:35.698 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T22:42:35.699 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:35.699 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:35.707 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:35.740 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:42:35.740 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T22:42:35.753 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:35.751+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:35.788 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:42:35.848 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:35.843+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:35.853 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:35.853 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:35.873 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:35.948 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:35.947+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:36.030 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:36.030 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:36.044 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:36.049 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:36.047+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:36.140 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:42:36.140 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":71,"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","created":"2024-04-25T22:39:52.303074+0000","modified":"2024-04-25T22:42:34.400519+0000","last_up_change":"2024-04-25T22:41:34.334402+0000","last_in_change":"2024-04-25T22:39:53.230242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:40:03.197725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"error_message":"pool 1 has primary_affinity set to zero on all OSDs","score_acting":0,"score_stable":0}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:40:07.560858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"error_message":"pool 2 has primary_affinity set to zero on all OSDs","score_acting":0,"score_stable":0}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:40:12.431697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"error_message":"pool 3 has primary_affinity set to zero on all OSDs","score_acting":0,"score_stable":0}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:40:12.919828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"error_message":"pool 4 has primary_affinity set to zero on all OSDs","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"73d465b4-5896-4d69-80b1-7e69d31eb455","up":1,"in":1,"weight":1,"primary_affinity":0,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6801","nonce":765118869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6803","nonce":765118869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6807","nonce":765118869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6805","nonce":765118869}]},"public_addr":"172.21.15.122:6801/765118869","cluster_addr":"172.21.15.122:6803/765118869","heartbeat_back_addr":"172.21.15.122:6807/765118869","heartbeat_front_addr":"172.21.15.122:6805/765118869","state":["exists","up"]},{"osd":1,"uuid":"8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5","up":0,"in":1,"weight":1,"primary_affinity":0,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6801","nonce":2387035286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6803","nonce":2387035286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6807","nonce":2387035286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6805","nonce":2387035286}]},"public_addr":"172.21.15.148:6801/2387035286","cluster_addr":"172.21.15.148:6803/2387035286","heartbeat_back_addr":"172.21.15.148:6807/2387035286","heartbeat_front_addr":"172.21.15.148:6805/2387035286","state":["exists"]},{"osd":2,"uuid":"164fc653-2135-4e9b-8826-1716fdba6ea0","up":1,"in":1,"weight":1,"primary_affinity":0,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6801","nonce":368834361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6803","nonce":368834361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6807","nonce":368834361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6805","nonce":368834361}]},"public_addr":"172.21.15.188:6801/368834361","cluster_addr":"172.21.15.188:6803/368834361","heartbeat_back_addr":"172.21.15.188:6807/368834361","heartbeat_front_addr":"172.21.15.188:6805/368834361","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.559393+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.563434+0000","dead_epoch":45},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.557643+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.16","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.16","osds":[2,0]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:42:36.150 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:36.151+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:36.160 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:40:03.197725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'error_message': 'pool 1 has primary_affinity set to zero on all OSDs', 'score_acting': 0, 'score_stable': 0}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:40:07.560858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 has primary_affinity set to zero on all OSDs', 'score_acting': 0, 'score_stable': 0}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:40:12.431697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'error_message': 'pool 3 has primary_affinity set to zero on all OSDs', 'score_acting': 0, 'score_stable': 0}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:40:12.919828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 4 has primary_affinity set to zero on all OSDs', 'score_acting': 0, 'score_stable': 0}}] 2024-04-25T22:42:36.160 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:42:36.172 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:36.172 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:36.186 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:36.251 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:36.251+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:36.310 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:36.311 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:36.325 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:36.351 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:36.347+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:36.440 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:42:36.452 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:36.451+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:36.463 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-04-25T22:42:36.481 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:42:36.488 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:36.488 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:36.503 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:36.553 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:36.551+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:36.635 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:36.635 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:36.650 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:36.654 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:36.651+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:36.755 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:36.751+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:36.766 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:36.766 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:36.779 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:36.849 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-04-25T22:42:36.856 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:36.855+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:36.869 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T22:42:36.956 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:36.951+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:36.977 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:36.977 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:36.991 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:37.057 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:37.055+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:37.121 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:37.121 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:37.135 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:37.159 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-04-25T22:42:37.178 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T22:42:37.179 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:37.179+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:37.224 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:42:37.257 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:37.257 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:37.259 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:37.259+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:37.271 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:37.360 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:37.359+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:37.366 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:37.367 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:37.367 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:37.387 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:37.387 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:37.391 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:37.391 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:37.442 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:37.442 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:37.442 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:37.442 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:37.442 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.442 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:37.443 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:37.443 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 142.843498539, 2024-04-25T22:42:37.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:37.443 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:37.443 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:37.443 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:37.443 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:37.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.443 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:37.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:37.443 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.443 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.443 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.443 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:37.443 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:37.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:37.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:37.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:37.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:37.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:37.444 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:37.444 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.444 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.444 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:37.444 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:37.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:37.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:37.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:37.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:37.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:37.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:37.445 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.445 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.445 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:37.445 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:37.445 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:37.446 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.446 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.446 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:37.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:37.446 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.446 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:37.446 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:37.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:37.446 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.446 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.446 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:37.446 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:37.446 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:37.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.447 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.447 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:37.447 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:37.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:37.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.447 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.447 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:37.447 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:37.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:37.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.447 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.447 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:37.447 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:37.447 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:37.447 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.448 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.448 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:37.448 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:37.448 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:37.448 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.448 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.448 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.448 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.448 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.448 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:37.448 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:37.448 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 142.84336128300001, 2024-04-25T22:42:37.448 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:37.448 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:37.448 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:37.448 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:37.449 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:37.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.449 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:37.449 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:37.449 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.449 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.449 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:37.449 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:37.449 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.449 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.449 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.449 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:37.449 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:37.449 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:37.450 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.450 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.450 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:37.450 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:37.450 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:37.450 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.450 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.450 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:37.450 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:37.450 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:37.450 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.450 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.450 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:37.450 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:37.450 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:37.451 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.451 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.451 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.451 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:37.451 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:37.451 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.451 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.451 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:37.451 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:37.451 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:37.451 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.451 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.451 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.451 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:37.451 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:37.451 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:37.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:37.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:37.452 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:37.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:37.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:37.452 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.452 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:37.452 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:37.452 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:37.452 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.452 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.453 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:37.453 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:37.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:37.453 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.453 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.453 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:37.453 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:37.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:37.453 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.453 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.453 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:37.453 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:37.453 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:37.453 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.453 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.453 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.454 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.454 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.454 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:37.454 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:37.454 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 142.843101115, 2024-04-25T22:42:37.454 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:37.454 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:37.454 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:37.454 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:37.454 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:37.454 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.454 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:37.454 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:37.454 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.455 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:37.455 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:37.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.455 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:37.455 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:37.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:37.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.455 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.455 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:37.455 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:37.455 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:37.455 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.456 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.456 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:37.456 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:37.456 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:37.456 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.456 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.456 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:37.456 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:37.456 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:37.456 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.456 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.456 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.456 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:37.456 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:37.456 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.457 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.457 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:37.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:37.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:37.457 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.457 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.457 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:37.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:37.457 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.457 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.457 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:37.457 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:37.457 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:37.457 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.457 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.458 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:37.458 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:37.458 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:37.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.458 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.458 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:37.458 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:37.458 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:37.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.458 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.458 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:37.458 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:37.458 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:37.458 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.458 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.458 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:37.459 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:37.459 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:37.459 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.459 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.459 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:37.459 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:37.459 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:37.459 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.459 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.459 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.459 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.459 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.459 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:37.459 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:37.459 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 142.84293591599999, 2024-04-25T22:42:37.459 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:37.460 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:37.460 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:37.460 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:37.460 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:37.460 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.460 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:37.460 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:37.460 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.460 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.460 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.460 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:37.460 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:37.460 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.460 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.460 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.461 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:37.461 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:37.461 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:37.461 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.461 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.461 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:37.461 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:37.461 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:37.461 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.461 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.461 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:37.461 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:37.461 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:37.461 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.461 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.461 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:37.462 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:37.462 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:37.462 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.462 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.462 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.462 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:37.462 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:37.462 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.462 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.462 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:37.462 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:37.462 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:37.462 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.462 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:37.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:37.463 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.463 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:37.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:37.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:37.463 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.463 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.463 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:37.463 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:37.463 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:37.463 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.463 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.463 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.464 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.464 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.464 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:37.464 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:37.464 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 142.84287025399999, 2024-04-25T22:42:37.464 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:37.464 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:37.464 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:37.464 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:37.464 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:37.464 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.464 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:37.464 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:37.464 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.464 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.464 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.465 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:37.465 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:37.465 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.465 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.465 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:37.465 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:37.465 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:37.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.465 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.465 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:37.465 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:37.465 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:37.465 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.465 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.466 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:37.466 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:37.466 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:37.466 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.466 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.466 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:37.466 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:37.466 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:37.466 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.466 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.466 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.466 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:37.466 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:37.466 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.466 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.466 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:37.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:37.467 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:37.467 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.467 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.467 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:37.467 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:37.467 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.467 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.467 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:37.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:37.467 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:37.467 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.467 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.467 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:37.467 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:37.468 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:37.468 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.468 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.468 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.468 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.468 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.468 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10700 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:37.468 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:37.468 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.920003037000001, 2024-04-25T22:42:37.468 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066789482999999997, 2024-04-25T22:42:37.468 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:37.468 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:37.468 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:37.468 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:37.468 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:37.468 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:37.469 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10700 2024-04-25T22:42:37.469 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.469 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:37.469 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.469 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:37.469 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:37.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.469 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.469 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.469 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:37.469 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:37.469 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.469 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.469 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.469 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:37.469 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519112+0000", 2024-04-25T22:42:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1399999999999998e-06 2024-04-25T22:42:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527187+0000", 2024-04-25T22:42:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080748899999999995 2024-04-25T22:42:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527232+0000", 2024-04-25T22:42:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4895999999999998e-05 2024-04-25T22:42:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:37.470 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527259+0000", 2024-04-25T22:42:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7331999999999999e-05 2024-04-25T22:42:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529418+0000", 2024-04-25T22:42:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002158765 2024-04-25T22:42:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529572+0000", 2024-04-25T22:42:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015438499999999999 2024-04-25T22:42:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:37.471 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529762+0000", 2024-04-25T22:42:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018998100000000001 2024-04-25T22:42:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.548359+0000", 2024-04-25T22:42:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018596444 2024-04-25T22:42:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585801+0000", 2024-04-25T22:42:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.037442469999999999 2024-04-25T22:42:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585847+0000", 2024-04-25T22:42:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5565000000000002e-05 2024-04-25T22:42:37.472 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585899+0000", 2024-04-25T22:42:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2614999999999997e-05 2024-04-25T22:42:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10714 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.886322073999999, 2024-04-25T22:42:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.048080623000000003, 2024-04-25T22:42:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:37.473 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10714 2024-04-25T22:42:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:37.474 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552792+0000", 2024-04-25T22:42:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:42:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559915+0000", 2024-04-25T22:42:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071231690000000004 2024-04-25T22:42:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559932+0000", 2024-04-25T22:42:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7169000000000001e-05 2024-04-25T22:42:37.475 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559942+0000", 2024-04-25T22:42:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0261999999999999e-05 2024-04-25T22:42:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560018+0000", 2024-04-25T22:42:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5358000000000006e-05 2024-04-25T22:42:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560118+0000", 2024-04-25T22:42:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000100911 2024-04-25T22:42:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.476 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560281+0000", 2024-04-25T22:42:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016288500000000001 2024-04-25T22:42:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.579740+0000", 2024-04-25T22:42:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019458598000000001 2024-04-25T22:42:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600484+0000", 2024-04-25T22:42:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020744483000000001 2024-04-25T22:42:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.477 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600664+0000", 2024-04-25T22:42:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017953899999999999 2024-04-25T22:42:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600871+0000", 2024-04-25T22:42:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020737199999999999 2024-04-25T22:42:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10813 4.17 4:e8010137:::100000030b0.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.691373068000001, 2024-04-25T22:42:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.047503799999999999, 2024-04-25T22:42:37.478 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10813 2024-04-25T22:42:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.479 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747741+0000", 2024-04-25T22:42:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1119999999999999e-06 2024-04-25T22:42:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752366+0000", 2024-04-25T22:42:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046253240000000001 2024-04-25T22:42:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.480 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752382+0000", 2024-04-25T22:42:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5639999999999999e-05 2024-04-25T22:42:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752393+0000", 2024-04-25T22:42:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1626e-05 2024-04-25T22:42:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752459+0000", 2024-04-25T22:42:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5309999999999996e-05 2024-04-25T22:42:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:37.481 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752529+0000", 2024-04-25T22:42:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0543000000000005e-05 2024-04-25T22:42:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752637+0000", 2024-04-25T22:42:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010788799999999999 2024-04-25T22:42:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760295+0000", 2024-04-25T22:42:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076583290000000002 2024-04-25T22:42:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.482 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.794990+0000", 2024-04-25T22:42:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034694317000000002 2024-04-25T22:42:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795097+0000", 2024-04-25T22:42:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010768999999999999 2024-04-25T22:42:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795243+0000", 2024-04-25T22:42:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000146021 2024-04-25T22:42:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.483 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10816 4.17 4:e8010137:::100000030b0.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.686043607999999, 2024-04-25T22:42:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042406530999999997, 2024-04-25T22:42:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10816 2024-04-25T22:42:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:37.484 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753070+0000", 2024-04-25T22:42:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9800000000000002e-07 2024-04-25T22:42:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.485 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753288+0000", 2024-04-25T22:42:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000217789 2024-04-25T22:42:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753301+0000", 2024-04-25T22:42:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2764e-05 2024-04-25T22:42:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753310+0000", 2024-04-25T22:42:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:42:37.486 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758240+0000", 2024-04-25T22:42:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049304910000000004 2024-04-25T22:42:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758374+0000", 2024-04-25T22:42:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000133428 2024-04-25T22:42:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758576+0000", 2024-04-25T22:42:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020177899999999999 2024-04-25T22:42:37.487 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760626+0000", 2024-04-25T22:42:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0020501489999999998 2024-04-25T22:42:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795329+0000", 2024-04-25T22:42:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034703352999999999 2024-04-25T22:42:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795414+0000", 2024-04-25T22:42:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5292999999999998e-05 2024-04-25T22:42:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.488 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795476+0000", 2024-04-25T22:42:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1206999999999999e-05 2024-04-25T22:42:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10914 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.485243226000001, 2024-04-25T22:42:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044452984000000001, 2024-04-25T22:42:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:37.489 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10914 2024-04-25T22:42:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.490 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953871+0000", 2024-04-25T22:42:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1829999999999999e-06 2024-04-25T22:42:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.962992+0000", 2024-04-25T22:42:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091217409999999992 2024-04-25T22:42:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963027+0000", 2024-04-25T22:42:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4229e-05 2024-04-25T22:42:37.491 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963042+0000", 2024-04-25T22:42:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5152e-05 2024-04-25T22:42:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963143+0000", 2024-04-25T22:42:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101171 2024-04-25T22:42:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963269+0000", 2024-04-25T22:42:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012623499999999999 2024-04-25T22:42:37.492 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963453+0000", 2024-04-25T22:42:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018357900000000001 2024-04-25T22:42:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998133+0000", 2024-04-25T22:42:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034679789000000003 2024-04-25T22:42:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998220+0000", 2024-04-25T22:42:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7153999999999999e-05 2024-04-25T22:42:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.493 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998278+0000", 2024-04-25T22:42:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8035000000000003e-05 2024-04-25T22:42:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998323+0000", 2024-04-25T22:42:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4715999999999997e-05 2024-04-25T22:42:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.494 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10919 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 24.464931945, 2024-04-25T22:42:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044010552000000001, 2024-04-25T22:42:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10919 2024-04-25T22:42:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.495 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8100000000000003e-07 2024-04-25T22:42:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980221+0000", 2024-04-25T22:42:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060397230000000003 2024-04-25T22:42:37.496 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980242+0000", 2024-04-25T22:42:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1373e-05 2024-04-25T22:42:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980252+0000", 2024-04-25T22:42:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9990000000000003e-06 2024-04-25T22:42:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981303+0000", 2024-04-25T22:42:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010501670000000001 2024-04-25T22:42:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.497 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981444+0000", 2024-04-25T22:42:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014123799999999999 2024-04-25T22:42:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981585+0000", 2024-04-25T22:42:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014071999999999999 2024-04-25T22:42:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003640+0000", 2024-04-25T22:42:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022055113000000001 2024-04-25T22:42:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.498 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018070+0000", 2024-04-25T22:42:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014430877 2024-04-25T22:42:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018138+0000", 2024-04-25T22:42:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7743000000000005e-05 2024-04-25T22:42:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018191+0000", 2024-04-25T22:42:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3118000000000002e-05 2024-04-25T22:42:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.499 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:12632 4.a e64/17 4:506aad5d:::1000000310f.00000000:head v 64'203, mlcod=64'201)", 2024-04-25T22:42:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 21.79558355, 2024-04-25T22:42:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041913617, 2024-04-25T22:42:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.500 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643531+0000", 2024-04-25T22:42:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.497e-06 2024-04-25T22:42:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650159+0000", 2024-04-25T22:42:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066287059999999998 2024-04-25T22:42:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.501 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650185+0000", 2024-04-25T22:42:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5646000000000001e-05 2024-04-25T22:42:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650205+0000", 2024-04-25T22:42:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9720000000000001e-05 2024-04-25T22:42:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650521+0000", 2024-04-25T22:42:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00031590699999999998 2024-04-25T22:42:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.502 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650574+0000", 2024-04-25T22:42:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3192000000000002e-05 2024-04-25T22:42:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685374+0000", 2024-04-25T22:42:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034799902000000001 2024-04-25T22:42:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685443+0000", 2024-04-25T22:42:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9047000000000005e-05 2024-04-25T22:42:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.503 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12644 4.11 4:8893db93:::100000034c2.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 21.787174660000002, 2024-04-25T22:42:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045039497999999997, 2024-04-25T22:42:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12644 2024-04-25T22:42:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.504 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651940+0000", 2024-04-25T22:42:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.013e-06 2024-04-25T22:42:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.505 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659663+0000", 2024-04-25T22:42:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077228150000000001 2024-04-25T22:42:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659694+0000", 2024-04-25T22:42:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1112999999999998e-05 2024-04-25T22:42:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659715+0000", 2024-04-25T22:42:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1053e-05 2024-04-25T22:42:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.506 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659842+0000", 2024-04-25T22:42:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012738100000000001 2024-04-25T22:42:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660068+0000", 2024-04-25T22:42:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000225746 2024-04-25T22:42:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660307+0000", 2024-04-25T22:42:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000238352 2024-04-25T22:42:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:37.507 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.683776+0000", 2024-04-25T22:42:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023469891999999999 2024-04-25T22:42:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696810+0000", 2024-04-25T22:42:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013033385999999999 2024-04-25T22:42:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696904+0000", 2024-04-25T22:42:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3820000000000006e-05 2024-04-25T22:42:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:37.508 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696978+0000", 2024-04-25T22:42:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3926999999999999e-05 2024-04-25T22:42:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12645 4.2d 4:b45456a9:::10000003241.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 21.779354173000002, 2024-04-25T22:42:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.043099660999999997, 2024-04-25T22:42:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:37.509 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12645 2024-04-25T22:42:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.510 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659761+0000", 2024-04-25T22:42:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8459999999999999e-06 2024-04-25T22:42:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666663+0000", 2024-04-25T22:42:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0069017080000000003 2024-04-25T22:42:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666684+0000", 2024-04-25T22:42:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0706000000000001e-05 2024-04-25T22:42:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.511 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666700+0000", 2024-04-25T22:42:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5985999999999999e-05 2024-04-25T22:42:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666914+0000", 2024-04-25T22:42:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000213861 2024-04-25T22:42:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.667082+0000", 2024-04-25T22:42:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016809 2024-04-25T22:42:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.512 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702598+0000", 2024-04-25T22:42:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035515962999999998 2024-04-25T22:42:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702705+0000", 2024-04-25T22:42:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010689800000000001 2024-04-25T22:42:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702858+0000", 2024-04-25T22:42:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015360300000000001 2024-04-25T22:42:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.513 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12829 4.3b 4:de8bdadd:::100000033c7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 21.551094257999999, 2024-04-25T22:42:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042457306, 2024-04-25T22:42:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12829 2024-04-25T22:42:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.514 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888019+0000", 2024-04-25T22:42:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3300000000000002e-07 2024-04-25T22:42:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.515 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891638+0000", 2024-04-25T22:42:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036189109999999998 2024-04-25T22:42:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891661+0000", 2024-04-25T22:42:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3345000000000001e-05 2024-04-25T22:42:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891671+0000", 2024-04-25T22:42:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0115000000000001e-05 2024-04-25T22:42:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.516 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891737+0000", 2024-04-25T22:42:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5600999999999998e-05 2024-04-25T22:42:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891856+0000", 2024-04-25T22:42:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011881 2024-04-25T22:42:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930251+0000", 2024-04-25T22:42:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.038395141000000001 2024-04-25T22:42:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:37.517 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930389+0000", 2024-04-25T22:42:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013849000000000001 2024-04-25T22:42:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930476+0000", 2024-04-25T22:42:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6360000000000007e-05 2024-04-25T22:42:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13009 4.1e 4:78728bd7:::100000033a5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 21.349207245999999, 2024-04-25T22:42:37.518 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049997452999999997, 2024-04-25T22:42:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13009 2024-04-25T22:42:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.519 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4799999999999997e-07 2024-04-25T22:42:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097105+0000", 2024-04-25T22:42:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071984060000000001 2024-04-25T22:42:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:37.520 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097118+0000", 2024-04-25T22:42:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2865e-05 2024-04-25T22:42:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097127+0000", 2024-04-25T22:42:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8449999999999998e-06 2024-04-25T22:42:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097174+0000", 2024-04-25T22:42:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6084000000000001e-05 2024-04-25T22:42:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097232+0000", 2024-04-25T22:42:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8928999999999998e-05 2024-04-25T22:42:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097309+0000", 2024-04-25T22:42:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7014999999999994e-05 2024-04-25T22:42:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.108708+0000", 2024-04-25T22:42:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011398233000000001 2024-04-25T22:42:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139793+0000", 2024-04-25T22:42:37.522 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031084856000000001 2024-04-25T22:42:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139848+0000", 2024-04-25T22:42:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5464000000000003e-05 2024-04-25T22:42:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139903+0000", 2024-04-25T22:42:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4907999999999997e-05 2024-04-25T22:42:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.523 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13318 4.16 4:6810bf9e:::10000003259.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.978632888, 2024-04-25T22:42:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057538179000000002, 2024-04-25T22:42:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13318 2024-04-25T22:42:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.524 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460481+0000", 2024-04-25T22:42:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:42:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.525 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466775+0000", 2024-04-25T22:42:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062944239999999999 2024-04-25T22:42:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466787+0000", 2024-04-25T22:42:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1688999999999999e-05 2024-04-25T22:42:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466793+0000", 2024-04-25T22:42:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7209999999999999e-06 2024-04-25T22:42:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.526 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466845+0000", 2024-04-25T22:42:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2166999999999997e-05 2024-04-25T22:42:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466912+0000", 2024-04-25T22:42:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7016999999999999e-05 2024-04-25T22:42:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.467020+0000", 2024-04-25T22:42:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010827699999999999 2024-04-25T22:42:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.527 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.476718+0000", 2024-04-25T22:42:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0096980439999999994 2024-04-25T22:42:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517860+0000", 2024-04-25T22:42:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041141847000000002 2024-04-25T22:42:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517924+0000", 2024-04-25T22:42:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3997000000000004e-05 2024-04-25T22:42:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.528 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.518018+0000", 2024-04-25T22:42:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4139000000000001e-05 2024-04-25T22:42:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13328 4.16 4:6a9ab238:::1000000339b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.959719903, 2024-04-25T22:42:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057072695999999999, 2024-04-25T22:42:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:37.529 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13328 2024-04-25T22:42:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.530 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479395+0000", 2024-04-25T22:42:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2859999999999998e-06 2024-04-25T22:42:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486667+0000", 2024-04-25T22:42:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072715599999999998 2024-04-25T22:42:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.531 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486677+0000", 2024-04-25T22:42:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0305e-05 2024-04-25T22:42:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486683+0000", 2024-04-25T22:42:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5300000000000004e-06 2024-04-25T22:42:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486768+0000", 2024-04-25T22:42:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5725999999999999e-05 2024-04-25T22:42:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:37.532 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486905+0000", 2024-04-25T22:42:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013696699999999999 2024-04-25T22:42:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.487121+0000", 2024-04-25T22:42:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021615299999999999 2024-04-25T22:42:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.509675+0000", 2024-04-25T22:42:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022553225999999999 2024-04-25T22:42:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536355+0000", 2024-04-25T22:42:37.533 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026680855 2024-04-25T22:42:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536401+0000", 2024-04-25T22:42:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5649000000000003e-05 2024-04-25T22:42:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536466+0000", 2024-04-25T22:42:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4438999999999997e-05 2024-04-25T22:42:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.534 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13329 4.26 4:64e005a2:::10000003483.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.952411504000001, 2024-04-25T22:42:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066502845000000005, 2024-04-25T22:42:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13329 2024-04-25T22:42:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.535 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486703+0000", 2024-04-25T22:42:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3909999999999999e-06 2024-04-25T22:42:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:37.536 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494612+0000", 2024-04-25T22:42:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0079096670000000004 2024-04-25T22:42:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494626+0000", 2024-04-25T22:42:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3263e-05 2024-04-25T22:42:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494637+0000", 2024-04-25T22:42:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.171e-05 2024-04-25T22:42:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494720+0000", 2024-04-25T22:42:37.537 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2767000000000002e-05 2024-04-25T22:42:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494834+0000", 2024-04-25T22:42:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011387699999999999 2024-04-25T22:42:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494998+0000", 2024-04-25T22:42:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016390799999999999 2024-04-25T22:42:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517407+0000", 2024-04-25T22:42:37.538 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022409068000000001 2024-04-25T22:42:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553040+0000", 2024-04-25T22:42:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035633155 2024-04-25T22:42:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553140+0000", 2024-04-25T22:42:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9623000000000005e-05 2024-04-25T22:42:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:37.539 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553204+0000", 2024-04-25T22:42:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4416000000000001e-05 2024-04-25T22:42:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13399 4.16 4:6bb7cc3a:::10000003648.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 20.879045703999999, 2024-04-25T22:42:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045625003999999997, 2024-04-25T22:42:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:37.540 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13399 2024-04-25T22:42:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:37.541 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560068+0000", 2024-04-25T22:42:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:42:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576902+0000", 2024-04-25T22:42:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016833806 2024-04-25T22:42:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576916+0000", 2024-04-25T22:42:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3648e-05 2024-04-25T22:42:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:37.542 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576927+0000", 2024-04-25T22:42:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0992000000000001e-05 2024-04-25T22:42:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577026+0000", 2024-04-25T22:42:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9116000000000004e-05 2024-04-25T22:42:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577203+0000", 2024-04-25T22:42:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017700499999999999 2024-04-25T22:42:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577336+0000", 2024-04-25T22:42:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013340800000000001 2024-04-25T22:42:37.543 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.589077+0000", 2024-04-25T22:42:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011741151 2024-04-25T22:42:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605436+0000", 2024-04-25T22:42:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016359146000000001 2024-04-25T22:42:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605493+0000", 2024-04-25T22:42:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7067000000000001e-05 2024-04-25T22:42:37.544 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605692+0000", 2024-04-25T22:42:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00019855799999999999 2024-04-25T22:42:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:37.545 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:37.547 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is set 2024-04-25T22:42:37.547 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:37.548 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T22:42:37.548 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T22:42:37.549 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:37.543+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:37.647 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:37.643+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:37.679 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:37.679 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:37.680 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:42:37.680 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:37.693 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:37.748 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:37.747+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:37.849 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:37.847+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:37.851 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2024-04-25T22:42:37.857 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:37.857 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:37.857 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:42:37.857 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:42:37.857 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:37.869 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-25T22:42:37.869 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T22:42:37.871 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:37.874 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:42:37.950 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:37.947+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:37.988 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:42:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:42:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 143.39134991099999, 2024-04-25T22:42:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:42:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.065 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:42:38.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:42:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:42:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:42:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:42:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:42:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:42:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:42:38.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:42:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:42:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:42:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:42:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:42:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:42:38.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:42:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:42:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:42:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:42:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:42:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:42:38.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:42:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:42:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:42:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:42:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:42:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:42:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.070 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 143.39124159799999, 2024-04-25T22:42:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:42:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:42:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:42:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:42:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:42:38.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:42:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:42:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:42:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:42:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:42:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:42:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:42:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:42:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:42:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:42:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:42:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:42:38.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:42:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:42:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:42:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:42:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:42:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:42:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:42:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:42:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:42:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:42:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 143.39117494199999, 2024-04-25T22:42:38.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:42:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:42:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:42:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:42:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:42:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:42:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:42:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:42:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:42:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:42:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:42:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:42:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:42:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:42:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:42:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:42:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:42:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:42:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:42:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:42:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:42:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:42:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:42:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:42:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:42:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:42:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:42:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 143.39108434600001, 2024-04-25T22:42:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:42:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:38.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:42:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:42:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:42:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:42:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:42:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:42:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:42:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:42:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:42:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:42:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:42:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:42:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:42:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:42:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:42:38.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:42:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:42:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:42:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:42:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:42:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:42:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:42:38.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:42:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:42:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:42:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:42:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:38.087 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 143.39101977300001, 2024-04-25T22:42:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:42:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:42:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:42:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:42:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:42:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:42:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:42:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:42:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:42:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:42:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:42:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:42:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:42:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:42:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:42:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:42:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:42:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:42:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:42:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:42:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:42:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:42:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:42:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:42:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:38.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:42:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:42:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 143.39095434999999, 2024-04-25T22:42:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:42:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:42:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:38.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:42:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:42:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:42:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:42:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:42:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:42:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:42:38.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:42:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:42:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:42:38.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:42:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:42:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:42:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:42:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:42:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:42:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:42:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:42:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:42:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:42:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:42:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:42:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:42:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:42:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:38.099 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 143.390673816, 2024-04-25T22:42:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:42:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:42:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:42:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:42:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:42:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:42:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:42:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:42:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:42:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:42:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:42:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:42:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:42:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:42:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:42:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:42:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:42:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:42:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:42:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:42:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:42:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:42:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:42:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:42:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:42:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:42:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:42:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10678 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.499389077, 2024-04-25T22:42:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050477795999999998, 2024-04-25T22:42:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:38.105 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10678 2024-04-25T22:42:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488127+0000", 2024-04-25T22:42:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.716e-06 2024-04-25T22:42:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496392+0000", 2024-04-25T22:42:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082651500000000006 2024-04-25T22:42:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496428+0000", 2024-04-25T22:42:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5441999999999997e-05 2024-04-25T22:42:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496451+0000", 2024-04-25T22:42:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3529000000000001e-05 2024-04-25T22:42:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496601+0000", 2024-04-25T22:42:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014935600000000001 2024-04-25T22:42:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496856+0000", 2024-04-25T22:42:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025537900000000002 2024-04-25T22:42:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.497206+0000", 2024-04-25T22:42:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000350599 2024-04-25T22:42:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538231+0000", 2024-04-25T22:42:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041024146999999997 2024-04-25T22:42:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538298+0000", 2024-04-25T22:42:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7688000000000007e-05 2024-04-25T22:42:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538467+0000", 2024-04-25T22:42:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000168178 2024-04-25T22:42:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538603+0000", 2024-04-25T22:42:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013661200000000001 2024-04-25T22:42:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10692 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.482799282999999, 2024-04-25T22:42:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.061242408999999998, 2024-04-25T22:42:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10692 2024-04-25T22:42:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:38.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504717+0000", 2024-04-25T22:42:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6199999999999999e-06 2024-04-25T22:42:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511770+0000", 2024-04-25T22:42:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0070530929999999999 2024-04-25T22:42:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511810+0000", 2024-04-25T22:42:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0635e-05 2024-04-25T22:42:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511837+0000", 2024-04-25T22:42:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6423000000000001e-05 2024-04-25T22:42:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520096+0000", 2024-04-25T22:42:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082593730000000004 2024-04-25T22:42:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520345+0000", 2024-04-25T22:42:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024908800000000001 2024-04-25T22:42:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520794+0000", 2024-04-25T22:42:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000449023 2024-04-25T22:42:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538675+0000", 2024-04-25T22:42:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017880991999999998 2024-04-25T22:42:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565761+0000", 2024-04-25T22:42:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027085260999999999 2024-04-25T22:42:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565892+0000", 2024-04-25T22:42:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013152300000000001 2024-04-25T22:42:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565958+0000", 2024-04-25T22:42:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5377999999999996e-05 2024-04-25T22:42:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10693 4.2c 4:36971e45:::100000030bd.00000001:head [write 971225~86041] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.475620921000001, 2024-04-25T22:42:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054529782999999998, 2024-04-25T22:42:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.116 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10693 2024-04-25T22:42:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511897+0000", 2024-04-25T22:42:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2499999999999998e-06 2024-04-25T22:42:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512094+0000", 2024-04-25T22:42:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019700100000000001 2024-04-25T22:42:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512121+0000", 2024-04-25T22:42:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7288999999999999e-05 2024-04-25T22:42:38.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512137+0000", 2024-04-25T22:42:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.592e-05 2024-04-25T22:42:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.533845+0000", 2024-04-25T22:42:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021707595999999999 2024-04-25T22:42:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534176+0000", 2024-04-25T22:42:38.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033187000000000001 2024-04-25T22:42:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534626+0000", 2024-04-25T22:42:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00045008599999999999 2024-04-25T22:42:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.539165+0000", 2024-04-25T22:42:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045386380000000002 2024-04-25T22:42:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566169+0000", 2024-04-25T22:42:38.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027004199 2024-04-25T22:42:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566317+0000", 2024-04-25T22:42:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014747999999999999 2024-04-25T22:42:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566423+0000", 2024-04-25T22:42:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010645399999999999 2024-04-25T22:42:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10696 4.2b 4:d56d2a96:::100000030c3.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.473913276000001, 2024-04-25T22:42:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052282190999999999, 2024-04-25T22:42:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10696 2024-04-25T22:42:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513603+0000", 2024-04-25T22:42:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.283e-06 2024-04-25T22:42:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:38.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518647+0000", 2024-04-25T22:42:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050440859999999997 2024-04-25T22:42:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518672+0000", 2024-04-25T22:42:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4468e-05 2024-04-25T22:42:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518691+0000", 2024-04-25T22:42:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9213999999999999e-05 2024-04-25T22:42:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518806+0000", 2024-04-25T22:42:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115296 2024-04-25T22:42:38.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519011+0000", 2024-04-25T22:42:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020445700000000001 2024-04-25T22:42:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519207+0000", 2024-04-25T22:42:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000196431 2024-04-25T22:42:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531309+0000", 2024-04-25T22:42:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012101694 2024-04-25T22:42:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565622+0000", 2024-04-25T22:42:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034312976000000002 2024-04-25T22:42:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565769+0000", 2024-04-25T22:42:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014715900000000001 2024-04-25T22:42:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565883+0000", 2024-04-25T22:42:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000114127 2024-04-25T22:42:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.126 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10701 4.a 4:51b6a63a:::100000030f2.00000000:head [write 0~3014656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.462469265999999, 2024-04-25T22:42:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047414393999999999, 2024-04-25T22:42:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.127 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10701 2024-04-25T22:42:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:38.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525048+0000", 2024-04-25T22:42:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0819999999999999e-06 2024-04-25T22:42:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531709+0000", 2024-04-25T22:42:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066610929999999999 2024-04-25T22:42:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531751+0000", 2024-04-25T22:42:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1650000000000003e-05 2024-04-25T22:42:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531788+0000", 2024-04-25T22:42:38.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7305000000000003e-05 2024-04-25T22:42:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531943+0000", 2024-04-25T22:42:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015500600000000001 2024-04-25T22:42:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532086+0000", 2024-04-25T22:42:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014238599999999999 2024-04-25T22:42:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532295+0000", 2024-04-25T22:42:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020922000000000001 2024-04-25T22:42:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.545987+0000", 2024-04-25T22:42:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013692582999999999 2024-04-25T22:42:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572315+0000", 2024-04-25T22:42:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026327488 2024-04-25T22:42:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572381+0000", 2024-04-25T22:42:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5609000000000002e-05 2024-04-25T22:42:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572460+0000", 2024-04-25T22:42:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8972000000000002e-05 2024-04-25T22:42:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:10700 4.11 e63/57 4:88409fbf:::100000030ec.00000000:head v 63'193, mlcod=62'191)", 2024-04-25T22:42:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:38.132 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.45163981, 2024-04-25T22:42:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050517667000000002, 2024-04-25T22:42:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535876+0000", 2024-04-25T22:42:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0300000000000001e-06 2024-04-25T22:42:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565275+0000", 2024-04-25T22:42:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029399033000000001 2024-04-25T22:42:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565358+0000", 2024-04-25T22:42:38.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3403000000000001e-05 2024-04-25T22:42:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565380+0000", 2024-04-25T22:42:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1761999999999999e-05 2024-04-25T22:42:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565505+0000", 2024-04-25T22:42:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000125153 2024-04-25T22:42:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565550+0000", 2024-04-25T22:42:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5479000000000003e-05 2024-04-25T22:42:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586328+0000", 2024-04-25T22:42:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020777982 2024-04-25T22:42:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586392+0000", 2024-04-25T22:42:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3825000000000006e-05 2024-04-25T22:42:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12632 4.a 4:506aad5d:::1000000310f.00000000:head [write 0~4194304 [2@2043125]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:38.136 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.352584684, 2024-04-25T22:42:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051574097999999999, 2024-04-25T22:42:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12632 2024-04-25T22:42:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634932+0000", 2024-04-25T22:42:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1600000000000001e-06 2024-04-25T22:42:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642614+0000", 2024-04-25T22:42:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076823000000000004 2024-04-25T22:42:38.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642660+0000", 2024-04-25T22:42:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6016000000000001e-05 2024-04-25T22:42:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642686+0000", 2024-04-25T22:42:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5491999999999999e-05 2024-04-25T22:42:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642870+0000", 2024-04-25T22:42:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000184045 2024-04-25T22:42:38.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643122+0000", 2024-04-25T22:42:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025242299999999999 2024-04-25T22:42:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643634+0000", 2024-04-25T22:42:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051145800000000001 2024-04-25T22:42:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.682287+0000", 2024-04-25T22:42:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038653342 2024-04-25T22:42:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686419+0000", 2024-04-25T22:42:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0041325169999999996 2024-04-25T22:42:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686464+0000", 2024-04-25T22:42:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4171000000000001e-05 2024-04-25T22:42:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686504+0000", 2024-04-25T22:42:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0173999999999999e-05 2024-04-25T22:42:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.141 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12691 4.39 4:9d0d8843:::100000030ef.00000000:head [write 0~4194304 [3@92787]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.256863594999999, 2024-04-25T22:42:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045521998000000001, 2024-04-25T22:42:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.142 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12691 2024-04-25T22:42:38.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.143 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:38.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:38.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:38.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:38.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:38.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:38.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730653+0000", 2024-04-25T22:42:38.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1799999999999999e-06 2024-04-25T22:42:38.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:38.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738136+0000", 2024-04-25T22:42:38.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0074832789999999998 2024-04-25T22:42:38.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:38.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738169+0000", 2024-04-25T22:42:38.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3115999999999999e-05 2024-04-25T22:42:38.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738190+0000", 2024-04-25T22:42:38.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1060000000000002e-05 2024-04-25T22:42:38.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738264+0000", 2024-04-25T22:42:38.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3150000000000003e-05 2024-04-25T22:42:38.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:38.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738333+0000", 2024-04-25T22:42:38.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9314999999999996e-05 2024-04-25T22:42:38.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:38.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738425+0000", 2024-04-25T22:42:38.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2498999999999996e-05 2024-04-25T22:42:38.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:38.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.745181+0000", 2024-04-25T22:42:38.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067553240000000001 2024-04-25T22:42:38.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776101+0000", 2024-04-25T22:42:38.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.030920033 2024-04-25T22:42:38.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:38.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776140+0000", 2024-04-25T22:42:38.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9706999999999998e-05 2024-04-25T22:42:38.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:38.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776173+0000", 2024-04-25T22:42:38.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2335000000000001e-05 2024-04-25T22:42:38.147 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.147 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.147 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.147 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12813 4.18 4:1945bfc2:::10000003578.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:38.147 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:38.147 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.118340113999999, 2024-04-25T22:42:38.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054261216000000001, 2024-04-25T22:42:38.147 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:38.147 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:38.147 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.148 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:38.148 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:38.148 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.148 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12813 2024-04-25T22:42:38.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.148 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:38.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:38.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:38.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:38.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:38.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:38.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869175+0000", 2024-04-25T22:42:38.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3200000000000005e-07 2024-04-25T22:42:38.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:38.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872980+0000", 2024-04-25T22:42:38.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038049720000000002 2024-04-25T22:42:38.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:38.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872988+0000", 2024-04-25T22:42:38.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5429999999999994e-06 2024-04-25T22:42:38.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872993+0000", 2024-04-25T22:42:38.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8570000000000003e-06 2024-04-25T22:42:38.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873054+0000", 2024-04-25T22:42:38.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0801000000000003e-05 2024-04-25T22:42:38.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:38.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873140+0000", 2024-04-25T22:42:38.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6236999999999994e-05 2024-04-25T22:42:38.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:38.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873271+0000", 2024-04-25T22:42:38.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130541 2024-04-25T22:42:38.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:38.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.884240+0000", 2024-04-25T22:42:38.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010969527 2024-04-25T22:42:38.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923308+0000", 2024-04-25T22:42:38.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039067317999999997 2024-04-25T22:42:38.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:38.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923373+0000", 2024-04-25T22:42:38.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5055000000000006e-05 2024-04-25T22:42:38.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:38.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923436+0000", 2024-04-25T22:42:38.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2732999999999997e-05 2024-04-25T22:42:38.152 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.152 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.152 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.152 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13328 4.16 e65/54 4:6a9ab238:::1000000339b.00000000:head v 65'186, mlcod=65'183)", 2024-04-25T22:42:38.152 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:38.152 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.497880045999999, 2024-04-25T22:42:38.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.046438762000000001, 2024-04-25T22:42:38.153 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:38.153 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:38.153 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.153 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:38.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:38.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:38.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:38.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:38.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:38.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489637+0000", 2024-04-25T22:42:38.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.357e-06 2024-04-25T22:42:38.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:38.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496055+0000", 2024-04-25T22:42:38.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0064181380000000003 2024-04-25T22:42:38.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:38.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496074+0000", 2024-04-25T22:42:38.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8904000000000001e-05 2024-04-25T22:42:38.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496085+0000", 2024-04-25T22:42:38.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1245e-05 2024-04-25T22:42:38.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496169+0000", 2024-04-25T22:42:38.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3974000000000006e-05 2024-04-25T22:42:38.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:38.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496203+0000", 2024-04-25T22:42:38.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3679000000000001e-05 2024-04-25T22:42:38.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:38.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536002+0000", 2024-04-25T22:42:38.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039799569 2024-04-25T22:42:38.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:38.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536073+0000", 2024-04-25T22:42:38.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0895999999999993e-05 2024-04-25T22:42:38.156 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.156 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.156 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.156 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13338 4.e 4:737b94c2:::1000000338a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:38.157 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:38.157 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.491739531, 2024-04-25T22:42:38.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047911849999999999, 2024-04-25T22:42:38.157 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:38.157 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:38.157 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.157 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:38.157 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:38.157 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.157 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13338 2024-04-25T22:42:38.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.157 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:38.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:38.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:38.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:38.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:38.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:38.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495776+0000", 2024-04-25T22:42:38.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2399999999999996e-07 2024-04-25T22:42:38.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:38.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503748+0000", 2024-04-25T22:42:38.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079725479999999994 2024-04-25T22:42:38.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:38.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503940+0000", 2024-04-25T22:42:38.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000191249 2024-04-25T22:42:38.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504061+0000", 2024-04-25T22:42:38.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120982 2024-04-25T22:42:38.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515564+0000", 2024-04-25T22:42:38.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011503342999999999 2024-04-25T22:42:38.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:38.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515799+0000", 2024-04-25T22:42:38.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000235138 2024-04-25T22:42:38.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:38.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543419+0000", 2024-04-25T22:42:38.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027620167000000001 2024-04-25T22:42:38.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:38.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543522+0000", 2024-04-25T22:42:38.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010254100000000001 2024-04-25T22:42:38.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:38.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543687+0000", 2024-04-25T22:42:38.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016495799999999999 2024-04-25T22:42:38.161 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.161 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.161 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.161 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13329 4.26 e65/57 4:64e005a2:::10000003483.00000000:head v 65'226, mlcod=64'224)", 2024-04-25T22:42:38.161 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:38.161 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.49113685, 2024-04-25T22:42:38.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048871456000000001, 2024-04-25T22:42:38.161 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:38.161 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:38.161 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.161 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:38.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:38.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:38.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:38.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:38.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:38.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496379+0000", 2024-04-25T22:42:38.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1480000000000001e-06 2024-04-25T22:42:38.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:38.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504870+0000", 2024-04-25T22:42:38.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0084917880000000001 2024-04-25T22:42:38.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:38.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504888+0000", 2024-04-25T22:42:38.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7365999999999999e-05 2024-04-25T22:42:38.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504899+0000", 2024-04-25T22:42:38.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1516e-05 2024-04-25T22:42:38.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515953+0000", 2024-04-25T22:42:38.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011054074000000001 2024-04-25T22:42:38.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:38.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515993+0000", 2024-04-25T22:42:38.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9854999999999997e-05 2024-04-25T22:42:38.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:38.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545191+0000", 2024-04-25T22:42:38.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029197323000000001 2024-04-25T22:42:38.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:38.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545249+0000", 2024-04-25T22:42:38.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8386e-05 2024-04-25T22:42:38.165 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.165 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.165 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.165 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13713 4.2b 4:d574dbff:::100000031d0.00000001:head [write 0~4194304 [2@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:38.165 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:38.165 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.078950731999999, 2024-04-25T22:42:38.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047324328999999998, 2024-04-25T22:42:38.165 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:38.165 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:38.165 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.165 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:38.166 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:38.166 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.166 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13713 2024-04-25T22:42:38.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.166 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:38.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:38.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:38.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:38.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:38.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:38.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:38.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908565+0000", 2024-04-25T22:42:38.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.694e-06 2024-04-25T22:42:38.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:38.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916170+0000", 2024-04-25T22:42:38.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076041720000000002 2024-04-25T22:42:38.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:38.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916200+0000", 2024-04-25T22:42:38.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0463999999999998e-05 2024-04-25T22:42:38.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916209+0000", 2024-04-25T22:42:38.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3079999999999997e-06 2024-04-25T22:42:38.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:38.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916297+0000", 2024-04-25T22:42:38.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8159999999999996e-05 2024-04-25T22:42:38.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:38.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916554+0000", 2024-04-25T22:42:38.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025661800000000002 2024-04-25T22:42:38.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:38.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916794+0000", 2024-04-25T22:42:38.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024013999999999999 2024-04-25T22:42:38.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:38.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.933120+0000", 2024-04-25T22:42:38.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016325559 2024-04-25T22:42:38.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955612+0000", 2024-04-25T22:42:38.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022491786 2024-04-25T22:42:38.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:38.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955797+0000", 2024-04-25T22:42:38.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018533699999999999 2024-04-25T22:42:38.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:38.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:38.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:38.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955888+0000", 2024-04-25T22:42:38.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1090999999999999e-05 2024-04-25T22:42:38.170 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.170 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.170 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.170 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:38.170 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:38.170 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:38.171 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:38.172 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:38.171+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:38.211 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:42:38.212 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":72,"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","created":"2024-04-25T22:39:52.303074+0000","modified":"2024-04-25T22:42:37.457070+0000","last_up_change":"2024-04-25T22:41:34.334402+0000","last_in_change":"2024-04-25T22:39:53.230242+0000","flags":"noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5801984,"flags_set":["noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:40:03.197725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"error_message":"pool 1 has primary_affinity set to zero on all OSDs","score_acting":0,"score_stable":0}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:40:07.560858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"error_message":"pool 2 has primary_affinity set to zero on all OSDs","score_acting":0,"score_stable":0}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:40:12.431697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"error_message":"pool 3 has primary_affinity set to zero on all OSDs","score_acting":0,"score_stable":0}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:40:12.919828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"error_message":"pool 4 has primary_affinity set to zero on all OSDs","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"73d465b4-5896-4d69-80b1-7e69d31eb455","up":1,"in":1,"weight":1,"primary_affinity":0,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6801","nonce":765118869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6803","nonce":765118869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6807","nonce":765118869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6805","nonce":765118869}]},"public_addr":"172.21.15.122:6801/765118869","cluster_addr":"172.21.15.122:6803/765118869","heartbeat_back_addr":"172.21.15.122:6807/765118869","heartbeat_front_addr":"172.21.15.122:6805/765118869","state":["exists","up"]},{"osd":1,"uuid":"8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5","up":0,"in":1,"weight":1,"primary_affinity":0,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6801","nonce":2387035286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6803","nonce":2387035286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6807","nonce":2387035286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2387035286},{"type":"v1","addr":"172.21.15.148:6805","nonce":2387035286}]},"public_addr":"172.21.15.148:6801/2387035286","cluster_addr":"172.21.15.148:6803/2387035286","heartbeat_back_addr":"172.21.15.148:6807/2387035286","heartbeat_front_addr":"172.21.15.148:6805/2387035286","state":["exists"]},{"osd":2,"uuid":"164fc653-2135-4e9b-8826-1716fdba6ea0","up":1,"in":1,"weight":1,"primary_affinity":0,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6801","nonce":368834361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6803","nonce":368834361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6807","nonce":368834361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6805","nonce":368834361}]},"public_addr":"172.21.15.188:6801/368834361","cluster_addr":"172.21.15.188:6803/368834361","heartbeat_back_addr":"172.21.15.188:6807/368834361","heartbeat_front_addr":"172.21.15.188:6805/368834361","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.559393+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.563434+0000","dead_epoch":45},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.557643+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.16","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.16","osds":[2,0]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:42:38.231 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:40:03.197725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'error_message': 'pool 1 has primary_affinity set to zero on all OSDs', 'score_acting': 0, 'score_stable': 0}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:40:07.560858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 has primary_affinity set to zero on all OSDs', 'score_acting': 0, 'score_stable': 0}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:40:12.431697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'error_message': 'pool 3 has primary_affinity set to zero on all OSDs', 'score_acting': 0, 'score_stable': 0}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:40:12.919828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 4 has primary_affinity set to zero on all OSDs', 'score_acting': 0, 'score_stable': 0}}] 2024-04-25T22:42:38.231 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:42:38.272 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:38.267+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:38.301 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:38.301 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:38.301 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:42:38.301 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:38.315 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:38.373 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:38.371+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:38.438 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:38.438 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:38.438 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:42:38.438 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:42:38.438 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:38.451 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:38.494 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:38.495+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:38.536 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-04-25T22:42:38.554 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:42:38.574 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:38.575+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:38.617 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 144.01799231000001, 2024-04-25T22:42:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.617 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:38.618 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:38.619 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:38.620 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:38.621 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:38.622 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 144.01785505399999, 2024-04-25T22:42:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:38.623 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.624 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:38.625 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:38.626 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.627 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.627 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:38.627 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:38.627 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:38.627 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.627 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.627 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:38.627 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:38.627 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:38.627 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.627 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.627 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:38.627 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:38.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:38.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.628 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.628 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:38.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:38.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.628 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:38.628 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:38.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:38.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.629 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:38.629 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:38.629 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:38.629 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.629 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.629 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.629 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.629 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.629 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:38.629 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:38.629 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 144.01759488600001, 2024-04-25T22:42:38.629 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:38.629 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:38.629 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:38.629 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.630 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:38.630 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.630 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:38.630 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:38.630 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.630 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.630 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.630 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:38.630 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:38.630 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.630 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.630 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.630 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:38.631 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:38.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:38.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:38.631 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:38.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:38.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:38.631 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:38.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:38.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.632 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:38.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:38.632 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.632 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:38.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:38.632 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.632 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:38.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:38.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:38.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.633 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.633 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.633 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:38.633 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:38.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.633 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.633 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:38.633 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:38.633 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:38.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.633 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.633 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:38.633 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:38.633 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:38.634 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.634 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.634 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:38.634 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:38.634 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:38.634 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.634 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.634 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.634 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:38.634 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:38.634 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.634 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.634 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:38.634 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:38.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:38.635 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.635 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:38.635 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:38.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:38.635 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.635 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.635 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.635 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.635 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:38.635 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:38.635 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 144.017429687, 2024-04-25T22:42:38.636 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:38.636 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:38.636 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:38.636 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:38.636 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:38.636 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.636 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:38.636 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:38.636 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.636 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.636 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.636 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:38.636 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:38.636 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:38.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:38.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:38.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:38.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:38.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:38.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:38.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:38.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:38.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.638 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:38.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:38.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.638 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:38.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:38.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:38.638 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:38.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:38.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:38.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:38.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:38.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:38.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:38.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:38.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:38.640 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:38.640 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.640 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.640 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.640 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.640 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:38.640 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:38.640 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 144.01736402500001, 2024-04-25T22:42:38.640 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:38.640 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:38.640 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:38.640 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:38.640 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:38.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:38.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:38.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:38.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:38.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:38.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:38.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:38.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:38.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:38.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:38.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:38.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:38.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:38.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:38.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:38.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:38.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:38.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:38.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:38.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:38.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:38.644 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:38.644 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.644 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:38.644 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:38.644 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:38.644 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.644 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:38.644 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:38.644 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:38.644 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.644 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.644 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.644 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.645 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10700 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:38.645 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:38.645 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 26.094496807999999, 2024-04-25T22:42:38.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066789482999999997, 2024-04-25T22:42:38.645 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:38.645 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:38.645 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.645 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:38.645 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:38.645 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.645 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10700 2024-04-25T22:42:38.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.646 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:38.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.646 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:38.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:38.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.646 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:38.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:38.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.646 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:38.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519112+0000", 2024-04-25T22:42:38.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1399999999999998e-06 2024-04-25T22:42:38.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:38.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527187+0000", 2024-04-25T22:42:38.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080748899999999995 2024-04-25T22:42:38.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:38.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527232+0000", 2024-04-25T22:42:38.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4895999999999998e-05 2024-04-25T22:42:38.647 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.647 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527259+0000", 2024-04-25T22:42:38.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7331999999999999e-05 2024-04-25T22:42:38.648 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.648 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.648 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529418+0000", 2024-04-25T22:42:38.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002158765 2024-04-25T22:42:38.648 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.648 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:38.648 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529572+0000", 2024-04-25T22:42:38.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015438499999999999 2024-04-25T22:42:38.648 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.648 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:38.648 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529762+0000", 2024-04-25T22:42:38.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018998100000000001 2024-04-25T22:42:38.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:38.649 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.548359+0000", 2024-04-25T22:42:38.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018596444 2024-04-25T22:42:38.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.649 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585801+0000", 2024-04-25T22:42:38.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.037442469999999999 2024-04-25T22:42:38.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:38.650 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585847+0000", 2024-04-25T22:42:38.650 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5565000000000002e-05 2024-04-25T22:42:38.650 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.650 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.650 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:38.650 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585899+0000", 2024-04-25T22:42:38.650 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2614999999999997e-05 2024-04-25T22:42:38.650 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.650 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.650 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.650 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.650 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.650 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10714 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:38.650 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:38.651 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 26.060815845, 2024-04-25T22:42:38.651 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.048080623000000003, 2024-04-25T22:42:38.651 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:38.651 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:38.651 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.651 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:38.651 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:38.651 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.651 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10714 2024-04-25T22:42:38.651 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.651 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:38.651 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.651 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:38.651 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:38.651 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.652 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:38.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:38.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.652 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:38.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552792+0000", 2024-04-25T22:42:38.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:42:38.652 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:38.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559915+0000", 2024-04-25T22:42:38.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071231690000000004 2024-04-25T22:42:38.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:38.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559932+0000", 2024-04-25T22:42:38.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7169000000000001e-05 2024-04-25T22:42:38.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559942+0000", 2024-04-25T22:42:38.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0261999999999999e-05 2024-04-25T22:42:38.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560018+0000", 2024-04-25T22:42:38.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5358000000000006e-05 2024-04-25T22:42:38.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:38.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560118+0000", 2024-04-25T22:42:38.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000100911 2024-04-25T22:42:38.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:38.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560281+0000", 2024-04-25T22:42:38.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016288500000000001 2024-04-25T22:42:38.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:38.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.579740+0000", 2024-04-25T22:42:38.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019458598000000001 2024-04-25T22:42:38.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600484+0000", 2024-04-25T22:42:38.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020744483000000001 2024-04-25T22:42:38.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:38.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600664+0000", 2024-04-25T22:42:38.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017953899999999999 2024-04-25T22:42:38.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:38.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600871+0000", 2024-04-25T22:42:38.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020737199999999999 2024-04-25T22:42:38.656 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.656 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.656 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.656 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10813 4.17 4:e8010137:::100000030b0.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:38.656 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:38.656 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 25.865866838999999, 2024-04-25T22:42:38.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.047503799999999999, 2024-04-25T22:42:38.656 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:38.656 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:38.656 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.656 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:38.656 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:38.657 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.657 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10813 2024-04-25T22:42:38.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.657 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:38.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.657 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:38.657 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:38.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.657 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:38.657 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:38.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:38.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747741+0000", 2024-04-25T22:42:38.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1119999999999999e-06 2024-04-25T22:42:38.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:38.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752366+0000", 2024-04-25T22:42:38.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046253240000000001 2024-04-25T22:42:38.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:38.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752382+0000", 2024-04-25T22:42:38.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5639999999999999e-05 2024-04-25T22:42:38.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752393+0000", 2024-04-25T22:42:38.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1626e-05 2024-04-25T22:42:38.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752459+0000", 2024-04-25T22:42:38.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5309999999999996e-05 2024-04-25T22:42:38.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752529+0000", 2024-04-25T22:42:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0543000000000005e-05 2024-04-25T22:42:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752637+0000", 2024-04-25T22:42:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010788799999999999 2024-04-25T22:42:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760295+0000", 2024-04-25T22:42:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076583290000000002 2024-04-25T22:42:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.794990+0000", 2024-04-25T22:42:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034694317000000002 2024-04-25T22:42:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795097+0000", 2024-04-25T22:42:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010768999999999999 2024-04-25T22:42:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795243+0000", 2024-04-25T22:42:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000146021 2024-04-25T22:42:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.661 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.662 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.662 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10816 4.17 4:e8010137:::100000030b0.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:38.662 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:38.662 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 25.860537379, 2024-04-25T22:42:38.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042406530999999997, 2024-04-25T22:42:38.662 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:38.662 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:38.662 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.662 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:38.662 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:38.662 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.663 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10816 2024-04-25T22:42:38.663 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.663 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:38.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.663 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:38.663 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:38.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.663 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.663 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:38.663 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:38.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.663 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:38.664 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753070+0000", 2024-04-25T22:42:38.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9800000000000002e-07 2024-04-25T22:42:38.664 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:38.664 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753288+0000", 2024-04-25T22:42:38.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000217789 2024-04-25T22:42:38.664 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:38.664 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753301+0000", 2024-04-25T22:42:38.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2764e-05 2024-04-25T22:42:38.664 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753310+0000", 2024-04-25T22:42:38.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:42:38.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758240+0000", 2024-04-25T22:42:38.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049304910000000004 2024-04-25T22:42:38.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:38.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758374+0000", 2024-04-25T22:42:38.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000133428 2024-04-25T22:42:38.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:38.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758576+0000", 2024-04-25T22:42:38.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020177899999999999 2024-04-25T22:42:38.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:38.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760626+0000", 2024-04-25T22:42:38.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0020501489999999998 2024-04-25T22:42:38.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795329+0000", 2024-04-25T22:42:38.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034703352999999999 2024-04-25T22:42:38.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:38.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795414+0000", 2024-04-25T22:42:38.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5292999999999998e-05 2024-04-25T22:42:38.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:38.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795476+0000", 2024-04-25T22:42:38.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1206999999999999e-05 2024-04-25T22:42:38.667 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.667 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.667 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.668 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10914 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:38.668 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:38.668 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 25.659736997, 2024-04-25T22:42:38.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044452984000000001, 2024-04-25T22:42:38.668 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:38.668 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:38.668 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.668 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:38.668 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:38.668 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.668 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10914 2024-04-25T22:42:38.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.668 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:38.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:38.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:38.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.669 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:38.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:38.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.669 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:38.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953871+0000", 2024-04-25T22:42:38.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1829999999999999e-06 2024-04-25T22:42:38.669 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.670 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:38.670 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.962992+0000", 2024-04-25T22:42:38.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091217409999999992 2024-04-25T22:42:38.670 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.670 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.670 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:38.670 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963027+0000", 2024-04-25T22:42:38.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4229e-05 2024-04-25T22:42:38.670 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.670 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.670 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.670 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963042+0000", 2024-04-25T22:42:38.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5152e-05 2024-04-25T22:42:38.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963143+0000", 2024-04-25T22:42:38.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101171 2024-04-25T22:42:38.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:38.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963269+0000", 2024-04-25T22:42:38.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012623499999999999 2024-04-25T22:42:38.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:38.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963453+0000", 2024-04-25T22:42:38.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018357900000000001 2024-04-25T22:42:38.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:38.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998133+0000", 2024-04-25T22:42:38.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034679789000000003 2024-04-25T22:42:38.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998220+0000", 2024-04-25T22:42:38.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7153999999999999e-05 2024-04-25T22:42:38.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:38.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998278+0000", 2024-04-25T22:42:38.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8035000000000003e-05 2024-04-25T22:42:38.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:38.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998323+0000", 2024-04-25T22:42:38.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4715999999999997e-05 2024-04-25T22:42:38.673 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.673 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.673 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.673 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10919 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:38.673 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:38.673 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 25.639425716000002, 2024-04-25T22:42:38.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044010552000000001, 2024-04-25T22:42:38.674 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:38.674 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:38.674 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.674 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:38.674 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:38.674 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.674 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10919 2024-04-25T22:42:38.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.674 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:38.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:38.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:38.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.675 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:38.675 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:38.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.675 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:38.675 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:38.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8100000000000003e-07 2024-04-25T22:42:38.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.675 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:38.675 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980221+0000", 2024-04-25T22:42:38.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060397230000000003 2024-04-25T22:42:38.676 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.676 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.676 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:38.676 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980242+0000", 2024-04-25T22:42:38.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1373e-05 2024-04-25T22:42:38.676 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.676 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.676 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.676 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980252+0000", 2024-04-25T22:42:38.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9990000000000003e-06 2024-04-25T22:42:38.676 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.676 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.676 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.677 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981303+0000", 2024-04-25T22:42:38.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010501670000000001 2024-04-25T22:42:38.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.677 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:38.677 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981444+0000", 2024-04-25T22:42:38.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014123799999999999 2024-04-25T22:42:38.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.677 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:38.677 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981585+0000", 2024-04-25T22:42:38.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014071999999999999 2024-04-25T22:42:38.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:38.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003640+0000", 2024-04-25T22:42:38.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022055113000000001 2024-04-25T22:42:38.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018070+0000", 2024-04-25T22:42:38.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014430877 2024-04-25T22:42:38.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:38.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018138+0000", 2024-04-25T22:42:38.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7743000000000005e-05 2024-04-25T22:42:38.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:38.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018191+0000", 2024-04-25T22:42:38.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3118000000000002e-05 2024-04-25T22:42:38.679 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.679 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.679 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.679 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:12632 4.a e64/17 4:506aad5d:::1000000310f.00000000:head v 64'203, mlcod=64'201)", 2024-04-25T22:42:38.679 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:38.679 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.970077321000002, 2024-04-25T22:42:38.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041913617, 2024-04-25T22:42:38.679 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:38.680 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:38.680 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.680 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:38.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:38.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:38.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:38.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:38.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.681 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:38.681 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643531+0000", 2024-04-25T22:42:38.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.497e-06 2024-04-25T22:42:38.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.681 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:38.681 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650159+0000", 2024-04-25T22:42:38.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066287059999999998 2024-04-25T22:42:38.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.681 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:38.681 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650185+0000", 2024-04-25T22:42:38.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5646000000000001e-05 2024-04-25T22:42:38.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650205+0000", 2024-04-25T22:42:38.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9720000000000001e-05 2024-04-25T22:42:38.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650521+0000", 2024-04-25T22:42:38.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00031590699999999998 2024-04-25T22:42:38.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:38.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650574+0000", 2024-04-25T22:42:38.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3192000000000002e-05 2024-04-25T22:42:38.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.683 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:38.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685374+0000", 2024-04-25T22:42:38.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034799902000000001 2024-04-25T22:42:38.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.683 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:38.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685443+0000", 2024-04-25T22:42:38.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9047000000000005e-05 2024-04-25T22:42:38.683 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.683 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.683 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.683 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12644 4.11 4:8893db93:::100000034c2.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:38.684 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:38.684 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.961668431, 2024-04-25T22:42:38.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045039497999999997, 2024-04-25T22:42:38.684 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:38.684 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:38.684 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.684 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:38.684 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:38.684 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.684 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12644 2024-04-25T22:42:38.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.684 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:38.684 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.684 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:38.685 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:38.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:38.685 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:38.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:38.685 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651940+0000", 2024-04-25T22:42:38.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.013e-06 2024-04-25T22:42:38.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.686 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:38.686 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659663+0000", 2024-04-25T22:42:38.686 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077228150000000001 2024-04-25T22:42:38.686 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.686 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.686 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:38.686 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659694+0000", 2024-04-25T22:42:38.686 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1112999999999998e-05 2024-04-25T22:42:38.686 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.686 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.686 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.686 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659715+0000", 2024-04-25T22:42:38.686 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1053e-05 2024-04-25T22:42:38.686 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659842+0000", 2024-04-25T22:42:38.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012738100000000001 2024-04-25T22:42:38.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:38.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660068+0000", 2024-04-25T22:42:38.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000225746 2024-04-25T22:42:38.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:38.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660307+0000", 2024-04-25T22:42:38.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000238352 2024-04-25T22:42:38.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:38.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.683776+0000", 2024-04-25T22:42:38.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023469891999999999 2024-04-25T22:42:38.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696810+0000", 2024-04-25T22:42:38.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013033385999999999 2024-04-25T22:42:38.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:38.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696904+0000", 2024-04-25T22:42:38.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3820000000000006e-05 2024-04-25T22:42:38.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:38.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696978+0000", 2024-04-25T22:42:38.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3926999999999999e-05 2024-04-25T22:42:38.689 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.689 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.689 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.689 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12645 4.2d 4:b45456a9:::10000003241.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:38.689 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:38.689 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.953847944, 2024-04-25T22:42:38.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.043099660999999997, 2024-04-25T22:42:38.689 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:38.690 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:38.690 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.690 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:38.690 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:38.690 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.690 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12645 2024-04-25T22:42:38.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.690 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:38.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.690 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:38.690 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:38.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.691 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:38.691 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:38.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.691 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.691 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.691 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:38.691 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659761+0000", 2024-04-25T22:42:38.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8459999999999999e-06 2024-04-25T22:42:38.691 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.691 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.691 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:38.691 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666663+0000", 2024-04-25T22:42:38.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0069017080000000003 2024-04-25T22:42:38.691 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:38.692 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666684+0000", 2024-04-25T22:42:38.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0706000000000001e-05 2024-04-25T22:42:38.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.692 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666700+0000", 2024-04-25T22:42:38.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5985999999999999e-05 2024-04-25T22:42:38.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.692 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666914+0000", 2024-04-25T22:42:38.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000213861 2024-04-25T22:42:38.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:38.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.667082+0000", 2024-04-25T22:42:38.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016809 2024-04-25T22:42:38.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:38.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702598+0000", 2024-04-25T22:42:38.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035515962999999998 2024-04-25T22:42:38.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:38.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702705+0000", 2024-04-25T22:42:38.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010689800000000001 2024-04-25T22:42:38.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.694 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.694 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:38.694 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702858+0000", 2024-04-25T22:42:38.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015360300000000001 2024-04-25T22:42:38.694 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.694 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.694 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.694 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.694 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.694 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12829 4.3b 4:de8bdadd:::100000033c7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:38.694 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:38.694 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.725588029000001, 2024-04-25T22:42:38.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042457306, 2024-04-25T22:42:38.695 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:38.695 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:38.695 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.695 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:38.695 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:38.695 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.695 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12829 2024-04-25T22:42:38.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.695 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:38.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.695 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:38.695 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:38.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:38.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:38.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:38.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888019+0000", 2024-04-25T22:42:38.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3300000000000002e-07 2024-04-25T22:42:38.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:38.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891638+0000", 2024-04-25T22:42:38.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036189109999999998 2024-04-25T22:42:38.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:38.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891661+0000", 2024-04-25T22:42:38.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3345000000000001e-05 2024-04-25T22:42:38.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891671+0000", 2024-04-25T22:42:38.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0115000000000001e-05 2024-04-25T22:42:38.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891737+0000", 2024-04-25T22:42:38.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5600999999999998e-05 2024-04-25T22:42:38.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.698 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:38.698 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891856+0000", 2024-04-25T22:42:38.698 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011881 2024-04-25T22:42:38.698 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.698 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:38.698 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930251+0000", 2024-04-25T22:42:38.698 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.038395141000000001 2024-04-25T22:42:38.698 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.698 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:38.698 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930389+0000", 2024-04-25T22:42:38.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013849000000000001 2024-04-25T22:42:38.699 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.699 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.699 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:38.699 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930476+0000", 2024-04-25T22:42:38.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6360000000000007e-05 2024-04-25T22:42:38.699 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.699 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.699 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.699 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.699 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.699 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13009 4.1e 4:78728bd7:::100000033a5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:38.699 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:38.699 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.523701017, 2024-04-25T22:42:38.700 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049997452999999997, 2024-04-25T22:42:38.700 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:38.700 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:38.700 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.700 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:38.700 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:38.700 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.700 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13009 2024-04-25T22:42:38.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.700 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:38.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.700 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:38.700 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:38.700 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:38.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:38.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:38.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:38.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4799999999999997e-07 2024-04-25T22:42:38.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:38.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097105+0000", 2024-04-25T22:42:38.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071984060000000001 2024-04-25T22:42:38.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.702 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:38.702 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097118+0000", 2024-04-25T22:42:38.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2865e-05 2024-04-25T22:42:38.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.702 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.702 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097127+0000", 2024-04-25T22:42:38.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8449999999999998e-06 2024-04-25T22:42:38.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.702 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097174+0000", 2024-04-25T22:42:38.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6084000000000001e-05 2024-04-25T22:42:38.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:38.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097232+0000", 2024-04-25T22:42:38.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8928999999999998e-05 2024-04-25T22:42:38.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:38.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097309+0000", 2024-04-25T22:42:38.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7014999999999994e-05 2024-04-25T22:42:38.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.704 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:38.704 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.108708+0000", 2024-04-25T22:42:38.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011398233000000001 2024-04-25T22:42:38.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.704 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.704 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139793+0000", 2024-04-25T22:42:38.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031084856000000001 2024-04-25T22:42:38.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.704 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:38.704 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139848+0000", 2024-04-25T22:42:38.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5464000000000003e-05 2024-04-25T22:42:38.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.705 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:38.705 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139903+0000", 2024-04-25T22:42:38.705 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4907999999999997e-05 2024-04-25T22:42:38.705 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.705 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.705 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.705 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.705 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13318 4.16 4:6810bf9e:::10000003259.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:38.705 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:38.705 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.153126659000002, 2024-04-25T22:42:38.705 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057538179000000002, 2024-04-25T22:42:38.705 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:38.705 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:38.705 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.706 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:38.706 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:38.706 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.706 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13318 2024-04-25T22:42:38.706 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.706 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:38.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:38.706 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:38.706 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.706 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:38.706 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:38.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.707 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:38.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460481+0000", 2024-04-25T22:42:38.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:42:38.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.707 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:38.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466775+0000", 2024-04-25T22:42:38.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062944239999999999 2024-04-25T22:42:38.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.707 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:38.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466787+0000", 2024-04-25T22:42:38.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1688999999999999e-05 2024-04-25T22:42:38.708 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.708 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.708 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.709 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466793+0000", 2024-04-25T22:42:38.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7209999999999999e-06 2024-04-25T22:42:38.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466845+0000", 2024-04-25T22:42:38.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2166999999999997e-05 2024-04-25T22:42:38.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.710 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:38.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466912+0000", 2024-04-25T22:42:38.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7016999999999999e-05 2024-04-25T22:42:38.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.710 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:38.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.467020+0000", 2024-04-25T22:42:38.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010827699999999999 2024-04-25T22:42:38.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.710 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:38.711 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.476718+0000", 2024-04-25T22:42:38.711 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0096980439999999994 2024-04-25T22:42:38.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.711 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.711 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.711 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517860+0000", 2024-04-25T22:42:38.711 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041141847000000002 2024-04-25T22:42:38.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.711 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.711 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:38.711 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517924+0000", 2024-04-25T22:42:38.711 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3997000000000004e-05 2024-04-25T22:42:38.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:38.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.518018+0000", 2024-04-25T22:42:38.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4139000000000001e-05 2024-04-25T22:42:38.712 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.712 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.712 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.712 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13328 4.16 4:6a9ab238:::1000000339b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:38.712 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:38.712 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.134213674000002, 2024-04-25T22:42:38.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057072695999999999, 2024-04-25T22:42:38.713 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:38.713 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:38.713 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.713 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:38.713 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:38.713 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.713 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13328 2024-04-25T22:42:38.713 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.713 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:38.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.713 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:38.713 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:38.713 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.713 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.714 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:38.714 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:38.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.714 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:38.714 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479395+0000", 2024-04-25T22:42:38.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2859999999999998e-06 2024-04-25T22:42:38.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.714 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:38.714 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486667+0000", 2024-04-25T22:42:38.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072715599999999998 2024-04-25T22:42:38.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:38.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486677+0000", 2024-04-25T22:42:38.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0305e-05 2024-04-25T22:42:38.715 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486683+0000", 2024-04-25T22:42:38.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5300000000000004e-06 2024-04-25T22:42:38.715 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486768+0000", 2024-04-25T22:42:38.716 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5725999999999999e-05 2024-04-25T22:42:38.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.716 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:38.716 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486905+0000", 2024-04-25T22:42:38.716 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013696699999999999 2024-04-25T22:42:38.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.716 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:38.716 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.487121+0000", 2024-04-25T22:42:38.716 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021615299999999999 2024-04-25T22:42:38.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.716 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:38.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.509675+0000", 2024-04-25T22:42:38.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022553225999999999 2024-04-25T22:42:38.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536355+0000", 2024-04-25T22:42:38.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026680855 2024-04-25T22:42:38.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:38.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536401+0000", 2024-04-25T22:42:38.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5649000000000003e-05 2024-04-25T22:42:38.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.718 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:38.718 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536466+0000", 2024-04-25T22:42:38.718 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4438999999999997e-05 2024-04-25T22:42:38.718 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.718 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.718 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.718 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.718 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.718 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13329 4.26 4:64e005a2:::10000003483.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:38.718 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:38.718 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.126905274999999, 2024-04-25T22:42:38.718 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066502845000000005, 2024-04-25T22:42:38.718 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:38.718 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:38.719 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.719 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:38.719 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:38.719 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.719 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13329 2024-04-25T22:42:38.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.719 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:38.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:38.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:38.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:38.720 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:38.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.720 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.720 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:38.720 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486703+0000", 2024-04-25T22:42:38.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3909999999999999e-06 2024-04-25T22:42:38.720 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.720 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:38.720 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494612+0000", 2024-04-25T22:42:38.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0079096670000000004 2024-04-25T22:42:38.720 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:38.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494626+0000", 2024-04-25T22:42:38.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3263e-05 2024-04-25T22:42:38.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494637+0000", 2024-04-25T22:42:38.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.171e-05 2024-04-25T22:42:38.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494720+0000", 2024-04-25T22:42:38.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2767000000000002e-05 2024-04-25T22:42:38.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:38.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494834+0000", 2024-04-25T22:42:38.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011387699999999999 2024-04-25T22:42:38.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:38.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494998+0000", 2024-04-25T22:42:38.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016390799999999999 2024-04-25T22:42:38.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:38.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517407+0000", 2024-04-25T22:42:38.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022409068000000001 2024-04-25T22:42:38.723 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.723 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.723 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553040+0000", 2024-04-25T22:42:38.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035633155 2024-04-25T22:42:38.723 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.723 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:38.723 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553140+0000", 2024-04-25T22:42:38.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9623000000000005e-05 2024-04-25T22:42:38.723 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.723 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:38.723 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553204+0000", 2024-04-25T22:42:38.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4416000000000001e-05 2024-04-25T22:42:38.724 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.724 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.724 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.724 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.724 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.724 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13399 4.16 4:6bb7cc3a:::10000003648.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:38.724 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:38.724 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 22.053539475000001, 2024-04-25T22:42:38.724 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045625003999999997, 2024-04-25T22:42:38.724 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:38.724 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:38.724 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:38.724 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:38.724 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:38.725 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:38.725 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13399 2024-04-25T22:42:38.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.725 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:38.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:38.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:38.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:38.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:38.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:38.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:38.726 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560068+0000", 2024-04-25T22:42:38.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:42:38.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:38.726 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576902+0000", 2024-04-25T22:42:38.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016833806 2024-04-25T22:42:38.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:38.726 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576916+0000", 2024-04-25T22:42:38.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3648e-05 2024-04-25T22:42:38.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:38.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576927+0000", 2024-04-25T22:42:38.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0992000000000001e-05 2024-04-25T22:42:38.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:38.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577026+0000", 2024-04-25T22:42:38.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9116000000000004e-05 2024-04-25T22:42:38.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:38.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577203+0000", 2024-04-25T22:42:38.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017700499999999999 2024-04-25T22:42:38.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:38.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577336+0000", 2024-04-25T22:42:38.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013340800000000001 2024-04-25T22:42:38.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:38.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.589077+0000", 2024-04-25T22:42:38.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011741151 2024-04-25T22:42:38.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:38.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605436+0000", 2024-04-25T22:42:38.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016359146000000001 2024-04-25T22:42:38.729 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.729 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.729 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:38.729 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605493+0000", 2024-04-25T22:42:38.729 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7067000000000001e-05 2024-04-25T22:42:38.729 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:38.729 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:38.729 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:38.729 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605692+0000", 2024-04-25T22:42:38.729 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00019855799999999999 2024-04-25T22:42:38.729 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.729 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.729 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.729 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:38.729 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:38.730 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:38.731 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:38.731+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:38.731 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:38.832 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:38.831+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:38.856 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-04-25T22:42:38.864 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:38.864 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:38.864 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:42:38.864 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:38.877 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T22:42:38.878 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:38.933 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:38.931+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:38.994 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:38.995 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:38.995 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:42:38.995 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:42:38.995 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:39.008 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:39.054 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:39.051+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:39.127 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:39.127 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:42:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:42:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 144.531023479, 2024-04-25T22:42:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:42:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:42:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:42:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:42:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:42:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:42:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:42:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:42:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:42:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:42:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:42:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:42:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:42:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:42:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:42:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:42:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:42:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:42:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:42:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:42:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:42:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:42:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:42:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:42:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:42:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:42:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:42:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 144.530915166, 2024-04-25T22:42:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:42:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:42:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:42:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:42:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:42:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:42:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:42:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:42:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:42:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:42:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:42:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:42:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:42:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:42:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:42:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:42:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:42:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:42:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:42:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:42:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:42:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:42:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:42:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:42:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:42:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:42:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:42:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 144.53084851, 2024-04-25T22:42:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:42:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:42:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:42:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:42:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:42:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:42:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:42:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:42:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:42:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:42:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:42:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:42:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:42:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:42:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:42:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:42:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:42:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:42:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:42:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:42:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:42:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:42:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:42:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:42:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:42:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:42:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:42:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 144.53075791399999, 2024-04-25T22:42:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:42:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:42:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:42:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:42:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:42:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:42:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:42:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:42:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:42:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:42:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:42:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:42:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:42:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:42:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:42:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:42:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:42:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:42:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:42:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:42:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:42:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:42:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:42:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:42:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:42:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:42:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:42:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 144.53069334099999, 2024-04-25T22:42:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:42:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:42:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:42:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:42:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:42:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:42:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:42:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:42:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:42:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:42:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:42:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:42:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:42:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:42:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:42:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:42:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:42:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:42:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:42:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:42:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:42:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:42:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:42:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:42:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:42:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:42:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 144.53062791799999, 2024-04-25T22:42:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:42:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:42:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:42:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:42:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:42:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:42:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:39.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:42:39.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:42:39.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:42:39.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:42:39.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:39.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:42:39.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:42:39.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:42:39.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:42:39.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:39.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:42:39.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:42:39.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:39.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:42:39.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:42:39.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:39.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:42:39.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:42:39.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:39.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:42:39.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:42:39.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:39.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:42:39.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:42:39.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:39.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:42:39.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:42:39.165 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.165 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.165 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.166 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:39.166 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:39.166 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 144.53034738400001, 2024-04-25T22:42:39.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:42:39.166 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:39.166 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:39.166 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:39.166 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:39.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:39.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:39.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:39.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:39.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:39.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:42:39.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:42:39.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:39.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:42:39.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:42:39.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:39.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:42:39.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:42:39.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:39.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:42:39.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:42:39.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:42:39.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:42:39.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:39.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:42:39.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:42:39.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:42:39.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:42:39.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:39.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:42:39.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:42:39.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:39.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:42:39.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:42:39.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:39.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:42:39.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:42:39.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:39.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:42:39.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:42:39.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:39.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:42:39.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:42:39.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:39.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:42:39.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:42:39.172 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.172 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.172 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.172 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10678 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:39.172 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:39.172 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.639062644999999, 2024-04-25T22:42:39.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050477795999999998, 2024-04-25T22:42:39.172 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:39.172 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:39.172 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:39.172 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:39.172 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:39.173 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:39.173 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10678 2024-04-25T22:42:39.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.173 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:39.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:39.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:39.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:39.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:39.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:39.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488127+0000", 2024-04-25T22:42:39.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.716e-06 2024-04-25T22:42:39.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:39.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496392+0000", 2024-04-25T22:42:39.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082651500000000006 2024-04-25T22:42:39.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:39.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496428+0000", 2024-04-25T22:42:39.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5441999999999997e-05 2024-04-25T22:42:39.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:39.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496451+0000", 2024-04-25T22:42:39.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3529000000000001e-05 2024-04-25T22:42:39.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496601+0000", 2024-04-25T22:42:39.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014935600000000001 2024-04-25T22:42:39.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:39.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496856+0000", 2024-04-25T22:42:39.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025537900000000002 2024-04-25T22:42:39.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:39.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.497206+0000", 2024-04-25T22:42:39.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000350599 2024-04-25T22:42:39.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:39.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538231+0000", 2024-04-25T22:42:39.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041024146999999997 2024-04-25T22:42:39.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:39.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538298+0000", 2024-04-25T22:42:39.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7688000000000007e-05 2024-04-25T22:42:39.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:39.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538467+0000", 2024-04-25T22:42:39.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000168178 2024-04-25T22:42:39.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:39.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538603+0000", 2024-04-25T22:42:39.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013661200000000001 2024-04-25T22:42:39.177 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.177 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.177 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.177 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10692 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:39.177 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:39.177 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.622472851000001, 2024-04-25T22:42:39.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.061242408999999998, 2024-04-25T22:42:39.178 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:39.178 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:39.178 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:39.178 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:39.178 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:39.178 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:39.178 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10692 2024-04-25T22:42:39.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.178 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:39.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:39.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:39.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:39.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:39.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:39.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504717+0000", 2024-04-25T22:42:39.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6199999999999999e-06 2024-04-25T22:42:39.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:39.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511770+0000", 2024-04-25T22:42:39.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0070530929999999999 2024-04-25T22:42:39.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:39.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511810+0000", 2024-04-25T22:42:39.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0635e-05 2024-04-25T22:42:39.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:39.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511837+0000", 2024-04-25T22:42:39.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6423000000000001e-05 2024-04-25T22:42:39.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520096+0000", 2024-04-25T22:42:39.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082593730000000004 2024-04-25T22:42:39.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:39.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520345+0000", 2024-04-25T22:42:39.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024908800000000001 2024-04-25T22:42:39.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:39.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520794+0000", 2024-04-25T22:42:39.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000449023 2024-04-25T22:42:39.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:39.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538675+0000", 2024-04-25T22:42:39.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017880991999999998 2024-04-25T22:42:39.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:39.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565761+0000", 2024-04-25T22:42:39.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027085260999999999 2024-04-25T22:42:39.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:39.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565892+0000", 2024-04-25T22:42:39.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013152300000000001 2024-04-25T22:42:39.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:39.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565958+0000", 2024-04-25T22:42:39.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5377999999999996e-05 2024-04-25T22:42:39.183 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.183 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.183 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.183 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10693 4.2c 4:36971e45:::100000030bd.00000001:head [write 971225~86041] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:39.183 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:39.184 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.615294489, 2024-04-25T22:42:39.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054529782999999998, 2024-04-25T22:42:39.184 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:39.184 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:39.184 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:39.184 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:39.184 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:39.184 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:39.184 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10693 2024-04-25T22:42:39.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.184 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:39.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:39.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:39.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:39.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:39.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:39.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511897+0000", 2024-04-25T22:42:39.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2499999999999998e-06 2024-04-25T22:42:39.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:39.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512094+0000", 2024-04-25T22:42:39.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019700100000000001 2024-04-25T22:42:39.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:39.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512121+0000", 2024-04-25T22:42:39.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7288999999999999e-05 2024-04-25T22:42:39.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:39.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512137+0000", 2024-04-25T22:42:39.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.592e-05 2024-04-25T22:42:39.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.533845+0000", 2024-04-25T22:42:39.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021707595999999999 2024-04-25T22:42:39.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:39.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534176+0000", 2024-04-25T22:42:39.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033187000000000001 2024-04-25T22:42:39.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:39.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534626+0000", 2024-04-25T22:42:39.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00045008599999999999 2024-04-25T22:42:39.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:39.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.539165+0000", 2024-04-25T22:42:39.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045386380000000002 2024-04-25T22:42:39.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:39.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566169+0000", 2024-04-25T22:42:39.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027004199 2024-04-25T22:42:39.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:39.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566317+0000", 2024-04-25T22:42:39.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014747999999999999 2024-04-25T22:42:39.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:39.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566423+0000", 2024-04-25T22:42:39.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010645399999999999 2024-04-25T22:42:39.189 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.189 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.189 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.190 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10696 4.2b 4:d56d2a96:::100000030c3.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:39.190 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:39.190 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.613586844, 2024-04-25T22:42:39.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052282190999999999, 2024-04-25T22:42:39.190 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:39.190 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:39.190 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:39.190 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:39.190 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:39.190 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:39.190 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10696 2024-04-25T22:42:39.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.190 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:39.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:39.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:39.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:39.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:39.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:39.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513603+0000", 2024-04-25T22:42:39.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.283e-06 2024-04-25T22:42:39.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:39.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518647+0000", 2024-04-25T22:42:39.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050440859999999997 2024-04-25T22:42:39.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:39.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518672+0000", 2024-04-25T22:42:39.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4468e-05 2024-04-25T22:42:39.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:39.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518691+0000", 2024-04-25T22:42:39.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9213999999999999e-05 2024-04-25T22:42:39.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518806+0000", 2024-04-25T22:42:39.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115296 2024-04-25T22:42:39.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:39.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519011+0000", 2024-04-25T22:42:39.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020445700000000001 2024-04-25T22:42:39.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:39.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519207+0000", 2024-04-25T22:42:39.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000196431 2024-04-25T22:42:39.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:39.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531309+0000", 2024-04-25T22:42:39.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012101694 2024-04-25T22:42:39.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:39.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565622+0000", 2024-04-25T22:42:39.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034312976000000002 2024-04-25T22:42:39.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:39.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565769+0000", 2024-04-25T22:42:39.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014715900000000001 2024-04-25T22:42:39.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:39.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565883+0000", 2024-04-25T22:42:39.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000114127 2024-04-25T22:42:39.195 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.195 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.195 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.195 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10701 4.a 4:51b6a63a:::100000030f2.00000000:head [write 0~3014656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:39.195 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:39.195 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.602142833999999, 2024-04-25T22:42:39.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047414393999999999, 2024-04-25T22:42:39.196 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:39.196 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:39.196 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:39.196 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:39.196 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:39.196 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:39.196 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10701 2024-04-25T22:42:39.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.196 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:39.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:39.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:39.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:39.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:39.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:39.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525048+0000", 2024-04-25T22:42:39.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0819999999999999e-06 2024-04-25T22:42:39.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:39.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531709+0000", 2024-04-25T22:42:39.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066610929999999999 2024-04-25T22:42:39.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:39.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531751+0000", 2024-04-25T22:42:39.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1650000000000003e-05 2024-04-25T22:42:39.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:39.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531788+0000", 2024-04-25T22:42:39.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7305000000000003e-05 2024-04-25T22:42:39.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531943+0000", 2024-04-25T22:42:39.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015500600000000001 2024-04-25T22:42:39.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:39.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532086+0000", 2024-04-25T22:42:39.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014238599999999999 2024-04-25T22:42:39.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:39.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532295+0000", 2024-04-25T22:42:39.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020922000000000001 2024-04-25T22:42:39.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:39.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.545987+0000", 2024-04-25T22:42:39.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013692582999999999 2024-04-25T22:42:39.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:39.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572315+0000", 2024-04-25T22:42:39.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026327488 2024-04-25T22:42:39.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:39.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572381+0000", 2024-04-25T22:42:39.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5609000000000002e-05 2024-04-25T22:42:39.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:39.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572460+0000", 2024-04-25T22:42:39.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8972000000000002e-05 2024-04-25T22:42:39.203 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.203 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.203 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.204 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:10700 4.11 e63/57 4:88409fbf:::100000030ec.00000000:head v 63'193, mlcod=62'191)", 2024-04-25T22:42:39.204 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:39.204 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.591313377999999, 2024-04-25T22:42:39.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050517667000000002, 2024-04-25T22:42:39.204 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:39.204 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:39.204 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:39.204 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:39.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:39.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:39.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:39.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:39.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:39.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535876+0000", 2024-04-25T22:42:39.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0300000000000001e-06 2024-04-25T22:42:39.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:39.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565275+0000", 2024-04-25T22:42:39.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029399033000000001 2024-04-25T22:42:39.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:39.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565358+0000", 2024-04-25T22:42:39.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3403000000000001e-05 2024-04-25T22:42:39.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:39.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565380+0000", 2024-04-25T22:42:39.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1761999999999999e-05 2024-04-25T22:42:39.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565505+0000", 2024-04-25T22:42:39.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000125153 2024-04-25T22:42:39.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:39.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565550+0000", 2024-04-25T22:42:39.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5479000000000003e-05 2024-04-25T22:42:39.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:39.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586328+0000", 2024-04-25T22:42:39.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020777982 2024-04-25T22:42:39.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:39.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586392+0000", 2024-04-25T22:42:39.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3825000000000006e-05 2024-04-25T22:42:39.208 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.208 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.208 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.208 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12632 4.a 4:506aad5d:::1000000310f.00000000:head [write 0~4194304 [2@2043125]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:39.208 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:39.208 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.492258251999999, 2024-04-25T22:42:39.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051574097999999999, 2024-04-25T22:42:39.208 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:39.208 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:39.208 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:39.208 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:39.208 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:39.209 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:39.209 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12632 2024-04-25T22:42:39.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.209 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:39.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:39.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:39.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:39.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:39.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:39.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634932+0000", 2024-04-25T22:42:39.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1600000000000001e-06 2024-04-25T22:42:39.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:39.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642614+0000", 2024-04-25T22:42:39.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076823000000000004 2024-04-25T22:42:39.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:39.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642660+0000", 2024-04-25T22:42:39.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6016000000000001e-05 2024-04-25T22:42:39.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:39.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642686+0000", 2024-04-25T22:42:39.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5491999999999999e-05 2024-04-25T22:42:39.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642870+0000", 2024-04-25T22:42:39.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000184045 2024-04-25T22:42:39.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:39.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643122+0000", 2024-04-25T22:42:39.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025242299999999999 2024-04-25T22:42:39.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:39.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643634+0000", 2024-04-25T22:42:39.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051145800000000001 2024-04-25T22:42:39.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:39.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.682287+0000", 2024-04-25T22:42:39.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038653342 2024-04-25T22:42:39.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:39.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686419+0000", 2024-04-25T22:42:39.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0041325169999999996 2024-04-25T22:42:39.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:39.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686464+0000", 2024-04-25T22:42:39.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4171000000000001e-05 2024-04-25T22:42:39.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:39.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686504+0000", 2024-04-25T22:42:39.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0173999999999999e-05 2024-04-25T22:42:39.213 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.213 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.213 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.214 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12691 4.39 4:9d0d8843:::100000030ef.00000000:head [write 0~4194304 [3@92787]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:39.214 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:39.214 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.396537163000001, 2024-04-25T22:42:39.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045521998000000001, 2024-04-25T22:42:39.214 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:39.214 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:39.214 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:39.214 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:39.214 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:39.214 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:39.214 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12691 2024-04-25T22:42:39.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.214 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:39.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:39.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:39.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:39.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:39.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:39.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730653+0000", 2024-04-25T22:42:39.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1799999999999999e-06 2024-04-25T22:42:39.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:39.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738136+0000", 2024-04-25T22:42:39.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0074832789999999998 2024-04-25T22:42:39.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:39.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738169+0000", 2024-04-25T22:42:39.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3115999999999999e-05 2024-04-25T22:42:39.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:39.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738190+0000", 2024-04-25T22:42:39.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1060000000000002e-05 2024-04-25T22:42:39.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738264+0000", 2024-04-25T22:42:39.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3150000000000003e-05 2024-04-25T22:42:39.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:39.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738333+0000", 2024-04-25T22:42:39.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9314999999999996e-05 2024-04-25T22:42:39.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:39.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738425+0000", 2024-04-25T22:42:39.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2498999999999996e-05 2024-04-25T22:42:39.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:39.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.745181+0000", 2024-04-25T22:42:39.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067553240000000001 2024-04-25T22:42:39.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:39.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776101+0000", 2024-04-25T22:42:39.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.030920033 2024-04-25T22:42:39.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:39.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776140+0000", 2024-04-25T22:42:39.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9706999999999998e-05 2024-04-25T22:42:39.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:39.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776173+0000", 2024-04-25T22:42:39.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2335000000000001e-05 2024-04-25T22:42:39.219 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.219 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.219 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.219 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12813 4.18 4:1945bfc2:::10000003578.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:39.219 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:39.219 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.258013682000001, 2024-04-25T22:42:39.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054261216000000001, 2024-04-25T22:42:39.219 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:39.220 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:39.220 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:39.220 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:39.220 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:39.220 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:39.220 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12813 2024-04-25T22:42:39.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.220 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:39.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:39.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:39.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:39.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:39.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:39.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869175+0000", 2024-04-25T22:42:39.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3200000000000005e-07 2024-04-25T22:42:39.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:39.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872980+0000", 2024-04-25T22:42:39.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038049720000000002 2024-04-25T22:42:39.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:39.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872988+0000", 2024-04-25T22:42:39.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5429999999999994e-06 2024-04-25T22:42:39.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:39.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872993+0000", 2024-04-25T22:42:39.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8570000000000003e-06 2024-04-25T22:42:39.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873054+0000", 2024-04-25T22:42:39.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0801000000000003e-05 2024-04-25T22:42:39.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:39.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873140+0000", 2024-04-25T22:42:39.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6236999999999994e-05 2024-04-25T22:42:39.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:39.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873271+0000", 2024-04-25T22:42:39.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130541 2024-04-25T22:42:39.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:39.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.884240+0000", 2024-04-25T22:42:39.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010969527 2024-04-25T22:42:39.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:39.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923308+0000", 2024-04-25T22:42:39.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039067317999999997 2024-04-25T22:42:39.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:39.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923373+0000", 2024-04-25T22:42:39.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5055000000000006e-05 2024-04-25T22:42:39.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:39.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923436+0000", 2024-04-25T22:42:39.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2732999999999997e-05 2024-04-25T22:42:39.224 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.224 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.224 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.225 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13328 4.16 e65/54 4:6a9ab238:::1000000339b.00000000:head v 65'186, mlcod=65'183)", 2024-04-25T22:42:39.225 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:39.225 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.637553614000002, 2024-04-25T22:42:39.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.046438762000000001, 2024-04-25T22:42:39.225 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:39.225 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:39.225 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:39.225 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:39.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:39.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:39.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:39.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:39.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:39.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489637+0000", 2024-04-25T22:42:39.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.357e-06 2024-04-25T22:42:39.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:39.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496055+0000", 2024-04-25T22:42:39.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0064181380000000003 2024-04-25T22:42:39.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:39.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496074+0000", 2024-04-25T22:42:39.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8904000000000001e-05 2024-04-25T22:42:39.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:39.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496085+0000", 2024-04-25T22:42:39.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1245e-05 2024-04-25T22:42:39.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496169+0000", 2024-04-25T22:42:39.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3974000000000006e-05 2024-04-25T22:42:39.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:39.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496203+0000", 2024-04-25T22:42:39.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3679000000000001e-05 2024-04-25T22:42:39.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:39.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536002+0000", 2024-04-25T22:42:39.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039799569 2024-04-25T22:42:39.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:39.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536073+0000", 2024-04-25T22:42:39.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0895999999999993e-05 2024-04-25T22:42:39.229 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.229 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.229 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.229 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13338 4.e 4:737b94c2:::1000000338a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:39.229 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:39.229 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.631413099, 2024-04-25T22:42:39.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047911849999999999, 2024-04-25T22:42:39.229 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:39.229 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:39.229 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:39.230 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:39.230 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:39.230 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:39.230 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13338 2024-04-25T22:42:39.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.230 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:39.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:39.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:39.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:39.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:39.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:39.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495776+0000", 2024-04-25T22:42:39.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2399999999999996e-07 2024-04-25T22:42:39.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:39.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503748+0000", 2024-04-25T22:42:39.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079725479999999994 2024-04-25T22:42:39.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:39.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503940+0000", 2024-04-25T22:42:39.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000191249 2024-04-25T22:42:39.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:39.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504061+0000", 2024-04-25T22:42:39.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120982 2024-04-25T22:42:39.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515564+0000", 2024-04-25T22:42:39.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011503342999999999 2024-04-25T22:42:39.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:39.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515799+0000", 2024-04-25T22:42:39.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000235138 2024-04-25T22:42:39.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:39.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543419+0000", 2024-04-25T22:42:39.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027620167000000001 2024-04-25T22:42:39.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:39.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543522+0000", 2024-04-25T22:42:39.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010254100000000001 2024-04-25T22:42:39.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:39.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543687+0000", 2024-04-25T22:42:39.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016495799999999999 2024-04-25T22:42:39.234 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.234 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.234 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.234 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13329 4.26 e65/57 4:64e005a2:::10000003483.00000000:head v 65'226, mlcod=64'224)", 2024-04-25T22:42:39.235 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:39.235 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.630810417999999, 2024-04-25T22:42:39.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048871456000000001, 2024-04-25T22:42:39.235 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:39.235 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:39.235 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:39.235 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:39.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:39.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:39.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:39.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:39.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:39.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496379+0000", 2024-04-25T22:42:39.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1480000000000001e-06 2024-04-25T22:42:39.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:39.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504870+0000", 2024-04-25T22:42:39.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0084917880000000001 2024-04-25T22:42:39.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:39.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504888+0000", 2024-04-25T22:42:39.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7365999999999999e-05 2024-04-25T22:42:39.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:39.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504899+0000", 2024-04-25T22:42:39.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1516e-05 2024-04-25T22:42:39.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515953+0000", 2024-04-25T22:42:39.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011054074000000001 2024-04-25T22:42:39.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:39.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515993+0000", 2024-04-25T22:42:39.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9854999999999997e-05 2024-04-25T22:42:39.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:39.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545191+0000", 2024-04-25T22:42:39.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029197323000000001 2024-04-25T22:42:39.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:39.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545249+0000", 2024-04-25T22:42:39.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8386e-05 2024-04-25T22:42:39.238 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.238 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.238 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.239 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13713 4.2b 4:d574dbff:::100000031d0.00000001:head [write 0~4194304 [2@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:39.239 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:39.239 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.218624299999998, 2024-04-25T22:42:39.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047324328999999998, 2024-04-25T22:42:39.239 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:39.239 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:39.239 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:39.239 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:39.239 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:39.239 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:39.239 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13713 2024-04-25T22:42:39.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.239 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:39.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:39.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:39.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:39.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:39.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:39.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:39.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908565+0000", 2024-04-25T22:42:39.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.694e-06 2024-04-25T22:42:39.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:39.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916170+0000", 2024-04-25T22:42:39.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076041720000000002 2024-04-25T22:42:39.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:39.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916200+0000", 2024-04-25T22:42:39.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0463999999999998e-05 2024-04-25T22:42:39.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:39.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916209+0000", 2024-04-25T22:42:39.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3079999999999997e-06 2024-04-25T22:42:39.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:39.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916297+0000", 2024-04-25T22:42:39.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8159999999999996e-05 2024-04-25T22:42:39.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:39.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916554+0000", 2024-04-25T22:42:39.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025661800000000002 2024-04-25T22:42:39.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:39.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916794+0000", 2024-04-25T22:42:39.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024013999999999999 2024-04-25T22:42:39.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:39.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.933120+0000", 2024-04-25T22:42:39.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016325559 2024-04-25T22:42:39.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:39.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955612+0000", 2024-04-25T22:42:39.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022491786 2024-04-25T22:42:39.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:39.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955797+0000", 2024-04-25T22:42:39.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018533699999999999 2024-04-25T22:42:39.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:39.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:39.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:39.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955888+0000", 2024-04-25T22:42:39.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1090999999999999e-05 2024-04-25T22:42:39.244 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.244 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.244 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.244 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:39.244 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:39.244 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:39.247 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-04-25T22:42:39.247 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:39.247 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T22:42:39.248 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:39.243+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:39.347 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:39.346+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:39.379 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:39.380 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:39.380 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:42:39.380 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:39.392 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:42:39.394 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:39.448 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:39.443+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:39.533 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:39.533 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:39.533 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:39.548 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:42:39.550 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:39.546+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:39.553 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:39.553 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:39.554 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-04-25T22:42:39.557 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:39.557 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:39.559 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:39.559 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:39.573 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T22:42:39.574 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:39.662 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:39.662+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:39.735 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:39.736 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:39.750 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:39.751 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:39.747+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:39.852 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:39.850+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:39.882 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:39.882 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:39.896 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:39.933 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2024-04-25T22:42:39.951 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi057.front.sepia.ceph.com... 2024-04-25T22:42:39.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:42:39.951 DEBUG:teuthology.orchestra.run.smithi057:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-25T22:42:39.952 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~65s 2024-04-25T22:42:39.953 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:39.947+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:39.976 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:ceph-fuse[22831]: fuse finished with error 0 and tester_r 0 2024-04-25T22:42:39.977 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:42:40.034 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:40.034 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:40.049 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:40.055 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:40.050+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:40.154 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:40.151+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:40.213 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:40.213 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:40.227 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:40.269 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:40.267+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:40.356 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:40.355+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:40.357 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:40.357 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:40.371 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:40.457 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:40.454+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:40.495 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:40.495 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:40.495 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is set 2024-04-25T22:42:40.509 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:40.594 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:40.594+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:40.659 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:40.655+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:40.674 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:40.674 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:40.688 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:40.760 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:40.758+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:40.822 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:40.822 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:40.835 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:40.881 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:40.879+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:40.951 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:40.951 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:40.961 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:40.955+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:40.965 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:41.062 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:41.059+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:41.131 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:41.131 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:41.145 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:41.189 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:41.187+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:41.263 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:41.262+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:41.276 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:41.276 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:41.291 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:41.364 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:41.359+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:41.462 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:41.462 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:41.465 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:41.462+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:41.477 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:41.558 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:42:41.566 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:41.563+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:41.644 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:41.644 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:41.659 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:41.705 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:41.703+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:41.716 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:41.716 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:41.716 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:41.736 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:41.736 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:41.740 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:41.740 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:41.768 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:41.763+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:41.790 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:41.791 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:41.791 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:42:41.791 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:41.804 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:41.868 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:41.866+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:41.961 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:41.961 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:41.961 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:42:41.961 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:42:41.961 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:41.969 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:41.966+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:41.975 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:42.070 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:42.067+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:42.095 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:42:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:42:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 147.49732245499999, 2024-04-25T22:42:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:42:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:42:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:42:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:42.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:42:42.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:42:42.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:42.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:42:42.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:42:42.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:42:42.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:42:42.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:42:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:42:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:42:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:42:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:42:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:42:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:42:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:42:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:42:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:42:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:42:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:42:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:42:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:42:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:42:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:42:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:42:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:42:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 147.49721414199999, 2024-04-25T22:42:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:42:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:42:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:42:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:42:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:42:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:42:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:42:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:42:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:42:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:42:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:42:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:42:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:42:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:42:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:42:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:42:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:42:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:42:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:42:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:42:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:42:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:42:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:42:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:42:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:42:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:42:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:42:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 147.49714748599999, 2024-04-25T22:42:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:42:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:42:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:42:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:42:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:42:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:42:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:42:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:42:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:42:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:42:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:42:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:42:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:42:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:42:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:42:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:42:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:42:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:42:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:42:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:42:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:42:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:42:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:42:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:42:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:42:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:42.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:42:42.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:42:42.114 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.114 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.114 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.114 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:42.114 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:42.114 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 147.49705689000001, 2024-04-25T22:42:42.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:42:42.114 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:42.115 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:42.115 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.115 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:42.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:42.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:42.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:42.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:42.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:42.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:42:42.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:42:42.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:42.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:42:42.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:42:42.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:42.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:42:42.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:42:42.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:42:42.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:42:42.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:42:42.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:42:42.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:42.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:42:42.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:42:42.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:42:42.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:42:42.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:42.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:42:42.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:42:42.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:42.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:42:42.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:42:42.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:42.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:42:42.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:42:42.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:42:42.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:42:42.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:42.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:42:42.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:42:42.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:42.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:42:42.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:42:42.120 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.120 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.120 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.120 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:42.120 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:42.120 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 147.49699231700001, 2024-04-25T22:42:42.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:42:42.120 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:42.120 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:42.120 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.121 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:42.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:42.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:42.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:42.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:42.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:42.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:42:42.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:42:42.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:42.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:42:42.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:42:42.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:42.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:42:42.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:42:42.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:42:42.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:42:42.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:42.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:42:42.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:42.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:42:42.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:42:42.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:42:42.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:42:42.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:42.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:42:42.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:42:42.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:42.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:42:42.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:42:42.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:42:42.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:42:42.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:42.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:42:42.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:42:42.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:42.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:42:42.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:42:42.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:42.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:42:42.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:42:42.126 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.126 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.126 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.126 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:42.126 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:42.126 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 147.49692689400001, 2024-04-25T22:42:42.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:42:42.126 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:42.126 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:42.126 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.126 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:42.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:42.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:42.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:42.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:42.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:42.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:42:42.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:42.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:42.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:42:42.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:42:42.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:42.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:42:42.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:42:42.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:42:42.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:42:42.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:42:42.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:42:42.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:42.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:42:42.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:42:42.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:42:42.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:42:42.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:42.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:42:42.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:42:42.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:42.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:42:42.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:42:42.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:42.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:42:42.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:42:42.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:42:42.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:42:42.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:42.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:42:42.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:42:42.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:42.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:42:42.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:42:42.132 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.132 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.132 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.132 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:42.132 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:42.132 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 147.49664636, 2024-04-25T22:42:42.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:42:42.132 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:42.132 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:42.132 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.132 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:42.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:42.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:42.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:42.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:42.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:42.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:42:42.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:42:42.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:42.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:42:42.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:42:42.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:42.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:42:42.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:42:42.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:42:42.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:42:42.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:42:42.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:42:42.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:42.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:42:42.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:42:42.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:42:42.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:42:42.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:42.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:42:42.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:42:42.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:42.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:42:42.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:42:42.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:42:42.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:42:42.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:42.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:42:42.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:42:42.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:42.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:42:42.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:42:42.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:42.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:42:42.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:42:42.138 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.138 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.138 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.138 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10678 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:42.138 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:42.138 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.605361621, 2024-04-25T22:42:42.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050477795999999998, 2024-04-25T22:42:42.138 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:42.138 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:42.138 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.138 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:42.138 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:42.139 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.139 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10678 2024-04-25T22:42:42.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.139 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:42.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:42.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:42.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:42.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:42.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:42.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488127+0000", 2024-04-25T22:42:42.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.716e-06 2024-04-25T22:42:42.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:42.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496392+0000", 2024-04-25T22:42:42.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082651500000000006 2024-04-25T22:42:42.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:42.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496428+0000", 2024-04-25T22:42:42.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5441999999999997e-05 2024-04-25T22:42:42.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496451+0000", 2024-04-25T22:42:42.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3529000000000001e-05 2024-04-25T22:42:42.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496601+0000", 2024-04-25T22:42:42.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014935600000000001 2024-04-25T22:42:42.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:42.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496856+0000", 2024-04-25T22:42:42.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025537900000000002 2024-04-25T22:42:42.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:42.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.497206+0000", 2024-04-25T22:42:42.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000350599 2024-04-25T22:42:42.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538231+0000", 2024-04-25T22:42:42.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041024146999999997 2024-04-25T22:42:42.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:42.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538298+0000", 2024-04-25T22:42:42.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7688000000000007e-05 2024-04-25T22:42:42.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:42.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538467+0000", 2024-04-25T22:42:42.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000168178 2024-04-25T22:42:42.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:42.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538603+0000", 2024-04-25T22:42:42.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013661200000000001 2024-04-25T22:42:42.143 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.143 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.143 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.144 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10692 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:42.144 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:42.144 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.588771826999999, 2024-04-25T22:42:42.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.061242408999999998, 2024-04-25T22:42:42.144 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:42.144 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:42.144 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.144 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:42.144 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:42.144 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.144 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10692 2024-04-25T22:42:42.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.144 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:42.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:42.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:42.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:42.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:42.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:42.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504717+0000", 2024-04-25T22:42:42.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6199999999999999e-06 2024-04-25T22:42:42.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:42.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511770+0000", 2024-04-25T22:42:42.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0070530929999999999 2024-04-25T22:42:42.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:42.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511810+0000", 2024-04-25T22:42:42.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0635e-05 2024-04-25T22:42:42.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511837+0000", 2024-04-25T22:42:42.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6423000000000001e-05 2024-04-25T22:42:42.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520096+0000", 2024-04-25T22:42:42.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082593730000000004 2024-04-25T22:42:42.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:42.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520345+0000", 2024-04-25T22:42:42.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024908800000000001 2024-04-25T22:42:42.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:42.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520794+0000", 2024-04-25T22:42:42.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000449023 2024-04-25T22:42:42.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:42.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538675+0000", 2024-04-25T22:42:42.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017880991999999998 2024-04-25T22:42:42.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565761+0000", 2024-04-25T22:42:42.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027085260999999999 2024-04-25T22:42:42.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:42.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565892+0000", 2024-04-25T22:42:42.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013152300000000001 2024-04-25T22:42:42.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:42.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565958+0000", 2024-04-25T22:42:42.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5377999999999996e-05 2024-04-25T22:42:42.149 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.149 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.149 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.149 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10693 4.2c 4:36971e45:::100000030bd.00000001:head [write 971225~86041] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:42.149 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:42.149 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.581593465000001, 2024-04-25T22:42:42.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054529782999999998, 2024-04-25T22:42:42.149 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:42.149 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:42.150 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.150 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:42.150 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:42.150 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.150 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10693 2024-04-25T22:42:42.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.150 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:42.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:42.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:42.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:42.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:42.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:42.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511897+0000", 2024-04-25T22:42:42.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2499999999999998e-06 2024-04-25T22:42:42.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:42.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512094+0000", 2024-04-25T22:42:42.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019700100000000001 2024-04-25T22:42:42.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:42.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512121+0000", 2024-04-25T22:42:42.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7288999999999999e-05 2024-04-25T22:42:42.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512137+0000", 2024-04-25T22:42:42.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.592e-05 2024-04-25T22:42:42.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.533845+0000", 2024-04-25T22:42:42.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021707595999999999 2024-04-25T22:42:42.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:42.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534176+0000", 2024-04-25T22:42:42.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033187000000000001 2024-04-25T22:42:42.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:42.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534626+0000", 2024-04-25T22:42:42.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00045008599999999999 2024-04-25T22:42:42.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:42.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.539165+0000", 2024-04-25T22:42:42.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045386380000000002 2024-04-25T22:42:42.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566169+0000", 2024-04-25T22:42:42.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027004199 2024-04-25T22:42:42.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:42.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566317+0000", 2024-04-25T22:42:42.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014747999999999999 2024-04-25T22:42:42.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:42.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566423+0000", 2024-04-25T22:42:42.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010645399999999999 2024-04-25T22:42:42.154 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.154 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.154 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.155 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10696 4.2b 4:d56d2a96:::100000030c3.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:42.155 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:42.155 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.579885820000001, 2024-04-25T22:42:42.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052282190999999999, 2024-04-25T22:42:42.155 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:42.155 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:42.155 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.155 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:42.155 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:42.155 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.155 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10696 2024-04-25T22:42:42.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.156 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:42.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:42.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:42.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:42.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:42.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:42.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513603+0000", 2024-04-25T22:42:42.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.283e-06 2024-04-25T22:42:42.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:42.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518647+0000", 2024-04-25T22:42:42.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050440859999999997 2024-04-25T22:42:42.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:42.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518672+0000", 2024-04-25T22:42:42.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4468e-05 2024-04-25T22:42:42.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518691+0000", 2024-04-25T22:42:42.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9213999999999999e-05 2024-04-25T22:42:42.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518806+0000", 2024-04-25T22:42:42.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115296 2024-04-25T22:42:42.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:42.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519011+0000", 2024-04-25T22:42:42.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020445700000000001 2024-04-25T22:42:42.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:42.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519207+0000", 2024-04-25T22:42:42.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000196431 2024-04-25T22:42:42.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:42.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531309+0000", 2024-04-25T22:42:42.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012101694 2024-04-25T22:42:42.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565622+0000", 2024-04-25T22:42:42.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034312976000000002 2024-04-25T22:42:42.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:42.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565769+0000", 2024-04-25T22:42:42.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014715900000000001 2024-04-25T22:42:42.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:42.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565883+0000", 2024-04-25T22:42:42.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000114127 2024-04-25T22:42:42.160 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.160 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.160 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.160 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10701 4.a 4:51b6a63a:::100000030f2.00000000:head [write 0~3014656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:42.160 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:42.161 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.568441809999999, 2024-04-25T22:42:42.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047414393999999999, 2024-04-25T22:42:42.161 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:42.161 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:42.161 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.161 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:42.161 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:42.161 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.161 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10701 2024-04-25T22:42:42.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.161 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:42.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:42.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:42.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:42.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:42.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:42.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525048+0000", 2024-04-25T22:42:42.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0819999999999999e-06 2024-04-25T22:42:42.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:42.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531709+0000", 2024-04-25T22:42:42.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066610929999999999 2024-04-25T22:42:42.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:42.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531751+0000", 2024-04-25T22:42:42.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1650000000000003e-05 2024-04-25T22:42:42.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531788+0000", 2024-04-25T22:42:42.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7305000000000003e-05 2024-04-25T22:42:42.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531943+0000", 2024-04-25T22:42:42.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015500600000000001 2024-04-25T22:42:42.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:42.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532086+0000", 2024-04-25T22:42:42.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014238599999999999 2024-04-25T22:42:42.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:42.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532295+0000", 2024-04-25T22:42:42.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020922000000000001 2024-04-25T22:42:42.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:42.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.545987+0000", 2024-04-25T22:42:42.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013692582999999999 2024-04-25T22:42:42.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572315+0000", 2024-04-25T22:42:42.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026327488 2024-04-25T22:42:42.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:42.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572381+0000", 2024-04-25T22:42:42.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5609000000000002e-05 2024-04-25T22:42:42.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:42.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572460+0000", 2024-04-25T22:42:42.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8972000000000002e-05 2024-04-25T22:42:42.166 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.166 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.166 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.166 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:10700 4.11 e63/57 4:88409fbf:::100000030ec.00000000:head v 63'193, mlcod=62'191)", 2024-04-25T22:42:42.167 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:42.167 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.557612354, 2024-04-25T22:42:42.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050517667000000002, 2024-04-25T22:42:42.167 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:42.167 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:42.167 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.167 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:42.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:42.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:42.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:42.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:42.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:42.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535876+0000", 2024-04-25T22:42:42.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0300000000000001e-06 2024-04-25T22:42:42.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:42.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565275+0000", 2024-04-25T22:42:42.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029399033000000001 2024-04-25T22:42:42.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:42.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565358+0000", 2024-04-25T22:42:42.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3403000000000001e-05 2024-04-25T22:42:42.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565380+0000", 2024-04-25T22:42:42.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1761999999999999e-05 2024-04-25T22:42:42.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565505+0000", 2024-04-25T22:42:42.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000125153 2024-04-25T22:42:42.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:42.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565550+0000", 2024-04-25T22:42:42.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5479000000000003e-05 2024-04-25T22:42:42.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:42.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586328+0000", 2024-04-25T22:42:42.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020777982 2024-04-25T22:42:42.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:42.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586392+0000", 2024-04-25T22:42:42.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3825000000000006e-05 2024-04-25T22:42:42.171 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.171 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.171 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.171 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12632 4.a 4:506aad5d:::1000000310f.00000000:head [write 0~4194304 [2@2043125]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:42.171 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:42.171 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.458557228, 2024-04-25T22:42:42.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051574097999999999, 2024-04-25T22:42:42.171 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:42.171 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:42.171 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.171 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:42.171 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:42.171 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.171 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12632 2024-04-25T22:42:42.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.172 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:42.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:42.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:42.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:42.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:42.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:42.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634932+0000", 2024-04-25T22:42:42.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1600000000000001e-06 2024-04-25T22:42:42.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:42.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642614+0000", 2024-04-25T22:42:42.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076823000000000004 2024-04-25T22:42:42.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:42.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642660+0000", 2024-04-25T22:42:42.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6016000000000001e-05 2024-04-25T22:42:42.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642686+0000", 2024-04-25T22:42:42.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5491999999999999e-05 2024-04-25T22:42:42.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642870+0000", 2024-04-25T22:42:42.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000184045 2024-04-25T22:42:42.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:42.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643122+0000", 2024-04-25T22:42:42.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025242299999999999 2024-04-25T22:42:42.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:42.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643634+0000", 2024-04-25T22:42:42.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051145800000000001 2024-04-25T22:42:42.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:42.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.682287+0000", 2024-04-25T22:42:42.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038653342 2024-04-25T22:42:42.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686419+0000", 2024-04-25T22:42:42.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0041325169999999996 2024-04-25T22:42:42.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:42.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686464+0000", 2024-04-25T22:42:42.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4171000000000001e-05 2024-04-25T22:42:42.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:42.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686504+0000", 2024-04-25T22:42:42.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0173999999999999e-05 2024-04-25T22:42:42.176 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.176 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.176 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.176 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12691 4.39 4:9d0d8843:::100000030ef.00000000:head [write 0~4194304 [3@92787]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:42.176 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:42.177 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.362836138999999, 2024-04-25T22:42:42.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045521998000000001, 2024-04-25T22:42:42.177 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:42.177 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:42.177 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.177 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:42.177 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:42.177 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.177 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12691 2024-04-25T22:42:42.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.177 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:42.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:42.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:42.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:42.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:42.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:42.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730653+0000", 2024-04-25T22:42:42.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1799999999999999e-06 2024-04-25T22:42:42.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:42.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738136+0000", 2024-04-25T22:42:42.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0074832789999999998 2024-04-25T22:42:42.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:42.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738169+0000", 2024-04-25T22:42:42.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3115999999999999e-05 2024-04-25T22:42:42.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738190+0000", 2024-04-25T22:42:42.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1060000000000002e-05 2024-04-25T22:42:42.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738264+0000", 2024-04-25T22:42:42.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3150000000000003e-05 2024-04-25T22:42:42.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:42.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738333+0000", 2024-04-25T22:42:42.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9314999999999996e-05 2024-04-25T22:42:42.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:42.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738425+0000", 2024-04-25T22:42:42.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2498999999999996e-05 2024-04-25T22:42:42.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:42.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.745181+0000", 2024-04-25T22:42:42.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067553240000000001 2024-04-25T22:42:42.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776101+0000", 2024-04-25T22:42:42.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.030920033 2024-04-25T22:42:42.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:42.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776140+0000", 2024-04-25T22:42:42.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9706999999999998e-05 2024-04-25T22:42:42.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:42.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776173+0000", 2024-04-25T22:42:42.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2335000000000001e-05 2024-04-25T22:42:42.181 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.181 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.182 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.182 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12813 4.18 4:1945bfc2:::10000003578.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:42.182 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:42.182 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.224312657999999, 2024-04-25T22:42:42.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054261216000000001, 2024-04-25T22:42:42.182 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:42.182 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:42.182 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.182 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:42.182 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:42.182 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.183 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12813 2024-04-25T22:42:42.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.183 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:42.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:42.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:42.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:42.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:42.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:42.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869175+0000", 2024-04-25T22:42:42.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3200000000000005e-07 2024-04-25T22:42:42.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:42.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872980+0000", 2024-04-25T22:42:42.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038049720000000002 2024-04-25T22:42:42.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:42.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872988+0000", 2024-04-25T22:42:42.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5429999999999994e-06 2024-04-25T22:42:42.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872993+0000", 2024-04-25T22:42:42.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8570000000000003e-06 2024-04-25T22:42:42.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873054+0000", 2024-04-25T22:42:42.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0801000000000003e-05 2024-04-25T22:42:42.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:42.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873140+0000", 2024-04-25T22:42:42.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6236999999999994e-05 2024-04-25T22:42:42.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:42.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873271+0000", 2024-04-25T22:42:42.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130541 2024-04-25T22:42:42.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:42.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.884240+0000", 2024-04-25T22:42:42.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010969527 2024-04-25T22:42:42.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923308+0000", 2024-04-25T22:42:42.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039067317999999997 2024-04-25T22:42:42.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:42.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923373+0000", 2024-04-25T22:42:42.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5055000000000006e-05 2024-04-25T22:42:42.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:42.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923436+0000", 2024-04-25T22:42:42.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2732999999999997e-05 2024-04-25T22:42:42.188 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.188 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.188 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.188 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13328 4.16 e65/54 4:6a9ab238:::1000000339b.00000000:head v 65'186, mlcod=65'183)", 2024-04-25T22:42:42.188 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:42.188 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.603852589999999, 2024-04-25T22:42:42.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.046438762000000001, 2024-04-25T22:42:42.188 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:42.188 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:42.188 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.188 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:42.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:42.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:42.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:42.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:42.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:42.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489637+0000", 2024-04-25T22:42:42.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.357e-06 2024-04-25T22:42:42.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:42.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496055+0000", 2024-04-25T22:42:42.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0064181380000000003 2024-04-25T22:42:42.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:42.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496074+0000", 2024-04-25T22:42:42.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8904000000000001e-05 2024-04-25T22:42:42.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496085+0000", 2024-04-25T22:42:42.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1245e-05 2024-04-25T22:42:42.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496169+0000", 2024-04-25T22:42:42.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3974000000000006e-05 2024-04-25T22:42:42.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:42.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496203+0000", 2024-04-25T22:42:42.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3679000000000001e-05 2024-04-25T22:42:42.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:42.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536002+0000", 2024-04-25T22:42:42.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039799569 2024-04-25T22:42:42.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:42.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536073+0000", 2024-04-25T22:42:42.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0895999999999993e-05 2024-04-25T22:42:42.192 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.192 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.192 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.192 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13338 4.e 4:737b94c2:::1000000338a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:42.192 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:42.192 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.597712075, 2024-04-25T22:42:42.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047911849999999999, 2024-04-25T22:42:42.192 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:42.192 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:42.193 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.193 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:42.193 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:42.193 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.193 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13338 2024-04-25T22:42:42.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.193 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:42.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:42.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:42.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:42.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:42.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:42.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495776+0000", 2024-04-25T22:42:42.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2399999999999996e-07 2024-04-25T22:42:42.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:42.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503748+0000", 2024-04-25T22:42:42.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079725479999999994 2024-04-25T22:42:42.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:42.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503940+0000", 2024-04-25T22:42:42.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000191249 2024-04-25T22:42:42.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504061+0000", 2024-04-25T22:42:42.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120982 2024-04-25T22:42:42.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515564+0000", 2024-04-25T22:42:42.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011503342999999999 2024-04-25T22:42:42.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:42.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515799+0000", 2024-04-25T22:42:42.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000235138 2024-04-25T22:42:42.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:42.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543419+0000", 2024-04-25T22:42:42.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027620167000000001 2024-04-25T22:42:42.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:42.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543522+0000", 2024-04-25T22:42:42.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010254100000000001 2024-04-25T22:42:42.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:42.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543687+0000", 2024-04-25T22:42:42.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016495799999999999 2024-04-25T22:42:42.197 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.197 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.197 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.197 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13329 4.26 e65/57 4:64e005a2:::10000003483.00000000:head v 65'226, mlcod=64'224)", 2024-04-25T22:42:42.197 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:42.197 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.597109394, 2024-04-25T22:42:42.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048871456000000001, 2024-04-25T22:42:42.197 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:42.197 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:42.197 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.198 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:42.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:42.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:42.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:42.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:42.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:42.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496379+0000", 2024-04-25T22:42:42.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1480000000000001e-06 2024-04-25T22:42:42.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:42.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504870+0000", 2024-04-25T22:42:42.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0084917880000000001 2024-04-25T22:42:42.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:42.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504888+0000", 2024-04-25T22:42:42.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7365999999999999e-05 2024-04-25T22:42:42.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504899+0000", 2024-04-25T22:42:42.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1516e-05 2024-04-25T22:42:42.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515953+0000", 2024-04-25T22:42:42.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011054074000000001 2024-04-25T22:42:42.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:42.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515993+0000", 2024-04-25T22:42:42.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9854999999999997e-05 2024-04-25T22:42:42.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:42.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545191+0000", 2024-04-25T22:42:42.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029197323000000001 2024-04-25T22:42:42.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:42.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545249+0000", 2024-04-25T22:42:42.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8386e-05 2024-04-25T22:42:42.201 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.201 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.201 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.201 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13713 4.2b 4:d574dbff:::100000031d0.00000001:head [write 0~4194304 [2@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:42.201 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:42.201 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.184923275999999, 2024-04-25T22:42:42.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047324328999999998, 2024-04-25T22:42:42.201 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:42.201 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:42.202 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.202 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:42.202 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:42.202 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.202 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13713 2024-04-25T22:42:42.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.202 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:42.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:42.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:42.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:42.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:42.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:42.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:42.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908565+0000", 2024-04-25T22:42:42.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.694e-06 2024-04-25T22:42:42.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:42.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916170+0000", 2024-04-25T22:42:42.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076041720000000002 2024-04-25T22:42:42.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:42.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916200+0000", 2024-04-25T22:42:42.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0463999999999998e-05 2024-04-25T22:42:42.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916209+0000", 2024-04-25T22:42:42.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3079999999999997e-06 2024-04-25T22:42:42.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:42.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916297+0000", 2024-04-25T22:42:42.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8159999999999996e-05 2024-04-25T22:42:42.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:42.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916554+0000", 2024-04-25T22:42:42.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025661800000000002 2024-04-25T22:42:42.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:42.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916794+0000", 2024-04-25T22:42:42.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024013999999999999 2024-04-25T22:42:42.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:42.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.933120+0000", 2024-04-25T22:42:42.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016325559 2024-04-25T22:42:42.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955612+0000", 2024-04-25T22:42:42.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022491786 2024-04-25T22:42:42.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:42.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955797+0000", 2024-04-25T22:42:42.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018533699999999999 2024-04-25T22:42:42.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:42.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:42.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:42.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955888+0000", 2024-04-25T22:42:42.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1090999999999999e-05 2024-04-25T22:42:42.207 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.207 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.207 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.207 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:42.207 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:42.207 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:42.208 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:42.209 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:42.207+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:42.309 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:42.306+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:42.341 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:42.341 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:42.341 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:42:42.341 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:42.355 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:42.410 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:42.411+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:42.511 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:42.511+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:42.518 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:42.518 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:42.518 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:42:42.518 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:42:42.518 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:42.518 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:42:42.532 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:42.612 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:42.607+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:42.651 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:42.651 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:42.651 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:42.652 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:42.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.652 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:42.652 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:42.652 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 148.05282584, 2024-04-25T22:42:42.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:42.652 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:42.652 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:42.652 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.652 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:42.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.652 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:42.652 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:42.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:42.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:42.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:42.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:42.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:42.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:42.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:42.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:42.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:42.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:42.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:42.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:42.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:42.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:42.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:42.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:42.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:42.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:42.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:42.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:42.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:42.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:42.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:42.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:42.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:42.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:42.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:42.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:42.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:42.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:42.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:42.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.657 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:42.657 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:42.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:42.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.657 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:42.657 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:42.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:42.657 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.657 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.657 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.658 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:42.658 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:42.658 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 148.05268858400001, 2024-04-25T22:42:42.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:42.658 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:42.658 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:42.658 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.658 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:42.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:42.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:42.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:42.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:42.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:42.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:42.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:42.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:42.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:42.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:42.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:42.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:42.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:42.660 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:42.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:42.660 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:42.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:42.660 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:42.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:42.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:42.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:42.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:42.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:42.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:42.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:42.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.662 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:42.662 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:42.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:42.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.662 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:42.662 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:42.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:42.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.662 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.662 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:42.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:42.663 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.663 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:42.663 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:42.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:42.663 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.663 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:42.663 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:42.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:42.663 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.663 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.663 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.664 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.664 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:42.664 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:42.664 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 148.052428416, 2024-04-25T22:42:42.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:42.664 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:42.664 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:42.664 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.664 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:42.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:42.664 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:42.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:42.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:42.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:42.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:42.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:42.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:42.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:42.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:42.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:42.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:42.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:42.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:42.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:42.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:42.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:42.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:42.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:42.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:42.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:42.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:42.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:42.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:42.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:42.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.668 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:42.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:42.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:42.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.668 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:42.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:42.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:42.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:42.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:42.669 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:42.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:42.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:42.669 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:42.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:42.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:42.669 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.670 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.670 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.670 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.670 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.670 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:42.670 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:42.670 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 148.05226321699999, 2024-04-25T22:42:42.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:42.670 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:42.670 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:42.670 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:42.670 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:42.670 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:42.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:42.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:42.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:42.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:42.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:42.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:42.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:42.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:42.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:42.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:42.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:42.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:42.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:42.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:42.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:42.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:42.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:42.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:42.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:42.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:42.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:42.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:42.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:42.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:42.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:42.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:42.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:42.674 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.674 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.674 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.675 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:42.675 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:42.675 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 148.05219755499999, 2024-04-25T22:42:42.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:42.675 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:42.675 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:42.675 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:42.675 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:42.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.675 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:42.675 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:42.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.675 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:42.676 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:42.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.676 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.676 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.676 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:42.676 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:42.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:42.676 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.676 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.676 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:42.676 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:42.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:42.676 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.676 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.676 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:42.677 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:42.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:42.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.677 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.677 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:42.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:42.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.677 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.677 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:42.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:42.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.677 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:42.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:42.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:42.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:42.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:42.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:42.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:42.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:42.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:42.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:42.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:42.679 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.679 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.679 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.679 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10700 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:42.679 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:42.679 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.129330337999999, 2024-04-25T22:42:42.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066789482999999997, 2024-04-25T22:42:42.679 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:42.679 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:42.680 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.680 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:42.680 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:42.680 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.680 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10700 2024-04-25T22:42:42.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.680 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:42.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:42.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:42.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:42.681 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:42.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.681 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:42.681 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519112+0000", 2024-04-25T22:42:42.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1399999999999998e-06 2024-04-25T22:42:42.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.681 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:42.681 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527187+0000", 2024-04-25T22:42:42.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080748899999999995 2024-04-25T22:42:42.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.681 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:42.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527232+0000", 2024-04-25T22:42:42.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4895999999999998e-05 2024-04-25T22:42:42.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527259+0000", 2024-04-25T22:42:42.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7331999999999999e-05 2024-04-25T22:42:42.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529418+0000", 2024-04-25T22:42:42.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002158765 2024-04-25T22:42:42.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:42.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529572+0000", 2024-04-25T22:42:42.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015438499999999999 2024-04-25T22:42:42.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.683 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:42.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529762+0000", 2024-04-25T22:42:42.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018998100000000001 2024-04-25T22:42:42.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.683 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:42.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.548359+0000", 2024-04-25T22:42:42.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018596444 2024-04-25T22:42:42.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.683 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.683 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585801+0000", 2024-04-25T22:42:42.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.037442469999999999 2024-04-25T22:42:42.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.684 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.684 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:42.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585847+0000", 2024-04-25T22:42:42.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5565000000000002e-05 2024-04-25T22:42:42.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.684 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.684 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:42.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585899+0000", 2024-04-25T22:42:42.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2614999999999997e-05 2024-04-25T22:42:42.684 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.684 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.684 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.685 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10714 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:42.685 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:42.685 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.095649375000001, 2024-04-25T22:42:42.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.048080623000000003, 2024-04-25T22:42:42.685 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:42.685 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:42.685 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.685 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:42.685 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:42.685 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.685 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10714 2024-04-25T22:42:42.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.685 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:42.686 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.686 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:42.686 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:42.686 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.686 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.686 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.686 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:42.686 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:42.686 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.686 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.686 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.686 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:42.686 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552792+0000", 2024-04-25T22:42:42.686 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:42:42.686 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:42.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559915+0000", 2024-04-25T22:42:42.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071231690000000004 2024-04-25T22:42:42.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:42.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559932+0000", 2024-04-25T22:42:42.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7169000000000001e-05 2024-04-25T22:42:42.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559942+0000", 2024-04-25T22:42:42.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0261999999999999e-05 2024-04-25T22:42:42.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560018+0000", 2024-04-25T22:42:42.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5358000000000006e-05 2024-04-25T22:42:42.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:42.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560118+0000", 2024-04-25T22:42:42.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000100911 2024-04-25T22:42:42.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:42.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560281+0000", 2024-04-25T22:42:42.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016288500000000001 2024-04-25T22:42:42.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:42.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.579740+0000", 2024-04-25T22:42:42.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019458598000000001 2024-04-25T22:42:42.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600484+0000", 2024-04-25T22:42:42.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020744483000000001 2024-04-25T22:42:42.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.689 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:42.689 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600664+0000", 2024-04-25T22:42:42.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017953899999999999 2024-04-25T22:42:42.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.690 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:42.690 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600871+0000", 2024-04-25T22:42:42.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020737199999999999 2024-04-25T22:42:42.690 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.690 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.690 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.690 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10813 4.17 4:e8010137:::100000030b0.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:42.690 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:42.690 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.900700368999999, 2024-04-25T22:42:42.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.047503799999999999, 2024-04-25T22:42:42.690 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:42.690 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:42.691 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.691 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:42.691 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:42.691 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.691 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10813 2024-04-25T22:42:42.691 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.691 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:42.691 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.691 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:42.691 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:42.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.691 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.691 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.691 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:42.692 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:42.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:42.692 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747741+0000", 2024-04-25T22:42:42.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1119999999999999e-06 2024-04-25T22:42:42.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:42.692 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752366+0000", 2024-04-25T22:42:42.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046253240000000001 2024-04-25T22:42:42.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:42.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752382+0000", 2024-04-25T22:42:42.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5639999999999999e-05 2024-04-25T22:42:42.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752393+0000", 2024-04-25T22:42:42.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1626e-05 2024-04-25T22:42:42.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752459+0000", 2024-04-25T22:42:42.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5309999999999996e-05 2024-04-25T22:42:42.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:42.694 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752529+0000", 2024-04-25T22:42:42.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0543000000000005e-05 2024-04-25T22:42:42.694 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.694 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.694 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:42.694 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752637+0000", 2024-04-25T22:42:42.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010788799999999999 2024-04-25T22:42:42.694 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.694 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.694 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:42.694 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760295+0000", 2024-04-25T22:42:42.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076583290000000002 2024-04-25T22:42:42.694 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.694 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.694 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.695 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.794990+0000", 2024-04-25T22:42:42.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034694317000000002 2024-04-25T22:42:42.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.695 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:42.695 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795097+0000", 2024-04-25T22:42:42.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010768999999999999 2024-04-25T22:42:42.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.695 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:42.695 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795243+0000", 2024-04-25T22:42:42.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000146021 2024-04-25T22:42:42.695 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.695 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.695 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.696 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10816 4.17 4:e8010137:::100000030b0.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:42.696 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:42.696 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.895370909, 2024-04-25T22:42:42.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042406530999999997, 2024-04-25T22:42:42.696 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:42.696 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:42.696 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.696 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:42.696 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:42.696 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.696 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10816 2024-04-25T22:42:42.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.696 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:42.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:42.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:42.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:42.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:42.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:42.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753070+0000", 2024-04-25T22:42:42.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9800000000000002e-07 2024-04-25T22:42:42.698 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.698 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:42.698 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753288+0000", 2024-04-25T22:42:42.698 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000217789 2024-04-25T22:42:42.698 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.698 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:42.698 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753301+0000", 2024-04-25T22:42:42.698 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2764e-05 2024-04-25T22:42:42.698 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.698 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.699 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753310+0000", 2024-04-25T22:42:42.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:42:42.699 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.699 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.699 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.699 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758240+0000", 2024-04-25T22:42:42.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049304910000000004 2024-04-25T22:42:42.699 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.699 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.699 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:42.699 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758374+0000", 2024-04-25T22:42:42.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000133428 2024-04-25T22:42:42.699 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.699 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.700 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:42.700 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758576+0000", 2024-04-25T22:42:42.700 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020177899999999999 2024-04-25T22:42:42.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.700 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:42.700 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760626+0000", 2024-04-25T22:42:42.700 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0020501489999999998 2024-04-25T22:42:42.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.700 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.700 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795329+0000", 2024-04-25T22:42:42.700 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034703352999999999 2024-04-25T22:42:42.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:42.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795414+0000", 2024-04-25T22:42:42.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5292999999999998e-05 2024-04-25T22:42:42.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:42.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795476+0000", 2024-04-25T22:42:42.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1206999999999999e-05 2024-04-25T22:42:42.701 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.701 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.701 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.702 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10914 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:42.702 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:42.702 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.694570527, 2024-04-25T22:42:42.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044452984000000001, 2024-04-25T22:42:42.702 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:42.702 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:42.702 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.702 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:42.702 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:42.702 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.702 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10914 2024-04-25T22:42:42.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.702 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:42.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.702 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:42.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:42.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:42.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:42.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:42.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953871+0000", 2024-04-25T22:42:42.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1829999999999999e-06 2024-04-25T22:42:42.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.704 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:42.704 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.962992+0000", 2024-04-25T22:42:42.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091217409999999992 2024-04-25T22:42:42.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.704 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:42.704 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963027+0000", 2024-04-25T22:42:42.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4229e-05 2024-04-25T22:42:42.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.704 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.704 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963042+0000", 2024-04-25T22:42:42.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5152e-05 2024-04-25T22:42:42.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.705 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.705 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.705 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963143+0000", 2024-04-25T22:42:42.705 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101171 2024-04-25T22:42:42.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.705 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.705 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:42.705 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963269+0000", 2024-04-25T22:42:42.705 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012623499999999999 2024-04-25T22:42:42.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.705 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.705 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:42.705 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963453+0000", 2024-04-25T22:42:42.705 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018357900000000001 2024-04-25T22:42:42.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:42.706 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998133+0000", 2024-04-25T22:42:42.706 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034679789000000003 2024-04-25T22:42:42.706 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.706 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998220+0000", 2024-04-25T22:42:42.706 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7153999999999999e-05 2024-04-25T22:42:42.706 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:42.706 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998278+0000", 2024-04-25T22:42:42.706 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8035000000000003e-05 2024-04-25T22:42:42.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.707 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:42.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998323+0000", 2024-04-25T22:42:42.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4715999999999997e-05 2024-04-25T22:42:42.707 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.707 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.707 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.707 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10919 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:42.707 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:42.707 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 29.674259245999998, 2024-04-25T22:42:42.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044010552000000001, 2024-04-25T22:42:42.708 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:42.708 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:42.708 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.708 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:42.708 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:42.708 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.708 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10919 2024-04-25T22:42:42.708 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.708 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:42.708 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.708 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:42.708 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:42.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.708 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:42.709 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:42.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:42.709 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:42.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8100000000000003e-07 2024-04-25T22:42:42.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:42.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980221+0000", 2024-04-25T22:42:42.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060397230000000003 2024-04-25T22:42:42.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.710 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:42.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980242+0000", 2024-04-25T22:42:42.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1373e-05 2024-04-25T22:42:42.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.710 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980252+0000", 2024-04-25T22:42:42.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9990000000000003e-06 2024-04-25T22:42:42.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.711 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.711 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981303+0000", 2024-04-25T22:42:42.711 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010501670000000001 2024-04-25T22:42:42.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.711 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.711 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:42.711 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981444+0000", 2024-04-25T22:42:42.711 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014123799999999999 2024-04-25T22:42:42.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.711 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.711 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:42.711 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981585+0000", 2024-04-25T22:42:42.711 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014071999999999999 2024-04-25T22:42:42.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:42.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003640+0000", 2024-04-25T22:42:42.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022055113000000001 2024-04-25T22:42:42.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018070+0000", 2024-04-25T22:42:42.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014430877 2024-04-25T22:42:42.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:42.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018138+0000", 2024-04-25T22:42:42.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7743000000000005e-05 2024-04-25T22:42:42.713 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.713 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:42.713 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018191+0000", 2024-04-25T22:42:42.713 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3118000000000002e-05 2024-04-25T22:42:42.713 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.713 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.713 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.713 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.713 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:12632 4.a e64/17 4:506aad5d:::1000000310f.00000000:head v 64'203, mlcod=64'201)", 2024-04-25T22:42:42.713 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:42.713 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.004910851000002, 2024-04-25T22:42:42.713 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041913617, 2024-04-25T22:42:42.713 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:42.714 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:42.714 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.714 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:42.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.714 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:42.714 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:42.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.714 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:42.714 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:42.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:42.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643531+0000", 2024-04-25T22:42:42.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.497e-06 2024-04-25T22:42:42.715 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:42.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650159+0000", 2024-04-25T22:42:42.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066287059999999998 2024-04-25T22:42:42.715 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:42.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650185+0000", 2024-04-25T22:42:42.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5646000000000001e-05 2024-04-25T22:42:42.715 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.716 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650205+0000", 2024-04-25T22:42:42.716 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9720000000000001e-05 2024-04-25T22:42:42.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.716 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.716 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650521+0000", 2024-04-25T22:42:42.716 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00031590699999999998 2024-04-25T22:42:42.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.716 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:42.716 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650574+0000", 2024-04-25T22:42:42.716 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3192000000000002e-05 2024-04-25T22:42:42.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.716 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:42.716 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685374+0000", 2024-04-25T22:42:42.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034799902000000001 2024-04-25T22:42:42.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:42.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685443+0000", 2024-04-25T22:42:42.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9047000000000005e-05 2024-04-25T22:42:42.717 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.717 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.717 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.717 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12644 4.11 4:8893db93:::100000034c2.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:42.717 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:42.717 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 26.996501961, 2024-04-25T22:42:42.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045039497999999997, 2024-04-25T22:42:42.718 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:42.718 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:42.718 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.718 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:42.718 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:42.718 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.718 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12644 2024-04-25T22:42:42.718 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.718 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:42.718 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.718 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:42.718 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:42.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:42.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:42.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:42.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651940+0000", 2024-04-25T22:42:42.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.013e-06 2024-04-25T22:42:42.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:42.720 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659663+0000", 2024-04-25T22:42:42.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077228150000000001 2024-04-25T22:42:42.720 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.720 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:42.720 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659694+0000", 2024-04-25T22:42:42.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1112999999999998e-05 2024-04-25T22:42:42.720 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.720 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.720 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659715+0000", 2024-04-25T22:42:42.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1053e-05 2024-04-25T22:42:42.720 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659842+0000", 2024-04-25T22:42:42.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012738100000000001 2024-04-25T22:42:42.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:42.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660068+0000", 2024-04-25T22:42:42.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000225746 2024-04-25T22:42:42.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:42.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660307+0000", 2024-04-25T22:42:42.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000238352 2024-04-25T22:42:42.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:42.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.683776+0000", 2024-04-25T22:42:42.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023469891999999999 2024-04-25T22:42:42.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696810+0000", 2024-04-25T22:42:42.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013033385999999999 2024-04-25T22:42:42.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:42.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696904+0000", 2024-04-25T22:42:42.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3820000000000006e-05 2024-04-25T22:42:42.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.723 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:42.723 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696978+0000", 2024-04-25T22:42:42.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3926999999999999e-05 2024-04-25T22:42:42.723 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.723 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.723 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.723 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.723 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12645 4.2d 4:b45456a9:::10000003241.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:42.723 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:42.723 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 26.988681474, 2024-04-25T22:42:42.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.043099660999999997, 2024-04-25T22:42:42.723 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:42.723 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:42.723 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.723 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:42.724 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:42.724 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.724 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12645 2024-04-25T22:42:42.724 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.724 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:42.724 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.724 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:42.724 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:42.724 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.724 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.724 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.724 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:42.724 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:42.724 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:42.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659761+0000", 2024-04-25T22:42:42.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8459999999999999e-06 2024-04-25T22:42:42.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:42.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666663+0000", 2024-04-25T22:42:42.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0069017080000000003 2024-04-25T22:42:42.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:42.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666684+0000", 2024-04-25T22:42:42.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0706000000000001e-05 2024-04-25T22:42:42.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.726 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666700+0000", 2024-04-25T22:42:42.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5985999999999999e-05 2024-04-25T22:42:42.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.726 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666914+0000", 2024-04-25T22:42:42.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000213861 2024-04-25T22:42:42.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:42.726 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.667082+0000", 2024-04-25T22:42:42.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016809 2024-04-25T22:42:42.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:42.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702598+0000", 2024-04-25T22:42:42.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035515962999999998 2024-04-25T22:42:42.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:42.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702705+0000", 2024-04-25T22:42:42.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010689800000000001 2024-04-25T22:42:42.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:42.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702858+0000", 2024-04-25T22:42:42.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015360300000000001 2024-04-25T22:42:42.728 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.728 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.728 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.728 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12829 4.3b 4:de8bdadd:::100000033c7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:42.728 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:42.728 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 26.760421559000001, 2024-04-25T22:42:42.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042457306, 2024-04-25T22:42:42.729 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:42.729 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:42.729 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.729 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:42.729 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:42.729 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.729 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12829 2024-04-25T22:42:42.729 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.729 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:42.729 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.729 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:42.729 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:42.729 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:42.730 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:42.730 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:42.730 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888019+0000", 2024-04-25T22:42:42.730 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3300000000000002e-07 2024-04-25T22:42:42.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:42.731 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891638+0000", 2024-04-25T22:42:42.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036189109999999998 2024-04-25T22:42:42.731 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.731 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.731 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:42.731 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891661+0000", 2024-04-25T22:42:42.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3345000000000001e-05 2024-04-25T22:42:42.731 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.731 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.731 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.731 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891671+0000", 2024-04-25T22:42:42.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0115000000000001e-05 2024-04-25T22:42:42.731 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.732 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.732 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891737+0000", 2024-04-25T22:42:42.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5600999999999998e-05 2024-04-25T22:42:42.732 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.732 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:42.732 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891856+0000", 2024-04-25T22:42:42.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011881 2024-04-25T22:42:42.732 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.732 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:42.732 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930251+0000", 2024-04-25T22:42:42.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.038395141000000001 2024-04-25T22:42:42.732 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:42.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930389+0000", 2024-04-25T22:42:42.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013849000000000001 2024-04-25T22:42:42.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:42.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930476+0000", 2024-04-25T22:42:42.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6360000000000007e-05 2024-04-25T22:42:42.733 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.733 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.733 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.733 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13009 4.1e 4:78728bd7:::100000033a5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:42.733 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:42.733 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 26.558534547000001, 2024-04-25T22:42:42.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049997452999999997, 2024-04-25T22:42:42.734 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:42.734 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:42.734 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.734 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:42.734 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:42.734 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.734 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13009 2024-04-25T22:42:42.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.734 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:42.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:42.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:42.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:42.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:42.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:42.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:42.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4799999999999997e-07 2024-04-25T22:42:42.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.735 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:42.735 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097105+0000", 2024-04-25T22:42:42.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071984060000000001 2024-04-25T22:42:42.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:42.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097118+0000", 2024-04-25T22:42:42.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2865e-05 2024-04-25T22:42:42.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097127+0000", 2024-04-25T22:42:42.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8449999999999998e-06 2024-04-25T22:42:42.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097174+0000", 2024-04-25T22:42:42.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6084000000000001e-05 2024-04-25T22:42:42.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:42.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097232+0000", 2024-04-25T22:42:42.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8928999999999998e-05 2024-04-25T22:42:42.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:42.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097309+0000", 2024-04-25T22:42:42.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7014999999999994e-05 2024-04-25T22:42:42.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:42.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.108708+0000", 2024-04-25T22:42:42.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011398233000000001 2024-04-25T22:42:42.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139793+0000", 2024-04-25T22:42:42.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031084856000000001 2024-04-25T22:42:42.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:42.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139848+0000", 2024-04-25T22:42:42.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5464000000000003e-05 2024-04-25T22:42:42.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:42.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139903+0000", 2024-04-25T22:42:42.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4907999999999997e-05 2024-04-25T22:42:42.738 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.739 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.739 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.739 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13318 4.16 4:6810bf9e:::10000003259.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:42.739 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:42.739 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 26.187960189000002, 2024-04-25T22:42:42.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057538179000000002, 2024-04-25T22:42:42.739 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:42.739 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:42.739 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.739 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:42.739 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:42.739 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.739 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13318 2024-04-25T22:42:42.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.740 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:42.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:42.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:42.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:42.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:42.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:42.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460481+0000", 2024-04-25T22:42:42.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:42:42.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:42.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466775+0000", 2024-04-25T22:42:42.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062944239999999999 2024-04-25T22:42:42.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.741 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:42.741 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466787+0000", 2024-04-25T22:42:42.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1688999999999999e-05 2024-04-25T22:42:42.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466793+0000", 2024-04-25T22:42:42.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7209999999999999e-06 2024-04-25T22:42:42.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466845+0000", 2024-04-25T22:42:42.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2166999999999997e-05 2024-04-25T22:42:42.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:42.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466912+0000", 2024-04-25T22:42:42.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7016999999999999e-05 2024-04-25T22:42:42.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:42.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.467020+0000", 2024-04-25T22:42:42.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010827699999999999 2024-04-25T22:42:42.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:42.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.476718+0000", 2024-04-25T22:42:42.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0096980439999999994 2024-04-25T22:42:42.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517860+0000", 2024-04-25T22:42:42.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041141847000000002 2024-04-25T22:42:42.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:42.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517924+0000", 2024-04-25T22:42:42.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3997000000000004e-05 2024-04-25T22:42:42.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:42.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.518018+0000", 2024-04-25T22:42:42.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4139000000000001e-05 2024-04-25T22:42:42.745 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.745 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.745 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.745 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13328 4.16 4:6a9ab238:::1000000339b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:42.745 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:42.745 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 26.169047204000002, 2024-04-25T22:42:42.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057072695999999999, 2024-04-25T22:42:42.745 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:42.745 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:42.745 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.745 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:42.745 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:42.745 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.746 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13328 2024-04-25T22:42:42.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.746 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:42.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:42.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:42.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:42.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:42.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:42.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479395+0000", 2024-04-25T22:42:42.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2859999999999998e-06 2024-04-25T22:42:42.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.747 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:42.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486667+0000", 2024-04-25T22:42:42.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072715599999999998 2024-04-25T22:42:42.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.747 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:42.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486677+0000", 2024-04-25T22:42:42.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0305e-05 2024-04-25T22:42:42.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486683+0000", 2024-04-25T22:42:42.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5300000000000004e-06 2024-04-25T22:42:42.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486768+0000", 2024-04-25T22:42:42.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5725999999999999e-05 2024-04-25T22:42:42.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:42.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486905+0000", 2024-04-25T22:42:42.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013696699999999999 2024-04-25T22:42:42.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:42.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.487121+0000", 2024-04-25T22:42:42.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021615299999999999 2024-04-25T22:42:42.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:42.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.509675+0000", 2024-04-25T22:42:42.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022553225999999999 2024-04-25T22:42:42.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536355+0000", 2024-04-25T22:42:42.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026680855 2024-04-25T22:42:42.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:42.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536401+0000", 2024-04-25T22:42:42.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5649000000000003e-05 2024-04-25T22:42:42.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.750 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:42.750 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536466+0000", 2024-04-25T22:42:42.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4438999999999997e-05 2024-04-25T22:42:42.750 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.750 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.750 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.750 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13329 4.26 4:64e005a2:::10000003483.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:42.750 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:42.750 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 26.161738804999999, 2024-04-25T22:42:42.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066502845000000005, 2024-04-25T22:42:42.751 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:42.751 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:42.751 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.751 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:42.751 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:42.751 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.751 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13329 2024-04-25T22:42:42.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.751 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:42.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:42.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:42.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:42.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:42.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:42.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486703+0000", 2024-04-25T22:42:42.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3909999999999999e-06 2024-04-25T22:42:42.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:42.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494612+0000", 2024-04-25T22:42:42.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0079096670000000004 2024-04-25T22:42:42.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:42.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494626+0000", 2024-04-25T22:42:42.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3263e-05 2024-04-25T22:42:42.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494637+0000", 2024-04-25T22:42:42.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.171e-05 2024-04-25T22:42:42.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494720+0000", 2024-04-25T22:42:42.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2767000000000002e-05 2024-04-25T22:42:42.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:42.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494834+0000", 2024-04-25T22:42:42.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011387699999999999 2024-04-25T22:42:42.754 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.754 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:42.754 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494998+0000", 2024-04-25T22:42:42.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016390799999999999 2024-04-25T22:42:42.754 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.754 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:42.754 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517407+0000", 2024-04-25T22:42:42.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022409068000000001 2024-04-25T22:42:42.754 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.754 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.755 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553040+0000", 2024-04-25T22:42:42.755 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035633155 2024-04-25T22:42:42.755 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.755 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.755 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:42.755 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553140+0000", 2024-04-25T22:42:42.755 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9623000000000005e-05 2024-04-25T22:42:42.755 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.755 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.755 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:42.755 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553204+0000", 2024-04-25T22:42:42.755 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4416000000000001e-05 2024-04-25T22:42:42.755 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.756 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.756 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.756 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13399 4.16 4:6bb7cc3a:::10000003648.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:42.756 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:42.756 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 26.088373005000001, 2024-04-25T22:42:42.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045625003999999997, 2024-04-25T22:42:42.756 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:42.756 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:42.756 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:42.756 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:42.756 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:42.756 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:42.757 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13399 2024-04-25T22:42:42.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.757 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:42.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:42.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:42.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:42.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:42.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:42.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:42.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560068+0000", 2024-04-25T22:42:42.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:42:42.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:42.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576902+0000", 2024-04-25T22:42:42.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016833806 2024-04-25T22:42:42.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:42.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576916+0000", 2024-04-25T22:42:42.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3648e-05 2024-04-25T22:42:42.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:42.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576927+0000", 2024-04-25T22:42:42.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0992000000000001e-05 2024-04-25T22:42:42.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.759 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:42.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577026+0000", 2024-04-25T22:42:42.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9116000000000004e-05 2024-04-25T22:42:42.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.759 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:42.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577203+0000", 2024-04-25T22:42:42.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017700499999999999 2024-04-25T22:42:42.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.760 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:42.760 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577336+0000", 2024-04-25T22:42:42.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013340800000000001 2024-04-25T22:42:42.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.760 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:42.760 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.589077+0000", 2024-04-25T22:42:42.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011741151 2024-04-25T22:42:42.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.760 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:42.760 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605436+0000", 2024-04-25T22:42:42.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016359146000000001 2024-04-25T22:42:42.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.761 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:42.761 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605493+0000", 2024-04-25T22:42:42.761 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7067000000000001e-05 2024-04-25T22:42:42.761 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:42.761 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:42.761 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:42.761 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605692+0000", 2024-04-25T22:42:42.761 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00019855799999999999 2024-04-25T22:42:42.761 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.761 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.761 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.761 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:42.761 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:42.761 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:42.763 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:42.762+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:42.763 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:42.863 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:42.859+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:42.894 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:42.894 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:42.894 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:42:42.894 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:42.908 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:42.964 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:42.962+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:43.065 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:43.059+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:43.065 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:43.065 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:43.065 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-25T22:42:43.065 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-25T22:42:43.065 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:43.080 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:43.166 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:43.162+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:43.246 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:43.246 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-25T22:42:43.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-25T22:42:43.246 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-25T22:42:43.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.247 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:43.247 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:43.247 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 148.64969876000001, 2024-04-25T22:42:43.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047245426, 2024-04-25T22:42:43.247 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:43.247 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:43.247 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.247 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:43.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:43.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:43.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:43.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596164+0000", 2024-04-25T22:42:43.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:43.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596166+0000", 2024-04-25T22:42:43.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7570000000000001e-06 2024-04-25T22:42:43.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:43.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596198+0000", 2024-04-25T22:42:43.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2140000000000001e-05 2024-04-25T22:42:43.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:43.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596214+0000", 2024-04-25T22:42:43.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5342999999999999e-05 2024-04-25T22:42:43.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596225+0000", 2024-04-25T22:42:43.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1637000000000001e-05 2024-04-25T22:42:43.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596365+0000", 2024-04-25T22:42:43.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139402 2024-04-25T22:42:43.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:43.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596374+0000", 2024-04-25T22:42:43.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5340000000000005e-06 2024-04-25T22:42:43.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636114+0000", 2024-04-25T22:42:43.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039739602999999998 2024-04-25T22:42:43.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:43.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.636475+0000", 2024-04-25T22:42:43.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036105700000000002 2024-04-25T22:42:43.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:43.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637074+0000", 2024-04-25T22:42:43.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000599225 2024-04-25T22:42:43.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642982+0000", 2024-04-25T22:42:43.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059074150000000001 2024-04-25T22:42:43.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:43.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643223+0000", 2024-04-25T22:42:43.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024128800000000001 2024-04-25T22:42:43.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:43.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643305+0000", 2024-04-25T22:42:43.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2441999999999994e-05 2024-04-25T22:42:43.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:43.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643410+0000", 2024-04-25T22:42:43.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104583 2024-04-25T22:42:43.252 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.252 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.253 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.253 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:43.253 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:43.253 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 148.64959044700001, 2024-04-25T22:42:43.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047287085, 2024-04-25T22:42:43.253 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:43.253 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:43.253 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.253 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:43.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:43.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:43.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:43.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596273+0000", 2024-04-25T22:42:43.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:43.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596274+0000", 2024-04-25T22:42:43.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.37e-06 2024-04-25T22:42:43.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:43.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596281+0000", 2024-04-25T22:42:43.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8029999999999999e-06 2024-04-25T22:42:43.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:43.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596299+0000", 2024-04-25T22:42:43.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.842e-05 2024-04-25T22:42:43.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596314+0000", 2024-04-25T22:42:43.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4732999999999999e-05 2024-04-25T22:42:43.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596450+0000", 2024-04-25T22:42:43.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135556 2024-04-25T22:42:43.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:43.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596461+0000", 2024-04-25T22:42:43.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1233000000000001e-05 2024-04-25T22:42:43.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637812+0000", 2024-04-25T22:42:43.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041351295000000003 2024-04-25T22:42:43.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:43.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638068+0000", 2024-04-25T22:42:43.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025552399999999997 2024-04-25T22:42:43.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:43.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638886+0000", 2024-04-25T22:42:43.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081850100000000002 2024-04-25T22:42:43.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643194+0000", 2024-04-25T22:42:43.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043078630000000003 2024-04-25T22:42:43.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:43.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643425+0000", 2024-04-25T22:42:43.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000231284 2024-04-25T22:42:43.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:43.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643512+0000", 2024-04-25T22:42:43.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6253000000000002e-05 2024-04-25T22:42:43.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:43.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643560+0000", 2024-04-25T22:42:43.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8250000000000001e-05 2024-04-25T22:42:43.258 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.258 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.258 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.258 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:43.258 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:43.258 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 148.64952379100001, 2024-04-25T22:42:43.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047442757000000002, 2024-04-25T22:42:43.259 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:43.259 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:43.259 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.259 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:43.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:43.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:43.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:43.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596339+0000", 2024-04-25T22:42:43.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:43.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596341+0000", 2024-04-25T22:42:43.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2240000000000001e-06 2024-04-25T22:42:43.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:43.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596348+0000", 2024-04-25T22:42:43.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3730000000000004e-06 2024-04-25T22:42:43.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:43.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596367+0000", 2024-04-25T22:42:43.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.88e-05 2024-04-25T22:42:43.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596385+0000", 2024-04-25T22:42:43.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8102999999999999e-05 2024-04-25T22:42:43.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596497+0000", 2024-04-25T22:42:43.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111669 2024-04-25T22:42:43.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:43.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596502+0000", 2024-04-25T22:42:43.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7969999999999997e-06 2024-04-25T22:42:43.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639475+0000", 2024-04-25T22:42:43.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.042972995 2024-04-25T22:42:43.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:43.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.639757+0000", 2024-04-25T22:42:43.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000281954 2024-04-25T22:42:43.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:43.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640086+0000", 2024-04-25T22:42:43.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032850099999999998 2024-04-25T22:42:43.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643639+0000", 2024-04-25T22:42:43.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003553339 2024-04-25T22:42:43.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:43.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643658+0000", 2024-04-25T22:42:43.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9023000000000001e-05 2024-04-25T22:42:43.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:43.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643722+0000", 2024-04-25T22:42:43.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3355999999999994e-05 2024-04-25T22:42:43.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:43.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643782+0000", 2024-04-25T22:42:43.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0622999999999999e-05 2024-04-25T22:42:43.264 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.264 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.264 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.264 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:43.264 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:43.265 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 148.649433195, 2024-04-25T22:42:43.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047834288000000003, 2024-04-25T22:42:43.265 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:43.265 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:43.265 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.265 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:43.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:43.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:43.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:43.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596430+0000", 2024-04-25T22:42:43.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:43.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596431+0000", 2024-04-25T22:42:43.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2699999999999999e-06 2024-04-25T22:42:43.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:43.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596439+0000", 2024-04-25T22:42:43.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-25T22:42:43.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:43.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596458+0000", 2024-04-25T22:42:43.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8797e-05 2024-04-25T22:42:43.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596472+0000", 2024-04-25T22:42:43.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3773e-05 2024-04-25T22:42:43.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596568+0000", 2024-04-25T22:42:43.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5709000000000001e-05 2024-04-25T22:42:43.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:43.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596582+0000", 2024-04-25T22:42:43.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4754e-05 2024-04-25T22:42:43.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640759+0000", 2024-04-25T22:42:43.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.044176741999999998 2024-04-25T22:42:43.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:43.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.640964+0000", 2024-04-25T22:42:43.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020438100000000001 2024-04-25T22:42:43.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:43.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641288+0000", 2024-04-25T22:42:43.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00032404500000000002 2024-04-25T22:42:43.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:43.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643795+0000", 2024-04-25T22:42:43.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025071170000000001 2024-04-25T22:42:43.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.643932+0000", 2024-04-25T22:42:43.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137112 2024-04-25T22:42:43.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:43.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644153+0000", 2024-04-25T22:42:43.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022088199999999999 2024-04-25T22:42:43.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:43.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644264+0000", 2024-04-25T22:42:43.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-25T22:42:43.270 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.270 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.270 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.270 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:43.271 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:43.271 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 148.649368622, 2024-04-25T22:42:43.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048008413, 2024-04-25T22:42:43.271 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:43.271 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:43.271 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.271 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:43.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:43.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:43.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:43.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596495+0000", 2024-04-25T22:42:43.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:43.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596496+0000", 2024-04-25T22:42:43.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3039999999999999e-06 2024-04-25T22:42:43.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:43.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596504+0000", 2024-04-25T22:42:43.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.96e-06 2024-04-25T22:42:43.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:43.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596521+0000", 2024-04-25T22:42:43.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7473e-05 2024-04-25T22:42:43.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596538+0000", 2024-04-25T22:42:43.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6143000000000001e-05 2024-04-25T22:42:43.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596617+0000", 2024-04-25T22:42:43.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9536000000000006e-05 2024-04-25T22:42:43.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:43.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596622+0000", 2024-04-25T22:42:43.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2900000000000002e-06 2024-04-25T22:42:43.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641891+0000", 2024-04-25T22:42:43.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045269116999999998 2024-04-25T22:42:43.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:43.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642104+0000", 2024-04-25T22:42:43.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021223100000000001 2024-04-25T22:42:43.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:43.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642289+0000", 2024-04-25T22:42:43.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018503200000000001 2024-04-25T22:42:43.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644364+0000", 2024-04-25T22:42:43.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020748580000000002 2024-04-25T22:42:43.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:43.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644389+0000", 2024-04-25T22:42:43.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5185999999999999e-05 2024-04-25T22:42:43.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:43.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644451+0000", 2024-04-25T22:42:43.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2030000000000001e-05 2024-04-25T22:42:43.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:43.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644503+0000", 2024-04-25T22:42:43.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2253000000000003e-05 2024-04-25T22:42:43.276 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.276 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.276 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.276 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:43.276 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:43.277 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 148.649303199, 2024-04-25T22:42:43.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050300947999999998, 2024-04-25T22:42:43.277 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:43.277 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:43.277 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.277 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:43.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:43.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:43.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:43.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596560+0000", 2024-04-25T22:42:43.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:43.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596561+0000", 2024-04-25T22:42:43.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.19e-06 2024-04-25T22:42:43.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:43.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596567+0000", 2024-04-25T22:42:43.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-25T22:42:43.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:43.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596585+0000", 2024-04-25T22:42:43.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7810000000000001e-05 2024-04-25T22:42:43.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596598+0000", 2024-04-25T22:42:43.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2677000000000001e-05 2024-04-25T22:42:43.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596686+0000", 2024-04-25T22:42:43.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7948999999999994e-05 2024-04-25T22:42:43.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:43.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596701+0000", 2024-04-25T22:42:43.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4853e-05 2024-04-25T22:42:43.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644557+0000", 2024-04-25T22:42:43.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047856547999999999 2024-04-25T22:42:43.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:43.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644688+0000", 2024-04-25T22:42:43.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013107200000000001 2024-04-25T22:42:43.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-25T22:42:43.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.644889+0000", 2024-04-25T22:42:43.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020060100000000001 2024-04-25T22:42:43.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:43.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.645822+0000", 2024-04-25T22:42:43.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093324300000000005 2024-04-25T22:42:43.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646706+0000", 2024-04-25T22:42:43.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088343000000000004 2024-04-25T22:42:43.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:43.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646790+0000", 2024-04-25T22:42:43.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4852999999999995e-05 2024-04-25T22:42:43.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:43.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.646861+0000", 2024-04-25T22:42:43.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0588999999999998e-05 2024-04-25T22:42:43.282 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.282 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.282 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.282 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:43.282 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:43.282 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 148.64902266499999, 2024-04-25T22:42:43.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045506788999999999, 2024-04-25T22:42:43.282 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:43.282 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:43.283 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.283 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:43.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:43.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:43.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:43.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596841+0000", 2024-04-25T22:42:43.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:43.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596843+0000", 2024-04-25T22:42:43.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9269999999999999e-06 2024-04-25T22:42:43.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:43.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596850+0000", 2024-04-25T22:42:43.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-25T22:42:43.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:43.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596868+0000", 2024-04-25T22:42:43.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8620000000000001e-05 2024-04-25T22:42:43.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596882+0000", 2024-04-25T22:42:43.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3603e-05 2024-04-25T22:42:43.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596982+0000", 2024-04-25T22:42:43.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100076 2024-04-25T22:42:43.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:43.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.596988+0000", 2024-04-25T22:42:43.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0599999999999996e-06 2024-04-25T22:42:43.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637519+0000", 2024-04-25T22:42:43.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.040531013999999997 2024-04-25T22:42:43.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:43.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.637735+0000", 2024-04-25T22:42:43.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021622500000000001 2024-04-25T22:42:43.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:43.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.638072+0000", 2024-04-25T22:42:43.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033700400000000001 2024-04-25T22:42:43.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.641623+0000", 2024-04-25T22:42:43.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035510170000000001 2024-04-25T22:42:43.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:43.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642186+0000", 2024-04-25T22:42:43.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056243099999999996 2024-04-25T22:42:43.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:43.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642259+0000", 2024-04-25T22:42:43.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3176000000000005e-05 2024-04-25T22:42:43.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:43.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:40:14.642347+0000", 2024-04-25T22:42:43.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8566000000000006e-05 2024-04-25T22:42:43.288 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.288 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.288 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.288 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10678 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:43.288 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:43.288 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.757737926000001, 2024-04-25T22:42:43.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050477795999999998, 2024-04-25T22:42:43.288 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:43.288 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:43.288 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.288 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:43.288 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:43.288 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.289 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10678 2024-04-25T22:42:43.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.289 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:43.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:43.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:43.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:43.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488125+0000", 2024-04-25T22:42:43.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:43.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.488127+0000", 2024-04-25T22:42:43.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.716e-06 2024-04-25T22:42:43.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:43.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496392+0000", 2024-04-25T22:42:43.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082651500000000006 2024-04-25T22:42:43.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:43.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496428+0000", 2024-04-25T22:42:43.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5441999999999997e-05 2024-04-25T22:42:43.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496451+0000", 2024-04-25T22:42:43.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3529000000000001e-05 2024-04-25T22:42:43.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496601+0000", 2024-04-25T22:42:43.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014935600000000001 2024-04-25T22:42:43.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:43.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.496856+0000", 2024-04-25T22:42:43.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025537900000000002 2024-04-25T22:42:43.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:43.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.497206+0000", 2024-04-25T22:42:43.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000350599 2024-04-25T22:42:43.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538231+0000", 2024-04-25T22:42:43.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.041024146999999997 2024-04-25T22:42:43.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:43.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538298+0000", 2024-04-25T22:42:43.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7688000000000007e-05 2024-04-25T22:42:43.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:43.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538467+0000", 2024-04-25T22:42:43.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000168178 2024-04-25T22:42:43.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:43.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538603+0000", 2024-04-25T22:42:43.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013661200000000001 2024-04-25T22:42:43.293 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.293 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.293 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.293 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10692 4.2c 4:36971e45:::100000030bd.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:43.293 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:43.294 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.741148131999999, 2024-04-25T22:42:43.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.061242408999999998, 2024-04-25T22:42:43.294 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:43.294 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:43.294 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.294 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:43.294 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:43.294 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.294 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10692 2024-04-25T22:42:43.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.294 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:43.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:43.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:43.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:43.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504715+0000", 2024-04-25T22:42:43.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:43.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.504717+0000", 2024-04-25T22:42:43.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6199999999999999e-06 2024-04-25T22:42:43.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:43.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511770+0000", 2024-04-25T22:42:43.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0070530929999999999 2024-04-25T22:42:43.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:43.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511810+0000", 2024-04-25T22:42:43.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0635e-05 2024-04-25T22:42:43.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511837+0000", 2024-04-25T22:42:43.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6423000000000001e-05 2024-04-25T22:42:43.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520096+0000", 2024-04-25T22:42:43.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082593730000000004 2024-04-25T22:42:43.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:43.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520345+0000", 2024-04-25T22:42:43.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024908800000000001 2024-04-25T22:42:43.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:43.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.520794+0000", 2024-04-25T22:42:43.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000449023 2024-04-25T22:42:43.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:43.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.538675+0000", 2024-04-25T22:42:43.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017880991999999998 2024-04-25T22:42:43.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565761+0000", 2024-04-25T22:42:43.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027085260999999999 2024-04-25T22:42:43.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:43.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565892+0000", 2024-04-25T22:42:43.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013152300000000001 2024-04-25T22:42:43.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:43.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565958+0000", 2024-04-25T22:42:43.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5377999999999996e-05 2024-04-25T22:42:43.299 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.299 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.299 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.299 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10693 4.2c 4:36971e45:::100000030bd.00000001:head [write 971225~86041] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:43.299 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:43.299 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.733969770000002, 2024-04-25T22:42:43.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054529782999999998, 2024-04-25T22:42:43.299 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:43.299 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:43.299 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.300 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:43.300 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:43.300 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.300 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10693 2024-04-25T22:42:43.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.300 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:43.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:43.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:43.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:43.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511893+0000", 2024-04-25T22:42:43.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:43.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.511897+0000", 2024-04-25T22:42:43.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2499999999999998e-06 2024-04-25T22:42:43.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:43.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512094+0000", 2024-04-25T22:42:43.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019700100000000001 2024-04-25T22:42:43.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:43.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512121+0000", 2024-04-25T22:42:43.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7288999999999999e-05 2024-04-25T22:42:43.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.512137+0000", 2024-04-25T22:42:43.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.592e-05 2024-04-25T22:42:43.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.533845+0000", 2024-04-25T22:42:43.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021707595999999999 2024-04-25T22:42:43.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:43.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534176+0000", 2024-04-25T22:42:43.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033187000000000001 2024-04-25T22:42:43.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:43.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.534626+0000", 2024-04-25T22:42:43.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00045008599999999999 2024-04-25T22:42:43.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:43.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.539165+0000", 2024-04-25T22:42:43.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045386380000000002 2024-04-25T22:42:43.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566169+0000", 2024-04-25T22:42:43.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027004199 2024-04-25T22:42:43.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:43.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566317+0000", 2024-04-25T22:42:43.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014747999999999999 2024-04-25T22:42:43.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:43.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.566423+0000", 2024-04-25T22:42:43.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010645399999999999 2024-04-25T22:42:43.304 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.304 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.304 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.305 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10696 4.2b 4:d56d2a96:::100000030c3.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:43.305 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:43.305 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.732262124999998, 2024-04-25T22:42:43.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.052282190999999999, 2024-04-25T22:42:43.305 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:43.305 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:43.305 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.305 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:43.305 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:43.305 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.305 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10696 2024-04-25T22:42:43.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.305 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:43.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:43.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:43.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:43.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513601+0000", 2024-04-25T22:42:43.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:43.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.513603+0000", 2024-04-25T22:42:43.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.283e-06 2024-04-25T22:42:43.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:43.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518647+0000", 2024-04-25T22:42:43.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050440859999999997 2024-04-25T22:42:43.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:43.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518672+0000", 2024-04-25T22:42:43.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4468e-05 2024-04-25T22:42:43.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518691+0000", 2024-04-25T22:42:43.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9213999999999999e-05 2024-04-25T22:42:43.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.518806+0000", 2024-04-25T22:42:43.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115296 2024-04-25T22:42:43.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:43.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519011+0000", 2024-04-25T22:42:43.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020445700000000001 2024-04-25T22:42:43.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:43.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.519207+0000", 2024-04-25T22:42:43.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000196431 2024-04-25T22:42:43.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:43.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531309+0000", 2024-04-25T22:42:43.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012101694 2024-04-25T22:42:43.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565622+0000", 2024-04-25T22:42:43.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.034312976000000002 2024-04-25T22:42:43.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:43.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565769+0000", 2024-04-25T22:42:43.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014715900000000001 2024-04-25T22:42:43.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:43.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565883+0000", 2024-04-25T22:42:43.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000114127 2024-04-25T22:42:43.310 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.310 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.310 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.310 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:10701 4.a 4:51b6a63a:::100000030f2.00000000:head [write 0~3014656] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:43.310 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:43.310 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.720818115, 2024-04-25T22:42:43.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047414393999999999, 2024-04-25T22:42:43.310 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:43.310 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:43.311 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.311 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:43.311 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:43.311 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.311 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10701 2024-04-25T22:42:43.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.311 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:43.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:43.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:43.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:43.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525045+0000", 2024-04-25T22:42:43.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:43.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.525048+0000", 2024-04-25T22:42:43.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0819999999999999e-06 2024-04-25T22:42:43.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:43.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531709+0000", 2024-04-25T22:42:43.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066610929999999999 2024-04-25T22:42:43.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:43.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531751+0000", 2024-04-25T22:42:43.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1650000000000003e-05 2024-04-25T22:42:43.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531788+0000", 2024-04-25T22:42:43.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7305000000000003e-05 2024-04-25T22:42:43.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.531943+0000", 2024-04-25T22:42:43.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015500600000000001 2024-04-25T22:42:43.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:43.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532086+0000", 2024-04-25T22:42:43.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014238599999999999 2024-04-25T22:42:43.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:43.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.532295+0000", 2024-04-25T22:42:43.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020922000000000001 2024-04-25T22:42:43.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:43.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.545987+0000", 2024-04-25T22:42:43.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013692582999999999 2024-04-25T22:42:43.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572315+0000", 2024-04-25T22:42:43.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026327488 2024-04-25T22:42:43.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:43.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572381+0000", 2024-04-25T22:42:43.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5609000000000002e-05 2024-04-25T22:42:43.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:43.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.572460+0000", 2024-04-25T22:42:43.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8972000000000002e-05 2024-04-25T22:42:43.315 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.315 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.316 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.316 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:10700 4.11 e63/57 4:88409fbf:::100000030ec.00000000:head v 63'193, mlcod=62'191)", 2024-04-25T22:42:43.316 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:43.316 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.709988659, 2024-04-25T22:42:43.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.050517667000000002, 2024-04-25T22:42:43.316 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:43.316 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:43.316 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.316 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:43.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:43.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:43.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:43.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535875+0000", 2024-04-25T22:42:43.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:43.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.535876+0000", 2024-04-25T22:42:43.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0300000000000001e-06 2024-04-25T22:42:43.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:43.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565275+0000", 2024-04-25T22:42:43.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029399033000000001 2024-04-25T22:42:43.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:43.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565358+0000", 2024-04-25T22:42:43.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3403000000000001e-05 2024-04-25T22:42:43.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565380+0000", 2024-04-25T22:42:43.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1761999999999999e-05 2024-04-25T22:42:43.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565505+0000", 2024-04-25T22:42:43.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000125153 2024-04-25T22:42:43.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:43.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.565550+0000", 2024-04-25T22:42:43.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5479000000000003e-05 2024-04-25T22:42:43.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:43.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586328+0000", 2024-04-25T22:42:43.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020777982 2024-04-25T22:42:43.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:43.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:12.586392+0000", 2024-04-25T22:42:43.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3825000000000006e-05 2024-04-25T22:42:43.320 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.320 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.320 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.320 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12632 4.a 4:506aad5d:::1000000310f.00000000:head [write 0~4194304 [2@2043125]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:43.320 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:43.320 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.610933533000001, 2024-04-25T22:42:43.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.051574097999999999, 2024-04-25T22:42:43.320 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:43.320 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:43.320 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.321 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:43.321 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:43.321 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.321 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12632 2024-04-25T22:42:43.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.321 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:43.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:43.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:43.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:43.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634930+0000", 2024-04-25T22:42:43.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:43.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.634932+0000", 2024-04-25T22:42:43.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1600000000000001e-06 2024-04-25T22:42:43.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:43.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642614+0000", 2024-04-25T22:42:43.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076823000000000004 2024-04-25T22:42:43.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:43.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642660+0000", 2024-04-25T22:42:43.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6016000000000001e-05 2024-04-25T22:42:43.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642686+0000", 2024-04-25T22:42:43.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5491999999999999e-05 2024-04-25T22:42:43.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.642870+0000", 2024-04-25T22:42:43.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000184045 2024-04-25T22:42:43.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:43.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643122+0000", 2024-04-25T22:42:43.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025242299999999999 2024-04-25T22:42:43.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:43.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.643634+0000", 2024-04-25T22:42:43.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051145800000000001 2024-04-25T22:42:43.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:43.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.682287+0000", 2024-04-25T22:42:43.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038653342 2024-04-25T22:42:43.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686419+0000", 2024-04-25T22:42:43.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0041325169999999996 2024-04-25T22:42:43.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:43.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686464+0000", 2024-04-25T22:42:43.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4171000000000001e-05 2024-04-25T22:42:43.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:43.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.686504+0000", 2024-04-25T22:42:43.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0173999999999999e-05 2024-04-25T22:42:43.325 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.325 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.326 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.326 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12691 4.39 4:9d0d8843:::100000030ef.00000000:head [write 0~4194304 [3@92787]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:43.326 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:43.326 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.515212443999999, 2024-04-25T22:42:43.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.045521998000000001, 2024-04-25T22:42:43.326 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:43.326 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:43.326 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.326 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:43.326 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:43.326 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.326 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12691 2024-04-25T22:42:43.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.327 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:43.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:43.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:43.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:43.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730651+0000", 2024-04-25T22:42:43.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:43.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.730653+0000", 2024-04-25T22:42:43.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1799999999999999e-06 2024-04-25T22:42:43.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:43.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738136+0000", 2024-04-25T22:42:43.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0074832789999999998 2024-04-25T22:42:43.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:43.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738169+0000", 2024-04-25T22:42:43.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3115999999999999e-05 2024-04-25T22:42:43.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738190+0000", 2024-04-25T22:42:43.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1060000000000002e-05 2024-04-25T22:42:43.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738264+0000", 2024-04-25T22:42:43.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3150000000000003e-05 2024-04-25T22:42:43.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:43.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738333+0000", 2024-04-25T22:42:43.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9314999999999996e-05 2024-04-25T22:42:43.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:43.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.738425+0000", 2024-04-25T22:42:43.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2498999999999996e-05 2024-04-25T22:42:43.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:43.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.745181+0000", 2024-04-25T22:42:43.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067553240000000001 2024-04-25T22:42:43.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776101+0000", 2024-04-25T22:42:43.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.030920033 2024-04-25T22:42:43.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:43.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776140+0000", 2024-04-25T22:42:43.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9706999999999998e-05 2024-04-25T22:42:43.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:43.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.776173+0000", 2024-04-25T22:42:43.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2335000000000001e-05 2024-04-25T22:42:43.331 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.331 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.331 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.331 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:12813 4.18 4:1945bfc2:::10000003578.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:43.331 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:43.331 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.376688962999999, 2024-04-25T22:42:43.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.054261216000000001, 2024-04-25T22:42:43.332 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:43.332 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:43.332 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.332 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:43.332 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:43.332 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.332 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 12813 2024-04-25T22:42:43.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.332 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:43.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:43.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:43.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:43.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869174+0000", 2024-04-25T22:42:43.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:43.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.869175+0000", 2024-04-25T22:42:43.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3200000000000005e-07 2024-04-25T22:42:43.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:43.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872980+0000", 2024-04-25T22:42:43.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038049720000000002 2024-04-25T22:42:43.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:43.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872988+0000", 2024-04-25T22:42:43.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5429999999999994e-06 2024-04-25T22:42:43.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.872993+0000", 2024-04-25T22:42:43.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8570000000000003e-06 2024-04-25T22:42:43.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873054+0000", 2024-04-25T22:42:43.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0801000000000003e-05 2024-04-25T22:42:43.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:43.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873140+0000", 2024-04-25T22:42:43.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6236999999999994e-05 2024-04-25T22:42:43.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:43.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.873271+0000", 2024-04-25T22:42:43.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130541 2024-04-25T22:42:43.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:43.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.884240+0000", 2024-04-25T22:42:43.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010969527 2024-04-25T22:42:43.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923308+0000", 2024-04-25T22:42:43.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039067317999999997 2024-04-25T22:42:43.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:43.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923373+0000", 2024-04-25T22:42:43.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5055000000000006e-05 2024-04-25T22:42:43.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:43.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:15.923436+0000", 2024-04-25T22:42:43.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2732999999999997e-05 2024-04-25T22:42:43.337 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.337 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.337 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.337 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13328 4.16 e65/54 4:6a9ab238:::1000000339b.00000000:head v 65'186, mlcod=65'183)", 2024-04-25T22:42:43.337 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:43.337 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.756228895, 2024-04-25T22:42:43.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.046438762000000001, 2024-04-25T22:42:43.337 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:43.337 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:43.338 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.338 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:43.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:43.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:43.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:43.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489634+0000", 2024-04-25T22:42:43.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:43.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.489637+0000", 2024-04-25T22:42:43.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.357e-06 2024-04-25T22:42:43.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:43.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496055+0000", 2024-04-25T22:42:43.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0064181380000000003 2024-04-25T22:42:43.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:43.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496074+0000", 2024-04-25T22:42:43.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8904000000000001e-05 2024-04-25T22:42:43.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496085+0000", 2024-04-25T22:42:43.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1245e-05 2024-04-25T22:42:43.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496169+0000", 2024-04-25T22:42:43.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3974000000000006e-05 2024-04-25T22:42:43.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:43.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496203+0000", 2024-04-25T22:42:43.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3679000000000001e-05 2024-04-25T22:42:43.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:43.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536002+0000", 2024-04-25T22:42:43.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039799569 2024-04-25T22:42:43.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:43.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.536073+0000", 2024-04-25T22:42:43.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0895999999999993e-05 2024-04-25T22:42:43.341 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.341 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.341 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.342 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13338 4.e 4:737b94c2:::1000000338a.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:43.342 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:43.342 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.750088380000001, 2024-04-25T22:42:43.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047911849999999999, 2024-04-25T22:42:43.342 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:43.342 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:43.342 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.342 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:43.342 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:43.342 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.342 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13338 2024-04-25T22:42:43.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.343 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:43.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:43.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:43.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:43.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495775+0000", 2024-04-25T22:42:43.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:43.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.495776+0000", 2024-04-25T22:42:43.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2399999999999996e-07 2024-04-25T22:42:43.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:43.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503748+0000", 2024-04-25T22:42:43.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079725479999999994 2024-04-25T22:42:43.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:43.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.503940+0000", 2024-04-25T22:42:43.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000191249 2024-04-25T22:42:43.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504061+0000", 2024-04-25T22:42:43.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120982 2024-04-25T22:42:43.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515564+0000", 2024-04-25T22:42:43.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011503342999999999 2024-04-25T22:42:43.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:43.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515799+0000", 2024-04-25T22:42:43.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000235138 2024-04-25T22:42:43.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:43.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543419+0000", 2024-04-25T22:42:43.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027620167000000001 2024-04-25T22:42:43.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:43.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543522+0000", 2024-04-25T22:42:43.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010254100000000001 2024-04-25T22:42:43.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:43.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.543687+0000", 2024-04-25T22:42:43.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016495799999999999 2024-04-25T22:42:43.346 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.346 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.346 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.346 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4529.0:13329 4.26 e65/57 4:64e005a2:::10000003483.00000000:head v 65'226, mlcod=64'224)", 2024-04-25T22:42:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.749485699000001, 2024-04-25T22:42:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.048871456000000001, 2024-04-25T22:42:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496378+0000", 2024-04-25T22:42:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.496379+0000", 2024-04-25T22:42:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1480000000000001e-06 2024-04-25T22:42:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504870+0000", 2024-04-25T22:42:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0084917880000000001 2024-04-25T22:42:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:43.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504888+0000", 2024-04-25T22:42:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7365999999999999e-05 2024-04-25T22:42:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.504899+0000", 2024-04-25T22:42:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1516e-05 2024-04-25T22:42:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515953+0000", 2024-04-25T22:42:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011054074000000001 2024-04-25T22:42:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:43.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.515993+0000", 2024-04-25T22:42:43.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9854999999999997e-05 2024-04-25T22:42:43.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:43.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545191+0000", 2024-04-25T22:42:43.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.029197323000000001 2024-04-25T22:42:43.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:43.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.545249+0000", 2024-04-25T22:42:43.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8386e-05 2024-04-25T22:42:43.350 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.350 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.351 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.351 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4529.0:13713 4.2b 4:d574dbff:::100000031d0.00000001:head [write 0~4194304 [2@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:43.351 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:43.351 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.337299581, 2024-04-25T22:42:43.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.047324328999999998, 2024-04-25T22:42:43.351 INFO:teuthology.orchestra.run.smithi122.stdout: "continuous": false, 2024-04-25T22:42:43.351 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-25T22:42:43.351 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.351 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-25T22:42:43.351 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4529", 2024-04-25T22:42:43.351 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.351 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 13713 2024-04-25T22:42:43.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.352 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-25T22:42:43.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-25T22:42:43.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:43.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-25T22:42:43.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908564+0000", 2024-04-25T22:42:43.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-25T22:42:43.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-25T22:42:43.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.908565+0000", 2024-04-25T22:42:43.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.694e-06 2024-04-25T22:42:43.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-25T22:42:43.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916170+0000", 2024-04-25T22:42:43.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076041720000000002 2024-04-25T22:42:43.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-25T22:42:43.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916200+0000", 2024-04-25T22:42:43.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0463999999999998e-05 2024-04-25T22:42:43.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916209+0000", 2024-04-25T22:42:43.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3079999999999997e-06 2024-04-25T22:42:43.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-25T22:42:43.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916297+0000", 2024-04-25T22:42:43.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8159999999999996e-05 2024-04-25T22:42:43.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-25T22:42:43.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916554+0000", 2024-04-25T22:42:43.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025661800000000002 2024-04-25T22:42:43.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 2", 2024-04-25T22:42:43.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.916794+0000", 2024-04-25T22:42:43.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024013999999999999 2024-04-25T22:42:43.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-25T22:42:43.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.933120+0000", 2024-04-25T22:42:43.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016325559 2024-04-25T22:42:43.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955612+0000", 2024-04-25T22:42:43.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022491786 2024-04-25T22:42:43.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-25T22:42:43.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955797+0000", 2024-04-25T22:42:43.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018533699999999999 2024-04-25T22:42:43.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-25T22:42:43.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-25T22:42:43.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-25T22:42:43.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-25T22:42:16.955888+0000", 2024-04-25T22:42:43.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1090999999999999e-05 2024-04-25T22:42:43.356 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.356 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.356 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.356 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-25T22:42:43.356 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-25T22:42:43.356 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:43.357 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:43.358 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:43.354+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:43.458 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:43.459+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:43.484 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:43.484 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:43.484 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:42:43.485 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:43.498 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:43.543 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is unset 2024-04-25T22:42:43.559 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:43.555+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:43.606 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:43.607 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:43.607 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:42:43.607 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:42:43.607 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:43.619 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:43.660 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:43.659+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:43.741 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:43.741 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:43.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:43.741 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:43.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.741 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 149.144315492, 2024-04-25T22:42:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:43.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:43.747 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 149.14417823599999, 2024-04-25T22:42:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:43.748 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.749 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.750 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.751 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.752 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:43.753 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 149.143918068, 2024-04-25T22:42:43.754 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:43.755 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.756 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.757 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:43.758 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:43.759 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.760 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 149.143752869, 2024-04-25T22:42:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.761 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.762 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:43.763 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.764 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 149.143687207, 2024-04-25T22:42:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:43.765 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:43.766 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.767 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.768 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:43.769 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10700 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.220819989999999, 2024-04-25T22:42:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066789482999999997, 2024-04-25T22:42:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:43.770 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10700 2024-04-25T22:42:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.771 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519112+0000", 2024-04-25T22:42:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1399999999999998e-06 2024-04-25T22:42:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527187+0000", 2024-04-25T22:42:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080748899999999995 2024-04-25T22:42:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527232+0000", 2024-04-25T22:42:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4895999999999998e-05 2024-04-25T22:42:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.772 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527259+0000", 2024-04-25T22:42:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7331999999999999e-05 2024-04-25T22:42:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529418+0000", 2024-04-25T22:42:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002158765 2024-04-25T22:42:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529572+0000", 2024-04-25T22:42:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015438499999999999 2024-04-25T22:42:43.773 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529762+0000", 2024-04-25T22:42:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018998100000000001 2024-04-25T22:42:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.548359+0000", 2024-04-25T22:42:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018596444 2024-04-25T22:42:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.774 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585801+0000", 2024-04-25T22:42:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.037442469999999999 2024-04-25T22:42:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585847+0000", 2024-04-25T22:42:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5565000000000002e-05 2024-04-25T22:42:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585899+0000", 2024-04-25T22:42:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2614999999999997e-05 2024-04-25T22:42:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.775 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10714 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 31.187139027000001, 2024-04-25T22:42:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.048080623000000003, 2024-04-25T22:42:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10714 2024-04-25T22:42:43.776 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552792+0000", 2024-04-25T22:42:43.777 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:42:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559915+0000", 2024-04-25T22:42:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071231690000000004 2024-04-25T22:42:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559932+0000", 2024-04-25T22:42:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7169000000000001e-05 2024-04-25T22:42:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.778 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559942+0000", 2024-04-25T22:42:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0261999999999999e-05 2024-04-25T22:42:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560018+0000", 2024-04-25T22:42:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5358000000000006e-05 2024-04-25T22:42:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560118+0000", 2024-04-25T22:42:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000100911 2024-04-25T22:42:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.779 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560281+0000", 2024-04-25T22:42:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016288500000000001 2024-04-25T22:42:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.579740+0000", 2024-04-25T22:42:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019458598000000001 2024-04-25T22:42:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600484+0000", 2024-04-25T22:42:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020744483000000001 2024-04-25T22:42:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.780 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600664+0000", 2024-04-25T22:42:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017953899999999999 2024-04-25T22:42:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600871+0000", 2024-04-25T22:42:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020737199999999999 2024-04-25T22:42:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.781 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10813 4.17 4:e8010137:::100000030b0.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.992190020999999, 2024-04-25T22:42:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.047503799999999999, 2024-04-25T22:42:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10813 2024-04-25T22:42:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:43.782 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747741+0000", 2024-04-25T22:42:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1119999999999999e-06 2024-04-25T22:42:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.783 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752366+0000", 2024-04-25T22:42:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046253240000000001 2024-04-25T22:42:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752382+0000", 2024-04-25T22:42:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5639999999999999e-05 2024-04-25T22:42:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752393+0000", 2024-04-25T22:42:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1626e-05 2024-04-25T22:42:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.784 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752459+0000", 2024-04-25T22:42:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5309999999999996e-05 2024-04-25T22:42:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752529+0000", 2024-04-25T22:42:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0543000000000005e-05 2024-04-25T22:42:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752637+0000", 2024-04-25T22:42:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010788799999999999 2024-04-25T22:42:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:43.785 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760295+0000", 2024-04-25T22:42:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076583290000000002 2024-04-25T22:42:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.794990+0000", 2024-04-25T22:42:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034694317000000002 2024-04-25T22:42:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795097+0000", 2024-04-25T22:42:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010768999999999999 2024-04-25T22:42:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:43.786 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795243+0000", 2024-04-25T22:42:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000146021 2024-04-25T22:42:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10816 4.17 4:e8010137:::100000030b0.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.986860561, 2024-04-25T22:42:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042406530999999997, 2024-04-25T22:42:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.787 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10816 2024-04-25T22:42:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.788 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753070+0000", 2024-04-25T22:42:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9800000000000002e-07 2024-04-25T22:42:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753288+0000", 2024-04-25T22:42:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000217789 2024-04-25T22:42:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753301+0000", 2024-04-25T22:42:43.789 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2764e-05 2024-04-25T22:42:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753310+0000", 2024-04-25T22:42:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:42:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758240+0000", 2024-04-25T22:42:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049304910000000004 2024-04-25T22:42:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.790 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758374+0000", 2024-04-25T22:42:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000133428 2024-04-25T22:42:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758576+0000", 2024-04-25T22:42:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020177899999999999 2024-04-25T22:42:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760626+0000", 2024-04-25T22:42:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0020501489999999998 2024-04-25T22:42:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.791 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795329+0000", 2024-04-25T22:42:43.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034703352999999999 2024-04-25T22:42:43.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:43.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795414+0000", 2024-04-25T22:42:43.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5292999999999998e-05 2024-04-25T22:42:43.792 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.792 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.792 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:43.792 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795476+0000", 2024-04-25T22:42:43.792 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1206999999999999e-05 2024-04-25T22:42:43.792 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.792 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.793 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.793 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.793 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.793 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10914 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:43.793 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:43.793 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.786060179, 2024-04-25T22:42:43.793 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044452984000000001, 2024-04-25T22:42:43.793 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:43.793 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:43.793 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.793 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:43.793 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:43.793 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.793 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10914 2024-04-25T22:42:43.794 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.794 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:43.794 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.794 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:43.794 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:43.794 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.794 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.794 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.794 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:43.794 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:43.794 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.794 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.794 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.794 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:43.795 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953871+0000", 2024-04-25T22:42:43.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1829999999999999e-06 2024-04-25T22:42:43.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.795 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:43.795 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.962992+0000", 2024-04-25T22:42:43.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091217409999999992 2024-04-25T22:42:43.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.795 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:43.795 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963027+0000", 2024-04-25T22:42:43.795 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4229e-05 2024-04-25T22:42:43.795 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.795 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.796 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.796 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963042+0000", 2024-04-25T22:42:43.796 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5152e-05 2024-04-25T22:42:43.796 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.796 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.796 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.796 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963143+0000", 2024-04-25T22:42:43.796 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101171 2024-04-25T22:42:43.796 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.796 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.796 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:43.796 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963269+0000", 2024-04-25T22:42:43.796 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012623499999999999 2024-04-25T22:42:43.796 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.797 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:43.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963453+0000", 2024-04-25T22:42:43.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018357900000000001 2024-04-25T22:42:43.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.797 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:43.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998133+0000", 2024-04-25T22:42:43.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034679789000000003 2024-04-25T22:42:43.797 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.797 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.797 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.797 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998220+0000", 2024-04-25T22:42:43.797 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7153999999999999e-05 2024-04-25T22:42:43.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:43.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998278+0000", 2024-04-25T22:42:43.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8035000000000003e-05 2024-04-25T22:42:43.798 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.798 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.798 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:43.798 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998323+0000", 2024-04-25T22:42:43.798 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4715999999999997e-05 2024-04-25T22:42:43.798 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.798 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.798 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.799 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.799 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.799 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10919 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:43.799 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:43.799 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.765748897999998, 2024-04-25T22:42:43.799 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044010552000000001, 2024-04-25T22:42:43.799 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:43.799 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:43.799 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.799 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:43.799 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:43.799 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.799 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10919 2024-04-25T22:42:43.799 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.800 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:43.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:43.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:43.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:43.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:43.800 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.800 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.800 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.800 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:43.800 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:43.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8100000000000003e-07 2024-04-25T22:42:43.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.801 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:43.801 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980221+0000", 2024-04-25T22:42:43.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060397230000000003 2024-04-25T22:42:43.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.801 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:43.801 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980242+0000", 2024-04-25T22:42:43.801 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1373e-05 2024-04-25T22:42:43.801 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.801 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.802 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.802 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980252+0000", 2024-04-25T22:42:43.802 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9990000000000003e-06 2024-04-25T22:42:43.802 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.802 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.802 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.802 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981303+0000", 2024-04-25T22:42:43.802 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010501670000000001 2024-04-25T22:42:43.802 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.802 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.802 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:43.802 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981444+0000", 2024-04-25T22:42:43.802 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014123799999999999 2024-04-25T22:42:43.802 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:43.803 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981585+0000", 2024-04-25T22:42:43.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014071999999999999 2024-04-25T22:42:43.803 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:43.803 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003640+0000", 2024-04-25T22:42:43.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022055113000000001 2024-04-25T22:42:43.803 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.803 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.803 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.803 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018070+0000", 2024-04-25T22:42:43.803 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014430877 2024-04-25T22:42:43.803 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.804 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:43.804 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018138+0000", 2024-04-25T22:42:43.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7743000000000005e-05 2024-04-25T22:42:43.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.804 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:43.804 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018191+0000", 2024-04-25T22:42:43.804 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3118000000000002e-05 2024-04-25T22:42:43.804 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.804 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.804 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.804 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.804 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.804 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:12632 4.a e64/17 4:506aad5d:::1000000310f.00000000:head v 64'203, mlcod=64'201)", 2024-04-25T22:42:43.805 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:43.805 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 28.096400503000002, 2024-04-25T22:42:43.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041913617, 2024-04-25T22:42:43.805 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:43.805 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:43.805 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.805 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:43.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.805 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:43.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:43.805 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.805 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.805 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.805 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:43.805 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:43.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.806 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:43.806 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643531+0000", 2024-04-25T22:42:43.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.497e-06 2024-04-25T22:42:43.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.806 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:43.806 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650159+0000", 2024-04-25T22:42:43.806 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066287059999999998 2024-04-25T22:42:43.806 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.806 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.806 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:43.807 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650185+0000", 2024-04-25T22:42:43.807 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5646000000000001e-05 2024-04-25T22:42:43.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.807 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.807 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.807 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650205+0000", 2024-04-25T22:42:43.807 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9720000000000001e-05 2024-04-25T22:42:43.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.807 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.807 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.807 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650521+0000", 2024-04-25T22:42:43.807 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00031590699999999998 2024-04-25T22:42:43.807 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.807 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.807 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:43.808 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650574+0000", 2024-04-25T22:42:43.808 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3192000000000002e-05 2024-04-25T22:42:43.808 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.808 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.808 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:43.808 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685374+0000", 2024-04-25T22:42:43.808 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034799902000000001 2024-04-25T22:42:43.808 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.808 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.808 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:43.808 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685443+0000", 2024-04-25T22:42:43.808 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9047000000000005e-05 2024-04-25T22:42:43.808 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.808 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.809 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.809 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.809 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.809 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12644 4.11 4:8893db93:::100000034c2.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:43.809 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:43.809 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 28.087991613, 2024-04-25T22:42:43.809 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045039497999999997, 2024-04-25T22:42:43.809 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:43.809 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:43.809 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.809 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:43.809 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:43.810 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.810 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12644 2024-04-25T22:42:43.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.810 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:43.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.810 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:43.810 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:43.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.810 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:43.810 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:43.810 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.810 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.810 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.811 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:43.811 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651940+0000", 2024-04-25T22:42:43.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.013e-06 2024-04-25T22:42:43.811 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.811 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:43.811 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659663+0000", 2024-04-25T22:42:43.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077228150000000001 2024-04-25T22:42:43.811 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.811 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:43.811 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659694+0000", 2024-04-25T22:42:43.811 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1112999999999998e-05 2024-04-25T22:42:43.811 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.811 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.811 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659715+0000", 2024-04-25T22:42:43.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1053e-05 2024-04-25T22:42:43.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659842+0000", 2024-04-25T22:42:43.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012738100000000001 2024-04-25T22:42:43.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:43.812 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660068+0000", 2024-04-25T22:42:43.812 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000225746 2024-04-25T22:42:43.812 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.812 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.812 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:43.813 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660307+0000", 2024-04-25T22:42:43.813 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000238352 2024-04-25T22:42:43.813 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.813 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.813 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:43.813 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.683776+0000", 2024-04-25T22:42:43.813 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023469891999999999 2024-04-25T22:42:43.813 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.813 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.813 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.813 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696810+0000", 2024-04-25T22:42:43.813 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013033385999999999 2024-04-25T22:42:43.813 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.813 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.813 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:43.813 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696904+0000", 2024-04-25T22:42:43.814 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3820000000000006e-05 2024-04-25T22:42:43.814 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.814 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.814 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:43.814 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696978+0000", 2024-04-25T22:42:43.814 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3926999999999999e-05 2024-04-25T22:42:43.814 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.814 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.814 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.814 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.814 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.814 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12645 4.2d 4:b45456a9:::10000003241.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:43.814 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:43.814 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 28.080171126, 2024-04-25T22:42:43.815 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.043099660999999997, 2024-04-25T22:42:43.815 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:43.815 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:43.815 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.815 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:43.815 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:43.815 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.815 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12645 2024-04-25T22:42:43.815 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.815 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:43.815 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.815 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:43.815 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:43.815 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.815 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.816 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:43.816 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:43.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.816 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:43.816 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659761+0000", 2024-04-25T22:42:43.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8459999999999999e-06 2024-04-25T22:42:43.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.816 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.816 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:43.816 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666663+0000", 2024-04-25T22:42:43.816 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0069017080000000003 2024-04-25T22:42:43.816 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.817 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.817 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:43.817 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666684+0000", 2024-04-25T22:42:43.817 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0706000000000001e-05 2024-04-25T22:42:43.817 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.817 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.817 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.817 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666700+0000", 2024-04-25T22:42:43.817 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5985999999999999e-05 2024-04-25T22:42:43.817 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.817 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.817 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.817 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666914+0000", 2024-04-25T22:42:43.817 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000213861 2024-04-25T22:42:43.817 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.817 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.818 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:43.818 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.667082+0000", 2024-04-25T22:42:43.818 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016809 2024-04-25T22:42:43.818 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.818 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.818 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:43.818 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702598+0000", 2024-04-25T22:42:43.818 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035515962999999998 2024-04-25T22:42:43.818 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.818 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.818 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:43.818 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702705+0000", 2024-04-25T22:42:43.818 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010689800000000001 2024-04-25T22:42:43.818 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.819 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.819 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:43.819 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702858+0000", 2024-04-25T22:42:43.819 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015360300000000001 2024-04-25T22:42:43.819 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.819 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.819 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.819 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.819 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.819 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12829 4.3b 4:de8bdadd:::100000033c7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:43.819 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:43.819 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.851911211000001, 2024-04-25T22:42:43.819 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042457306, 2024-04-25T22:42:43.819 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:43.819 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:43.820 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.820 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:43.820 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:43.820 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.820 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12829 2024-04-25T22:42:43.820 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.820 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:43.820 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.820 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:43.820 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:43.820 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.820 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.820 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.820 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:43.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:43.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:43.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888019+0000", 2024-04-25T22:42:43.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3300000000000002e-07 2024-04-25T22:42:43.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:43.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891638+0000", 2024-04-25T22:42:43.821 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036189109999999998 2024-04-25T22:42:43.821 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.821 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.821 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:43.821 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891661+0000", 2024-04-25T22:42:43.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3345000000000001e-05 2024-04-25T22:42:43.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.822 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.822 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.822 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891671+0000", 2024-04-25T22:42:43.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0115000000000001e-05 2024-04-25T22:42:43.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.822 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.822 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.822 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891737+0000", 2024-04-25T22:42:43.822 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5600999999999998e-05 2024-04-25T22:42:43.822 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.822 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:43.823 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891856+0000", 2024-04-25T22:42:43.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011881 2024-04-25T22:42:43.823 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:43.823 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930251+0000", 2024-04-25T22:42:43.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.038395141000000001 2024-04-25T22:42:43.823 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:43.823 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930389+0000", 2024-04-25T22:42:43.823 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013849000000000001 2024-04-25T22:42:43.823 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.823 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.823 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:43.824 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930476+0000", 2024-04-25T22:42:43.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6360000000000007e-05 2024-04-25T22:42:43.824 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.824 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.824 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.824 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.824 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.824 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13009 4.1e 4:78728bd7:::100000033a5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:43.824 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:43.824 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.650024199000001, 2024-04-25T22:42:43.824 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049997452999999997, 2024-04-25T22:42:43.824 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:43.824 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:43.824 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.824 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:43.824 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:43.824 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.825 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13009 2024-04-25T22:42:43.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.825 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:43.825 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.825 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:43.825 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:43.825 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.825 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.825 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:43.825 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:43.825 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.825 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.825 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.825 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:43.826 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:43.826 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4799999999999997e-07 2024-04-25T22:42:43.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.826 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:43.826 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097105+0000", 2024-04-25T22:42:43.826 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071984060000000001 2024-04-25T22:42:43.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.826 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:43.826 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097118+0000", 2024-04-25T22:42:43.826 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2865e-05 2024-04-25T22:42:43.826 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.826 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097127+0000", 2024-04-25T22:42:43.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8449999999999998e-06 2024-04-25T22:42:43.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097174+0000", 2024-04-25T22:42:43.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6084000000000001e-05 2024-04-25T22:42:43.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:43.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097232+0000", 2024-04-25T22:42:43.827 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8928999999999998e-05 2024-04-25T22:42:43.827 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.827 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.827 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:43.827 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097309+0000", 2024-04-25T22:42:43.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7014999999999994e-05 2024-04-25T22:42:43.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:43.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.108708+0000", 2024-04-25T22:42:43.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011398233000000001 2024-04-25T22:42:43.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139793+0000", 2024-04-25T22:42:43.828 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031084856000000001 2024-04-25T22:42:43.828 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.828 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.828 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:43.828 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139848+0000", 2024-04-25T22:42:43.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5464000000000003e-05 2024-04-25T22:42:43.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.829 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:43.829 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139903+0000", 2024-04-25T22:42:43.829 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4907999999999997e-05 2024-04-25T22:42:43.829 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.829 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.829 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.829 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.829 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.829 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13318 4.16 4:6810bf9e:::10000003259.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:43.829 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:43.829 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.279449841000002, 2024-04-25T22:42:43.830 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057538179000000002, 2024-04-25T22:42:43.830 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:43.830 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:43.830 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.830 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:43.830 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:43.830 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.830 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13318 2024-04-25T22:42:43.830 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.830 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:43.830 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.830 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:43.830 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:43.831 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.831 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.831 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.831 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:43.831 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:43.831 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.831 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.831 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.831 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:43.831 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460481+0000", 2024-04-25T22:42:43.831 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:42:43.831 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.831 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.832 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:43.832 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466775+0000", 2024-04-25T22:42:43.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062944239999999999 2024-04-25T22:42:43.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.832 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.832 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:43.832 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466787+0000", 2024-04-25T22:42:43.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1688999999999999e-05 2024-04-25T22:42:43.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.832 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.832 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.832 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466793+0000", 2024-04-25T22:42:43.832 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7209999999999999e-06 2024-04-25T22:42:43.832 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.832 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.832 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466845+0000", 2024-04-25T22:42:43.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2166999999999997e-05 2024-04-25T22:42:43.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:43.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466912+0000", 2024-04-25T22:42:43.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7016999999999999e-05 2024-04-25T22:42:43.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:43.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.467020+0000", 2024-04-25T22:42:43.833 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010827699999999999 2024-04-25T22:42:43.833 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.833 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.833 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:43.833 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.476718+0000", 2024-04-25T22:42:43.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0096980439999999994 2024-04-25T22:42:43.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517860+0000", 2024-04-25T22:42:43.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041141847000000002 2024-04-25T22:42:43.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:43.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517924+0000", 2024-04-25T22:42:43.834 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3997000000000004e-05 2024-04-25T22:42:43.834 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.834 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.834 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:43.834 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.518018+0000", 2024-04-25T22:42:43.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4139000000000001e-05 2024-04-25T22:42:43.835 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.835 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.835 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.835 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.835 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.835 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13328 4.16 4:6a9ab238:::1000000339b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:43.835 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:43.835 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.260536856000002, 2024-04-25T22:42:43.835 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057072695999999999, 2024-04-25T22:42:43.835 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:43.835 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:43.835 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.835 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:43.835 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:43.836 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.836 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13328 2024-04-25T22:42:43.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.836 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:43.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.836 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:43.836 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:43.836 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.836 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.836 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:43.836 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:43.836 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.836 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.837 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.837 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:43.837 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479395+0000", 2024-04-25T22:42:43.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2859999999999998e-06 2024-04-25T22:42:43.837 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.837 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.837 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:43.837 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486667+0000", 2024-04-25T22:42:43.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072715599999999998 2024-04-25T22:42:43.837 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.837 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.837 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:43.837 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486677+0000", 2024-04-25T22:42:43.837 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0305e-05 2024-04-25T22:42:43.838 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486683+0000", 2024-04-25T22:42:43.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5300000000000004e-06 2024-04-25T22:42:43.838 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486768+0000", 2024-04-25T22:42:43.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5725999999999999e-05 2024-04-25T22:42:43.838 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.838 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.838 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:43.838 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486905+0000", 2024-04-25T22:42:43.838 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013696699999999999 2024-04-25T22:42:43.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:43.839 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.487121+0000", 2024-04-25T22:42:43.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021615299999999999 2024-04-25T22:42:43.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:43.839 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.509675+0000", 2024-04-25T22:42:43.839 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022553225999999999 2024-04-25T22:42:43.839 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.839 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.839 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536355+0000", 2024-04-25T22:42:43.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026680855 2024-04-25T22:42:43.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:43.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536401+0000", 2024-04-25T22:42:43.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5649000000000003e-05 2024-04-25T22:42:43.840 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.840 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.840 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:43.840 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536466+0000", 2024-04-25T22:42:43.840 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4438999999999997e-05 2024-04-25T22:42:43.840 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.840 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.840 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.841 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.841 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13329 4.26 4:64e005a2:::10000003483.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:43.841 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:43.841 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.253228456999999, 2024-04-25T22:42:43.841 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066502845000000005, 2024-04-25T22:42:43.841 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:43.841 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:43.841 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.841 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:43.841 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:43.841 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.841 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13329 2024-04-25T22:42:43.841 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.842 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:43.842 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.842 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:43.842 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:43.842 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.842 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.842 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.842 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:43.842 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:43.842 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.842 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.842 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.842 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:43.843 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486703+0000", 2024-04-25T22:42:43.843 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3909999999999999e-06 2024-04-25T22:42:43.843 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.843 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.843 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:43.843 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494612+0000", 2024-04-25T22:42:43.843 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0079096670000000004 2024-04-25T22:42:43.843 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.843 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.843 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:43.843 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494626+0000", 2024-04-25T22:42:43.843 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3263e-05 2024-04-25T22:42:43.843 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.843 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.843 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494637+0000", 2024-04-25T22:42:43.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.171e-05 2024-04-25T22:42:43.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494720+0000", 2024-04-25T22:42:43.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2767000000000002e-05 2024-04-25T22:42:43.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.844 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.844 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:43.844 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494834+0000", 2024-04-25T22:42:43.844 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011387699999999999 2024-04-25T22:42:43.844 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:43.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494998+0000", 2024-04-25T22:42:43.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016390799999999999 2024-04-25T22:42:43.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:43.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517407+0000", 2024-04-25T22:42:43.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022409068000000001 2024-04-25T22:42:43.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.845 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.845 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.845 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553040+0000", 2024-04-25T22:42:43.845 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035633155 2024-04-25T22:42:43.845 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:43.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553140+0000", 2024-04-25T22:42:43.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9623000000000005e-05 2024-04-25T22:42:43.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.846 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.846 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:43.846 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553204+0000", 2024-04-25T22:42:43.846 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4416000000000001e-05 2024-04-25T22:42:43.846 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.846 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.846 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.846 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.847 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.847 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13399 4.16 4:6bb7cc3a:::10000003648.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:43.847 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:43.847 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 27.179862657000001, 2024-04-25T22:42:43.847 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045625003999999997, 2024-04-25T22:42:43.847 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:43.847 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:43.847 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:43.847 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:43.847 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:43.847 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:43.847 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13399 2024-04-25T22:42:43.847 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.848 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:43.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:43.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:43.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:43.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:43.848 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:43.848 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.848 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.848 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:43.848 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560068+0000", 2024-04-25T22:42:43.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:42:43.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:43.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576902+0000", 2024-04-25T22:42:43.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016833806 2024-04-25T22:42:43.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:43.849 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576916+0000", 2024-04-25T22:42:43.849 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3648e-05 2024-04-25T22:42:43.849 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.849 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.849 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:43.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576927+0000", 2024-04-25T22:42:43.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0992000000000001e-05 2024-04-25T22:42:43.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:43.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577026+0000", 2024-04-25T22:42:43.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9116000000000004e-05 2024-04-25T22:42:43.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.850 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.850 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:43.850 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577203+0000", 2024-04-25T22:42:43.850 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017700499999999999 2024-04-25T22:42:43.850 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:43.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577336+0000", 2024-04-25T22:42:43.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013340800000000001 2024-04-25T22:42:43.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:43.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.589077+0000", 2024-04-25T22:42:43.851 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011741151 2024-04-25T22:42:43.851 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.851 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.851 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:43.851 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605436+0000", 2024-04-25T22:42:43.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016359146000000001 2024-04-25T22:42:43.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:43.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605493+0000", 2024-04-25T22:42:43.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7067000000000001e-05 2024-04-25T22:42:43.852 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:43.852 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:43.852 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:43.852 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605692+0000", 2024-04-25T22:42:43.852 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00019855799999999999 2024-04-25T22:42:43.852 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.852 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.852 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.853 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:43.853 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:43.853 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:43.853 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:42:43.855 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:43.854+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:43.855 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:43.955 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:43.954+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:43.986 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-25T22:42:43.986 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-25T22:42:43.986 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-25T22:42:43.987 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-25T22:42:44.000 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:44.016 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:44.017 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:44.017 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:44.038 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:44.039 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:44.043 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:44.043 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:44.056 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:44.054+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:44.116 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:44.116 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:44.130 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:44.157 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:44.154+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:44.246 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:44.247 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:44.258 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:44.255+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:44.260 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:44.358 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:44.358+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:44.390 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:44.390 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:44.405 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:44.490 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:44.490+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:44.560 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:44.558+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:44.571 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:44.571 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:44.585 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:44.670 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:44.670+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:44.746 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:44.746 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:44.759 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:44.803 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:44.802+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:44.862 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:44.862+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:44.888 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:44.889 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:44.903 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:44.962 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:44.959+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:45.022 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:45.022 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:45.035 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:45.077 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:45.075+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:45.165 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:45.162+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:45.198 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:45.198 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:45.212 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:45.266 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:45.263+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:45.346 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:45.346 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:45.361 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:45.406 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:45.406+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:45.468 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:45.463+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:45.482 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:45.483 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:45.496 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:45.569 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:45.567+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:45.570 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:42:45.662 INFO:teuthology.orchestra.run.smithi188.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:45.662 INFO:teuthology.orchestra.run.smithi188.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:45.670 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:45.671+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:45.678 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:42:45.756 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~71s 2024-04-25T22:42:45.771 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:45.767+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:45.806 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:45.806 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:45.819 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:42:45.906 INFO:tasks.ceph.osd.0.smithi122.stderr:2024-04-25T22:42:45.903+0000 7f5c08260640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21646) UID: 0 2024-04-25T22:42:45.972 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:45.970+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:45.982 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:45.982 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:45.996 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:42:46.044 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:42:46.073 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:46.070+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:46.078 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T22:42:46.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:42:46.079 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T22:42:46.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:42:46.104 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2024-04-25T22:42:46.151 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T22:42:46.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:42:46.152 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:42:46.158 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-25T22:42:46.159 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:42:46.172 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:42:46.174 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:46.170+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:46.196 INFO:teuthology.orchestra.run.smithi057.stdout:osd.0: {} 2024-04-25T22:42:46.196 INFO:teuthology.orchestra.run.smithi057.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:42:46.196 INFO:teuthology.orchestra.run.smithi057.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:42:46.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:42:46.204 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link delete ceph-brx 2024-04-25T22:42:46.215 INFO:teuthology.orchestra.run.smithi057.stdout:osd.2: {} 2024-04-25T22:42:46.215 INFO:teuthology.orchestra.run.smithi057.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:42:46.218 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:42:46.218 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:42:46.275 INFO:tasks.ceph.osd.2.smithi188.stderr:2024-04-25T22:42:46.274+0000 7f113b2ef640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21722) UID: 0 2024-04-25T22:42:46.304 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:46.304 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:46.304 INFO:teuthology.orchestra.run.smithi188.stdout: "num_ops": 0 2024-04-25T22:42:46.304 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:46.318 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:42:46.352 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-25T22:42:46.362 INFO:tasks.thrashosds:joining thrashosds 2024-04-25T22:42:46.486 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:46.486 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [], 2024-04-25T22:42:46.486 INFO:teuthology.orchestra.run.smithi188.stdout: "complaint_time": 30, 2024-04-25T22:42:46.486 INFO:teuthology.orchestra.run.smithi188.stdout: "num_blocked_ops": 0 2024-04-25T22:42:46.486 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:46.501 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:42:46.563 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is unset 2024-04-25T22:42:46.627 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-04-25T22:42:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: "size": 20, 2024-04-25T22:42:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 600, 2024-04-25T22:42:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: "ops": [ 2024-04-25T22:42:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 152.02956355500001, 2024-04-25T22:42:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041045294000000003, 2024-04-25T22:42:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595614+0000", 2024-04-25T22:42:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.628 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595617+0000", 2024-04-25T22:42:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3369999999999998e-06 2024-04-25T22:42:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595632+0000", 2024-04-25T22:42:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5529999999999999e-05 2024-04-25T22:42:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595662+0000", 2024-04-25T22:42:46.629 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.9933e-05 2024-04-25T22:42:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595690+0000", 2024-04-25T22:42:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7855999999999999e-05 2024-04-25T22:42:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595825+0000", 2024-04-25T22:42:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013557200000000001 2024-04-25T22:42:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.630 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op must wait for map", 2024-04-25T22:42:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595836+0000", 2024-04-25T22:42:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0267e-05 2024-04-25T22:42:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612687+0000", 2024-04-25T22:42:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016851400999999998 2024-04-25T22:42:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.612957+0000", 2024-04-25T22:42:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00026968400000000002 2024-04-25T22:42:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.631 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.613228+0000", 2024-04-25T22:42:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00027087500000000001 2024-04-25T22:42:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.620472+0000", 2024-04-25T22:42:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072443860000000002 2024-04-25T22:42:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636461+0000", 2024-04-25T22:42:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.015989390999999999 2024-04-25T22:42:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.632 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636571+0000", 2024-04-25T22:42:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010912 2024-04-25T22:42:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636660+0000", 2024-04-25T22:42:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.8942000000000003e-05 2024-04-25T22:42:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.633 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 152.02942629899999, 2024-04-25T22:42:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041334171000000003, 2024-04-25T22:42:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.634 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595751+0000", 2024-04-25T22:42:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595753+0000", 2024-04-25T22:42:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.6029999999999999e-06 2024-04-25T22:42:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595764+0000", 2024-04-25T22:42:46.635 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0477e-05 2024-04-25T22:42:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595787+0000", 2024-04-25T22:42:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3280000000000001e-05 2024-04-25T22:42:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595805+0000", 2024-04-25T22:42:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8073000000000001e-05 2024-04-25T22:42:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.636 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595946+0000", 2024-04-25T22:42:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000140712 2024-04-25T22:42:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.595959+0000", 2024-04-25T22:42:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3286e-05 2024-04-25T22:42:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614390+0000", 2024-04-25T22:42:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018430992 2024-04-25T22:42:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:46.637 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.614648+0000", 2024-04-25T22:42:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00025830100000000001 2024-04-25T22:42:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615008+0000", 2024-04-25T22:42:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00036022799999999998 2024-04-25T22:42:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.622335+0000", 2024-04-25T22:42:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0073270560000000002 2024-04-25T22:42:46.638 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636836+0000", 2024-04-25T22:42:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014500305 2024-04-25T22:42:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.636989+0000", 2024-04-25T22:42:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015272199999999999 2024-04-25T22:42:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637086+0000", 2024-04-25T22:42:46.639 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.7136e-05 2024-04-25T22:42:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 152.02916613100001, 2024-04-25T22:42:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041366576000000002, 2024-04-25T22:42:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:46.640 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596012+0000", 2024-04-25T22:42:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596013+0000", 2024-04-25T22:42:46.641 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.333e-06 2024-04-25T22:42:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596021+0000", 2024-04-25T22:42:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.6869999999999994e-06 2024-04-25T22:42:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596041+0000", 2024-04-25T22:42:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.056e-05 2024-04-25T22:42:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.642 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596057+0000", 2024-04-25T22:42:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5386000000000001e-05 2024-04-25T22:42:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596116+0000", 2024-04-25T22:42:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.9488999999999999e-05 2024-04-25T22:42:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596123+0000", 2024-04-25T22:42:46.643 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5139999999999998e-06 2024-04-25T22:42:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615677+0000", 2024-04-25T22:42:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019554706000000002 2024-04-25T22:42:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.615975+0000", 2024-04-25T22:42:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00029722400000000001 2024-04-25T22:42:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.644 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.616955+0000", 2024-04-25T22:42:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00098042899999999989 2024-04-25T22:42:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.625484+0000", 2024-04-25T22:42:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0085292909999999996 2024-04-25T22:42:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637232+0000", 2024-04-25T22:42:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011747992000000001 2024-04-25T22:42:46.645 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637328+0000", 2024-04-25T22:42:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.5478999999999998e-05 2024-04-25T22:42:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637378+0000", 2024-04-25T22:42:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.0485999999999997e-05 2024-04-25T22:42:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.646 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 152.029000932, 2024-04-25T22:42:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041043312999999998, 2024-04-25T22:42:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.647 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596177+0000", 2024-04-25T22:42:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:46.648 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596178+0000", 2024-04-25T22:42:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.536e-06 2024-04-25T22:42:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596185+0000", 2024-04-25T22:42:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.2539999999999998e-06 2024-04-25T22:42:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596203+0000", 2024-04-25T22:42:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8783e-05 2024-04-25T22:42:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.649 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596217+0000", 2024-04-25T22:42:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.4069e-05 2024-04-25T22:42:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596285+0000", 2024-04-25T22:42:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7847000000000003e-05 2024-04-25T22:42:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596291+0000", 2024-04-25T22:42:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.733e-06 2024-04-25T22:42:46.650 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.602546+0000", 2024-04-25T22:42:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062547719999999996 2024-04-25T22:42:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.603571+0000", 2024-04-25T22:42:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010249149999999999 2024-04-25T22:42:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637220+0000", 2024-04-25T22:42:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.033649404000000001 2024-04-25T22:42:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:42:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 152.02893527000001, 2024-04-25T22:42:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041420604, 2024-04-25T22:42:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "started", 2024-04-25T22:42:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596242+0000", 2024-04-25T22:42:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596244+0000", 2024-04-25T22:42:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3799999999999999e-06 2024-04-25T22:42:46.653 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596254+0000", 2024-04-25T22:42:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8770000000000005e-06 2024-04-25T22:42:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596272+0000", 2024-04-25T22:42:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.8706e-05 2024-04-25T22:42:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.654 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596288+0000", 2024-04-25T22:42:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5577e-05 2024-04-25T22:42:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596369+0000", 2024-04-25T22:42:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.0568999999999994e-05 2024-04-25T22:42:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:42:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.596380+0000", 2024-04-25T22:42:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1552999999999999e-05 2024-04-25T22:42:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.655 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619429+0000", 2024-04-25T22:42:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023048813000000001 2024-04-25T22:42:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.619714+0000", 2024-04-25T22:42:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00028471699999999998 2024-04-25T22:42:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:46.656 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:40:14.637663+0000", 2024-04-25T22:42:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.017949412000000001 2024-04-25T22:42:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10700 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 34.106068053000001, 2024-04-25T22:42:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066789482999999997, 2024-04-25T22:42:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:46.657 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10700 2024-04-25T22:42:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.658 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519110+0000", 2024-04-25T22:42:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.519112+0000", 2024-04-25T22:42:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1399999999999998e-06 2024-04-25T22:42:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527187+0000", 2024-04-25T22:42:46.659 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0080748899999999995 2024-04-25T22:42:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527232+0000", 2024-04-25T22:42:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4895999999999998e-05 2024-04-25T22:42:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.527259+0000", 2024-04-25T22:42:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.7331999999999999e-05 2024-04-25T22:42:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.660 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529418+0000", 2024-04-25T22:42:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.002158765 2024-04-25T22:42:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529572+0000", 2024-04-25T22:42:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015438499999999999 2024-04-25T22:42:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:46.661 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.529762+0000", 2024-04-25T22:42:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018998100000000001 2024-04-25T22:42:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.548359+0000", 2024-04-25T22:42:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.018596444 2024-04-25T22:42:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585801+0000", 2024-04-25T22:42:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.037442469999999999 2024-04-25T22:42:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.662 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585847+0000", 2024-04-25T22:42:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5565000000000002e-05 2024-04-25T22:42:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.585899+0000", 2024-04-25T22:42:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2614999999999997e-05 2024-04-25T22:42:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.663 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10714 4.11 4:88409fbf:::100000030ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 34.072387089999999, 2024-04-25T22:42:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.048080623000000003, 2024-04-25T22:42:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10714 2024-04-25T22:42:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.664 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552791+0000", 2024-04-25T22:42:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.552792+0000", 2024-04-25T22:42:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:42:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.665 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559915+0000", 2024-04-25T22:42:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071231690000000004 2024-04-25T22:42:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559932+0000", 2024-04-25T22:42:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.7169000000000001e-05 2024-04-25T22:42:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.559942+0000", 2024-04-25T22:42:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0261999999999999e-05 2024-04-25T22:42:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560018+0000", 2024-04-25T22:42:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.5358000000000006e-05 2024-04-25T22:42:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560118+0000", 2024-04-25T22:42:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000100911 2024-04-25T22:42:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:46.667 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.560281+0000", 2024-04-25T22:42:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016288500000000001 2024-04-25T22:42:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.579740+0000", 2024-04-25T22:42:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.019458598000000001 2024-04-25T22:42:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600484+0000", 2024-04-25T22:42:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.020744483000000001 2024-04-25T22:42:46.668 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600664+0000", 2024-04-25T22:42:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017953899999999999 2024-04-25T22:42:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.600871+0000", 2024-04-25T22:42:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020737199999999999 2024-04-25T22:42:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.669 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10813 4.17 4:e8010137:::100000030b0.00000000:head [write 0~3932160] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.877438083999998, 2024-04-25T22:42:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.047503799999999999, 2024-04-25T22:42:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10813 2024-04-25T22:42:46.670 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747740+0000", 2024-04-25T22:42:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.671 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.747741+0000", 2024-04-25T22:42:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1119999999999999e-06 2024-04-25T22:42:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752366+0000", 2024-04-25T22:42:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0046253240000000001 2024-04-25T22:42:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752382+0000", 2024-04-25T22:42:46.672 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5639999999999999e-05 2024-04-25T22:42:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752393+0000", 2024-04-25T22:42:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1626e-05 2024-04-25T22:42:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752459+0000", 2024-04-25T22:42:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5309999999999996e-05 2024-04-25T22:42:46.673 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752529+0000", 2024-04-25T22:42:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.0543000000000005e-05 2024-04-25T22:42:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.752637+0000", 2024-04-25T22:42:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010788799999999999 2024-04-25T22:42:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760295+0000", 2024-04-25T22:42:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0076583290000000002 2024-04-25T22:42:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.794990+0000", 2024-04-25T22:42:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034694317000000002 2024-04-25T22:42:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795097+0000", 2024-04-25T22:42:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010768999999999999 2024-04-25T22:42:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.675 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.676 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:46.676 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795243+0000", 2024-04-25T22:42:46.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000146021 2024-04-25T22:42:46.676 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.676 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.676 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.676 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.676 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.676 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10816 4.17 4:e8010137:::100000030b0.00000000:head [write 3932160~262144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-25T22:42:46.676 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:46.676 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.872108623999999, 2024-04-25T22:42:46.676 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042406530999999997, 2024-04-25T22:42:46.676 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:46.677 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:46.677 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:46.677 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:46.677 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:46.677 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:46.677 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10816 2024-04-25T22:42:46.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.677 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:46.677 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.677 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:46.677 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:46.677 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.677 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:46.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753069+0000", 2024-04-25T22:42:46.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:46.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753070+0000", 2024-04-25T22:42:46.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9800000000000002e-07 2024-04-25T22:42:46.678 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.678 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.678 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:46.678 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753288+0000", 2024-04-25T22:42:46.678 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000217789 2024-04-25T22:42:46.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:46.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753301+0000", 2024-04-25T22:42:46.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2764e-05 2024-04-25T22:42:46.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:46.679 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.753310+0000", 2024-04-25T22:42:46.679 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.2799999999999992e-06 2024-04-25T22:42:46.679 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.679 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.679 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758240+0000", 2024-04-25T22:42:46.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0049304910000000004 2024-04-25T22:42:46.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:46.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758374+0000", 2024-04-25T22:42:46.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000133428 2024-04-25T22:42:46.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.680 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.680 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:46.680 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.758576+0000", 2024-04-25T22:42:46.680 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00020177899999999999 2024-04-25T22:42:46.680 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.681 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:46.681 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.760626+0000", 2024-04-25T22:42:46.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0020501489999999998 2024-04-25T22:42:46.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.681 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:46.681 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795329+0000", 2024-04-25T22:42:46.681 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034703352999999999 2024-04-25T22:42:46.681 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.681 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.681 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:46.681 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795414+0000", 2024-04-25T22:42:46.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5292999999999998e-05 2024-04-25T22:42:46.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.682 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:46.682 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.795476+0000", 2024-04-25T22:42:46.682 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.1206999999999999e-05 2024-04-25T22:42:46.682 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.682 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.682 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.682 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.682 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.682 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10914 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:46.683 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:46.683 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.671308242000002, 2024-04-25T22:42:46.683 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044452984000000001, 2024-04-25T22:42:46.683 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:46.683 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:46.683 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:46.683 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:46.683 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:46.683 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:46.683 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10914 2024-04-25T22:42:46.683 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.683 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:46.683 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.683 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:46.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:46.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.684 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.684 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:46.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953870+0000", 2024-04-25T22:42:46.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.684 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.684 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.684 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:46.684 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.953871+0000", 2024-04-25T22:42:46.684 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1829999999999999e-06 2024-04-25T22:42:46.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:46.685 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.962992+0000", 2024-04-25T22:42:46.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0091217409999999992 2024-04-25T22:42:46.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:46.685 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963027+0000", 2024-04-25T22:42:46.685 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.4229e-05 2024-04-25T22:42:46.685 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.685 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.685 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:46.686 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963042+0000", 2024-04-25T22:42:46.686 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5152e-05 2024-04-25T22:42:46.686 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.686 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.686 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.686 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963143+0000", 2024-04-25T22:42:46.686 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000101171 2024-04-25T22:42:46.686 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.686 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.686 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:46.686 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963269+0000", 2024-04-25T22:42:46.686 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012623499999999999 2024-04-25T22:42:46.686 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:46.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.963453+0000", 2024-04-25T22:42:46.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00018357900000000001 2024-04-25T22:42:46.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:46.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998133+0000", 2024-04-25T22:42:46.687 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034679789000000003 2024-04-25T22:42:46.687 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.687 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.687 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:46.687 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998220+0000", 2024-04-25T22:42:46.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.7153999999999999e-05 2024-04-25T22:42:46.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:46.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998278+0000", 2024-04-25T22:42:46.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8035000000000003e-05 2024-04-25T22:42:46.688 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.688 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.688 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:46.688 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.998323+0000", 2024-04-25T22:42:46.688 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.4715999999999997e-05 2024-04-25T22:42:46.688 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.688 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.689 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.689 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.689 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.689 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:10919 4.26 4:6414d19f:::10000003137.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:46.689 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:46.689 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 33.650996960999997, 2024-04-25T22:42:46.689 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.044010552000000001, 2024-04-25T22:42:46.689 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:46.689 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:46.689 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:46.689 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:46.689 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:46.689 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:46.689 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 10919 2024-04-25T22:42:46.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.690 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:46.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.690 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:46.690 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:46.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.690 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:46.690 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:46.690 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.690 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.690 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.690 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:46.691 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.974181+0000", 2024-04-25T22:42:46.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.8100000000000003e-07 2024-04-25T22:42:46.691 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.691 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.691 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:46.691 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980221+0000", 2024-04-25T22:42:46.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0060397230000000003 2024-04-25T22:42:46.691 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.691 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.691 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:46.691 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980242+0000", 2024-04-25T22:42:46.691 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1373e-05 2024-04-25T22:42:46.691 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.691 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:46.692 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.980252+0000", 2024-04-25T22:42:46.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9990000000000003e-06 2024-04-25T22:42:46.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.692 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981303+0000", 2024-04-25T22:42:46.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0010501670000000001 2024-04-25T22:42:46.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.692 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.692 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:46.692 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981444+0000", 2024-04-25T22:42:46.692 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014123799999999999 2024-04-25T22:42:46.692 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:46.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:12.981585+0000", 2024-04-25T22:42:46.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00014071999999999999 2024-04-25T22:42:46.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:46.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.003640+0000", 2024-04-25T22:42:46.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022055113000000001 2024-04-25T22:42:46.693 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.693 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.693 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:46.693 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018070+0000", 2024-04-25T22:42:46.693 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.014430877 2024-04-25T22:42:46.694 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.694 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.694 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:46.694 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018138+0000", 2024-04-25T22:42:46.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7743000000000005e-05 2024-04-25T22:42:46.694 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.694 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.694 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:46.694 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:13.018191+0000", 2024-04-25T22:42:46.694 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3118000000000002e-05 2024-04-25T22:42:46.694 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.694 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.694 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.695 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.695 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_repop(client.4529.0:12632 4.a e64/17 4:506aad5d:::1000000310f.00000000:head v 64'203, mlcod=64'201)", 2024-04-25T22:42:46.695 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:46.695 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.981648566, 2024-04-25T22:42:46.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041913617, 2024-04-25T22:42:46.695 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:46.695 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:46.695 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:46.695 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:46.695 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.695 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:46.695 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:46.695 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:46.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643529+0000", 2024-04-25T22:42:46.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:46.696 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.643531+0000", 2024-04-25T22:42:46.696 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.497e-06 2024-04-25T22:42:46.696 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.696 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.696 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:46.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650159+0000", 2024-04-25T22:42:46.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0066287059999999998 2024-04-25T22:42:46.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:46.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650185+0000", 2024-04-25T22:42:46.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.5646000000000001e-05 2024-04-25T22:42:46.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.697 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.697 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:46.697 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650205+0000", 2024-04-25T22:42:46.697 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.9720000000000001e-05 2024-04-25T22:42:46.697 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.698 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.698 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650521+0000", 2024-04-25T22:42:46.698 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00031590699999999998 2024-04-25T22:42:46.698 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.698 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:46.698 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.650574+0000", 2024-04-25T22:42:46.698 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3192000000000002e-05 2024-04-25T22:42:46.698 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.698 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.698 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:46.698 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685374+0000", 2024-04-25T22:42:46.698 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.034799902000000001 2024-04-25T22:42:46.699 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.699 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.699 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:46.699 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.685443+0000", 2024-04-25T22:42:46.699 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.9047000000000005e-05 2024-04-25T22:42:46.699 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.699 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.699 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.699 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.699 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.699 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12644 4.11 4:8893db93:::100000034c2.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:46.699 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:46.699 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.973239675999999, 2024-04-25T22:42:46.700 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045039497999999997, 2024-04-25T22:42:46.700 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:46.700 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:46.700 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:46.700 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:46.700 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:46.700 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:46.700 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12644 2024-04-25T22:42:46.700 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.700 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:46.700 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.700 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:46.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:46.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:46.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651938+0000", 2024-04-25T22:42:46.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.701 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:46.701 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.651940+0000", 2024-04-25T22:42:46.701 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.013e-06 2024-04-25T22:42:46.701 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.701 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.702 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:46.702 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659663+0000", 2024-04-25T22:42:46.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0077228150000000001 2024-04-25T22:42:46.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.702 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:46.702 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659694+0000", 2024-04-25T22:42:46.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 3.1112999999999998e-05 2024-04-25T22:42:46.702 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.702 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.702 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:46.702 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659715+0000", 2024-04-25T22:42:46.702 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.1053e-05 2024-04-25T22:42:46.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659842+0000", 2024-04-25T22:42:46.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00012738100000000001 2024-04-25T22:42:46.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:46.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660068+0000", 2024-04-25T22:42:46.703 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000225746 2024-04-25T22:42:46.703 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.703 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.703 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:46.703 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.660307+0000", 2024-04-25T22:42:46.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000238352 2024-04-25T22:42:46.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.704 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:46.704 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.683776+0000", 2024-04-25T22:42:46.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.023469891999999999 2024-04-25T22:42:46.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.704 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:46.704 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696810+0000", 2024-04-25T22:42:46.704 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.013033385999999999 2024-04-25T22:42:46.704 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.704 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.705 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:46.705 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696904+0000", 2024-04-25T22:42:46.705 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.3820000000000006e-05 2024-04-25T22:42:46.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.705 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.705 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:46.705 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.696978+0000", 2024-04-25T22:42:46.705 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.3926999999999999e-05 2024-04-25T22:42:46.705 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.705 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.705 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.705 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.705 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.705 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12645 4.2d 4:b45456a9:::10000003241.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:46.706 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:46.706 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.965419188999999, 2024-04-25T22:42:46.706 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.043099660999999997, 2024-04-25T22:42:46.706 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:46.706 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:46.706 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:46.706 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:46.706 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:46.706 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:46.706 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12645 2024-04-25T22:42:46.706 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.706 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:46.706 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.706 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:46.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:46.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.707 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:46.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659759+0000", 2024-04-25T22:42:46.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.707 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:46.707 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.659761+0000", 2024-04-25T22:42:46.707 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.8459999999999999e-06 2024-04-25T22:42:46.707 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.707 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.708 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:46.708 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666663+0000", 2024-04-25T22:42:46.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0069017080000000003 2024-04-25T22:42:46.708 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.708 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.708 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:46.708 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666684+0000", 2024-04-25T22:42:46.708 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.0706000000000001e-05 2024-04-25T22:42:46.708 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.708 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.708 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:46.709 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666700+0000", 2024-04-25T22:42:46.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.5985999999999999e-05 2024-04-25T22:42:46.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.709 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.666914+0000", 2024-04-25T22:42:46.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.000213861 2024-04-25T22:42:46.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.709 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:46.709 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.667082+0000", 2024-04-25T22:42:46.709 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016809 2024-04-25T22:42:46.709 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.709 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.710 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:46.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702598+0000", 2024-04-25T22:42:46.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035515962999999998 2024-04-25T22:42:46.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.710 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:46.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702705+0000", 2024-04-25T22:42:46.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010689800000000001 2024-04-25T22:42:46.710 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.710 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.710 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:46.710 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.702858+0000", 2024-04-25T22:42:46.710 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00015360300000000001 2024-04-25T22:42:46.711 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.711 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.711 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.711 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.711 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.711 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:12829 4.3b 4:de8bdadd:::100000033c7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:46.711 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:46.711 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.737159274, 2024-04-25T22:42:46.711 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.042457306, 2024-04-25T22:42:46.711 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:46.711 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:46.711 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:46.711 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:46.711 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:46.712 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:46.712 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 12829 2024-04-25T22:42:46.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.712 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:46.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:46.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:46.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.712 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.712 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:46.712 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888018+0000", 2024-04-25T22:42:46.712 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.712 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.713 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:46.713 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.888019+0000", 2024-04-25T22:42:46.713 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.3300000000000002e-07 2024-04-25T22:42:46.713 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.713 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:46.713 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891638+0000", 2024-04-25T22:42:46.713 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0036189109999999998 2024-04-25T22:42:46.713 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.713 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.713 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:46.713 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891661+0000", 2024-04-25T22:42:46.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.3345000000000001e-05 2024-04-25T22:42:46.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.714 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:46.714 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891671+0000", 2024-04-25T22:42:46.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0115000000000001e-05 2024-04-25T22:42:46.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.714 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.714 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891737+0000", 2024-04-25T22:42:46.714 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.5600999999999998e-05 2024-04-25T22:42:46.714 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.714 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:46.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.891856+0000", 2024-04-25T22:42:46.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011881 2024-04-25T22:42:46.715 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:46.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930251+0000", 2024-04-25T22:42:46.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.038395141000000001 2024-04-25T22:42:46.715 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.715 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.715 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:46.715 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930389+0000", 2024-04-25T22:42:46.715 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013849000000000001 2024-04-25T22:42:46.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.716 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:46.716 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:15.930476+0000", 2024-04-25T22:42:46.716 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.6360000000000007e-05 2024-04-25T22:42:46.716 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.716 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.716 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.716 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.716 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.716 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13009 4.1e 4:78728bd7:::100000033a5.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-25T22:42:46.716 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:46.716 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.535272261999999, 2024-04-25T22:42:46.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.049997452999999997, 2024-04-25T22:42:46.717 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:46.717 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:46.717 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:46.717 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:46.717 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:46.717 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:46.717 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13009 2024-04-25T22:42:46.717 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.717 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:46.717 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.717 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:46.717 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:46.717 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.718 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.718 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.718 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:46.718 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:46.718 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.718 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.718 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.718 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:46.718 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.089906+0000", 2024-04-25T22:42:46.718 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.4799999999999997e-07 2024-04-25T22:42:46.718 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.718 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.718 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:46.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097105+0000", 2024-04-25T22:42:46.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0071984060000000001 2024-04-25T22:42:46.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:46.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097118+0000", 2024-04-25T22:42:46.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.2865e-05 2024-04-25T22:42:46.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.719 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:46.719 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097127+0000", 2024-04-25T22:42:46.719 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.8449999999999998e-06 2024-04-25T22:42:46.719 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.719 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.720 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.720 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097174+0000", 2024-04-25T22:42:46.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.6084000000000001e-05 2024-04-25T22:42:46.720 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.720 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:46.720 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097232+0000", 2024-04-25T22:42:46.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.8928999999999998e-05 2024-04-25T22:42:46.720 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.720 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.720 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:46.720 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.097309+0000", 2024-04-25T22:42:46.720 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 7.7014999999999994e-05 2024-04-25T22:42:46.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:46.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.108708+0000", 2024-04-25T22:42:46.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011398233000000001 2024-04-25T22:42:46.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:46.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139793+0000", 2024-04-25T22:42:46.721 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.031084856000000001 2024-04-25T22:42:46.721 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.721 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.721 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:46.721 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139848+0000", 2024-04-25T22:42:46.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5464000000000003e-05 2024-04-25T22:42:46.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.722 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:46.722 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.139903+0000", 2024-04-25T22:42:46.722 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.4907999999999997e-05 2024-04-25T22:42:46.722 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.722 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.722 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.722 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.722 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.722 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13318 4.16 4:6810bf9e:::10000003259.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:46.723 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:46.723 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.164697904000001, 2024-04-25T22:42:46.723 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057538179000000002, 2024-04-25T22:42:46.723 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:46.723 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:46.723 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:46.723 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:46.723 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:46.723 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:46.723 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13318 2024-04-25T22:42:46.723 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.723 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:46.723 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.723 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:46.724 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:46.724 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.724 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.724 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.724 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:46.724 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460480+0000", 2024-04-25T22:42:46.724 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.724 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.724 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.724 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:46.724 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.460481+0000", 2024-04-25T22:42:46.724 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:42:46.724 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:46.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466775+0000", 2024-04-25T22:42:46.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0062944239999999999 2024-04-25T22:42:46.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:46.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466787+0000", 2024-04-25T22:42:46.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1688999999999999e-05 2024-04-25T22:42:46.725 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.725 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.725 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:46.725 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466793+0000", 2024-04-25T22:42:46.725 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7209999999999999e-06 2024-04-25T22:42:46.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.726 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466845+0000", 2024-04-25T22:42:46.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.2166999999999997e-05 2024-04-25T22:42:46.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:46.726 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.466912+0000", 2024-04-25T22:42:46.726 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.7016999999999999e-05 2024-04-25T22:42:46.726 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.726 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.726 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:46.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.467020+0000", 2024-04-25T22:42:46.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00010827699999999999 2024-04-25T22:42:46.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:46.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.476718+0000", 2024-04-25T22:42:46.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0096980439999999994 2024-04-25T22:42:46.727 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.727 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.727 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:46.727 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517860+0000", 2024-04-25T22:42:46.727 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.041141847000000002 2024-04-25T22:42:46.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:46.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517924+0000", 2024-04-25T22:42:46.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.3997000000000004e-05 2024-04-25T22:42:46.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.728 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.728 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:46.728 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.518018+0000", 2024-04-25T22:42:46.728 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.4139000000000001e-05 2024-04-25T22:42:46.728 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.728 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.728 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.728 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.729 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.729 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13328 4.16 4:6a9ab238:::1000000339b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:46.729 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:46.729 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.145784919, 2024-04-25T22:42:46.729 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.057072695999999999, 2024-04-25T22:42:46.729 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:46.729 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:46.729 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:46.729 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:46.729 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:46.729 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:46.729 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13328 2024-04-25T22:42:46.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.730 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:46.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:46.730 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:46.730 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.730 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:46.730 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479393+0000", 2024-04-25T22:42:46.730 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.730 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.730 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.731 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:46.731 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.479395+0000", 2024-04-25T22:42:46.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 2.2859999999999998e-06 2024-04-25T22:42:46.731 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.731 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.731 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:46.731 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486667+0000", 2024-04-25T22:42:46.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0072715599999999998 2024-04-25T22:42:46.731 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.731 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.731 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:46.731 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486677+0000", 2024-04-25T22:42:46.731 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0305e-05 2024-04-25T22:42:46.732 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.732 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:46.732 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486683+0000", 2024-04-25T22:42:46.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.5300000000000004e-06 2024-04-25T22:42:46.732 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.732 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.732 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486768+0000", 2024-04-25T22:42:46.732 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.5725999999999999e-05 2024-04-25T22:42:46.732 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.732 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.732 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:46.732 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486905+0000", 2024-04-25T22:42:46.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013696699999999999 2024-04-25T22:42:46.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:46.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.487121+0000", 2024-04-25T22:42:46.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00021615299999999999 2024-04-25T22:42:46.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:46.733 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.509675+0000", 2024-04-25T22:42:46.733 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022553225999999999 2024-04-25T22:42:46.733 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.733 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.733 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:46.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536355+0000", 2024-04-25T22:42:46.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.026680855 2024-04-25T22:42:46.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:46.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536401+0000", 2024-04-25T22:42:46.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 4.5649000000000003e-05 2024-04-25T22:42:46.734 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.734 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.734 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:46.734 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.536466+0000", 2024-04-25T22:42:46.734 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4438999999999997e-05 2024-04-25T22:42:46.734 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.735 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.735 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.735 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.735 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.735 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13329 4.26 4:64e005a2:::10000003483.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:46.735 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:46.735 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.138476520000001, 2024-04-25T22:42:46.735 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.066502845000000005, 2024-04-25T22:42:46.735 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:46.735 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:46.735 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:46.735 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:46.736 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:46.736 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:46.736 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13329 2024-04-25T22:42:46.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.736 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:46.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:46.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:46.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.736 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.736 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.736 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:46.736 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486701+0000", 2024-04-25T22:42:46.736 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:46.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.486703+0000", 2024-04-25T22:42:46.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3909999999999999e-06 2024-04-25T22:42:46.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:46.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494612+0000", 2024-04-25T22:42:46.737 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.0079096670000000004 2024-04-25T22:42:46.737 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.737 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.737 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:46.737 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494626+0000", 2024-04-25T22:42:46.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3263e-05 2024-04-25T22:42:46.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:46.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494637+0000", 2024-04-25T22:42:46.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.171e-05 2024-04-25T22:42:46.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.738 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.738 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494720+0000", 2024-04-25T22:42:46.738 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 8.2767000000000002e-05 2024-04-25T22:42:46.738 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.738 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:46.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494834+0000", 2024-04-25T22:42:46.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00011387699999999999 2024-04-25T22:42:46.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:46.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.494998+0000", 2024-04-25T22:42:46.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00016390799999999999 2024-04-25T22:42:46.739 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.739 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.739 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:46.739 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.517407+0000", 2024-04-25T22:42:46.739 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.022409068000000001 2024-04-25T22:42:46.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:46.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553040+0000", 2024-04-25T22:42:46.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.035633155 2024-04-25T22:42:46.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:46.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553140+0000", 2024-04-25T22:42:46.740 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9623000000000005e-05 2024-04-25T22:42:46.740 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.740 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.740 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:46.740 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.553204+0000", 2024-04-25T22:42:46.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 6.4416000000000001e-05 2024-04-25T22:42:46.741 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.741 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.741 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.741 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.741 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.741 INFO:teuthology.orchestra.run.smithi188.stdout: "description": "osd_op(client.4529.0:13399 4.16 4:6bb7cc3a:::10000003648.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-25T22:42:46.741 INFO:teuthology.orchestra.run.smithi188.stdout: "initiated_at": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:46.741 INFO:teuthology.orchestra.run.smithi188.stdout: "age": 30.06511072, 2024-04-25T22:42:46.741 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.045625003999999997, 2024-04-25T22:42:46.741 INFO:teuthology.orchestra.run.smithi188.stdout: "continuous": false, 2024-04-25T22:42:46.741 INFO:teuthology.orchestra.run.smithi188.stdout: "type_data": { 2024-04-25T22:42:46.741 INFO:teuthology.orchestra.run.smithi188.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:42:46.741 INFO:teuthology.orchestra.run.smithi188.stdout: "client_info": { 2024-04-25T22:42:46.742 INFO:teuthology.orchestra.run.smithi188.stdout: "client": "client.4529", 2024-04-25T22:42:46.742 INFO:teuthology.orchestra.run.smithi188.stdout: "client_addr": "192.168.0.1:0/225458868", 2024-04-25T22:42:46.742 INFO:teuthology.orchestra.run.smithi188.stdout: "tid": 13399 2024-04-25T22:42:46.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.742 INFO:teuthology.orchestra.run.smithi188.stdout: "events": [ 2024-04-25T22:42:46.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "initiated", 2024-04-25T22:42:46.742 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:46.742 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.742 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.742 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.742 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "header_read", 2024-04-25T22:42:46.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560067+0000", 2024-04-25T22:42:46.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0 2024-04-25T22:42:46.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "throttled", 2024-04-25T22:42:46.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.560068+0000", 2024-04-25T22:42:46.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.1069999999999999e-06 2024-04-25T22:42:46.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.743 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.743 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "all_read", 2024-04-25T22:42:46.743 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576902+0000", 2024-04-25T22:42:46.743 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016833806 2024-04-25T22:42:46.743 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "dispatched", 2024-04-25T22:42:46.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576916+0000", 2024-04-25T22:42:46.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.3648e-05 2024-04-25T22:42:46.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "queued_for_pg", 2024-04-25T22:42:46.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.576927+0000", 2024-04-25T22:42:46.744 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 1.0992000000000001e-05 2024-04-25T22:42:46.744 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.744 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.744 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "reached_pg", 2024-04-25T22:42:46.744 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577026+0000", 2024-04-25T22:42:46.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 9.9116000000000004e-05 2024-04-25T22:42:46.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "started", 2024-04-25T22:42:46.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577203+0000", 2024-04-25T22:42:46.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00017700499999999999 2024-04-25T22:42:46.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.745 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "waiting for subops from 0", 2024-04-25T22:42:46.745 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.577336+0000", 2024-04-25T22:42:46.745 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00013340800000000001 2024-04-25T22:42:46.745 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.745 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "op_commit", 2024-04-25T22:42:46.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.589077+0000", 2024-04-25T22:42:46.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.011741151 2024-04-25T22:42:46.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:42:46.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605436+0000", 2024-04-25T22:42:46.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.016359146000000001 2024-04-25T22:42:46.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.746 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.746 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "commit_sent", 2024-04-25T22:42:46.746 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605493+0000", 2024-04-25T22:42:46.746 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 5.7067000000000001e-05 2024-04-25T22:42:46.746 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-04-25T22:42:46.747 INFO:teuthology.orchestra.run.smithi188.stdout: { 2024-04-25T22:42:46.747 INFO:teuthology.orchestra.run.smithi188.stdout: "event": "done", 2024-04-25T22:42:46.747 INFO:teuthology.orchestra.run.smithi188.stdout: "time": "2024-04-25T22:42:16.605692+0000", 2024-04-25T22:42:46.747 INFO:teuthology.orchestra.run.smithi188.stdout: "duration": 0.00019855799999999999 2024-04-25T22:42:46.747 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.747 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.747 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.747 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-04-25T22:42:46.747 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-04-25T22:42:46.747 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-04-25T22:42:48.590 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:42:48.968 INFO:teuthology.orchestra.run.smithi057.stderr:noscrub is unset 2024-04-25T22:42:48.993 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:42:50.026 INFO:teuthology.orchestra.run.smithi057.stderr:nodeep-scrub is unset 2024-04-25T22:42:51.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~76s 2024-04-25T22:42:57.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~82s 2024-04-25T22:43:03.178 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~88s 2024-04-25T22:43:08.986 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~94s 2024-04-25T22:43:14.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~100s 2024-04-25T22:43:20.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~105s 2024-04-25T22:43:26.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~111s 2024-04-25T22:43:32.214 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~117s 2024-04-25T22:43:38.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~123s 2024-04-25T22:43:43.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~129s 2024-04-25T22:43:49.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~134s 2024-04-25T22:43:55.438 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~140s 2024-04-25T22:44:01.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~146s 2024-04-25T22:44:07.049 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~152s 2024-04-25T22:44:12.856 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~158s 2024-04-25T22:44:16.674 DEBUG:teuthology.orchestra.console.smithi148:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 72 57 GUID: 00000000 0000 0000 0000 0CC47ADA6AA4 DHCP.\                    DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.-  21.15.148 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.148 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:72:57)... Configuring (net0 0c:c4:7a:88:72:57).... Configuring (net0 0c:c4:7a:88:72:57)..... Configuring (net0 0c:c4:7a:88:72:57)...... ok     *  *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 5s.  GNU GRUB version 2.04  ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-105-generic ... Loading initial ramdisk ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-105-generic (buildd@lcy02-amd64-007) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #115-Ubuntu SMP Mon Apr 15 09:52:04 UTC 2024 (Ubuntu 5.15.0-105.115-generic 5.15.148) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.853 MHz processor [ 0.000417] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000597] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001922] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.008141] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.008155] Using GB pages for direct mapping [ 0.008288] RAMDISK: [mem 0x300d1000-0x3405ffff] [ 0.008294] ACPI: Early table checksum verification disabled [ 0.008297] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.008301] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.008306] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008311] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008314] ACPI: FACS 0x0000000079D43F80 000040 [ 0.008317] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008320] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008322] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008325] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008328] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008331] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008334] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008336] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008339] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008342] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008345] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008348] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008350] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008353] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008356] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008359] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008362] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008364] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008367] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.008368] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.008369] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.008370] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.008371] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.008372] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.008373] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.008374] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.008375] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.008376] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.008377] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.008378] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.008379] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.008380] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.008381] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.008382] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.008383] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.008384] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.008385] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.008386] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.008387] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.008482] No NUMA configuration found [ 0.008483] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008492] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.008821] Zone ranges: [ 0.008822] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008824] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008825] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008827] Device empty [ 0.008828] Movable zone start for each node [ 0.008831] Early memory node ranges [ 0.008831] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.008833] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.008834] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008838] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.008843] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.008878] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.080433] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.080546] ACPI: PM-Timer IO Port: 0x408 [ 0.080554] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.080556] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.080557] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.080558] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.080559] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.080560] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.080560] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.080561] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.080571] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.080576] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.080578] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.080580] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.080584] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.080585] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.080590] TSC deadline timer available [ 0.080591] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.080601] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.080603] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.080604] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.080605] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.080606] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.080607] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.080608] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.080609] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.080610] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.080611] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.080612] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.080614] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.080615] Booting paravirtualized kernel on bare hardware [ 0.080617] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.080624] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.080835] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u262144 [ 0.080867] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.080868] Policy zone: Normal [ 0.080870] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.080928] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic", will be passed to user space. [ 0.083082] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.084231] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.084322] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.170482] Memory: 32672724K/33438012K available (16393K kernel code, 4395K rwdata, 10948K rodata, 3352K init, 18716K bss, 765028K reserved, 0K cma-reserved) [ 0.170767] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.170783] Kernel/User page tables isolation: enabled [ 0.170814] ftrace: allocating 50694 entries in 199 pages [ 0.190610] ftrace: allocated 199 pages with 5 groups [ 0.190726] rcu: Hierarchical RCU implementation. [ 0.190728] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.190729] Rude variant of Tasks RCU enabled. [ 0.190730] Tracing variant of Tasks RCU enabled. [ 0.190731] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.190732] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.194152] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.194351] random: crng init done [ 0.199212] Console: colour VGA+ 80x25 [ 0.210609] printk: console [tty0] enabled [ 1.197581] printk: console [ttyS1] enabled [ 1.201838] ACPI: Core revision 20210730 [ 1.206000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.215231] APIC: Switch to symmetric I/O mode setup [ 1.220268] DMAR: Host address width 46 [ 1.224179] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.230654] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.238749] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.245088] DMAR: ATSR flags: 0x0 [ 1.248469] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.254803] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.261226] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.267648] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.273116] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.273117] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.288300] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.293676] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.299972] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.323235] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3272c5ab12b, max_idle_ns: 440795224465 ns [ 1.333849] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.70 BogoMIPS (lpj=13999412) [ 1.337865] CPU0: Thermal monitoring enabled (TM1) [ 1.341900] process: using mwait in idle threads [ 1.345848] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.349847] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.353848] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.357847] Spectre V2 : Mitigation: Retpolines [ 1.361847] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.365847] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.369847] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.373848] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.377847] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.381847] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.385851] MDS: Mitigation: Clear CPU buffers [ 1.389847] TAA: Mitigation: Clear CPU buffers [ 1.393847] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.397852] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.401847] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.405847] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.409847] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.413847] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.435540] Freeing SMP alternatives memory: 44K [ 1.437848] pid_max: default: 32768 minimum: 301 [ 1.441868] LSM: Security Framework initializing [ 1.445855] landlock: Up and running. [ 1.449847] Yama: becoming mindful. [ 1.453864] AppArmor: AppArmor initialized [ 1.457908] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.461887] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.466202] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.469852] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.473953] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.477848] ... version: 3 [ 1.481847] ... bit width: 48 [ 1.485847] ... generic registers: 4 [ 1.489847] ... value mask: 0000ffffffffffff [ 1.493847] ... max period: 00007fffffffffff [ 1.497847] ... fixed-purpose events: 3 [ 1.501847] ... event mask: 000000070000000f [ 1.505907] signal: max sigframe size: 1776 [ 1.509861] rcu: Hierarchical SRCU implementation. [ 1.514560] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.517911] smp: Bringing up secondary CPUs ... [ 1.521928] x86: Booting SMP configuration: [ 1.525849] .... node #0, CPUs: #1 #2 #3 #4 [ 1.533928] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.541847] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.545847] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.549945] #5 #6 #7 [ 1.550401] smp: Brought up 1 node, 8 CPUs [ 1.557849] smpboot: Max logical packages: 1 [ 1.561847] smpboot: Total of 8 processors activated (55997.64 BogoMIPS) [ 1.570199] devtmpfs: initialized [ 1.573261] x86/mm: Memory block size: 128MB [ 1.575448] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.577923] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.581858] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.585894] pinctrl core: initialized pinctrl subsystem [ 1.589937] PM: RTC time: 22:43:51, date: 2024-04-25 [ 1.593953] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.598180] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.602145] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.606180] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.609857] audit: initializing netlink subsys (disabled) [ 1.613866] audit: type=2000 audit(1714085030.356:1): state=initialized audit_enabled=0 res=1 [ 1.613964] thermal_sys: Registered thermal governor 'fair_share' [ 1.617849] thermal_sys: Registered thermal governor 'bang_bang' [ 1.621847] thermal_sys: Registered thermal governor 'step_wise' [ 1.625847] thermal_sys: Registered thermal governor 'user_space' [ 1.629847] thermal_sys: Registered thermal governor 'power_allocator' [ 1.633852] EISA bus registered [ 1.641063] cpuidle: using governor ladder [ 1.641849] cpuidle: using governor menu [ 1.645863] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.649848] ACPI: bus type PCI registered [ 1.653848] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.657903] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.661849] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.665860] PCI: Using configuration type 1 for base access [ 1.670874] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.673863] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.677848] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.681921] ACPI: Added _OSI(Module Device) [ 1.685849] ACPI: Added _OSI(Processor Device) [ 1.689855] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.693847] ACPI: Added _OSI(Processor Aggregator Device) [ 1.697847] ACPI: Added _OSI(Linux-Dell-Video) [ 1.701847] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.705847] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.756605] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.761176] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.765997] ACPI: Dynamic OEM Table Load: [ 1.797822] ACPI: Interpreter enabled [ 1.797858] ACPI: PM: (supports S0 S4 S5) [ 1.801848] ACPI: Using IOAPIC for interrupt routing [ 1.805870] HEST: Enabling Firmware First mode for corrected errors. [ 1.809927] HEST: Table parsing has been initialized. [ 1.813998] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.817849] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.821847] PCI: Using E820 reservations for host bridge windows [ 1.826538] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.863163] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.865850] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.871839] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.874900] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.877847] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.881880] PCI host bridge to bus 0000:ff [ 1.885848] pci_bus 0000:ff: root bus resource [bus ff] [ 1.889857] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.893912] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.897901] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.901899] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.905900] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.909901] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.913898] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.917899] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.921903] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.925897] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.929899] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.933898] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.937899] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.941899] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.945899] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.949900] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.953902] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.957898] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.961898] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.965872] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.969908] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.973949] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.977911] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.981911] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.985914] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.989912] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.993909] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.997902] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 2.001901] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 2.005913] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 2.009911] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 2.013912] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.017912] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.021900] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.025900] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.029900] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.033902] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.037911] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.041911] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.045912] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.049915] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.053904] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.057901] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.061902] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.065904] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.069901] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.073901] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.077900] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.081906] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.085903] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.089899] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.093900] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.097873] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.101901] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.105899] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.114307] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.117850] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.122188] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.126319] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.129847] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.134139] PCI host bridge to bus 0000:00 [ 2.137848] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.141847] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.145847] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.149847] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.153847] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.157847] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.161847] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.165954] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.170058] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.173912] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.178019] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.181912] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.186014] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.189912] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.194007] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.197866] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.202042] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.205866] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.210039] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.213866] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.218040] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.221866] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.226039] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.229866] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.234042] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.237866] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.242039] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.245866] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.250039] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.253866] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.257992] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.262068] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.265996] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.270017] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.273861] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.278087] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.282140] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.285869] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.289858] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.293858] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.297858] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.301858] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.305858] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.309887] pci 0000:00:11.4: PME# supported from D3hot [ 2.314002] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.317873] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.321923] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.325995] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.329873] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.333924] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.337992] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.341873] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.345924] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.350006] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.353870] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.357951] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.362008] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.365936] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.370010] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.373939] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.378007] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.381939] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.386017] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.389870] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.393951] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.398004] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.402120] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.405866] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.409857] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.413857] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.417857] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.421857] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.425857] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.429881] pci 0000:00:1f.2: PME# supported from D3hot [ 2.433990] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.437872] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.441878] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.446062] acpiphp: Slot [1] registered [ 2.449864] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.454027] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.457867] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.461889] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.465850] pci 0000:02:00.0: enabling Extended Tags [ 2.469952] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.473849] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.478029] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.481869] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.485856] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.489869] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.493857] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.497888] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.501868] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.505847] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.509860] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.513847] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.518010] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.521869] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.525856] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.529869] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.533856] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.537887] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.541864] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.545847] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.549860] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.553848] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.557980] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.561848] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.565848] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.569848] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.573878] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.577914] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.581935] pci 0000:05:00.0: enabling Extended Tags [ 2.585924] pci 0000:05:00.0: supports D1 D2 [ 2.589847] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.593952] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.597849] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.601848] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.605895] pci_bus 0000:06: extended config space not accessible [ 2.609877] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.613880] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.617864] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.621864] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.625931] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.629889] pci 0000:06:00.0: supports D1 D2 [ 2.633847] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.637955] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.641853] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.645850] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.649948] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.653874] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.657875] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.661861] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.665981] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.669885] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.673848] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.677873] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.681847] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.686021] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.689874] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.693875] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.697861] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.701976] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.705884] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.709847] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.713873] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.717847] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.722001] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.725849] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.729848] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.733851] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.738760] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.741898] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.745895] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.749896] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.753896] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.757848] ACPI: PCI: Interrupt link LNKE disabled [ 2.761896] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.765847] ACPI: PCI: Interrupt link LNKF disabled [ 2.769895] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.773847] ACPI: PCI: Interrupt link LNKG disabled [ 2.777897] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.781847] ACPI: PCI: Interrupt link LNKH disabled [ 2.786035] iommu: Default domain type: Translated [ 2.789848] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.793973] SCSI subsystem initialized [ 2.797859] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.801846] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.801847] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.805847] vgaarb: loaded [ 2.808634] ACPI: bus type USB registered [ 2.809857] usbcore: registered new interface driver usbfs [ 2.813851] usbcore: registered new interface driver hub [ 2.817852] usbcore: registered new device driver usb [ 2.821862] pps_core: LinuxPPS API ver. 1 registered [ 2.825847] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.829850] PTP clock support registered [ 2.833861] EDAC MC: Ver: 3.0.0 [ 2.837156] NetLabel: Initializing [ 2.837848] NetLabel: domain hash size = 128 [ 2.841847] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.845858] NetLabel: unlabeled traffic allowed by default [ 2.849856] PCI: Using ACPI for IRQ routing [ 2.859055] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.861848] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.867887] clocksource: Switched to clocksource tsc-early [ 2.880086] VFS: Disk quotas dquot_6.6.0 [ 2.884092] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.891128] AppArmor: AppArmor Filesystem Enabled [ 2.895928] pnp: PnP ACPI init [ 2.899516] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.905502] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.911491] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.917482] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.923469] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.929457] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.935438] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.942123] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.948805] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.955486] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.962168] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.968852] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.975535] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.982427] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.988412] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.994402] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 3.000391] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.006379] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.013327] pnp: PnP ACPI: found 5 devices [ 3.022878] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.031874] NET: Registered PF_INET protocol family [ 3.036987] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.046278] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.055098] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.063095] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.071504] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.079041] TCP: Hash tables configured (established 262144 bind 65536) [ 3.085867] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.093649] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.100675] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.108131] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.113858] NET: Registered PF_XDP protocol family [ 3.118736] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.130309] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.138224] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.143265] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.148300] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.155168] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.162821] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.170821] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.178560] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.186647] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.194299] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.202300] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.210038] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.218128] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.225778] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.233778] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.241518] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.249604] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.257256] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.265260] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.272998] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.281084] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.286114] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.292274] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.299128] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.306963] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.312011] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.317038] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.323203] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.330076] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.335370] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.341530] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.348395] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.356224] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.364146] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.371982] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.379902] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.384929] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.391091] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.397946] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.413507] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.419755] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.426004] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.432948] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.439890] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.446834] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.453776] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.460110] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.465751] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.472081] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.479388] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.485025] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.491355] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.496999] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.503333] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.508973] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.515302] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.522821] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 3.551606] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 20987 usecs [ 3.583659] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 23979 usecs [ 3.591155] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.597709] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.597718] Trying to unpack rootfs image as initramfs... [ 3.604213] software IO TLB: mapped [mem 0x0000000074ec6000-0x0000000078ec6000] (64MB) [ 3.618180] Initialise system trusted keyrings [ 3.622699] Key type blacklist registered [ 3.626828] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.634301] zbud: loaded [ 3.637102] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 3.643179] fuse: init (API version 7.34) [ 3.647412] integrity: Platform Keyring initialized [ 3.660203] Key type asymmetric registered [ 3.664374] Asymmetric key parser 'x509' registered [ 3.669344] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 3.676886] io scheduler mq-deadline registered [ 3.681923] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.687970] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.693998] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.699965] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.705939] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.711902] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.717873] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.724788] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.730538] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.739012] ACPI: button: Power Button [PWRB] [ 3.743478] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.750997] ACPI: button: Power Button [PWRF] [ 3.756697] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.764271] pstore: Registered erst as persistent store backend [ 3.770392] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 3.797324] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.826251] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.835879] Linux agpgart interface v0.103 [ 3.841702] loop: module loaded [ 3.845139] tun: Universal TUN/TAP device driver, 1.6 [ 3.850284] PPP generic driver version 2.4.2 [ 3.854673] VFIO - User Level meta-driver version: 0.3 [ 3.859971] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.866568] ehci-pci: EHCI PCI platform driver [ 3.871232] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.876534] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.884029] ehci-pci 0000:00:1a.0: debug port 2 [ 3.892537] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.911538] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.917395] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.925754] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.933064] usb usb1: Product: EHCI Host Controller [ 3.938013] usb usb1: Manufacturer: Linux 5.15.0-105-generic ehci_hcd [ 3.944526] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.949363] hub 1-0:1.0: USB hub found [ 3.951626] Freeing initrd memory: 65084K [ 3.953195] hub 1-0:1.0: 2 ports detected [ 3.961603] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.966897] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 3.974392] ehci-pci 0000:00:1d.0: debug port 2 [ 3.982895] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.003574] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.009433] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.017784] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.025088] usb usb2: Product: EHCI Host Controller [ 4.030031] usb usb2: Manufacturer: Linux 5.15.0-105-generic ehci_hcd [ 4.036535] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.041334] hub 2-0:1.0: USB hub found [ 4.045148] hub 2-0:1.0: 2 ports detected [ 4.049337] ehci-platform: EHCI generic platform driver [ 4.054645] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.060892] ohci-pci: OHCI PCI platform driver [ 4.065421] ohci-platform: OHCI generic platform driver [ 4.070714] uhci_hcd: USB Universal Host Controller Interface driver [ 4.077180] i8042: PNP: No PS/2 controller found. [ 4.082013] mousedev: PS/2 mouse device common for all mice [ 4.087726] rtc_cmos 00:00: RTC can wake from S4 [ 4.092628] rtc_cmos 00:00: registered as rtc0 [ 4.097172] rtc_cmos 00:00: setting system clock to 2024-04-25T22:43:55 UTC (1714085035) [ 4.105376] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.112147] i2c_dev: i2c /dev entries driver [ 4.116653] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.128930] device-mapper: uevent: version 1.0.3 [ 4.133675] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.142213] platform eisa.0: Probing EISA bus 0 [ 4.146806] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.153658] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.160164] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.166675] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.173184] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.179692] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.186200] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.192711] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.199219] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.205729] platform eisa.0: EISA: Detected 0 cards [ 4.210681] intel_pstate: Intel P-state driver initializing [ 4.217357] ledtrig-cpu: registered to indicate activity on CPUs [ 4.223580] drop_monitor: Initializing network drop monitor service [ 4.230022] NET: Registered PF_INET6 protocol family [ 4.241103] Segment Routing with IPv6 [ 4.244839] In-situ OAM (IOAM) with IPv6 [ 4.248840] NET: Registered PF_PACKET protocol family [ 4.254015] Key type dns_resolver registered [ 4.258800] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.264787] microcode: Microcode Update Driver: v2.2. [ 4.264857] resctrl: L3 allocation detected [ 4.274221] resctrl: L3 monitoring detected [ 4.278472] IPI shorthand broadcast: enabled [ 4.282824] sched_clock: Marking stable (3219307687, 1063501700)->(5271999093, -989189706) [ 4.291423] registered taskstats version 1 [ 4.295714] Loading compiled-in X.509 certificates [ 4.299545] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.301122] Loaded X.509 cert 'Build time autogenerated kernel key: 2031b00138f148c9752e8bea71b9285d2b2af682' [ 4.317640] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.328145] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.338235] blacklist: Loading compiled-in revocation X.509 certificates [ 4.345015] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.354935] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.365468] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.376346] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.386876] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.397658] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.399571] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.415068] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.425870] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.437637] zswap: loaded using pool lzo/zbud [ 4.442324] Key type .fscrypt registered [ 4.446311] Key type fscrypt-provisioning registered [ 4.451431] pstore: Using crash dump compression: deflate [ 4.458988] Key type encrypted registered [ 4.463066] AppArmor: AppArmor sha1 policy hashing enabled [ 4.468626] ima: No TPM chip found, activating TPM-bypass! [ 4.472089] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.481975] Loading compiled-in module X.509 certificates [ 4.482441] Loaded X.509 cert 'Build time autogenerated kernel key: 2031b00138f148c9752e8bea71b9285d2b2af682' [ 4.490262] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.495740] ima: Allocated hash algorithm: sha1 [ 4.495745] ima: No architecture policies found [ 4.506010] hub 1-1:1.0: USB hub found [ 4.512990] evm: Initialising EVM extended attributes: [ 4.517720] hub 1-1:1.0: 6 ports detected [ 4.522183] evm: security.selinux [ 4.522185] evm: security.SMACK64 [ 4.522186] evm: security.SMACK64EXEC [ 4.522186] evm: security.SMACK64TRANSMUTE [ 4.522186] evm: security.SMACK64MMAP [ 4.522187] evm: security.apparmor [ 4.557151] evm: security.ima [ 4.559833] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.560185] evm: security.capability [ 4.568451] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.572104] evm: HMAC attrs: 0x1 [ 4.572373] PM: Magic number: 4:885:755 [ 4.582873] hub 2-1:1.0: USB hub found [ 4.586700] PM: hash matches drivers/base/power/main.c:979 [ 4.586726] tty ttyS6: hash matches [ 4.596465] hub 2-1:1.0: 8 ports detected [ 4.599885] pci 0000:ff:1e.4: hash matches [ 4.608184] acpi LNXCPU:4d: hash matches [ 4.612418] RAS: Correctable Errors collector initialized. [ 4.618917] Freeing unused decrypted memory: 2036K [ 4.624240] Freeing unused kernel image (initmem) memory: 3352K [ 4.643571] Write protecting the kernel read-only data: 30720k [ 4.647513] tsc: Refined TSC clocksource calibration: 3499.997 MHz [ 4.655734] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734e5ebc4, max_idle_ns: 440795265422 ns [ 4.665887] clocksource: Switched to clocksource tsc [ 4.671198] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 4.678115] Freeing unused kernel image (rodata/data gap) memory: 1340K [ 4.723647] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.730154] x86/mm: Checking user space page tables [ 4.772391] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.778899] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 4.927019] dca service started, version 1.12.1 [ 4.935114] nvme nvme0: pci function 0000:02:00.0 [ 4.940235] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.942838] nvme nvme0: 8/0/0 default/read/poll queues [ 4.948702] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.962355] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.967719] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.976250] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.985666] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.990957] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.995818] scsi host0: ahci [ 4.998442] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 5.001528] scsi host1: ahci [ 5.007747] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 5.010787] scsi host2: ahci [ 5.019019] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.019956] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 5.021244] i2c i2c-0: 2/8 memory slots populated (from DMI) [ 5.021246] i2c i2c-0: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 5.023264] scsi host3: ahci [ 5.029285] usb usb3: Product: xHCI Host Controller [ 5.035254] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 34 [ 5.040932] usb usb3: Manufacturer: Linux 5.15.0-105-generic xhci-hcd [ 5.050243] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 34 [ 5.053189] usb usb3: SerialNumber: 0000:00:14.0 [ 5.058137] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 34 [ 5.065743] hub 3-0:1.0: USB hub found [ 5.072131] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 34 [ 5.079646] hub 3-0:1.0: 15 ports detected [ 5.084607] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.094911] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 5.095601] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.103077] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.131594] igb: Intel(R) Gigabit Ethernet Network Driver [ 5.138864] usb usb4: Product: xHCI Host Controller [ 5.144327] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.149272] usb usb4: Manufacturer: Linux 5.15.0-105-generic xhci-hcd [ 5.149459] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.149460] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.171900] scsi host4: ahci [ 5.173427] usb usb4: SerialNumber: 0000:00:14.0 [ 5.176489] scsi host5: ahci [ 5.181142] hub 4-0:1.0: USB hub found [ 5.184114] scsi host6: ahci [ 5.187882] hub 4-0:1.0: 6 ports detected [ 5.190927] scsi host7: ahci [ 5.198008] scsi host8: ahci [ 5.201106] scsi host9: ahci [ 5.204105] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 44 [ 5.210987] igb 0000:07:00.0: added PHC on eth0 [ 5.211593] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 44 [ 5.216210] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.223671] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 44 [ 5.230609] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:da:6a:a4 [ 5.238108] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 44 [ 5.245398] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.252830] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 44 [ 5.258052] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.265541] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 44 [ 5.330418] igb 0000:07:00.1: added PHC on eth1 [ 5.335031] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.341977] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:da:6a:a5 [ 5.349275] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.354478] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.398244] ata4: SATA link down (SStatus 0 SControl 300) [ 5.403736] ata3: SATA link down (SStatus 0 SControl 300) [ 5.409240] ata2: SATA link down (SStatus 0 SControl 300) [ 5.414730] ata1: SATA link down (SStatus 0 SControl 300) [ 5.431591] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.587809] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.594432] ata10: SATA link down (SStatus 0 SControl 300) [ 5.596182] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.601767] ata9: SATA link down (SStatus 0 SControl 300) [ 5.609513] hub 3-12:1.0: USB hub found [ 5.614569] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.624730] hub 3-12:1.0: 4 ports detected [ 5.624752] ata7: SATA link down (SStatus 0 SControl 300) [ 5.634407] ata8: SATA link down (SStatus 0 SControl 300) [ 5.639908] ata6: SATA link down (SStatus 0 SControl 300) [ 5.729098] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.735968] ata5.00: NCQ Send/Recv Log not supported [ 5.741013] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.749513] ata5.00: NCQ Send/Recv Log not supported [ 5.754572] ata5.00: configured for UDMA/133 [ 5.759170] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.767673] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.767869] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.780844] sd 4:0:0:0: [sda] Write Protect is off [ 5.785724] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.806666] sda: sda1 [ 5.809320] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.815605] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.835964] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.939565] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 6.071934] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 6.080489] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.096088] hid: raw HID events driver (C) Jiri Kosina [ 6.104030] usbcore: registered new interface driver usbhid [ 6.109681] usbhid: USB HID core driver [ 6.115260] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.183753] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.195748] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.215572] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.340116] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.350499] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.359111] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.365364] ixgbe 0000:03:00.0: 0c:c4:7a:88:72:56 [ 6.373356] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 6.543978] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.554362] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.562969] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.570086] ixgbe 0000:03:00.1: 0c:c4:7a:88:72:57 [ 6.578065] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.585905] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 6.612325] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: clean, 198138/61054976 files, 6506324/244190336 blocks done. [ 6.786984] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 7.612974] systemd[1]: Inserted module 'autofs4' [ 7.696968] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 7.747705] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 7.792645] systemd[1]: Hostname set to . [ 9.127648] systemd[1]: Queued start job for default target Graphical Interface. [ 9.137734] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 9.160473] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 9.184344] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 9.207733] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 9.227768] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 9.251967] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 9.279702] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 9.307690] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 9.335654] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 9.363678] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 9.391643] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 9.419648] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 9.447743] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 9.471690] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 9.491678] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 9.515792] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 9.539895] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 9.566111] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 9.591923] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 9.611865] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 9.635769] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 9.660086] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 9.679896] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 9.699919] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 9.720026] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 9.743939] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 9.763896] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 9.785358] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 9.805247] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 9.829105] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 9.853310] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 9.874665] systemd[1]: Mounting Kernel Trace File System... [ 9.878176] RPC: Registered named UNIX socket transport module. [ 9.886397] RPC: Registered udp transport module. [ 9.886398] RPC: Registered tcp transport module. [ 9.886398] RPC: Registered tcp NFSv4.1 backchannel transport module. Mounting Kernel Trace File System... [ 9.918901] systemd[1]: Starting Journal Service... Starting Journal Service... [ 9.939733] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 9.950393] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 9.962981] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 9.972578] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 9.996364] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 10.024398] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 10.048451] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 10.068459] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 10.088710] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 10.112331] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 10.132434] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 10.156497] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 10.180562] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 10.199568] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 10.209325] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 10.219670] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 10.240315] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 10.261661] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. [ 10.271053] systemd[1]: Starting Coldplug All udev Devices... Starting Coldplug All udev Devices... [ 10.293531] systemd[1]: Started Journal Service. [ OK [[ 10.298371] lp: driver loaded but no devices found 0m] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ 10.325651] Loading iSCSI transport class v2.0-870. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... [ 10.663523] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... Starting Load/Save Random Seed... [ 10.765941] systemd-journald[360]: Received client request to flush runtime journal. Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Finished Flush Journal to Persistent Storage. Starting Create Volatile Files and Directories... [ OK ] Finished Create Volatile Files and Directories. [ OK ] Finished Load AppArmor profiles. Mounting RPC Pipe File System... Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... Starting RPC bind portmap service... Starting Record System Boot/Shutdown in UTMP... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Mounted RPC Pipe File System. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Reached target rpc_pipefs.target. Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target NFS client services. Starting Network Configuration... [ OK ] Started pNFS block layout mapping daemon. [ OK ] Found device /dev/ttyS1. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Started RPC bind portmap service. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. [ OK ] Listening on UUID daemon activation socket. Mounting /var/lib/ceph... Starting LVM event activation on device 259:0... [ OK ] Started Network Configuration. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Listening on Docker Socket for the API. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting Dispatcher daemon for systemd-networkd... [ OK ] Started ntp-systemd-netif.service. Starting RPC Remote Quota Server... Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Finished Helper to synchronize boot up for ifupdown. [ OK ] Found device 82599ES 10-Gi…ork Connection (AOC-STGN-i2S). [ OK ] Started ifup for enp3s0f1. Starting Raise network interfaces... [ OK ] Started RPC Remote Quota Server. [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Started System Logging Service. [ OK ] Finished GRUB failed boot detection. [ OK ] Started User Login Management. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started ntp-systemd-netif.service. Starting Authorization Manager... [ OK ] Finished Wait for Network to be Configured. [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting NFS status monitor for NFSv2/3 locking.... Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. + myips=172.21.15.148 + attempts=1 + sleep 1 [ OK ] Started Network Time Service. [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Dispatcher daemon for systemd-networkd. [ OK ] Finished Ubuntu FAN network setup. + '[' 172.21.15.148 '!=' '' ']' + set -e + '[' -n 172.21.15.148 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.148 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.148 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi148.front.sepia.ceph.com + '[' -n smithi148.front.sepia.ceph.com ']' + hostname smithi148.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi148 + echo smithi148 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.148 smithi148.front.sepia.ceph.com smithi148/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. [ OK ] Started ntp-systemd-netif.service. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started Docker Application Container Engine. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Record Runlevel Change in UTMP... [ OK ] Finished Record Runlevel Change in UTMP. Ubuntu 22.04.1 LTS smithi148.front.sepia.ceph.com ttyS1 2024-04-25T22:44:16.675 DEBUG:teuthology.orchestra.console.smithi148:expect after: smithi148 login: 2024-04-25T22:44:16.727 DEBUG:teuthology.orchestra.console.smithi148:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 72 57 GUID: 00000000 0000 0000 0000 0CC47ADA6AA4 DHCP.\                    DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.-  21.15.148 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.148 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:72:57)... Configuring (net0 0c:c4:7a:88:72:57).... Configuring (net0 0c:c4:7a:88:72:57)..... Configuring (net0 0c:c4:7a:88:72:57)...... ok     *  *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 5s.  GNU GRUB version 2.04  ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-105-generic ... Loading initial ramdisk ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-105-generic (buildd@lcy02-amd64-007) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #115-Ubuntu SMP Mon Apr 15 09:52:04 UTC 2024 (Ubuntu 5.15.0-105.115-generic 5.15.148) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.853 MHz processor [ 0.000417] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000597] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001922] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.008141] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.008155] Using GB pages for direct mapping [ 0.008288] RAMDISK: [mem 0x300d1000-0x3405ffff] [ 0.008294] ACPI: Early table checksum verification disabled [ 0.008297] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.008301] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.008306] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008311] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008314] ACPI: FACS 0x0000000079D43F80 000040 [ 0.008317] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008320] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008322] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008325] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008328] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008331] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008334] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008336] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008339] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008342] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008345] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008348] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008350] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008353] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008356] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008359] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008362] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008364] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008367] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.008368] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.008369] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.008370] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.008371] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.008372] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.008373] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.008374] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.008375] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.008376] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.008377] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.008378] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.008379] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.008380] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.008381] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.008382] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.008383] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.008384] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.008385] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.008386] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.008387] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.008482] No NUMA configuration found [ 0.008483] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008492] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.008821] Zone ranges: [ 0.008822] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008824] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008825] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008827] Device empty [ 0.008828] Movable zone start for each node [ 0.008831] Early memory node ranges [ 0.008831] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.008833] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.008834] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008838] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.008843] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.008878] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.080433] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.080546] ACPI: PM-Timer IO Port: 0x408 [ 0.080554] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.080556] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.080557] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.080558] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.080559] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.080560] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.080560] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.080561] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.080571] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.080576] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.080578] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.080580] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.080584] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.080585] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.080590] TSC deadline timer available [ 0.080591] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.080601] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.080603] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.080604] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.080605] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.080606] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.080607] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.080608] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.080609] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.080610] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.080611] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.080612] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.080614] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.080615] Booting paravirtualized kernel on bare hardware [ 0.080617] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.080624] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.080835] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u262144 [ 0.080867] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.080868] Policy zone: Normal [ 0.080870] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.080928] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic", will be passed to user space. [ 0.083082] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.084231] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.084322] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.170482] Memory: 32672724K/33438012K available (16393K kernel code, 4395K rwdata, 10948K rodata, 3352K init, 18716K bss, 765028K reserved, 0K cma-reserved) [ 0.170767] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.170783] Kernel/User page tables isolation: enabled [ 0.170814] ftrace: allocating 50694 entries in 199 pages [ 0.190610] ftrace: allocated 199 pages with 5 groups [ 0.190726] rcu: Hierarchical RCU implementation. [ 0.190728] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.190729] Rude variant of Tasks RCU enabled. [ 0.190730] Tracing variant of Tasks RCU enabled. [ 0.190731] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.190732] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.194152] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.194351] random: crng init done [ 0.199212] Console: colour VGA+ 80x25 [ 0.210609] printk: console [tty0] enabled [ 1.197581] printk: console [ttyS1] enabled [ 1.201838] ACPI: Core revision 20210730 [ 1.206000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.215231] APIC: Switch to symmetric I/O mode setup [ 1.220268] DMAR: Host address width 46 [ 1.224179] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.230654] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.238749] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.245088] DMAR: ATSR flags: 0x0 [ 1.248469] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.254803] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.261226] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.267648] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.273116] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.273117] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.288300] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.293676] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.299972] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.323235] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3272c5ab12b, max_idle_ns: 440795224465 ns [ 1.333849] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.70 BogoMIPS (lpj=13999412) [ 1.337865] CPU0: Thermal monitoring enabled (TM1) [ 1.341900] process: using mwait in idle threads [ 1.345848] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.349847] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.353848] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.357847] Spectre V2 : Mitigation: Retpolines [ 1.361847] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.365847] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.369847] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.373848] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.377847] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.381847] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.385851] MDS: Mitigation: Clear CPU buffers [ 1.389847] TAA: Mitigation: Clear CPU buffers [ 1.393847] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.397852] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.401847] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.405847] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.409847] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.413847] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.435540] Freeing SMP alternatives memory: 44K [ 1.437848] pid_max: default: 32768 minimum: 301 [ 1.441868] LSM: Security Framework initializing [ 1.445855] landlock: Up and running. [ 1.449847] Yama: becoming mindful. [ 1.453864] AppArmor: AppArmor initialized [ 1.457908] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.461887] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.466202] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.469852] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.473953] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.477848] ... version: 3 [ 1.481847] ... bit width: 48 [ 1.485847] ... generic registers: 4 [ 1.489847] ... value mask: 0000ffffffffffff [ 1.493847] ... max period: 00007fffffffffff [ 1.497847] ... fixed-purpose events: 3 [ 1.501847] ... event mask: 000000070000000f [ 1.505907] signal: max sigframe size: 1776 [ 1.509861] rcu: Hierarchical SRCU implementation. [ 1.514560] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.517911] smp: Bringing up secondary CPUs ... [ 1.521928] x86: Booting SMP configuration: [ 1.525849] .... node #0, CPUs: #1 #2 #3 #4 [ 1.533928] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.541847] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.545847] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.549945] #5 #6 #7 [ 1.550401] smp: Brought up 1 node, 8 CPUs [ 1.557849] smpboot: Max logical packages: 1 [ 1.561847] smpboot: Total of 8 processors activated (55997.64 BogoMIPS) [ 1.570199] devtmpfs: initialized [ 1.573261] x86/mm: Memory block size: 128MB [ 1.575448] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.577923] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.581858] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.585894] pinctrl core: initialized pinctrl subsystem [ 1.589937] PM: RTC time: 22:43:51, date: 2024-04-25 [ 1.593953] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.598180] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.602145] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.606180] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.609857] audit: initializing netlink subsys (disabled) [ 1.613866] audit: type=2000 audit(1714085030.356:1): state=initialized audit_enabled=0 res=1 [ 1.613964] thermal_sys: Registered thermal governor 'fair_share' [ 1.617849] thermal_sys: Registered thermal governor 'bang_bang' [ 1.621847] thermal_sys: Registered thermal governor 'step_wise' [ 1.625847] thermal_sys: Registered thermal governor 'user_space' [ 1.629847] thermal_sys: Registered thermal governor 'power_allocator' [ 1.633852] EISA bus registered [ 1.641063] cpuidle: using governor ladder [ 1.641849] cpuidle: using governor menu [ 1.645863] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.649848] ACPI: bus type PCI registered [ 1.653848] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.657903] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.661849] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.665860] PCI: Using configuration type 1 for base access [ 1.670874] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.673863] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.677848] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.681921] ACPI: Added _OSI(Module Device) [ 1.685849] ACPI: Added _OSI(Processor Device) [ 1.689855] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.693847] ACPI: Added _OSI(Processor Aggregator Device) [ 1.697847] ACPI: Added _OSI(Linux-Dell-Video) [ 1.701847] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.705847] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.756605] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.761176] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.765997] ACPI: Dynamic OEM Table Load: [ 1.797822] ACPI: Interpreter enabled [ 1.797858] ACPI: PM: (supports S0 S4 S5) [ 1.801848] ACPI: Using IOAPIC for interrupt routing [ 1.805870] HEST: Enabling Firmware First mode for corrected errors. [ 1.809927] HEST: Table parsing has been initialized. [ 1.813998] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.817849] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.821847] PCI: Using E820 reservations for host bridge windows [ 1.826538] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.863163] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.865850] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.871839] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.874900] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.877847] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.881880] PCI host bridge to bus 0000:ff [ 1.885848] pci_bus 0000:ff: root bus resource [bus ff] [ 1.889857] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.893912] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.897901] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.901899] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.905900] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.909901] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.913898] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.917899] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.921903] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.925897] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.929899] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.933898] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.937899] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.941899] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.945899] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.949900] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.953902] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.957898] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.961898] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.965872] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.969908] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.973949] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.977911] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.981911] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.985914] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.989912] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.993909] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.997902] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 2.001901] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 2.005913] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 2.009911] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 2.013912] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.017912] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.021900] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.025900] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.029900] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.033902] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.037911] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.041911] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.045912] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.049915] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.053904] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.057901] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.061902] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.065904] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.069901] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.073901] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.077900] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.081906] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.085903] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.089899] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.093900] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.097873] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.101901] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.105899] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.114307] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.117850] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.122188] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.126319] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.129847] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.134139] PCI host bridge to bus 0000:00 [ 2.137848] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.141847] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.145847] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.149847] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.153847] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.157847] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.161847] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.165954] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.170058] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.173912] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.178019] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.181912] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.186014] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.189912] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.194007] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.197866] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.202042] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.205866] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.210039] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.213866] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.218040] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.221866] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.226039] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.229866] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.234042] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.237866] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.242039] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.245866] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.250039] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.253866] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.257992] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.262068] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.265996] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.270017] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.273861] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.278087] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.282140] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.285869] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.289858] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.293858] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.297858] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.301858] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.305858] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.309887] pci 0000:00:11.4: PME# supported from D3hot [ 2.314002] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.317873] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.321923] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.325995] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.329873] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.333924] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.337992] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.341873] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.345924] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.350006] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.353870] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.357951] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.362008] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.365936] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.370010] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.373939] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.378007] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.381939] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.386017] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.389870] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.393951] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.398004] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.402120] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.405866] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.409857] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.413857] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.417857] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.421857] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.425857] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.429881] pci 0000:00:1f.2: PME# supported from D3hot [ 2.433990] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.437872] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.441878] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.446062] acpiphp: Slot [1] registered [ 2.449864] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.454027] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.457867] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.461889] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.465850] pci 0000:02:00.0: enabling Extended Tags [ 2.469952] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.473849] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.478029] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.481869] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.485856] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.489869] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.493857] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.497888] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.501868] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.505847] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.509860] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.513847] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.518010] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.521869] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.525856] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.529869] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.533856] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.537887] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.541864] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.545847] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.549860] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.553848] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.557980] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.561848] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.565848] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.569848] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.573878] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.577914] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.581935] pci 0000:05:00.0: enabling Extended Tags [ 2.585924] pci 0000:05:00.0: supports D1 D2 [ 2.589847] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.593952] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.597849] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.601848] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.605895] pci_bus 0000:06: extended config space not accessible [ 2.609877] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.613880] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.617864] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.621864] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.625931] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.629889] pci 0000:06:00.0: supports D1 D2 [ 2.633847] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.637955] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.641853] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.645850] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.649948] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.653874] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.657875] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.661861] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.665981] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.669885] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.673848] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.677873] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.681847] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.686021] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.689874] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.693875] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.697861] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.701976] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.705884] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.709847] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.713873] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.717847] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.722001] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.725849] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.729848] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.733851] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.738760] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.741898] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.745895] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.749896] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.753896] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.757848] ACPI: PCI: Interrupt link LNKE disabled [ 2.761896] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.765847] ACPI: PCI: Interrupt link LNKF disabled [ 2.769895] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.773847] ACPI: PCI: Interrupt link LNKG disabled [ 2.777897] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.781847] ACPI: PCI: Interrupt link LNKH disabled [ 2.786035] iommu: Default domain type: Translated [ 2.789848] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.793973] SCSI subsystem initialized [ 2.797859] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.801846] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.801847] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.805847] vgaarb: loaded [ 2.808634] ACPI: bus type USB registered [ 2.809857] usbcore: registered new interface driver usbfs [ 2.813851] usbcore: registered new interface driver hub [ 2.817852] usbcore: registered new device driver usb [ 2.821862] pps_core: LinuxPPS API ver. 1 registered [ 2.825847] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.829850] PTP clock support registered [ 2.833861] EDAC MC: Ver: 3.0.0 [ 2.837156] NetLabel: Initializing [ 2.837848] NetLabel: domain hash size = 128 [ 2.841847] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.845858] NetLabel: unlabeled traffic allowed by default [ 2.849856] PCI: Using ACPI for IRQ routing [ 2.859055] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.861848] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.867887] clocksource: Switched to clocksource tsc-early [ 2.880086] VFS: Disk quotas dquot_6.6.0 [ 2.884092] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.891128] AppArmor: AppArmor Filesystem Enabled [ 2.895928] pnp: PnP ACPI init [ 2.899516] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.905502] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.911491] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.917482] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.923469] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.929457] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.935438] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.942123] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.948805] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.955486] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.962168] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.968852] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.975535] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.982427] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.988412] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.994402] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 3.000391] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.006379] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.013327] pnp: PnP ACPI: found 5 devices [ 3.022878] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.031874] NET: Registered PF_INET protocol family [ 3.036987] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.046278] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.055098] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.063095] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.071504] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.079041] TCP: Hash tables configured (established 262144 bind 65536) [ 3.085867] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.093649] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.100675] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.108131] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.113858] NET: Registered PF_XDP protocol family [ 3.118736] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.130309] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.138224] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.143265] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.148300] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.155168] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.162821] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.170821] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.178560] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.186647] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.194299] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.202300] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.210038] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.218128] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.225778] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.233778] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.241518] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.249604] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.257256] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.265260] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.272998] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.281084] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.286114] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.292274] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.299128] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.306963] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.312011] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.317038] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.323203] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.330076] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.335370] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.341530] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.348395] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.356224] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.364146] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.371982] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.379902] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.384929] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.391091] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.397946] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.413507] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.419755] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.426004] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.432948] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.439890] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.446834] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.453776] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.460110] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.465751] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.472081] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.479388] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.485025] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.491355] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.496999] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.503333] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.508973] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.515302] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.522821] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 3.551606] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 20987 usecs [ 3.583659] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 23979 usecs [ 3.591155] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.597709] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.597718] Trying to unpack rootfs image as initramfs... [ 3.604213] software IO TLB: mapped [mem 0x0000000074ec6000-0x0000000078ec6000] (64MB) [ 3.618180] Initialise system trusted keyrings [ 3.622699] Key type blacklist registered [ 3.626828] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.634301] zbud: loaded [ 3.637102] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 3.643179] fuse: init (API version 7.34) [ 3.647412] integrity: Platform Keyring initialized [ 3.660203] Key type asymmetric registered [ 3.664374] Asymmetric key parser 'x509' registered [ 3.669344] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 3.676886] io scheduler mq-deadline registered [ 3.681923] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.687970] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.693998] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.699965] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.705939] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.711902] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.717873] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.724788] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.730538] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.739012] ACPI: button: Power Button [PWRB] [ 3.743478] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.750997] ACPI: button: Power Button [PWRF] [ 3.756697] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.764271] pstore: Registered erst as persistent store backend [ 3.770392] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 3.797324] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.826251] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.835879] Linux agpgart interface v0.103 [ 3.841702] loop: module loaded [ 3.845139] tun: Universal TUN/TAP device driver, 1.6 [ 3.850284] PPP generic driver version 2.4.2 [ 3.854673] VFIO - User Level meta-driver version: 0.3 [ 3.859971] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.866568] ehci-pci: EHCI PCI platform driver [ 3.871232] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.876534] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.884029] ehci-pci 0000:00:1a.0: debug port 2 [ 3.892537] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.911538] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.917395] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.925754] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.933064] usb usb1: Product: EHCI Host Controller [ 3.938013] usb usb1: Manufacturer: Linux 5.15.0-105-generic ehci_hcd [ 3.944526] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.949363] hub 1-0:1.0: USB hub found [ 3.951626] Freeing initrd memory: 65084K [ 3.953195] hub 1-0:1.0: 2 ports detected [ 3.961603] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.966897] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 3.974392] ehci-pci 0000:00:1d.0: debug port 2 [ 3.982895] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.003574] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.009433] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.017784] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.025088] usb usb2: Product: EHCI Host Controller [ 4.030031] usb usb2: Manufacturer: Linux 5.15.0-105-generic ehci_hcd [ 4.036535] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.041334] hub 2-0:1.0: USB hub found [ 4.045148] hub 2-0:1.0: 2 ports detected [ 4.049337] ehci-platform: EHCI generic platform driver [ 4.054645] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.060892] ohci-pci: OHCI PCI platform driver [ 4.065421] ohci-platform: OHCI generic platform driver [ 4.070714] uhci_hcd: USB Universal Host Controller Interface driver [ 4.077180] i8042: PNP: No PS/2 controller found. [ 4.082013] mousedev: PS/2 mouse device common for all mice [ 4.087726] rtc_cmos 00:00: RTC can wake from S4 [ 4.092628] rtc_cmos 00:00: registered as rtc0 [ 4.097172] rtc_cmos 00:00: setting system clock to 2024-04-25T22:43:55 UTC (1714085035) [ 4.105376] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.112147] i2c_dev: i2c /dev entries driver [ 4.116653] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.128930] device-mapper: uevent: version 1.0.3 [ 4.133675] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.142213] platform eisa.0: Probing EISA bus 0 [ 4.146806] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.153658] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.160164] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.166675] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.173184] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.179692] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.186200] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.192711] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.199219] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.205729] platform eisa.0: EISA: Detected 0 cards [ 4.210681] intel_pstate: Intel P-state driver initializing [ 4.217357] ledtrig-cpu: registered to indicate activity on CPUs [ 4.223580] drop_monitor: Initializing network drop monitor service [ 4.230022] NET: Registered PF_INET6 protocol family [ 4.241103] Segment Routing with IPv6 [ 4.244839] In-situ OAM (IOAM) with IPv6 [ 4.248840] NET: Registered PF_PACKET protocol family [ 4.254015] Key type dns_resolver registered [ 4.258800] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.264787] microcode: Microcode Update Driver: v2.2. [ 4.264857] resctrl: L3 allocation detected [ 4.274221] resctrl: L3 monitoring detected [ 4.278472] IPI shorthand broadcast: enabled [ 4.282824] sched_clock: Marking stable (3219307687, 1063501700)->(5271999093, -989189706) [ 4.291423] registered taskstats version 1 [ 4.295714] Loading compiled-in X.509 certificates [ 4.299545] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.301122] Loaded X.509 cert 'Build time autogenerated kernel key: 2031b00138f148c9752e8bea71b9285d2b2af682' [ 4.317640] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.328145] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.338235] blacklist: Loading compiled-in revocation X.509 certificates [ 4.345015] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.354935] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.365468] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.376346] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.386876] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.397658] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.399571] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.415068] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.425870] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.437637] zswap: loaded using pool lzo/zbud [ 4.442324] Key type .fscrypt registered [ 4.446311] Key type fscrypt-provisioning registered [ 4.451431] pstore: Using crash dump compression: deflate [ 4.458988] Key type encrypted registered [ 4.463066] AppArmor: AppArmor sha1 policy hashing enabled [ 4.468626] ima: No TPM chip found, activating TPM-bypass! [ 4.472089] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.481975] Loading compiled-in module X.509 certificates [ 4.482441] Loaded X.509 cert 'Build time autogenerated kernel key: 2031b00138f148c9752e8bea71b9285d2b2af682' [ 4.490262] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.495740] ima: Allocated hash algorithm: sha1 [ 4.495745] ima: No architecture policies found [ 4.506010] hub 1-1:1.0: USB hub found [ 4.512990] evm: Initialising EVM extended attributes: [ 4.517720] hub 1-1:1.0: 6 ports detected [ 4.522183] evm: security.selinux [ 4.522185] evm: security.SMACK64 [ 4.522186] evm: security.SMACK64EXEC [ 4.522186] evm: security.SMACK64TRANSMUTE [ 4.522186] evm: security.SMACK64MMAP [ 4.522187] evm: security.apparmor [ 4.557151] evm: security.ima [ 4.559833] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.560185] evm: security.capability [ 4.568451] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.572104] evm: HMAC attrs: 0x1 [ 4.572373] PM: Magic number: 4:885:755 [ 4.582873] hub 2-1:1.0: USB hub found [ 4.586700] PM: hash matches drivers/base/power/main.c:979 [ 4.586726] tty ttyS6: hash matches [ 4.596465] hub 2-1:1.0: 8 ports detected [ 4.599885] pci 0000:ff:1e.4: hash matches [ 4.608184] acpi LNXCPU:4d: hash matches [ 4.612418] RAS: Correctable Errors collector initialized. [ 4.618917] Freeing unused decrypted memory: 2036K [ 4.624240] Freeing unused kernel image (initmem) memory: 3352K [ 4.643571] Write protecting the kernel read-only data: 30720k [ 4.647513] tsc: Refined TSC clocksource calibration: 3499.997 MHz [ 4.655734] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734e5ebc4, max_idle_ns: 440795265422 ns [ 4.665887] clocksource: Switched to clocksource tsc [ 4.671198] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 4.678115] Freeing unused kernel image (rodata/data gap) memory: 1340K [ 4.723647] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.730154] x86/mm: Checking user space page tables [ 4.772391] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.778899] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 4.927019] dca service started, version 1.12.1 [ 4.935114] nvme nvme0: pci function 0000:02:00.0 [ 4.940235] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.942838] nvme nvme0: 8/0/0 default/read/poll queues [ 4.948702] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.962355] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.967719] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.976250] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.985666] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.990957] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.995818] scsi host0: ahci [ 4.998442] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 5.001528] scsi host1: ahci [ 5.007747] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 5.010787] scsi host2: ahci [ 5.019019] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.019956] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 5.021244] i2c i2c-0: 2/8 memory slots populated (from DMI) [ 5.021246] i2c i2c-0: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 5.023264] scsi host3: ahci [ 5.029285] usb usb3: Product: xHCI Host Controller [ 5.035254] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 34 [ 5.040932] usb usb3: Manufacturer: Linux 5.15.0-105-generic xhci-hcd [ 5.050243] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 34 [ 5.053189] usb usb3: SerialNumber: 0000:00:14.0 [ 5.058137] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 34 [ 5.065743] hub 3-0:1.0: USB hub found [ 5.072131] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 34 [ 5.079646] hub 3-0:1.0: 15 ports detected [ 5.084607] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.094911] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 5.095601] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.103077] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.131594] igb: Intel(R) Gigabit Ethernet Network Driver [ 5.138864] usb usb4: Product: xHCI Host Controller [ 5.144327] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.149272] usb usb4: Manufacturer: Linux 5.15.0-105-generic xhci-hcd [ 5.149459] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.149460] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.171900] scsi host4: ahci [ 5.173427] usb usb4: SerialNumber: 0000:00:14.0 [ 5.176489] scsi host5: ahci [ 5.181142] hub 4-0:1.0: USB hub found [ 5.184114] scsi host6: ahci [ 5.187882] hub 4-0:1.0: 6 ports detected [ 5.190927] scsi host7: ahci [ 5.198008] scsi host8: ahci [ 5.201106] scsi host9: ahci [ 5.204105] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 44 [ 5.210987] igb 0000:07:00.0: added PHC on eth0 [ 5.211593] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 44 [ 5.216210] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.223671] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 44 [ 5.230609] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:da:6a:a4 [ 5.238108] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 44 [ 5.245398] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.252830] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 44 [ 5.258052] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.265541] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 44 [ 5.330418] igb 0000:07:00.1: added PHC on eth1 [ 5.335031] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.341977] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:da:6a:a5 [ 5.349275] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.354478] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.398244] ata4: SATA link down (SStatus 0 SControl 300) [ 5.403736] ata3: SATA link down (SStatus 0 SControl 300) [ 5.409240] ata2: SATA link down (SStatus 0 SControl 300) [ 5.414730] ata1: SATA link down (SStatus 0 SControl 300) [ 5.431591] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.587809] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.594432] ata10: SATA link down (SStatus 0 SControl 300) [ 5.596182] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.601767] ata9: SATA link down (SStatus 0 SControl 300) [ 5.609513] hub 3-12:1.0: USB hub found [ 5.614569] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.624730] hub 3-12:1.0: 4 ports detected [ 5.624752] ata7: SATA link down (SStatus 0 SControl 300) [ 5.634407] ata8: SATA link down (SStatus 0 SControl 300) [ 5.639908] ata6: SATA link down (SStatus 0 SControl 300) [ 5.729098] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.735968] ata5.00: NCQ Send/Recv Log not supported [ 5.741013] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.749513] ata5.00: NCQ Send/Recv Log not supported [ 5.754572] ata5.00: configured for UDMA/133 [ 5.759170] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.767673] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.767869] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.780844] sd 4:0:0:0: [sda] Write Protect is off [ 5.785724] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.806666] sda: sda1 [ 5.809320] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.815605] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.835964] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.939565] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 6.071934] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 6.080489] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.096088] hid: raw HID events driver (C) Jiri Kosina [ 6.104030] usbcore: registered new interface driver usbhid [ 6.109681] usbhid: USB HID core driver [ 6.115260] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.183753] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.195748] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.215572] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.340116] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.350499] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.359111] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.365364] ixgbe 0000:03:00.0: 0c:c4:7a:88:72:56 [ 6.373356] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 6.543978] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.554362] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.562969] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.570086] ixgbe 0000:03:00.1: 0c:c4:7a:88:72:57 [ 6.578065] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.585905] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 6.612325] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: clean, 198138/61054976 files, 6506324/244190336 blocks done. [ 6.786984] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 7.612974] systemd[1]: Inserted module 'autofs4' [ 7.696968] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 7.747705] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 7.792645] systemd[1]: Hostname set to . [ 9.127648] systemd[1]: Queued start job for default target Graphical Interface. [ 9.137734] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 9.160473] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 9.184344] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 9.207733] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 9.227768] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 9.251967] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 9.279702] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 9.307690] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 9.335654] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 9.363678] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 9.391643] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 9.419648] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 9.447743] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 9.471690] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 9.491678] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 9.515792] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 9.539895] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 9.566111] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 9.591923] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 9.611865] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 9.635769] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 9.660086] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 9.679896] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 9.699919] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 9.720026] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 9.743939] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 9.763896] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 9.785358] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 9.805247] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 9.829105] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 9.853310] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 9.874665] systemd[1]: Mounting Kernel Trace File System... [ 9.878176] RPC: Registered named UNIX socket transport module. [ 9.886397] RPC: Registered udp transport module. [ 9.886398] RPC: Registered tcp transport module. [ 9.886398] RPC: Registered tcp NFSv4.1 backchannel transport module. Mounting Kernel Trace File System... [ 9.918901] systemd[1]: Starting Journal Service... Starting Journal Service... [ 9.939733] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 9.950393] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 9.962981] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 9.972578] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 9.996364] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 10.024398] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 10.048451] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 10.068459] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 10.088710] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 10.112331] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 10.132434] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 10.156497] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 10.180562] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 10.199568] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 10.209325] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 10.219670] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 10.240315] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 10.261661] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. [ 10.271053] systemd[1]: Starting Coldplug All udev Devices... Starting Coldplug All udev Devices... [ 10.293531] systemd[1]: Started Journal Service. [ OK [[ 10.298371] lp: driver loaded but no devices found 0m] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ 10.325651] Loading iSCSI transport class v2.0-870. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... [ 10.663523] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... Starting Load/Save Random Seed... [ 10.765941] systemd-journald[360]: Received client request to flush runtime journal. Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Finished Flush Journal to Persistent Storage. Starting Create Volatile Files and Directories... [ OK ] Finished Create Volatile Files and Directories. [ OK ] Finished Load AppArmor profiles. Mounting RPC Pipe File System... Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... Starting RPC bind portmap service... Starting Record System Boot/Shutdown in UTMP... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Mounted RPC Pipe File System. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Reached target rpc_pipefs.target. Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target NFS client services. Starting Network Configuration... [ OK ] Started pNFS block layout mapping daemon. [ OK ] Found device /dev/ttyS1. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Started RPC bind portmap service. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. [ OK ] Listening on UUID daemon activation socket. Mounting /var/lib/ceph... Starting LVM event activation on device 259:0... [ OK ] Started Network Configuration. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Listening on Docker Socket for the API. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting Dispatcher daemon for systemd-networkd... [ OK ] Started ntp-systemd-netif.service. Starting RPC Remote Quota Server... Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Finished Helper to synchronize boot up for ifupdown. [ OK ] Found device 82599ES 10-Gi…ork Connection (AOC-STGN-i2S). [ OK ] Started ifup for enp3s0f1. Starting Raise network interfaces... [ OK ] Started RPC Remote Quota Server. [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Started System Logging Service. [ OK ] Finished GRUB failed boot detection. [ OK ] Started User Login Management. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started ntp-systemd-netif.service. Starting Authorization Manager... [ OK ] Finished Wait for Network to be Configured. [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting NFS status monitor for NFSv2/3 locking.... Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. + myips=172.21.15.148 + attempts=1 + sleep 1 [ OK ] Started Network Time Service. [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Dispatcher daemon for systemd-networkd. [ OK ] Finished Ubuntu FAN network setup. + '[' 172.21.15.148 '!=' '' ']' + set -e + '[' -n 172.21.15.148 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.148 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.148 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi148.front.sepia.ceph.com + '[' -n smithi148.front.sepia.ceph.com ']' + hostname smithi148.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi148 + echo smithi148 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.148 smithi148.front.sepia.ceph.com smithi148/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. [ OK ] Started ntp-systemd-netif.service. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started Docker Application Container Engine. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Record Runlevel Change in UTMP... [ OK ] Finished Record Runlevel Change in UTMP. Ubuntu 22.04.1 LTS smithi148.front.sepia.ceph.com ttyS1 smithi148 login: [disconnect] 2024-04-25T22:44:16.829 INFO:teuthology.misc:Re-opening connections... 2024-04-25T22:44:16.829 INFO:teuthology.misc:trying to connect to ubuntu@smithi148.front.sepia.ceph.com 2024-04-25T22:44:16.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-04-25T22:44:16.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:44:17.063 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-04-25T22:44:17.599 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-04-25T22:44:17.599 DEBUG:teuthology.misc:waited 0.770557165145874 2024-04-25T22:44:18.601 DEBUG:tasks.ceph_manager:Mounting data for osd.1 on ubuntu@smithi148.front.sepia.ceph.com 2024-04-25T22:44:18.601 INFO:tasks.ceph_manager:Mounting osd.1: dev: ubuntu@smithi148.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-1, type: xfs, options: ['noatime'] 2024-04-25T22:44:18.601 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-25T22:44:18.664 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~164s 2024-04-25T22:44:18.706 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T22:44:18.730 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T22:44:18.730 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T22:44:18.769 INFO:tasks.ceph.osd.1:Started 2024-04-25T22:44:18.769 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:44:18.881 INFO:teuthology.orchestra.run.smithi148.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-25T22:44:18.884 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T22:44:18.884 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-25T22:44:19.841 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:44:20.124+0000 7ff808f9c7c0 -1 Falling back to public interface 2024-04-25T22:44:23.776 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:44:24.060+0000 7ff808f9c7c0 -1 osd.1 45 log_to_monitors true 2024-04-25T22:44:23.885 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:44:24.012 INFO:teuthology.orchestra.run.smithi148.stderr:no valid command found; 10 closest matches: 2024-04-25T22:44:24.012 INFO:teuthology.orchestra.run.smithi148.stderr:0 2024-04-25T22:44:24.012 INFO:teuthology.orchestra.run.smithi148.stderr:1 2024-04-25T22:44:24.012 INFO:teuthology.orchestra.run.smithi148.stderr:2 2024-04-25T22:44:24.012 INFO:teuthology.orchestra.run.smithi148.stderr:abort 2024-04-25T22:44:24.012 INFO:teuthology.orchestra.run.smithi148.stderr:assert 2024-04-25T22:44:24.012 INFO:teuthology.orchestra.run.smithi148.stderr:bluefs debug_inject_read_zeros 2024-04-25T22:44:24.012 INFO:teuthology.orchestra.run.smithi148.stderr:bluefs files list 2024-04-25T22:44:24.012 INFO:teuthology.orchestra.run.smithi148.stderr:bluefs stats 2024-04-25T22:44:24.012 INFO:teuthology.orchestra.run.smithi148.stderr:bluestore allocator dump block 2024-04-25T22:44:24.012 INFO:teuthology.orchestra.run.smithi148.stderr:bluestore allocator fragmentation block 2024-04-25T22:44:24.012 INFO:teuthology.orchestra.run.smithi148.stderr:admin_socket: invalid command 2024-04-25T22:44:24.014 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T22:44:24.014 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-25T22:44:24.422 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-04-25T22:44:24.704+0000 7ff7fcd69640 -1 osd.1 78 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T22:44:24.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-25T22:44:29.015 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:44:29.164 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-04-25T22:44:29.165 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-04-25T22:44:29.165 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-04-25T22:44:29.165 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-04-25T22:44:34.181 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-25T22:44:34.332 INFO:teuthology.orchestra.run.smithi057.stdout:mon.a: {} 2024-04-25T22:44:34.332 INFO:teuthology.orchestra.run.smithi057.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:44:34.341 INFO:teuthology.orchestra.run.smithi057.stdout:mon.b: {} 2024-04-25T22:44:34.341 INFO:teuthology.orchestra.run.smithi057.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:44:34.350 INFO:teuthology.orchestra.run.smithi057.stdout:mon.c: {} 2024-04-25T22:44:34.350 INFO:teuthology.orchestra.run.smithi057.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:44:34.368 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T22:44:35.087 INFO:teuthology.orchestra.run.smithi057.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T22:44:35.117 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-25T22:44:36.098 INFO:teuthology.orchestra.run.smithi057.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-25T22:44:36.130 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T22:44:37.081 INFO:teuthology.orchestra.run.smithi057.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T22:44:37.108 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-25T22:44:38.080 INFO:teuthology.orchestra.run.smithi057.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-25T22:44:38.109 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T22:44:39.101 INFO:teuthology.orchestra.run.smithi057.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T22:44:39.124 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-25T22:44:40.090 INFO:teuthology.orchestra.run.smithi057.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-25T22:44:40.114 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-25T22:44:40.115 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-25T22:44:40.115 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-25T22:44:40.115 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-25T22:44:40.115 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T22:44:40.115 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:44:40.408 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:44:40.408 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":94,"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","created":"2024-04-25T22:39:52.303074+0000","modified":"2024-04-25T22:44:40.084195+0000","last_up_change":"2024-04-25T22:44:25.314578+0000","last_in_change":"2024-04-25T22:39:53.230242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:40:03.197725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:40:07.560858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:40:12.431697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:40:12.919828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4500000476837158,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.4500000476837158,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d465b4-5896-4d69-80b1-7e69d31eb455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6801","nonce":765118869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6803","nonce":765118869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6807","nonce":765118869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6805","nonce":765118869}]},"public_addr":"172.21.15.122:6801/765118869","cluster_addr":"172.21.15.122:6803/765118869","heartbeat_back_addr":"172.21.15.122:6807/765118869","heartbeat_front_addr":"172.21.15.122:6805/765118869","state":["exists","up"]},{"osd":1,"uuid":"8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":45,"up_from":79,"up_thru":91,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":3379571590},{"type":"v1","addr":"172.21.15.148:6801","nonce":3379571590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":3379571590},{"type":"v1","addr":"172.21.15.148:6803","nonce":3379571590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":3379571590},{"type":"v1","addr":"172.21.15.148:6807","nonce":3379571590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":3379571590},{"type":"v1","addr":"172.21.15.148:6805","nonce":3379571590}]},"public_addr":"172.21.15.148:6801/3379571590","cluster_addr":"172.21.15.148:6803/3379571590","heartbeat_back_addr":"172.21.15.148:6807/3379571590","heartbeat_front_addr":"172.21.15.148:6805/3379571590","state":["exists","up"]},{"osd":2,"uuid":"164fc653-2135-4e9b-8826-1716fdba6ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6801","nonce":368834361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6803","nonce":368834361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6807","nonce":368834361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6805","nonce":368834361}]},"public_addr":"172.21.15.188:6801/368834361","cluster_addr":"172.21.15.188:6803/368834361","heartbeat_back_addr":"172.21.15.188:6807/368834361","heartbeat_front_addr":"172.21.15.188:6805/368834361","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.559393+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.563434+0000","dead_epoch":45},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.557643+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.16","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.2","osds":[0]},{"pgid":"4.3","osds":[0]},{"pgid":"4.5","osds":[0]},{"pgid":"4.7","osds":[2]},{"pgid":"4.8","osds":[0]},{"pgid":"4.9","osds":[2]},{"pgid":"4.d","osds":[0]},{"pgid":"4.f","osds":[2]},{"pgid":"4.10","osds":[2]},{"pgid":"4.12","osds":[2]},{"pgid":"4.14","osds":[2]},{"pgid":"4.15","osds":[2]},{"pgid":"4.16","osds":[2]},{"pgid":"4.1c","osds":[2]},{"pgid":"4.1d","osds":[0]},{"pgid":"4.1f","osds":[0]},{"pgid":"4.22","osds":[0]},{"pgid":"4.27","osds":[0]},{"pgid":"4.28","osds":[2]},{"pgid":"4.2a","osds":[0]},{"pgid":"4.2e","osds":[2]},{"pgid":"4.2f","osds":[2]},{"pgid":"4.34","osds":[0]},{"pgid":"4.37","osds":[2]},{"pgid":"4.3b","osds":[2]},{"pgid":"4.3d","osds":[0]},{"pgid":"4.3f","osds":[2]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:44:40.426 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T22:44:40.426 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:44:40.708 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:44:40.708 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":94,"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","created":"2024-04-25T22:39:52.303074+0000","modified":"2024-04-25T22:44:40.084195+0000","last_up_change":"2024-04-25T22:44:25.314578+0000","last_in_change":"2024-04-25T22:39:53.230242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:40:03.197725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:40:07.560858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:40:12.431697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:40:12.919828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4500000476837158,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.4500000476837158,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d465b4-5896-4d69-80b1-7e69d31eb455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6801","nonce":765118869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6803","nonce":765118869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6807","nonce":765118869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6805","nonce":765118869}]},"public_addr":"172.21.15.122:6801/765118869","cluster_addr":"172.21.15.122:6803/765118869","heartbeat_back_addr":"172.21.15.122:6807/765118869","heartbeat_front_addr":"172.21.15.122:6805/765118869","state":["exists","up"]},{"osd":1,"uuid":"8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":45,"up_from":79,"up_thru":91,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":3379571590},{"type":"v1","addr":"172.21.15.148:6801","nonce":3379571590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":3379571590},{"type":"v1","addr":"172.21.15.148:6803","nonce":3379571590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":3379571590},{"type":"v1","addr":"172.21.15.148:6807","nonce":3379571590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":3379571590},{"type":"v1","addr":"172.21.15.148:6805","nonce":3379571590}]},"public_addr":"172.21.15.148:6801/3379571590","cluster_addr":"172.21.15.148:6803/3379571590","heartbeat_back_addr":"172.21.15.148:6807/3379571590","heartbeat_front_addr":"172.21.15.148:6805/3379571590","state":["exists","up"]},{"osd":2,"uuid":"164fc653-2135-4e9b-8826-1716fdba6ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6801","nonce":368834361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6803","nonce":368834361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6807","nonce":368834361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6805","nonce":368834361}]},"public_addr":"172.21.15.188:6801/368834361","cluster_addr":"172.21.15.188:6803/368834361","heartbeat_back_addr":"172.21.15.188:6807/368834361","heartbeat_front_addr":"172.21.15.188:6805/368834361","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.559393+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.563434+0000","dead_epoch":45},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.557643+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.16","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.2","osds":[0]},{"pgid":"4.3","osds":[0]},{"pgid":"4.5","osds":[0]},{"pgid":"4.7","osds":[2]},{"pgid":"4.8","osds":[0]},{"pgid":"4.9","osds":[2]},{"pgid":"4.d","osds":[0]},{"pgid":"4.f","osds":[2]},{"pgid":"4.10","osds":[2]},{"pgid":"4.12","osds":[2]},{"pgid":"4.14","osds":[2]},{"pgid":"4.15","osds":[2]},{"pgid":"4.16","osds":[2]},{"pgid":"4.1c","osds":[2]},{"pgid":"4.1d","osds":[0]},{"pgid":"4.1f","osds":[0]},{"pgid":"4.22","osds":[0]},{"pgid":"4.27","osds":[0]},{"pgid":"4.28","osds":[2]},{"pgid":"4.2a","osds":[0]},{"pgid":"4.2e","osds":[2]},{"pgid":"4.2f","osds":[2]},{"pgid":"4.34","osds":[0]},{"pgid":"4.37","osds":[2]},{"pgid":"4.3b","osds":[2]},{"pgid":"4.3d","osds":[0]},{"pgid":"4.3f","osds":[2]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:44:40.727 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T22:44:40.727 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T22:44:40.728 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T22:44:40.883 INFO:teuthology.orchestra.run.smithi057.stdout:339302416389 2024-04-25T22:44:40.883 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T22:44:40.884 INFO:teuthology.orchestra.run.smithi057.stdout:34359738429 2024-04-25T22:44:40.885 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T22:44:40.886 INFO:teuthology.orchestra.run.smithi057.stdout:34359738429 2024-04-25T22:44:40.886 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T22:44:41.206 INFO:teuthology.orchestra.run.smithi057.stdout:339302416387 2024-04-25T22:44:41.207 INFO:teuthology.orchestra.run.smithi057.stdout:34359738428 2024-04-25T22:44:41.212 INFO:teuthology.orchestra.run.smithi057.stdout:34359738428 2024-04-25T22:44:41.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 339302416389 got 339302416387 for osd.1 2024-04-25T22:44:41.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738428 for osd.2 2024-04-25T22:44:41.233 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738428 for osd.0 2024-04-25T22:44:42.231 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T22:44:42.232 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T22:44:42.234 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T22:44:42.527 INFO:teuthology.orchestra.run.smithi057.stdout:34359738429 2024-04-25T22:44:42.531 INFO:teuthology.orchestra.run.smithi057.stdout:34359738429 2024-04-25T22:44:42.538 INFO:teuthology.orchestra.run.smithi057.stdout:339302416389 2024-04-25T22:44:42.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738429 for osd.2 2024-04-25T22:44:42.555 DEBUG:teuthology.parallel:result is None 2024-04-25T22:44:42.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 339302416389 got 339302416389 for osd.1 2024-04-25T22:44:42.559 DEBUG:teuthology.parallel:result is None 2024-04-25T22:44:42.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738429 for osd.0 2024-04-25T22:44:42.560 DEBUG:teuthology.parallel:result is None 2024-04-25T22:44:42.560 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T22:44:42.560 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:44:42.895 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:44:42.897 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:44:42.911 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2024-04-25T22:44:42.077177+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127661643,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1239,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2659,"num_read_kb":1250233,"num_write":29110,"num_write_kb":4268127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3044,"num_bytes_recovered":79463584,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32912,"ondisk_log_size":32912,"up":210,"acting":183,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":458240,"kb_used_data":251848,"kb_used_omap":8,"kb_used_meta":206327,"kb_avail":282657280,"statfs":{"total":289910292480,"available":289441054720,"internally_reserved":0,"allocated":257892352,"data_stored":256505261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9193,"internal_metadata":211278871},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-4599,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1469,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.998967"},"pg_stats":[{"pgid":"4.3f","version":"72'404","reported_seq":580,"reported_epoch":94,"state":"remapped+peering","last_fresh":"2024-04-25T22:44:40.105034+0000","last_change":"2024-04-25T22:44:40.105034+0000","last_active":"2024-04-25T22:44:40.105034+0000","last_peered":"2024-04-25T22:44:39.135508+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:39.114950+0000","last_became_peered":"2024-04-25T22:44:39.114950+0000","last_unstale":"2024-04-25T22:44:40.105034+0000","last_undegraded":"2024-04-25T22:44:40.105034+0000","last_fullsized":"2024-04-25T22:44:40.105034+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19772,"num_write":366,"num_write_kb":46873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"72'420","reported_seq":578,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:37.369026+0000","last_change":"2024-04-25T22:44:40.395075+0000","last_active":"2024-04-25T22:44:40.395075+0000","last_peered":"2024-04-25T22:44:37.369026+0000","last_clean":"2024-04-25T22:44:37.369026+0000","last_became_active":"2024-04-25T22:44:35.395973+0000","last_became_peered":"2024-04-25T22:44:35.395973+0000","last_unstale":"2024-04-25T22:44:37.369026+0000","last_undegraded":"2024-04-25T22:44:37.369026+0000","last_fullsized":"2024-04-25T22:44:37.369026+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24515,"num_write":386,"num_write_kb":55688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"72'377","reported_seq":909,"reported_epoch":94,"state":"active+undersized+remapped","last_fresh":"2024-04-25T22:44:40.167466+0000","last_change":"2024-04-25T22:44:40.167889+0000","last_active":"2024-04-25T22:44:40.167466+0000","last_peered":"2024-04-25T22:44:40.167466+0000","last_clean":"2024-04-25T22:41:34.255813+0000","last_became_active":"2024-04-25T22:44:27.914787+0000","last_became_peered":"2024-04-25T22:44:27.914787+0000","last_unstale":"2024-04-25T22:44:40.167466+0000","last_undegraded":"2024-04-25T22:44:40.167466+0000","last_fullsized":"2024-04-25T22:44:27.368162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11135,"num_write":346,"num_write_kb":38950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"72'366","reported_seq":535,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.109528+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:44:40.109528+0000","last_peered":"2024-04-25T22:44:40.109528+0000","last_clean":"2024-04-25T22:44:40.109528+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:44:40.109528+0000","last_undegraded":"2024-04-25T22:44:40.109528+0000","last_fullsized":"2024-04-25T22:44:40.109528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":326,"num_write_kb":34079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"72'455","reported_seq":642,"reported_epoch":94,"state":"remapped+peering","last_fresh":"2024-04-25T22:44:40.102779+0000","last_change":"2024-04-25T22:44:40.102779+0000","last_active":"2024-04-25T22:44:40.102779+0000","last_peered":"2024-04-25T22:44:39.130425+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:39.112488+0000","last_became_peered":"2024-04-25T22:44:39.112488+0000","last_unstale":"2024-04-25T22:44:40.102779+0000","last_undegraded":"2024-04-25T22:44:40.102779+0000","last_fullsized":"2024-04-25T22:44:40.102779+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33897,"num_write":426,"num_write_kb":100721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"72'401","reported_seq":597,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.108221+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:44:40.108221+0000","last_peered":"2024-04-25T22:44:40.108221+0000","last_clean":"2024-04-25T22:44:40.108221+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:44:40.108221+0000","last_undegraded":"2024-04-25T22:44:40.108221+0000","last_fullsized":"2024-04-25T22:44:40.108221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15258,"num_write":369,"num_write_kb":53298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"72'452","reported_seq":680,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.106184+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:44:40.106184+0000","last_peered":"2024-04-25T22:44:40.106184+0000","last_clean":"2024-04-25T22:44:40.106184+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:44:40.106184+0000","last_undegraded":"2024-04-25T22:44:40.106184+0000","last_fullsized":"2024-04-25T22:44:40.106184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34010,"num_write":428,"num_write_kb":157752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"72'401","reported_seq":602,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.106167+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:44:40.106167+0000","last_peered":"2024-04-25T22:44:40.106167+0000","last_clean":"2024-04-25T22:44:40.106167+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:44:40.106167+0000","last_undegraded":"2024-04-25T22:44:40.106167+0000","last_fullsized":"2024-04-25T22:44:40.106167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19917,"num_write":359,"num_write_kb":109382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"72'394","reported_seq":579,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:40.101164+0000","last_change":"2024-04-25T22:44:27.933160+0000","last_active":"2024-04-25T22:44:40.101164+0000","last_peered":"2024-04-25T22:44:40.101164+0000","last_clean":"2024-04-25T22:41:33.341370+0000","last_became_active":"2024-04-25T22:44:27.927304+0000","last_became_peered":"2024-04-25T22:44:27.927304+0000","last_unstale":"2024-04-25T22:44:40.101164+0000","last_undegraded":"2024-04-25T22:44:27.369434+0000","last_fullsized":"2024-04-25T22:44:27.345517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9569,"num_write":360,"num_write_kb":25560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"72'382","reported_seq":522,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:36.706732+0000","last_change":"2024-04-25T22:44:40.396212+0000","last_active":"2024-04-25T22:44:40.396212+0000","last_peered":"2024-04-25T22:44:36.706732+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:27.909822+0000","last_became_peered":"2024-04-25T22:44:27.909822+0000","last_unstale":"2024-04-25T22:44:36.706732+0000","last_undegraded":"2024-04-25T22:44:36.706732+0000","last_fullsized":"2024-04-25T22:44:27.348732+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17192,"num_write":338,"num_write_kb":38688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"72'369","reported_seq":554,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.111453+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:44:40.111453+0000","last_peered":"2024-04-25T22:44:40.111453+0000","last_clean":"2024-04-25T22:44:40.111453+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:44:40.111453+0000","last_undegraded":"2024-04-25T22:44:40.111453+0000","last_fullsized":"2024-04-25T22:44:40.111453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7385,"num_write":349,"num_write_kb":58842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"72'338","reported_seq":529,"reported_epoch":94,"state":"remapped+peering","last_fresh":"2024-04-25T22:44:40.109123+0000","last_change":"2024-04-25T22:44:40.109123+0000","last_active":"2024-04-25T22:44:40.109123+0000","last_peered":"2024-04-25T22:44:39.103653+0000","last_clean":"2024-04-25T22:41:34.255048+0000","last_became_active":"2024-04-25T22:44:37.098177+0000","last_became_peered":"2024-04-25T22:44:37.098177+0000","last_unstale":"2024-04-25T22:44:40.109123+0000","last_undegraded":"2024-04-25T22:44:40.109123+0000","last_fullsized":"2024-04-25T22:44:40.109123+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13619,"num_write":312,"num_write_kb":21391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"72'411","reported_seq":561,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:37.367999+0000","last_change":"2024-04-25T22:44:40.404787+0000","last_active":"2024-04-25T22:44:40.404787+0000","last_peered":"2024-04-25T22:44:37.367999+0000","last_clean":"2024-04-25T22:44:37.367999+0000","last_became_active":"2024-04-25T22:44:30.683328+0000","last_became_peered":"2024-04-25T22:44:30.683328+0000","last_unstale":"2024-04-25T22:44:37.367999+0000","last_undegraded":"2024-04-25T22:44:37.367999+0000","last_fullsized":"2024-04-25T22:44:37.367999+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12998,"num_write":375,"num_write_kb":79661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"72'452","reported_seq":1012,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.130299+0000","last_change":"2024-04-25T22:44:40.130299+0000","last_active":"2024-04-25T22:44:40.130299+0000","last_peered":"2024-04-25T22:44:40.130299+0000","last_clean":"2024-04-25T22:44:40.130299+0000","last_became_active":"2024-04-25T22:44:40.127307+0000","last_became_peered":"2024-04-25T22:44:40.127307+0000","last_unstale":"2024-04-25T22:44:40.130299+0000","last_undegraded":"2024-04-25T22:44:40.130299+0000","last_fullsized":"2024-04-25T22:44:40.130299+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:16.746830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":854,"num_write":419,"num_write_kb":88217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"72'428","reported_seq":992,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.106608+0000","last_change":"2024-04-25T22:44:35.108361+0000","last_active":"2024-04-25T22:44:40.106608+0000","last_peered":"2024-04-25T22:44:40.106608+0000","last_clean":"2024-04-25T22:44:40.106608+0000","last_became_active":"2024-04-25T22:44:35.103208+0000","last_became_peered":"2024-04-25T22:44:35.103208+0000","last_unstale":"2024-04-25T22:44:40.106608+0000","last_undegraded":"2024-04-25T22:44:40.106608+0000","last_fullsized":"2024-04-25T22:44:40.106608+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:22.046332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21291,"num_write":389,"num_write_kb":68562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"72'401","reported_seq":576,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.106549+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:44:40.106549+0000","last_peered":"2024-04-25T22:44:40.106549+0000","last_clean":"2024-04-25T22:44:40.106549+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:44:40.106549+0000","last_undegraded":"2024-04-25T22:44:40.106549+0000","last_fullsized":"2024-04-25T22:44:40.106549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8276,"num_write":369,"num_write_kb":17867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"72'398","reported_seq":575,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:40.104542+0000","last_change":"2024-04-25T22:44:27.936766+0000","last_active":"2024-04-25T22:44:40.104542+0000","last_peered":"2024-04-25T22:44:40.104542+0000","last_clean":"2024-04-25T22:41:33.342064+0000","last_became_active":"2024-04-25T22:44:27.932101+0000","last_became_peered":"2024-04-25T22:44:27.932101+0000","last_unstale":"2024-04-25T22:44:40.104542+0000","last_undegraded":"2024-04-25T22:44:27.388123+0000","last_fullsized":"2024-04-25T22:44:27.382718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":175,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5883,"num_write":362,"num_write_kb":38188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"72'407","reported_seq":568,"reported_epoch":94,"state":"remapped+peering","last_fresh":"2024-04-25T22:44:40.109948+0000","last_change":"2024-04-25T22:44:40.109948+0000","last_active":"2024-04-25T22:44:40.109948+0000","last_peered":"2024-04-25T22:44:39.146836+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:39.138341+0000","last_became_peered":"2024-04-25T22:44:39.138341+0000","last_unstale":"2024-04-25T22:44:40.109948+0000","last_undegraded":"2024-04-25T22:44:40.109948+0000","last_fullsized":"2024-04-25T22:44:40.109948+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13073,"num_write":372,"num_write_kb":59323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"72'441","reported_seq":1014,"reported_epoch":93,"state":"peering","last_fresh":"2024-04-25T22:44:39.547606+0000","last_change":"2024-04-25T22:44:40.108135+0000","last_active":"2024-04-25T22:44:40.108135+0000","last_peered":"2024-04-25T22:44:39.547606+0000","last_clean":"2024-04-25T22:41:33.341549+0000","last_became_active":"2024-04-25T22:44:27.915995+0000","last_became_peered":"2024-04-25T22:44:27.915995+0000","last_unstale":"2024-04-25T22:44:39.547606+0000","last_undegraded":"2024-04-25T22:44:39.547606+0000","last_fullsized":"2024-04-25T22:44:27.344836+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37611,"num_write":403,"num_write_kb":116618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"72'438","reported_seq":625,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.110458+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:44:40.110458+0000","last_peered":"2024-04-25T22:44:40.110458+0000","last_clean":"2024-04-25T22:44:40.110458+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:44:40.110458+0000","last_undegraded":"2024-04-25T22:44:40.110458+0000","last_fullsized":"2024-04-25T22:44:40.110458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12393,"num_write":408,"num_write_kb":99933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"72'407","reported_seq":583,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.110252+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:44:40.110252+0000","last_peered":"2024-04-25T22:44:40.110252+0000","last_clean":"2024-04-25T22:44:40.110252+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:44:40.110252+0000","last_undegraded":"2024-04-25T22:44:40.110252+0000","last_fullsized":"2024-04-25T22:44:40.110252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8932,"num_write":382,"num_write_kb":59684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"72'463","reported_seq":692,"reported_epoch":94,"state":"remapped+peering","last_fresh":"2024-04-25T22:44:40.106197+0000","last_change":"2024-04-25T22:44:40.106197+0000","last_active":"2024-04-25T22:44:40.106197+0000","last_peered":"2024-04-25T22:44:39.103298+0000","last_clean":"2024-04-25T22:41:34.254643+0000","last_became_active":"2024-04-25T22:44:37.098309+0000","last_became_peered":"2024-04-25T22:44:37.098309+0000","last_unstale":"2024-04-25T22:44:40.106197+0000","last_undegraded":"2024-04-25T22:44:40.106197+0000","last_fullsized":"2024-04-25T22:44:40.106197+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27589,"num_write":428,"num_write_kb":76861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"72'425","reported_seq":655,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.099851+0000","last_change":"2024-04-25T22:44:39.132230+0000","last_active":"2024-04-25T22:44:40.099851+0000","last_peered":"2024-04-25T22:44:40.099851+0000","last_clean":"2024-04-25T22:44:40.099851+0000","last_became_active":"2024-04-25T22:44:39.118635+0000","last_became_peered":"2024-04-25T22:44:39.118635+0000","last_unstale":"2024-04-25T22:44:40.099851+0000","last_undegraded":"2024-04-25T22:44:40.099851+0000","last_fullsized":"2024-04-25T22:44:40.099851+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:15.096836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":46424,"num_write":390,"num_write_kb":96359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"72'445","reported_seq":634,"reported_epoch":94,"state":"remapped+peering","last_fresh":"2024-04-25T22:44:40.102100+0000","last_change":"2024-04-25T22:44:40.102100+0000","last_active":"2024-04-25T22:44:40.102100+0000","last_peered":"2024-04-25T22:44:39.131924+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:39.121605+0000","last_became_peered":"2024-04-25T22:44:39.121605+0000","last_unstale":"2024-04-25T22:44:40.102100+0000","last_undegraded":"2024-04-25T22:44:40.102100+0000","last_fullsized":"2024-04-25T22:44:40.102100+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32317,"num_write":419,"num_write_kb":76071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"72'424","reported_seq":598,"reported_epoch":94,"state":"remapped+peering","last_fresh":"2024-04-25T22:44:40.111380+0000","last_change":"2024-04-25T22:44:40.111380+0000","last_active":"2024-04-25T22:44:40.111380+0000","last_peered":"2024-04-25T22:44:39.106441+0000","last_clean":"2024-04-25T22:41:34.256374+0000","last_became_active":"2024-04-25T22:44:37.114258+0000","last_became_peered":"2024-04-25T22:44:37.114258+0000","last_unstale":"2024-04-25T22:44:40.111380+0000","last_undegraded":"2024-04-25T22:44:40.111380+0000","last_fullsized":"2024-04-25T22:44:40.111380+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8396,"num_write":399,"num_write_kb":50416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"72'499","reported_seq":672,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.107540+0000","last_change":"2024-04-25T22:44:39.149280+0000","last_active":"2024-04-25T22:44:40.107540+0000","last_peered":"2024-04-25T22:44:40.107540+0000","last_clean":"2024-04-25T22:44:40.107540+0000","last_became_active":"2024-04-25T22:44:39.143391+0000","last_became_peered":"2024-04-25T22:44:39.143391+0000","last_unstale":"2024-04-25T22:44:40.107540+0000","last_undegraded":"2024-04-25T22:44:40.107540+0000","last_fullsized":"2024-04-25T22:44:40.107540+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:54:10.301144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10227,"num_write":453,"num_write_kb":96585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'430","reported_seq":1044,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.111614+0000","last_change":"2024-04-25T22:44:39.113437+0000","last_active":"2024-04-25T22:44:40.111614+0000","last_peered":"2024-04-25T22:44:40.111614+0000","last_clean":"2024-04-25T22:44:40.111614+0000","last_became_active":"2024-04-25T22:44:39.109771+0000","last_became_peered":"2024-04-25T22:44:39.109771+0000","last_unstale":"2024-04-25T22:44:40.111614+0000","last_undegraded":"2024-04-25T22:44:40.111614+0000","last_fullsized":"2024-04-25T22:44:40.111614+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:40:46.739897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":32116,"num_write":409,"num_write_kb":89217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"72'393","reported_seq":946,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.108331+0000","last_change":"2024-04-25T22:44:37.108331+0000","last_active":"2024-04-25T22:44:37.108331+0000","last_peered":"2024-04-25T22:44:37.108331+0000","last_clean":"2024-04-25T22:44:37.108331+0000","last_became_active":"2024-04-25T22:44:37.100491+0000","last_became_peered":"2024-04-25T22:44:37.100491+0000","last_unstale":"2024-04-25T22:44:37.108331+0000","last_undegraded":"2024-04-25T22:44:37.108331+0000","last_fullsized":"2024-04-25T22:44:37.108331+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:48.521828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":28076,"num_write":364,"num_write_kb":47473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"72'399","reported_seq":955,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.124745+0000","last_change":"2024-04-25T22:44:40.124745+0000","last_active":"2024-04-25T22:44:40.124745+0000","last_peered":"2024-04-25T22:44:40.124745+0000","last_clean":"2024-04-25T22:44:40.124745+0000","last_became_active":"2024-04-25T22:44:40.121838+0000","last_became_peered":"2024-04-25T22:44:40.121838+0000","last_unstale":"2024-04-25T22:44:40.124745+0000","last_undegraded":"2024-04-25T22:44:40.124745+0000","last_fullsized":"2024-04-25T22:44:40.124745+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:28.299317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14005,"num_write":367,"num_write_kb":58883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"72'484","reported_seq":697,"reported_epoch":94,"state":"remapped+peering","last_fresh":"2024-04-25T22:44:40.108393+0000","last_change":"2024-04-25T22:44:40.108393+0000","last_active":"2024-04-25T22:44:40.108393+0000","last_peered":"2024-04-25T22:44:39.107198+0000","last_clean":"2024-04-25T22:41:34.255390+0000","last_became_active":"2024-04-25T22:44:37.115335+0000","last_became_peered":"2024-04-25T22:44:37.115335+0000","last_unstale":"2024-04-25T22:44:40.108393+0000","last_undegraded":"2024-04-25T22:44:40.108393+0000","last_fullsized":"2024-04-25T22:44:40.108393+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23352,"num_write":446,"num_write_kb":100094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"72'455","reported_seq":1098,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.100035+0000","last_change":"2024-04-25T22:44:33.087211+0000","last_active":"2024-04-25T22:44:40.100035+0000","last_peered":"2024-04-25T22:44:40.100035+0000","last_clean":"2024-04-25T22:44:40.100035+0000","last_became_active":"2024-04-25T22:44:33.084127+0000","last_became_peered":"2024-04-25T22:44:33.084127+0000","last_unstale":"2024-04-25T22:44:40.100035+0000","last_undegraded":"2024-04-25T22:44:40.100035+0000","last_fullsized":"2024-04-25T22:44:40.100035+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38440,"num_write":423,"num_write_kb":71855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"72'434","reported_seq":630,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.107948+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:44:40.107948+0000","last_peered":"2024-04-25T22:44:40.107948+0000","last_clean":"2024-04-25T22:44:40.107948+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:44:40.107948+0000","last_undegraded":"2024-04-25T22:44:40.107948+0000","last_fullsized":"2024-04-25T22:44:40.107948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18701,"num_write":402,"num_write_kb":27564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"72'379","reported_seq":539,"reported_epoch":94,"state":"remapped+peering","last_fresh":"2024-04-25T22:44:40.103295+0000","last_change":"2024-04-25T22:44:40.103295+0000","last_active":"2024-04-25T22:44:40.103295+0000","last_peered":"2024-04-25T22:44:39.118016+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:39.109569+0000","last_became_peered":"2024-04-25T22:44:39.109569+0000","last_unstale":"2024-04-25T22:44:40.103295+0000","last_undegraded":"2024-04-25T22:44:40.103295+0000","last_fullsized":"2024-04-25T22:44:40.103295+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18623,"num_write":344,"num_write_kb":50888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"71'528","reported_seq":692,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.110747+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:44:40.110747+0000","last_peered":"2024-04-25T22:44:40.110747+0000","last_clean":"2024-04-25T22:44:40.110747+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:44:40.110747+0000","last_undegraded":"2024-04-25T22:44:40.110747+0000","last_fullsized":"2024-04-25T22:44:40.110747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"72'383","reported_seq":526,"reported_epoch":94,"state":"remapped+peering","last_fresh":"2024-04-25T22:44:40.106908+0000","last_change":"2024-04-25T22:44:40.106908+0000","last_active":"2024-04-25T22:44:40.106908+0000","last_peered":"2024-04-25T22:44:39.126828+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:39.110060+0000","last_became_peered":"2024-04-25T22:44:39.110060+0000","last_unstale":"2024-04-25T22:44:40.106908+0000","last_undegraded":"2024-04-25T22:44:40.106908+0000","last_fullsized":"2024-04-25T22:44:40.106908+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8364,"num_write":351,"num_write_kb":30625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"71'45","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.101360+0000","last_change":"2024-04-25T22:44:39.117622+0000","last_active":"2024-04-25T22:44:40.101360+0000","last_peered":"2024-04-25T22:44:40.101360+0000","last_clean":"2024-04-25T22:44:40.101360+0000","last_became_active":"2024-04-25T22:44:39.115669+0000","last_became_peered":"2024-04-25T22:44:39.115669+0000","last_unstale":"2024-04-25T22:44:40.101360+0000","last_undegraded":"2024-04-25T22:44:40.101360+0000","last_fullsized":"2024-04-25T22:44:40.101360+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:21.793820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"72'429","reported_seq":593,"reported_epoch":94,"state":"remapped+peering","last_fresh":"2024-04-25T22:44:40.111091+0000","last_change":"2024-04-25T22:44:40.111091+0000","last_active":"2024-04-25T22:44:40.111091+0000","last_peered":"2024-04-25T22:44:39.146385+0000","last_clean":"2024-04-25T22:44:24.311958+0000","last_became_active":"2024-04-25T22:44:39.133620+0000","last_became_peered":"2024-04-25T22:44:39.133620+0000","last_unstale":"2024-04-25T22:44:40.111091+0000","last_undegraded":"2024-04-25T22:44:40.111091+0000","last_fullsized":"2024-04-25T22:44:40.111091+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16584,"num_write":393,"num_write_kb":63712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'61","reported_seq":197,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.127336+0000","last_change":"2024-04-25T22:44:37.127336+0000","last_active":"2024-04-25T22:44:37.127336+0000","last_peered":"2024-04-25T22:44:37.127336+0000","last_clean":"2024-04-25T22:44:37.127336+0000","last_became_active":"2024-04-25T22:44:37.125592+0000","last_became_peered":"2024-04-25T22:44:37.125592+0000","last_unstale":"2024-04-25T22:44:37.127336+0000","last_undegraded":"2024-04-25T22:44:37.127336+0000","last_fullsized":"2024-04-25T22:44:37.127336+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:27.270332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"72'404","reported_seq":586,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.101866+0000","last_change":"2024-04-25T22:44:39.128428+0000","last_active":"2024-04-25T22:44:40.101866+0000","last_peered":"2024-04-25T22:44:40.101866+0000","last_clean":"2024-04-25T22:44:40.101866+0000","last_became_active":"2024-04-25T22:44:39.116562+0000","last_became_peered":"2024-04-25T22:44:39.116562+0000","last_unstale":"2024-04-25T22:44:40.101866+0000","last_undegraded":"2024-04-25T22:44:40.101866+0000","last_fullsized":"2024-04-25T22:44:40.101866+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:09.750726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18745,"num_write":376,"num_write_kb":96145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'71","reported_seq":243,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.107126+0000","last_change":"2024-04-25T22:44:26.363329+0000","last_active":"2024-04-25T22:44:40.107126+0000","last_peered":"2024-04-25T22:44:40.107126+0000","last_clean":"2024-04-25T22:44:40.107126+0000","last_became_active":"2024-04-25T22:44:26.362499+0000","last_became_peered":"2024-04-25T22:44:26.362499+0000","last_unstale":"2024-04-25T22:44:40.107126+0000","last_undegraded":"2024-04-25T22:44:40.107126+0000","last_fullsized":"2024-04-25T22:44:40.107126+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'145","reported_seq":323,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.112030+0000","last_change":"2024-04-25T22:44:29.400540+0000","last_active":"2024-04-25T22:44:40.112030+0000","last_peered":"2024-04-25T22:44:40.112030+0000","last_clean":"2024-04-25T22:44:40.112030+0000","last_became_active":"2024-04-25T22:44:29.399853+0000","last_became_peered":"2024-04-25T22:44:29.399853+0000","last_unstale":"2024-04-25T22:44:40.112030+0000","last_undegraded":"2024-04-25T22:44:40.112030+0000","last_fullsized":"2024-04-25T22:44:40.112030+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"72'399","reported_seq":603,"reported_epoch":94,"state":"remapped+peering","last_fresh":"2024-04-25T22:44:40.105732+0000","last_change":"2024-04-25T22:44:40.105732+0000","last_active":"2024-04-25T22:44:40.105732+0000","last_peered":"2024-04-25T22:44:39.102564+0000","last_clean":"2024-04-25T22:41:34.254259+0000","last_became_active":"2024-04-25T22:44:37.105680+0000","last_became_peered":"2024-04-25T22:44:37.105680+0000","last_unstale":"2024-04-25T22:44:40.105732+0000","last_undegraded":"2024-04-25T22:44:40.105732+0000","last_fullsized":"2024-04-25T22:44:40.105732+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25159,"num_write":363,"num_write_kb":34063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'226","reported_seq":382,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.113648+0000","last_change":"2024-04-25T22:44:37.113648+0000","last_active":"2024-04-25T22:44:37.113648+0000","last_peered":"2024-04-25T22:44:37.113648+0000","last_clean":"2024-04-25T22:44:37.113648+0000","last_became_active":"2024-04-25T22:44:37.109354+0000","last_became_peered":"2024-04-25T22:44:37.109354+0000","last_unstale":"2024-04-25T22:44:37.113648+0000","last_undegraded":"2024-04-25T22:44:37.113648+0000","last_fullsized":"2024-04-25T22:44:37.113648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:32.428982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"72'431","reported_seq":597,"reported_epoch":94,"state":"remapped+peering","last_fresh":"2024-04-25T22:44:40.102010+0000","last_change":"2024-04-25T22:44:40.102010+0000","last_active":"2024-04-25T22:44:40.102010+0000","last_peered":"2024-04-25T22:44:39.131968+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:39.115063+0000","last_became_peered":"2024-04-25T22:44:39.115063+0000","last_unstale":"2024-04-25T22:44:40.102010+0000","last_undegraded":"2024-04-25T22:44:40.102010+0000","last_fullsized":"2024-04-25T22:44:40.102010+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14688,"num_write":405,"num_write_kb":38957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"71'382","reported_seq":560,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.114349+0000","last_change":"2024-04-25T22:44:30.401893+0000","last_active":"2024-04-25T22:44:40.114349+0000","last_peered":"2024-04-25T22:44:40.114349+0000","last_clean":"2024-04-25T22:44:40.114349+0000","last_became_active":"2024-04-25T22:44:30.401021+0000","last_became_peered":"2024-04-25T22:44:30.401021+0000","last_unstale":"2024-04-25T22:44:40.114349+0000","last_undegraded":"2024-04-25T22:44:40.114349+0000","last_fullsized":"2024-04-25T22:44:40.114349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:38.452482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'453","reported_seq":647,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.109042+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:44:40.109042+0000","last_peered":"2024-04-25T22:44:40.109042+0000","last_clean":"2024-04-25T22:44:40.109042+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:44:40.109042+0000","last_undegraded":"2024-04-25T22:44:40.109042+0000","last_fullsized":"2024-04-25T22:44:40.109042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18900,"num_write":418,"num_write_kb":117500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"71'64","reported_seq":228,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.111221+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:44:40.111221+0000","last_peered":"2024-04-25T22:44:40.111221+0000","last_clean":"2024-04-25T22:44:40.111221+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:44:40.111221+0000","last_undegraded":"2024-04-25T22:44:40.111221+0000","last_fullsized":"2024-04-25T22:44:40.111221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'428","reported_seq":592,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.106013+0000","last_change":"2024-04-25T22:44:39.129871+0000","last_active":"2024-04-25T22:44:40.106013+0000","last_peered":"2024-04-25T22:44:40.106013+0000","last_clean":"2024-04-25T22:44:40.106013+0000","last_became_active":"2024-04-25T22:44:39.121205+0000","last_became_peered":"2024-04-25T22:44:39.121205+0000","last_unstale":"2024-04-25T22:44:40.106013+0000","last_undegraded":"2024-04-25T22:44:40.106013+0000","last_fullsized":"2024-04-25T22:44:40.106013+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:48.521828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7477,"num_write":383,"num_write_kb":9617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'166","reported_seq":283,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.106481+0000","last_change":"2024-04-25T22:44:39.133550+0000","last_active":"2024-04-25T22:44:40.106481+0000","last_peered":"2024-04-25T22:44:40.106481+0000","last_clean":"2024-04-25T22:44:40.106481+0000","last_became_active":"2024-04-25T22:44:39.131489+0000","last_became_peered":"2024-04-25T22:44:39.131489+0000","last_unstale":"2024-04-25T22:44:40.106481+0000","last_undegraded":"2024-04-25T22:44:40.106481+0000","last_fullsized":"2024-04-25T22:44:40.106481+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:32.980801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"72'446","reported_seq":657,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.110741+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:44:40.110741+0000","last_peered":"2024-04-25T22:44:40.110741+0000","last_clean":"2024-04-25T22:44:40.110741+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:44:40.110741+0000","last_undegraded":"2024-04-25T22:44:40.110741+0000","last_fullsized":"2024-04-25T22:44:40.110741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27788,"num_write":414,"num_write_kb":47058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"71'113","reported_seq":278,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.110138+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:44:40.110138+0000","last_peered":"2024-04-25T22:44:40.110138+0000","last_clean":"2024-04-25T22:44:40.110138+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:44:40.110138+0000","last_undegraded":"2024-04-25T22:44:40.110138+0000","last_fullsized":"2024-04-25T22:44:40.110138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"72'417","reported_seq":609,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:40.111962+0000","last_change":"2024-04-25T22:44:27.929243+0000","last_active":"2024-04-25T22:44:40.111962+0000","last_peered":"2024-04-25T22:44:40.111962+0000","last_clean":"2024-04-25T22:41:34.256785+0000","last_became_active":"2024-04-25T22:44:27.921914+0000","last_became_peered":"2024-04-25T22:44:27.921914+0000","last_unstale":"2024-04-25T22:44:40.111962+0000","last_undegraded":"2024-04-25T22:44:27.383160+0000","last_fullsized":"2024-04-25T22:44:27.380722+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16487,"num_write":388,"num_write_kb":75452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'59","reported_seq":195,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.125505+0000","last_change":"2024-04-25T22:44:37.125505+0000","last_active":"2024-04-25T22:44:37.125505+0000","last_peered":"2024-04-25T22:44:37.125505+0000","last_clean":"2024-04-25T22:44:37.125505+0000","last_became_active":"2024-04-25T22:44:37.115248+0000","last_became_peered":"2024-04-25T22:44:37.115248+0000","last_unstale":"2024-04-25T22:44:37.125505+0000","last_undegraded":"2024-04-25T22:44:37.125505+0000","last_fullsized":"2024-04-25T22:44:37.125505+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:49:53.613641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"72'358","reported_seq":861,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.107689+0000","last_change":"2024-04-25T22:44:34.101942+0000","last_active":"2024-04-25T22:44:40.107689+0000","last_peered":"2024-04-25T22:44:40.107689+0000","last_clean":"2024-04-25T22:44:40.107689+0000","last_became_active":"2024-04-25T22:44:34.099595+0000","last_became_peered":"2024-04-25T22:44:34.099595+0000","last_unstale":"2024-04-25T22:44:40.107689+0000","last_undegraded":"2024-04-25T22:44:40.107689+0000","last_fullsized":"2024-04-25T22:44:40.107689+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:06.523166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12259,"num_write":325,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'465","reported_seq":590,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:37.367145+0000","last_change":"2024-04-25T22:44:40.397873+0000","last_active":"2024-04-25T22:44:40.397873+0000","last_peered":"2024-04-25T22:44:37.367145+0000","last_clean":"2024-04-25T22:44:37.367145+0000","last_became_active":"2024-04-25T22:44:29.681106+0000","last_became_peered":"2024-04-25T22:44:29.681106+0000","last_unstale":"2024-04-25T22:44:37.367145+0000","last_undegraded":"2024-04-25T22:44:37.367145+0000","last_fullsized":"2024-04-25T22:44:37.367145+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"72'386","reported_seq":573,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:40.102226+0000","last_change":"2024-04-25T22:44:27.932877+0000","last_active":"2024-04-25T22:44:40.102226+0000","last_peered":"2024-04-25T22:44:40.102226+0000","last_clean":"2024-04-25T22:41:33.341615+0000","last_became_active":"2024-04-25T22:44:27.913881+0000","last_became_peered":"2024-04-25T22:44:27.913881+0000","last_unstale":"2024-04-25T22:44:40.102226+0000","last_undegraded":"2024-04-25T22:44:27.377759+0000","last_fullsized":"2024-04-25T22:44:27.352221+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9402,"num_write":352,"num_write_kb":50548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":380,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.108290+0000","last_change":"2024-04-25T22:44:26.355770+0000","last_active":"2024-04-25T22:44:40.108290+0000","last_peered":"2024-04-25T22:44:40.108290+0000","last_clean":"2024-04-25T22:44:40.108290+0000","last_became_active":"2024-04-25T22:44:26.354730+0000","last_became_peered":"2024-04-25T22:44:26.354730+0000","last_unstale":"2024-04-25T22:44:40.108290+0000","last_undegraded":"2024-04-25T22:44:40.108290+0000","last_fullsized":"2024-04-25T22:44:40.108290+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:34.987031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.111811+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:44:40.111811+0000","last_peered":"2024-04-25T22:44:40.111811+0000","last_clean":"2024-04-25T22:44:40.111811+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:44:40.111811+0000","last_undegraded":"2024-04-25T22:44:40.111811+0000","last_fullsized":"2024-04-25T22:44:40.111811+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"71'457","reported_seq":638,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.101855+0000","last_change":"2024-04-25T22:44:29.399148+0000","last_active":"2024-04-25T22:44:40.101855+0000","last_peered":"2024-04-25T22:44:40.101855+0000","last_clean":"2024-04-25T22:44:40.101855+0000","last_became_active":"2024-04-25T22:44:29.397962+0000","last_became_peered":"2024-04-25T22:44:29.397962+0000","last_unstale":"2024-04-25T22:44:40.101855+0000","last_undegraded":"2024-04-25T22:44:40.101855+0000","last_fullsized":"2024-04-25T22:44:40.101855+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:14.015619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"72'447","reported_seq":694,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:40.113641+0000","last_change":"2024-04-25T22:44:27.929083+0000","last_active":"2024-04-25T22:44:40.113641+0000","last_peered":"2024-04-25T22:44:40.113641+0000","last_clean":"2024-04-25T22:41:34.256933+0000","last_became_active":"2024-04-25T22:44:27.920076+0000","last_became_peered":"2024-04-25T22:44:27.920076+0000","last_unstale":"2024-04-25T22:44:40.113641+0000","last_undegraded":"2024-04-25T22:44:27.385746+0000","last_fullsized":"2024-04-25T22:44:27.382933+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":186,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45074,"num_write":414,"num_write_kb":120596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.107709+0000","last_change":"2024-04-25T22:44:26.355238+0000","last_active":"2024-04-25T22:44:40.107709+0000","last_peered":"2024-04-25T22:44:40.107709+0000","last_clean":"2024-04-25T22:44:40.107709+0000","last_became_active":"2024-04-25T22:44:26.354482+0000","last_became_peered":"2024-04-25T22:44:26.354482+0000","last_unstale":"2024-04-25T22:44:40.107709+0000","last_undegraded":"2024-04-25T22:44:40.107709+0000","last_fullsized":"2024-04-25T22:44:40.107709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.042514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'122","reported_seq":302,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.102348+0000","last_change":"2024-04-25T22:44:39.141843+0000","last_active":"2024-04-25T22:44:40.102348+0000","last_peered":"2024-04-25T22:44:40.102348+0000","last_clean":"2024-04-25T22:44:40.102348+0000","last_became_active":"2024-04-25T22:44:39.139689+0000","last_became_peered":"2024-04-25T22:44:39.139689+0000","last_unstale":"2024-04-25T22:44:40.102348+0000","last_undegraded":"2024-04-25T22:44:40.102348+0000","last_fullsized":"2024-04-25T22:44:40.102348+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:18.614670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":62,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"72'449","reported_seq":608,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:37.369353+0000","last_change":"2024-04-25T22:44:40.403253+0000","last_active":"2024-04-25T22:44:40.403253+0000","last_peered":"2024-04-25T22:44:37.369353+0000","last_clean":"2024-04-25T22:44:37.369353+0000","last_became_active":"2024-04-25T22:44:36.396927+0000","last_became_peered":"2024-04-25T22:44:36.396927+0000","last_unstale":"2024-04-25T22:44:37.369353+0000","last_undegraded":"2024-04-25T22:44:37.369353+0000","last_fullsized":"2024-04-25T22:44:37.369353+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25191,"num_write":420,"num_write_kb":79855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.102654+0000","last_change":"2024-04-25T22:44:26.363464+0000","last_active":"2024-04-25T22:44:40.102654+0000","last_peered":"2024-04-25T22:44:40.102654+0000","last_clean":"2024-04-25T22:44:40.102654+0000","last_became_active":"2024-04-25T22:44:26.362808+0000","last_became_peered":"2024-04-25T22:44:26.362808+0000","last_unstale":"2024-04-25T22:44:40.102654+0000","last_undegraded":"2024-04-25T22:44:40.102654+0000","last_fullsized":"2024-04-25T22:44:40.102654+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:06.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'435","reported_seq":587,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.117095+0000","last_change":"2024-04-25T22:44:37.105559+0000","last_active":"2024-04-25T22:44:37.117095+0000","last_peered":"2024-04-25T22:44:37.117095+0000","last_clean":"2024-04-25T22:44:37.117095+0000","last_became_active":"2024-04-25T22:44:37.099207+0000","last_became_peered":"2024-04-25T22:44:37.099207+0000","last_unstale":"2024-04-25T22:44:37.117095+0000","last_undegraded":"2024-04-25T22:44:37.117095+0000","last_fullsized":"2024-04-25T22:44:37.117095+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:53:04.083054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"72'337","reported_seq":549,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:40.102352+0000","last_change":"2024-04-25T22:44:27.932720+0000","last_active":"2024-04-25T22:44:40.102352+0000","last_peered":"2024-04-25T22:44:40.102352+0000","last_clean":"2024-04-25T22:41:33.341668+0000","last_became_active":"2024-04-25T22:44:27.914069+0000","last_became_peered":"2024-04-25T22:44:27.914069+0000","last_unstale":"2024-04-25T22:44:40.102352+0000","last_undegraded":"2024-04-25T22:44:27.381554+0000","last_fullsized":"2024-04-25T22:44:27.374715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":147,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25242,"num_write":307,"num_write_kb":26250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.110509+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:44:40.110509+0000","last_peered":"2024-04-25T22:44:40.110509+0000","last_clean":"2024-04-25T22:44:40.110509+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:44:40.110509+0000","last_undegraded":"2024-04-25T22:44:40.110509+0000","last_fullsized":"2024-04-25T22:44:40.110509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"71'61","reported_seq":226,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.113048+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:44:40.113048+0000","last_peered":"2024-04-25T22:44:40.113048+0000","last_clean":"2024-04-25T22:44:40.113048+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:44:40.113048+0000","last_undegraded":"2024-04-25T22:44:40.113048+0000","last_fullsized":"2024-04-25T22:44:40.113048+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'404","reported_seq":978,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.104221+0000","last_change":"2024-04-25T22:44:32.092728+0000","last_active":"2024-04-25T22:44:40.104221+0000","last_peered":"2024-04-25T22:44:40.104221+0000","last_clean":"2024-04-25T22:44:40.104221+0000","last_became_active":"2024-04-25T22:44:32.087528+0000","last_became_peered":"2024-04-25T22:44:32.087528+0000","last_unstale":"2024-04-25T22:44:40.104221+0000","last_undegraded":"2024-04-25T22:44:40.104221+0000","last_fullsized":"2024-04-25T22:44:40.104221+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:39.481467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":20287,"num_write":371,"num_write_kb":59919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'285","reported_seq":450,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.114342+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:44:40.114342+0000","last_peered":"2024-04-25T22:44:40.114342+0000","last_clean":"2024-04-25T22:44:40.114342+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:44:40.114342+0000","last_undegraded":"2024-04-25T22:44:40.114342+0000","last_fullsized":"2024-04-25T22:44:40.114342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.104841+0000","last_change":"2024-04-25T22:44:26.364185+0000","last_active":"2024-04-25T22:44:40.104841+0000","last_peered":"2024-04-25T22:44:40.104841+0000","last_clean":"2024-04-25T22:44:40.104841+0000","last_became_active":"2024-04-25T22:44:26.363583+0000","last_became_peered":"2024-04-25T22:44:26.363583+0000","last_unstale":"2024-04-25T22:44:40.104841+0000","last_undegraded":"2024-04-25T22:44:40.104841+0000","last_fullsized":"2024-04-25T22:44:40.104841+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:35:04.325449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"72'366","reported_seq":532,"reported_epoch":94,"state":"remapped+peering","last_fresh":"2024-04-25T22:44:40.106183+0000","last_change":"2024-04-25T22:44:40.106183+0000","last_active":"2024-04-25T22:44:40.106183+0000","last_peered":"2024-04-25T22:44:39.104615+0000","last_clean":"2024-04-25T22:41:34.254671+0000","last_became_active":"2024-04-25T22:44:37.103023+0000","last_became_peered":"2024-04-25T22:44:37.103023+0000","last_unstale":"2024-04-25T22:44:40.106183+0000","last_undegraded":"2024-04-25T22:44:40.106183+0000","last_fullsized":"2024-04-25T22:44:40.106183+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":346,"num_write":330,"num_write_kb":33934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":227,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.104580+0000","last_change":"2024-04-25T22:44:26.364178+0000","last_active":"2024-04-25T22:44:40.104580+0000","last_peered":"2024-04-25T22:44:40.104580+0000","last_clean":"2024-04-25T22:44:40.104580+0000","last_became_active":"2024-04-25T22:44:26.363455+0000","last_became_peered":"2024-04-25T22:44:26.363455+0000","last_unstale":"2024-04-25T22:44:40.104580+0000","last_undegraded":"2024-04-25T22:44:40.104580+0000","last_fullsized":"2024-04-25T22:44:40.104580+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:58.181763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":93,"state":"peering","last_fresh":"2024-04-25T22:44:39.100875+0000","last_change":"2024-04-25T22:44:26.632763+0000","last_active":"2024-04-25T22:44:26.632763+0000","last_peered":"2024-04-25T22:44:24.310757+0000","last_clean":"2024-04-25T22:40:08.425969+0000","last_became_active":"2024-04-25T22:41:35.381219+0000","last_became_peered":"2024-04-25T22:41:35.381219+0000","last_unstale":"2024-04-25T22:44:39.100875+0000","last_undegraded":"2024-04-25T22:44:39.100875+0000","last_fullsized":"2024-04-25T22:44:39.100875+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'413","reported_seq":700,"reported_epoch":94,"state":"remapped+peering","last_fresh":"2024-04-25T22:44:40.106357+0000","last_change":"2024-04-25T22:44:40.106357+0000","last_active":"2024-04-25T22:44:40.106357+0000","last_peered":"2024-04-25T22:44:39.103803+0000","last_clean":"2024-04-25T22:41:34.255399+0000","last_became_active":"2024-04-25T22:44:37.118801+0000","last_became_peered":"2024-04-25T22:44:37.118801+0000","last_unstale":"2024-04-25T22:44:40.106357+0000","last_undegraded":"2024-04-25T22:44:40.106357+0000","last_fullsized":"2024-04-25T22:44:40.106357+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22994,"num_write":377,"num_write_kb":63140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"72'57","reported_seq":231,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.106144+0000","last_change":"2024-04-25T22:44:26.366189+0000","last_active":"2024-04-25T22:44:40.106144+0000","last_peered":"2024-04-25T22:44:40.106144+0000","last_clean":"2024-04-25T22:44:40.106144+0000","last_became_active":"2024-04-25T22:44:26.365267+0000","last_became_peered":"2024-04-25T22:44:26.365267+0000","last_unstale":"2024-04-25T22:44:40.106144+0000","last_undegraded":"2024-04-25T22:44:40.106144+0000","last_fullsized":"2024-04-25T22:44:40.106144+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:54.128937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.110392+0000","last_change":"2024-04-25T22:44:26.361633+0000","last_active":"2024-04-25T22:44:40.110392+0000","last_peered":"2024-04-25T22:44:40.110392+0000","last_clean":"2024-04-25T22:44:40.110392+0000","last_became_active":"2024-04-25T22:44:26.360968+0000","last_became_peered":"2024-04-25T22:44:26.360968+0000","last_unstale":"2024-04-25T22:44:40.110392+0000","last_undegraded":"2024-04-25T22:44:40.110392+0000","last_fullsized":"2024-04-25T22:44:40.110392+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:40.454898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'398","reported_seq":561,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.102544+0000","last_change":"2024-04-25T22:44:39.132801+0000","last_active":"2024-04-25T22:44:40.102544+0000","last_peered":"2024-04-25T22:44:40.102544+0000","last_clean":"2024-04-25T22:44:40.102544+0000","last_became_active":"2024-04-25T22:44:39.124378+0000","last_became_peered":"2024-04-25T22:44:39.124378+0000","last_unstale":"2024-04-25T22:44:40.102544+0000","last_undegraded":"2024-04-25T22:44:40.102544+0000","last_fullsized":"2024-04-25T22:44:40.102544+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:29.195889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6306,"num_write":372,"num_write_kb":34077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'100","reported_seq":268,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.110316+0000","last_change":"2024-04-25T22:44:39.150245+0000","last_active":"2024-04-25T22:44:40.110316+0000","last_peered":"2024-04-25T22:44:40.110316+0000","last_clean":"2024-04-25T22:44:40.110316+0000","last_became_active":"2024-04-25T22:44:39.147377+0000","last_became_peered":"2024-04-25T22:44:39.147377+0000","last_unstale":"2024-04-25T22:44:40.110316+0000","last_undegraded":"2024-04-25T22:44:40.110316+0000","last_fullsized":"2024-04-25T22:44:40.110316+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:36.007978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.113120+0000","last_change":"2024-04-25T22:44:26.360890+0000","last_active":"2024-04-25T22:44:40.113120+0000","last_peered":"2024-04-25T22:44:40.113120+0000","last_clean":"2024-04-25T22:44:40.113120+0000","last_became_active":"2024-04-25T22:44:26.360106+0000","last_became_peered":"2024-04-25T22:44:26.360106+0000","last_unstale":"2024-04-25T22:44:40.113120+0000","last_undegraded":"2024-04-25T22:44:40.113120+0000","last_fullsized":"2024-04-25T22:44:40.113120+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:09.929196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'390","reported_seq":577,"reported_epoch":94,"state":"peering","last_fresh":"2024-04-25T22:44:40.394943+0000","last_change":"2024-04-25T22:44:40.394943+0000","last_active":"2024-04-25T22:44:26.341716+0000","last_peered":"2024-04-25T22:44:24.309629+0000","last_clean":"2024-04-25T22:41:34.254462+0000","last_became_active":"2024-04-25T22:41:35.384292+0000","last_became_peered":"2024-04-25T22:41:35.384292+0000","last_unstale":"2024-04-25T22:44:40.394943+0000","last_undegraded":"2024-04-25T22:44:40.394943+0000","last_fullsized":"2024-04-25T22:44:40.394943+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":22915,"num_write":352,"num_write_kb":47201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"72'411","reported_seq":969,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.109953+0000","last_change":"2024-04-25T22:44:32.090492+0000","last_active":"2024-04-25T22:44:40.109953+0000","last_peered":"2024-04-25T22:44:40.109953+0000","last_clean":"2024-04-25T22:44:40.109953+0000","last_became_active":"2024-04-25T22:44:32.087303+0000","last_became_peered":"2024-04-25T22:44:32.087303+0000","last_unstale":"2024-04-25T22:44:40.109953+0000","last_undegraded":"2024-04-25T22:44:40.109953+0000","last_fullsized":"2024-04-25T22:44:40.109953+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25412,"num_write":367,"num_write_kb":64656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'268","reported_seq":450,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.111069+0000","last_change":"2024-04-25T22:44:29.399184+0000","last_active":"2024-04-25T22:44:40.111069+0000","last_peered":"2024-04-25T22:44:40.111069+0000","last_clean":"2024-04-25T22:44:40.111069+0000","last_became_active":"2024-04-25T22:44:29.398317+0000","last_became_peered":"2024-04-25T22:44:29.398317+0000","last_unstale":"2024-04-25T22:44:40.111069+0000","last_undegraded":"2024-04-25T22:44:40.111069+0000","last_fullsized":"2024-04-25T22:44:40.111069+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:21.765162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382817,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"72'423","reported_seq":962,"reported_epoch":94,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-25T22:44:40.865400+0000","last_change":"2024-04-25T22:44:40.172402+0000","last_active":"2024-04-25T22:44:40.865400+0000","last_peered":"2024-04-25T22:44:40.865400+0000","last_clean":"2024-04-25T22:41:33.340293+0000","last_became_active":"2024-04-25T22:44:27.916257+0000","last_became_peered":"2024-04-25T22:44:27.916257+0000","last_unstale":"2024-04-25T22:44:40.865400+0000","last_undegraded":"2024-04-25T22:44:40.865400+0000","last_fullsized":"2024-04-25T22:44:27.346172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24794,"num_write":386,"num_write_kb":63756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'102","reported_seq":245,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.111783+0000","last_change":"2024-04-25T22:44:37.111783+0000","last_active":"2024-04-25T22:44:37.111783+0000","last_peered":"2024-04-25T22:44:37.111783+0000","last_clean":"2024-04-25T22:44:37.111783+0000","last_became_active":"2024-04-25T22:44:37.109678+0000","last_became_peered":"2024-04-25T22:44:37.109678+0000","last_unstale":"2024-04-25T22:44:37.111783+0000","last_undegraded":"2024-04-25T22:44:37.111783+0000","last_fullsized":"2024-04-25T22:44:37.111783+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:32.980801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'213","reported_seq":377,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.110157+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:44:40.110157+0000","last_peered":"2024-04-25T22:44:40.110157+0000","last_clean":"2024-04-25T22:44:40.110157+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:44:40.110157+0000","last_undegraded":"2024-04-25T22:44:40.110157+0000","last_fullsized":"2024-04-25T22:44:40.110157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"72'504","reported_seq":730,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.100127+0000","last_change":"2024-04-25T22:44:39.142694+0000","last_active":"2024-04-25T22:44:40.100127+0000","last_peered":"2024-04-25T22:44:40.100127+0000","last_clean":"2024-04-25T22:44:40.100127+0000","last_became_active":"2024-04-25T22:44:39.132582+0000","last_became_peered":"2024-04-25T22:44:39.132582+0000","last_unstale":"2024-04-25T22:44:40.100127+0000","last_undegraded":"2024-04-25T22:44:40.100127+0000","last_fullsized":"2024-04-25T22:44:40.100127+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:14.401644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":46975,"num_write":471,"num_write_kb":146290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'64","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.104203+0000","last_change":"2024-04-25T22:44:39.136961+0000","last_active":"2024-04-25T22:44:40.104203+0000","last_peered":"2024-04-25T22:44:40.104203+0000","last_clean":"2024-04-25T22:44:40.104203+0000","last_became_active":"2024-04-25T22:44:39.136090+0000","last_became_peered":"2024-04-25T22:44:39.136090+0000","last_unstale":"2024-04-25T22:44:40.104203+0000","last_undegraded":"2024-04-25T22:44:40.104203+0000","last_fullsized":"2024-04-25T22:44:40.104203+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:35.220314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"72'475","reported_seq":702,"reported_epoch":94,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:40.101753+0000","last_change":"2024-04-25T22:44:27.928280+0000","last_active":"2024-04-25T22:44:40.101753+0000","last_peered":"2024-04-25T22:44:40.101753+0000","last_clean":"2024-04-25T22:41:33.339970+0000","last_became_active":"2024-04-25T22:44:27.916087+0000","last_became_peered":"2024-04-25T22:44:27.916087+0000","last_unstale":"2024-04-25T22:44:40.101753+0000","last_undegraded":"2024-04-25T22:44:27.377976+0000","last_fullsized":"2024-04-25T22:44:27.357937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":203,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":23011,"num_write":448,"num_write_kb":76439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"72'370","reported_seq":585,"reported_epoch":94,"state":"remapped+peering","last_fresh":"2024-04-25T22:44:40.111335+0000","last_change":"2024-04-25T22:44:40.111335+0000","last_active":"2024-04-25T22:44:40.111335+0000","last_peered":"2024-04-25T22:44:39.106610+0000","last_clean":"2024-04-25T22:41:34.256787+0000","last_became_active":"2024-04-25T22:44:37.113783+0000","last_became_peered":"2024-04-25T22:44:37.113783+0000","last_unstale":"2024-04-25T22:44:40.111335+0000","last_undegraded":"2024-04-25T22:44:40.111335+0000","last_fullsized":"2024-04-25T22:44:40.111335+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33211,"num_write":340,"num_write_kb":63312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'647","reported_seq":827,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.102841+0000","last_change":"2024-04-25T22:44:30.396965+0000","last_active":"2024-04-25T22:44:40.102841+0000","last_peered":"2024-04-25T22:44:40.102841+0000","last_clean":"2024-04-25T22:44:40.102841+0000","last_became_active":"2024-04-25T22:44:30.396073+0000","last_became_peered":"2024-04-25T22:44:30.396073+0000","last_unstale":"2024-04-25T22:44:40.102841+0000","last_undegraded":"2024-04-25T22:44:40.102841+0000","last_fullsized":"2024-04-25T22:44:40.102841+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"72'415","reported_seq":598,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.107678+0000","last_change":"2024-04-25T22:44:39.150290+0000","last_active":"2024-04-25T22:44:40.107678+0000","last_peered":"2024-04-25T22:44:40.107678+0000","last_clean":"2024-04-25T22:44:40.107678+0000","last_became_active":"2024-04-25T22:44:39.146949+0000","last_became_peered":"2024-04-25T22:44:39.146949+0000","last_unstale":"2024-04-25T22:44:40.107678+0000","last_undegraded":"2024-04-25T22:44:40.107678+0000","last_fullsized":"2024-04-25T22:44:40.107678+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:11.804350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19493,"num_write":386,"num_write_kb":64692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'207","reported_seq":324,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.101790+0000","last_change":"2024-04-25T22:44:39.141125+0000","last_active":"2024-04-25T22:44:40.101790+0000","last_peered":"2024-04-25T22:44:40.101790+0000","last_clean":"2024-04-25T22:44:40.101790+0000","last_became_active":"2024-04-25T22:44:39.138371+0000","last_became_peered":"2024-04-25T22:44:39.138371+0000","last_unstale":"2024-04-25T22:44:40.101790+0000","last_undegraded":"2024-04-25T22:44:40.101790+0000","last_fullsized":"2024-04-25T22:44:40.101790+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:14.147026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"72'395","reported_seq":578,"reported_epoch":94,"state":"remapped+peering","last_fresh":"2024-04-25T22:44:40.110736+0000","last_change":"2024-04-25T22:44:40.110736+0000","last_active":"2024-04-25T22:44:40.110736+0000","last_peered":"2024-04-25T22:44:39.106436+0000","last_clean":"2024-04-25T22:41:34.256072+0000","last_became_active":"2024-04-25T22:44:37.108883+0000","last_became_peered":"2024-04-25T22:44:37.108883+0000","last_unstale":"2024-04-25T22:44:40.110736+0000","last_undegraded":"2024-04-25T22:44:40.110736+0000","last_fullsized":"2024-04-25T22:44:40.110736+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9576,"num_write":348,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"72'194","reported_seq":319,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:37.367018+0000","last_change":"2024-04-25T22:44:40.397359+0000","last_active":"2024-04-25T22:44:40.397359+0000","last_peered":"2024-04-25T22:44:37.367018+0000","last_clean":"2024-04-25T22:44:37.367018+0000","last_became_active":"2024-04-25T22:44:29.680841+0000","last_became_peered":"2024-04-25T22:44:29.680841+0000","last_unstale":"2024-04-25T22:44:37.367018+0000","last_undegraded":"2024-04-25T22:44:37.367018+0000","last_fullsized":"2024-04-25T22:44:37.367018+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360511,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":12143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12360511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"72'398","reported_seq":604,"reported_epoch":94,"state":"remapped+peering","last_fresh":"2024-04-25T22:44:40.106175+0000","last_change":"2024-04-25T22:44:40.106175+0000","last_active":"2024-04-25T22:44:40.106175+0000","last_peered":"2024-04-25T22:44:39.118957+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:39.111648+0000","last_became_peered":"2024-04-25T22:44:39.111648+0000","last_unstale":"2024-04-25T22:44:40.106175+0000","last_undegraded":"2024-04-25T22:44:40.106175+0000","last_fullsized":"2024-04-25T22:44:40.106175+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31284,"num_write":371,"num_write_kb":80144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"71'51","reported_seq":186,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.121915+0000","last_change":"2024-04-25T22:44:37.121915+0000","last_active":"2024-04-25T22:44:37.121915+0000","last_peered":"2024-04-25T22:44:37.121915+0000","last_clean":"2024-04-25T22:44:37.121915+0000","last_became_active":"2024-04-25T22:44:37.119258+0000","last_became_peered":"2024-04-25T22:44:37.119258+0000","last_unstale":"2024-04-25T22:44:37.121915+0000","last_undegraded":"2024-04-25T22:44:37.121915+0000","last_fullsized":"2024-04-25T22:44:37.121915+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:18.614670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"72'383","reported_seq":597,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.109252+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:44:40.109252+0000","last_peered":"2024-04-25T22:44:40.109252+0000","last_clean":"2024-04-25T22:44:40.109252+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:44:40.109252+0000","last_undegraded":"2024-04-25T22:44:40.109252+0000","last_fullsized":"2024-04-25T22:44:40.109252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29308,"num_write":358,"num_write_kb":66975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"71'177","reported_seq":341,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.110900+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:44:40.110900+0000","last_peered":"2024-04-25T22:44:40.110900+0000","last_clean":"2024-04-25T22:44:40.110900+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:44:40.110900+0000","last_undegraded":"2024-04-25T22:44:40.110900+0000","last_fullsized":"2024-04-25T22:44:40.110900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"72'387","reported_seq":562,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.109435+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:44:40.109435+0000","last_peered":"2024-04-25T22:44:40.109435+0000","last_clean":"2024-04-25T22:44:40.109435+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:44:40.109435+0000","last_undegraded":"2024-04-25T22:44:40.109435+0000","last_fullsized":"2024-04-25T22:44:40.109435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3883,"num_write":348,"num_write_kb":34122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'209","reported_seq":371,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.108618+0000","last_change":"2024-04-25T22:44:37.108618+0000","last_active":"2024-04-25T22:44:37.108618+0000","last_peered":"2024-04-25T22:44:37.108618+0000","last_clean":"2024-04-25T22:44:37.108618+0000","last_became_active":"2024-04-25T22:44:37.106658+0000","last_became_peered":"2024-04-25T22:44:37.106658+0000","last_unstale":"2024-04-25T22:44:37.108618+0000","last_undegraded":"2024-04-25T22:44:37.108618+0000","last_fullsized":"2024-04-25T22:44:37.108618+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:14.067851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":12363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"72'419","reported_seq":563,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:37.376631+0000","last_change":"2024-04-25T22:44:40.396292+0000","last_active":"2024-04-25T22:44:40.396292+0000","last_peered":"2024-04-25T22:44:37.376631+0000","last_clean":"2024-04-25T22:44:37.376631+0000","last_became_active":"2024-04-25T22:44:37.370586+0000","last_became_peered":"2024-04-25T22:44:37.370586+0000","last_unstale":"2024-04-25T22:44:37.376631+0000","last_undegraded":"2024-04-25T22:44:37.376631+0000","last_fullsized":"2024-04-25T22:44:37.376631+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":13327,"num_write":388,"num_write_kb":55674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"71'131","reported_seq":311,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.107989+0000","last_change":"2024-04-25T22:44:29.398880+0000","last_active":"2024-04-25T22:44:40.107989+0000","last_peered":"2024-04-25T22:44:40.107989+0000","last_clean":"2024-04-25T22:44:40.107989+0000","last_became_active":"2024-04-25T22:44:29.397905+0000","last_became_peered":"2024-04-25T22:44:29.397905+0000","last_unstale":"2024-04-25T22:44:40.107989+0000","last_undegraded":"2024-04-25T22:44:40.107989+0000","last_fullsized":"2024-04-25T22:44:40.107989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:44.236330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"72'449","reported_seq":645,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.107427+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:44:40.107427+0000","last_peered":"2024-04-25T22:44:40.107427+0000","last_clean":"2024-04-25T22:44:40.107427+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:44:40.107427+0000","last_undegraded":"2024-04-25T22:44:40.107427+0000","last_fullsized":"2024-04-25T22:44:40.107427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14222,"num_write":424,"num_write_kb":79796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"71'57","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T22:44:40.103061+0000","last_change":"2024-04-25T22:44:39.137232+0000","last_active":"2024-04-25T22:44:40.103061+0000","last_peered":"2024-04-25T22:44:40.103061+0000","last_clean":"2024-04-25T22:44:40.103061+0000","last_became_active":"2024-04-25T22:44:39.136283+0000","last_became_peered":"2024-04-25T22:44:39.136283+0000","last_unstale":"2024-04-25T22:44:40.103061+0000","last_undegraded":"2024-04-25T22:44:40.103061+0000","last_fullsized":"2024-04-25T22:44:40.103061+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:32.428982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1239,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2461,"num_read_kb":1248646,"num_write":24434,"num_write_kb":4137258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3024,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26539,"ondisk_log_size":26539,"up":128,"acting":101,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127071275,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":4473,"num_write_kb":127409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79463584,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254210048,"data_stored":254142550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},"log_size":6216,"ondisk_log_size":6216,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165124,"kb_used_data":79856,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94206716,"statfs":{"total":96636764160,"available":96467677184,"internally_reserved":0,"allocated":81772544,"data_stored":81325411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":79,"seq":339302416389,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118984,"kb_used_data":83128,"kb_used_omap":5,"kb_used_meta":35834,"kb_avail":94252856,"statfs":{"total":96636764160,"available":96514924544,"internally_reserved":0,"allocated":85123072,"data_stored":84652208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6003,"internal_metadata":36694157},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174132,"kb_used_data":88864,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94197708,"statfs":{"total":96636764160,"available":96458452992,"internally_reserved":0,"allocated":90996736,"data_stored":90527642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89575424,"data_stored":89544940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83689472,"data_stored":83664533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80945152,"data_stored":80933077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:44:42.916 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:44:43.263 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:44:43.265 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:44:43.283 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-04-25T22:44:43.236378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127661643,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3832,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2659,"num_read_kb":1250233,"num_write":29110,"num_write_kb":4268127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3464,"num_bytes_recovered":79463584,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32912,"ondisk_log_size":32912,"up":210,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":458280,"kb_used_data":251896,"kb_used_omap":8,"kb_used_meta":206327,"kb_avail":282657240,"statfs":{"total":289910292480,"available":289441013760,"internally_reserved":0,"allocated":257941504,"data_stored":256525095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9193,"internal_metadata":211278871},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2006,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1889,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001198"},"pg_stats":[{"pgid":"4.3f","version":"72'404","reported_seq":588,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.088901+0000","last_change":"2024-04-25T22:44:41.145114+0000","last_active":"2024-04-25T22:44:42.088901+0000","last_peered":"2024-04-25T22:44:42.088901+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.142277+0000","last_became_peered":"2024-04-25T22:44:41.142277+0000","last_unstale":"2024-04-25T22:44:42.088901+0000","last_undegraded":"2024-04-25T22:44:41.121372+0000","last_fullsized":"2024-04-25T22:44:41.120599+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19772,"num_write":366,"num_write_kb":46873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"72'420","reported_seq":578,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:37.369026+0000","last_change":"2024-04-25T22:44:40.395075+0000","last_active":"2024-04-25T22:44:40.395075+0000","last_peered":"2024-04-25T22:44:37.369026+0000","last_clean":"2024-04-25T22:44:37.369026+0000","last_became_active":"2024-04-25T22:44:35.395973+0000","last_became_peered":"2024-04-25T22:44:35.395973+0000","last_unstale":"2024-04-25T22:44:37.369026+0000","last_undegraded":"2024-04-25T22:44:37.369026+0000","last_fullsized":"2024-04-25T22:44:37.369026+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24515,"num_write":386,"num_write_kb":55688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"72'377","reported_seq":918,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.096911+0000","last_change":"2024-04-25T22:44:42.096911+0000","last_active":"2024-04-25T22:44:42.096911+0000","last_peered":"2024-04-25T22:44:42.096911+0000","last_clean":"2024-04-25T22:44:42.096911+0000","last_became_active":"2024-04-25T22:44:42.093941+0000","last_became_peered":"2024-04-25T22:44:42.093941+0000","last_unstale":"2024-04-25T22:44:42.096911+0000","last_undegraded":"2024-04-25T22:44:42.096911+0000","last_fullsized":"2024-04-25T22:44:42.096911+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11135,"num_write":346,"num_write_kb":38950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"72'366","reported_seq":539,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087879+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:44:42.087879+0000","last_peered":"2024-04-25T22:44:42.087879+0000","last_clean":"2024-04-25T22:44:42.087879+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:44:42.087879+0000","last_undegraded":"2024-04-25T22:44:42.087879+0000","last_fullsized":"2024-04-25T22:44:42.087879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":326,"num_write_kb":34079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"72'455","reported_seq":650,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.085443+0000","last_change":"2024-04-25T22:44:41.134406+0000","last_active":"2024-04-25T22:44:42.085443+0000","last_peered":"2024-04-25T22:44:42.085443+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130077+0000","last_became_peered":"2024-04-25T22:44:41.130077+0000","last_unstale":"2024-04-25T22:44:42.085443+0000","last_undegraded":"2024-04-25T22:44:41.117231+0000","last_fullsized":"2024-04-25T22:44:41.116610+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33897,"num_write":426,"num_write_kb":100721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"72'401","reported_seq":601,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086851+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:44:42.086851+0000","last_peered":"2024-04-25T22:44:42.086851+0000","last_clean":"2024-04-25T22:44:42.086851+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:44:42.086851+0000","last_undegraded":"2024-04-25T22:44:42.086851+0000","last_fullsized":"2024-04-25T22:44:42.086851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15258,"num_write":369,"num_write_kb":53298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"72'452","reported_seq":684,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086442+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:44:42.086442+0000","last_peered":"2024-04-25T22:44:42.086442+0000","last_clean":"2024-04-25T22:44:42.086442+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:44:42.086442+0000","last_undegraded":"2024-04-25T22:44:42.086442+0000","last_fullsized":"2024-04-25T22:44:42.086442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34010,"num_write":428,"num_write_kb":157752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"72'401","reported_seq":606,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.085837+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:44:42.085837+0000","last_peered":"2024-04-25T22:44:42.085837+0000","last_clean":"2024-04-25T22:44:42.085837+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:44:42.085837+0000","last_undegraded":"2024-04-25T22:44:42.085837+0000","last_fullsized":"2024-04-25T22:44:42.085837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19917,"num_write":359,"num_write_kb":109382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"72'394","reported_seq":583,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.087682+0000","last_change":"2024-04-25T22:44:27.933160+0000","last_active":"2024-04-25T22:44:42.087682+0000","last_peered":"2024-04-25T22:44:42.087682+0000","last_clean":"2024-04-25T22:41:33.341370+0000","last_became_active":"2024-04-25T22:44:27.927304+0000","last_became_peered":"2024-04-25T22:44:27.927304+0000","last_unstale":"2024-04-25T22:44:42.087682+0000","last_undegraded":"2024-04-25T22:44:27.369434+0000","last_fullsized":"2024-04-25T22:44:27.345517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9569,"num_write":360,"num_write_kb":25560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"72'382","reported_seq":522,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:36.706732+0000","last_change":"2024-04-25T22:44:40.396212+0000","last_active":"2024-04-25T22:44:40.396212+0000","last_peered":"2024-04-25T22:44:36.706732+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:27.909822+0000","last_became_peered":"2024-04-25T22:44:27.909822+0000","last_unstale":"2024-04-25T22:44:36.706732+0000","last_undegraded":"2024-04-25T22:44:36.706732+0000","last_fullsized":"2024-04-25T22:44:27.348732+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17192,"num_write":338,"num_write_kb":38688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"72'369","reported_seq":558,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089014+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:44:42.089014+0000","last_peered":"2024-04-25T22:44:42.089014+0000","last_clean":"2024-04-25T22:44:42.089014+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:44:42.089014+0000","last_undegraded":"2024-04-25T22:44:42.089014+0000","last_fullsized":"2024-04-25T22:44:42.089014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7385,"num_write":349,"num_write_kb":58842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"72'338","reported_seq":537,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.086765+0000","last_change":"2024-04-25T22:44:41.137110+0000","last_active":"2024-04-25T22:44:42.086765+0000","last_peered":"2024-04-25T22:44:42.086765+0000","last_clean":"2024-04-25T22:41:34.255048+0000","last_became_active":"2024-04-25T22:44:41.133243+0000","last_became_peered":"2024-04-25T22:44:41.133243+0000","last_unstale":"2024-04-25T22:44:42.086765+0000","last_undegraded":"2024-04-25T22:44:41.118173+0000","last_fullsized":"2024-04-25T22:44:41.117638+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":151,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13619,"num_write":312,"num_write_kb":21391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"72'411","reported_seq":561,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:37.367999+0000","last_change":"2024-04-25T22:44:40.404787+0000","last_active":"2024-04-25T22:44:40.404787+0000","last_peered":"2024-04-25T22:44:37.367999+0000","last_clean":"2024-04-25T22:44:37.367999+0000","last_became_active":"2024-04-25T22:44:30.683328+0000","last_became_peered":"2024-04-25T22:44:30.683328+0000","last_unstale":"2024-04-25T22:44:37.367999+0000","last_undegraded":"2024-04-25T22:44:37.367999+0000","last_fullsized":"2024-04-25T22:44:37.367999+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12998,"num_write":375,"num_write_kb":79661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"72'452","reported_seq":1016,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087164+0000","last_change":"2024-04-25T22:44:40.130299+0000","last_active":"2024-04-25T22:44:42.087164+0000","last_peered":"2024-04-25T22:44:42.087164+0000","last_clean":"2024-04-25T22:44:42.087164+0000","last_became_active":"2024-04-25T22:44:40.127307+0000","last_became_peered":"2024-04-25T22:44:40.127307+0000","last_unstale":"2024-04-25T22:44:42.087164+0000","last_undegraded":"2024-04-25T22:44:42.087164+0000","last_fullsized":"2024-04-25T22:44:42.087164+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:16.746830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":854,"num_write":419,"num_write_kb":88217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"72'428","reported_seq":996,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086764+0000","last_change":"2024-04-25T22:44:35.108361+0000","last_active":"2024-04-25T22:44:42.086764+0000","last_peered":"2024-04-25T22:44:42.086764+0000","last_clean":"2024-04-25T22:44:42.086764+0000","last_became_active":"2024-04-25T22:44:35.103208+0000","last_became_peered":"2024-04-25T22:44:35.103208+0000","last_unstale":"2024-04-25T22:44:42.086764+0000","last_undegraded":"2024-04-25T22:44:42.086764+0000","last_fullsized":"2024-04-25T22:44:42.086764+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:22.046332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21291,"num_write":389,"num_write_kb":68562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"72'401","reported_seq":580,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086149+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:44:42.086149+0000","last_peered":"2024-04-25T22:44:42.086149+0000","last_clean":"2024-04-25T22:44:42.086149+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:44:42.086149+0000","last_undegraded":"2024-04-25T22:44:42.086149+0000","last_fullsized":"2024-04-25T22:44:42.086149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8276,"num_write":369,"num_write_kb":17867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"72'398","reported_seq":579,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.089606+0000","last_change":"2024-04-25T22:44:27.936766+0000","last_active":"2024-04-25T22:44:42.089606+0000","last_peered":"2024-04-25T22:44:42.089606+0000","last_clean":"2024-04-25T22:41:33.342064+0000","last_became_active":"2024-04-25T22:44:27.932101+0000","last_became_peered":"2024-04-25T22:44:27.932101+0000","last_unstale":"2024-04-25T22:44:42.089606+0000","last_undegraded":"2024-04-25T22:44:27.388123+0000","last_fullsized":"2024-04-25T22:44:27.382718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":175,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5883,"num_write":362,"num_write_kb":38188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"72'407","reported_seq":576,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.088041+0000","last_change":"2024-04-25T22:44:41.159724+0000","last_active":"2024-04-25T22:44:42.088041+0000","last_peered":"2024-04-25T22:44:42.088041+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.154547+0000","last_became_peered":"2024-04-25T22:44:41.154547+0000","last_unstale":"2024-04-25T22:44:42.088041+0000","last_undegraded":"2024-04-25T22:44:41.121499+0000","last_fullsized":"2024-04-25T22:44:41.120885+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13073,"num_write":372,"num_write_kb":59323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"72'441","reported_seq":1024,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086175+0000","last_change":"2024-04-25T22:44:41.148409+0000","last_active":"2024-04-25T22:44:42.086175+0000","last_peered":"2024-04-25T22:44:42.086175+0000","last_clean":"2024-04-25T22:44:42.086175+0000","last_became_active":"2024-04-25T22:44:41.143302+0000","last_became_peered":"2024-04-25T22:44:41.143302+0000","last_unstale":"2024-04-25T22:44:42.086175+0000","last_undegraded":"2024-04-25T22:44:42.086175+0000","last_fullsized":"2024-04-25T22:44:42.086175+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:46.289713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37611,"num_write":403,"num_write_kb":116618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"72'438","reported_seq":629,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088188+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:44:42.088188+0000","last_peered":"2024-04-25T22:44:42.088188+0000","last_clean":"2024-04-25T22:44:42.088188+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:44:42.088188+0000","last_undegraded":"2024-04-25T22:44:42.088188+0000","last_fullsized":"2024-04-25T22:44:42.088188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12393,"num_write":408,"num_write_kb":99933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"72'407","reported_seq":587,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087699+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:44:42.087699+0000","last_peered":"2024-04-25T22:44:42.087699+0000","last_clean":"2024-04-25T22:44:42.087699+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:44:42.087699+0000","last_undegraded":"2024-04-25T22:44:42.087699+0000","last_fullsized":"2024-04-25T22:44:42.087699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8932,"num_write":382,"num_write_kb":59684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"72'463","reported_seq":700,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.086051+0000","last_change":"2024-04-25T22:44:41.132736+0000","last_active":"2024-04-25T22:44:42.086051+0000","last_peered":"2024-04-25T22:44:42.086051+0000","last_clean":"2024-04-25T22:41:34.254643+0000","last_became_active":"2024-04-25T22:44:41.129315+0000","last_became_peered":"2024-04-25T22:44:41.129315+0000","last_unstale":"2024-04-25T22:44:42.086051+0000","last_undegraded":"2024-04-25T22:44:41.117085+0000","last_fullsized":"2024-04-25T22:44:41.116491+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27589,"num_write":428,"num_write_kb":76861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"72'425","reported_seq":659,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.084155+0000","last_change":"2024-04-25T22:44:39.132230+0000","last_active":"2024-04-25T22:44:42.084155+0000","last_peered":"2024-04-25T22:44:42.084155+0000","last_clean":"2024-04-25T22:44:42.084155+0000","last_became_active":"2024-04-25T22:44:39.118635+0000","last_became_peered":"2024-04-25T22:44:39.118635+0000","last_unstale":"2024-04-25T22:44:42.084155+0000","last_undegraded":"2024-04-25T22:44:42.084155+0000","last_fullsized":"2024-04-25T22:44:42.084155+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:15.096836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":46424,"num_write":390,"num_write_kb":96359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"72'445","reported_seq":642,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.084451+0000","last_change":"2024-04-25T22:44:41.135696+0000","last_active":"2024-04-25T22:44:42.084451+0000","last_peered":"2024-04-25T22:44:42.084451+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130730+0000","last_became_peered":"2024-04-25T22:44:41.130730+0000","last_unstale":"2024-04-25T22:44:42.084451+0000","last_undegraded":"2024-04-25T22:44:41.116994+0000","last_fullsized":"2024-04-25T22:44:41.116354+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32317,"num_write":419,"num_write_kb":76071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"72'424","reported_seq":606,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.087863+0000","last_change":"2024-04-25T22:44:41.138549+0000","last_active":"2024-04-25T22:44:42.087863+0000","last_peered":"2024-04-25T22:44:42.087863+0000","last_clean":"2024-04-25T22:41:34.256374+0000","last_became_active":"2024-04-25T22:44:41.133640+0000","last_became_peered":"2024-04-25T22:44:41.133640+0000","last_unstale":"2024-04-25T22:44:42.087863+0000","last_undegraded":"2024-04-25T22:44:41.120823+0000","last_fullsized":"2024-04-25T22:44:41.120131+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8396,"num_write":399,"num_write_kb":50416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"72'499","reported_seq":676,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087727+0000","last_change":"2024-04-25T22:44:39.149280+0000","last_active":"2024-04-25T22:44:42.087727+0000","last_peered":"2024-04-25T22:44:42.087727+0000","last_clean":"2024-04-25T22:44:42.087727+0000","last_became_active":"2024-04-25T22:44:39.143391+0000","last_became_peered":"2024-04-25T22:44:39.143391+0000","last_unstale":"2024-04-25T22:44:42.087727+0000","last_undegraded":"2024-04-25T22:44:42.087727+0000","last_fullsized":"2024-04-25T22:44:42.087727+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:54:10.301144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10227,"num_write":453,"num_write_kb":96585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'430","reported_seq":1048,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089442+0000","last_change":"2024-04-25T22:44:39.113437+0000","last_active":"2024-04-25T22:44:42.089442+0000","last_peered":"2024-04-25T22:44:42.089442+0000","last_clean":"2024-04-25T22:44:42.089442+0000","last_became_active":"2024-04-25T22:44:39.109771+0000","last_became_peered":"2024-04-25T22:44:39.109771+0000","last_unstale":"2024-04-25T22:44:42.089442+0000","last_undegraded":"2024-04-25T22:44:42.089442+0000","last_fullsized":"2024-04-25T22:44:42.089442+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:40:46.739897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":32116,"num_write":409,"num_write_kb":89217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"72'393","reported_seq":946,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.108331+0000","last_change":"2024-04-25T22:44:37.108331+0000","last_active":"2024-04-25T22:44:37.108331+0000","last_peered":"2024-04-25T22:44:37.108331+0000","last_clean":"2024-04-25T22:44:37.108331+0000","last_became_active":"2024-04-25T22:44:37.100491+0000","last_became_peered":"2024-04-25T22:44:37.100491+0000","last_unstale":"2024-04-25T22:44:37.108331+0000","last_undegraded":"2024-04-25T22:44:37.108331+0000","last_fullsized":"2024-04-25T22:44:37.108331+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:48.521828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":28076,"num_write":364,"num_write_kb":47473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"72'399","reported_seq":959,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086271+0000","last_change":"2024-04-25T22:44:40.124745+0000","last_active":"2024-04-25T22:44:42.086271+0000","last_peered":"2024-04-25T22:44:42.086271+0000","last_clean":"2024-04-25T22:44:42.086271+0000","last_became_active":"2024-04-25T22:44:40.121838+0000","last_became_peered":"2024-04-25T22:44:40.121838+0000","last_unstale":"2024-04-25T22:44:42.086271+0000","last_undegraded":"2024-04-25T22:44:42.086271+0000","last_fullsized":"2024-04-25T22:44:42.086271+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:28.299317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14005,"num_write":367,"num_write_kb":58883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"72'484","reported_seq":705,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.086723+0000","last_change":"2024-04-25T22:44:41.147898+0000","last_active":"2024-04-25T22:44:42.086723+0000","last_peered":"2024-04-25T22:44:42.086723+0000","last_clean":"2024-04-25T22:41:34.255390+0000","last_became_active":"2024-04-25T22:44:41.144605+0000","last_became_peered":"2024-04-25T22:44:41.144605+0000","last_unstale":"2024-04-25T22:44:42.086723+0000","last_undegraded":"2024-04-25T22:44:41.118456+0000","last_fullsized":"2024-04-25T22:44:41.117828+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":208,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23352,"num_write":446,"num_write_kb":100094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"72'455","reported_seq":1102,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.084361+0000","last_change":"2024-04-25T22:44:33.087211+0000","last_active":"2024-04-25T22:44:42.084361+0000","last_peered":"2024-04-25T22:44:42.084361+0000","last_clean":"2024-04-25T22:44:42.084361+0000","last_became_active":"2024-04-25T22:44:33.084127+0000","last_became_peered":"2024-04-25T22:44:33.084127+0000","last_unstale":"2024-04-25T22:44:42.084361+0000","last_undegraded":"2024-04-25T22:44:42.084361+0000","last_fullsized":"2024-04-25T22:44:42.084361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38440,"num_write":423,"num_write_kb":71855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"72'434","reported_seq":634,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086411+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:44:42.086411+0000","last_peered":"2024-04-25T22:44:42.086411+0000","last_clean":"2024-04-25T22:44:42.086411+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:44:42.086411+0000","last_undegraded":"2024-04-25T22:44:42.086411+0000","last_fullsized":"2024-04-25T22:44:42.086411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18701,"num_write":402,"num_write_kb":27564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"72'379","reported_seq":547,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.086370+0000","last_change":"2024-04-25T22:44:41.134849+0000","last_active":"2024-04-25T22:44:42.086370+0000","last_peered":"2024-04-25T22:44:42.086370+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130604+0000","last_became_peered":"2024-04-25T22:44:41.130604+0000","last_unstale":"2024-04-25T22:44:42.086370+0000","last_undegraded":"2024-04-25T22:44:41.118062+0000","last_fullsized":"2024-04-25T22:44:41.117484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18623,"num_write":344,"num_write_kb":50888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"71'528","reported_seq":696,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088190+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:44:42.088190+0000","last_peered":"2024-04-25T22:44:42.088190+0000","last_clean":"2024-04-25T22:44:42.088190+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:44:42.088190+0000","last_undegraded":"2024-04-25T22:44:42.088190+0000","last_fullsized":"2024-04-25T22:44:42.088190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"72'383","reported_seq":534,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.085100+0000","last_change":"2024-04-25T22:44:41.148275+0000","last_active":"2024-04-25T22:44:42.085100+0000","last_peered":"2024-04-25T22:44:42.085100+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.142954+0000","last_became_peered":"2024-04-25T22:44:41.142954+0000","last_unstale":"2024-04-25T22:44:42.085100+0000","last_undegraded":"2024-04-25T22:44:41.119000+0000","last_fullsized":"2024-04-25T22:44:41.118353+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8364,"num_write":351,"num_write_kb":30625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"71'45","reported_seq":166,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.085312+0000","last_change":"2024-04-25T22:44:39.117622+0000","last_active":"2024-04-25T22:44:42.085312+0000","last_peered":"2024-04-25T22:44:42.085312+0000","last_clean":"2024-04-25T22:44:42.085312+0000","last_became_active":"2024-04-25T22:44:39.115669+0000","last_became_peered":"2024-04-25T22:44:39.115669+0000","last_unstale":"2024-04-25T22:44:42.085312+0000","last_undegraded":"2024-04-25T22:44:42.085312+0000","last_fullsized":"2024-04-25T22:44:42.085312+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:21.793820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"72'429","reported_seq":601,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.088350+0000","last_change":"2024-04-25T22:44:41.157231+0000","last_active":"2024-04-25T22:44:42.088350+0000","last_peered":"2024-04-25T22:44:42.088350+0000","last_clean":"2024-04-25T22:44:24.311958+0000","last_became_active":"2024-04-25T22:44:41.154517+0000","last_became_peered":"2024-04-25T22:44:41.154517+0000","last_unstale":"2024-04-25T22:44:42.088350+0000","last_undegraded":"2024-04-25T22:44:41.121712+0000","last_fullsized":"2024-04-25T22:44:41.121143+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16584,"num_write":393,"num_write_kb":63712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'61","reported_seq":197,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.127336+0000","last_change":"2024-04-25T22:44:37.127336+0000","last_active":"2024-04-25T22:44:37.127336+0000","last_peered":"2024-04-25T22:44:37.127336+0000","last_clean":"2024-04-25T22:44:37.127336+0000","last_became_active":"2024-04-25T22:44:37.125592+0000","last_became_peered":"2024-04-25T22:44:37.125592+0000","last_unstale":"2024-04-25T22:44:37.127336+0000","last_undegraded":"2024-04-25T22:44:37.127336+0000","last_fullsized":"2024-04-25T22:44:37.127336+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:27.270332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"72'404","reported_seq":590,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087721+0000","last_change":"2024-04-25T22:44:39.128428+0000","last_active":"2024-04-25T22:44:42.087721+0000","last_peered":"2024-04-25T22:44:42.087721+0000","last_clean":"2024-04-25T22:44:42.087721+0000","last_became_active":"2024-04-25T22:44:39.116562+0000","last_became_peered":"2024-04-25T22:44:39.116562+0000","last_unstale":"2024-04-25T22:44:42.087721+0000","last_undegraded":"2024-04-25T22:44:42.087721+0000","last_fullsized":"2024-04-25T22:44:42.087721+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:09.750726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18745,"num_write":376,"num_write_kb":96145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'71","reported_seq":247,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087388+0000","last_change":"2024-04-25T22:44:26.363329+0000","last_active":"2024-04-25T22:44:42.087388+0000","last_peered":"2024-04-25T22:44:42.087388+0000","last_clean":"2024-04-25T22:44:42.087388+0000","last_became_active":"2024-04-25T22:44:26.362499+0000","last_became_peered":"2024-04-25T22:44:26.362499+0000","last_unstale":"2024-04-25T22:44:42.087388+0000","last_undegraded":"2024-04-25T22:44:42.087388+0000","last_fullsized":"2024-04-25T22:44:42.087388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'145","reported_seq":327,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089705+0000","last_change":"2024-04-25T22:44:29.400540+0000","last_active":"2024-04-25T22:44:42.089705+0000","last_peered":"2024-04-25T22:44:42.089705+0000","last_clean":"2024-04-25T22:44:42.089705+0000","last_became_active":"2024-04-25T22:44:29.399853+0000","last_became_peered":"2024-04-25T22:44:29.399853+0000","last_unstale":"2024-04-25T22:44:42.089705+0000","last_undegraded":"2024-04-25T22:44:42.089705+0000","last_fullsized":"2024-04-25T22:44:42.089705+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"72'399","reported_seq":611,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.085642+0000","last_change":"2024-04-25T22:44:41.132315+0000","last_active":"2024-04-25T22:44:42.085642+0000","last_peered":"2024-04-25T22:44:42.085642+0000","last_clean":"2024-04-25T22:41:34.254259+0000","last_became_active":"2024-04-25T22:44:41.129040+0000","last_became_peered":"2024-04-25T22:44:41.129040+0000","last_unstale":"2024-04-25T22:44:42.085642+0000","last_undegraded":"2024-04-25T22:44:41.116129+0000","last_fullsized":"2024-04-25T22:44:41.115733+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25159,"num_write":363,"num_write_kb":34063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'226","reported_seq":382,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.113648+0000","last_change":"2024-04-25T22:44:37.113648+0000","last_active":"2024-04-25T22:44:37.113648+0000","last_peered":"2024-04-25T22:44:37.113648+0000","last_clean":"2024-04-25T22:44:37.113648+0000","last_became_active":"2024-04-25T22:44:37.109354+0000","last_became_peered":"2024-04-25T22:44:37.109354+0000","last_unstale":"2024-04-25T22:44:37.113648+0000","last_undegraded":"2024-04-25T22:44:37.113648+0000","last_fullsized":"2024-04-25T22:44:37.113648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:32.428982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"72'431","reported_seq":605,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.084707+0000","last_change":"2024-04-25T22:44:41.136042+0000","last_active":"2024-04-25T22:44:42.084707+0000","last_peered":"2024-04-25T22:44:42.084707+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130862+0000","last_became_peered":"2024-04-25T22:44:41.130862+0000","last_unstale":"2024-04-25T22:44:42.084707+0000","last_undegraded":"2024-04-25T22:44:41.117168+0000","last_fullsized":"2024-04-25T22:44:41.116538+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14688,"num_write":405,"num_write_kb":38957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"71'382","reported_seq":564,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.090283+0000","last_change":"2024-04-25T22:44:30.401893+0000","last_active":"2024-04-25T22:44:42.090283+0000","last_peered":"2024-04-25T22:44:42.090283+0000","last_clean":"2024-04-25T22:44:42.090283+0000","last_became_active":"2024-04-25T22:44:30.401021+0000","last_became_peered":"2024-04-25T22:44:30.401021+0000","last_unstale":"2024-04-25T22:44:42.090283+0000","last_undegraded":"2024-04-25T22:44:42.090283+0000","last_fullsized":"2024-04-25T22:44:42.090283+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:38.452482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'453","reported_seq":651,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087593+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:44:42.087593+0000","last_peered":"2024-04-25T22:44:42.087593+0000","last_clean":"2024-04-25T22:44:42.087593+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:44:42.087593+0000","last_undegraded":"2024-04-25T22:44:42.087593+0000","last_fullsized":"2024-04-25T22:44:42.087593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18900,"num_write":418,"num_write_kb":117500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"71'64","reported_seq":232,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088847+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:44:42.088847+0000","last_peered":"2024-04-25T22:44:42.088847+0000","last_clean":"2024-04-25T22:44:42.088847+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:44:42.088847+0000","last_undegraded":"2024-04-25T22:44:42.088847+0000","last_fullsized":"2024-04-25T22:44:42.088847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'428","reported_seq":596,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086469+0000","last_change":"2024-04-25T22:44:39.129871+0000","last_active":"2024-04-25T22:44:42.086469+0000","last_peered":"2024-04-25T22:44:42.086469+0000","last_clean":"2024-04-25T22:44:42.086469+0000","last_became_active":"2024-04-25T22:44:39.121205+0000","last_became_peered":"2024-04-25T22:44:39.121205+0000","last_unstale":"2024-04-25T22:44:42.086469+0000","last_undegraded":"2024-04-25T22:44:42.086469+0000","last_fullsized":"2024-04-25T22:44:42.086469+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:48.521828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7477,"num_write":383,"num_write_kb":9617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'166","reported_seq":287,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086749+0000","last_change":"2024-04-25T22:44:39.133550+0000","last_active":"2024-04-25T22:44:42.086749+0000","last_peered":"2024-04-25T22:44:42.086749+0000","last_clean":"2024-04-25T22:44:42.086749+0000","last_became_active":"2024-04-25T22:44:39.131489+0000","last_became_peered":"2024-04-25T22:44:39.131489+0000","last_unstale":"2024-04-25T22:44:42.086749+0000","last_undegraded":"2024-04-25T22:44:42.086749+0000","last_fullsized":"2024-04-25T22:44:42.086749+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:32.980801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"72'446","reported_seq":661,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088397+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:44:42.088397+0000","last_peered":"2024-04-25T22:44:42.088397+0000","last_clean":"2024-04-25T22:44:42.088397+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:44:42.088397+0000","last_undegraded":"2024-04-25T22:44:42.088397+0000","last_fullsized":"2024-04-25T22:44:42.088397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27788,"num_write":414,"num_write_kb":47058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"71'113","reported_seq":282,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088223+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:44:42.088223+0000","last_peered":"2024-04-25T22:44:42.088223+0000","last_clean":"2024-04-25T22:44:42.088223+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:44:42.088223+0000","last_undegraded":"2024-04-25T22:44:42.088223+0000","last_fullsized":"2024-04-25T22:44:42.088223+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"72'417","reported_seq":636,"reported_epoch":96,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-25T22:44:42.260259+0000","last_change":"2024-04-25T22:44:42.218982+0000","last_active":"2024-04-25T22:44:42.260259+0000","last_peered":"2024-04-25T22:44:42.260259+0000","last_clean":"2024-04-25T22:41:34.256785+0000","last_became_active":"2024-04-25T22:44:27.921914+0000","last_became_peered":"2024-04-25T22:44:27.921914+0000","last_unstale":"2024-04-25T22:44:42.260259+0000","last_undegraded":"2024-04-25T22:44:42.260259+0000","last_fullsized":"2024-04-25T22:44:27.380722+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16487,"num_write":388,"num_write_kb":75452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'59","reported_seq":195,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.125505+0000","last_change":"2024-04-25T22:44:37.125505+0000","last_active":"2024-04-25T22:44:37.125505+0000","last_peered":"2024-04-25T22:44:37.125505+0000","last_clean":"2024-04-25T22:44:37.125505+0000","last_became_active":"2024-04-25T22:44:37.115248+0000","last_became_peered":"2024-04-25T22:44:37.115248+0000","last_unstale":"2024-04-25T22:44:37.125505+0000","last_undegraded":"2024-04-25T22:44:37.125505+0000","last_fullsized":"2024-04-25T22:44:37.125505+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:49:53.613641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"72'358","reported_seq":865,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087138+0000","last_change":"2024-04-25T22:44:34.101942+0000","last_active":"2024-04-25T22:44:42.087138+0000","last_peered":"2024-04-25T22:44:42.087138+0000","last_clean":"2024-04-25T22:44:42.087138+0000","last_became_active":"2024-04-25T22:44:34.099595+0000","last_became_peered":"2024-04-25T22:44:34.099595+0000","last_unstale":"2024-04-25T22:44:42.087138+0000","last_undegraded":"2024-04-25T22:44:42.087138+0000","last_fullsized":"2024-04-25T22:44:42.087138+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:06.523166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12259,"num_write":325,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'465","reported_seq":590,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:37.367145+0000","last_change":"2024-04-25T22:44:40.397873+0000","last_active":"2024-04-25T22:44:40.397873+0000","last_peered":"2024-04-25T22:44:37.367145+0000","last_clean":"2024-04-25T22:44:37.367145+0000","last_became_active":"2024-04-25T22:44:29.681106+0000","last_became_peered":"2024-04-25T22:44:29.681106+0000","last_unstale":"2024-04-25T22:44:37.367145+0000","last_undegraded":"2024-04-25T22:44:37.367145+0000","last_fullsized":"2024-04-25T22:44:37.367145+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"72'386","reported_seq":577,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.088052+0000","last_change":"2024-04-25T22:44:27.932877+0000","last_active":"2024-04-25T22:44:42.088052+0000","last_peered":"2024-04-25T22:44:42.088052+0000","last_clean":"2024-04-25T22:41:33.341615+0000","last_became_active":"2024-04-25T22:44:27.913881+0000","last_became_peered":"2024-04-25T22:44:27.913881+0000","last_unstale":"2024-04-25T22:44:42.088052+0000","last_undegraded":"2024-04-25T22:44:27.377759+0000","last_fullsized":"2024-04-25T22:44:27.352221+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9402,"num_write":352,"num_write_kb":50548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":384,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087280+0000","last_change":"2024-04-25T22:44:26.355770+0000","last_active":"2024-04-25T22:44:42.087280+0000","last_peered":"2024-04-25T22:44:42.087280+0000","last_clean":"2024-04-25T22:44:42.087280+0000","last_became_active":"2024-04-25T22:44:26.354730+0000","last_became_peered":"2024-04-25T22:44:26.354730+0000","last_unstale":"2024-04-25T22:44:42.087280+0000","last_undegraded":"2024-04-25T22:44:42.087280+0000","last_fullsized":"2024-04-25T22:44:42.087280+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:34.987031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":175,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088800+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:44:42.088800+0000","last_peered":"2024-04-25T22:44:42.088800+0000","last_clean":"2024-04-25T22:44:42.088800+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:44:42.088800+0000","last_undegraded":"2024-04-25T22:44:42.088800+0000","last_fullsized":"2024-04-25T22:44:42.088800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"71'457","reported_seq":642,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.085796+0000","last_change":"2024-04-25T22:44:29.399148+0000","last_active":"2024-04-25T22:44:42.085796+0000","last_peered":"2024-04-25T22:44:42.085796+0000","last_clean":"2024-04-25T22:44:42.085796+0000","last_became_active":"2024-04-25T22:44:29.397962+0000","last_became_peered":"2024-04-25T22:44:29.397962+0000","last_unstale":"2024-04-25T22:44:42.085796+0000","last_undegraded":"2024-04-25T22:44:42.085796+0000","last_fullsized":"2024-04-25T22:44:42.085796+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:14.015619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"72'447","reported_seq":1071,"reported_epoch":95,"state":"peering","last_fresh":"2024-04-25T22:44:41.483145+0000","last_change":"2024-04-25T22:44:42.089544+0000","last_active":"2024-04-25T22:44:42.089544+0000","last_peered":"2024-04-25T22:44:41.483145+0000","last_clean":"2024-04-25T22:41:34.256933+0000","last_became_active":"2024-04-25T22:44:27.920076+0000","last_became_peered":"2024-04-25T22:44:27.920076+0000","last_unstale":"2024-04-25T22:44:41.483145+0000","last_undegraded":"2024-04-25T22:44:41.483145+0000","last_fullsized":"2024-04-25T22:44:27.382933+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45074,"num_write":414,"num_write_kb":120596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":182,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087015+0000","last_change":"2024-04-25T22:44:26.355238+0000","last_active":"2024-04-25T22:44:42.087015+0000","last_peered":"2024-04-25T22:44:42.087015+0000","last_clean":"2024-04-25T22:44:42.087015+0000","last_became_active":"2024-04-25T22:44:26.354482+0000","last_became_peered":"2024-04-25T22:44:26.354482+0000","last_unstale":"2024-04-25T22:44:42.087015+0000","last_undegraded":"2024-04-25T22:44:42.087015+0000","last_fullsized":"2024-04-25T22:44:42.087015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.042514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'122","reported_seq":306,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.085296+0000","last_change":"2024-04-25T22:44:39.141843+0000","last_active":"2024-04-25T22:44:42.085296+0000","last_peered":"2024-04-25T22:44:42.085296+0000","last_clean":"2024-04-25T22:44:42.085296+0000","last_became_active":"2024-04-25T22:44:39.139689+0000","last_became_peered":"2024-04-25T22:44:39.139689+0000","last_unstale":"2024-04-25T22:44:42.085296+0000","last_undegraded":"2024-04-25T22:44:42.085296+0000","last_fullsized":"2024-04-25T22:44:42.085296+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:18.614670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":62,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"72'449","reported_seq":608,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:37.369353+0000","last_change":"2024-04-25T22:44:40.403253+0000","last_active":"2024-04-25T22:44:40.403253+0000","last_peered":"2024-04-25T22:44:37.369353+0000","last_clean":"2024-04-25T22:44:37.369353+0000","last_became_active":"2024-04-25T22:44:36.396927+0000","last_became_peered":"2024-04-25T22:44:36.396927+0000","last_unstale":"2024-04-25T22:44:37.369353+0000","last_undegraded":"2024-04-25T22:44:37.369353+0000","last_fullsized":"2024-04-25T22:44:37.369353+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25191,"num_write":420,"num_write_kb":79855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":183,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086934+0000","last_change":"2024-04-25T22:44:26.363464+0000","last_active":"2024-04-25T22:44:42.086934+0000","last_peered":"2024-04-25T22:44:42.086934+0000","last_clean":"2024-04-25T22:44:42.086934+0000","last_became_active":"2024-04-25T22:44:26.362808+0000","last_became_peered":"2024-04-25T22:44:26.362808+0000","last_unstale":"2024-04-25T22:44:42.086934+0000","last_undegraded":"2024-04-25T22:44:42.086934+0000","last_fullsized":"2024-04-25T22:44:42.086934+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:06.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'435","reported_seq":587,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.117095+0000","last_change":"2024-04-25T22:44:37.105559+0000","last_active":"2024-04-25T22:44:37.117095+0000","last_peered":"2024-04-25T22:44:37.117095+0000","last_clean":"2024-04-25T22:44:37.117095+0000","last_became_active":"2024-04-25T22:44:37.099207+0000","last_became_peered":"2024-04-25T22:44:37.099207+0000","last_unstale":"2024-04-25T22:44:37.117095+0000","last_undegraded":"2024-04-25T22:44:37.117095+0000","last_fullsized":"2024-04-25T22:44:37.117095+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:53:04.083054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"72'337","reported_seq":553,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.088405+0000","last_change":"2024-04-25T22:44:27.932720+0000","last_active":"2024-04-25T22:44:42.088405+0000","last_peered":"2024-04-25T22:44:42.088405+0000","last_clean":"2024-04-25T22:41:33.341668+0000","last_became_active":"2024-04-25T22:44:27.914069+0000","last_became_peered":"2024-04-25T22:44:27.914069+0000","last_unstale":"2024-04-25T22:44:42.088405+0000","last_undegraded":"2024-04-25T22:44:27.381554+0000","last_fullsized":"2024-04-25T22:44:27.374715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":147,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25242,"num_write":307,"num_write_kb":26250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":175,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088384+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:44:42.088384+0000","last_peered":"2024-04-25T22:44:42.088384+0000","last_clean":"2024-04-25T22:44:42.088384+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:44:42.088384+0000","last_undegraded":"2024-04-25T22:44:42.088384+0000","last_fullsized":"2024-04-25T22:44:42.088384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"71'61","reported_seq":230,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088480+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:44:42.088480+0000","last_peered":"2024-04-25T22:44:42.088480+0000","last_clean":"2024-04-25T22:44:42.088480+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:44:42.088480+0000","last_undegraded":"2024-04-25T22:44:42.088480+0000","last_fullsized":"2024-04-25T22:44:42.088480+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'404","reported_seq":982,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086998+0000","last_change":"2024-04-25T22:44:32.092728+0000","last_active":"2024-04-25T22:44:42.086998+0000","last_peered":"2024-04-25T22:44:42.086998+0000","last_clean":"2024-04-25T22:44:42.086998+0000","last_became_active":"2024-04-25T22:44:32.087528+0000","last_became_peered":"2024-04-25T22:44:32.087528+0000","last_unstale":"2024-04-25T22:44:42.086998+0000","last_undegraded":"2024-04-25T22:44:42.086998+0000","last_fullsized":"2024-04-25T22:44:42.086998+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:39.481467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":20287,"num_write":371,"num_write_kb":59919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'285","reported_seq":454,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.090364+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:44:42.090364+0000","last_peered":"2024-04-25T22:44:42.090364+0000","last_clean":"2024-04-25T22:44:42.090364+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:44:42.090364+0000","last_undegraded":"2024-04-25T22:44:42.090364+0000","last_fullsized":"2024-04-25T22:44:42.090364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":183,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087287+0000","last_change":"2024-04-25T22:44:26.364185+0000","last_active":"2024-04-25T22:44:42.087287+0000","last_peered":"2024-04-25T22:44:42.087287+0000","last_clean":"2024-04-25T22:44:42.087287+0000","last_became_active":"2024-04-25T22:44:26.363583+0000","last_became_peered":"2024-04-25T22:44:26.363583+0000","last_unstale":"2024-04-25T22:44:42.087287+0000","last_undegraded":"2024-04-25T22:44:42.087287+0000","last_fullsized":"2024-04-25T22:44:42.087287+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:35:04.325449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"72'366","reported_seq":540,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.086211+0000","last_change":"2024-04-25T22:44:41.142343+0000","last_active":"2024-04-25T22:44:42.086211+0000","last_peered":"2024-04-25T22:44:42.086211+0000","last_clean":"2024-04-25T22:41:34.254671+0000","last_became_active":"2024-04-25T22:44:41.137495+0000","last_became_peered":"2024-04-25T22:44:41.137495+0000","last_unstale":"2024-04-25T22:44:42.086211+0000","last_undegraded":"2024-04-25T22:44:41.117781+0000","last_fullsized":"2024-04-25T22:44:41.117310+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":346,"num_write":330,"num_write_kb":33934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":231,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087142+0000","last_change":"2024-04-25T22:44:26.364178+0000","last_active":"2024-04-25T22:44:42.087142+0000","last_peered":"2024-04-25T22:44:42.087142+0000","last_clean":"2024-04-25T22:44:42.087142+0000","last_became_active":"2024-04-25T22:44:26.363455+0000","last_became_peered":"2024-04-25T22:44:26.363455+0000","last_unstale":"2024-04-25T22:44:42.087142+0000","last_undegraded":"2024-04-25T22:44:42.087142+0000","last_fullsized":"2024-04-25T22:44:42.087142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:58.181763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":93,"state":"peering","last_fresh":"2024-04-25T22:44:39.100875+0000","last_change":"2024-04-25T22:44:26.632763+0000","last_active":"2024-04-25T22:44:26.632763+0000","last_peered":"2024-04-25T22:44:24.310757+0000","last_clean":"2024-04-25T22:40:08.425969+0000","last_became_active":"2024-04-25T22:41:35.381219+0000","last_became_peered":"2024-04-25T22:41:35.381219+0000","last_unstale":"2024-04-25T22:44:39.100875+0000","last_undegraded":"2024-04-25T22:44:39.100875+0000","last_fullsized":"2024-04-25T22:44:39.100875+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'413","reported_seq":708,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.086247+0000","last_change":"2024-04-25T22:44:41.136359+0000","last_active":"2024-04-25T22:44:42.086247+0000","last_peered":"2024-04-25T22:44:42.086247+0000","last_clean":"2024-04-25T22:41:34.255399+0000","last_became_active":"2024-04-25T22:44:41.132847+0000","last_became_peered":"2024-04-25T22:44:41.132847+0000","last_unstale":"2024-04-25T22:44:42.086247+0000","last_undegraded":"2024-04-25T22:44:41.118158+0000","last_fullsized":"2024-04-25T22:44:41.117469+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":142,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22994,"num_write":377,"num_write_kb":63140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"72'57","reported_seq":235,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089787+0000","last_change":"2024-04-25T22:44:26.366189+0000","last_active":"2024-04-25T22:44:42.089787+0000","last_peered":"2024-04-25T22:44:42.089787+0000","last_clean":"2024-04-25T22:44:42.089787+0000","last_became_active":"2024-04-25T22:44:26.365267+0000","last_became_peered":"2024-04-25T22:44:26.365267+0000","last_unstale":"2024-04-25T22:44:42.089787+0000","last_undegraded":"2024-04-25T22:44:42.089787+0000","last_fullsized":"2024-04-25T22:44:42.089787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:54.128937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":183,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089102+0000","last_change":"2024-04-25T22:44:26.361633+0000","last_active":"2024-04-25T22:44:42.089102+0000","last_peered":"2024-04-25T22:44:42.089102+0000","last_clean":"2024-04-25T22:44:42.089102+0000","last_became_active":"2024-04-25T22:44:26.360968+0000","last_became_peered":"2024-04-25T22:44:26.360968+0000","last_unstale":"2024-04-25T22:44:42.089102+0000","last_undegraded":"2024-04-25T22:44:42.089102+0000","last_fullsized":"2024-04-25T22:44:42.089102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:40.454898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'398","reported_seq":565,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.085377+0000","last_change":"2024-04-25T22:44:39.132801+0000","last_active":"2024-04-25T22:44:42.085377+0000","last_peered":"2024-04-25T22:44:42.085377+0000","last_clean":"2024-04-25T22:44:42.085377+0000","last_became_active":"2024-04-25T22:44:39.124378+0000","last_became_peered":"2024-04-25T22:44:39.124378+0000","last_unstale":"2024-04-25T22:44:42.085377+0000","last_undegraded":"2024-04-25T22:44:42.085377+0000","last_fullsized":"2024-04-25T22:44:42.085377+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:29.195889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6306,"num_write":372,"num_write_kb":34077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'100","reported_seq":272,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088696+0000","last_change":"2024-04-25T22:44:39.150245+0000","last_active":"2024-04-25T22:44:42.088696+0000","last_peered":"2024-04-25T22:44:42.088696+0000","last_clean":"2024-04-25T22:44:42.088696+0000","last_became_active":"2024-04-25T22:44:39.147377+0000","last_became_peered":"2024-04-25T22:44:39.147377+0000","last_unstale":"2024-04-25T22:44:42.088696+0000","last_undegraded":"2024-04-25T22:44:42.088696+0000","last_fullsized":"2024-04-25T22:44:42.088696+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:36.007978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":182,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089804+0000","last_change":"2024-04-25T22:44:26.360890+0000","last_active":"2024-04-25T22:44:42.089804+0000","last_peered":"2024-04-25T22:44:42.089804+0000","last_clean":"2024-04-25T22:44:42.089804+0000","last_became_active":"2024-04-25T22:44:26.360106+0000","last_became_peered":"2024-04-25T22:44:26.360106+0000","last_unstale":"2024-04-25T22:44:42.089804+0000","last_undegraded":"2024-04-25T22:44:42.089804+0000","last_fullsized":"2024-04-25T22:44:42.089804+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:09.929196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'390","reported_seq":577,"reported_epoch":94,"state":"peering","last_fresh":"2024-04-25T22:44:40.394943+0000","last_change":"2024-04-25T22:44:40.394943+0000","last_active":"2024-04-25T22:44:26.341716+0000","last_peered":"2024-04-25T22:44:24.309629+0000","last_clean":"2024-04-25T22:41:34.254462+0000","last_became_active":"2024-04-25T22:41:35.384292+0000","last_became_peered":"2024-04-25T22:41:35.384292+0000","last_unstale":"2024-04-25T22:44:40.394943+0000","last_undegraded":"2024-04-25T22:44:40.394943+0000","last_fullsized":"2024-04-25T22:44:40.394943+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":22915,"num_write":352,"num_write_kb":47201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"72'411","reported_seq":973,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087588+0000","last_change":"2024-04-25T22:44:32.090492+0000","last_active":"2024-04-25T22:44:42.087588+0000","last_peered":"2024-04-25T22:44:42.087588+0000","last_clean":"2024-04-25T22:44:42.087588+0000","last_became_active":"2024-04-25T22:44:32.087303+0000","last_became_peered":"2024-04-25T22:44:32.087303+0000","last_unstale":"2024-04-25T22:44:42.087588+0000","last_undegraded":"2024-04-25T22:44:42.087588+0000","last_fullsized":"2024-04-25T22:44:42.087588+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25412,"num_write":367,"num_write_kb":64656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'268","reported_seq":454,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088769+0000","last_change":"2024-04-25T22:44:29.399184+0000","last_active":"2024-04-25T22:44:42.088769+0000","last_peered":"2024-04-25T22:44:42.088769+0000","last_clean":"2024-04-25T22:44:42.088769+0000","last_became_active":"2024-04-25T22:44:29.398317+0000","last_became_peered":"2024-04-25T22:44:29.398317+0000","last_unstale":"2024-04-25T22:44:42.088769+0000","last_undegraded":"2024-04-25T22:44:42.088769+0000","last_fullsized":"2024-04-25T22:44:42.088769+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:21.765162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382817,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"72'423","reported_seq":1012,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.092243+0000","last_change":"2024-04-25T22:44:42.092243+0000","last_active":"2024-04-25T22:44:42.092243+0000","last_peered":"2024-04-25T22:44:42.092243+0000","last_clean":"2024-04-25T22:44:42.092243+0000","last_became_active":"2024-04-25T22:44:42.088432+0000","last_became_peered":"2024-04-25T22:44:42.088432+0000","last_unstale":"2024-04-25T22:44:42.092243+0000","last_undegraded":"2024-04-25T22:44:42.092243+0000","last_fullsized":"2024-04-25T22:44:42.092243+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:54.239406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24794,"num_write":386,"num_write_kb":63756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'102","reported_seq":245,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.111783+0000","last_change":"2024-04-25T22:44:37.111783+0000","last_active":"2024-04-25T22:44:37.111783+0000","last_peered":"2024-04-25T22:44:37.111783+0000","last_clean":"2024-04-25T22:44:37.111783+0000","last_became_active":"2024-04-25T22:44:37.109678+0000","last_became_peered":"2024-04-25T22:44:37.109678+0000","last_unstale":"2024-04-25T22:44:37.111783+0000","last_undegraded":"2024-04-25T22:44:37.111783+0000","last_fullsized":"2024-04-25T22:44:37.111783+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:32.980801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'213","reported_seq":381,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088415+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:44:42.088415+0000","last_peered":"2024-04-25T22:44:42.088415+0000","last_clean":"2024-04-25T22:44:42.088415+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:44:42.088415+0000","last_undegraded":"2024-04-25T22:44:42.088415+0000","last_fullsized":"2024-04-25T22:44:42.088415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"72'504","reported_seq":734,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.084490+0000","last_change":"2024-04-25T22:44:39.142694+0000","last_active":"2024-04-25T22:44:42.084490+0000","last_peered":"2024-04-25T22:44:42.084490+0000","last_clean":"2024-04-25T22:44:42.084490+0000","last_became_active":"2024-04-25T22:44:39.132582+0000","last_became_peered":"2024-04-25T22:44:39.132582+0000","last_unstale":"2024-04-25T22:44:42.084490+0000","last_undegraded":"2024-04-25T22:44:42.084490+0000","last_fullsized":"2024-04-25T22:44:42.084490+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:14.401644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":46975,"num_write":471,"num_write_kb":146290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'64","reported_seq":185,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089106+0000","last_change":"2024-04-25T22:44:39.136961+0000","last_active":"2024-04-25T22:44:42.089106+0000","last_peered":"2024-04-25T22:44:42.089106+0000","last_clean":"2024-04-25T22:44:42.089106+0000","last_became_active":"2024-04-25T22:44:39.136090+0000","last_became_peered":"2024-04-25T22:44:39.136090+0000","last_unstale":"2024-04-25T22:44:42.089106+0000","last_undegraded":"2024-04-25T22:44:42.089106+0000","last_fullsized":"2024-04-25T22:44:42.089106+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:35.220314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"72'475","reported_seq":1114,"reported_epoch":96,"state":"active+undersized+remapped","last_fresh":"2024-04-25T22:44:42.213854+0000","last_change":"2024-04-25T22:44:42.214479+0000","last_active":"2024-04-25T22:44:42.213854+0000","last_peered":"2024-04-25T22:44:42.213854+0000","last_clean":"2024-04-25T22:41:33.339970+0000","last_became_active":"2024-04-25T22:44:27.916087+0000","last_became_peered":"2024-04-25T22:44:27.916087+0000","last_unstale":"2024-04-25T22:44:42.213854+0000","last_undegraded":"2024-04-25T22:44:42.213854+0000","last_fullsized":"2024-04-25T22:44:27.357937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":23011,"num_write":448,"num_write_kb":76439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"72'370","reported_seq":593,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.089307+0000","last_change":"2024-04-25T22:44:41.149278+0000","last_active":"2024-04-25T22:44:42.089307+0000","last_peered":"2024-04-25T22:44:42.089307+0000","last_clean":"2024-04-25T22:41:34.256787+0000","last_became_active":"2024-04-25T22:44:41.144535+0000","last_became_peered":"2024-04-25T22:44:41.144535+0000","last_unstale":"2024-04-25T22:44:42.089307+0000","last_undegraded":"2024-04-25T22:44:41.120919+0000","last_fullsized":"2024-04-25T22:44:41.120194+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":159,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33211,"num_write":340,"num_write_kb":63312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'647","reported_seq":831,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.085716+0000","last_change":"2024-04-25T22:44:30.396965+0000","last_active":"2024-04-25T22:44:42.085716+0000","last_peered":"2024-04-25T22:44:42.085716+0000","last_clean":"2024-04-25T22:44:42.085716+0000","last_became_active":"2024-04-25T22:44:30.396073+0000","last_became_peered":"2024-04-25T22:44:30.396073+0000","last_unstale":"2024-04-25T22:44:42.085716+0000","last_undegraded":"2024-04-25T22:44:42.085716+0000","last_fullsized":"2024-04-25T22:44:42.085716+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"72'415","reported_seq":602,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087733+0000","last_change":"2024-04-25T22:44:39.150290+0000","last_active":"2024-04-25T22:44:42.087733+0000","last_peered":"2024-04-25T22:44:42.087733+0000","last_clean":"2024-04-25T22:44:42.087733+0000","last_became_active":"2024-04-25T22:44:39.146949+0000","last_became_peered":"2024-04-25T22:44:39.146949+0000","last_unstale":"2024-04-25T22:44:42.087733+0000","last_undegraded":"2024-04-25T22:44:42.087733+0000","last_fullsized":"2024-04-25T22:44:42.087733+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:11.804350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19493,"num_write":386,"num_write_kb":64692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'207","reported_seq":328,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.084841+0000","last_change":"2024-04-25T22:44:39.141125+0000","last_active":"2024-04-25T22:44:42.084841+0000","last_peered":"2024-04-25T22:44:42.084841+0000","last_clean":"2024-04-25T22:44:42.084841+0000","last_became_active":"2024-04-25T22:44:39.138371+0000","last_became_peered":"2024-04-25T22:44:39.138371+0000","last_unstale":"2024-04-25T22:44:42.084841+0000","last_undegraded":"2024-04-25T22:44:42.084841+0000","last_fullsized":"2024-04-25T22:44:42.084841+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:14.147026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"72'395","reported_seq":586,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.088005+0000","last_change":"2024-04-25T22:44:41.148833+0000","last_active":"2024-04-25T22:44:42.088005+0000","last_peered":"2024-04-25T22:44:42.088005+0000","last_clean":"2024-04-25T22:41:34.256072+0000","last_became_active":"2024-04-25T22:44:41.144491+0000","last_became_peered":"2024-04-25T22:44:41.144491+0000","last_unstale":"2024-04-25T22:44:42.088005+0000","last_undegraded":"2024-04-25T22:44:41.119473+0000","last_fullsized":"2024-04-25T22:44:41.118876+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9576,"num_write":348,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"72'194","reported_seq":319,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:37.367018+0000","last_change":"2024-04-25T22:44:40.397359+0000","last_active":"2024-04-25T22:44:40.397359+0000","last_peered":"2024-04-25T22:44:37.367018+0000","last_clean":"2024-04-25T22:44:37.367018+0000","last_became_active":"2024-04-25T22:44:29.680841+0000","last_became_peered":"2024-04-25T22:44:29.680841+0000","last_unstale":"2024-04-25T22:44:37.367018+0000","last_undegraded":"2024-04-25T22:44:37.367018+0000","last_fullsized":"2024-04-25T22:44:37.367018+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360511,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":12143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12360511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"72'398","reported_seq":612,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.085707+0000","last_change":"2024-04-25T22:44:41.134567+0000","last_active":"2024-04-25T22:44:42.085707+0000","last_peered":"2024-04-25T22:44:42.085707+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130189+0000","last_became_peered":"2024-04-25T22:44:41.130189+0000","last_unstale":"2024-04-25T22:44:42.085707+0000","last_undegraded":"2024-04-25T22:44:41.117532+0000","last_fullsized":"2024-04-25T22:44:41.116946+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31284,"num_write":371,"num_write_kb":80144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"71'51","reported_seq":186,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.121915+0000","last_change":"2024-04-25T22:44:37.121915+0000","last_active":"2024-04-25T22:44:37.121915+0000","last_peered":"2024-04-25T22:44:37.121915+0000","last_clean":"2024-04-25T22:44:37.121915+0000","last_became_active":"2024-04-25T22:44:37.119258+0000","last_became_peered":"2024-04-25T22:44:37.119258+0000","last_unstale":"2024-04-25T22:44:37.121915+0000","last_undegraded":"2024-04-25T22:44:37.121915+0000","last_fullsized":"2024-04-25T22:44:37.121915+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:18.614670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"72'383","reported_seq":601,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087165+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:44:42.087165+0000","last_peered":"2024-04-25T22:44:42.087165+0000","last_clean":"2024-04-25T22:44:42.087165+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:44:42.087165+0000","last_undegraded":"2024-04-25T22:44:42.087165+0000","last_fullsized":"2024-04-25T22:44:42.087165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29308,"num_write":358,"num_write_kb":66975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"71'177","reported_seq":345,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088466+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:44:42.088466+0000","last_peered":"2024-04-25T22:44:42.088466+0000","last_clean":"2024-04-25T22:44:42.088466+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:44:42.088466+0000","last_undegraded":"2024-04-25T22:44:42.088466+0000","last_fullsized":"2024-04-25T22:44:42.088466+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"72'387","reported_seq":566,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087464+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:44:42.087464+0000","last_peered":"2024-04-25T22:44:42.087464+0000","last_clean":"2024-04-25T22:44:42.087464+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:44:42.087464+0000","last_undegraded":"2024-04-25T22:44:42.087464+0000","last_fullsized":"2024-04-25T22:44:42.087464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3883,"num_write":348,"num_write_kb":34122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'209","reported_seq":371,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.108618+0000","last_change":"2024-04-25T22:44:37.108618+0000","last_active":"2024-04-25T22:44:37.108618+0000","last_peered":"2024-04-25T22:44:37.108618+0000","last_clean":"2024-04-25T22:44:37.108618+0000","last_became_active":"2024-04-25T22:44:37.106658+0000","last_became_peered":"2024-04-25T22:44:37.106658+0000","last_unstale":"2024-04-25T22:44:37.108618+0000","last_undegraded":"2024-04-25T22:44:37.108618+0000","last_fullsized":"2024-04-25T22:44:37.108618+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:14.067851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":12363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"72'419","reported_seq":563,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:37.376631+0000","last_change":"2024-04-25T22:44:40.396292+0000","last_active":"2024-04-25T22:44:40.396292+0000","last_peered":"2024-04-25T22:44:37.376631+0000","last_clean":"2024-04-25T22:44:37.376631+0000","last_became_active":"2024-04-25T22:44:37.370586+0000","last_became_peered":"2024-04-25T22:44:37.370586+0000","last_unstale":"2024-04-25T22:44:37.376631+0000","last_undegraded":"2024-04-25T22:44:37.376631+0000","last_fullsized":"2024-04-25T22:44:37.376631+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":13327,"num_write":388,"num_write_kb":55674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"71'131","reported_seq":315,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088052+0000","last_change":"2024-04-25T22:44:29.398880+0000","last_active":"2024-04-25T22:44:42.088052+0000","last_peered":"2024-04-25T22:44:42.088052+0000","last_clean":"2024-04-25T22:44:42.088052+0000","last_became_active":"2024-04-25T22:44:29.397905+0000","last_became_peered":"2024-04-25T22:44:29.397905+0000","last_unstale":"2024-04-25T22:44:42.088052+0000","last_undegraded":"2024-04-25T22:44:42.088052+0000","last_fullsized":"2024-04-25T22:44:42.088052+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:44.236330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"72'449","reported_seq":649,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086730+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:44:42.086730+0000","last_peered":"2024-04-25T22:44:42.086730+0000","last_clean":"2024-04-25T22:44:42.086730+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:44:42.086730+0000","last_undegraded":"2024-04-25T22:44:42.086730+0000","last_fullsized":"2024-04-25T22:44:42.086730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14222,"num_write":424,"num_write_kb":79796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"71'57","reported_seq":179,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088552+0000","last_change":"2024-04-25T22:44:39.137232+0000","last_active":"2024-04-25T22:44:42.088552+0000","last_peered":"2024-04-25T22:44:42.088552+0000","last_clean":"2024-04-25T22:44:42.088552+0000","last_became_active":"2024-04-25T22:44:39.136283+0000","last_became_peered":"2024-04-25T22:44:39.136283+0000","last_unstale":"2024-04-25T22:44:42.088552+0000","last_undegraded":"2024-04-25T22:44:42.088552+0000","last_fullsized":"2024-04-25T22:44:42.088552+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:32.428982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3832,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2461,"num_read_kb":1248646,"num_write":24434,"num_write_kb":4137258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3444,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26539,"ondisk_log_size":26539,"up":128,"acting":104,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127071275,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":4473,"num_write_kb":127409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79463584,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254210048,"data_stored":254142550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},"log_size":6216,"ondisk_log_size":6216,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738430,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165144,"kb_used_data":79880,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94206696,"statfs":{"total":96636764160,"available":96467656704,"internally_reserved":0,"allocated":81797120,"data_stored":81335328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":79,"seq":339302416389,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118984,"kb_used_data":83128,"kb_used_omap":5,"kb_used_meta":35834,"kb_avail":94252856,"statfs":{"total":96636764160,"available":96514924544,"internally_reserved":0,"allocated":85123072,"data_stored":84652208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6003,"internal_metadata":36694157},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174152,"kb_used_data":88888,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94197688,"statfs":{"total":96636764160,"available":96458432512,"internally_reserved":0,"allocated":91021312,"data_stored":90537559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89575424,"data_stored":89544940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83689472,"data_stored":83664533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80945152,"data_stored":80933077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:44:43.287 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T22:44:43.681 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:44:43.681 INFO:teuthology.orchestra.run.smithi057.stdout:{"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1239/108 objects degraded (1147.222%), 7 pgs degraded","count":7},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":291,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":97,"num_osds":3,"num_up_osds":3,"osd_up_since":1714085065,"num_in_osds":3,"osd_in_since":1714084793,"num_remapped_pgs":22},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":68},{"state_name":"remapped+peering","count":18},{"state_name":"peering","count":10},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":7},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"active+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":54,"data_bytes":127661643,"bytes_used":469237760,"bytes_avail":289441054720,"bytes_total":289910292480,"inactive_pgs_ratio":0.26666668057441711,"degraded_objects":1239,"degraded_total":108,"degraded_ratio":11.472222222222221,"recovering_objects_per_sec":511,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":2048,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4192}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-25T22:41:21.139402+0000","services":{}},"progress_events":{}} 2024-04-25T22:44:43.699 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-25T22:44:43.699 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:44:44.012 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:44:44.013 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:44:44.030 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-04-25T22:44:43.236378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127661643,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3832,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2659,"num_read_kb":1250233,"num_write":29110,"num_write_kb":4268127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3464,"num_bytes_recovered":79463584,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32912,"ondisk_log_size":32912,"up":210,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":458280,"kb_used_data":251896,"kb_used_omap":8,"kb_used_meta":206327,"kb_avail":282657240,"statfs":{"total":289910292480,"available":289441013760,"internally_reserved":0,"allocated":257941504,"data_stored":256525095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9193,"internal_metadata":211278871},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2006,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1889,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001198"},"pg_stats":[{"pgid":"4.3f","version":"72'404","reported_seq":588,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.088901+0000","last_change":"2024-04-25T22:44:41.145114+0000","last_active":"2024-04-25T22:44:42.088901+0000","last_peered":"2024-04-25T22:44:42.088901+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.142277+0000","last_became_peered":"2024-04-25T22:44:41.142277+0000","last_unstale":"2024-04-25T22:44:42.088901+0000","last_undegraded":"2024-04-25T22:44:41.121372+0000","last_fullsized":"2024-04-25T22:44:41.120599+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19772,"num_write":366,"num_write_kb":46873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"72'420","reported_seq":578,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:37.369026+0000","last_change":"2024-04-25T22:44:40.395075+0000","last_active":"2024-04-25T22:44:40.395075+0000","last_peered":"2024-04-25T22:44:37.369026+0000","last_clean":"2024-04-25T22:44:37.369026+0000","last_became_active":"2024-04-25T22:44:35.395973+0000","last_became_peered":"2024-04-25T22:44:35.395973+0000","last_unstale":"2024-04-25T22:44:37.369026+0000","last_undegraded":"2024-04-25T22:44:37.369026+0000","last_fullsized":"2024-04-25T22:44:37.369026+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24515,"num_write":386,"num_write_kb":55688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"72'377","reported_seq":918,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.096911+0000","last_change":"2024-04-25T22:44:42.096911+0000","last_active":"2024-04-25T22:44:42.096911+0000","last_peered":"2024-04-25T22:44:42.096911+0000","last_clean":"2024-04-25T22:44:42.096911+0000","last_became_active":"2024-04-25T22:44:42.093941+0000","last_became_peered":"2024-04-25T22:44:42.093941+0000","last_unstale":"2024-04-25T22:44:42.096911+0000","last_undegraded":"2024-04-25T22:44:42.096911+0000","last_fullsized":"2024-04-25T22:44:42.096911+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11135,"num_write":346,"num_write_kb":38950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"72'366","reported_seq":539,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087879+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:44:42.087879+0000","last_peered":"2024-04-25T22:44:42.087879+0000","last_clean":"2024-04-25T22:44:42.087879+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:44:42.087879+0000","last_undegraded":"2024-04-25T22:44:42.087879+0000","last_fullsized":"2024-04-25T22:44:42.087879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":326,"num_write_kb":34079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"72'455","reported_seq":650,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.085443+0000","last_change":"2024-04-25T22:44:41.134406+0000","last_active":"2024-04-25T22:44:42.085443+0000","last_peered":"2024-04-25T22:44:42.085443+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130077+0000","last_became_peered":"2024-04-25T22:44:41.130077+0000","last_unstale":"2024-04-25T22:44:42.085443+0000","last_undegraded":"2024-04-25T22:44:41.117231+0000","last_fullsized":"2024-04-25T22:44:41.116610+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33897,"num_write":426,"num_write_kb":100721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"72'401","reported_seq":601,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086851+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:44:42.086851+0000","last_peered":"2024-04-25T22:44:42.086851+0000","last_clean":"2024-04-25T22:44:42.086851+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:44:42.086851+0000","last_undegraded":"2024-04-25T22:44:42.086851+0000","last_fullsized":"2024-04-25T22:44:42.086851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15258,"num_write":369,"num_write_kb":53298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"72'452","reported_seq":684,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086442+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:44:42.086442+0000","last_peered":"2024-04-25T22:44:42.086442+0000","last_clean":"2024-04-25T22:44:42.086442+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:44:42.086442+0000","last_undegraded":"2024-04-25T22:44:42.086442+0000","last_fullsized":"2024-04-25T22:44:42.086442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34010,"num_write":428,"num_write_kb":157752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"72'401","reported_seq":606,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.085837+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:44:42.085837+0000","last_peered":"2024-04-25T22:44:42.085837+0000","last_clean":"2024-04-25T22:44:42.085837+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:44:42.085837+0000","last_undegraded":"2024-04-25T22:44:42.085837+0000","last_fullsized":"2024-04-25T22:44:42.085837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19917,"num_write":359,"num_write_kb":109382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"72'394","reported_seq":583,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.087682+0000","last_change":"2024-04-25T22:44:27.933160+0000","last_active":"2024-04-25T22:44:42.087682+0000","last_peered":"2024-04-25T22:44:42.087682+0000","last_clean":"2024-04-25T22:41:33.341370+0000","last_became_active":"2024-04-25T22:44:27.927304+0000","last_became_peered":"2024-04-25T22:44:27.927304+0000","last_unstale":"2024-04-25T22:44:42.087682+0000","last_undegraded":"2024-04-25T22:44:27.369434+0000","last_fullsized":"2024-04-25T22:44:27.345517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9569,"num_write":360,"num_write_kb":25560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"72'382","reported_seq":522,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:36.706732+0000","last_change":"2024-04-25T22:44:40.396212+0000","last_active":"2024-04-25T22:44:40.396212+0000","last_peered":"2024-04-25T22:44:36.706732+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:27.909822+0000","last_became_peered":"2024-04-25T22:44:27.909822+0000","last_unstale":"2024-04-25T22:44:36.706732+0000","last_undegraded":"2024-04-25T22:44:36.706732+0000","last_fullsized":"2024-04-25T22:44:27.348732+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17192,"num_write":338,"num_write_kb":38688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"72'369","reported_seq":558,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089014+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:44:42.089014+0000","last_peered":"2024-04-25T22:44:42.089014+0000","last_clean":"2024-04-25T22:44:42.089014+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:44:42.089014+0000","last_undegraded":"2024-04-25T22:44:42.089014+0000","last_fullsized":"2024-04-25T22:44:42.089014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7385,"num_write":349,"num_write_kb":58842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"72'338","reported_seq":537,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.086765+0000","last_change":"2024-04-25T22:44:41.137110+0000","last_active":"2024-04-25T22:44:42.086765+0000","last_peered":"2024-04-25T22:44:42.086765+0000","last_clean":"2024-04-25T22:41:34.255048+0000","last_became_active":"2024-04-25T22:44:41.133243+0000","last_became_peered":"2024-04-25T22:44:41.133243+0000","last_unstale":"2024-04-25T22:44:42.086765+0000","last_undegraded":"2024-04-25T22:44:41.118173+0000","last_fullsized":"2024-04-25T22:44:41.117638+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":151,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13619,"num_write":312,"num_write_kb":21391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"72'411","reported_seq":561,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:37.367999+0000","last_change":"2024-04-25T22:44:40.404787+0000","last_active":"2024-04-25T22:44:40.404787+0000","last_peered":"2024-04-25T22:44:37.367999+0000","last_clean":"2024-04-25T22:44:37.367999+0000","last_became_active":"2024-04-25T22:44:30.683328+0000","last_became_peered":"2024-04-25T22:44:30.683328+0000","last_unstale":"2024-04-25T22:44:37.367999+0000","last_undegraded":"2024-04-25T22:44:37.367999+0000","last_fullsized":"2024-04-25T22:44:37.367999+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12998,"num_write":375,"num_write_kb":79661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"72'452","reported_seq":1016,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087164+0000","last_change":"2024-04-25T22:44:40.130299+0000","last_active":"2024-04-25T22:44:42.087164+0000","last_peered":"2024-04-25T22:44:42.087164+0000","last_clean":"2024-04-25T22:44:42.087164+0000","last_became_active":"2024-04-25T22:44:40.127307+0000","last_became_peered":"2024-04-25T22:44:40.127307+0000","last_unstale":"2024-04-25T22:44:42.087164+0000","last_undegraded":"2024-04-25T22:44:42.087164+0000","last_fullsized":"2024-04-25T22:44:42.087164+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:16.746830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":854,"num_write":419,"num_write_kb":88217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"72'428","reported_seq":996,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086764+0000","last_change":"2024-04-25T22:44:35.108361+0000","last_active":"2024-04-25T22:44:42.086764+0000","last_peered":"2024-04-25T22:44:42.086764+0000","last_clean":"2024-04-25T22:44:42.086764+0000","last_became_active":"2024-04-25T22:44:35.103208+0000","last_became_peered":"2024-04-25T22:44:35.103208+0000","last_unstale":"2024-04-25T22:44:42.086764+0000","last_undegraded":"2024-04-25T22:44:42.086764+0000","last_fullsized":"2024-04-25T22:44:42.086764+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:22.046332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21291,"num_write":389,"num_write_kb":68562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"72'401","reported_seq":580,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086149+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:44:42.086149+0000","last_peered":"2024-04-25T22:44:42.086149+0000","last_clean":"2024-04-25T22:44:42.086149+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:44:42.086149+0000","last_undegraded":"2024-04-25T22:44:42.086149+0000","last_fullsized":"2024-04-25T22:44:42.086149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8276,"num_write":369,"num_write_kb":17867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"72'398","reported_seq":579,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.089606+0000","last_change":"2024-04-25T22:44:27.936766+0000","last_active":"2024-04-25T22:44:42.089606+0000","last_peered":"2024-04-25T22:44:42.089606+0000","last_clean":"2024-04-25T22:41:33.342064+0000","last_became_active":"2024-04-25T22:44:27.932101+0000","last_became_peered":"2024-04-25T22:44:27.932101+0000","last_unstale":"2024-04-25T22:44:42.089606+0000","last_undegraded":"2024-04-25T22:44:27.388123+0000","last_fullsized":"2024-04-25T22:44:27.382718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":175,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5883,"num_write":362,"num_write_kb":38188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"72'407","reported_seq":576,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.088041+0000","last_change":"2024-04-25T22:44:41.159724+0000","last_active":"2024-04-25T22:44:42.088041+0000","last_peered":"2024-04-25T22:44:42.088041+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.154547+0000","last_became_peered":"2024-04-25T22:44:41.154547+0000","last_unstale":"2024-04-25T22:44:42.088041+0000","last_undegraded":"2024-04-25T22:44:41.121499+0000","last_fullsized":"2024-04-25T22:44:41.120885+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13073,"num_write":372,"num_write_kb":59323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"72'441","reported_seq":1024,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086175+0000","last_change":"2024-04-25T22:44:41.148409+0000","last_active":"2024-04-25T22:44:42.086175+0000","last_peered":"2024-04-25T22:44:42.086175+0000","last_clean":"2024-04-25T22:44:42.086175+0000","last_became_active":"2024-04-25T22:44:41.143302+0000","last_became_peered":"2024-04-25T22:44:41.143302+0000","last_unstale":"2024-04-25T22:44:42.086175+0000","last_undegraded":"2024-04-25T22:44:42.086175+0000","last_fullsized":"2024-04-25T22:44:42.086175+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:46.289713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37611,"num_write":403,"num_write_kb":116618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"72'438","reported_seq":629,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088188+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:44:42.088188+0000","last_peered":"2024-04-25T22:44:42.088188+0000","last_clean":"2024-04-25T22:44:42.088188+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:44:42.088188+0000","last_undegraded":"2024-04-25T22:44:42.088188+0000","last_fullsized":"2024-04-25T22:44:42.088188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12393,"num_write":408,"num_write_kb":99933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"72'407","reported_seq":587,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087699+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:44:42.087699+0000","last_peered":"2024-04-25T22:44:42.087699+0000","last_clean":"2024-04-25T22:44:42.087699+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:44:42.087699+0000","last_undegraded":"2024-04-25T22:44:42.087699+0000","last_fullsized":"2024-04-25T22:44:42.087699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8932,"num_write":382,"num_write_kb":59684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"72'463","reported_seq":700,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.086051+0000","last_change":"2024-04-25T22:44:41.132736+0000","last_active":"2024-04-25T22:44:42.086051+0000","last_peered":"2024-04-25T22:44:42.086051+0000","last_clean":"2024-04-25T22:41:34.254643+0000","last_became_active":"2024-04-25T22:44:41.129315+0000","last_became_peered":"2024-04-25T22:44:41.129315+0000","last_unstale":"2024-04-25T22:44:42.086051+0000","last_undegraded":"2024-04-25T22:44:41.117085+0000","last_fullsized":"2024-04-25T22:44:41.116491+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27589,"num_write":428,"num_write_kb":76861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"72'425","reported_seq":659,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.084155+0000","last_change":"2024-04-25T22:44:39.132230+0000","last_active":"2024-04-25T22:44:42.084155+0000","last_peered":"2024-04-25T22:44:42.084155+0000","last_clean":"2024-04-25T22:44:42.084155+0000","last_became_active":"2024-04-25T22:44:39.118635+0000","last_became_peered":"2024-04-25T22:44:39.118635+0000","last_unstale":"2024-04-25T22:44:42.084155+0000","last_undegraded":"2024-04-25T22:44:42.084155+0000","last_fullsized":"2024-04-25T22:44:42.084155+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:15.096836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":46424,"num_write":390,"num_write_kb":96359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"72'445","reported_seq":642,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.084451+0000","last_change":"2024-04-25T22:44:41.135696+0000","last_active":"2024-04-25T22:44:42.084451+0000","last_peered":"2024-04-25T22:44:42.084451+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130730+0000","last_became_peered":"2024-04-25T22:44:41.130730+0000","last_unstale":"2024-04-25T22:44:42.084451+0000","last_undegraded":"2024-04-25T22:44:41.116994+0000","last_fullsized":"2024-04-25T22:44:41.116354+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32317,"num_write":419,"num_write_kb":76071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"72'424","reported_seq":606,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.087863+0000","last_change":"2024-04-25T22:44:41.138549+0000","last_active":"2024-04-25T22:44:42.087863+0000","last_peered":"2024-04-25T22:44:42.087863+0000","last_clean":"2024-04-25T22:41:34.256374+0000","last_became_active":"2024-04-25T22:44:41.133640+0000","last_became_peered":"2024-04-25T22:44:41.133640+0000","last_unstale":"2024-04-25T22:44:42.087863+0000","last_undegraded":"2024-04-25T22:44:41.120823+0000","last_fullsized":"2024-04-25T22:44:41.120131+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8396,"num_write":399,"num_write_kb":50416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"72'499","reported_seq":676,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087727+0000","last_change":"2024-04-25T22:44:39.149280+0000","last_active":"2024-04-25T22:44:42.087727+0000","last_peered":"2024-04-25T22:44:42.087727+0000","last_clean":"2024-04-25T22:44:42.087727+0000","last_became_active":"2024-04-25T22:44:39.143391+0000","last_became_peered":"2024-04-25T22:44:39.143391+0000","last_unstale":"2024-04-25T22:44:42.087727+0000","last_undegraded":"2024-04-25T22:44:42.087727+0000","last_fullsized":"2024-04-25T22:44:42.087727+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:54:10.301144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10227,"num_write":453,"num_write_kb":96585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'430","reported_seq":1048,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089442+0000","last_change":"2024-04-25T22:44:39.113437+0000","last_active":"2024-04-25T22:44:42.089442+0000","last_peered":"2024-04-25T22:44:42.089442+0000","last_clean":"2024-04-25T22:44:42.089442+0000","last_became_active":"2024-04-25T22:44:39.109771+0000","last_became_peered":"2024-04-25T22:44:39.109771+0000","last_unstale":"2024-04-25T22:44:42.089442+0000","last_undegraded":"2024-04-25T22:44:42.089442+0000","last_fullsized":"2024-04-25T22:44:42.089442+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:40:46.739897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":32116,"num_write":409,"num_write_kb":89217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"72'393","reported_seq":946,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.108331+0000","last_change":"2024-04-25T22:44:37.108331+0000","last_active":"2024-04-25T22:44:37.108331+0000","last_peered":"2024-04-25T22:44:37.108331+0000","last_clean":"2024-04-25T22:44:37.108331+0000","last_became_active":"2024-04-25T22:44:37.100491+0000","last_became_peered":"2024-04-25T22:44:37.100491+0000","last_unstale":"2024-04-25T22:44:37.108331+0000","last_undegraded":"2024-04-25T22:44:37.108331+0000","last_fullsized":"2024-04-25T22:44:37.108331+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:48.521828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":28076,"num_write":364,"num_write_kb":47473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"72'399","reported_seq":959,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086271+0000","last_change":"2024-04-25T22:44:40.124745+0000","last_active":"2024-04-25T22:44:42.086271+0000","last_peered":"2024-04-25T22:44:42.086271+0000","last_clean":"2024-04-25T22:44:42.086271+0000","last_became_active":"2024-04-25T22:44:40.121838+0000","last_became_peered":"2024-04-25T22:44:40.121838+0000","last_unstale":"2024-04-25T22:44:42.086271+0000","last_undegraded":"2024-04-25T22:44:42.086271+0000","last_fullsized":"2024-04-25T22:44:42.086271+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:28.299317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14005,"num_write":367,"num_write_kb":58883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"72'484","reported_seq":705,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.086723+0000","last_change":"2024-04-25T22:44:41.147898+0000","last_active":"2024-04-25T22:44:42.086723+0000","last_peered":"2024-04-25T22:44:42.086723+0000","last_clean":"2024-04-25T22:41:34.255390+0000","last_became_active":"2024-04-25T22:44:41.144605+0000","last_became_peered":"2024-04-25T22:44:41.144605+0000","last_unstale":"2024-04-25T22:44:42.086723+0000","last_undegraded":"2024-04-25T22:44:41.118456+0000","last_fullsized":"2024-04-25T22:44:41.117828+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":208,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23352,"num_write":446,"num_write_kb":100094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"72'455","reported_seq":1102,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.084361+0000","last_change":"2024-04-25T22:44:33.087211+0000","last_active":"2024-04-25T22:44:42.084361+0000","last_peered":"2024-04-25T22:44:42.084361+0000","last_clean":"2024-04-25T22:44:42.084361+0000","last_became_active":"2024-04-25T22:44:33.084127+0000","last_became_peered":"2024-04-25T22:44:33.084127+0000","last_unstale":"2024-04-25T22:44:42.084361+0000","last_undegraded":"2024-04-25T22:44:42.084361+0000","last_fullsized":"2024-04-25T22:44:42.084361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38440,"num_write":423,"num_write_kb":71855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"72'434","reported_seq":634,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086411+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:44:42.086411+0000","last_peered":"2024-04-25T22:44:42.086411+0000","last_clean":"2024-04-25T22:44:42.086411+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:44:42.086411+0000","last_undegraded":"2024-04-25T22:44:42.086411+0000","last_fullsized":"2024-04-25T22:44:42.086411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18701,"num_write":402,"num_write_kb":27564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"72'379","reported_seq":547,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.086370+0000","last_change":"2024-04-25T22:44:41.134849+0000","last_active":"2024-04-25T22:44:42.086370+0000","last_peered":"2024-04-25T22:44:42.086370+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130604+0000","last_became_peered":"2024-04-25T22:44:41.130604+0000","last_unstale":"2024-04-25T22:44:42.086370+0000","last_undegraded":"2024-04-25T22:44:41.118062+0000","last_fullsized":"2024-04-25T22:44:41.117484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18623,"num_write":344,"num_write_kb":50888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"71'528","reported_seq":696,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088190+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:44:42.088190+0000","last_peered":"2024-04-25T22:44:42.088190+0000","last_clean":"2024-04-25T22:44:42.088190+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:44:42.088190+0000","last_undegraded":"2024-04-25T22:44:42.088190+0000","last_fullsized":"2024-04-25T22:44:42.088190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"72'383","reported_seq":534,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.085100+0000","last_change":"2024-04-25T22:44:41.148275+0000","last_active":"2024-04-25T22:44:42.085100+0000","last_peered":"2024-04-25T22:44:42.085100+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.142954+0000","last_became_peered":"2024-04-25T22:44:41.142954+0000","last_unstale":"2024-04-25T22:44:42.085100+0000","last_undegraded":"2024-04-25T22:44:41.119000+0000","last_fullsized":"2024-04-25T22:44:41.118353+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8364,"num_write":351,"num_write_kb":30625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"71'45","reported_seq":166,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.085312+0000","last_change":"2024-04-25T22:44:39.117622+0000","last_active":"2024-04-25T22:44:42.085312+0000","last_peered":"2024-04-25T22:44:42.085312+0000","last_clean":"2024-04-25T22:44:42.085312+0000","last_became_active":"2024-04-25T22:44:39.115669+0000","last_became_peered":"2024-04-25T22:44:39.115669+0000","last_unstale":"2024-04-25T22:44:42.085312+0000","last_undegraded":"2024-04-25T22:44:42.085312+0000","last_fullsized":"2024-04-25T22:44:42.085312+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:21.793820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"72'429","reported_seq":601,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.088350+0000","last_change":"2024-04-25T22:44:41.157231+0000","last_active":"2024-04-25T22:44:42.088350+0000","last_peered":"2024-04-25T22:44:42.088350+0000","last_clean":"2024-04-25T22:44:24.311958+0000","last_became_active":"2024-04-25T22:44:41.154517+0000","last_became_peered":"2024-04-25T22:44:41.154517+0000","last_unstale":"2024-04-25T22:44:42.088350+0000","last_undegraded":"2024-04-25T22:44:41.121712+0000","last_fullsized":"2024-04-25T22:44:41.121143+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16584,"num_write":393,"num_write_kb":63712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'61","reported_seq":197,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.127336+0000","last_change":"2024-04-25T22:44:37.127336+0000","last_active":"2024-04-25T22:44:37.127336+0000","last_peered":"2024-04-25T22:44:37.127336+0000","last_clean":"2024-04-25T22:44:37.127336+0000","last_became_active":"2024-04-25T22:44:37.125592+0000","last_became_peered":"2024-04-25T22:44:37.125592+0000","last_unstale":"2024-04-25T22:44:37.127336+0000","last_undegraded":"2024-04-25T22:44:37.127336+0000","last_fullsized":"2024-04-25T22:44:37.127336+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:27.270332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"72'404","reported_seq":590,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087721+0000","last_change":"2024-04-25T22:44:39.128428+0000","last_active":"2024-04-25T22:44:42.087721+0000","last_peered":"2024-04-25T22:44:42.087721+0000","last_clean":"2024-04-25T22:44:42.087721+0000","last_became_active":"2024-04-25T22:44:39.116562+0000","last_became_peered":"2024-04-25T22:44:39.116562+0000","last_unstale":"2024-04-25T22:44:42.087721+0000","last_undegraded":"2024-04-25T22:44:42.087721+0000","last_fullsized":"2024-04-25T22:44:42.087721+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:09.750726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18745,"num_write":376,"num_write_kb":96145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'71","reported_seq":247,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087388+0000","last_change":"2024-04-25T22:44:26.363329+0000","last_active":"2024-04-25T22:44:42.087388+0000","last_peered":"2024-04-25T22:44:42.087388+0000","last_clean":"2024-04-25T22:44:42.087388+0000","last_became_active":"2024-04-25T22:44:26.362499+0000","last_became_peered":"2024-04-25T22:44:26.362499+0000","last_unstale":"2024-04-25T22:44:42.087388+0000","last_undegraded":"2024-04-25T22:44:42.087388+0000","last_fullsized":"2024-04-25T22:44:42.087388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'145","reported_seq":327,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089705+0000","last_change":"2024-04-25T22:44:29.400540+0000","last_active":"2024-04-25T22:44:42.089705+0000","last_peered":"2024-04-25T22:44:42.089705+0000","last_clean":"2024-04-25T22:44:42.089705+0000","last_became_active":"2024-04-25T22:44:29.399853+0000","last_became_peered":"2024-04-25T22:44:29.399853+0000","last_unstale":"2024-04-25T22:44:42.089705+0000","last_undegraded":"2024-04-25T22:44:42.089705+0000","last_fullsized":"2024-04-25T22:44:42.089705+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"72'399","reported_seq":611,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.085642+0000","last_change":"2024-04-25T22:44:41.132315+0000","last_active":"2024-04-25T22:44:42.085642+0000","last_peered":"2024-04-25T22:44:42.085642+0000","last_clean":"2024-04-25T22:41:34.254259+0000","last_became_active":"2024-04-25T22:44:41.129040+0000","last_became_peered":"2024-04-25T22:44:41.129040+0000","last_unstale":"2024-04-25T22:44:42.085642+0000","last_undegraded":"2024-04-25T22:44:41.116129+0000","last_fullsized":"2024-04-25T22:44:41.115733+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25159,"num_write":363,"num_write_kb":34063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'226","reported_seq":382,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.113648+0000","last_change":"2024-04-25T22:44:37.113648+0000","last_active":"2024-04-25T22:44:37.113648+0000","last_peered":"2024-04-25T22:44:37.113648+0000","last_clean":"2024-04-25T22:44:37.113648+0000","last_became_active":"2024-04-25T22:44:37.109354+0000","last_became_peered":"2024-04-25T22:44:37.109354+0000","last_unstale":"2024-04-25T22:44:37.113648+0000","last_undegraded":"2024-04-25T22:44:37.113648+0000","last_fullsized":"2024-04-25T22:44:37.113648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:32.428982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"72'431","reported_seq":605,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.084707+0000","last_change":"2024-04-25T22:44:41.136042+0000","last_active":"2024-04-25T22:44:42.084707+0000","last_peered":"2024-04-25T22:44:42.084707+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130862+0000","last_became_peered":"2024-04-25T22:44:41.130862+0000","last_unstale":"2024-04-25T22:44:42.084707+0000","last_undegraded":"2024-04-25T22:44:41.117168+0000","last_fullsized":"2024-04-25T22:44:41.116538+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14688,"num_write":405,"num_write_kb":38957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"71'382","reported_seq":564,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.090283+0000","last_change":"2024-04-25T22:44:30.401893+0000","last_active":"2024-04-25T22:44:42.090283+0000","last_peered":"2024-04-25T22:44:42.090283+0000","last_clean":"2024-04-25T22:44:42.090283+0000","last_became_active":"2024-04-25T22:44:30.401021+0000","last_became_peered":"2024-04-25T22:44:30.401021+0000","last_unstale":"2024-04-25T22:44:42.090283+0000","last_undegraded":"2024-04-25T22:44:42.090283+0000","last_fullsized":"2024-04-25T22:44:42.090283+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:38.452482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'453","reported_seq":651,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087593+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:44:42.087593+0000","last_peered":"2024-04-25T22:44:42.087593+0000","last_clean":"2024-04-25T22:44:42.087593+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:44:42.087593+0000","last_undegraded":"2024-04-25T22:44:42.087593+0000","last_fullsized":"2024-04-25T22:44:42.087593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18900,"num_write":418,"num_write_kb":117500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"71'64","reported_seq":232,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088847+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:44:42.088847+0000","last_peered":"2024-04-25T22:44:42.088847+0000","last_clean":"2024-04-25T22:44:42.088847+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:44:42.088847+0000","last_undegraded":"2024-04-25T22:44:42.088847+0000","last_fullsized":"2024-04-25T22:44:42.088847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'428","reported_seq":596,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086469+0000","last_change":"2024-04-25T22:44:39.129871+0000","last_active":"2024-04-25T22:44:42.086469+0000","last_peered":"2024-04-25T22:44:42.086469+0000","last_clean":"2024-04-25T22:44:42.086469+0000","last_became_active":"2024-04-25T22:44:39.121205+0000","last_became_peered":"2024-04-25T22:44:39.121205+0000","last_unstale":"2024-04-25T22:44:42.086469+0000","last_undegraded":"2024-04-25T22:44:42.086469+0000","last_fullsized":"2024-04-25T22:44:42.086469+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:48.521828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7477,"num_write":383,"num_write_kb":9617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'166","reported_seq":287,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086749+0000","last_change":"2024-04-25T22:44:39.133550+0000","last_active":"2024-04-25T22:44:42.086749+0000","last_peered":"2024-04-25T22:44:42.086749+0000","last_clean":"2024-04-25T22:44:42.086749+0000","last_became_active":"2024-04-25T22:44:39.131489+0000","last_became_peered":"2024-04-25T22:44:39.131489+0000","last_unstale":"2024-04-25T22:44:42.086749+0000","last_undegraded":"2024-04-25T22:44:42.086749+0000","last_fullsized":"2024-04-25T22:44:42.086749+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:32.980801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"72'446","reported_seq":661,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088397+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:44:42.088397+0000","last_peered":"2024-04-25T22:44:42.088397+0000","last_clean":"2024-04-25T22:44:42.088397+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:44:42.088397+0000","last_undegraded":"2024-04-25T22:44:42.088397+0000","last_fullsized":"2024-04-25T22:44:42.088397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27788,"num_write":414,"num_write_kb":47058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"71'113","reported_seq":282,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088223+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:44:42.088223+0000","last_peered":"2024-04-25T22:44:42.088223+0000","last_clean":"2024-04-25T22:44:42.088223+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:44:42.088223+0000","last_undegraded":"2024-04-25T22:44:42.088223+0000","last_fullsized":"2024-04-25T22:44:42.088223+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"72'417","reported_seq":636,"reported_epoch":96,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-25T22:44:42.260259+0000","last_change":"2024-04-25T22:44:42.218982+0000","last_active":"2024-04-25T22:44:42.260259+0000","last_peered":"2024-04-25T22:44:42.260259+0000","last_clean":"2024-04-25T22:41:34.256785+0000","last_became_active":"2024-04-25T22:44:27.921914+0000","last_became_peered":"2024-04-25T22:44:27.921914+0000","last_unstale":"2024-04-25T22:44:42.260259+0000","last_undegraded":"2024-04-25T22:44:42.260259+0000","last_fullsized":"2024-04-25T22:44:27.380722+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16487,"num_write":388,"num_write_kb":75452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'59","reported_seq":195,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.125505+0000","last_change":"2024-04-25T22:44:37.125505+0000","last_active":"2024-04-25T22:44:37.125505+0000","last_peered":"2024-04-25T22:44:37.125505+0000","last_clean":"2024-04-25T22:44:37.125505+0000","last_became_active":"2024-04-25T22:44:37.115248+0000","last_became_peered":"2024-04-25T22:44:37.115248+0000","last_unstale":"2024-04-25T22:44:37.125505+0000","last_undegraded":"2024-04-25T22:44:37.125505+0000","last_fullsized":"2024-04-25T22:44:37.125505+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:49:53.613641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"72'358","reported_seq":865,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087138+0000","last_change":"2024-04-25T22:44:34.101942+0000","last_active":"2024-04-25T22:44:42.087138+0000","last_peered":"2024-04-25T22:44:42.087138+0000","last_clean":"2024-04-25T22:44:42.087138+0000","last_became_active":"2024-04-25T22:44:34.099595+0000","last_became_peered":"2024-04-25T22:44:34.099595+0000","last_unstale":"2024-04-25T22:44:42.087138+0000","last_undegraded":"2024-04-25T22:44:42.087138+0000","last_fullsized":"2024-04-25T22:44:42.087138+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:06.523166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12259,"num_write":325,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'465","reported_seq":590,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:37.367145+0000","last_change":"2024-04-25T22:44:40.397873+0000","last_active":"2024-04-25T22:44:40.397873+0000","last_peered":"2024-04-25T22:44:37.367145+0000","last_clean":"2024-04-25T22:44:37.367145+0000","last_became_active":"2024-04-25T22:44:29.681106+0000","last_became_peered":"2024-04-25T22:44:29.681106+0000","last_unstale":"2024-04-25T22:44:37.367145+0000","last_undegraded":"2024-04-25T22:44:37.367145+0000","last_fullsized":"2024-04-25T22:44:37.367145+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"72'386","reported_seq":577,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.088052+0000","last_change":"2024-04-25T22:44:27.932877+0000","last_active":"2024-04-25T22:44:42.088052+0000","last_peered":"2024-04-25T22:44:42.088052+0000","last_clean":"2024-04-25T22:41:33.341615+0000","last_became_active":"2024-04-25T22:44:27.913881+0000","last_became_peered":"2024-04-25T22:44:27.913881+0000","last_unstale":"2024-04-25T22:44:42.088052+0000","last_undegraded":"2024-04-25T22:44:27.377759+0000","last_fullsized":"2024-04-25T22:44:27.352221+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9402,"num_write":352,"num_write_kb":50548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":384,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087280+0000","last_change":"2024-04-25T22:44:26.355770+0000","last_active":"2024-04-25T22:44:42.087280+0000","last_peered":"2024-04-25T22:44:42.087280+0000","last_clean":"2024-04-25T22:44:42.087280+0000","last_became_active":"2024-04-25T22:44:26.354730+0000","last_became_peered":"2024-04-25T22:44:26.354730+0000","last_unstale":"2024-04-25T22:44:42.087280+0000","last_undegraded":"2024-04-25T22:44:42.087280+0000","last_fullsized":"2024-04-25T22:44:42.087280+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:34.987031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":175,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088800+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:44:42.088800+0000","last_peered":"2024-04-25T22:44:42.088800+0000","last_clean":"2024-04-25T22:44:42.088800+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:44:42.088800+0000","last_undegraded":"2024-04-25T22:44:42.088800+0000","last_fullsized":"2024-04-25T22:44:42.088800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"71'457","reported_seq":642,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.085796+0000","last_change":"2024-04-25T22:44:29.399148+0000","last_active":"2024-04-25T22:44:42.085796+0000","last_peered":"2024-04-25T22:44:42.085796+0000","last_clean":"2024-04-25T22:44:42.085796+0000","last_became_active":"2024-04-25T22:44:29.397962+0000","last_became_peered":"2024-04-25T22:44:29.397962+0000","last_unstale":"2024-04-25T22:44:42.085796+0000","last_undegraded":"2024-04-25T22:44:42.085796+0000","last_fullsized":"2024-04-25T22:44:42.085796+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:14.015619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"72'447","reported_seq":1071,"reported_epoch":95,"state":"peering","last_fresh":"2024-04-25T22:44:41.483145+0000","last_change":"2024-04-25T22:44:42.089544+0000","last_active":"2024-04-25T22:44:42.089544+0000","last_peered":"2024-04-25T22:44:41.483145+0000","last_clean":"2024-04-25T22:41:34.256933+0000","last_became_active":"2024-04-25T22:44:27.920076+0000","last_became_peered":"2024-04-25T22:44:27.920076+0000","last_unstale":"2024-04-25T22:44:41.483145+0000","last_undegraded":"2024-04-25T22:44:41.483145+0000","last_fullsized":"2024-04-25T22:44:27.382933+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45074,"num_write":414,"num_write_kb":120596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":182,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087015+0000","last_change":"2024-04-25T22:44:26.355238+0000","last_active":"2024-04-25T22:44:42.087015+0000","last_peered":"2024-04-25T22:44:42.087015+0000","last_clean":"2024-04-25T22:44:42.087015+0000","last_became_active":"2024-04-25T22:44:26.354482+0000","last_became_peered":"2024-04-25T22:44:26.354482+0000","last_unstale":"2024-04-25T22:44:42.087015+0000","last_undegraded":"2024-04-25T22:44:42.087015+0000","last_fullsized":"2024-04-25T22:44:42.087015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.042514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'122","reported_seq":306,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.085296+0000","last_change":"2024-04-25T22:44:39.141843+0000","last_active":"2024-04-25T22:44:42.085296+0000","last_peered":"2024-04-25T22:44:42.085296+0000","last_clean":"2024-04-25T22:44:42.085296+0000","last_became_active":"2024-04-25T22:44:39.139689+0000","last_became_peered":"2024-04-25T22:44:39.139689+0000","last_unstale":"2024-04-25T22:44:42.085296+0000","last_undegraded":"2024-04-25T22:44:42.085296+0000","last_fullsized":"2024-04-25T22:44:42.085296+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:18.614670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":62,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"72'449","reported_seq":608,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:37.369353+0000","last_change":"2024-04-25T22:44:40.403253+0000","last_active":"2024-04-25T22:44:40.403253+0000","last_peered":"2024-04-25T22:44:37.369353+0000","last_clean":"2024-04-25T22:44:37.369353+0000","last_became_active":"2024-04-25T22:44:36.396927+0000","last_became_peered":"2024-04-25T22:44:36.396927+0000","last_unstale":"2024-04-25T22:44:37.369353+0000","last_undegraded":"2024-04-25T22:44:37.369353+0000","last_fullsized":"2024-04-25T22:44:37.369353+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25191,"num_write":420,"num_write_kb":79855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":183,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086934+0000","last_change":"2024-04-25T22:44:26.363464+0000","last_active":"2024-04-25T22:44:42.086934+0000","last_peered":"2024-04-25T22:44:42.086934+0000","last_clean":"2024-04-25T22:44:42.086934+0000","last_became_active":"2024-04-25T22:44:26.362808+0000","last_became_peered":"2024-04-25T22:44:26.362808+0000","last_unstale":"2024-04-25T22:44:42.086934+0000","last_undegraded":"2024-04-25T22:44:42.086934+0000","last_fullsized":"2024-04-25T22:44:42.086934+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:06.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'435","reported_seq":587,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.117095+0000","last_change":"2024-04-25T22:44:37.105559+0000","last_active":"2024-04-25T22:44:37.117095+0000","last_peered":"2024-04-25T22:44:37.117095+0000","last_clean":"2024-04-25T22:44:37.117095+0000","last_became_active":"2024-04-25T22:44:37.099207+0000","last_became_peered":"2024-04-25T22:44:37.099207+0000","last_unstale":"2024-04-25T22:44:37.117095+0000","last_undegraded":"2024-04-25T22:44:37.117095+0000","last_fullsized":"2024-04-25T22:44:37.117095+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:53:04.083054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"72'337","reported_seq":553,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.088405+0000","last_change":"2024-04-25T22:44:27.932720+0000","last_active":"2024-04-25T22:44:42.088405+0000","last_peered":"2024-04-25T22:44:42.088405+0000","last_clean":"2024-04-25T22:41:33.341668+0000","last_became_active":"2024-04-25T22:44:27.914069+0000","last_became_peered":"2024-04-25T22:44:27.914069+0000","last_unstale":"2024-04-25T22:44:42.088405+0000","last_undegraded":"2024-04-25T22:44:27.381554+0000","last_fullsized":"2024-04-25T22:44:27.374715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":147,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25242,"num_write":307,"num_write_kb":26250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":175,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088384+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:44:42.088384+0000","last_peered":"2024-04-25T22:44:42.088384+0000","last_clean":"2024-04-25T22:44:42.088384+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:44:42.088384+0000","last_undegraded":"2024-04-25T22:44:42.088384+0000","last_fullsized":"2024-04-25T22:44:42.088384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"71'61","reported_seq":230,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088480+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:44:42.088480+0000","last_peered":"2024-04-25T22:44:42.088480+0000","last_clean":"2024-04-25T22:44:42.088480+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:44:42.088480+0000","last_undegraded":"2024-04-25T22:44:42.088480+0000","last_fullsized":"2024-04-25T22:44:42.088480+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'404","reported_seq":982,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086998+0000","last_change":"2024-04-25T22:44:32.092728+0000","last_active":"2024-04-25T22:44:42.086998+0000","last_peered":"2024-04-25T22:44:42.086998+0000","last_clean":"2024-04-25T22:44:42.086998+0000","last_became_active":"2024-04-25T22:44:32.087528+0000","last_became_peered":"2024-04-25T22:44:32.087528+0000","last_unstale":"2024-04-25T22:44:42.086998+0000","last_undegraded":"2024-04-25T22:44:42.086998+0000","last_fullsized":"2024-04-25T22:44:42.086998+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:39.481467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":20287,"num_write":371,"num_write_kb":59919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'285","reported_seq":454,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.090364+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:44:42.090364+0000","last_peered":"2024-04-25T22:44:42.090364+0000","last_clean":"2024-04-25T22:44:42.090364+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:44:42.090364+0000","last_undegraded":"2024-04-25T22:44:42.090364+0000","last_fullsized":"2024-04-25T22:44:42.090364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":183,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087287+0000","last_change":"2024-04-25T22:44:26.364185+0000","last_active":"2024-04-25T22:44:42.087287+0000","last_peered":"2024-04-25T22:44:42.087287+0000","last_clean":"2024-04-25T22:44:42.087287+0000","last_became_active":"2024-04-25T22:44:26.363583+0000","last_became_peered":"2024-04-25T22:44:26.363583+0000","last_unstale":"2024-04-25T22:44:42.087287+0000","last_undegraded":"2024-04-25T22:44:42.087287+0000","last_fullsized":"2024-04-25T22:44:42.087287+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:35:04.325449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"72'366","reported_seq":540,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.086211+0000","last_change":"2024-04-25T22:44:41.142343+0000","last_active":"2024-04-25T22:44:42.086211+0000","last_peered":"2024-04-25T22:44:42.086211+0000","last_clean":"2024-04-25T22:41:34.254671+0000","last_became_active":"2024-04-25T22:44:41.137495+0000","last_became_peered":"2024-04-25T22:44:41.137495+0000","last_unstale":"2024-04-25T22:44:42.086211+0000","last_undegraded":"2024-04-25T22:44:41.117781+0000","last_fullsized":"2024-04-25T22:44:41.117310+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":346,"num_write":330,"num_write_kb":33934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":231,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087142+0000","last_change":"2024-04-25T22:44:26.364178+0000","last_active":"2024-04-25T22:44:42.087142+0000","last_peered":"2024-04-25T22:44:42.087142+0000","last_clean":"2024-04-25T22:44:42.087142+0000","last_became_active":"2024-04-25T22:44:26.363455+0000","last_became_peered":"2024-04-25T22:44:26.363455+0000","last_unstale":"2024-04-25T22:44:42.087142+0000","last_undegraded":"2024-04-25T22:44:42.087142+0000","last_fullsized":"2024-04-25T22:44:42.087142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:58.181763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":93,"state":"peering","last_fresh":"2024-04-25T22:44:39.100875+0000","last_change":"2024-04-25T22:44:26.632763+0000","last_active":"2024-04-25T22:44:26.632763+0000","last_peered":"2024-04-25T22:44:24.310757+0000","last_clean":"2024-04-25T22:40:08.425969+0000","last_became_active":"2024-04-25T22:41:35.381219+0000","last_became_peered":"2024-04-25T22:41:35.381219+0000","last_unstale":"2024-04-25T22:44:39.100875+0000","last_undegraded":"2024-04-25T22:44:39.100875+0000","last_fullsized":"2024-04-25T22:44:39.100875+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'413","reported_seq":708,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.086247+0000","last_change":"2024-04-25T22:44:41.136359+0000","last_active":"2024-04-25T22:44:42.086247+0000","last_peered":"2024-04-25T22:44:42.086247+0000","last_clean":"2024-04-25T22:41:34.255399+0000","last_became_active":"2024-04-25T22:44:41.132847+0000","last_became_peered":"2024-04-25T22:44:41.132847+0000","last_unstale":"2024-04-25T22:44:42.086247+0000","last_undegraded":"2024-04-25T22:44:41.118158+0000","last_fullsized":"2024-04-25T22:44:41.117469+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":142,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22994,"num_write":377,"num_write_kb":63140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"72'57","reported_seq":235,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089787+0000","last_change":"2024-04-25T22:44:26.366189+0000","last_active":"2024-04-25T22:44:42.089787+0000","last_peered":"2024-04-25T22:44:42.089787+0000","last_clean":"2024-04-25T22:44:42.089787+0000","last_became_active":"2024-04-25T22:44:26.365267+0000","last_became_peered":"2024-04-25T22:44:26.365267+0000","last_unstale":"2024-04-25T22:44:42.089787+0000","last_undegraded":"2024-04-25T22:44:42.089787+0000","last_fullsized":"2024-04-25T22:44:42.089787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:54.128937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":183,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089102+0000","last_change":"2024-04-25T22:44:26.361633+0000","last_active":"2024-04-25T22:44:42.089102+0000","last_peered":"2024-04-25T22:44:42.089102+0000","last_clean":"2024-04-25T22:44:42.089102+0000","last_became_active":"2024-04-25T22:44:26.360968+0000","last_became_peered":"2024-04-25T22:44:26.360968+0000","last_unstale":"2024-04-25T22:44:42.089102+0000","last_undegraded":"2024-04-25T22:44:42.089102+0000","last_fullsized":"2024-04-25T22:44:42.089102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:40.454898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'398","reported_seq":565,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.085377+0000","last_change":"2024-04-25T22:44:39.132801+0000","last_active":"2024-04-25T22:44:42.085377+0000","last_peered":"2024-04-25T22:44:42.085377+0000","last_clean":"2024-04-25T22:44:42.085377+0000","last_became_active":"2024-04-25T22:44:39.124378+0000","last_became_peered":"2024-04-25T22:44:39.124378+0000","last_unstale":"2024-04-25T22:44:42.085377+0000","last_undegraded":"2024-04-25T22:44:42.085377+0000","last_fullsized":"2024-04-25T22:44:42.085377+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:29.195889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6306,"num_write":372,"num_write_kb":34077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'100","reported_seq":272,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088696+0000","last_change":"2024-04-25T22:44:39.150245+0000","last_active":"2024-04-25T22:44:42.088696+0000","last_peered":"2024-04-25T22:44:42.088696+0000","last_clean":"2024-04-25T22:44:42.088696+0000","last_became_active":"2024-04-25T22:44:39.147377+0000","last_became_peered":"2024-04-25T22:44:39.147377+0000","last_unstale":"2024-04-25T22:44:42.088696+0000","last_undegraded":"2024-04-25T22:44:42.088696+0000","last_fullsized":"2024-04-25T22:44:42.088696+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:36.007978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":182,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089804+0000","last_change":"2024-04-25T22:44:26.360890+0000","last_active":"2024-04-25T22:44:42.089804+0000","last_peered":"2024-04-25T22:44:42.089804+0000","last_clean":"2024-04-25T22:44:42.089804+0000","last_became_active":"2024-04-25T22:44:26.360106+0000","last_became_peered":"2024-04-25T22:44:26.360106+0000","last_unstale":"2024-04-25T22:44:42.089804+0000","last_undegraded":"2024-04-25T22:44:42.089804+0000","last_fullsized":"2024-04-25T22:44:42.089804+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:09.929196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'390","reported_seq":577,"reported_epoch":94,"state":"peering","last_fresh":"2024-04-25T22:44:40.394943+0000","last_change":"2024-04-25T22:44:40.394943+0000","last_active":"2024-04-25T22:44:26.341716+0000","last_peered":"2024-04-25T22:44:24.309629+0000","last_clean":"2024-04-25T22:41:34.254462+0000","last_became_active":"2024-04-25T22:41:35.384292+0000","last_became_peered":"2024-04-25T22:41:35.384292+0000","last_unstale":"2024-04-25T22:44:40.394943+0000","last_undegraded":"2024-04-25T22:44:40.394943+0000","last_fullsized":"2024-04-25T22:44:40.394943+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":22915,"num_write":352,"num_write_kb":47201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"72'411","reported_seq":973,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087588+0000","last_change":"2024-04-25T22:44:32.090492+0000","last_active":"2024-04-25T22:44:42.087588+0000","last_peered":"2024-04-25T22:44:42.087588+0000","last_clean":"2024-04-25T22:44:42.087588+0000","last_became_active":"2024-04-25T22:44:32.087303+0000","last_became_peered":"2024-04-25T22:44:32.087303+0000","last_unstale":"2024-04-25T22:44:42.087588+0000","last_undegraded":"2024-04-25T22:44:42.087588+0000","last_fullsized":"2024-04-25T22:44:42.087588+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25412,"num_write":367,"num_write_kb":64656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'268","reported_seq":454,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088769+0000","last_change":"2024-04-25T22:44:29.399184+0000","last_active":"2024-04-25T22:44:42.088769+0000","last_peered":"2024-04-25T22:44:42.088769+0000","last_clean":"2024-04-25T22:44:42.088769+0000","last_became_active":"2024-04-25T22:44:29.398317+0000","last_became_peered":"2024-04-25T22:44:29.398317+0000","last_unstale":"2024-04-25T22:44:42.088769+0000","last_undegraded":"2024-04-25T22:44:42.088769+0000","last_fullsized":"2024-04-25T22:44:42.088769+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:21.765162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382817,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"72'423","reported_seq":1012,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.092243+0000","last_change":"2024-04-25T22:44:42.092243+0000","last_active":"2024-04-25T22:44:42.092243+0000","last_peered":"2024-04-25T22:44:42.092243+0000","last_clean":"2024-04-25T22:44:42.092243+0000","last_became_active":"2024-04-25T22:44:42.088432+0000","last_became_peered":"2024-04-25T22:44:42.088432+0000","last_unstale":"2024-04-25T22:44:42.092243+0000","last_undegraded":"2024-04-25T22:44:42.092243+0000","last_fullsized":"2024-04-25T22:44:42.092243+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:54.239406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24794,"num_write":386,"num_write_kb":63756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'102","reported_seq":245,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.111783+0000","last_change":"2024-04-25T22:44:37.111783+0000","last_active":"2024-04-25T22:44:37.111783+0000","last_peered":"2024-04-25T22:44:37.111783+0000","last_clean":"2024-04-25T22:44:37.111783+0000","last_became_active":"2024-04-25T22:44:37.109678+0000","last_became_peered":"2024-04-25T22:44:37.109678+0000","last_unstale":"2024-04-25T22:44:37.111783+0000","last_undegraded":"2024-04-25T22:44:37.111783+0000","last_fullsized":"2024-04-25T22:44:37.111783+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:32.980801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"71'213","reported_seq":381,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088415+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:44:42.088415+0000","last_peered":"2024-04-25T22:44:42.088415+0000","last_clean":"2024-04-25T22:44:42.088415+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:44:42.088415+0000","last_undegraded":"2024-04-25T22:44:42.088415+0000","last_fullsized":"2024-04-25T22:44:42.088415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"72'504","reported_seq":734,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.084490+0000","last_change":"2024-04-25T22:44:39.142694+0000","last_active":"2024-04-25T22:44:42.084490+0000","last_peered":"2024-04-25T22:44:42.084490+0000","last_clean":"2024-04-25T22:44:42.084490+0000","last_became_active":"2024-04-25T22:44:39.132582+0000","last_became_peered":"2024-04-25T22:44:39.132582+0000","last_unstale":"2024-04-25T22:44:42.084490+0000","last_undegraded":"2024-04-25T22:44:42.084490+0000","last_fullsized":"2024-04-25T22:44:42.084490+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:14.401644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":46975,"num_write":471,"num_write_kb":146290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'64","reported_seq":185,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089106+0000","last_change":"2024-04-25T22:44:39.136961+0000","last_active":"2024-04-25T22:44:42.089106+0000","last_peered":"2024-04-25T22:44:42.089106+0000","last_clean":"2024-04-25T22:44:42.089106+0000","last_became_active":"2024-04-25T22:44:39.136090+0000","last_became_peered":"2024-04-25T22:44:39.136090+0000","last_unstale":"2024-04-25T22:44:42.089106+0000","last_undegraded":"2024-04-25T22:44:42.089106+0000","last_fullsized":"2024-04-25T22:44:42.089106+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:35.220314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"72'475","reported_seq":1114,"reported_epoch":96,"state":"active+undersized+remapped","last_fresh":"2024-04-25T22:44:42.213854+0000","last_change":"2024-04-25T22:44:42.214479+0000","last_active":"2024-04-25T22:44:42.213854+0000","last_peered":"2024-04-25T22:44:42.213854+0000","last_clean":"2024-04-25T22:41:33.339970+0000","last_became_active":"2024-04-25T22:44:27.916087+0000","last_became_peered":"2024-04-25T22:44:27.916087+0000","last_unstale":"2024-04-25T22:44:42.213854+0000","last_undegraded":"2024-04-25T22:44:42.213854+0000","last_fullsized":"2024-04-25T22:44:27.357937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":23011,"num_write":448,"num_write_kb":76439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"72'370","reported_seq":593,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.089307+0000","last_change":"2024-04-25T22:44:41.149278+0000","last_active":"2024-04-25T22:44:42.089307+0000","last_peered":"2024-04-25T22:44:42.089307+0000","last_clean":"2024-04-25T22:41:34.256787+0000","last_became_active":"2024-04-25T22:44:41.144535+0000","last_became_peered":"2024-04-25T22:44:41.144535+0000","last_unstale":"2024-04-25T22:44:42.089307+0000","last_undegraded":"2024-04-25T22:44:41.120919+0000","last_fullsized":"2024-04-25T22:44:41.120194+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":159,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33211,"num_write":340,"num_write_kb":63312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'647","reported_seq":831,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.085716+0000","last_change":"2024-04-25T22:44:30.396965+0000","last_active":"2024-04-25T22:44:42.085716+0000","last_peered":"2024-04-25T22:44:42.085716+0000","last_clean":"2024-04-25T22:44:42.085716+0000","last_became_active":"2024-04-25T22:44:30.396073+0000","last_became_peered":"2024-04-25T22:44:30.396073+0000","last_unstale":"2024-04-25T22:44:42.085716+0000","last_undegraded":"2024-04-25T22:44:42.085716+0000","last_fullsized":"2024-04-25T22:44:42.085716+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"72'415","reported_seq":602,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087733+0000","last_change":"2024-04-25T22:44:39.150290+0000","last_active":"2024-04-25T22:44:42.087733+0000","last_peered":"2024-04-25T22:44:42.087733+0000","last_clean":"2024-04-25T22:44:42.087733+0000","last_became_active":"2024-04-25T22:44:39.146949+0000","last_became_peered":"2024-04-25T22:44:39.146949+0000","last_unstale":"2024-04-25T22:44:42.087733+0000","last_undegraded":"2024-04-25T22:44:42.087733+0000","last_fullsized":"2024-04-25T22:44:42.087733+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:11.804350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19493,"num_write":386,"num_write_kb":64692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'207","reported_seq":328,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.084841+0000","last_change":"2024-04-25T22:44:39.141125+0000","last_active":"2024-04-25T22:44:42.084841+0000","last_peered":"2024-04-25T22:44:42.084841+0000","last_clean":"2024-04-25T22:44:42.084841+0000","last_became_active":"2024-04-25T22:44:39.138371+0000","last_became_peered":"2024-04-25T22:44:39.138371+0000","last_unstale":"2024-04-25T22:44:42.084841+0000","last_undegraded":"2024-04-25T22:44:42.084841+0000","last_fullsized":"2024-04-25T22:44:42.084841+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:14.147026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"72'395","reported_seq":586,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.088005+0000","last_change":"2024-04-25T22:44:41.148833+0000","last_active":"2024-04-25T22:44:42.088005+0000","last_peered":"2024-04-25T22:44:42.088005+0000","last_clean":"2024-04-25T22:41:34.256072+0000","last_became_active":"2024-04-25T22:44:41.144491+0000","last_became_peered":"2024-04-25T22:44:41.144491+0000","last_unstale":"2024-04-25T22:44:42.088005+0000","last_undegraded":"2024-04-25T22:44:41.119473+0000","last_fullsized":"2024-04-25T22:44:41.118876+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9576,"num_write":348,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"72'194","reported_seq":319,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:37.367018+0000","last_change":"2024-04-25T22:44:40.397359+0000","last_active":"2024-04-25T22:44:40.397359+0000","last_peered":"2024-04-25T22:44:37.367018+0000","last_clean":"2024-04-25T22:44:37.367018+0000","last_became_active":"2024-04-25T22:44:29.680841+0000","last_became_peered":"2024-04-25T22:44:29.680841+0000","last_unstale":"2024-04-25T22:44:37.367018+0000","last_undegraded":"2024-04-25T22:44:37.367018+0000","last_fullsized":"2024-04-25T22:44:37.367018+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360511,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":12143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12360511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"72'398","reported_seq":612,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.085707+0000","last_change":"2024-04-25T22:44:41.134567+0000","last_active":"2024-04-25T22:44:42.085707+0000","last_peered":"2024-04-25T22:44:42.085707+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130189+0000","last_became_peered":"2024-04-25T22:44:41.130189+0000","last_unstale":"2024-04-25T22:44:42.085707+0000","last_undegraded":"2024-04-25T22:44:41.117532+0000","last_fullsized":"2024-04-25T22:44:41.116946+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31284,"num_write":371,"num_write_kb":80144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"71'51","reported_seq":186,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.121915+0000","last_change":"2024-04-25T22:44:37.121915+0000","last_active":"2024-04-25T22:44:37.121915+0000","last_peered":"2024-04-25T22:44:37.121915+0000","last_clean":"2024-04-25T22:44:37.121915+0000","last_became_active":"2024-04-25T22:44:37.119258+0000","last_became_peered":"2024-04-25T22:44:37.119258+0000","last_unstale":"2024-04-25T22:44:37.121915+0000","last_undegraded":"2024-04-25T22:44:37.121915+0000","last_fullsized":"2024-04-25T22:44:37.121915+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:18.614670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"72'383","reported_seq":601,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087165+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:44:42.087165+0000","last_peered":"2024-04-25T22:44:42.087165+0000","last_clean":"2024-04-25T22:44:42.087165+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:44:42.087165+0000","last_undegraded":"2024-04-25T22:44:42.087165+0000","last_fullsized":"2024-04-25T22:44:42.087165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29308,"num_write":358,"num_write_kb":66975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"71'177","reported_seq":345,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088466+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:44:42.088466+0000","last_peered":"2024-04-25T22:44:42.088466+0000","last_clean":"2024-04-25T22:44:42.088466+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:44:42.088466+0000","last_undegraded":"2024-04-25T22:44:42.088466+0000","last_fullsized":"2024-04-25T22:44:42.088466+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"72'387","reported_seq":566,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087464+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:44:42.087464+0000","last_peered":"2024-04-25T22:44:42.087464+0000","last_clean":"2024-04-25T22:44:42.087464+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:44:42.087464+0000","last_undegraded":"2024-04-25T22:44:42.087464+0000","last_fullsized":"2024-04-25T22:44:42.087464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3883,"num_write":348,"num_write_kb":34122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'209","reported_seq":371,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T22:44:37.108618+0000","last_change":"2024-04-25T22:44:37.108618+0000","last_active":"2024-04-25T22:44:37.108618+0000","last_peered":"2024-04-25T22:44:37.108618+0000","last_clean":"2024-04-25T22:44:37.108618+0000","last_became_active":"2024-04-25T22:44:37.106658+0000","last_became_peered":"2024-04-25T22:44:37.106658+0000","last_unstale":"2024-04-25T22:44:37.108618+0000","last_undegraded":"2024-04-25T22:44:37.108618+0000","last_fullsized":"2024-04-25T22:44:37.108618+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:14.067851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":12363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"72'419","reported_seq":563,"reported_epoch":91,"state":"peering","last_fresh":"2024-04-25T22:44:37.376631+0000","last_change":"2024-04-25T22:44:40.396292+0000","last_active":"2024-04-25T22:44:40.396292+0000","last_peered":"2024-04-25T22:44:37.376631+0000","last_clean":"2024-04-25T22:44:37.376631+0000","last_became_active":"2024-04-25T22:44:37.370586+0000","last_became_peered":"2024-04-25T22:44:37.370586+0000","last_unstale":"2024-04-25T22:44:37.376631+0000","last_undegraded":"2024-04-25T22:44:37.376631+0000","last_fullsized":"2024-04-25T22:44:37.376631+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":13327,"num_write":388,"num_write_kb":55674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"71'131","reported_seq":315,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088052+0000","last_change":"2024-04-25T22:44:29.398880+0000","last_active":"2024-04-25T22:44:42.088052+0000","last_peered":"2024-04-25T22:44:42.088052+0000","last_clean":"2024-04-25T22:44:42.088052+0000","last_became_active":"2024-04-25T22:44:29.397905+0000","last_became_peered":"2024-04-25T22:44:29.397905+0000","last_unstale":"2024-04-25T22:44:42.088052+0000","last_undegraded":"2024-04-25T22:44:42.088052+0000","last_fullsized":"2024-04-25T22:44:42.088052+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:44.236330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"72'449","reported_seq":649,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086730+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:44:42.086730+0000","last_peered":"2024-04-25T22:44:42.086730+0000","last_clean":"2024-04-25T22:44:42.086730+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:44:42.086730+0000","last_undegraded":"2024-04-25T22:44:42.086730+0000","last_fullsized":"2024-04-25T22:44:42.086730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14222,"num_write":424,"num_write_kb":79796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"71'57","reported_seq":179,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088552+0000","last_change":"2024-04-25T22:44:39.137232+0000","last_active":"2024-04-25T22:44:42.088552+0000","last_peered":"2024-04-25T22:44:42.088552+0000","last_clean":"2024-04-25T22:44:42.088552+0000","last_became_active":"2024-04-25T22:44:39.136283+0000","last_became_peered":"2024-04-25T22:44:39.136283+0000","last_unstale":"2024-04-25T22:44:42.088552+0000","last_undegraded":"2024-04-25T22:44:42.088552+0000","last_fullsized":"2024-04-25T22:44:42.088552+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:32.428982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3832,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2461,"num_read_kb":1248646,"num_write":24434,"num_write_kb":4137258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3444,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26539,"ondisk_log_size":26539,"up":128,"acting":104,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127071275,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":4473,"num_write_kb":127409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79463584,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254210048,"data_stored":254142550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},"log_size":6216,"ondisk_log_size":6216,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738430,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165144,"kb_used_data":79880,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94206696,"statfs":{"total":96636764160,"available":96467656704,"internally_reserved":0,"allocated":81797120,"data_stored":81335328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":79,"seq":339302416389,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118984,"kb_used_data":83128,"kb_used_omap":5,"kb_used_meta":35834,"kb_avail":94252856,"statfs":{"total":96636764160,"available":96514924544,"internally_reserved":0,"allocated":85123072,"data_stored":84652208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6003,"internal_metadata":36694157},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174152,"kb_used_data":88888,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94197688,"statfs":{"total":96636764160,"available":96458432512,"internally_reserved":0,"allocated":91021312,"data_stored":90537559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89575424,"data_stored":89544940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83689472,"data_stored":83664533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80945152,"data_stored":80933077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:44:47.035 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:44:47.363 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:44:47.365 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:44:47.382 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-04-25T22:44:47.237907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127661643,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3832,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2659,"num_read_kb":1250233,"num_write":29110,"num_write_kb":4268127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3466,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32912,"ondisk_log_size":32912,"up":210,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":449996,"kb_used_data":251932,"kb_used_omap":8,"kb_used_meta":198007,"kb_avail":282665524,"statfs":{"total":289910292480,"available":289449496576,"internally_reserved":0,"allocated":257978368,"data_stored":256539790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9193,"internal_metadata":202759191},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194394,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001528"},"pg_stats":[{"pgid":"4.3f","version":"72'404","reported_seq":588,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.088901+0000","last_change":"2024-04-25T22:44:41.145114+0000","last_active":"2024-04-25T22:44:42.088901+0000","last_peered":"2024-04-25T22:44:42.088901+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.142277+0000","last_became_peered":"2024-04-25T22:44:41.142277+0000","last_unstale":"2024-04-25T22:44:42.088901+0000","last_undegraded":"2024-04-25T22:44:41.121372+0000","last_fullsized":"2024-04-25T22:44:41.120599+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19772,"num_write":366,"num_write_kb":46873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"72'420","reported_seq":592,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.384378+0000","last_change":"2024-04-25T22:44:41.434387+0000","last_active":"2024-04-25T22:44:44.384378+0000","last_peered":"2024-04-25T22:44:44.384378+0000","last_clean":"2024-04-25T22:44:44.384378+0000","last_became_active":"2024-04-25T22:44:41.418792+0000","last_became_peered":"2024-04-25T22:44:41.418792+0000","last_unstale":"2024-04-25T22:44:44.384378+0000","last_undegraded":"2024-04-25T22:44:44.384378+0000","last_fullsized":"2024-04-25T22:44:44.384378+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:43.196115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24515,"num_write":386,"num_write_kb":55688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"72'377","reported_seq":918,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.096911+0000","last_change":"2024-04-25T22:44:42.096911+0000","last_active":"2024-04-25T22:44:42.096911+0000","last_peered":"2024-04-25T22:44:42.096911+0000","last_clean":"2024-04-25T22:44:42.096911+0000","last_became_active":"2024-04-25T22:44:42.093941+0000","last_became_peered":"2024-04-25T22:44:42.093941+0000","last_unstale":"2024-04-25T22:44:42.096911+0000","last_undegraded":"2024-04-25T22:44:42.096911+0000","last_fullsized":"2024-04-25T22:44:42.096911+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11135,"num_write":346,"num_write_kb":38950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"72'366","reported_seq":539,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087879+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:44:42.087879+0000","last_peered":"2024-04-25T22:44:42.087879+0000","last_clean":"2024-04-25T22:44:42.087879+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:44:42.087879+0000","last_undegraded":"2024-04-25T22:44:42.087879+0000","last_fullsized":"2024-04-25T22:44:42.087879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":326,"num_write_kb":34079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"72'455","reported_seq":650,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.085443+0000","last_change":"2024-04-25T22:44:41.134406+0000","last_active":"2024-04-25T22:44:42.085443+0000","last_peered":"2024-04-25T22:44:42.085443+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130077+0000","last_became_peered":"2024-04-25T22:44:41.130077+0000","last_unstale":"2024-04-25T22:44:42.085443+0000","last_undegraded":"2024-04-25T22:44:41.117231+0000","last_fullsized":"2024-04-25T22:44:41.116610+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33897,"num_write":426,"num_write_kb":100721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"72'401","reported_seq":601,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086851+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:44:42.086851+0000","last_peered":"2024-04-25T22:44:42.086851+0000","last_clean":"2024-04-25T22:44:42.086851+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:44:42.086851+0000","last_undegraded":"2024-04-25T22:44:42.086851+0000","last_fullsized":"2024-04-25T22:44:42.086851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15258,"num_write":369,"num_write_kb":53298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"72'452","reported_seq":684,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086442+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:44:42.086442+0000","last_peered":"2024-04-25T22:44:42.086442+0000","last_clean":"2024-04-25T22:44:42.086442+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:44:42.086442+0000","last_undegraded":"2024-04-25T22:44:42.086442+0000","last_fullsized":"2024-04-25T22:44:42.086442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34010,"num_write":428,"num_write_kb":157752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"72'401","reported_seq":606,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.085837+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:44:42.085837+0000","last_peered":"2024-04-25T22:44:42.085837+0000","last_clean":"2024-04-25T22:44:42.085837+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:44:42.085837+0000","last_undegraded":"2024-04-25T22:44:42.085837+0000","last_fullsized":"2024-04-25T22:44:42.085837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19917,"num_write":359,"num_write_kb":109382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"72'394","reported_seq":583,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.087682+0000","last_change":"2024-04-25T22:44:27.933160+0000","last_active":"2024-04-25T22:44:42.087682+0000","last_peered":"2024-04-25T22:44:42.087682+0000","last_clean":"2024-04-25T22:41:33.341370+0000","last_became_active":"2024-04-25T22:44:27.927304+0000","last_became_peered":"2024-04-25T22:44:27.927304+0000","last_unstale":"2024-04-25T22:44:42.087682+0000","last_undegraded":"2024-04-25T22:44:27.369434+0000","last_fullsized":"2024-04-25T22:44:27.345517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9569,"num_write":360,"num_write_kb":25560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"72'382","reported_seq":536,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.384255+0000","last_change":"2024-04-25T22:44:41.433644+0000","last_active":"2024-04-25T22:44:44.384255+0000","last_peered":"2024-04-25T22:44:44.384255+0000","last_clean":"2024-04-25T22:44:44.384255+0000","last_became_active":"2024-04-25T22:44:41.421234+0000","last_became_peered":"2024-04-25T22:44:41.421234+0000","last_unstale":"2024-04-25T22:44:44.384255+0000","last_undegraded":"2024-04-25T22:44:44.384255+0000","last_fullsized":"2024-04-25T22:44:44.384255+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:24.217391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17192,"num_write":338,"num_write_kb":38688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"72'369","reported_seq":558,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089014+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:44:42.089014+0000","last_peered":"2024-04-25T22:44:42.089014+0000","last_clean":"2024-04-25T22:44:42.089014+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:44:42.089014+0000","last_undegraded":"2024-04-25T22:44:42.089014+0000","last_fullsized":"2024-04-25T22:44:42.089014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7385,"num_write":349,"num_write_kb":58842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"72'338","reported_seq":537,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.086765+0000","last_change":"2024-04-25T22:44:41.137110+0000","last_active":"2024-04-25T22:44:42.086765+0000","last_peered":"2024-04-25T22:44:42.086765+0000","last_clean":"2024-04-25T22:41:34.255048+0000","last_became_active":"2024-04-25T22:44:41.133243+0000","last_became_peered":"2024-04-25T22:44:41.133243+0000","last_unstale":"2024-04-25T22:44:42.086765+0000","last_undegraded":"2024-04-25T22:44:41.118173+0000","last_fullsized":"2024-04-25T22:44:41.117638+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":151,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13619,"num_write":312,"num_write_kb":21391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"72'411","reported_seq":575,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.383220+0000","last_change":"2024-04-25T22:44:41.432463+0000","last_active":"2024-04-25T22:44:44.383220+0000","last_peered":"2024-04-25T22:44:44.383220+0000","last_clean":"2024-04-25T22:44:44.383220+0000","last_became_active":"2024-04-25T22:44:41.421096+0000","last_became_peered":"2024-04-25T22:44:41.421096+0000","last_unstale":"2024-04-25T22:44:44.383220+0000","last_undegraded":"2024-04-25T22:44:44.383220+0000","last_fullsized":"2024-04-25T22:44:44.383220+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:46.942677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12998,"num_write":375,"num_write_kb":79661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"72'452","reported_seq":1016,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087164+0000","last_change":"2024-04-25T22:44:40.130299+0000","last_active":"2024-04-25T22:44:42.087164+0000","last_peered":"2024-04-25T22:44:42.087164+0000","last_clean":"2024-04-25T22:44:42.087164+0000","last_became_active":"2024-04-25T22:44:40.127307+0000","last_became_peered":"2024-04-25T22:44:40.127307+0000","last_unstale":"2024-04-25T22:44:42.087164+0000","last_undegraded":"2024-04-25T22:44:42.087164+0000","last_fullsized":"2024-04-25T22:44:42.087164+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:16.746830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":854,"num_write":419,"num_write_kb":88217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"72'428","reported_seq":996,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086764+0000","last_change":"2024-04-25T22:44:35.108361+0000","last_active":"2024-04-25T22:44:42.086764+0000","last_peered":"2024-04-25T22:44:42.086764+0000","last_clean":"2024-04-25T22:44:42.086764+0000","last_became_active":"2024-04-25T22:44:35.103208+0000","last_became_peered":"2024-04-25T22:44:35.103208+0000","last_unstale":"2024-04-25T22:44:42.086764+0000","last_undegraded":"2024-04-25T22:44:42.086764+0000","last_fullsized":"2024-04-25T22:44:42.086764+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:22.046332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21291,"num_write":389,"num_write_kb":68562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"72'401","reported_seq":580,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086149+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:44:42.086149+0000","last_peered":"2024-04-25T22:44:42.086149+0000","last_clean":"2024-04-25T22:44:42.086149+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:44:42.086149+0000","last_undegraded":"2024-04-25T22:44:42.086149+0000","last_fullsized":"2024-04-25T22:44:42.086149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8276,"num_write":369,"num_write_kb":17867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"72'398","reported_seq":579,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.089606+0000","last_change":"2024-04-25T22:44:27.936766+0000","last_active":"2024-04-25T22:44:42.089606+0000","last_peered":"2024-04-25T22:44:42.089606+0000","last_clean":"2024-04-25T22:41:33.342064+0000","last_became_active":"2024-04-25T22:44:27.932101+0000","last_became_peered":"2024-04-25T22:44:27.932101+0000","last_unstale":"2024-04-25T22:44:42.089606+0000","last_undegraded":"2024-04-25T22:44:27.388123+0000","last_fullsized":"2024-04-25T22:44:27.382718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":175,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5883,"num_write":362,"num_write_kb":38188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"72'407","reported_seq":576,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.088041+0000","last_change":"2024-04-25T22:44:41.159724+0000","last_active":"2024-04-25T22:44:42.088041+0000","last_peered":"2024-04-25T22:44:42.088041+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.154547+0000","last_became_peered":"2024-04-25T22:44:41.154547+0000","last_unstale":"2024-04-25T22:44:42.088041+0000","last_undegraded":"2024-04-25T22:44:41.121499+0000","last_fullsized":"2024-04-25T22:44:41.120885+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13073,"num_write":372,"num_write_kb":59323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"72'441","reported_seq":1024,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086175+0000","last_change":"2024-04-25T22:44:41.148409+0000","last_active":"2024-04-25T22:44:42.086175+0000","last_peered":"2024-04-25T22:44:42.086175+0000","last_clean":"2024-04-25T22:44:42.086175+0000","last_became_active":"2024-04-25T22:44:41.143302+0000","last_became_peered":"2024-04-25T22:44:41.143302+0000","last_unstale":"2024-04-25T22:44:42.086175+0000","last_undegraded":"2024-04-25T22:44:42.086175+0000","last_fullsized":"2024-04-25T22:44:42.086175+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:46.289713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37611,"num_write":403,"num_write_kb":116618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"72'438","reported_seq":629,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088188+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:44:42.088188+0000","last_peered":"2024-04-25T22:44:42.088188+0000","last_clean":"2024-04-25T22:44:42.088188+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:44:42.088188+0000","last_undegraded":"2024-04-25T22:44:42.088188+0000","last_fullsized":"2024-04-25T22:44:42.088188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12393,"num_write":408,"num_write_kb":99933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"72'407","reported_seq":587,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087699+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:44:42.087699+0000","last_peered":"2024-04-25T22:44:42.087699+0000","last_clean":"2024-04-25T22:44:42.087699+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:44:42.087699+0000","last_undegraded":"2024-04-25T22:44:42.087699+0000","last_fullsized":"2024-04-25T22:44:42.087699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8932,"num_write":382,"num_write_kb":59684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"72'463","reported_seq":700,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.086051+0000","last_change":"2024-04-25T22:44:41.132736+0000","last_active":"2024-04-25T22:44:42.086051+0000","last_peered":"2024-04-25T22:44:42.086051+0000","last_clean":"2024-04-25T22:41:34.254643+0000","last_became_active":"2024-04-25T22:44:41.129315+0000","last_became_peered":"2024-04-25T22:44:41.129315+0000","last_unstale":"2024-04-25T22:44:42.086051+0000","last_undegraded":"2024-04-25T22:44:41.117085+0000","last_fullsized":"2024-04-25T22:44:41.116491+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27589,"num_write":428,"num_write_kb":76861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"72'425","reported_seq":659,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.084155+0000","last_change":"2024-04-25T22:44:39.132230+0000","last_active":"2024-04-25T22:44:42.084155+0000","last_peered":"2024-04-25T22:44:42.084155+0000","last_clean":"2024-04-25T22:44:42.084155+0000","last_became_active":"2024-04-25T22:44:39.118635+0000","last_became_peered":"2024-04-25T22:44:39.118635+0000","last_unstale":"2024-04-25T22:44:42.084155+0000","last_undegraded":"2024-04-25T22:44:42.084155+0000","last_fullsized":"2024-04-25T22:44:42.084155+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:15.096836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":46424,"num_write":390,"num_write_kb":96359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"72'445","reported_seq":642,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.084451+0000","last_change":"2024-04-25T22:44:41.135696+0000","last_active":"2024-04-25T22:44:42.084451+0000","last_peered":"2024-04-25T22:44:42.084451+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130730+0000","last_became_peered":"2024-04-25T22:44:41.130730+0000","last_unstale":"2024-04-25T22:44:42.084451+0000","last_undegraded":"2024-04-25T22:44:41.116994+0000","last_fullsized":"2024-04-25T22:44:41.116354+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32317,"num_write":419,"num_write_kb":76071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"72'424","reported_seq":606,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.087863+0000","last_change":"2024-04-25T22:44:41.138549+0000","last_active":"2024-04-25T22:44:42.087863+0000","last_peered":"2024-04-25T22:44:42.087863+0000","last_clean":"2024-04-25T22:41:34.256374+0000","last_became_active":"2024-04-25T22:44:41.133640+0000","last_became_peered":"2024-04-25T22:44:41.133640+0000","last_unstale":"2024-04-25T22:44:42.087863+0000","last_undegraded":"2024-04-25T22:44:41.120823+0000","last_fullsized":"2024-04-25T22:44:41.120131+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8396,"num_write":399,"num_write_kb":50416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"72'499","reported_seq":676,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087727+0000","last_change":"2024-04-25T22:44:39.149280+0000","last_active":"2024-04-25T22:44:42.087727+0000","last_peered":"2024-04-25T22:44:42.087727+0000","last_clean":"2024-04-25T22:44:42.087727+0000","last_became_active":"2024-04-25T22:44:39.143391+0000","last_became_peered":"2024-04-25T22:44:39.143391+0000","last_unstale":"2024-04-25T22:44:42.087727+0000","last_undegraded":"2024-04-25T22:44:42.087727+0000","last_fullsized":"2024-04-25T22:44:42.087727+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:54:10.301144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10227,"num_write":453,"num_write_kb":96585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'430","reported_seq":1048,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089442+0000","last_change":"2024-04-25T22:44:39.113437+0000","last_active":"2024-04-25T22:44:42.089442+0000","last_peered":"2024-04-25T22:44:42.089442+0000","last_clean":"2024-04-25T22:44:42.089442+0000","last_became_active":"2024-04-25T22:44:39.109771+0000","last_became_peered":"2024-04-25T22:44:39.109771+0000","last_unstale":"2024-04-25T22:44:42.089442+0000","last_undegraded":"2024-04-25T22:44:42.089442+0000","last_fullsized":"2024-04-25T22:44:42.089442+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:40:46.739897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":32116,"num_write":409,"num_write_kb":89217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"72'393","reported_seq":626,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.384063+0000","last_change":"2024-04-25T22:44:41.425947+0000","last_active":"2024-04-25T22:44:44.384063+0000","last_peered":"2024-04-25T22:44:44.384063+0000","last_clean":"2024-04-25T22:44:44.384063+0000","last_became_active":"2024-04-25T22:44:41.413570+0000","last_became_peered":"2024-04-25T22:44:41.413570+0000","last_unstale":"2024-04-25T22:44:44.384063+0000","last_undegraded":"2024-04-25T22:44:44.384063+0000","last_fullsized":"2024-04-25T22:44:44.384063+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:39:00.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":28076,"num_write":364,"num_write_kb":47473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"72'399","reported_seq":959,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086271+0000","last_change":"2024-04-25T22:44:40.124745+0000","last_active":"2024-04-25T22:44:42.086271+0000","last_peered":"2024-04-25T22:44:42.086271+0000","last_clean":"2024-04-25T22:44:42.086271+0000","last_became_active":"2024-04-25T22:44:40.121838+0000","last_became_peered":"2024-04-25T22:44:40.121838+0000","last_unstale":"2024-04-25T22:44:42.086271+0000","last_undegraded":"2024-04-25T22:44:42.086271+0000","last_fullsized":"2024-04-25T22:44:42.086271+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:28.299317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14005,"num_write":367,"num_write_kb":58883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"72'484","reported_seq":705,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.086723+0000","last_change":"2024-04-25T22:44:41.147898+0000","last_active":"2024-04-25T22:44:42.086723+0000","last_peered":"2024-04-25T22:44:42.086723+0000","last_clean":"2024-04-25T22:41:34.255390+0000","last_became_active":"2024-04-25T22:44:41.144605+0000","last_became_peered":"2024-04-25T22:44:41.144605+0000","last_unstale":"2024-04-25T22:44:42.086723+0000","last_undegraded":"2024-04-25T22:44:41.118456+0000","last_fullsized":"2024-04-25T22:44:41.117828+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":208,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23352,"num_write":446,"num_write_kb":100094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"72'455","reported_seq":1102,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.084361+0000","last_change":"2024-04-25T22:44:33.087211+0000","last_active":"2024-04-25T22:44:42.084361+0000","last_peered":"2024-04-25T22:44:42.084361+0000","last_clean":"2024-04-25T22:44:42.084361+0000","last_became_active":"2024-04-25T22:44:33.084127+0000","last_became_peered":"2024-04-25T22:44:33.084127+0000","last_unstale":"2024-04-25T22:44:42.084361+0000","last_undegraded":"2024-04-25T22:44:42.084361+0000","last_fullsized":"2024-04-25T22:44:42.084361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38440,"num_write":423,"num_write_kb":71855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"72'434","reported_seq":634,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086411+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:44:42.086411+0000","last_peered":"2024-04-25T22:44:42.086411+0000","last_clean":"2024-04-25T22:44:42.086411+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:44:42.086411+0000","last_undegraded":"2024-04-25T22:44:42.086411+0000","last_fullsized":"2024-04-25T22:44:42.086411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18701,"num_write":402,"num_write_kb":27564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"72'379","reported_seq":547,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.086370+0000","last_change":"2024-04-25T22:44:41.134849+0000","last_active":"2024-04-25T22:44:42.086370+0000","last_peered":"2024-04-25T22:44:42.086370+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130604+0000","last_became_peered":"2024-04-25T22:44:41.130604+0000","last_unstale":"2024-04-25T22:44:42.086370+0000","last_undegraded":"2024-04-25T22:44:41.118062+0000","last_fullsized":"2024-04-25T22:44:41.117484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18623,"num_write":344,"num_write_kb":50888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"71'528","reported_seq":696,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088190+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:44:42.088190+0000","last_peered":"2024-04-25T22:44:42.088190+0000","last_clean":"2024-04-25T22:44:42.088190+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:44:42.088190+0000","last_undegraded":"2024-04-25T22:44:42.088190+0000","last_fullsized":"2024-04-25T22:44:42.088190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"72'383","reported_seq":534,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.085100+0000","last_change":"2024-04-25T22:44:41.148275+0000","last_active":"2024-04-25T22:44:42.085100+0000","last_peered":"2024-04-25T22:44:42.085100+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.142954+0000","last_became_peered":"2024-04-25T22:44:41.142954+0000","last_unstale":"2024-04-25T22:44:42.085100+0000","last_undegraded":"2024-04-25T22:44:41.119000+0000","last_fullsized":"2024-04-25T22:44:41.118353+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8364,"num_write":351,"num_write_kb":30625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"71'45","reported_seq":166,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.085312+0000","last_change":"2024-04-25T22:44:39.117622+0000","last_active":"2024-04-25T22:44:42.085312+0000","last_peered":"2024-04-25T22:44:42.085312+0000","last_clean":"2024-04-25T22:44:42.085312+0000","last_became_active":"2024-04-25T22:44:39.115669+0000","last_became_peered":"2024-04-25T22:44:39.115669+0000","last_unstale":"2024-04-25T22:44:42.085312+0000","last_undegraded":"2024-04-25T22:44:42.085312+0000","last_fullsized":"2024-04-25T22:44:42.085312+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:21.793820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"72'429","reported_seq":601,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.088350+0000","last_change":"2024-04-25T22:44:41.157231+0000","last_active":"2024-04-25T22:44:42.088350+0000","last_peered":"2024-04-25T22:44:42.088350+0000","last_clean":"2024-04-25T22:44:24.311958+0000","last_became_active":"2024-04-25T22:44:41.154517+0000","last_became_peered":"2024-04-25T22:44:41.154517+0000","last_unstale":"2024-04-25T22:44:42.088350+0000","last_undegraded":"2024-04-25T22:44:41.121712+0000","last_fullsized":"2024-04-25T22:44:41.121143+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16584,"num_write":393,"num_write_kb":63712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'61","reported_seq":59,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.382217+0000","last_change":"2024-04-25T22:44:41.416554+0000","last_active":"2024-04-25T22:44:44.382217+0000","last_peered":"2024-04-25T22:44:44.382217+0000","last_clean":"2024-04-25T22:44:44.382217+0000","last_became_active":"2024-04-25T22:44:41.413853+0000","last_became_peered":"2024-04-25T22:44:41.413853+0000","last_unstale":"2024-04-25T22:44:44.382217+0000","last_undegraded":"2024-04-25T22:44:44.382217+0000","last_fullsized":"2024-04-25T22:44:44.382217+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:50.701110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"72'404","reported_seq":590,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087721+0000","last_change":"2024-04-25T22:44:39.128428+0000","last_active":"2024-04-25T22:44:42.087721+0000","last_peered":"2024-04-25T22:44:42.087721+0000","last_clean":"2024-04-25T22:44:42.087721+0000","last_became_active":"2024-04-25T22:44:39.116562+0000","last_became_peered":"2024-04-25T22:44:39.116562+0000","last_unstale":"2024-04-25T22:44:42.087721+0000","last_undegraded":"2024-04-25T22:44:42.087721+0000","last_fullsized":"2024-04-25T22:44:42.087721+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:09.750726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18745,"num_write":376,"num_write_kb":96145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'71","reported_seq":247,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087388+0000","last_change":"2024-04-25T22:44:26.363329+0000","last_active":"2024-04-25T22:44:42.087388+0000","last_peered":"2024-04-25T22:44:42.087388+0000","last_clean":"2024-04-25T22:44:42.087388+0000","last_became_active":"2024-04-25T22:44:26.362499+0000","last_became_peered":"2024-04-25T22:44:26.362499+0000","last_unstale":"2024-04-25T22:44:42.087388+0000","last_undegraded":"2024-04-25T22:44:42.087388+0000","last_fullsized":"2024-04-25T22:44:42.087388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'145","reported_seq":327,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089705+0000","last_change":"2024-04-25T22:44:29.400540+0000","last_active":"2024-04-25T22:44:42.089705+0000","last_peered":"2024-04-25T22:44:42.089705+0000","last_clean":"2024-04-25T22:44:42.089705+0000","last_became_active":"2024-04-25T22:44:29.399853+0000","last_became_peered":"2024-04-25T22:44:29.399853+0000","last_unstale":"2024-04-25T22:44:42.089705+0000","last_undegraded":"2024-04-25T22:44:42.089705+0000","last_fullsized":"2024-04-25T22:44:42.089705+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"72'399","reported_seq":611,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.085642+0000","last_change":"2024-04-25T22:44:41.132315+0000","last_active":"2024-04-25T22:44:42.085642+0000","last_peered":"2024-04-25T22:44:42.085642+0000","last_clean":"2024-04-25T22:41:34.254259+0000","last_became_active":"2024-04-25T22:44:41.129040+0000","last_became_peered":"2024-04-25T22:44:41.129040+0000","last_unstale":"2024-04-25T22:44:42.085642+0000","last_undegraded":"2024-04-25T22:44:41.116129+0000","last_fullsized":"2024-04-25T22:44:41.115733+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25159,"num_write":363,"num_write_kb":34063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'226","reported_seq":402,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.383746+0000","last_change":"2024-04-25T22:44:41.417859+0000","last_active":"2024-04-25T22:44:44.383746+0000","last_peered":"2024-04-25T22:44:44.383746+0000","last_clean":"2024-04-25T22:44:44.383746+0000","last_became_active":"2024-04-25T22:44:41.416542+0000","last_became_peered":"2024-04-25T22:44:41.416542+0000","last_unstale":"2024-04-25T22:44:44.383746+0000","last_undegraded":"2024-04-25T22:44:44.383746+0000","last_fullsized":"2024-04-25T22:44:44.383746+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:27.884903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"72'431","reported_seq":605,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.084707+0000","last_change":"2024-04-25T22:44:41.136042+0000","last_active":"2024-04-25T22:44:42.084707+0000","last_peered":"2024-04-25T22:44:42.084707+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130862+0000","last_became_peered":"2024-04-25T22:44:41.130862+0000","last_unstale":"2024-04-25T22:44:42.084707+0000","last_undegraded":"2024-04-25T22:44:41.117168+0000","last_fullsized":"2024-04-25T22:44:41.116538+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14688,"num_write":405,"num_write_kb":38957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"71'382","reported_seq":564,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.090283+0000","last_change":"2024-04-25T22:44:30.401893+0000","last_active":"2024-04-25T22:44:42.090283+0000","last_peered":"2024-04-25T22:44:42.090283+0000","last_clean":"2024-04-25T22:44:42.090283+0000","last_became_active":"2024-04-25T22:44:30.401021+0000","last_became_peered":"2024-04-25T22:44:30.401021+0000","last_unstale":"2024-04-25T22:44:42.090283+0000","last_undegraded":"2024-04-25T22:44:42.090283+0000","last_fullsized":"2024-04-25T22:44:42.090283+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:38.452482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'453","reported_seq":651,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087593+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:44:42.087593+0000","last_peered":"2024-04-25T22:44:42.087593+0000","last_clean":"2024-04-25T22:44:42.087593+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:44:42.087593+0000","last_undegraded":"2024-04-25T22:44:42.087593+0000","last_fullsized":"2024-04-25T22:44:42.087593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18900,"num_write":418,"num_write_kb":117500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"71'64","reported_seq":232,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088847+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:44:42.088847+0000","last_peered":"2024-04-25T22:44:42.088847+0000","last_clean":"2024-04-25T22:44:42.088847+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:44:42.088847+0000","last_undegraded":"2024-04-25T22:44:42.088847+0000","last_fullsized":"2024-04-25T22:44:42.088847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'428","reported_seq":596,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086469+0000","last_change":"2024-04-25T22:44:39.129871+0000","last_active":"2024-04-25T22:44:42.086469+0000","last_peered":"2024-04-25T22:44:42.086469+0000","last_clean":"2024-04-25T22:44:42.086469+0000","last_became_active":"2024-04-25T22:44:39.121205+0000","last_became_peered":"2024-04-25T22:44:39.121205+0000","last_unstale":"2024-04-25T22:44:42.086469+0000","last_undegraded":"2024-04-25T22:44:42.086469+0000","last_fullsized":"2024-04-25T22:44:42.086469+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:48.521828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7477,"num_write":383,"num_write_kb":9617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'166","reported_seq":287,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086749+0000","last_change":"2024-04-25T22:44:39.133550+0000","last_active":"2024-04-25T22:44:42.086749+0000","last_peered":"2024-04-25T22:44:42.086749+0000","last_clean":"2024-04-25T22:44:42.086749+0000","last_became_active":"2024-04-25T22:44:39.131489+0000","last_became_peered":"2024-04-25T22:44:39.131489+0000","last_unstale":"2024-04-25T22:44:42.086749+0000","last_undegraded":"2024-04-25T22:44:42.086749+0000","last_fullsized":"2024-04-25T22:44:42.086749+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:32.980801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"72'446","reported_seq":661,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088397+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:44:42.088397+0000","last_peered":"2024-04-25T22:44:42.088397+0000","last_clean":"2024-04-25T22:44:42.088397+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:44:42.088397+0000","last_undegraded":"2024-04-25T22:44:42.088397+0000","last_fullsized":"2024-04-25T22:44:42.088397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27788,"num_write":414,"num_write_kb":47058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"71'113","reported_seq":282,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088223+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:44:42.088223+0000","last_peered":"2024-04-25T22:44:42.088223+0000","last_clean":"2024-04-25T22:44:42.088223+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:44:42.088223+0000","last_undegraded":"2024-04-25T22:44:42.088223+0000","last_fullsized":"2024-04-25T22:44:42.088223+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"72'417","reported_seq":636,"reported_epoch":96,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-25T22:44:42.260259+0000","last_change":"2024-04-25T22:44:42.218982+0000","last_active":"2024-04-25T22:44:42.260259+0000","last_peered":"2024-04-25T22:44:42.260259+0000","last_clean":"2024-04-25T22:41:34.256785+0000","last_became_active":"2024-04-25T22:44:27.921914+0000","last_became_peered":"2024-04-25T22:44:27.921914+0000","last_unstale":"2024-04-25T22:44:42.260259+0000","last_undegraded":"2024-04-25T22:44:42.260259+0000","last_fullsized":"2024-04-25T22:44:27.380722+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16487,"num_write":388,"num_write_kb":75452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'59","reported_seq":59,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.381832+0000","last_change":"2024-04-25T22:44:41.417821+0000","last_active":"2024-04-25T22:44:44.381832+0000","last_peered":"2024-04-25T22:44:44.381832+0000","last_clean":"2024-04-25T22:44:44.381832+0000","last_became_active":"2024-04-25T22:44:41.415769+0000","last_became_peered":"2024-04-25T22:44:41.415769+0000","last_unstale":"2024-04-25T22:44:44.381832+0000","last_undegraded":"2024-04-25T22:44:44.381832+0000","last_fullsized":"2024-04-25T22:44:44.381832+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.099475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'358","reported_seq":865,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087138+0000","last_change":"2024-04-25T22:44:34.101942+0000","last_active":"2024-04-25T22:44:42.087138+0000","last_peered":"2024-04-25T22:44:42.087138+0000","last_clean":"2024-04-25T22:44:42.087138+0000","last_became_active":"2024-04-25T22:44:34.099595+0000","last_became_peered":"2024-04-25T22:44:34.099595+0000","last_unstale":"2024-04-25T22:44:42.087138+0000","last_undegraded":"2024-04-25T22:44:42.087138+0000","last_fullsized":"2024-04-25T22:44:42.087138+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:06.523166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12259,"num_write":325,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'465","reported_seq":604,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.382350+0000","last_change":"2024-04-25T22:44:41.425331+0000","last_active":"2024-04-25T22:44:44.382350+0000","last_peered":"2024-04-25T22:44:44.382350+0000","last_clean":"2024-04-25T22:44:44.382350+0000","last_became_active":"2024-04-25T22:44:41.423799+0000","last_became_peered":"2024-04-25T22:44:41.423799+0000","last_unstale":"2024-04-25T22:44:44.382350+0000","last_undegraded":"2024-04-25T22:44:44.382350+0000","last_fullsized":"2024-04-25T22:44:44.382350+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:04.324825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"72'386","reported_seq":577,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.088052+0000","last_change":"2024-04-25T22:44:27.932877+0000","last_active":"2024-04-25T22:44:42.088052+0000","last_peered":"2024-04-25T22:44:42.088052+0000","last_clean":"2024-04-25T22:41:33.341615+0000","last_became_active":"2024-04-25T22:44:27.913881+0000","last_became_peered":"2024-04-25T22:44:27.913881+0000","last_unstale":"2024-04-25T22:44:42.088052+0000","last_undegraded":"2024-04-25T22:44:27.377759+0000","last_fullsized":"2024-04-25T22:44:27.352221+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9402,"num_write":352,"num_write_kb":50548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":384,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087280+0000","last_change":"2024-04-25T22:44:26.355770+0000","last_active":"2024-04-25T22:44:42.087280+0000","last_peered":"2024-04-25T22:44:42.087280+0000","last_clean":"2024-04-25T22:44:42.087280+0000","last_became_active":"2024-04-25T22:44:26.354730+0000","last_became_peered":"2024-04-25T22:44:26.354730+0000","last_unstale":"2024-04-25T22:44:42.087280+0000","last_undegraded":"2024-04-25T22:44:42.087280+0000","last_fullsized":"2024-04-25T22:44:42.087280+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:34.987031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":175,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088800+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:44:42.088800+0000","last_peered":"2024-04-25T22:44:42.088800+0000","last_clean":"2024-04-25T22:44:42.088800+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:44:42.088800+0000","last_undegraded":"2024-04-25T22:44:42.088800+0000","last_fullsized":"2024-04-25T22:44:42.088800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"71'457","reported_seq":642,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.085796+0000","last_change":"2024-04-25T22:44:29.399148+0000","last_active":"2024-04-25T22:44:42.085796+0000","last_peered":"2024-04-25T22:44:42.085796+0000","last_clean":"2024-04-25T22:44:42.085796+0000","last_became_active":"2024-04-25T22:44:29.397962+0000","last_became_peered":"2024-04-25T22:44:29.397962+0000","last_unstale":"2024-04-25T22:44:42.085796+0000","last_undegraded":"2024-04-25T22:44:42.085796+0000","last_fullsized":"2024-04-25T22:44:42.085796+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:14.015619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"72'447","reported_seq":1071,"reported_epoch":95,"state":"peering","last_fresh":"2024-04-25T22:44:41.483145+0000","last_change":"2024-04-25T22:44:42.089544+0000","last_active":"2024-04-25T22:44:42.089544+0000","last_peered":"2024-04-25T22:44:41.483145+0000","last_clean":"2024-04-25T22:41:34.256933+0000","last_became_active":"2024-04-25T22:44:27.920076+0000","last_became_peered":"2024-04-25T22:44:27.920076+0000","last_unstale":"2024-04-25T22:44:41.483145+0000","last_undegraded":"2024-04-25T22:44:41.483145+0000","last_fullsized":"2024-04-25T22:44:27.382933+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45074,"num_write":414,"num_write_kb":120596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":182,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087015+0000","last_change":"2024-04-25T22:44:26.355238+0000","last_active":"2024-04-25T22:44:42.087015+0000","last_peered":"2024-04-25T22:44:42.087015+0000","last_clean":"2024-04-25T22:44:42.087015+0000","last_became_active":"2024-04-25T22:44:26.354482+0000","last_became_peered":"2024-04-25T22:44:26.354482+0000","last_unstale":"2024-04-25T22:44:42.087015+0000","last_undegraded":"2024-04-25T22:44:42.087015+0000","last_fullsized":"2024-04-25T22:44:42.087015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.042514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'122","reported_seq":306,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.085296+0000","last_change":"2024-04-25T22:44:39.141843+0000","last_active":"2024-04-25T22:44:42.085296+0000","last_peered":"2024-04-25T22:44:42.085296+0000","last_clean":"2024-04-25T22:44:42.085296+0000","last_became_active":"2024-04-25T22:44:39.139689+0000","last_became_peered":"2024-04-25T22:44:39.139689+0000","last_unstale":"2024-04-25T22:44:42.085296+0000","last_undegraded":"2024-04-25T22:44:42.085296+0000","last_fullsized":"2024-04-25T22:44:42.085296+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:18.614670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":62,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"72'449","reported_seq":622,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.384559+0000","last_change":"2024-04-25T22:44:41.439044+0000","last_active":"2024-04-25T22:44:44.384559+0000","last_peered":"2024-04-25T22:44:44.384559+0000","last_clean":"2024-04-25T22:44:44.384559+0000","last_became_active":"2024-04-25T22:44:41.432785+0000","last_became_peered":"2024-04-25T22:44:41.432785+0000","last_unstale":"2024-04-25T22:44:44.384559+0000","last_undegraded":"2024-04-25T22:44:44.384559+0000","last_fullsized":"2024-04-25T22:44:44.384559+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:57.171725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25191,"num_write":420,"num_write_kb":79855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":183,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086934+0000","last_change":"2024-04-25T22:44:26.363464+0000","last_active":"2024-04-25T22:44:42.086934+0000","last_peered":"2024-04-25T22:44:42.086934+0000","last_clean":"2024-04-25T22:44:42.086934+0000","last_became_active":"2024-04-25T22:44:26.362808+0000","last_became_peered":"2024-04-25T22:44:26.362808+0000","last_unstale":"2024-04-25T22:44:42.086934+0000","last_undegraded":"2024-04-25T22:44:42.086934+0000","last_fullsized":"2024-04-25T22:44:42.086934+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:06.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'435","reported_seq":600,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.381810+0000","last_change":"2024-04-25T22:44:41.417191+0000","last_active":"2024-04-25T22:44:44.381810+0000","last_peered":"2024-04-25T22:44:44.381810+0000","last_clean":"2024-04-25T22:44:44.381810+0000","last_became_active":"2024-04-25T22:44:41.415592+0000","last_became_peered":"2024-04-25T22:44:41.415592+0000","last_unstale":"2024-04-25T22:44:44.381810+0000","last_undegraded":"2024-04-25T22:44:44.381810+0000","last_fullsized":"2024-04-25T22:44:44.381810+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:35.916512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"72'337","reported_seq":553,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.088405+0000","last_change":"2024-04-25T22:44:27.932720+0000","last_active":"2024-04-25T22:44:42.088405+0000","last_peered":"2024-04-25T22:44:42.088405+0000","last_clean":"2024-04-25T22:41:33.341668+0000","last_became_active":"2024-04-25T22:44:27.914069+0000","last_became_peered":"2024-04-25T22:44:27.914069+0000","last_unstale":"2024-04-25T22:44:42.088405+0000","last_undegraded":"2024-04-25T22:44:27.381554+0000","last_fullsized":"2024-04-25T22:44:27.374715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":147,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25242,"num_write":307,"num_write_kb":26250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":175,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088384+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:44:42.088384+0000","last_peered":"2024-04-25T22:44:42.088384+0000","last_clean":"2024-04-25T22:44:42.088384+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:44:42.088384+0000","last_undegraded":"2024-04-25T22:44:42.088384+0000","last_fullsized":"2024-04-25T22:44:42.088384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"71'61","reported_seq":230,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088480+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:44:42.088480+0000","last_peered":"2024-04-25T22:44:42.088480+0000","last_clean":"2024-04-25T22:44:42.088480+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:44:42.088480+0000","last_undegraded":"2024-04-25T22:44:42.088480+0000","last_fullsized":"2024-04-25T22:44:42.088480+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'404","reported_seq":982,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086998+0000","last_change":"2024-04-25T22:44:32.092728+0000","last_active":"2024-04-25T22:44:42.086998+0000","last_peered":"2024-04-25T22:44:42.086998+0000","last_clean":"2024-04-25T22:44:42.086998+0000","last_became_active":"2024-04-25T22:44:32.087528+0000","last_became_peered":"2024-04-25T22:44:32.087528+0000","last_unstale":"2024-04-25T22:44:42.086998+0000","last_undegraded":"2024-04-25T22:44:42.086998+0000","last_fullsized":"2024-04-25T22:44:42.086998+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:39.481467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":20287,"num_write":371,"num_write_kb":59919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'285","reported_seq":454,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.090364+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:44:42.090364+0000","last_peered":"2024-04-25T22:44:42.090364+0000","last_clean":"2024-04-25T22:44:42.090364+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:44:42.090364+0000","last_undegraded":"2024-04-25T22:44:42.090364+0000","last_fullsized":"2024-04-25T22:44:42.090364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":183,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087287+0000","last_change":"2024-04-25T22:44:26.364185+0000","last_active":"2024-04-25T22:44:42.087287+0000","last_peered":"2024-04-25T22:44:42.087287+0000","last_clean":"2024-04-25T22:44:42.087287+0000","last_became_active":"2024-04-25T22:44:26.363583+0000","last_became_peered":"2024-04-25T22:44:26.363583+0000","last_unstale":"2024-04-25T22:44:42.087287+0000","last_undegraded":"2024-04-25T22:44:42.087287+0000","last_fullsized":"2024-04-25T22:44:42.087287+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:35:04.325449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"72'366","reported_seq":540,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.086211+0000","last_change":"2024-04-25T22:44:41.142343+0000","last_active":"2024-04-25T22:44:42.086211+0000","last_peered":"2024-04-25T22:44:42.086211+0000","last_clean":"2024-04-25T22:41:34.254671+0000","last_became_active":"2024-04-25T22:44:41.137495+0000","last_became_peered":"2024-04-25T22:44:41.137495+0000","last_unstale":"2024-04-25T22:44:42.086211+0000","last_undegraded":"2024-04-25T22:44:41.117781+0000","last_fullsized":"2024-04-25T22:44:41.117310+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":346,"num_write":330,"num_write_kb":33934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":231,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087142+0000","last_change":"2024-04-25T22:44:26.364178+0000","last_active":"2024-04-25T22:44:42.087142+0000","last_peered":"2024-04-25T22:44:42.087142+0000","last_clean":"2024-04-25T22:44:42.087142+0000","last_became_active":"2024-04-25T22:44:26.363455+0000","last_became_peered":"2024-04-25T22:44:26.363455+0000","last_unstale":"2024-04-25T22:44:42.087142+0000","last_undegraded":"2024-04-25T22:44:42.087142+0000","last_fullsized":"2024-04-25T22:44:42.087142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:58.181763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":113,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.384764+0000","last_change":"2024-04-25T22:44:41.423030+0000","last_active":"2024-04-25T22:44:44.384764+0000","last_peered":"2024-04-25T22:44:44.384764+0000","last_clean":"2024-04-25T22:44:44.384764+0000","last_became_active":"2024-04-25T22:44:41.421194+0000","last_became_peered":"2024-04-25T22:44:41.421194+0000","last_unstale":"2024-04-25T22:44:44.384764+0000","last_undegraded":"2024-04-25T22:44:44.384764+0000","last_fullsized":"2024-04-25T22:44:44.384764+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:59.297537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'413","reported_seq":708,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.086247+0000","last_change":"2024-04-25T22:44:41.136359+0000","last_active":"2024-04-25T22:44:42.086247+0000","last_peered":"2024-04-25T22:44:42.086247+0000","last_clean":"2024-04-25T22:41:34.255399+0000","last_became_active":"2024-04-25T22:44:41.132847+0000","last_became_peered":"2024-04-25T22:44:41.132847+0000","last_unstale":"2024-04-25T22:44:42.086247+0000","last_undegraded":"2024-04-25T22:44:41.118158+0000","last_fullsized":"2024-04-25T22:44:41.117469+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":142,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22994,"num_write":377,"num_write_kb":63140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"72'57","reported_seq":235,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089787+0000","last_change":"2024-04-25T22:44:26.366189+0000","last_active":"2024-04-25T22:44:42.089787+0000","last_peered":"2024-04-25T22:44:42.089787+0000","last_clean":"2024-04-25T22:44:42.089787+0000","last_became_active":"2024-04-25T22:44:26.365267+0000","last_became_peered":"2024-04-25T22:44:26.365267+0000","last_unstale":"2024-04-25T22:44:42.089787+0000","last_undegraded":"2024-04-25T22:44:42.089787+0000","last_fullsized":"2024-04-25T22:44:42.089787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:54.128937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":183,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089102+0000","last_change":"2024-04-25T22:44:26.361633+0000","last_active":"2024-04-25T22:44:42.089102+0000","last_peered":"2024-04-25T22:44:42.089102+0000","last_clean":"2024-04-25T22:44:42.089102+0000","last_became_active":"2024-04-25T22:44:26.360968+0000","last_became_peered":"2024-04-25T22:44:26.360968+0000","last_unstale":"2024-04-25T22:44:42.089102+0000","last_undegraded":"2024-04-25T22:44:42.089102+0000","last_fullsized":"2024-04-25T22:44:42.089102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:40.454898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'398","reported_seq":565,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.085377+0000","last_change":"2024-04-25T22:44:39.132801+0000","last_active":"2024-04-25T22:44:42.085377+0000","last_peered":"2024-04-25T22:44:42.085377+0000","last_clean":"2024-04-25T22:44:42.085377+0000","last_became_active":"2024-04-25T22:44:39.124378+0000","last_became_peered":"2024-04-25T22:44:39.124378+0000","last_unstale":"2024-04-25T22:44:42.085377+0000","last_undegraded":"2024-04-25T22:44:42.085377+0000","last_fullsized":"2024-04-25T22:44:42.085377+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:29.195889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6306,"num_write":372,"num_write_kb":34077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'100","reported_seq":272,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088696+0000","last_change":"2024-04-25T22:44:39.150245+0000","last_active":"2024-04-25T22:44:42.088696+0000","last_peered":"2024-04-25T22:44:42.088696+0000","last_clean":"2024-04-25T22:44:42.088696+0000","last_became_active":"2024-04-25T22:44:39.147377+0000","last_became_peered":"2024-04-25T22:44:39.147377+0000","last_unstale":"2024-04-25T22:44:42.088696+0000","last_undegraded":"2024-04-25T22:44:42.088696+0000","last_fullsized":"2024-04-25T22:44:42.088696+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:36.007978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":182,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089804+0000","last_change":"2024-04-25T22:44:26.360890+0000","last_active":"2024-04-25T22:44:42.089804+0000","last_peered":"2024-04-25T22:44:42.089804+0000","last_clean":"2024-04-25T22:44:42.089804+0000","last_became_active":"2024-04-25T22:44:26.360106+0000","last_became_peered":"2024-04-25T22:44:26.360106+0000","last_unstale":"2024-04-25T22:44:42.089804+0000","last_undegraded":"2024-04-25T22:44:42.089804+0000","last_fullsized":"2024-04-25T22:44:42.089804+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:09.929196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'390","reported_seq":591,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.382471+0000","last_change":"2024-04-25T22:44:41.433574+0000","last_active":"2024-04-25T22:44:44.382471+0000","last_peered":"2024-04-25T22:44:44.382471+0000","last_clean":"2024-04-25T22:44:44.382471+0000","last_became_active":"2024-04-25T22:44:41.414924+0000","last_became_peered":"2024-04-25T22:44:41.414924+0000","last_unstale":"2024-04-25T22:44:44.382471+0000","last_undegraded":"2024-04-25T22:44:44.382471+0000","last_fullsized":"2024-04-25T22:44:44.382471+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:46.695300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":22915,"num_write":352,"num_write_kb":47201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"72'411","reported_seq":973,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087588+0000","last_change":"2024-04-25T22:44:32.090492+0000","last_active":"2024-04-25T22:44:42.087588+0000","last_peered":"2024-04-25T22:44:42.087588+0000","last_clean":"2024-04-25T22:44:42.087588+0000","last_became_active":"2024-04-25T22:44:32.087303+0000","last_became_peered":"2024-04-25T22:44:32.087303+0000","last_unstale":"2024-04-25T22:44:42.087588+0000","last_undegraded":"2024-04-25T22:44:42.087588+0000","last_fullsized":"2024-04-25T22:44:42.087588+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25412,"num_write":367,"num_write_kb":64656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'268","reported_seq":454,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088769+0000","last_change":"2024-04-25T22:44:29.399184+0000","last_active":"2024-04-25T22:44:42.088769+0000","last_peered":"2024-04-25T22:44:42.088769+0000","last_clean":"2024-04-25T22:44:42.088769+0000","last_became_active":"2024-04-25T22:44:29.398317+0000","last_became_peered":"2024-04-25T22:44:29.398317+0000","last_unstale":"2024-04-25T22:44:42.088769+0000","last_undegraded":"2024-04-25T22:44:42.088769+0000","last_fullsized":"2024-04-25T22:44:42.088769+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:21.765162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382817,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"72'423","reported_seq":1012,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.092243+0000","last_change":"2024-04-25T22:44:42.092243+0000","last_active":"2024-04-25T22:44:42.092243+0000","last_peered":"2024-04-25T22:44:42.092243+0000","last_clean":"2024-04-25T22:44:42.092243+0000","last_became_active":"2024-04-25T22:44:42.088432+0000","last_became_peered":"2024-04-25T22:44:42.088432+0000","last_unstale":"2024-04-25T22:44:42.092243+0000","last_undegraded":"2024-04-25T22:44:42.092243+0000","last_fullsized":"2024-04-25T22:44:42.092243+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:54.239406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24794,"num_write":386,"num_write_kb":63756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'102","reported_seq":66,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.383469+0000","last_change":"2024-04-25T22:44:41.423993+0000","last_active":"2024-04-25T22:44:44.383469+0000","last_peered":"2024-04-25T22:44:44.383469+0000","last_clean":"2024-04-25T22:44:44.383469+0000","last_became_active":"2024-04-25T22:44:41.422237+0000","last_became_peered":"2024-04-25T22:44:41.422237+0000","last_unstale":"2024-04-25T22:44:44.383469+0000","last_undegraded":"2024-04-25T22:44:44.383469+0000","last_fullsized":"2024-04-25T22:44:44.383469+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:02.880774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"71'213","reported_seq":381,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088415+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:44:42.088415+0000","last_peered":"2024-04-25T22:44:42.088415+0000","last_clean":"2024-04-25T22:44:42.088415+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:44:42.088415+0000","last_undegraded":"2024-04-25T22:44:42.088415+0000","last_fullsized":"2024-04-25T22:44:42.088415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"72'504","reported_seq":734,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.084490+0000","last_change":"2024-04-25T22:44:39.142694+0000","last_active":"2024-04-25T22:44:42.084490+0000","last_peered":"2024-04-25T22:44:42.084490+0000","last_clean":"2024-04-25T22:44:42.084490+0000","last_became_active":"2024-04-25T22:44:39.132582+0000","last_became_peered":"2024-04-25T22:44:39.132582+0000","last_unstale":"2024-04-25T22:44:42.084490+0000","last_undegraded":"2024-04-25T22:44:42.084490+0000","last_fullsized":"2024-04-25T22:44:42.084490+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:14.401644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":46975,"num_write":471,"num_write_kb":146290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'64","reported_seq":185,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.089106+0000","last_change":"2024-04-25T22:44:39.136961+0000","last_active":"2024-04-25T22:44:42.089106+0000","last_peered":"2024-04-25T22:44:42.089106+0000","last_clean":"2024-04-25T22:44:42.089106+0000","last_became_active":"2024-04-25T22:44:39.136090+0000","last_became_peered":"2024-04-25T22:44:39.136090+0000","last_unstale":"2024-04-25T22:44:42.089106+0000","last_undegraded":"2024-04-25T22:44:42.089106+0000","last_fullsized":"2024-04-25T22:44:42.089106+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:35.220314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"72'475","reported_seq":1114,"reported_epoch":96,"state":"active+undersized+remapped","last_fresh":"2024-04-25T22:44:42.213854+0000","last_change":"2024-04-25T22:44:42.214479+0000","last_active":"2024-04-25T22:44:42.213854+0000","last_peered":"2024-04-25T22:44:42.213854+0000","last_clean":"2024-04-25T22:41:33.339970+0000","last_became_active":"2024-04-25T22:44:27.916087+0000","last_became_peered":"2024-04-25T22:44:27.916087+0000","last_unstale":"2024-04-25T22:44:42.213854+0000","last_undegraded":"2024-04-25T22:44:42.213854+0000","last_fullsized":"2024-04-25T22:44:27.357937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":23011,"num_write":448,"num_write_kb":76439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"72'370","reported_seq":593,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.089307+0000","last_change":"2024-04-25T22:44:41.149278+0000","last_active":"2024-04-25T22:44:42.089307+0000","last_peered":"2024-04-25T22:44:42.089307+0000","last_clean":"2024-04-25T22:41:34.256787+0000","last_became_active":"2024-04-25T22:44:41.144535+0000","last_became_peered":"2024-04-25T22:44:41.144535+0000","last_unstale":"2024-04-25T22:44:42.089307+0000","last_undegraded":"2024-04-25T22:44:41.120919+0000","last_fullsized":"2024-04-25T22:44:41.120194+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":159,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33211,"num_write":340,"num_write_kb":63312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'647","reported_seq":831,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.085716+0000","last_change":"2024-04-25T22:44:30.396965+0000","last_active":"2024-04-25T22:44:42.085716+0000","last_peered":"2024-04-25T22:44:42.085716+0000","last_clean":"2024-04-25T22:44:42.085716+0000","last_became_active":"2024-04-25T22:44:30.396073+0000","last_became_peered":"2024-04-25T22:44:30.396073+0000","last_unstale":"2024-04-25T22:44:42.085716+0000","last_undegraded":"2024-04-25T22:44:42.085716+0000","last_fullsized":"2024-04-25T22:44:42.085716+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"72'415","reported_seq":602,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087733+0000","last_change":"2024-04-25T22:44:39.150290+0000","last_active":"2024-04-25T22:44:42.087733+0000","last_peered":"2024-04-25T22:44:42.087733+0000","last_clean":"2024-04-25T22:44:42.087733+0000","last_became_active":"2024-04-25T22:44:39.146949+0000","last_became_peered":"2024-04-25T22:44:39.146949+0000","last_unstale":"2024-04-25T22:44:42.087733+0000","last_undegraded":"2024-04-25T22:44:42.087733+0000","last_fullsized":"2024-04-25T22:44:42.087733+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:11.804350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19493,"num_write":386,"num_write_kb":64692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'207","reported_seq":328,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.084841+0000","last_change":"2024-04-25T22:44:39.141125+0000","last_active":"2024-04-25T22:44:42.084841+0000","last_peered":"2024-04-25T22:44:42.084841+0000","last_clean":"2024-04-25T22:44:42.084841+0000","last_became_active":"2024-04-25T22:44:39.138371+0000","last_became_peered":"2024-04-25T22:44:39.138371+0000","last_unstale":"2024-04-25T22:44:42.084841+0000","last_undegraded":"2024-04-25T22:44:42.084841+0000","last_fullsized":"2024-04-25T22:44:42.084841+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:14.147026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"72'395","reported_seq":586,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.088005+0000","last_change":"2024-04-25T22:44:41.148833+0000","last_active":"2024-04-25T22:44:42.088005+0000","last_peered":"2024-04-25T22:44:42.088005+0000","last_clean":"2024-04-25T22:41:34.256072+0000","last_became_active":"2024-04-25T22:44:41.144491+0000","last_became_peered":"2024-04-25T22:44:41.144491+0000","last_unstale":"2024-04-25T22:44:42.088005+0000","last_undegraded":"2024-04-25T22:44:41.119473+0000","last_fullsized":"2024-04-25T22:44:41.118876+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9576,"num_write":348,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"72'194","reported_seq":333,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.382478+0000","last_change":"2024-04-25T22:44:41.422369+0000","last_active":"2024-04-25T22:44:44.382478+0000","last_peered":"2024-04-25T22:44:44.382478+0000","last_clean":"2024-04-25T22:44:44.382478+0000","last_became_active":"2024-04-25T22:44:41.420491+0000","last_became_peered":"2024-04-25T22:44:41.420491+0000","last_unstale":"2024-04-25T22:44:44.382478+0000","last_undegraded":"2024-04-25T22:44:44.382478+0000","last_fullsized":"2024-04-25T22:44:44.382478+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:35.081225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360511,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":12143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12360511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"72'398","reported_seq":612,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.085707+0000","last_change":"2024-04-25T22:44:41.134567+0000","last_active":"2024-04-25T22:44:42.085707+0000","last_peered":"2024-04-25T22:44:42.085707+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130189+0000","last_became_peered":"2024-04-25T22:44:41.130189+0000","last_unstale":"2024-04-25T22:44:42.085707+0000","last_undegraded":"2024-04-25T22:44:41.117532+0000","last_fullsized":"2024-04-25T22:44:41.116946+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31284,"num_write":371,"num_write_kb":80144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"71'51","reported_seq":64,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.382728+0000","last_change":"2024-04-25T22:44:41.415722+0000","last_active":"2024-04-25T22:44:44.382728+0000","last_peered":"2024-04-25T22:44:44.382728+0000","last_clean":"2024-04-25T22:44:44.382728+0000","last_became_active":"2024-04-25T22:44:41.414774+0000","last_became_peered":"2024-04-25T22:44:41.414774+0000","last_unstale":"2024-04-25T22:44:44.382728+0000","last_undegraded":"2024-04-25T22:44:44.382728+0000","last_fullsized":"2024-04-25T22:44:44.382728+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:20.553373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"72'383","reported_seq":601,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087165+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:44:42.087165+0000","last_peered":"2024-04-25T22:44:42.087165+0000","last_clean":"2024-04-25T22:44:42.087165+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:44:42.087165+0000","last_undegraded":"2024-04-25T22:44:42.087165+0000","last_fullsized":"2024-04-25T22:44:42.087165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29308,"num_write":358,"num_write_kb":66975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"71'177","reported_seq":345,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088466+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:44:42.088466+0000","last_peered":"2024-04-25T22:44:42.088466+0000","last_clean":"2024-04-25T22:44:42.088466+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:44:42.088466+0000","last_undegraded":"2024-04-25T22:44:42.088466+0000","last_fullsized":"2024-04-25T22:44:42.088466+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"72'387","reported_seq":566,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.087464+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:44:42.087464+0000","last_peered":"2024-04-25T22:44:42.087464+0000","last_clean":"2024-04-25T22:44:42.087464+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:44:42.087464+0000","last_undegraded":"2024-04-25T22:44:42.087464+0000","last_fullsized":"2024-04-25T22:44:42.087464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3883,"num_write":348,"num_write_kb":34122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'209","reported_seq":383,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.382768+0000","last_change":"2024-04-25T22:44:41.419972+0000","last_active":"2024-04-25T22:44:44.382768+0000","last_peered":"2024-04-25T22:44:44.382768+0000","last_clean":"2024-04-25T22:44:44.382768+0000","last_became_active":"2024-04-25T22:44:41.418106+0000","last_became_peered":"2024-04-25T22:44:41.418106+0000","last_unstale":"2024-04-25T22:44:44.382768+0000","last_undegraded":"2024-04-25T22:44:44.382768+0000","last_fullsized":"2024-04-25T22:44:44.382768+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:07.628155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":12363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"72'419","reported_seq":577,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.382142+0000","last_change":"2024-04-25T22:44:41.434376+0000","last_active":"2024-04-25T22:44:44.382142+0000","last_peered":"2024-04-25T22:44:44.382142+0000","last_clean":"2024-04-25T22:44:44.382142+0000","last_became_active":"2024-04-25T22:44:41.420505+0000","last_became_peered":"2024-04-25T22:44:41.420505+0000","last_unstale":"2024-04-25T22:44:44.382142+0000","last_undegraded":"2024-04-25T22:44:44.382142+0000","last_fullsized":"2024-04-25T22:44:44.382142+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:04.414563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":13327,"num_write":388,"num_write_kb":55674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"71'131","reported_seq":315,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088052+0000","last_change":"2024-04-25T22:44:29.398880+0000","last_active":"2024-04-25T22:44:42.088052+0000","last_peered":"2024-04-25T22:44:42.088052+0000","last_clean":"2024-04-25T22:44:42.088052+0000","last_became_active":"2024-04-25T22:44:29.397905+0000","last_became_peered":"2024-04-25T22:44:29.397905+0000","last_unstale":"2024-04-25T22:44:42.088052+0000","last_undegraded":"2024-04-25T22:44:42.088052+0000","last_fullsized":"2024-04-25T22:44:42.088052+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:44.236330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"72'449","reported_seq":649,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.086730+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:44:42.086730+0000","last_peered":"2024-04-25T22:44:42.086730+0000","last_clean":"2024-04-25T22:44:42.086730+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:44:42.086730+0000","last_undegraded":"2024-04-25T22:44:42.086730+0000","last_fullsized":"2024-04-25T22:44:42.086730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14222,"num_write":424,"num_write_kb":79796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"71'57","reported_seq":179,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T22:44:42.088552+0000","last_change":"2024-04-25T22:44:39.137232+0000","last_active":"2024-04-25T22:44:42.088552+0000","last_peered":"2024-04-25T22:44:42.088552+0000","last_clean":"2024-04-25T22:44:42.088552+0000","last_became_active":"2024-04-25T22:44:39.136283+0000","last_became_peered":"2024-04-25T22:44:39.136283+0000","last_unstale":"2024-04-25T22:44:42.088552+0000","last_undegraded":"2024-04-25T22:44:42.088552+0000","last_fullsized":"2024-04-25T22:44:42.088552+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:32.428982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3832,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2461,"num_read_kb":1248646,"num_write":24434,"num_write_kb":4137258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3444,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26539,"ondisk_log_size":26539,"up":128,"acting":104,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127071275,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":4473,"num_write_kb":127409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254210048,"data_stored":254142550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},"log_size":6216,"ondisk_log_size":6216,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738430,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165144,"kb_used_data":79880,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94206696,"statfs":{"total":96636764160,"available":96467656704,"internally_reserved":0,"allocated":81797120,"data_stored":81335328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":79,"seq":339302416390,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110700,"kb_used_data":83164,"kb_used_omap":5,"kb_used_meta":27514,"kb_avail":94261140,"statfs":{"total":96636764160,"available":96523407360,"internally_reserved":0,"allocated":85159936,"data_stored":84666903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6003,"internal_metadata":28174477},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174152,"kb_used_data":88888,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94197688,"statfs":{"total":96636764160,"available":96458432512,"internally_reserved":0,"allocated":91021312,"data_stored":90537559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89575424,"data_stored":89544940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83689472,"data_stored":83664533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80945152,"data_stored":80933077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:44:47.387 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T22:44:47.786 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:44:47.786 INFO:teuthology.orchestra.run.smithi057.stdout:{"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 3832/108 objects degraded (3548.148%), 22 pgs degraded","count":22},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":295,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":101,"num_osds":3,"num_up_osds":3,"osd_up_since":1714085065,"num_in_osds":3,"osd_in_since":1714084793,"num_remapped_pgs":16},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":80},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":22},{"state_name":"peering","count":1},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"active+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":54,"data_bytes":127661643,"bytes_used":460795904,"bytes_avail":289449496576,"bytes_total":289910292480,"inactive_pgs_ratio":0.0095238098874688148,"degraded_objects":3832,"degraded_total":108,"degraded_ratio":35.481481481481481,"recovering_objects_per_sec":105,"recovering_bytes_per_sec":1048278,"recovering_keys_per_sec":0,"num_objects_recovered":422,"num_bytes_recovered":4194394,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4192}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-25T22:41:21.139402+0000","services":{}},"progress_events":{}} 2024-04-25T22:44:47.804 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-25T22:44:47.804 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:44:48.125 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:44:48.126 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:44:48.144 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2024-04-25T22:44:48.080067+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127661643,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2659,"num_read_kb":1250233,"num_write":29110,"num_write_kb":4268127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4258,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32912,"ondisk_log_size":32912,"up":210,"acting":191,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":450108,"kb_used_data":252052,"kb_used_omap":8,"kb_used_meta":198007,"kb_avail":282665412,"statfs":{"total":289910292480,"available":289449381888,"internally_reserved":0,"allocated":258101248,"data_stored":256587990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9193,"internal_metadata":202759191},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-668,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":794,"num_bytes_recovered":4194394,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.985729"},"pg_stats":[{"pgid":"4.3f","version":"72'404","reported_seq":599,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.081637+0000","last_change":"2024-04-25T22:44:41.145114+0000","last_active":"2024-04-25T22:44:47.081637+0000","last_peered":"2024-04-25T22:44:47.081637+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.142277+0000","last_became_peered":"2024-04-25T22:44:41.142277+0000","last_unstale":"2024-04-25T22:44:47.081637+0000","last_undegraded":"2024-04-25T22:44:41.121372+0000","last_fullsized":"2024-04-25T22:44:41.120599+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19772,"num_write":366,"num_write_kb":46873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"72'420","reported_seq":592,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.384378+0000","last_change":"2024-04-25T22:44:41.434387+0000","last_active":"2024-04-25T22:44:44.384378+0000","last_peered":"2024-04-25T22:44:44.384378+0000","last_clean":"2024-04-25T22:44:44.384378+0000","last_became_active":"2024-04-25T22:44:41.418792+0000","last_became_peered":"2024-04-25T22:44:41.418792+0000","last_unstale":"2024-04-25T22:44:44.384378+0000","last_undegraded":"2024-04-25T22:44:44.384378+0000","last_fullsized":"2024-04-25T22:44:44.384378+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:43.196115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24515,"num_write":386,"num_write_kb":55688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"72'377","reported_seq":928,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082800+0000","last_change":"2024-04-25T22:44:42.096911+0000","last_active":"2024-04-25T22:44:47.082800+0000","last_peered":"2024-04-25T22:44:47.082800+0000","last_clean":"2024-04-25T22:44:47.082800+0000","last_became_active":"2024-04-25T22:44:42.093941+0000","last_became_peered":"2024-04-25T22:44:42.093941+0000","last_unstale":"2024-04-25T22:44:47.082800+0000","last_undegraded":"2024-04-25T22:44:47.082800+0000","last_fullsized":"2024-04-25T22:44:47.082800+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11135,"num_write":346,"num_write_kb":38950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"72'366","reported_seq":549,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082403+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:44:47.082403+0000","last_peered":"2024-04-25T22:44:47.082403+0000","last_clean":"2024-04-25T22:44:47.082403+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:44:47.082403+0000","last_undegraded":"2024-04-25T22:44:47.082403+0000","last_fullsized":"2024-04-25T22:44:47.082403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":326,"num_write_kb":34079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"72'455","reported_seq":660,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.077923+0000","last_change":"2024-04-25T22:44:41.134406+0000","last_active":"2024-04-25T22:44:47.077923+0000","last_peered":"2024-04-25T22:44:47.077923+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130077+0000","last_became_peered":"2024-04-25T22:44:41.130077+0000","last_unstale":"2024-04-25T22:44:47.077923+0000","last_undegraded":"2024-04-25T22:44:41.117231+0000","last_fullsized":"2024-04-25T22:44:41.116610+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33897,"num_write":426,"num_write_kb":100721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"72'401","reported_seq":611,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082143+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:44:47.082143+0000","last_peered":"2024-04-25T22:44:47.082143+0000","last_clean":"2024-04-25T22:44:47.082143+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:44:47.082143+0000","last_undegraded":"2024-04-25T22:44:47.082143+0000","last_fullsized":"2024-04-25T22:44:47.082143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15258,"num_write":369,"num_write_kb":53298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"72'452","reported_seq":694,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081149+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:44:47.081149+0000","last_peered":"2024-04-25T22:44:47.081149+0000","last_clean":"2024-04-25T22:44:47.081149+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:44:47.081149+0000","last_undegraded":"2024-04-25T22:44:47.081149+0000","last_fullsized":"2024-04-25T22:44:47.081149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34010,"num_write":428,"num_write_kb":157752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"72'401","reported_seq":616,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080719+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:44:47.080719+0000","last_peered":"2024-04-25T22:44:47.080719+0000","last_clean":"2024-04-25T22:44:47.080719+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:44:47.080719+0000","last_undegraded":"2024-04-25T22:44:47.080719+0000","last_fullsized":"2024-04-25T22:44:47.080719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19917,"num_write":359,"num_write_kb":109382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"72'394","reported_seq":950,"reported_epoch":100,"state":"peering","last_fresh":"2024-04-25T22:44:46.273311+0000","last_change":"2024-04-25T22:44:47.080405+0000","last_active":"2024-04-25T22:44:47.080405+0000","last_peered":"2024-04-25T22:44:46.273311+0000","last_clean":"2024-04-25T22:41:33.341370+0000","last_became_active":"2024-04-25T22:44:27.927304+0000","last_became_peered":"2024-04-25T22:44:27.927304+0000","last_unstale":"2024-04-25T22:44:46.273311+0000","last_undegraded":"2024-04-25T22:44:46.273311+0000","last_fullsized":"2024-04-25T22:44:27.345517+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9569,"num_write":360,"num_write_kb":25560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"72'382","reported_seq":536,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.384255+0000","last_change":"2024-04-25T22:44:41.433644+0000","last_active":"2024-04-25T22:44:44.384255+0000","last_peered":"2024-04-25T22:44:44.384255+0000","last_clean":"2024-04-25T22:44:44.384255+0000","last_became_active":"2024-04-25T22:44:41.421234+0000","last_became_peered":"2024-04-25T22:44:41.421234+0000","last_unstale":"2024-04-25T22:44:44.384255+0000","last_undegraded":"2024-04-25T22:44:44.384255+0000","last_fullsized":"2024-04-25T22:44:44.384255+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:24.217391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17192,"num_write":338,"num_write_kb":38688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"72'369","reported_seq":568,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083093+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:44:47.083093+0000","last_peered":"2024-04-25T22:44:47.083093+0000","last_clean":"2024-04-25T22:44:47.083093+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:44:47.083093+0000","last_undegraded":"2024-04-25T22:44:47.083093+0000","last_fullsized":"2024-04-25T22:44:47.083093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7385,"num_write":349,"num_write_kb":58842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"72'338","reported_seq":547,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.082206+0000","last_change":"2024-04-25T22:44:41.137110+0000","last_active":"2024-04-25T22:44:47.082206+0000","last_peered":"2024-04-25T22:44:47.082206+0000","last_clean":"2024-04-25T22:41:34.255048+0000","last_became_active":"2024-04-25T22:44:41.133243+0000","last_became_peered":"2024-04-25T22:44:41.133243+0000","last_unstale":"2024-04-25T22:44:47.082206+0000","last_undegraded":"2024-04-25T22:44:41.118173+0000","last_fullsized":"2024-04-25T22:44:41.117638+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":151,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13619,"num_write":312,"num_write_kb":21391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"72'411","reported_seq":575,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.383220+0000","last_change":"2024-04-25T22:44:41.432463+0000","last_active":"2024-04-25T22:44:44.383220+0000","last_peered":"2024-04-25T22:44:44.383220+0000","last_clean":"2024-04-25T22:44:44.383220+0000","last_became_active":"2024-04-25T22:44:41.421096+0000","last_became_peered":"2024-04-25T22:44:41.421096+0000","last_unstale":"2024-04-25T22:44:44.383220+0000","last_undegraded":"2024-04-25T22:44:44.383220+0000","last_fullsized":"2024-04-25T22:44:44.383220+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:46.942677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12998,"num_write":375,"num_write_kb":79661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"72'452","reported_seq":1026,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082465+0000","last_change":"2024-04-25T22:44:40.130299+0000","last_active":"2024-04-25T22:44:47.082465+0000","last_peered":"2024-04-25T22:44:47.082465+0000","last_clean":"2024-04-25T22:44:47.082465+0000","last_became_active":"2024-04-25T22:44:40.127307+0000","last_became_peered":"2024-04-25T22:44:40.127307+0000","last_unstale":"2024-04-25T22:44:47.082465+0000","last_undegraded":"2024-04-25T22:44:47.082465+0000","last_fullsized":"2024-04-25T22:44:47.082465+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:16.746830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":854,"num_write":419,"num_write_kb":88217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"72'428","reported_seq":1006,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081139+0000","last_change":"2024-04-25T22:44:35.108361+0000","last_active":"2024-04-25T22:44:47.081139+0000","last_peered":"2024-04-25T22:44:47.081139+0000","last_clean":"2024-04-25T22:44:47.081139+0000","last_became_active":"2024-04-25T22:44:35.103208+0000","last_became_peered":"2024-04-25T22:44:35.103208+0000","last_unstale":"2024-04-25T22:44:47.081139+0000","last_undegraded":"2024-04-25T22:44:47.081139+0000","last_fullsized":"2024-04-25T22:44:47.081139+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:22.046332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21291,"num_write":389,"num_write_kb":68562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"72'401","reported_seq":590,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080733+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:44:47.080733+0000","last_peered":"2024-04-25T22:44:47.080733+0000","last_clean":"2024-04-25T22:44:47.080733+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:44:47.080733+0000","last_undegraded":"2024-04-25T22:44:47.080733+0000","last_fullsized":"2024-04-25T22:44:47.080733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8276,"num_write":369,"num_write_kb":17867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"72'398","reported_seq":846,"reported_epoch":101,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-25T22:44:47.267185+0000","last_change":"2024-04-25T22:44:46.800575+0000","last_active":"2024-04-25T22:44:47.267185+0000","last_peered":"2024-04-25T22:44:47.267185+0000","last_clean":"2024-04-25T22:41:33.342064+0000","last_became_active":"2024-04-25T22:44:27.932101+0000","last_became_peered":"2024-04-25T22:44:27.932101+0000","last_unstale":"2024-04-25T22:44:47.267185+0000","last_undegraded":"2024-04-25T22:44:47.267185+0000","last_fullsized":"2024-04-25T22:44:27.382718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5883,"num_write":362,"num_write_kb":38188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":128,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"72'407","reported_seq":586,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.079985+0000","last_change":"2024-04-25T22:44:41.159724+0000","last_active":"2024-04-25T22:44:47.079985+0000","last_peered":"2024-04-25T22:44:47.079985+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.154547+0000","last_became_peered":"2024-04-25T22:44:41.154547+0000","last_unstale":"2024-04-25T22:44:47.079985+0000","last_undegraded":"2024-04-25T22:44:41.121499+0000","last_fullsized":"2024-04-25T22:44:41.120885+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13073,"num_write":372,"num_write_kb":59323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"72'441","reported_seq":1035,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.079761+0000","last_change":"2024-04-25T22:44:41.148409+0000","last_active":"2024-04-25T22:44:47.079761+0000","last_peered":"2024-04-25T22:44:47.079761+0000","last_clean":"2024-04-25T22:44:47.079761+0000","last_became_active":"2024-04-25T22:44:41.143302+0000","last_became_peered":"2024-04-25T22:44:41.143302+0000","last_unstale":"2024-04-25T22:44:47.079761+0000","last_undegraded":"2024-04-25T22:44:47.079761+0000","last_fullsized":"2024-04-25T22:44:47.079761+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:46.289713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37611,"num_write":403,"num_write_kb":116618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"72'438","reported_seq":640,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082905+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:44:47.082905+0000","last_peered":"2024-04-25T22:44:47.082905+0000","last_clean":"2024-04-25T22:44:47.082905+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:44:47.082905+0000","last_undegraded":"2024-04-25T22:44:47.082905+0000","last_fullsized":"2024-04-25T22:44:47.082905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12393,"num_write":408,"num_write_kb":99933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"72'407","reported_seq":598,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083942+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:44:47.083942+0000","last_peered":"2024-04-25T22:44:47.083942+0000","last_clean":"2024-04-25T22:44:47.083942+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:44:47.083942+0000","last_undegraded":"2024-04-25T22:44:47.083942+0000","last_fullsized":"2024-04-25T22:44:47.083942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8932,"num_write":382,"num_write_kb":59684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"72'463","reported_seq":700,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.086051+0000","last_change":"2024-04-25T22:44:41.132736+0000","last_active":"2024-04-25T22:44:42.086051+0000","last_peered":"2024-04-25T22:44:42.086051+0000","last_clean":"2024-04-25T22:41:34.254643+0000","last_became_active":"2024-04-25T22:44:41.129315+0000","last_became_peered":"2024-04-25T22:44:41.129315+0000","last_unstale":"2024-04-25T22:44:42.086051+0000","last_undegraded":"2024-04-25T22:44:41.117085+0000","last_fullsized":"2024-04-25T22:44:41.116491+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27589,"num_write":428,"num_write_kb":76861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"72'425","reported_seq":670,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.077486+0000","last_change":"2024-04-25T22:44:39.132230+0000","last_active":"2024-04-25T22:44:47.077486+0000","last_peered":"2024-04-25T22:44:47.077486+0000","last_clean":"2024-04-25T22:44:47.077486+0000","last_became_active":"2024-04-25T22:44:39.118635+0000","last_became_peered":"2024-04-25T22:44:39.118635+0000","last_unstale":"2024-04-25T22:44:47.077486+0000","last_undegraded":"2024-04-25T22:44:47.077486+0000","last_fullsized":"2024-04-25T22:44:47.077486+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:15.096836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":46424,"num_write":390,"num_write_kb":96359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"72'445","reported_seq":652,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.078066+0000","last_change":"2024-04-25T22:44:41.135696+0000","last_active":"2024-04-25T22:44:47.078066+0000","last_peered":"2024-04-25T22:44:47.078066+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130730+0000","last_became_peered":"2024-04-25T22:44:41.130730+0000","last_unstale":"2024-04-25T22:44:47.078066+0000","last_undegraded":"2024-04-25T22:44:41.116994+0000","last_fullsized":"2024-04-25T22:44:41.116354+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32317,"num_write":419,"num_write_kb":76071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"72'424","reported_seq":616,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.084483+0000","last_change":"2024-04-25T22:44:41.138549+0000","last_active":"2024-04-25T22:44:47.084483+0000","last_peered":"2024-04-25T22:44:47.084483+0000","last_clean":"2024-04-25T22:41:34.256374+0000","last_became_active":"2024-04-25T22:44:41.133640+0000","last_became_peered":"2024-04-25T22:44:41.133640+0000","last_unstale":"2024-04-25T22:44:47.084483+0000","last_undegraded":"2024-04-25T22:44:41.120823+0000","last_fullsized":"2024-04-25T22:44:41.120131+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8396,"num_write":399,"num_write_kb":50416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"72'499","reported_seq":686,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.079339+0000","last_change":"2024-04-25T22:44:39.149280+0000","last_active":"2024-04-25T22:44:47.079339+0000","last_peered":"2024-04-25T22:44:47.079339+0000","last_clean":"2024-04-25T22:44:47.079339+0000","last_became_active":"2024-04-25T22:44:39.143391+0000","last_became_peered":"2024-04-25T22:44:39.143391+0000","last_unstale":"2024-04-25T22:44:47.079339+0000","last_undegraded":"2024-04-25T22:44:47.079339+0000","last_fullsized":"2024-04-25T22:44:47.079339+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:54:10.301144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10227,"num_write":453,"num_write_kb":96585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'430","reported_seq":1058,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083135+0000","last_change":"2024-04-25T22:44:39.113437+0000","last_active":"2024-04-25T22:44:47.083135+0000","last_peered":"2024-04-25T22:44:47.083135+0000","last_clean":"2024-04-25T22:44:47.083135+0000","last_became_active":"2024-04-25T22:44:39.109771+0000","last_became_peered":"2024-04-25T22:44:39.109771+0000","last_unstale":"2024-04-25T22:44:47.083135+0000","last_undegraded":"2024-04-25T22:44:47.083135+0000","last_fullsized":"2024-04-25T22:44:47.083135+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:40:46.739897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":32116,"num_write":409,"num_write_kb":89217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"72'393","reported_seq":626,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.384063+0000","last_change":"2024-04-25T22:44:41.425947+0000","last_active":"2024-04-25T22:44:44.384063+0000","last_peered":"2024-04-25T22:44:44.384063+0000","last_clean":"2024-04-25T22:44:44.384063+0000","last_became_active":"2024-04-25T22:44:41.413570+0000","last_became_peered":"2024-04-25T22:44:41.413570+0000","last_unstale":"2024-04-25T22:44:44.384063+0000","last_undegraded":"2024-04-25T22:44:44.384063+0000","last_fullsized":"2024-04-25T22:44:44.384063+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:39:00.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":28076,"num_write":364,"num_write_kb":47473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"72'399","reported_seq":969,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078495+0000","last_change":"2024-04-25T22:44:40.124745+0000","last_active":"2024-04-25T22:44:47.078495+0000","last_peered":"2024-04-25T22:44:47.078495+0000","last_clean":"2024-04-25T22:44:47.078495+0000","last_became_active":"2024-04-25T22:44:40.121838+0000","last_became_peered":"2024-04-25T22:44:40.121838+0000","last_unstale":"2024-04-25T22:44:47.078495+0000","last_undegraded":"2024-04-25T22:44:47.078495+0000","last_fullsized":"2024-04-25T22:44:47.078495+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:28.299317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14005,"num_write":367,"num_write_kb":58883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"72'484","reported_seq":716,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.082206+0000","last_change":"2024-04-25T22:44:41.147898+0000","last_active":"2024-04-25T22:44:47.082206+0000","last_peered":"2024-04-25T22:44:47.082206+0000","last_clean":"2024-04-25T22:41:34.255390+0000","last_became_active":"2024-04-25T22:44:41.144605+0000","last_became_peered":"2024-04-25T22:44:41.144605+0000","last_unstale":"2024-04-25T22:44:47.082206+0000","last_undegraded":"2024-04-25T22:44:41.118456+0000","last_fullsized":"2024-04-25T22:44:41.117828+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":208,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23352,"num_write":446,"num_write_kb":100094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"72'455","reported_seq":1112,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.077464+0000","last_change":"2024-04-25T22:44:33.087211+0000","last_active":"2024-04-25T22:44:47.077464+0000","last_peered":"2024-04-25T22:44:47.077464+0000","last_clean":"2024-04-25T22:44:47.077464+0000","last_became_active":"2024-04-25T22:44:33.084127+0000","last_became_peered":"2024-04-25T22:44:33.084127+0000","last_unstale":"2024-04-25T22:44:47.077464+0000","last_undegraded":"2024-04-25T22:44:47.077464+0000","last_fullsized":"2024-04-25T22:44:47.077464+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38440,"num_write":423,"num_write_kb":71855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"72'434","reported_seq":644,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081082+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:44:47.081082+0000","last_peered":"2024-04-25T22:44:47.081082+0000","last_clean":"2024-04-25T22:44:47.081082+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:44:47.081082+0000","last_undegraded":"2024-04-25T22:44:47.081082+0000","last_fullsized":"2024-04-25T22:44:47.081082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18701,"num_write":402,"num_write_kb":27564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"72'379","reported_seq":557,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.079424+0000","last_change":"2024-04-25T22:44:41.134849+0000","last_active":"2024-04-25T22:44:47.079424+0000","last_peered":"2024-04-25T22:44:47.079424+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130604+0000","last_became_peered":"2024-04-25T22:44:41.130604+0000","last_unstale":"2024-04-25T22:44:47.079424+0000","last_undegraded":"2024-04-25T22:44:41.118062+0000","last_fullsized":"2024-04-25T22:44:41.117484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18623,"num_write":344,"num_write_kb":50888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"71'528","reported_seq":706,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.084117+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:44:47.084117+0000","last_peered":"2024-04-25T22:44:47.084117+0000","last_clean":"2024-04-25T22:44:47.084117+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:44:47.084117+0000","last_undegraded":"2024-04-25T22:44:47.084117+0000","last_fullsized":"2024-04-25T22:44:47.084117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"72'383","reported_seq":544,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.078889+0000","last_change":"2024-04-25T22:44:41.148275+0000","last_active":"2024-04-25T22:44:47.078889+0000","last_peered":"2024-04-25T22:44:47.078889+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.142954+0000","last_became_peered":"2024-04-25T22:44:41.142954+0000","last_unstale":"2024-04-25T22:44:47.078889+0000","last_undegraded":"2024-04-25T22:44:41.119000+0000","last_fullsized":"2024-04-25T22:44:41.118353+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8364,"num_write":351,"num_write_kb":30625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"71'45","reported_seq":176,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078818+0000","last_change":"2024-04-25T22:44:39.117622+0000","last_active":"2024-04-25T22:44:47.078818+0000","last_peered":"2024-04-25T22:44:47.078818+0000","last_clean":"2024-04-25T22:44:47.078818+0000","last_became_active":"2024-04-25T22:44:39.115669+0000","last_became_peered":"2024-04-25T22:44:39.115669+0000","last_unstale":"2024-04-25T22:44:47.078818+0000","last_undegraded":"2024-04-25T22:44:47.078818+0000","last_fullsized":"2024-04-25T22:44:47.078818+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:21.793820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"72'429","reported_seq":611,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.080724+0000","last_change":"2024-04-25T22:44:41.157231+0000","last_active":"2024-04-25T22:44:47.080724+0000","last_peered":"2024-04-25T22:44:47.080724+0000","last_clean":"2024-04-25T22:44:24.311958+0000","last_became_active":"2024-04-25T22:44:41.154517+0000","last_became_peered":"2024-04-25T22:44:41.154517+0000","last_unstale":"2024-04-25T22:44:47.080724+0000","last_undegraded":"2024-04-25T22:44:41.121712+0000","last_fullsized":"2024-04-25T22:44:41.121143+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16584,"num_write":393,"num_write_kb":63712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'61","reported_seq":59,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.382217+0000","last_change":"2024-04-25T22:44:41.416554+0000","last_active":"2024-04-25T22:44:44.382217+0000","last_peered":"2024-04-25T22:44:44.382217+0000","last_clean":"2024-04-25T22:44:44.382217+0000","last_became_active":"2024-04-25T22:44:41.413853+0000","last_became_peered":"2024-04-25T22:44:41.413853+0000","last_unstale":"2024-04-25T22:44:44.382217+0000","last_undegraded":"2024-04-25T22:44:44.382217+0000","last_fullsized":"2024-04-25T22:44:44.382217+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:50.701110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"72'404","reported_seq":600,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.079576+0000","last_change":"2024-04-25T22:44:39.128428+0000","last_active":"2024-04-25T22:44:47.079576+0000","last_peered":"2024-04-25T22:44:47.079576+0000","last_clean":"2024-04-25T22:44:47.079576+0000","last_became_active":"2024-04-25T22:44:39.116562+0000","last_became_peered":"2024-04-25T22:44:39.116562+0000","last_unstale":"2024-04-25T22:44:47.079576+0000","last_undegraded":"2024-04-25T22:44:47.079576+0000","last_fullsized":"2024-04-25T22:44:47.079576+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:09.750726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18745,"num_write":376,"num_write_kb":96145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'71","reported_seq":257,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081201+0000","last_change":"2024-04-25T22:44:26.363329+0000","last_active":"2024-04-25T22:44:47.081201+0000","last_peered":"2024-04-25T22:44:47.081201+0000","last_clean":"2024-04-25T22:44:47.081201+0000","last_became_active":"2024-04-25T22:44:26.362499+0000","last_became_peered":"2024-04-25T22:44:26.362499+0000","last_unstale":"2024-04-25T22:44:47.081201+0000","last_undegraded":"2024-04-25T22:44:47.081201+0000","last_fullsized":"2024-04-25T22:44:47.081201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'145","reported_seq":338,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.085425+0000","last_change":"2024-04-25T22:44:29.400540+0000","last_active":"2024-04-25T22:44:47.085425+0000","last_peered":"2024-04-25T22:44:47.085425+0000","last_clean":"2024-04-25T22:44:47.085425+0000","last_became_active":"2024-04-25T22:44:29.399853+0000","last_became_peered":"2024-04-25T22:44:29.399853+0000","last_unstale":"2024-04-25T22:44:47.085425+0000","last_undegraded":"2024-04-25T22:44:47.085425+0000","last_fullsized":"2024-04-25T22:44:47.085425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"72'399","reported_seq":611,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.085642+0000","last_change":"2024-04-25T22:44:41.132315+0000","last_active":"2024-04-25T22:44:42.085642+0000","last_peered":"2024-04-25T22:44:42.085642+0000","last_clean":"2024-04-25T22:41:34.254259+0000","last_became_active":"2024-04-25T22:44:41.129040+0000","last_became_peered":"2024-04-25T22:44:41.129040+0000","last_unstale":"2024-04-25T22:44:42.085642+0000","last_undegraded":"2024-04-25T22:44:41.116129+0000","last_fullsized":"2024-04-25T22:44:41.115733+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25159,"num_write":363,"num_write_kb":34063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"71'226","reported_seq":402,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.383746+0000","last_change":"2024-04-25T22:44:41.417859+0000","last_active":"2024-04-25T22:44:44.383746+0000","last_peered":"2024-04-25T22:44:44.383746+0000","last_clean":"2024-04-25T22:44:44.383746+0000","last_became_active":"2024-04-25T22:44:41.416542+0000","last_became_peered":"2024-04-25T22:44:41.416542+0000","last_unstale":"2024-04-25T22:44:44.383746+0000","last_undegraded":"2024-04-25T22:44:44.383746+0000","last_fullsized":"2024-04-25T22:44:44.383746+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:27.884903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"72'431","reported_seq":615,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.077786+0000","last_change":"2024-04-25T22:44:41.136042+0000","last_active":"2024-04-25T22:44:47.077786+0000","last_peered":"2024-04-25T22:44:47.077786+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130862+0000","last_became_peered":"2024-04-25T22:44:41.130862+0000","last_unstale":"2024-04-25T22:44:47.077786+0000","last_undegraded":"2024-04-25T22:44:41.117168+0000","last_fullsized":"2024-04-25T22:44:41.116538+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14688,"num_write":405,"num_write_kb":38957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"71'382","reported_seq":575,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083938+0000","last_change":"2024-04-25T22:44:30.401893+0000","last_active":"2024-04-25T22:44:47.083938+0000","last_peered":"2024-04-25T22:44:47.083938+0000","last_clean":"2024-04-25T22:44:47.083938+0000","last_became_active":"2024-04-25T22:44:30.401021+0000","last_became_peered":"2024-04-25T22:44:30.401021+0000","last_unstale":"2024-04-25T22:44:47.083938+0000","last_undegraded":"2024-04-25T22:44:47.083938+0000","last_fullsized":"2024-04-25T22:44:47.083938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:38.452482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'453","reported_seq":661,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082545+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:44:47.082545+0000","last_peered":"2024-04-25T22:44:47.082545+0000","last_clean":"2024-04-25T22:44:47.082545+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:44:47.082545+0000","last_undegraded":"2024-04-25T22:44:47.082545+0000","last_fullsized":"2024-04-25T22:44:47.082545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18900,"num_write":418,"num_write_kb":117500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"71'64","reported_seq":243,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083511+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:44:47.083511+0000","last_peered":"2024-04-25T22:44:47.083511+0000","last_clean":"2024-04-25T22:44:47.083511+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:44:47.083511+0000","last_undegraded":"2024-04-25T22:44:47.083511+0000","last_fullsized":"2024-04-25T22:44:47.083511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'428","reported_seq":607,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078908+0000","last_change":"2024-04-25T22:44:39.129871+0000","last_active":"2024-04-25T22:44:47.078908+0000","last_peered":"2024-04-25T22:44:47.078908+0000","last_clean":"2024-04-25T22:44:47.078908+0000","last_became_active":"2024-04-25T22:44:39.121205+0000","last_became_peered":"2024-04-25T22:44:39.121205+0000","last_unstale":"2024-04-25T22:44:47.078908+0000","last_undegraded":"2024-04-25T22:44:47.078908+0000","last_fullsized":"2024-04-25T22:44:47.078908+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:48.521828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7477,"num_write":383,"num_write_kb":9617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'166","reported_seq":298,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.079410+0000","last_change":"2024-04-25T22:44:39.133550+0000","last_active":"2024-04-25T22:44:47.079410+0000","last_peered":"2024-04-25T22:44:47.079410+0000","last_clean":"2024-04-25T22:44:47.079410+0000","last_became_active":"2024-04-25T22:44:39.131489+0000","last_became_peered":"2024-04-25T22:44:39.131489+0000","last_unstale":"2024-04-25T22:44:47.079410+0000","last_undegraded":"2024-04-25T22:44:47.079410+0000","last_fullsized":"2024-04-25T22:44:47.079410+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:32.980801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"72'446","reported_seq":672,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083014+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:44:47.083014+0000","last_peered":"2024-04-25T22:44:47.083014+0000","last_clean":"2024-04-25T22:44:47.083014+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:44:47.083014+0000","last_undegraded":"2024-04-25T22:44:47.083014+0000","last_fullsized":"2024-04-25T22:44:47.083014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27788,"num_write":414,"num_write_kb":47058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"71'113","reported_seq":292,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083244+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:44:47.083244+0000","last_peered":"2024-04-25T22:44:47.083244+0000","last_clean":"2024-04-25T22:44:47.083244+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:44:47.083244+0000","last_undegraded":"2024-04-25T22:44:47.083244+0000","last_fullsized":"2024-04-25T22:44:47.083244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"72'417","reported_seq":995,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083635+0000","last_change":"2024-04-25T22:44:44.113498+0000","last_active":"2024-04-25T22:44:47.083635+0000","last_peered":"2024-04-25T22:44:47.083635+0000","last_clean":"2024-04-25T22:44:47.083635+0000","last_became_active":"2024-04-25T22:44:44.108084+0000","last_became_peered":"2024-04-25T22:44:44.108084+0000","last_unstale":"2024-04-25T22:44:47.083635+0000","last_undegraded":"2024-04-25T22:44:47.083635+0000","last_fullsized":"2024-04-25T22:44:47.083635+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16487,"num_write":388,"num_write_kb":75452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'59","reported_seq":59,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.381832+0000","last_change":"2024-04-25T22:44:41.417821+0000","last_active":"2024-04-25T22:44:44.381832+0000","last_peered":"2024-04-25T22:44:44.381832+0000","last_clean":"2024-04-25T22:44:44.381832+0000","last_became_active":"2024-04-25T22:44:41.415769+0000","last_became_peered":"2024-04-25T22:44:41.415769+0000","last_unstale":"2024-04-25T22:44:44.381832+0000","last_undegraded":"2024-04-25T22:44:44.381832+0000","last_fullsized":"2024-04-25T22:44:44.381832+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.099475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'358","reported_seq":876,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082996+0000","last_change":"2024-04-25T22:44:34.101942+0000","last_active":"2024-04-25T22:44:47.082996+0000","last_peered":"2024-04-25T22:44:47.082996+0000","last_clean":"2024-04-25T22:44:47.082996+0000","last_became_active":"2024-04-25T22:44:34.099595+0000","last_became_peered":"2024-04-25T22:44:34.099595+0000","last_unstale":"2024-04-25T22:44:47.082996+0000","last_undegraded":"2024-04-25T22:44:47.082996+0000","last_fullsized":"2024-04-25T22:44:47.082996+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:06.523166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12259,"num_write":325,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'465","reported_seq":604,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.382350+0000","last_change":"2024-04-25T22:44:41.425331+0000","last_active":"2024-04-25T22:44:44.382350+0000","last_peered":"2024-04-25T22:44:44.382350+0000","last_clean":"2024-04-25T22:44:44.382350+0000","last_became_active":"2024-04-25T22:44:41.423799+0000","last_became_peered":"2024-04-25T22:44:41.423799+0000","last_unstale":"2024-04-25T22:44:44.382350+0000","last_undegraded":"2024-04-25T22:44:44.382350+0000","last_fullsized":"2024-04-25T22:44:44.382350+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:04.324825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"72'386","reported_seq":931,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080025+0000","last_change":"2024-04-25T22:44:46.113269+0000","last_active":"2024-04-25T22:44:47.080025+0000","last_peered":"2024-04-25T22:44:47.080025+0000","last_clean":"2024-04-25T22:44:47.080025+0000","last_became_active":"2024-04-25T22:44:46.110394+0000","last_became_peered":"2024-04-25T22:44:46.110394+0000","last_unstale":"2024-04-25T22:44:47.080025+0000","last_undegraded":"2024-04-25T22:44:47.080025+0000","last_fullsized":"2024-04-25T22:44:47.080025+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9402,"num_write":352,"num_write_kb":50548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":394,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081692+0000","last_change":"2024-04-25T22:44:26.355770+0000","last_active":"2024-04-25T22:44:47.081692+0000","last_peered":"2024-04-25T22:44:47.081692+0000","last_clean":"2024-04-25T22:44:47.081692+0000","last_became_active":"2024-04-25T22:44:26.354730+0000","last_became_peered":"2024-04-25T22:44:26.354730+0000","last_unstale":"2024-04-25T22:44:47.081692+0000","last_undegraded":"2024-04-25T22:44:47.081692+0000","last_fullsized":"2024-04-25T22:44:47.081692+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:34.987031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":185,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.084341+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:44:47.084341+0000","last_peered":"2024-04-25T22:44:47.084341+0000","last_clean":"2024-04-25T22:44:47.084341+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:44:47.084341+0000","last_undegraded":"2024-04-25T22:44:47.084341+0000","last_fullsized":"2024-04-25T22:44:47.084341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"71'457","reported_seq":652,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078320+0000","last_change":"2024-04-25T22:44:29.399148+0000","last_active":"2024-04-25T22:44:47.078320+0000","last_peered":"2024-04-25T22:44:47.078320+0000","last_clean":"2024-04-25T22:44:47.078320+0000","last_became_active":"2024-04-25T22:44:29.397962+0000","last_became_peered":"2024-04-25T22:44:29.397962+0000","last_unstale":"2024-04-25T22:44:47.078320+0000","last_undegraded":"2024-04-25T22:44:47.078320+0000","last_fullsized":"2024-04-25T22:44:47.078320+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:14.015619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"72'447","reported_seq":1087,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083667+0000","last_change":"2024-04-25T22:44:43.108262+0000","last_active":"2024-04-25T22:44:47.083667+0000","last_peered":"2024-04-25T22:44:47.083667+0000","last_clean":"2024-04-25T22:44:47.083667+0000","last_became_active":"2024-04-25T22:44:43.105231+0000","last_became_peered":"2024-04-25T22:44:43.105231+0000","last_unstale":"2024-04-25T22:44:47.083667+0000","last_undegraded":"2024-04-25T22:44:47.083667+0000","last_fullsized":"2024-04-25T22:44:47.083667+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:09.728618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45074,"num_write":414,"num_write_kb":120596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":192,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081449+0000","last_change":"2024-04-25T22:44:26.355238+0000","last_active":"2024-04-25T22:44:47.081449+0000","last_peered":"2024-04-25T22:44:47.081449+0000","last_clean":"2024-04-25T22:44:47.081449+0000","last_became_active":"2024-04-25T22:44:26.354482+0000","last_became_peered":"2024-04-25T22:44:26.354482+0000","last_unstale":"2024-04-25T22:44:47.081449+0000","last_undegraded":"2024-04-25T22:44:47.081449+0000","last_fullsized":"2024-04-25T22:44:47.081449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.042514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'122","reported_seq":316,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078297+0000","last_change":"2024-04-25T22:44:39.141843+0000","last_active":"2024-04-25T22:44:47.078297+0000","last_peered":"2024-04-25T22:44:47.078297+0000","last_clean":"2024-04-25T22:44:47.078297+0000","last_became_active":"2024-04-25T22:44:39.139689+0000","last_became_peered":"2024-04-25T22:44:39.139689+0000","last_unstale":"2024-04-25T22:44:47.078297+0000","last_undegraded":"2024-04-25T22:44:47.078297+0000","last_fullsized":"2024-04-25T22:44:47.078297+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:18.614670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":62,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"72'449","reported_seq":622,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.384559+0000","last_change":"2024-04-25T22:44:41.439044+0000","last_active":"2024-04-25T22:44:44.384559+0000","last_peered":"2024-04-25T22:44:44.384559+0000","last_clean":"2024-04-25T22:44:44.384559+0000","last_became_active":"2024-04-25T22:44:41.432785+0000","last_became_peered":"2024-04-25T22:44:41.432785+0000","last_unstale":"2024-04-25T22:44:44.384559+0000","last_undegraded":"2024-04-25T22:44:44.384559+0000","last_fullsized":"2024-04-25T22:44:44.384559+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:57.171725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25191,"num_write":420,"num_write_kb":79855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":193,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.079967+0000","last_change":"2024-04-25T22:44:26.363464+0000","last_active":"2024-04-25T22:44:47.079967+0000","last_peered":"2024-04-25T22:44:47.079967+0000","last_clean":"2024-04-25T22:44:47.079967+0000","last_became_active":"2024-04-25T22:44:26.362808+0000","last_became_peered":"2024-04-25T22:44:26.362808+0000","last_unstale":"2024-04-25T22:44:47.079967+0000","last_undegraded":"2024-04-25T22:44:47.079967+0000","last_fullsized":"2024-04-25T22:44:47.079967+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:06.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'435","reported_seq":600,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.381810+0000","last_change":"2024-04-25T22:44:41.417191+0000","last_active":"2024-04-25T22:44:44.381810+0000","last_peered":"2024-04-25T22:44:44.381810+0000","last_clean":"2024-04-25T22:44:44.381810+0000","last_became_active":"2024-04-25T22:44:41.415592+0000","last_became_peered":"2024-04-25T22:44:41.415592+0000","last_unstale":"2024-04-25T22:44:44.381810+0000","last_undegraded":"2024-04-25T22:44:44.381810+0000","last_fullsized":"2024-04-25T22:44:44.381810+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:35.916512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"72'337","reported_seq":864,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080159+0000","last_change":"2024-04-25T22:44:45.113523+0000","last_active":"2024-04-25T22:44:47.080159+0000","last_peered":"2024-04-25T22:44:47.080159+0000","last_clean":"2024-04-25T22:44:47.080159+0000","last_became_active":"2024-04-25T22:44:45.111011+0000","last_became_peered":"2024-04-25T22:44:45.111011+0000","last_unstale":"2024-04-25T22:44:47.080159+0000","last_undegraded":"2024-04-25T22:44:47.080159+0000","last_fullsized":"2024-04-25T22:44:47.080159+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25242,"num_write":307,"num_write_kb":26250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":185,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083242+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:44:47.083242+0000","last_peered":"2024-04-25T22:44:47.083242+0000","last_clean":"2024-04-25T22:44:47.083242+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:44:47.083242+0000","last_undegraded":"2024-04-25T22:44:47.083242+0000","last_fullsized":"2024-04-25T22:44:47.083242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"71'61","reported_seq":240,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.084276+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:44:47.084276+0000","last_peered":"2024-04-25T22:44:47.084276+0000","last_clean":"2024-04-25T22:44:47.084276+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:44:47.084276+0000","last_undegraded":"2024-04-25T22:44:47.084276+0000","last_fullsized":"2024-04-25T22:44:47.084276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'404","reported_seq":992,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080407+0000","last_change":"2024-04-25T22:44:32.092728+0000","last_active":"2024-04-25T22:44:47.080407+0000","last_peered":"2024-04-25T22:44:47.080407+0000","last_clean":"2024-04-25T22:44:47.080407+0000","last_became_active":"2024-04-25T22:44:32.087528+0000","last_became_peered":"2024-04-25T22:44:32.087528+0000","last_unstale":"2024-04-25T22:44:47.080407+0000","last_undegraded":"2024-04-25T22:44:47.080407+0000","last_fullsized":"2024-04-25T22:44:47.080407+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:39.481467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":20287,"num_write":371,"num_write_kb":59919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'285","reported_seq":464,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083914+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:44:47.083914+0000","last_peered":"2024-04-25T22:44:47.083914+0000","last_clean":"2024-04-25T22:44:47.083914+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:44:47.083914+0000","last_undegraded":"2024-04-25T22:44:47.083914+0000","last_fullsized":"2024-04-25T22:44:47.083914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":193,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080720+0000","last_change":"2024-04-25T22:44:26.364185+0000","last_active":"2024-04-25T22:44:47.080720+0000","last_peered":"2024-04-25T22:44:47.080720+0000","last_clean":"2024-04-25T22:44:47.080720+0000","last_became_active":"2024-04-25T22:44:26.363583+0000","last_became_peered":"2024-04-25T22:44:26.363583+0000","last_unstale":"2024-04-25T22:44:47.080720+0000","last_undegraded":"2024-04-25T22:44:47.080720+0000","last_fullsized":"2024-04-25T22:44:47.080720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:35:04.325449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"72'366","reported_seq":551,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.081856+0000","last_change":"2024-04-25T22:44:41.142343+0000","last_active":"2024-04-25T22:44:47.081856+0000","last_peered":"2024-04-25T22:44:47.081856+0000","last_clean":"2024-04-25T22:41:34.254671+0000","last_became_active":"2024-04-25T22:44:41.137495+0000","last_became_peered":"2024-04-25T22:44:41.137495+0000","last_unstale":"2024-04-25T22:44:47.081856+0000","last_undegraded":"2024-04-25T22:44:41.117781+0000","last_fullsized":"2024-04-25T22:44:41.117310+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":346,"num_write":330,"num_write_kb":33934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":241,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080649+0000","last_change":"2024-04-25T22:44:26.364178+0000","last_active":"2024-04-25T22:44:47.080649+0000","last_peered":"2024-04-25T22:44:47.080649+0000","last_clean":"2024-04-25T22:44:47.080649+0000","last_became_active":"2024-04-25T22:44:26.363455+0000","last_became_peered":"2024-04-25T22:44:26.363455+0000","last_unstale":"2024-04-25T22:44:47.080649+0000","last_undegraded":"2024-04-25T22:44:47.080649+0000","last_fullsized":"2024-04-25T22:44:47.080649+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:58.181763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":113,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.384764+0000","last_change":"2024-04-25T22:44:41.423030+0000","last_active":"2024-04-25T22:44:44.384764+0000","last_peered":"2024-04-25T22:44:44.384764+0000","last_clean":"2024-04-25T22:44:44.384764+0000","last_became_active":"2024-04-25T22:44:41.421194+0000","last_became_peered":"2024-04-25T22:44:41.421194+0000","last_unstale":"2024-04-25T22:44:44.384764+0000","last_undegraded":"2024-04-25T22:44:44.384764+0000","last_fullsized":"2024-04-25T22:44:44.384764+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:59.297537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'413","reported_seq":708,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:42.086247+0000","last_change":"2024-04-25T22:44:41.136359+0000","last_active":"2024-04-25T22:44:42.086247+0000","last_peered":"2024-04-25T22:44:42.086247+0000","last_clean":"2024-04-25T22:41:34.255399+0000","last_became_active":"2024-04-25T22:44:41.132847+0000","last_became_peered":"2024-04-25T22:44:41.132847+0000","last_unstale":"2024-04-25T22:44:42.086247+0000","last_undegraded":"2024-04-25T22:44:41.118158+0000","last_fullsized":"2024-04-25T22:44:41.117469+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":142,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22994,"num_write":377,"num_write_kb":63140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"72'57","reported_seq":245,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081783+0000","last_change":"2024-04-25T22:44:26.366189+0000","last_active":"2024-04-25T22:44:47.081783+0000","last_peered":"2024-04-25T22:44:47.081783+0000","last_clean":"2024-04-25T22:44:47.081783+0000","last_became_active":"2024-04-25T22:44:26.365267+0000","last_became_peered":"2024-04-25T22:44:26.365267+0000","last_unstale":"2024-04-25T22:44:47.081783+0000","last_undegraded":"2024-04-25T22:44:47.081783+0000","last_fullsized":"2024-04-25T22:44:47.081783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:54.128937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":193,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080917+0000","last_change":"2024-04-25T22:44:26.361633+0000","last_active":"2024-04-25T22:44:47.080917+0000","last_peered":"2024-04-25T22:44:47.080917+0000","last_clean":"2024-04-25T22:44:47.080917+0000","last_became_active":"2024-04-25T22:44:26.360968+0000","last_became_peered":"2024-04-25T22:44:26.360968+0000","last_unstale":"2024-04-25T22:44:47.080917+0000","last_undegraded":"2024-04-25T22:44:47.080917+0000","last_fullsized":"2024-04-25T22:44:47.080917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:40.454898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'398","reported_seq":575,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078106+0000","last_change":"2024-04-25T22:44:39.132801+0000","last_active":"2024-04-25T22:44:47.078106+0000","last_peered":"2024-04-25T22:44:47.078106+0000","last_clean":"2024-04-25T22:44:47.078106+0000","last_became_active":"2024-04-25T22:44:39.124378+0000","last_became_peered":"2024-04-25T22:44:39.124378+0000","last_unstale":"2024-04-25T22:44:47.078106+0000","last_undegraded":"2024-04-25T22:44:47.078106+0000","last_fullsized":"2024-04-25T22:44:47.078106+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:29.195889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6306,"num_write":372,"num_write_kb":34077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'100","reported_seq":282,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080676+0000","last_change":"2024-04-25T22:44:39.150245+0000","last_active":"2024-04-25T22:44:47.080676+0000","last_peered":"2024-04-25T22:44:47.080676+0000","last_clean":"2024-04-25T22:44:47.080676+0000","last_became_active":"2024-04-25T22:44:39.147377+0000","last_became_peered":"2024-04-25T22:44:39.147377+0000","last_unstale":"2024-04-25T22:44:47.080676+0000","last_undegraded":"2024-04-25T22:44:47.080676+0000","last_fullsized":"2024-04-25T22:44:47.080676+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:36.007978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":192,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.085341+0000","last_change":"2024-04-25T22:44:26.360890+0000","last_active":"2024-04-25T22:44:47.085341+0000","last_peered":"2024-04-25T22:44:47.085341+0000","last_clean":"2024-04-25T22:44:47.085341+0000","last_became_active":"2024-04-25T22:44:26.360106+0000","last_became_peered":"2024-04-25T22:44:26.360106+0000","last_unstale":"2024-04-25T22:44:47.085341+0000","last_undegraded":"2024-04-25T22:44:47.085341+0000","last_fullsized":"2024-04-25T22:44:47.085341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:09.929196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'390","reported_seq":591,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.382471+0000","last_change":"2024-04-25T22:44:41.433574+0000","last_active":"2024-04-25T22:44:44.382471+0000","last_peered":"2024-04-25T22:44:44.382471+0000","last_clean":"2024-04-25T22:44:44.382471+0000","last_became_active":"2024-04-25T22:44:41.414924+0000","last_became_peered":"2024-04-25T22:44:41.414924+0000","last_unstale":"2024-04-25T22:44:44.382471+0000","last_undegraded":"2024-04-25T22:44:44.382471+0000","last_fullsized":"2024-04-25T22:44:44.382471+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:46.695300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":22915,"num_write":352,"num_write_kb":47201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"72'411","reported_seq":983,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083752+0000","last_change":"2024-04-25T22:44:32.090492+0000","last_active":"2024-04-25T22:44:47.083752+0000","last_peered":"2024-04-25T22:44:47.083752+0000","last_clean":"2024-04-25T22:44:47.083752+0000","last_became_active":"2024-04-25T22:44:32.087303+0000","last_became_peered":"2024-04-25T22:44:32.087303+0000","last_unstale":"2024-04-25T22:44:47.083752+0000","last_undegraded":"2024-04-25T22:44:47.083752+0000","last_fullsized":"2024-04-25T22:44:47.083752+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25412,"num_write":367,"num_write_kb":64656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'268","reported_seq":464,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083160+0000","last_change":"2024-04-25T22:44:29.399184+0000","last_active":"2024-04-25T22:44:47.083160+0000","last_peered":"2024-04-25T22:44:47.083160+0000","last_clean":"2024-04-25T22:44:47.083160+0000","last_became_active":"2024-04-25T22:44:29.398317+0000","last_became_peered":"2024-04-25T22:44:29.398317+0000","last_unstale":"2024-04-25T22:44:47.083160+0000","last_undegraded":"2024-04-25T22:44:47.083160+0000","last_fullsized":"2024-04-25T22:44:47.083160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:21.765162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382817,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"72'423","reported_seq":1022,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.077767+0000","last_change":"2024-04-25T22:44:42.092243+0000","last_active":"2024-04-25T22:44:47.077767+0000","last_peered":"2024-04-25T22:44:47.077767+0000","last_clean":"2024-04-25T22:44:47.077767+0000","last_became_active":"2024-04-25T22:44:42.088432+0000","last_became_peered":"2024-04-25T22:44:42.088432+0000","last_unstale":"2024-04-25T22:44:47.077767+0000","last_undegraded":"2024-04-25T22:44:47.077767+0000","last_fullsized":"2024-04-25T22:44:47.077767+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:54.239406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24794,"num_write":386,"num_write_kb":63756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'102","reported_seq":66,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.383469+0000","last_change":"2024-04-25T22:44:41.423993+0000","last_active":"2024-04-25T22:44:44.383469+0000","last_peered":"2024-04-25T22:44:44.383469+0000","last_clean":"2024-04-25T22:44:44.383469+0000","last_became_active":"2024-04-25T22:44:41.422237+0000","last_became_peered":"2024-04-25T22:44:41.422237+0000","last_unstale":"2024-04-25T22:44:44.383469+0000","last_undegraded":"2024-04-25T22:44:44.383469+0000","last_fullsized":"2024-04-25T22:44:44.383469+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:02.880774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"71'213","reported_seq":391,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.084374+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:44:47.084374+0000","last_peered":"2024-04-25T22:44:47.084374+0000","last_clean":"2024-04-25T22:44:47.084374+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:44:47.084374+0000","last_undegraded":"2024-04-25T22:44:47.084374+0000","last_fullsized":"2024-04-25T22:44:47.084374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"72'504","reported_seq":744,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.077657+0000","last_change":"2024-04-25T22:44:39.142694+0000","last_active":"2024-04-25T22:44:47.077657+0000","last_peered":"2024-04-25T22:44:47.077657+0000","last_clean":"2024-04-25T22:44:47.077657+0000","last_became_active":"2024-04-25T22:44:39.132582+0000","last_became_peered":"2024-04-25T22:44:39.132582+0000","last_unstale":"2024-04-25T22:44:47.077657+0000","last_undegraded":"2024-04-25T22:44:47.077657+0000","last_fullsized":"2024-04-25T22:44:47.077657+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:14.401644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":46975,"num_write":471,"num_write_kb":146290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'64","reported_seq":195,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081475+0000","last_change":"2024-04-25T22:44:39.136961+0000","last_active":"2024-04-25T22:44:47.081475+0000","last_peered":"2024-04-25T22:44:47.081475+0000","last_clean":"2024-04-25T22:44:47.081475+0000","last_became_active":"2024-04-25T22:44:39.136090+0000","last_became_peered":"2024-04-25T22:44:39.136090+0000","last_unstale":"2024-04-25T22:44:47.081475+0000","last_undegraded":"2024-04-25T22:44:47.081475+0000","last_fullsized":"2024-04-25T22:44:47.081475+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:35.220314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"72'475","reported_seq":1129,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.077799+0000","last_change":"2024-04-25T22:44:44.106484+0000","last_active":"2024-04-25T22:44:47.077799+0000","last_peered":"2024-04-25T22:44:47.077799+0000","last_clean":"2024-04-25T22:44:47.077799+0000","last_became_active":"2024-04-25T22:44:44.102061+0000","last_became_peered":"2024-04-25T22:44:44.102061+0000","last_unstale":"2024-04-25T22:44:47.077799+0000","last_undegraded":"2024-04-25T22:44:47.077799+0000","last_fullsized":"2024-04-25T22:44:47.077799+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:05.455255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":23011,"num_write":448,"num_write_kb":76439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"72'370","reported_seq":604,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.085009+0000","last_change":"2024-04-25T22:44:41.149278+0000","last_active":"2024-04-25T22:44:47.085009+0000","last_peered":"2024-04-25T22:44:47.085009+0000","last_clean":"2024-04-25T22:41:34.256787+0000","last_became_active":"2024-04-25T22:44:41.144535+0000","last_became_peered":"2024-04-25T22:44:41.144535+0000","last_unstale":"2024-04-25T22:44:47.085009+0000","last_undegraded":"2024-04-25T22:44:41.120919+0000","last_fullsized":"2024-04-25T22:44:41.120194+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":159,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33211,"num_write":340,"num_write_kb":63312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'647","reported_seq":841,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078412+0000","last_change":"2024-04-25T22:44:30.396965+0000","last_active":"2024-04-25T22:44:47.078412+0000","last_peered":"2024-04-25T22:44:47.078412+0000","last_clean":"2024-04-25T22:44:47.078412+0000","last_became_active":"2024-04-25T22:44:30.396073+0000","last_became_peered":"2024-04-25T22:44:30.396073+0000","last_unstale":"2024-04-25T22:44:47.078412+0000","last_undegraded":"2024-04-25T22:44:47.078412+0000","last_fullsized":"2024-04-25T22:44:47.078412+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"72'415","reported_seq":612,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.079634+0000","last_change":"2024-04-25T22:44:39.150290+0000","last_active":"2024-04-25T22:44:47.079634+0000","last_peered":"2024-04-25T22:44:47.079634+0000","last_clean":"2024-04-25T22:44:47.079634+0000","last_became_active":"2024-04-25T22:44:39.146949+0000","last_became_peered":"2024-04-25T22:44:39.146949+0000","last_unstale":"2024-04-25T22:44:47.079634+0000","last_undegraded":"2024-04-25T22:44:47.079634+0000","last_fullsized":"2024-04-25T22:44:47.079634+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:11.804350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19493,"num_write":386,"num_write_kb":64692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'207","reported_seq":338,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.077950+0000","last_change":"2024-04-25T22:44:39.141125+0000","last_active":"2024-04-25T22:44:47.077950+0000","last_peered":"2024-04-25T22:44:47.077950+0000","last_clean":"2024-04-25T22:44:47.077950+0000","last_became_active":"2024-04-25T22:44:39.138371+0000","last_became_peered":"2024-04-25T22:44:39.138371+0000","last_unstale":"2024-04-25T22:44:47.077950+0000","last_undegraded":"2024-04-25T22:44:47.077950+0000","last_fullsized":"2024-04-25T22:44:47.077950+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:14.147026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"72'395","reported_seq":596,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.082403+0000","last_change":"2024-04-25T22:44:41.148833+0000","last_active":"2024-04-25T22:44:47.082403+0000","last_peered":"2024-04-25T22:44:47.082403+0000","last_clean":"2024-04-25T22:41:34.256072+0000","last_became_active":"2024-04-25T22:44:41.144491+0000","last_became_peered":"2024-04-25T22:44:41.144491+0000","last_unstale":"2024-04-25T22:44:47.082403+0000","last_undegraded":"2024-04-25T22:44:41.119473+0000","last_fullsized":"2024-04-25T22:44:41.118876+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9576,"num_write":348,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"72'194","reported_seq":333,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.382478+0000","last_change":"2024-04-25T22:44:41.422369+0000","last_active":"2024-04-25T22:44:44.382478+0000","last_peered":"2024-04-25T22:44:44.382478+0000","last_clean":"2024-04-25T22:44:44.382478+0000","last_became_active":"2024-04-25T22:44:41.420491+0000","last_became_peered":"2024-04-25T22:44:41.420491+0000","last_unstale":"2024-04-25T22:44:44.382478+0000","last_undegraded":"2024-04-25T22:44:44.382478+0000","last_fullsized":"2024-04-25T22:44:44.382478+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:35.081225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360511,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":12143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12360511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"72'398","reported_seq":622,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.079225+0000","last_change":"2024-04-25T22:44:41.134567+0000","last_active":"2024-04-25T22:44:47.079225+0000","last_peered":"2024-04-25T22:44:47.079225+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130189+0000","last_became_peered":"2024-04-25T22:44:41.130189+0000","last_unstale":"2024-04-25T22:44:47.079225+0000","last_undegraded":"2024-04-25T22:44:41.117532+0000","last_fullsized":"2024-04-25T22:44:41.116946+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31284,"num_write":371,"num_write_kb":80144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"71'51","reported_seq":64,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.382728+0000","last_change":"2024-04-25T22:44:41.415722+0000","last_active":"2024-04-25T22:44:44.382728+0000","last_peered":"2024-04-25T22:44:44.382728+0000","last_clean":"2024-04-25T22:44:44.382728+0000","last_became_active":"2024-04-25T22:44:41.414774+0000","last_became_peered":"2024-04-25T22:44:41.414774+0000","last_unstale":"2024-04-25T22:44:44.382728+0000","last_undegraded":"2024-04-25T22:44:44.382728+0000","last_fullsized":"2024-04-25T22:44:44.382728+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:20.553373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"72'383","reported_seq":611,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083420+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:44:47.083420+0000","last_peered":"2024-04-25T22:44:47.083420+0000","last_clean":"2024-04-25T22:44:47.083420+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:44:47.083420+0000","last_undegraded":"2024-04-25T22:44:47.083420+0000","last_fullsized":"2024-04-25T22:44:47.083420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29308,"num_write":358,"num_write_kb":66975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"71'177","reported_seq":355,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083043+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:44:47.083043+0000","last_peered":"2024-04-25T22:44:47.083043+0000","last_clean":"2024-04-25T22:44:47.083043+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:44:47.083043+0000","last_undegraded":"2024-04-25T22:44:47.083043+0000","last_fullsized":"2024-04-25T22:44:47.083043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"72'387","reported_seq":576,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082748+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:44:47.082748+0000","last_peered":"2024-04-25T22:44:47.082748+0000","last_clean":"2024-04-25T22:44:47.082748+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:44:47.082748+0000","last_undegraded":"2024-04-25T22:44:47.082748+0000","last_fullsized":"2024-04-25T22:44:47.082748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3883,"num_write":348,"num_write_kb":34122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'209","reported_seq":383,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.382768+0000","last_change":"2024-04-25T22:44:41.419972+0000","last_active":"2024-04-25T22:44:44.382768+0000","last_peered":"2024-04-25T22:44:44.382768+0000","last_clean":"2024-04-25T22:44:44.382768+0000","last_became_active":"2024-04-25T22:44:41.418106+0000","last_became_peered":"2024-04-25T22:44:41.418106+0000","last_unstale":"2024-04-25T22:44:44.382768+0000","last_undegraded":"2024-04-25T22:44:44.382768+0000","last_fullsized":"2024-04-25T22:44:44.382768+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:07.628155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":12363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"72'419","reported_seq":577,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T22:44:44.382142+0000","last_change":"2024-04-25T22:44:41.434376+0000","last_active":"2024-04-25T22:44:44.382142+0000","last_peered":"2024-04-25T22:44:44.382142+0000","last_clean":"2024-04-25T22:44:44.382142+0000","last_became_active":"2024-04-25T22:44:41.420505+0000","last_became_peered":"2024-04-25T22:44:41.420505+0000","last_unstale":"2024-04-25T22:44:44.382142+0000","last_undegraded":"2024-04-25T22:44:44.382142+0000","last_fullsized":"2024-04-25T22:44:44.382142+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:04.414563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":13327,"num_write":388,"num_write_kb":55674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"71'131","reported_seq":325,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080515+0000","last_change":"2024-04-25T22:44:29.398880+0000","last_active":"2024-04-25T22:44:47.080515+0000","last_peered":"2024-04-25T22:44:47.080515+0000","last_clean":"2024-04-25T22:44:47.080515+0000","last_became_active":"2024-04-25T22:44:29.397905+0000","last_became_peered":"2024-04-25T22:44:29.397905+0000","last_unstale":"2024-04-25T22:44:47.080515+0000","last_undegraded":"2024-04-25T22:44:47.080515+0000","last_fullsized":"2024-04-25T22:44:47.080515+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:44.236330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"72'449","reported_seq":659,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081365+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:44:47.081365+0000","last_peered":"2024-04-25T22:44:47.081365+0000","last_clean":"2024-04-25T22:44:47.081365+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:44:47.081365+0000","last_undegraded":"2024-04-25T22:44:47.081365+0000","last_fullsized":"2024-04-25T22:44:47.081365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14222,"num_write":424,"num_write_kb":79796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"71'57","reported_seq":189,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081058+0000","last_change":"2024-04-25T22:44:39.137232+0000","last_active":"2024-04-25T22:44:47.081058+0000","last_peered":"2024-04-25T22:44:47.081058+0000","last_clean":"2024-04-25T22:44:47.081058+0000","last_became_active":"2024-04-25T22:44:39.136283+0000","last_became_peered":"2024-04-25T22:44:39.136283+0000","last_unstale":"2024-04-25T22:44:47.081058+0000","last_undegraded":"2024-04-25T22:44:47.081058+0000","last_fullsized":"2024-04-25T22:44:47.081058+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:32.428982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2461,"num_read_kb":1248646,"num_write":24434,"num_write_kb":4137258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4236,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26539,"ondisk_log_size":26539,"up":128,"acting":109,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127071275,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":4473,"num_write_kb":127409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254210048,"data_stored":254142550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},"log_size":6216,"ondisk_log_size":6216,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738431,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165200,"kb_used_data":79940,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94206640,"statfs":{"total":96636764160,"available":96467599360,"internally_reserved":0,"allocated":81858560,"data_stored":81359428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":79,"seq":339302416390,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110700,"kb_used_data":83164,"kb_used_omap":5,"kb_used_meta":27514,"kb_avail":94261140,"statfs":{"total":96636764160,"available":96523407360,"internally_reserved":0,"allocated":85159936,"data_stored":84666903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6003,"internal_metadata":28174477},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174208,"kb_used_data":88948,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94197632,"statfs":{"total":96636764160,"available":96458375168,"internally_reserved":0,"allocated":91082752,"data_stored":90561659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89575424,"data_stored":89544940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83689472,"data_stored":83664533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80945152,"data_stored":80933077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:44:51.149 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:44:51.468 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:44:51.470 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:44:51.486 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-04-25T22:44:51.239319+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127661643,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2311,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2659,"num_read_kb":1250233,"num_write":29110,"num_write_kb":4268127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4918,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32912,"ondisk_log_size":32912,"up":210,"acting":196,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":462644,"kb_used_data":252112,"kb_used_omap":8,"kb_used_meta":210487,"kb_avail":282652876,"statfs":{"total":289910292480,"available":289436545024,"internally_reserved":0,"allocated":258162688,"data_stored":256611727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9193,"internal_metadata":215538711},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1521,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1452,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001412"},"pg_stats":[{"pgid":"4.3f","version":"72'404","reported_seq":599,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.081637+0000","last_change":"2024-04-25T22:44:41.145114+0000","last_active":"2024-04-25T22:44:47.081637+0000","last_peered":"2024-04-25T22:44:47.081637+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.142277+0000","last_became_peered":"2024-04-25T22:44:41.142277+0000","last_unstale":"2024-04-25T22:44:47.081637+0000","last_undegraded":"2024-04-25T22:44:41.121372+0000","last_fullsized":"2024-04-25T22:44:41.120599+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19772,"num_write":366,"num_write_kb":46873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"72'420","reported_seq":602,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.371972+0000","last_change":"2024-04-25T22:44:41.434387+0000","last_active":"2024-04-25T22:44:49.371972+0000","last_peered":"2024-04-25T22:44:49.371972+0000","last_clean":"2024-04-25T22:44:49.371972+0000","last_became_active":"2024-04-25T22:44:41.418792+0000","last_became_peered":"2024-04-25T22:44:41.418792+0000","last_unstale":"2024-04-25T22:44:49.371972+0000","last_undegraded":"2024-04-25T22:44:49.371972+0000","last_fullsized":"2024-04-25T22:44:49.371972+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:43.196115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24515,"num_write":386,"num_write_kb":55688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"72'377","reported_seq":928,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082800+0000","last_change":"2024-04-25T22:44:42.096911+0000","last_active":"2024-04-25T22:44:47.082800+0000","last_peered":"2024-04-25T22:44:47.082800+0000","last_clean":"2024-04-25T22:44:47.082800+0000","last_became_active":"2024-04-25T22:44:42.093941+0000","last_became_peered":"2024-04-25T22:44:42.093941+0000","last_unstale":"2024-04-25T22:44:47.082800+0000","last_undegraded":"2024-04-25T22:44:47.082800+0000","last_fullsized":"2024-04-25T22:44:47.082800+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11135,"num_write":346,"num_write_kb":38950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"72'366","reported_seq":549,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082403+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:44:47.082403+0000","last_peered":"2024-04-25T22:44:47.082403+0000","last_clean":"2024-04-25T22:44:47.082403+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:44:47.082403+0000","last_undegraded":"2024-04-25T22:44:47.082403+0000","last_fullsized":"2024-04-25T22:44:47.082403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":326,"num_write_kb":34079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"72'455","reported_seq":609,"reported_epoch":103,"state":"peering","last_fresh":"2024-04-25T22:44:49.371770+0000","last_change":"2024-04-25T22:44:49.371770+0000","last_active":"2024-04-25T22:44:26.338770+0000","last_peered":"2024-04-25T22:44:24.308999+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:41:35.379723+0000","last_became_peered":"2024-04-25T22:41:35.379723+0000","last_unstale":"2024-04-25T22:44:49.371770+0000","last_undegraded":"2024-04-25T22:44:49.371770+0000","last_fullsized":"2024-04-25T22:44:49.371770+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33897,"num_write":426,"num_write_kb":100721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"72'401","reported_seq":611,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082143+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:44:47.082143+0000","last_peered":"2024-04-25T22:44:47.082143+0000","last_clean":"2024-04-25T22:44:47.082143+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:44:47.082143+0000","last_undegraded":"2024-04-25T22:44:47.082143+0000","last_fullsized":"2024-04-25T22:44:47.082143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15258,"num_write":369,"num_write_kb":53298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"72'452","reported_seq":694,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081149+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:44:47.081149+0000","last_peered":"2024-04-25T22:44:47.081149+0000","last_clean":"2024-04-25T22:44:47.081149+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:44:47.081149+0000","last_undegraded":"2024-04-25T22:44:47.081149+0000","last_fullsized":"2024-04-25T22:44:47.081149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34010,"num_write":428,"num_write_kb":157752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"72'401","reported_seq":616,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080719+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:44:47.080719+0000","last_peered":"2024-04-25T22:44:47.080719+0000","last_clean":"2024-04-25T22:44:47.080719+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:44:47.080719+0000","last_undegraded":"2024-04-25T22:44:47.080719+0000","last_fullsized":"2024-04-25T22:44:47.080719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19917,"num_write":359,"num_write_kb":109382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"72'394","reported_seq":950,"reported_epoch":100,"state":"peering","last_fresh":"2024-04-25T22:44:46.273311+0000","last_change":"2024-04-25T22:44:47.080405+0000","last_active":"2024-04-25T22:44:47.080405+0000","last_peered":"2024-04-25T22:44:46.273311+0000","last_clean":"2024-04-25T22:41:33.341370+0000","last_became_active":"2024-04-25T22:44:27.927304+0000","last_became_peered":"2024-04-25T22:44:27.927304+0000","last_unstale":"2024-04-25T22:44:46.273311+0000","last_undegraded":"2024-04-25T22:44:46.273311+0000","last_fullsized":"2024-04-25T22:44:27.345517+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9569,"num_write":360,"num_write_kb":25560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"72'382","reported_seq":546,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.371867+0000","last_change":"2024-04-25T22:44:41.433644+0000","last_active":"2024-04-25T22:44:49.371867+0000","last_peered":"2024-04-25T22:44:49.371867+0000","last_clean":"2024-04-25T22:44:49.371867+0000","last_became_active":"2024-04-25T22:44:41.421234+0000","last_became_peered":"2024-04-25T22:44:41.421234+0000","last_unstale":"2024-04-25T22:44:49.371867+0000","last_undegraded":"2024-04-25T22:44:49.371867+0000","last_fullsized":"2024-04-25T22:44:49.371867+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:24.217391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17192,"num_write":338,"num_write_kb":38688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"72'369","reported_seq":568,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083093+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:44:47.083093+0000","last_peered":"2024-04-25T22:44:47.083093+0000","last_clean":"2024-04-25T22:44:47.083093+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:44:47.083093+0000","last_undegraded":"2024-04-25T22:44:47.083093+0000","last_fullsized":"2024-04-25T22:44:47.083093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7385,"num_write":349,"num_write_kb":58842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"72'338","reported_seq":502,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.389845+0000","last_change":"2024-04-25T22:44:49.384005+0000","last_active":"2024-04-25T22:44:49.389845+0000","last_peered":"2024-04-25T22:44:49.389845+0000","last_clean":"2024-04-25T22:44:49.389845+0000","last_became_active":"2024-04-25T22:44:49.378325+0000","last_became_peered":"2024-04-25T22:44:49.378325+0000","last_unstale":"2024-04-25T22:44:49.389845+0000","last_undegraded":"2024-04-25T22:44:49.389845+0000","last_fullsized":"2024-04-25T22:44:49.389845+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:18.849786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13619,"num_write":312,"num_write_kb":21391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"72'411","reported_seq":585,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.371235+0000","last_change":"2024-04-25T22:44:41.432463+0000","last_active":"2024-04-25T22:44:49.371235+0000","last_peered":"2024-04-25T22:44:49.371235+0000","last_clean":"2024-04-25T22:44:49.371235+0000","last_became_active":"2024-04-25T22:44:41.421096+0000","last_became_peered":"2024-04-25T22:44:41.421096+0000","last_unstale":"2024-04-25T22:44:49.371235+0000","last_undegraded":"2024-04-25T22:44:49.371235+0000","last_fullsized":"2024-04-25T22:44:49.371235+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:46.942677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12998,"num_write":375,"num_write_kb":79661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"72'452","reported_seq":1026,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082465+0000","last_change":"2024-04-25T22:44:40.130299+0000","last_active":"2024-04-25T22:44:47.082465+0000","last_peered":"2024-04-25T22:44:47.082465+0000","last_clean":"2024-04-25T22:44:47.082465+0000","last_became_active":"2024-04-25T22:44:40.127307+0000","last_became_peered":"2024-04-25T22:44:40.127307+0000","last_unstale":"2024-04-25T22:44:47.082465+0000","last_undegraded":"2024-04-25T22:44:47.082465+0000","last_fullsized":"2024-04-25T22:44:47.082465+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:16.746830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":854,"num_write":419,"num_write_kb":88217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"72'428","reported_seq":1006,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081139+0000","last_change":"2024-04-25T22:44:35.108361+0000","last_active":"2024-04-25T22:44:47.081139+0000","last_peered":"2024-04-25T22:44:47.081139+0000","last_clean":"2024-04-25T22:44:47.081139+0000","last_became_active":"2024-04-25T22:44:35.103208+0000","last_became_peered":"2024-04-25T22:44:35.103208+0000","last_unstale":"2024-04-25T22:44:47.081139+0000","last_undegraded":"2024-04-25T22:44:47.081139+0000","last_fullsized":"2024-04-25T22:44:47.081139+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:22.046332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21291,"num_write":389,"num_write_kb":68562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"72'401","reported_seq":590,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080733+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:44:47.080733+0000","last_peered":"2024-04-25T22:44:47.080733+0000","last_clean":"2024-04-25T22:44:47.080733+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:44:47.080733+0000","last_undegraded":"2024-04-25T22:44:47.080733+0000","last_fullsized":"2024-04-25T22:44:47.080733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8276,"num_write":369,"num_write_kb":17867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"72'398","reported_seq":846,"reported_epoch":101,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-25T22:44:47.267185+0000","last_change":"2024-04-25T22:44:46.800575+0000","last_active":"2024-04-25T22:44:47.267185+0000","last_peered":"2024-04-25T22:44:47.267185+0000","last_clean":"2024-04-25T22:41:33.342064+0000","last_became_active":"2024-04-25T22:44:27.932101+0000","last_became_peered":"2024-04-25T22:44:27.932101+0000","last_unstale":"2024-04-25T22:44:47.267185+0000","last_undegraded":"2024-04-25T22:44:47.267185+0000","last_fullsized":"2024-04-25T22:44:27.382718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5883,"num_write":362,"num_write_kb":38188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":128,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"72'407","reported_seq":586,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.079985+0000","last_change":"2024-04-25T22:44:41.159724+0000","last_active":"2024-04-25T22:44:47.079985+0000","last_peered":"2024-04-25T22:44:47.079985+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.154547+0000","last_became_peered":"2024-04-25T22:44:41.154547+0000","last_unstale":"2024-04-25T22:44:47.079985+0000","last_undegraded":"2024-04-25T22:44:41.121499+0000","last_fullsized":"2024-04-25T22:44:41.120885+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13073,"num_write":372,"num_write_kb":59323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"72'441","reported_seq":1035,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.079761+0000","last_change":"2024-04-25T22:44:41.148409+0000","last_active":"2024-04-25T22:44:47.079761+0000","last_peered":"2024-04-25T22:44:47.079761+0000","last_clean":"2024-04-25T22:44:47.079761+0000","last_became_active":"2024-04-25T22:44:41.143302+0000","last_became_peered":"2024-04-25T22:44:41.143302+0000","last_unstale":"2024-04-25T22:44:47.079761+0000","last_undegraded":"2024-04-25T22:44:47.079761+0000","last_fullsized":"2024-04-25T22:44:47.079761+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:46.289713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37611,"num_write":403,"num_write_kb":116618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"72'438","reported_seq":640,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082905+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:44:47.082905+0000","last_peered":"2024-04-25T22:44:47.082905+0000","last_clean":"2024-04-25T22:44:47.082905+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:44:47.082905+0000","last_undegraded":"2024-04-25T22:44:47.082905+0000","last_fullsized":"2024-04-25T22:44:47.082905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12393,"num_write":408,"num_write_kb":99933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"72'407","reported_seq":598,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083942+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:44:47.083942+0000","last_peered":"2024-04-25T22:44:47.083942+0000","last_clean":"2024-04-25T22:44:47.083942+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:44:47.083942+0000","last_undegraded":"2024-04-25T22:44:47.083942+0000","last_fullsized":"2024-04-25T22:44:47.083942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8932,"num_write":382,"num_write_kb":59684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"72'463","reported_seq":672,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.370903+0000","last_change":"2024-04-25T22:44:47.376009+0000","last_active":"2024-04-25T22:44:49.370903+0000","last_peered":"2024-04-25T22:44:49.370903+0000","last_clean":"2024-04-25T22:44:49.370903+0000","last_became_active":"2024-04-25T22:44:47.369995+0000","last_became_peered":"2024-04-25T22:44:47.369995+0000","last_unstale":"2024-04-25T22:44:49.370903+0000","last_undegraded":"2024-04-25T22:44:49.370903+0000","last_fullsized":"2024-04-25T22:44:49.370903+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:04.129559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27589,"num_write":428,"num_write_kb":76861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"72'425","reported_seq":670,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.077486+0000","last_change":"2024-04-25T22:44:39.132230+0000","last_active":"2024-04-25T22:44:47.077486+0000","last_peered":"2024-04-25T22:44:47.077486+0000","last_clean":"2024-04-25T22:44:47.077486+0000","last_became_active":"2024-04-25T22:44:39.118635+0000","last_became_peered":"2024-04-25T22:44:39.118635+0000","last_unstale":"2024-04-25T22:44:47.077486+0000","last_undegraded":"2024-04-25T22:44:47.077486+0000","last_fullsized":"2024-04-25T22:44:47.077486+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:15.096836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":46424,"num_write":390,"num_write_kb":96359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"72'445","reported_seq":652,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.078066+0000","last_change":"2024-04-25T22:44:41.135696+0000","last_active":"2024-04-25T22:44:47.078066+0000","last_peered":"2024-04-25T22:44:47.078066+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130730+0000","last_became_peered":"2024-04-25T22:44:41.130730+0000","last_unstale":"2024-04-25T22:44:47.078066+0000","last_undegraded":"2024-04-25T22:44:41.116994+0000","last_fullsized":"2024-04-25T22:44:41.116354+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32317,"num_write":419,"num_write_kb":76071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"72'424","reported_seq":616,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.084483+0000","last_change":"2024-04-25T22:44:41.138549+0000","last_active":"2024-04-25T22:44:47.084483+0000","last_peered":"2024-04-25T22:44:47.084483+0000","last_clean":"2024-04-25T22:41:34.256374+0000","last_became_active":"2024-04-25T22:44:41.133640+0000","last_became_peered":"2024-04-25T22:44:41.133640+0000","last_unstale":"2024-04-25T22:44:47.084483+0000","last_undegraded":"2024-04-25T22:44:41.120823+0000","last_fullsized":"2024-04-25T22:44:41.120131+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8396,"num_write":399,"num_write_kb":50416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"72'499","reported_seq":686,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.079339+0000","last_change":"2024-04-25T22:44:39.149280+0000","last_active":"2024-04-25T22:44:47.079339+0000","last_peered":"2024-04-25T22:44:47.079339+0000","last_clean":"2024-04-25T22:44:47.079339+0000","last_became_active":"2024-04-25T22:44:39.143391+0000","last_became_peered":"2024-04-25T22:44:39.143391+0000","last_unstale":"2024-04-25T22:44:47.079339+0000","last_undegraded":"2024-04-25T22:44:47.079339+0000","last_fullsized":"2024-04-25T22:44:47.079339+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:54:10.301144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10227,"num_write":453,"num_write_kb":96585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'430","reported_seq":1058,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083135+0000","last_change":"2024-04-25T22:44:39.113437+0000","last_active":"2024-04-25T22:44:47.083135+0000","last_peered":"2024-04-25T22:44:47.083135+0000","last_clean":"2024-04-25T22:44:47.083135+0000","last_became_active":"2024-04-25T22:44:39.109771+0000","last_became_peered":"2024-04-25T22:44:39.109771+0000","last_unstale":"2024-04-25T22:44:47.083135+0000","last_undegraded":"2024-04-25T22:44:47.083135+0000","last_fullsized":"2024-04-25T22:44:47.083135+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:40:46.739897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":32116,"num_write":409,"num_write_kb":89217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"72'393","reported_seq":636,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.371730+0000","last_change":"2024-04-25T22:44:41.425947+0000","last_active":"2024-04-25T22:44:49.371730+0000","last_peered":"2024-04-25T22:44:49.371730+0000","last_clean":"2024-04-25T22:44:49.371730+0000","last_became_active":"2024-04-25T22:44:41.413570+0000","last_became_peered":"2024-04-25T22:44:41.413570+0000","last_unstale":"2024-04-25T22:44:49.371730+0000","last_undegraded":"2024-04-25T22:44:49.371730+0000","last_fullsized":"2024-04-25T22:44:49.371730+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:39:00.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":28076,"num_write":364,"num_write_kb":47473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"72'399","reported_seq":969,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078495+0000","last_change":"2024-04-25T22:44:40.124745+0000","last_active":"2024-04-25T22:44:47.078495+0000","last_peered":"2024-04-25T22:44:47.078495+0000","last_clean":"2024-04-25T22:44:47.078495+0000","last_became_active":"2024-04-25T22:44:40.121838+0000","last_became_peered":"2024-04-25T22:44:40.121838+0000","last_unstale":"2024-04-25T22:44:47.078495+0000","last_undegraded":"2024-04-25T22:44:47.078495+0000","last_fullsized":"2024-04-25T22:44:47.078495+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:28.299317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14005,"num_write":367,"num_write_kb":58883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"72'484","reported_seq":716,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.082206+0000","last_change":"2024-04-25T22:44:41.147898+0000","last_active":"2024-04-25T22:44:47.082206+0000","last_peered":"2024-04-25T22:44:47.082206+0000","last_clean":"2024-04-25T22:41:34.255390+0000","last_became_active":"2024-04-25T22:44:41.144605+0000","last_became_peered":"2024-04-25T22:44:41.144605+0000","last_unstale":"2024-04-25T22:44:47.082206+0000","last_undegraded":"2024-04-25T22:44:41.118456+0000","last_fullsized":"2024-04-25T22:44:41.117828+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":208,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23352,"num_write":446,"num_write_kb":100094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"72'455","reported_seq":1112,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.077464+0000","last_change":"2024-04-25T22:44:33.087211+0000","last_active":"2024-04-25T22:44:47.077464+0000","last_peered":"2024-04-25T22:44:47.077464+0000","last_clean":"2024-04-25T22:44:47.077464+0000","last_became_active":"2024-04-25T22:44:33.084127+0000","last_became_peered":"2024-04-25T22:44:33.084127+0000","last_unstale":"2024-04-25T22:44:47.077464+0000","last_undegraded":"2024-04-25T22:44:47.077464+0000","last_fullsized":"2024-04-25T22:44:47.077464+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38440,"num_write":423,"num_write_kb":71855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"72'434","reported_seq":644,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081082+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:44:47.081082+0000","last_peered":"2024-04-25T22:44:47.081082+0000","last_clean":"2024-04-25T22:44:47.081082+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:44:47.081082+0000","last_undegraded":"2024-04-25T22:44:47.081082+0000","last_fullsized":"2024-04-25T22:44:47.081082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18701,"num_write":402,"num_write_kb":27564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"72'379","reported_seq":557,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.079424+0000","last_change":"2024-04-25T22:44:41.134849+0000","last_active":"2024-04-25T22:44:47.079424+0000","last_peered":"2024-04-25T22:44:47.079424+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130604+0000","last_became_peered":"2024-04-25T22:44:41.130604+0000","last_unstale":"2024-04-25T22:44:47.079424+0000","last_undegraded":"2024-04-25T22:44:41.118062+0000","last_fullsized":"2024-04-25T22:44:41.117484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18623,"num_write":344,"num_write_kb":50888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"71'528","reported_seq":706,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.084117+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:44:47.084117+0000","last_peered":"2024-04-25T22:44:47.084117+0000","last_clean":"2024-04-25T22:44:47.084117+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:44:47.084117+0000","last_undegraded":"2024-04-25T22:44:47.084117+0000","last_fullsized":"2024-04-25T22:44:47.084117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"72'383","reported_seq":544,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.078889+0000","last_change":"2024-04-25T22:44:41.148275+0000","last_active":"2024-04-25T22:44:47.078889+0000","last_peered":"2024-04-25T22:44:47.078889+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.142954+0000","last_became_peered":"2024-04-25T22:44:41.142954+0000","last_unstale":"2024-04-25T22:44:47.078889+0000","last_undegraded":"2024-04-25T22:44:41.119000+0000","last_fullsized":"2024-04-25T22:44:41.118353+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8364,"num_write":351,"num_write_kb":30625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"71'45","reported_seq":176,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078818+0000","last_change":"2024-04-25T22:44:39.117622+0000","last_active":"2024-04-25T22:44:47.078818+0000","last_peered":"2024-04-25T22:44:47.078818+0000","last_clean":"2024-04-25T22:44:47.078818+0000","last_became_active":"2024-04-25T22:44:39.115669+0000","last_became_peered":"2024-04-25T22:44:39.115669+0000","last_unstale":"2024-04-25T22:44:47.078818+0000","last_undegraded":"2024-04-25T22:44:47.078818+0000","last_fullsized":"2024-04-25T22:44:47.078818+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:21.793820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"72'429","reported_seq":611,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.080724+0000","last_change":"2024-04-25T22:44:41.157231+0000","last_active":"2024-04-25T22:44:47.080724+0000","last_peered":"2024-04-25T22:44:47.080724+0000","last_clean":"2024-04-25T22:44:24.311958+0000","last_became_active":"2024-04-25T22:44:41.154517+0000","last_became_peered":"2024-04-25T22:44:41.154517+0000","last_unstale":"2024-04-25T22:44:47.080724+0000","last_undegraded":"2024-04-25T22:44:41.121712+0000","last_fullsized":"2024-04-25T22:44:41.121143+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16584,"num_write":393,"num_write_kb":63712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'61","reported_seq":69,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.370228+0000","last_change":"2024-04-25T22:44:41.416554+0000","last_active":"2024-04-25T22:44:49.370228+0000","last_peered":"2024-04-25T22:44:49.370228+0000","last_clean":"2024-04-25T22:44:49.370228+0000","last_became_active":"2024-04-25T22:44:41.413853+0000","last_became_peered":"2024-04-25T22:44:41.413853+0000","last_unstale":"2024-04-25T22:44:49.370228+0000","last_undegraded":"2024-04-25T22:44:49.370228+0000","last_fullsized":"2024-04-25T22:44:49.370228+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:50.701110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"72'404","reported_seq":600,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.079576+0000","last_change":"2024-04-25T22:44:39.128428+0000","last_active":"2024-04-25T22:44:47.079576+0000","last_peered":"2024-04-25T22:44:47.079576+0000","last_clean":"2024-04-25T22:44:47.079576+0000","last_became_active":"2024-04-25T22:44:39.116562+0000","last_became_peered":"2024-04-25T22:44:39.116562+0000","last_unstale":"2024-04-25T22:44:47.079576+0000","last_undegraded":"2024-04-25T22:44:47.079576+0000","last_fullsized":"2024-04-25T22:44:47.079576+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:09.750726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18745,"num_write":376,"num_write_kb":96145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'71","reported_seq":257,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081201+0000","last_change":"2024-04-25T22:44:26.363329+0000","last_active":"2024-04-25T22:44:47.081201+0000","last_peered":"2024-04-25T22:44:47.081201+0000","last_clean":"2024-04-25T22:44:47.081201+0000","last_became_active":"2024-04-25T22:44:26.362499+0000","last_became_peered":"2024-04-25T22:44:26.362499+0000","last_unstale":"2024-04-25T22:44:47.081201+0000","last_undegraded":"2024-04-25T22:44:47.081201+0000","last_fullsized":"2024-04-25T22:44:47.081201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'145","reported_seq":338,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.085425+0000","last_change":"2024-04-25T22:44:29.400540+0000","last_active":"2024-04-25T22:44:47.085425+0000","last_peered":"2024-04-25T22:44:47.085425+0000","last_clean":"2024-04-25T22:44:47.085425+0000","last_became_active":"2024-04-25T22:44:29.399853+0000","last_became_peered":"2024-04-25T22:44:29.399853+0000","last_unstale":"2024-04-25T22:44:47.085425+0000","last_undegraded":"2024-04-25T22:44:47.085425+0000","last_fullsized":"2024-04-25T22:44:47.085425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"72'399","reported_seq":585,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.370619+0000","last_change":"2024-04-25T22:44:46.398600+0000","last_active":"2024-04-25T22:44:49.370619+0000","last_peered":"2024-04-25T22:44:49.370619+0000","last_clean":"2024-04-25T22:44:49.370619+0000","last_became_active":"2024-04-25T22:44:46.392604+0000","last_became_peered":"2024-04-25T22:44:46.392604+0000","last_unstale":"2024-04-25T22:44:49.370619+0000","last_undegraded":"2024-04-25T22:44:49.370619+0000","last_fullsized":"2024-04-25T22:44:49.370619+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:15.771324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25159,"num_write":363,"num_write_kb":34063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"71'226","reported_seq":412,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.371490+0000","last_change":"2024-04-25T22:44:41.417859+0000","last_active":"2024-04-25T22:44:49.371490+0000","last_peered":"2024-04-25T22:44:49.371490+0000","last_clean":"2024-04-25T22:44:49.371490+0000","last_became_active":"2024-04-25T22:44:41.416542+0000","last_became_peered":"2024-04-25T22:44:41.416542+0000","last_unstale":"2024-04-25T22:44:49.371490+0000","last_undegraded":"2024-04-25T22:44:49.371490+0000","last_fullsized":"2024-04-25T22:44:49.371490+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:27.884903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"72'431","reported_seq":615,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.077786+0000","last_change":"2024-04-25T22:44:41.136042+0000","last_active":"2024-04-25T22:44:47.077786+0000","last_peered":"2024-04-25T22:44:47.077786+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130862+0000","last_became_peered":"2024-04-25T22:44:41.130862+0000","last_unstale":"2024-04-25T22:44:47.077786+0000","last_undegraded":"2024-04-25T22:44:41.117168+0000","last_fullsized":"2024-04-25T22:44:41.116538+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14688,"num_write":405,"num_write_kb":38957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"71'382","reported_seq":575,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083938+0000","last_change":"2024-04-25T22:44:30.401893+0000","last_active":"2024-04-25T22:44:47.083938+0000","last_peered":"2024-04-25T22:44:47.083938+0000","last_clean":"2024-04-25T22:44:47.083938+0000","last_became_active":"2024-04-25T22:44:30.401021+0000","last_became_peered":"2024-04-25T22:44:30.401021+0000","last_unstale":"2024-04-25T22:44:47.083938+0000","last_undegraded":"2024-04-25T22:44:47.083938+0000","last_fullsized":"2024-04-25T22:44:47.083938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:38.452482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'453","reported_seq":661,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082545+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:44:47.082545+0000","last_peered":"2024-04-25T22:44:47.082545+0000","last_clean":"2024-04-25T22:44:47.082545+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:44:47.082545+0000","last_undegraded":"2024-04-25T22:44:47.082545+0000","last_fullsized":"2024-04-25T22:44:47.082545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18900,"num_write":418,"num_write_kb":117500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"71'64","reported_seq":243,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083511+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:44:47.083511+0000","last_peered":"2024-04-25T22:44:47.083511+0000","last_clean":"2024-04-25T22:44:47.083511+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:44:47.083511+0000","last_undegraded":"2024-04-25T22:44:47.083511+0000","last_fullsized":"2024-04-25T22:44:47.083511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'428","reported_seq":607,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078908+0000","last_change":"2024-04-25T22:44:39.129871+0000","last_active":"2024-04-25T22:44:47.078908+0000","last_peered":"2024-04-25T22:44:47.078908+0000","last_clean":"2024-04-25T22:44:47.078908+0000","last_became_active":"2024-04-25T22:44:39.121205+0000","last_became_peered":"2024-04-25T22:44:39.121205+0000","last_unstale":"2024-04-25T22:44:47.078908+0000","last_undegraded":"2024-04-25T22:44:47.078908+0000","last_fullsized":"2024-04-25T22:44:47.078908+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:48.521828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7477,"num_write":383,"num_write_kb":9617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'166","reported_seq":298,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.079410+0000","last_change":"2024-04-25T22:44:39.133550+0000","last_active":"2024-04-25T22:44:47.079410+0000","last_peered":"2024-04-25T22:44:47.079410+0000","last_clean":"2024-04-25T22:44:47.079410+0000","last_became_active":"2024-04-25T22:44:39.131489+0000","last_became_peered":"2024-04-25T22:44:39.131489+0000","last_unstale":"2024-04-25T22:44:47.079410+0000","last_undegraded":"2024-04-25T22:44:47.079410+0000","last_fullsized":"2024-04-25T22:44:47.079410+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:32.980801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"72'446","reported_seq":672,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083014+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:44:47.083014+0000","last_peered":"2024-04-25T22:44:47.083014+0000","last_clean":"2024-04-25T22:44:47.083014+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:44:47.083014+0000","last_undegraded":"2024-04-25T22:44:47.083014+0000","last_fullsized":"2024-04-25T22:44:47.083014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27788,"num_write":414,"num_write_kb":47058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"71'113","reported_seq":292,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083244+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:44:47.083244+0000","last_peered":"2024-04-25T22:44:47.083244+0000","last_clean":"2024-04-25T22:44:47.083244+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:44:47.083244+0000","last_undegraded":"2024-04-25T22:44:47.083244+0000","last_fullsized":"2024-04-25T22:44:47.083244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"72'417","reported_seq":995,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083635+0000","last_change":"2024-04-25T22:44:44.113498+0000","last_active":"2024-04-25T22:44:47.083635+0000","last_peered":"2024-04-25T22:44:47.083635+0000","last_clean":"2024-04-25T22:44:47.083635+0000","last_became_active":"2024-04-25T22:44:44.108084+0000","last_became_peered":"2024-04-25T22:44:44.108084+0000","last_unstale":"2024-04-25T22:44:47.083635+0000","last_undegraded":"2024-04-25T22:44:47.083635+0000","last_fullsized":"2024-04-25T22:44:47.083635+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16487,"num_write":388,"num_write_kb":75452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'59","reported_seq":69,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.369758+0000","last_change":"2024-04-25T22:44:41.417821+0000","last_active":"2024-04-25T22:44:49.369758+0000","last_peered":"2024-04-25T22:44:49.369758+0000","last_clean":"2024-04-25T22:44:49.369758+0000","last_became_active":"2024-04-25T22:44:41.415769+0000","last_became_peered":"2024-04-25T22:44:41.415769+0000","last_unstale":"2024-04-25T22:44:49.369758+0000","last_undegraded":"2024-04-25T22:44:49.369758+0000","last_fullsized":"2024-04-25T22:44:49.369758+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.099475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'358","reported_seq":876,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082996+0000","last_change":"2024-04-25T22:44:34.101942+0000","last_active":"2024-04-25T22:44:47.082996+0000","last_peered":"2024-04-25T22:44:47.082996+0000","last_clean":"2024-04-25T22:44:47.082996+0000","last_became_active":"2024-04-25T22:44:34.099595+0000","last_became_peered":"2024-04-25T22:44:34.099595+0000","last_unstale":"2024-04-25T22:44:47.082996+0000","last_undegraded":"2024-04-25T22:44:47.082996+0000","last_fullsized":"2024-04-25T22:44:47.082996+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:06.523166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12259,"num_write":325,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'465","reported_seq":614,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.370151+0000","last_change":"2024-04-25T22:44:41.425331+0000","last_active":"2024-04-25T22:44:49.370151+0000","last_peered":"2024-04-25T22:44:49.370151+0000","last_clean":"2024-04-25T22:44:49.370151+0000","last_became_active":"2024-04-25T22:44:41.423799+0000","last_became_peered":"2024-04-25T22:44:41.423799+0000","last_unstale":"2024-04-25T22:44:49.370151+0000","last_undegraded":"2024-04-25T22:44:49.370151+0000","last_fullsized":"2024-04-25T22:44:49.370151+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:04.324825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"72'386","reported_seq":931,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080025+0000","last_change":"2024-04-25T22:44:46.113269+0000","last_active":"2024-04-25T22:44:47.080025+0000","last_peered":"2024-04-25T22:44:47.080025+0000","last_clean":"2024-04-25T22:44:47.080025+0000","last_became_active":"2024-04-25T22:44:46.110394+0000","last_became_peered":"2024-04-25T22:44:46.110394+0000","last_unstale":"2024-04-25T22:44:47.080025+0000","last_undegraded":"2024-04-25T22:44:47.080025+0000","last_fullsized":"2024-04-25T22:44:47.080025+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9402,"num_write":352,"num_write_kb":50548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":394,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081692+0000","last_change":"2024-04-25T22:44:26.355770+0000","last_active":"2024-04-25T22:44:47.081692+0000","last_peered":"2024-04-25T22:44:47.081692+0000","last_clean":"2024-04-25T22:44:47.081692+0000","last_became_active":"2024-04-25T22:44:26.354730+0000","last_became_peered":"2024-04-25T22:44:26.354730+0000","last_unstale":"2024-04-25T22:44:47.081692+0000","last_undegraded":"2024-04-25T22:44:47.081692+0000","last_fullsized":"2024-04-25T22:44:47.081692+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:34.987031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":185,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.084341+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:44:47.084341+0000","last_peered":"2024-04-25T22:44:47.084341+0000","last_clean":"2024-04-25T22:44:47.084341+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:44:47.084341+0000","last_undegraded":"2024-04-25T22:44:47.084341+0000","last_fullsized":"2024-04-25T22:44:47.084341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"71'457","reported_seq":652,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078320+0000","last_change":"2024-04-25T22:44:29.399148+0000","last_active":"2024-04-25T22:44:47.078320+0000","last_peered":"2024-04-25T22:44:47.078320+0000","last_clean":"2024-04-25T22:44:47.078320+0000","last_became_active":"2024-04-25T22:44:29.397962+0000","last_became_peered":"2024-04-25T22:44:29.397962+0000","last_unstale":"2024-04-25T22:44:47.078320+0000","last_undegraded":"2024-04-25T22:44:47.078320+0000","last_fullsized":"2024-04-25T22:44:47.078320+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:14.015619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"72'447","reported_seq":1087,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083667+0000","last_change":"2024-04-25T22:44:43.108262+0000","last_active":"2024-04-25T22:44:47.083667+0000","last_peered":"2024-04-25T22:44:47.083667+0000","last_clean":"2024-04-25T22:44:47.083667+0000","last_became_active":"2024-04-25T22:44:43.105231+0000","last_became_peered":"2024-04-25T22:44:43.105231+0000","last_unstale":"2024-04-25T22:44:47.083667+0000","last_undegraded":"2024-04-25T22:44:47.083667+0000","last_fullsized":"2024-04-25T22:44:47.083667+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:09.728618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45074,"num_write":414,"num_write_kb":120596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":192,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081449+0000","last_change":"2024-04-25T22:44:26.355238+0000","last_active":"2024-04-25T22:44:47.081449+0000","last_peered":"2024-04-25T22:44:47.081449+0000","last_clean":"2024-04-25T22:44:47.081449+0000","last_became_active":"2024-04-25T22:44:26.354482+0000","last_became_peered":"2024-04-25T22:44:26.354482+0000","last_unstale":"2024-04-25T22:44:47.081449+0000","last_undegraded":"2024-04-25T22:44:47.081449+0000","last_fullsized":"2024-04-25T22:44:47.081449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.042514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'122","reported_seq":316,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078297+0000","last_change":"2024-04-25T22:44:39.141843+0000","last_active":"2024-04-25T22:44:47.078297+0000","last_peered":"2024-04-25T22:44:47.078297+0000","last_clean":"2024-04-25T22:44:47.078297+0000","last_became_active":"2024-04-25T22:44:39.139689+0000","last_became_peered":"2024-04-25T22:44:39.139689+0000","last_unstale":"2024-04-25T22:44:47.078297+0000","last_undegraded":"2024-04-25T22:44:47.078297+0000","last_fullsized":"2024-04-25T22:44:47.078297+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:18.614670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":62,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"72'449","reported_seq":632,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.372451+0000","last_change":"2024-04-25T22:44:41.439044+0000","last_active":"2024-04-25T22:44:49.372451+0000","last_peered":"2024-04-25T22:44:49.372451+0000","last_clean":"2024-04-25T22:44:49.372451+0000","last_became_active":"2024-04-25T22:44:41.432785+0000","last_became_peered":"2024-04-25T22:44:41.432785+0000","last_unstale":"2024-04-25T22:44:49.372451+0000","last_undegraded":"2024-04-25T22:44:49.372451+0000","last_fullsized":"2024-04-25T22:44:49.372451+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:57.171725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25191,"num_write":420,"num_write_kb":79855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":193,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.079967+0000","last_change":"2024-04-25T22:44:26.363464+0000","last_active":"2024-04-25T22:44:47.079967+0000","last_peered":"2024-04-25T22:44:47.079967+0000","last_clean":"2024-04-25T22:44:47.079967+0000","last_became_active":"2024-04-25T22:44:26.362808+0000","last_became_peered":"2024-04-25T22:44:26.362808+0000","last_unstale":"2024-04-25T22:44:47.079967+0000","last_undegraded":"2024-04-25T22:44:47.079967+0000","last_fullsized":"2024-04-25T22:44:47.079967+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:06.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'435","reported_seq":610,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.369542+0000","last_change":"2024-04-25T22:44:41.417191+0000","last_active":"2024-04-25T22:44:49.369542+0000","last_peered":"2024-04-25T22:44:49.369542+0000","last_clean":"2024-04-25T22:44:49.369542+0000","last_became_active":"2024-04-25T22:44:41.415592+0000","last_became_peered":"2024-04-25T22:44:41.415592+0000","last_unstale":"2024-04-25T22:44:49.369542+0000","last_undegraded":"2024-04-25T22:44:49.369542+0000","last_fullsized":"2024-04-25T22:44:49.369542+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:35.916512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"72'337","reported_seq":864,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080159+0000","last_change":"2024-04-25T22:44:45.113523+0000","last_active":"2024-04-25T22:44:47.080159+0000","last_peered":"2024-04-25T22:44:47.080159+0000","last_clean":"2024-04-25T22:44:47.080159+0000","last_became_active":"2024-04-25T22:44:45.111011+0000","last_became_peered":"2024-04-25T22:44:45.111011+0000","last_unstale":"2024-04-25T22:44:47.080159+0000","last_undegraded":"2024-04-25T22:44:47.080159+0000","last_fullsized":"2024-04-25T22:44:47.080159+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25242,"num_write":307,"num_write_kb":26250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":185,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083242+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:44:47.083242+0000","last_peered":"2024-04-25T22:44:47.083242+0000","last_clean":"2024-04-25T22:44:47.083242+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:44:47.083242+0000","last_undegraded":"2024-04-25T22:44:47.083242+0000","last_fullsized":"2024-04-25T22:44:47.083242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"71'61","reported_seq":240,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.084276+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:44:47.084276+0000","last_peered":"2024-04-25T22:44:47.084276+0000","last_clean":"2024-04-25T22:44:47.084276+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:44:47.084276+0000","last_undegraded":"2024-04-25T22:44:47.084276+0000","last_fullsized":"2024-04-25T22:44:47.084276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'404","reported_seq":992,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080407+0000","last_change":"2024-04-25T22:44:32.092728+0000","last_active":"2024-04-25T22:44:47.080407+0000","last_peered":"2024-04-25T22:44:47.080407+0000","last_clean":"2024-04-25T22:44:47.080407+0000","last_became_active":"2024-04-25T22:44:32.087528+0000","last_became_peered":"2024-04-25T22:44:32.087528+0000","last_unstale":"2024-04-25T22:44:47.080407+0000","last_undegraded":"2024-04-25T22:44:47.080407+0000","last_fullsized":"2024-04-25T22:44:47.080407+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:39.481467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":20287,"num_write":371,"num_write_kb":59919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'285","reported_seq":464,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083914+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:44:47.083914+0000","last_peered":"2024-04-25T22:44:47.083914+0000","last_clean":"2024-04-25T22:44:47.083914+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:44:47.083914+0000","last_undegraded":"2024-04-25T22:44:47.083914+0000","last_fullsized":"2024-04-25T22:44:47.083914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":193,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080720+0000","last_change":"2024-04-25T22:44:26.364185+0000","last_active":"2024-04-25T22:44:47.080720+0000","last_peered":"2024-04-25T22:44:47.080720+0000","last_clean":"2024-04-25T22:44:47.080720+0000","last_became_active":"2024-04-25T22:44:26.363583+0000","last_became_peered":"2024-04-25T22:44:26.363583+0000","last_unstale":"2024-04-25T22:44:47.080720+0000","last_undegraded":"2024-04-25T22:44:47.080720+0000","last_fullsized":"2024-04-25T22:44:47.080720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:35:04.325449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"72'366","reported_seq":551,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.081856+0000","last_change":"2024-04-25T22:44:41.142343+0000","last_active":"2024-04-25T22:44:47.081856+0000","last_peered":"2024-04-25T22:44:47.081856+0000","last_clean":"2024-04-25T22:41:34.254671+0000","last_became_active":"2024-04-25T22:44:41.137495+0000","last_became_peered":"2024-04-25T22:44:41.137495+0000","last_unstale":"2024-04-25T22:44:47.081856+0000","last_undegraded":"2024-04-25T22:44:41.117781+0000","last_fullsized":"2024-04-25T22:44:41.117310+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":346,"num_write":330,"num_write_kb":33934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":241,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080649+0000","last_change":"2024-04-25T22:44:26.364178+0000","last_active":"2024-04-25T22:44:47.080649+0000","last_peered":"2024-04-25T22:44:47.080649+0000","last_clean":"2024-04-25T22:44:47.080649+0000","last_became_active":"2024-04-25T22:44:26.363455+0000","last_became_peered":"2024-04-25T22:44:26.363455+0000","last_unstale":"2024-04-25T22:44:47.080649+0000","last_undegraded":"2024-04-25T22:44:47.080649+0000","last_fullsized":"2024-04-25T22:44:47.080649+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:58.181763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":123,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.371893+0000","last_change":"2024-04-25T22:44:41.423030+0000","last_active":"2024-04-25T22:44:49.371893+0000","last_peered":"2024-04-25T22:44:49.371893+0000","last_clean":"2024-04-25T22:44:49.371893+0000","last_became_active":"2024-04-25T22:44:41.421194+0000","last_became_peered":"2024-04-25T22:44:41.421194+0000","last_unstale":"2024-04-25T22:44:49.371893+0000","last_undegraded":"2024-04-25T22:44:49.371893+0000","last_fullsized":"2024-04-25T22:44:49.371893+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:59.297537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'413","reported_seq":607,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.370403+0000","last_change":"2024-04-25T22:44:48.378474+0000","last_active":"2024-04-25T22:44:49.370403+0000","last_peered":"2024-04-25T22:44:49.370403+0000","last_clean":"2024-04-25T22:44:49.370403+0000","last_became_active":"2024-04-25T22:44:48.372485+0000","last_became_peered":"2024-04-25T22:44:48.372485+0000","last_unstale":"2024-04-25T22:44:49.370403+0000","last_undegraded":"2024-04-25T22:44:49.370403+0000","last_fullsized":"2024-04-25T22:44:49.370403+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:47.402437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22994,"num_write":377,"num_write_kb":63140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'57","reported_seq":245,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081783+0000","last_change":"2024-04-25T22:44:26.366189+0000","last_active":"2024-04-25T22:44:47.081783+0000","last_peered":"2024-04-25T22:44:47.081783+0000","last_clean":"2024-04-25T22:44:47.081783+0000","last_became_active":"2024-04-25T22:44:26.365267+0000","last_became_peered":"2024-04-25T22:44:26.365267+0000","last_unstale":"2024-04-25T22:44:47.081783+0000","last_undegraded":"2024-04-25T22:44:47.081783+0000","last_fullsized":"2024-04-25T22:44:47.081783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:54.128937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":193,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080917+0000","last_change":"2024-04-25T22:44:26.361633+0000","last_active":"2024-04-25T22:44:47.080917+0000","last_peered":"2024-04-25T22:44:47.080917+0000","last_clean":"2024-04-25T22:44:47.080917+0000","last_became_active":"2024-04-25T22:44:26.360968+0000","last_became_peered":"2024-04-25T22:44:26.360968+0000","last_unstale":"2024-04-25T22:44:47.080917+0000","last_undegraded":"2024-04-25T22:44:47.080917+0000","last_fullsized":"2024-04-25T22:44:47.080917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:40.454898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'398","reported_seq":575,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078106+0000","last_change":"2024-04-25T22:44:39.132801+0000","last_active":"2024-04-25T22:44:47.078106+0000","last_peered":"2024-04-25T22:44:47.078106+0000","last_clean":"2024-04-25T22:44:47.078106+0000","last_became_active":"2024-04-25T22:44:39.124378+0000","last_became_peered":"2024-04-25T22:44:39.124378+0000","last_unstale":"2024-04-25T22:44:47.078106+0000","last_undegraded":"2024-04-25T22:44:47.078106+0000","last_fullsized":"2024-04-25T22:44:47.078106+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:29.195889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6306,"num_write":372,"num_write_kb":34077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'100","reported_seq":282,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080676+0000","last_change":"2024-04-25T22:44:39.150245+0000","last_active":"2024-04-25T22:44:47.080676+0000","last_peered":"2024-04-25T22:44:47.080676+0000","last_clean":"2024-04-25T22:44:47.080676+0000","last_became_active":"2024-04-25T22:44:39.147377+0000","last_became_peered":"2024-04-25T22:44:39.147377+0000","last_unstale":"2024-04-25T22:44:47.080676+0000","last_undegraded":"2024-04-25T22:44:47.080676+0000","last_fullsized":"2024-04-25T22:44:47.080676+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:36.007978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":192,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.085341+0000","last_change":"2024-04-25T22:44:26.360890+0000","last_active":"2024-04-25T22:44:47.085341+0000","last_peered":"2024-04-25T22:44:47.085341+0000","last_clean":"2024-04-25T22:44:47.085341+0000","last_became_active":"2024-04-25T22:44:26.360106+0000","last_became_peered":"2024-04-25T22:44:26.360106+0000","last_unstale":"2024-04-25T22:44:47.085341+0000","last_undegraded":"2024-04-25T22:44:47.085341+0000","last_fullsized":"2024-04-25T22:44:47.085341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:09.929196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'390","reported_seq":601,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.370612+0000","last_change":"2024-04-25T22:44:41.433574+0000","last_active":"2024-04-25T22:44:49.370612+0000","last_peered":"2024-04-25T22:44:49.370612+0000","last_clean":"2024-04-25T22:44:49.370612+0000","last_became_active":"2024-04-25T22:44:41.414924+0000","last_became_peered":"2024-04-25T22:44:41.414924+0000","last_unstale":"2024-04-25T22:44:49.370612+0000","last_undegraded":"2024-04-25T22:44:49.370612+0000","last_fullsized":"2024-04-25T22:44:49.370612+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:46.695300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":22915,"num_write":352,"num_write_kb":47201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"72'411","reported_seq":983,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083752+0000","last_change":"2024-04-25T22:44:32.090492+0000","last_active":"2024-04-25T22:44:47.083752+0000","last_peered":"2024-04-25T22:44:47.083752+0000","last_clean":"2024-04-25T22:44:47.083752+0000","last_became_active":"2024-04-25T22:44:32.087303+0000","last_became_peered":"2024-04-25T22:44:32.087303+0000","last_unstale":"2024-04-25T22:44:47.083752+0000","last_undegraded":"2024-04-25T22:44:47.083752+0000","last_fullsized":"2024-04-25T22:44:47.083752+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25412,"num_write":367,"num_write_kb":64656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'268","reported_seq":464,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083160+0000","last_change":"2024-04-25T22:44:29.399184+0000","last_active":"2024-04-25T22:44:47.083160+0000","last_peered":"2024-04-25T22:44:47.083160+0000","last_clean":"2024-04-25T22:44:47.083160+0000","last_became_active":"2024-04-25T22:44:29.398317+0000","last_became_peered":"2024-04-25T22:44:29.398317+0000","last_unstale":"2024-04-25T22:44:47.083160+0000","last_undegraded":"2024-04-25T22:44:47.083160+0000","last_fullsized":"2024-04-25T22:44:47.083160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:21.765162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382817,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"72'423","reported_seq":1022,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.077767+0000","last_change":"2024-04-25T22:44:42.092243+0000","last_active":"2024-04-25T22:44:47.077767+0000","last_peered":"2024-04-25T22:44:47.077767+0000","last_clean":"2024-04-25T22:44:47.077767+0000","last_became_active":"2024-04-25T22:44:42.088432+0000","last_became_peered":"2024-04-25T22:44:42.088432+0000","last_unstale":"2024-04-25T22:44:47.077767+0000","last_undegraded":"2024-04-25T22:44:47.077767+0000","last_fullsized":"2024-04-25T22:44:47.077767+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:54.239406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24794,"num_write":386,"num_write_kb":63756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'102","reported_seq":76,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.371330+0000","last_change":"2024-04-25T22:44:41.423993+0000","last_active":"2024-04-25T22:44:49.371330+0000","last_peered":"2024-04-25T22:44:49.371330+0000","last_clean":"2024-04-25T22:44:49.371330+0000","last_became_active":"2024-04-25T22:44:41.422237+0000","last_became_peered":"2024-04-25T22:44:41.422237+0000","last_unstale":"2024-04-25T22:44:49.371330+0000","last_undegraded":"2024-04-25T22:44:49.371330+0000","last_fullsized":"2024-04-25T22:44:49.371330+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:02.880774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"71'213","reported_seq":391,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.084374+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:44:47.084374+0000","last_peered":"2024-04-25T22:44:47.084374+0000","last_clean":"2024-04-25T22:44:47.084374+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:44:47.084374+0000","last_undegraded":"2024-04-25T22:44:47.084374+0000","last_fullsized":"2024-04-25T22:44:47.084374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"72'504","reported_seq":744,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.077657+0000","last_change":"2024-04-25T22:44:39.142694+0000","last_active":"2024-04-25T22:44:47.077657+0000","last_peered":"2024-04-25T22:44:47.077657+0000","last_clean":"2024-04-25T22:44:47.077657+0000","last_became_active":"2024-04-25T22:44:39.132582+0000","last_became_peered":"2024-04-25T22:44:39.132582+0000","last_unstale":"2024-04-25T22:44:47.077657+0000","last_undegraded":"2024-04-25T22:44:47.077657+0000","last_fullsized":"2024-04-25T22:44:47.077657+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:14.401644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":46975,"num_write":471,"num_write_kb":146290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'64","reported_seq":195,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081475+0000","last_change":"2024-04-25T22:44:39.136961+0000","last_active":"2024-04-25T22:44:47.081475+0000","last_peered":"2024-04-25T22:44:47.081475+0000","last_clean":"2024-04-25T22:44:47.081475+0000","last_became_active":"2024-04-25T22:44:39.136090+0000","last_became_peered":"2024-04-25T22:44:39.136090+0000","last_unstale":"2024-04-25T22:44:47.081475+0000","last_undegraded":"2024-04-25T22:44:47.081475+0000","last_fullsized":"2024-04-25T22:44:47.081475+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:35.220314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"72'475","reported_seq":1129,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.077799+0000","last_change":"2024-04-25T22:44:44.106484+0000","last_active":"2024-04-25T22:44:47.077799+0000","last_peered":"2024-04-25T22:44:47.077799+0000","last_clean":"2024-04-25T22:44:47.077799+0000","last_became_active":"2024-04-25T22:44:44.102061+0000","last_became_peered":"2024-04-25T22:44:44.102061+0000","last_unstale":"2024-04-25T22:44:47.077799+0000","last_undegraded":"2024-04-25T22:44:47.077799+0000","last_fullsized":"2024-04-25T22:44:47.077799+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:05.455255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":23011,"num_write":448,"num_write_kb":76439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"72'370","reported_seq":604,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.085009+0000","last_change":"2024-04-25T22:44:41.149278+0000","last_active":"2024-04-25T22:44:47.085009+0000","last_peered":"2024-04-25T22:44:47.085009+0000","last_clean":"2024-04-25T22:41:34.256787+0000","last_became_active":"2024-04-25T22:44:41.144535+0000","last_became_peered":"2024-04-25T22:44:41.144535+0000","last_unstale":"2024-04-25T22:44:47.085009+0000","last_undegraded":"2024-04-25T22:44:41.120919+0000","last_fullsized":"2024-04-25T22:44:41.120194+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":159,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33211,"num_write":340,"num_write_kb":63312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'647","reported_seq":841,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078412+0000","last_change":"2024-04-25T22:44:30.396965+0000","last_active":"2024-04-25T22:44:47.078412+0000","last_peered":"2024-04-25T22:44:47.078412+0000","last_clean":"2024-04-25T22:44:47.078412+0000","last_became_active":"2024-04-25T22:44:30.396073+0000","last_became_peered":"2024-04-25T22:44:30.396073+0000","last_unstale":"2024-04-25T22:44:47.078412+0000","last_undegraded":"2024-04-25T22:44:47.078412+0000","last_fullsized":"2024-04-25T22:44:47.078412+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"72'415","reported_seq":612,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.079634+0000","last_change":"2024-04-25T22:44:39.150290+0000","last_active":"2024-04-25T22:44:47.079634+0000","last_peered":"2024-04-25T22:44:47.079634+0000","last_clean":"2024-04-25T22:44:47.079634+0000","last_became_active":"2024-04-25T22:44:39.146949+0000","last_became_peered":"2024-04-25T22:44:39.146949+0000","last_unstale":"2024-04-25T22:44:47.079634+0000","last_undegraded":"2024-04-25T22:44:47.079634+0000","last_fullsized":"2024-04-25T22:44:47.079634+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:11.804350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19493,"num_write":386,"num_write_kb":64692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'207","reported_seq":338,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.077950+0000","last_change":"2024-04-25T22:44:39.141125+0000","last_active":"2024-04-25T22:44:47.077950+0000","last_peered":"2024-04-25T22:44:47.077950+0000","last_clean":"2024-04-25T22:44:47.077950+0000","last_became_active":"2024-04-25T22:44:39.138371+0000","last_became_peered":"2024-04-25T22:44:39.138371+0000","last_unstale":"2024-04-25T22:44:47.077950+0000","last_undegraded":"2024-04-25T22:44:47.077950+0000","last_fullsized":"2024-04-25T22:44:47.077950+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:14.147026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"72'395","reported_seq":596,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.082403+0000","last_change":"2024-04-25T22:44:41.148833+0000","last_active":"2024-04-25T22:44:47.082403+0000","last_peered":"2024-04-25T22:44:47.082403+0000","last_clean":"2024-04-25T22:41:34.256072+0000","last_became_active":"2024-04-25T22:44:41.144491+0000","last_became_peered":"2024-04-25T22:44:41.144491+0000","last_unstale":"2024-04-25T22:44:47.082403+0000","last_undegraded":"2024-04-25T22:44:41.119473+0000","last_fullsized":"2024-04-25T22:44:41.118876+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9576,"num_write":348,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"72'194","reported_seq":343,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.370837+0000","last_change":"2024-04-25T22:44:41.422369+0000","last_active":"2024-04-25T22:44:49.370837+0000","last_peered":"2024-04-25T22:44:49.370837+0000","last_clean":"2024-04-25T22:44:49.370837+0000","last_became_active":"2024-04-25T22:44:41.420491+0000","last_became_peered":"2024-04-25T22:44:41.420491+0000","last_unstale":"2024-04-25T22:44:49.370837+0000","last_undegraded":"2024-04-25T22:44:49.370837+0000","last_fullsized":"2024-04-25T22:44:49.370837+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:35.081225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360511,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":12143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12360511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"72'398","reported_seq":622,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.079225+0000","last_change":"2024-04-25T22:44:41.134567+0000","last_active":"2024-04-25T22:44:47.079225+0000","last_peered":"2024-04-25T22:44:47.079225+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130189+0000","last_became_peered":"2024-04-25T22:44:41.130189+0000","last_unstale":"2024-04-25T22:44:47.079225+0000","last_undegraded":"2024-04-25T22:44:41.117532+0000","last_fullsized":"2024-04-25T22:44:41.116946+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31284,"num_write":371,"num_write_kb":80144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"71'51","reported_seq":74,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.370213+0000","last_change":"2024-04-25T22:44:41.415722+0000","last_active":"2024-04-25T22:44:49.370213+0000","last_peered":"2024-04-25T22:44:49.370213+0000","last_clean":"2024-04-25T22:44:49.370213+0000","last_became_active":"2024-04-25T22:44:41.414774+0000","last_became_peered":"2024-04-25T22:44:41.414774+0000","last_unstale":"2024-04-25T22:44:49.370213+0000","last_undegraded":"2024-04-25T22:44:49.370213+0000","last_fullsized":"2024-04-25T22:44:49.370213+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:20.553373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"72'383","reported_seq":611,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083420+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:44:47.083420+0000","last_peered":"2024-04-25T22:44:47.083420+0000","last_clean":"2024-04-25T22:44:47.083420+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:44:47.083420+0000","last_undegraded":"2024-04-25T22:44:47.083420+0000","last_fullsized":"2024-04-25T22:44:47.083420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29308,"num_write":358,"num_write_kb":66975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"71'177","reported_seq":355,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083043+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:44:47.083043+0000","last_peered":"2024-04-25T22:44:47.083043+0000","last_clean":"2024-04-25T22:44:47.083043+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:44:47.083043+0000","last_undegraded":"2024-04-25T22:44:47.083043+0000","last_fullsized":"2024-04-25T22:44:47.083043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"72'387","reported_seq":576,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082748+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:44:47.082748+0000","last_peered":"2024-04-25T22:44:47.082748+0000","last_clean":"2024-04-25T22:44:47.082748+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:44:47.082748+0000","last_undegraded":"2024-04-25T22:44:47.082748+0000","last_fullsized":"2024-04-25T22:44:47.082748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3883,"num_write":348,"num_write_kb":34122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'209","reported_seq":393,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.370837+0000","last_change":"2024-04-25T22:44:41.419972+0000","last_active":"2024-04-25T22:44:49.370837+0000","last_peered":"2024-04-25T22:44:49.370837+0000","last_clean":"2024-04-25T22:44:49.370837+0000","last_became_active":"2024-04-25T22:44:41.418106+0000","last_became_peered":"2024-04-25T22:44:41.418106+0000","last_unstale":"2024-04-25T22:44:49.370837+0000","last_undegraded":"2024-04-25T22:44:49.370837+0000","last_fullsized":"2024-04-25T22:44:49.370837+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:07.628155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":12363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"72'419","reported_seq":587,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.370152+0000","last_change":"2024-04-25T22:44:41.434376+0000","last_active":"2024-04-25T22:44:49.370152+0000","last_peered":"2024-04-25T22:44:49.370152+0000","last_clean":"2024-04-25T22:44:49.370152+0000","last_became_active":"2024-04-25T22:44:41.420505+0000","last_became_peered":"2024-04-25T22:44:41.420505+0000","last_unstale":"2024-04-25T22:44:49.370152+0000","last_undegraded":"2024-04-25T22:44:49.370152+0000","last_fullsized":"2024-04-25T22:44:49.370152+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:04.414563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":13327,"num_write":388,"num_write_kb":55674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"71'131","reported_seq":325,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080515+0000","last_change":"2024-04-25T22:44:29.398880+0000","last_active":"2024-04-25T22:44:47.080515+0000","last_peered":"2024-04-25T22:44:47.080515+0000","last_clean":"2024-04-25T22:44:47.080515+0000","last_became_active":"2024-04-25T22:44:29.397905+0000","last_became_peered":"2024-04-25T22:44:29.397905+0000","last_unstale":"2024-04-25T22:44:47.080515+0000","last_undegraded":"2024-04-25T22:44:47.080515+0000","last_fullsized":"2024-04-25T22:44:47.080515+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:44.236330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"72'449","reported_seq":659,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081365+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:44:47.081365+0000","last_peered":"2024-04-25T22:44:47.081365+0000","last_clean":"2024-04-25T22:44:47.081365+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:44:47.081365+0000","last_undegraded":"2024-04-25T22:44:47.081365+0000","last_fullsized":"2024-04-25T22:44:47.081365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14222,"num_write":424,"num_write_kb":79796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"71'57","reported_seq":189,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081058+0000","last_change":"2024-04-25T22:44:39.137232+0000","last_active":"2024-04-25T22:44:47.081058+0000","last_peered":"2024-04-25T22:44:47.081058+0000","last_clean":"2024-04-25T22:44:47.081058+0000","last_became_active":"2024-04-25T22:44:39.136283+0000","last_became_peered":"2024-04-25T22:44:39.136283+0000","last_unstale":"2024-04-25T22:44:47.081058+0000","last_undegraded":"2024-04-25T22:44:47.081058+0000","last_fullsized":"2024-04-25T22:44:47.081058+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:32.428982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2311,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2461,"num_read_kb":1248646,"num_write":24434,"num_write_kb":4137258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4896,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26539,"ondisk_log_size":26539,"up":128,"acting":114,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127071275,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":4473,"num_write_kb":127409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254210048,"data_stored":254142550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},"log_size":6216,"ondisk_log_size":6216,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738431,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165200,"kb_used_data":79940,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94206640,"statfs":{"total":96636764160,"available":96467599360,"internally_reserved":0,"allocated":81858560,"data_stored":81359428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":79,"seq":339302416391,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123236,"kb_used_data":83224,"kb_used_omap":5,"kb_used_meta":39994,"kb_avail":94248604,"statfs":{"total":96636764160,"available":96510570496,"internally_reserved":0,"allocated":85221376,"data_stored":84690640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6003,"internal_metadata":40953997},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174208,"kb_used_data":88948,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94197632,"statfs":{"total":96636764160,"available":96458375168,"internally_reserved":0,"allocated":91082752,"data_stored":90561659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89575424,"data_stored":89544940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83689472,"data_stored":83664533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80945152,"data_stored":80933077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:44:51.491 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T22:44:51.888 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:44:51.888 INFO:teuthology.orchestra.run.smithi057.stdout:{"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 3164/108 objects degraded (2929.630%), 18 pgs degraded","count":18},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":299,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":105,"num_osds":3,"num_up_osds":3,"osd_up_since":1714085065,"num_in_osds":3,"osd_in_since":1714084793,"num_remapped_pgs":10},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":85},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":18},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"peering","count":1}],"num_pgs":105,"num_pools":4,"num_objects":54,"data_bytes":127661643,"bytes_used":460910592,"bytes_avail":289449381888,"bytes_total":289910292480,"inactive_pgs_ratio":0.0095238098874688148,"degraded_objects":3164,"degraded_total":108,"degraded_ratio":29.296296296296294,"recovering_objects_per_sec":197,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":792,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4192}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-25T22:41:21.139402+0000","services":{}},"progress_events":{}} 2024-04-25T22:44:51.908 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-25T22:44:51.908 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:44:52.222 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:44:52.224 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:44:52.242 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-04-25T22:44:52.080737+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127661643,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2311,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2659,"num_read_kb":1250233,"num_write":29110,"num_write_kb":4268127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4918,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32912,"ondisk_log_size":32912,"up":210,"acting":196,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":462644,"kb_used_data":252112,"kb_used_omap":8,"kb_used_meta":210487,"kb_avail":282652876,"statfs":{"total":289910292480,"available":289436545024,"internally_reserved":0,"allocated":258162688,"data_stored":256611727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9193,"internal_metadata":215538711},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-853,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":660,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000670"},"pg_stats":[{"pgid":"4.3f","version":"72'404","reported_seq":599,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.081637+0000","last_change":"2024-04-25T22:44:41.145114+0000","last_active":"2024-04-25T22:44:47.081637+0000","last_peered":"2024-04-25T22:44:47.081637+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.142277+0000","last_became_peered":"2024-04-25T22:44:41.142277+0000","last_unstale":"2024-04-25T22:44:47.081637+0000","last_undegraded":"2024-04-25T22:44:41.121372+0000","last_fullsized":"2024-04-25T22:44:41.120599+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19772,"num_write":366,"num_write_kb":46873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"72'420","reported_seq":602,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.371972+0000","last_change":"2024-04-25T22:44:41.434387+0000","last_active":"2024-04-25T22:44:49.371972+0000","last_peered":"2024-04-25T22:44:49.371972+0000","last_clean":"2024-04-25T22:44:49.371972+0000","last_became_active":"2024-04-25T22:44:41.418792+0000","last_became_peered":"2024-04-25T22:44:41.418792+0000","last_unstale":"2024-04-25T22:44:49.371972+0000","last_undegraded":"2024-04-25T22:44:49.371972+0000","last_fullsized":"2024-04-25T22:44:49.371972+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:43.196115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24515,"num_write":386,"num_write_kb":55688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"72'377","reported_seq":928,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082800+0000","last_change":"2024-04-25T22:44:42.096911+0000","last_active":"2024-04-25T22:44:47.082800+0000","last_peered":"2024-04-25T22:44:47.082800+0000","last_clean":"2024-04-25T22:44:47.082800+0000","last_became_active":"2024-04-25T22:44:42.093941+0000","last_became_peered":"2024-04-25T22:44:42.093941+0000","last_unstale":"2024-04-25T22:44:47.082800+0000","last_undegraded":"2024-04-25T22:44:47.082800+0000","last_fullsized":"2024-04-25T22:44:47.082800+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11135,"num_write":346,"num_write_kb":38950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"72'366","reported_seq":549,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082403+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:44:47.082403+0000","last_peered":"2024-04-25T22:44:47.082403+0000","last_clean":"2024-04-25T22:44:47.082403+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:44:47.082403+0000","last_undegraded":"2024-04-25T22:44:47.082403+0000","last_fullsized":"2024-04-25T22:44:47.082403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":326,"num_write_kb":34079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"72'455","reported_seq":609,"reported_epoch":103,"state":"peering","last_fresh":"2024-04-25T22:44:49.371770+0000","last_change":"2024-04-25T22:44:49.371770+0000","last_active":"2024-04-25T22:44:26.338770+0000","last_peered":"2024-04-25T22:44:24.308999+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:41:35.379723+0000","last_became_peered":"2024-04-25T22:41:35.379723+0000","last_unstale":"2024-04-25T22:44:49.371770+0000","last_undegraded":"2024-04-25T22:44:49.371770+0000","last_fullsized":"2024-04-25T22:44:49.371770+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33897,"num_write":426,"num_write_kb":100721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"72'401","reported_seq":611,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082143+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:44:47.082143+0000","last_peered":"2024-04-25T22:44:47.082143+0000","last_clean":"2024-04-25T22:44:47.082143+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:44:47.082143+0000","last_undegraded":"2024-04-25T22:44:47.082143+0000","last_fullsized":"2024-04-25T22:44:47.082143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15258,"num_write":369,"num_write_kb":53298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"72'452","reported_seq":694,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081149+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:44:47.081149+0000","last_peered":"2024-04-25T22:44:47.081149+0000","last_clean":"2024-04-25T22:44:47.081149+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:44:47.081149+0000","last_undegraded":"2024-04-25T22:44:47.081149+0000","last_fullsized":"2024-04-25T22:44:47.081149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34010,"num_write":428,"num_write_kb":157752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"72'401","reported_seq":616,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080719+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:44:47.080719+0000","last_peered":"2024-04-25T22:44:47.080719+0000","last_clean":"2024-04-25T22:44:47.080719+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:44:47.080719+0000","last_undegraded":"2024-04-25T22:44:47.080719+0000","last_fullsized":"2024-04-25T22:44:47.080719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19917,"num_write":359,"num_write_kb":109382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"72'394","reported_seq":950,"reported_epoch":100,"state":"peering","last_fresh":"2024-04-25T22:44:46.273311+0000","last_change":"2024-04-25T22:44:47.080405+0000","last_active":"2024-04-25T22:44:47.080405+0000","last_peered":"2024-04-25T22:44:46.273311+0000","last_clean":"2024-04-25T22:41:33.341370+0000","last_became_active":"2024-04-25T22:44:27.927304+0000","last_became_peered":"2024-04-25T22:44:27.927304+0000","last_unstale":"2024-04-25T22:44:46.273311+0000","last_undegraded":"2024-04-25T22:44:46.273311+0000","last_fullsized":"2024-04-25T22:44:27.345517+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9569,"num_write":360,"num_write_kb":25560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"72'382","reported_seq":546,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.371867+0000","last_change":"2024-04-25T22:44:41.433644+0000","last_active":"2024-04-25T22:44:49.371867+0000","last_peered":"2024-04-25T22:44:49.371867+0000","last_clean":"2024-04-25T22:44:49.371867+0000","last_became_active":"2024-04-25T22:44:41.421234+0000","last_became_peered":"2024-04-25T22:44:41.421234+0000","last_unstale":"2024-04-25T22:44:49.371867+0000","last_undegraded":"2024-04-25T22:44:49.371867+0000","last_fullsized":"2024-04-25T22:44:49.371867+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:24.217391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17192,"num_write":338,"num_write_kb":38688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"72'369","reported_seq":568,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083093+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:44:47.083093+0000","last_peered":"2024-04-25T22:44:47.083093+0000","last_clean":"2024-04-25T22:44:47.083093+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:44:47.083093+0000","last_undegraded":"2024-04-25T22:44:47.083093+0000","last_fullsized":"2024-04-25T22:44:47.083093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7385,"num_write":349,"num_write_kb":58842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"72'338","reported_seq":502,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.389845+0000","last_change":"2024-04-25T22:44:49.384005+0000","last_active":"2024-04-25T22:44:49.389845+0000","last_peered":"2024-04-25T22:44:49.389845+0000","last_clean":"2024-04-25T22:44:49.389845+0000","last_became_active":"2024-04-25T22:44:49.378325+0000","last_became_peered":"2024-04-25T22:44:49.378325+0000","last_unstale":"2024-04-25T22:44:49.389845+0000","last_undegraded":"2024-04-25T22:44:49.389845+0000","last_fullsized":"2024-04-25T22:44:49.389845+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:18.849786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13619,"num_write":312,"num_write_kb":21391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"72'411","reported_seq":585,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.371235+0000","last_change":"2024-04-25T22:44:41.432463+0000","last_active":"2024-04-25T22:44:49.371235+0000","last_peered":"2024-04-25T22:44:49.371235+0000","last_clean":"2024-04-25T22:44:49.371235+0000","last_became_active":"2024-04-25T22:44:41.421096+0000","last_became_peered":"2024-04-25T22:44:41.421096+0000","last_unstale":"2024-04-25T22:44:49.371235+0000","last_undegraded":"2024-04-25T22:44:49.371235+0000","last_fullsized":"2024-04-25T22:44:49.371235+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:46.942677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12998,"num_write":375,"num_write_kb":79661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"72'452","reported_seq":1026,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082465+0000","last_change":"2024-04-25T22:44:40.130299+0000","last_active":"2024-04-25T22:44:47.082465+0000","last_peered":"2024-04-25T22:44:47.082465+0000","last_clean":"2024-04-25T22:44:47.082465+0000","last_became_active":"2024-04-25T22:44:40.127307+0000","last_became_peered":"2024-04-25T22:44:40.127307+0000","last_unstale":"2024-04-25T22:44:47.082465+0000","last_undegraded":"2024-04-25T22:44:47.082465+0000","last_fullsized":"2024-04-25T22:44:47.082465+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:16.746830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":854,"num_write":419,"num_write_kb":88217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"72'428","reported_seq":1006,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081139+0000","last_change":"2024-04-25T22:44:35.108361+0000","last_active":"2024-04-25T22:44:47.081139+0000","last_peered":"2024-04-25T22:44:47.081139+0000","last_clean":"2024-04-25T22:44:47.081139+0000","last_became_active":"2024-04-25T22:44:35.103208+0000","last_became_peered":"2024-04-25T22:44:35.103208+0000","last_unstale":"2024-04-25T22:44:47.081139+0000","last_undegraded":"2024-04-25T22:44:47.081139+0000","last_fullsized":"2024-04-25T22:44:47.081139+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:22.046332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21291,"num_write":389,"num_write_kb":68562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"72'401","reported_seq":590,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080733+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:44:47.080733+0000","last_peered":"2024-04-25T22:44:47.080733+0000","last_clean":"2024-04-25T22:44:47.080733+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:44:47.080733+0000","last_undegraded":"2024-04-25T22:44:47.080733+0000","last_fullsized":"2024-04-25T22:44:47.080733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8276,"num_write":369,"num_write_kb":17867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"72'398","reported_seq":846,"reported_epoch":101,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-25T22:44:47.267185+0000","last_change":"2024-04-25T22:44:46.800575+0000","last_active":"2024-04-25T22:44:47.267185+0000","last_peered":"2024-04-25T22:44:47.267185+0000","last_clean":"2024-04-25T22:41:33.342064+0000","last_became_active":"2024-04-25T22:44:27.932101+0000","last_became_peered":"2024-04-25T22:44:27.932101+0000","last_unstale":"2024-04-25T22:44:47.267185+0000","last_undegraded":"2024-04-25T22:44:47.267185+0000","last_fullsized":"2024-04-25T22:44:27.382718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5883,"num_write":362,"num_write_kb":38188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":128,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"72'407","reported_seq":586,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.079985+0000","last_change":"2024-04-25T22:44:41.159724+0000","last_active":"2024-04-25T22:44:47.079985+0000","last_peered":"2024-04-25T22:44:47.079985+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.154547+0000","last_became_peered":"2024-04-25T22:44:41.154547+0000","last_unstale":"2024-04-25T22:44:47.079985+0000","last_undegraded":"2024-04-25T22:44:41.121499+0000","last_fullsized":"2024-04-25T22:44:41.120885+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13073,"num_write":372,"num_write_kb":59323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"72'441","reported_seq":1035,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.079761+0000","last_change":"2024-04-25T22:44:41.148409+0000","last_active":"2024-04-25T22:44:47.079761+0000","last_peered":"2024-04-25T22:44:47.079761+0000","last_clean":"2024-04-25T22:44:47.079761+0000","last_became_active":"2024-04-25T22:44:41.143302+0000","last_became_peered":"2024-04-25T22:44:41.143302+0000","last_unstale":"2024-04-25T22:44:47.079761+0000","last_undegraded":"2024-04-25T22:44:47.079761+0000","last_fullsized":"2024-04-25T22:44:47.079761+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:46.289713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37611,"num_write":403,"num_write_kb":116618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"72'438","reported_seq":640,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082905+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:44:47.082905+0000","last_peered":"2024-04-25T22:44:47.082905+0000","last_clean":"2024-04-25T22:44:47.082905+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:44:47.082905+0000","last_undegraded":"2024-04-25T22:44:47.082905+0000","last_fullsized":"2024-04-25T22:44:47.082905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12393,"num_write":408,"num_write_kb":99933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"72'407","reported_seq":598,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083942+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:44:47.083942+0000","last_peered":"2024-04-25T22:44:47.083942+0000","last_clean":"2024-04-25T22:44:47.083942+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:44:47.083942+0000","last_undegraded":"2024-04-25T22:44:47.083942+0000","last_fullsized":"2024-04-25T22:44:47.083942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8932,"num_write":382,"num_write_kb":59684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"72'463","reported_seq":672,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.370903+0000","last_change":"2024-04-25T22:44:47.376009+0000","last_active":"2024-04-25T22:44:49.370903+0000","last_peered":"2024-04-25T22:44:49.370903+0000","last_clean":"2024-04-25T22:44:49.370903+0000","last_became_active":"2024-04-25T22:44:47.369995+0000","last_became_peered":"2024-04-25T22:44:47.369995+0000","last_unstale":"2024-04-25T22:44:49.370903+0000","last_undegraded":"2024-04-25T22:44:49.370903+0000","last_fullsized":"2024-04-25T22:44:49.370903+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:04.129559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27589,"num_write":428,"num_write_kb":76861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"72'425","reported_seq":670,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.077486+0000","last_change":"2024-04-25T22:44:39.132230+0000","last_active":"2024-04-25T22:44:47.077486+0000","last_peered":"2024-04-25T22:44:47.077486+0000","last_clean":"2024-04-25T22:44:47.077486+0000","last_became_active":"2024-04-25T22:44:39.118635+0000","last_became_peered":"2024-04-25T22:44:39.118635+0000","last_unstale":"2024-04-25T22:44:47.077486+0000","last_undegraded":"2024-04-25T22:44:47.077486+0000","last_fullsized":"2024-04-25T22:44:47.077486+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:15.096836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":46424,"num_write":390,"num_write_kb":96359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"72'445","reported_seq":652,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.078066+0000","last_change":"2024-04-25T22:44:41.135696+0000","last_active":"2024-04-25T22:44:47.078066+0000","last_peered":"2024-04-25T22:44:47.078066+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130730+0000","last_became_peered":"2024-04-25T22:44:41.130730+0000","last_unstale":"2024-04-25T22:44:47.078066+0000","last_undegraded":"2024-04-25T22:44:41.116994+0000","last_fullsized":"2024-04-25T22:44:41.116354+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":193,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32317,"num_write":419,"num_write_kb":76071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"72'424","reported_seq":616,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.084483+0000","last_change":"2024-04-25T22:44:41.138549+0000","last_active":"2024-04-25T22:44:47.084483+0000","last_peered":"2024-04-25T22:44:47.084483+0000","last_clean":"2024-04-25T22:41:34.256374+0000","last_became_active":"2024-04-25T22:44:41.133640+0000","last_became_peered":"2024-04-25T22:44:41.133640+0000","last_unstale":"2024-04-25T22:44:47.084483+0000","last_undegraded":"2024-04-25T22:44:41.120823+0000","last_fullsized":"2024-04-25T22:44:41.120131+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":192,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8396,"num_write":399,"num_write_kb":50416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"72'499","reported_seq":686,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.079339+0000","last_change":"2024-04-25T22:44:39.149280+0000","last_active":"2024-04-25T22:44:47.079339+0000","last_peered":"2024-04-25T22:44:47.079339+0000","last_clean":"2024-04-25T22:44:47.079339+0000","last_became_active":"2024-04-25T22:44:39.143391+0000","last_became_peered":"2024-04-25T22:44:39.143391+0000","last_unstale":"2024-04-25T22:44:47.079339+0000","last_undegraded":"2024-04-25T22:44:47.079339+0000","last_fullsized":"2024-04-25T22:44:47.079339+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:54:10.301144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10227,"num_write":453,"num_write_kb":96585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'430","reported_seq":1058,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083135+0000","last_change":"2024-04-25T22:44:39.113437+0000","last_active":"2024-04-25T22:44:47.083135+0000","last_peered":"2024-04-25T22:44:47.083135+0000","last_clean":"2024-04-25T22:44:47.083135+0000","last_became_active":"2024-04-25T22:44:39.109771+0000","last_became_peered":"2024-04-25T22:44:39.109771+0000","last_unstale":"2024-04-25T22:44:47.083135+0000","last_undegraded":"2024-04-25T22:44:47.083135+0000","last_fullsized":"2024-04-25T22:44:47.083135+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:40:46.739897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":32116,"num_write":409,"num_write_kb":89217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"72'393","reported_seq":636,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.371730+0000","last_change":"2024-04-25T22:44:41.425947+0000","last_active":"2024-04-25T22:44:49.371730+0000","last_peered":"2024-04-25T22:44:49.371730+0000","last_clean":"2024-04-25T22:44:49.371730+0000","last_became_active":"2024-04-25T22:44:41.413570+0000","last_became_peered":"2024-04-25T22:44:41.413570+0000","last_unstale":"2024-04-25T22:44:49.371730+0000","last_undegraded":"2024-04-25T22:44:49.371730+0000","last_fullsized":"2024-04-25T22:44:49.371730+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:39:00.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":28076,"num_write":364,"num_write_kb":47473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"72'399","reported_seq":969,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078495+0000","last_change":"2024-04-25T22:44:40.124745+0000","last_active":"2024-04-25T22:44:47.078495+0000","last_peered":"2024-04-25T22:44:47.078495+0000","last_clean":"2024-04-25T22:44:47.078495+0000","last_became_active":"2024-04-25T22:44:40.121838+0000","last_became_peered":"2024-04-25T22:44:40.121838+0000","last_unstale":"2024-04-25T22:44:47.078495+0000","last_undegraded":"2024-04-25T22:44:47.078495+0000","last_fullsized":"2024-04-25T22:44:47.078495+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:28.299317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14005,"num_write":367,"num_write_kb":58883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"72'484","reported_seq":716,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.082206+0000","last_change":"2024-04-25T22:44:41.147898+0000","last_active":"2024-04-25T22:44:47.082206+0000","last_peered":"2024-04-25T22:44:47.082206+0000","last_clean":"2024-04-25T22:41:34.255390+0000","last_became_active":"2024-04-25T22:44:41.144605+0000","last_became_peered":"2024-04-25T22:44:41.144605+0000","last_unstale":"2024-04-25T22:44:47.082206+0000","last_undegraded":"2024-04-25T22:44:41.118456+0000","last_fullsized":"2024-04-25T22:44:41.117828+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":208,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23352,"num_write":446,"num_write_kb":100094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"72'455","reported_seq":1112,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.077464+0000","last_change":"2024-04-25T22:44:33.087211+0000","last_active":"2024-04-25T22:44:47.077464+0000","last_peered":"2024-04-25T22:44:47.077464+0000","last_clean":"2024-04-25T22:44:47.077464+0000","last_became_active":"2024-04-25T22:44:33.084127+0000","last_became_peered":"2024-04-25T22:44:33.084127+0000","last_unstale":"2024-04-25T22:44:47.077464+0000","last_undegraded":"2024-04-25T22:44:47.077464+0000","last_fullsized":"2024-04-25T22:44:47.077464+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38440,"num_write":423,"num_write_kb":71855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"72'434","reported_seq":644,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081082+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:44:47.081082+0000","last_peered":"2024-04-25T22:44:47.081082+0000","last_clean":"2024-04-25T22:44:47.081082+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:44:47.081082+0000","last_undegraded":"2024-04-25T22:44:47.081082+0000","last_fullsized":"2024-04-25T22:44:47.081082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18701,"num_write":402,"num_write_kb":27564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"72'379","reported_seq":557,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.079424+0000","last_change":"2024-04-25T22:44:41.134849+0000","last_active":"2024-04-25T22:44:47.079424+0000","last_peered":"2024-04-25T22:44:47.079424+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130604+0000","last_became_peered":"2024-04-25T22:44:41.130604+0000","last_unstale":"2024-04-25T22:44:47.079424+0000","last_undegraded":"2024-04-25T22:44:41.118062+0000","last_fullsized":"2024-04-25T22:44:41.117484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18623,"num_write":344,"num_write_kb":50888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"71'528","reported_seq":706,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.084117+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:44:47.084117+0000","last_peered":"2024-04-25T22:44:47.084117+0000","last_clean":"2024-04-25T22:44:47.084117+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:44:47.084117+0000","last_undegraded":"2024-04-25T22:44:47.084117+0000","last_fullsized":"2024-04-25T22:44:47.084117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"72'383","reported_seq":544,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.078889+0000","last_change":"2024-04-25T22:44:41.148275+0000","last_active":"2024-04-25T22:44:47.078889+0000","last_peered":"2024-04-25T22:44:47.078889+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.142954+0000","last_became_peered":"2024-04-25T22:44:41.142954+0000","last_unstale":"2024-04-25T22:44:47.078889+0000","last_undegraded":"2024-04-25T22:44:41.119000+0000","last_fullsized":"2024-04-25T22:44:41.118353+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8364,"num_write":351,"num_write_kb":30625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"71'45","reported_seq":176,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078818+0000","last_change":"2024-04-25T22:44:39.117622+0000","last_active":"2024-04-25T22:44:47.078818+0000","last_peered":"2024-04-25T22:44:47.078818+0000","last_clean":"2024-04-25T22:44:47.078818+0000","last_became_active":"2024-04-25T22:44:39.115669+0000","last_became_peered":"2024-04-25T22:44:39.115669+0000","last_unstale":"2024-04-25T22:44:47.078818+0000","last_undegraded":"2024-04-25T22:44:47.078818+0000","last_fullsized":"2024-04-25T22:44:47.078818+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:21.793820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"72'429","reported_seq":611,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.080724+0000","last_change":"2024-04-25T22:44:41.157231+0000","last_active":"2024-04-25T22:44:47.080724+0000","last_peered":"2024-04-25T22:44:47.080724+0000","last_clean":"2024-04-25T22:44:24.311958+0000","last_became_active":"2024-04-25T22:44:41.154517+0000","last_became_peered":"2024-04-25T22:44:41.154517+0000","last_unstale":"2024-04-25T22:44:47.080724+0000","last_undegraded":"2024-04-25T22:44:41.121712+0000","last_fullsized":"2024-04-25T22:44:41.121143+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16584,"num_write":393,"num_write_kb":63712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'61","reported_seq":69,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.370228+0000","last_change":"2024-04-25T22:44:41.416554+0000","last_active":"2024-04-25T22:44:49.370228+0000","last_peered":"2024-04-25T22:44:49.370228+0000","last_clean":"2024-04-25T22:44:49.370228+0000","last_became_active":"2024-04-25T22:44:41.413853+0000","last_became_peered":"2024-04-25T22:44:41.413853+0000","last_unstale":"2024-04-25T22:44:49.370228+0000","last_undegraded":"2024-04-25T22:44:49.370228+0000","last_fullsized":"2024-04-25T22:44:49.370228+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:50.701110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"72'404","reported_seq":600,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.079576+0000","last_change":"2024-04-25T22:44:39.128428+0000","last_active":"2024-04-25T22:44:47.079576+0000","last_peered":"2024-04-25T22:44:47.079576+0000","last_clean":"2024-04-25T22:44:47.079576+0000","last_became_active":"2024-04-25T22:44:39.116562+0000","last_became_peered":"2024-04-25T22:44:39.116562+0000","last_unstale":"2024-04-25T22:44:47.079576+0000","last_undegraded":"2024-04-25T22:44:47.079576+0000","last_fullsized":"2024-04-25T22:44:47.079576+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:09.750726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18745,"num_write":376,"num_write_kb":96145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'71","reported_seq":257,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081201+0000","last_change":"2024-04-25T22:44:26.363329+0000","last_active":"2024-04-25T22:44:47.081201+0000","last_peered":"2024-04-25T22:44:47.081201+0000","last_clean":"2024-04-25T22:44:47.081201+0000","last_became_active":"2024-04-25T22:44:26.362499+0000","last_became_peered":"2024-04-25T22:44:26.362499+0000","last_unstale":"2024-04-25T22:44:47.081201+0000","last_undegraded":"2024-04-25T22:44:47.081201+0000","last_fullsized":"2024-04-25T22:44:47.081201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'145","reported_seq":338,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.085425+0000","last_change":"2024-04-25T22:44:29.400540+0000","last_active":"2024-04-25T22:44:47.085425+0000","last_peered":"2024-04-25T22:44:47.085425+0000","last_clean":"2024-04-25T22:44:47.085425+0000","last_became_active":"2024-04-25T22:44:29.399853+0000","last_became_peered":"2024-04-25T22:44:29.399853+0000","last_unstale":"2024-04-25T22:44:47.085425+0000","last_undegraded":"2024-04-25T22:44:47.085425+0000","last_fullsized":"2024-04-25T22:44:47.085425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"72'399","reported_seq":585,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.370619+0000","last_change":"2024-04-25T22:44:46.398600+0000","last_active":"2024-04-25T22:44:49.370619+0000","last_peered":"2024-04-25T22:44:49.370619+0000","last_clean":"2024-04-25T22:44:49.370619+0000","last_became_active":"2024-04-25T22:44:46.392604+0000","last_became_peered":"2024-04-25T22:44:46.392604+0000","last_unstale":"2024-04-25T22:44:49.370619+0000","last_undegraded":"2024-04-25T22:44:49.370619+0000","last_fullsized":"2024-04-25T22:44:49.370619+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:15.771324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25159,"num_write":363,"num_write_kb":34063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"71'226","reported_seq":412,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.371490+0000","last_change":"2024-04-25T22:44:41.417859+0000","last_active":"2024-04-25T22:44:49.371490+0000","last_peered":"2024-04-25T22:44:49.371490+0000","last_clean":"2024-04-25T22:44:49.371490+0000","last_became_active":"2024-04-25T22:44:41.416542+0000","last_became_peered":"2024-04-25T22:44:41.416542+0000","last_unstale":"2024-04-25T22:44:49.371490+0000","last_undegraded":"2024-04-25T22:44:49.371490+0000","last_fullsized":"2024-04-25T22:44:49.371490+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:27.884903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"72'431","reported_seq":615,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.077786+0000","last_change":"2024-04-25T22:44:41.136042+0000","last_active":"2024-04-25T22:44:47.077786+0000","last_peered":"2024-04-25T22:44:47.077786+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130862+0000","last_became_peered":"2024-04-25T22:44:41.130862+0000","last_unstale":"2024-04-25T22:44:47.077786+0000","last_undegraded":"2024-04-25T22:44:41.117168+0000","last_fullsized":"2024-04-25T22:44:41.116538+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14688,"num_write":405,"num_write_kb":38957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"71'382","reported_seq":575,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083938+0000","last_change":"2024-04-25T22:44:30.401893+0000","last_active":"2024-04-25T22:44:47.083938+0000","last_peered":"2024-04-25T22:44:47.083938+0000","last_clean":"2024-04-25T22:44:47.083938+0000","last_became_active":"2024-04-25T22:44:30.401021+0000","last_became_peered":"2024-04-25T22:44:30.401021+0000","last_unstale":"2024-04-25T22:44:47.083938+0000","last_undegraded":"2024-04-25T22:44:47.083938+0000","last_fullsized":"2024-04-25T22:44:47.083938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:38.452482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'453","reported_seq":661,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082545+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:44:47.082545+0000","last_peered":"2024-04-25T22:44:47.082545+0000","last_clean":"2024-04-25T22:44:47.082545+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:44:47.082545+0000","last_undegraded":"2024-04-25T22:44:47.082545+0000","last_fullsized":"2024-04-25T22:44:47.082545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18900,"num_write":418,"num_write_kb":117500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"71'64","reported_seq":243,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083511+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:44:47.083511+0000","last_peered":"2024-04-25T22:44:47.083511+0000","last_clean":"2024-04-25T22:44:47.083511+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:44:47.083511+0000","last_undegraded":"2024-04-25T22:44:47.083511+0000","last_fullsized":"2024-04-25T22:44:47.083511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'428","reported_seq":607,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078908+0000","last_change":"2024-04-25T22:44:39.129871+0000","last_active":"2024-04-25T22:44:47.078908+0000","last_peered":"2024-04-25T22:44:47.078908+0000","last_clean":"2024-04-25T22:44:47.078908+0000","last_became_active":"2024-04-25T22:44:39.121205+0000","last_became_peered":"2024-04-25T22:44:39.121205+0000","last_unstale":"2024-04-25T22:44:47.078908+0000","last_undegraded":"2024-04-25T22:44:47.078908+0000","last_fullsized":"2024-04-25T22:44:47.078908+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:48.521828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7477,"num_write":383,"num_write_kb":9617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'166","reported_seq":298,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.079410+0000","last_change":"2024-04-25T22:44:39.133550+0000","last_active":"2024-04-25T22:44:47.079410+0000","last_peered":"2024-04-25T22:44:47.079410+0000","last_clean":"2024-04-25T22:44:47.079410+0000","last_became_active":"2024-04-25T22:44:39.131489+0000","last_became_peered":"2024-04-25T22:44:39.131489+0000","last_unstale":"2024-04-25T22:44:47.079410+0000","last_undegraded":"2024-04-25T22:44:47.079410+0000","last_fullsized":"2024-04-25T22:44:47.079410+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:32.980801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"72'446","reported_seq":672,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083014+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:44:47.083014+0000","last_peered":"2024-04-25T22:44:47.083014+0000","last_clean":"2024-04-25T22:44:47.083014+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:44:47.083014+0000","last_undegraded":"2024-04-25T22:44:47.083014+0000","last_fullsized":"2024-04-25T22:44:47.083014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27788,"num_write":414,"num_write_kb":47058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"71'113","reported_seq":292,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083244+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:44:47.083244+0000","last_peered":"2024-04-25T22:44:47.083244+0000","last_clean":"2024-04-25T22:44:47.083244+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:44:47.083244+0000","last_undegraded":"2024-04-25T22:44:47.083244+0000","last_fullsized":"2024-04-25T22:44:47.083244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"72'417","reported_seq":995,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083635+0000","last_change":"2024-04-25T22:44:44.113498+0000","last_active":"2024-04-25T22:44:47.083635+0000","last_peered":"2024-04-25T22:44:47.083635+0000","last_clean":"2024-04-25T22:44:47.083635+0000","last_became_active":"2024-04-25T22:44:44.108084+0000","last_became_peered":"2024-04-25T22:44:44.108084+0000","last_unstale":"2024-04-25T22:44:47.083635+0000","last_undegraded":"2024-04-25T22:44:47.083635+0000","last_fullsized":"2024-04-25T22:44:47.083635+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16487,"num_write":388,"num_write_kb":75452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'59","reported_seq":69,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.369758+0000","last_change":"2024-04-25T22:44:41.417821+0000","last_active":"2024-04-25T22:44:49.369758+0000","last_peered":"2024-04-25T22:44:49.369758+0000","last_clean":"2024-04-25T22:44:49.369758+0000","last_became_active":"2024-04-25T22:44:41.415769+0000","last_became_peered":"2024-04-25T22:44:41.415769+0000","last_unstale":"2024-04-25T22:44:49.369758+0000","last_undegraded":"2024-04-25T22:44:49.369758+0000","last_fullsized":"2024-04-25T22:44:49.369758+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.099475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'358","reported_seq":876,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082996+0000","last_change":"2024-04-25T22:44:34.101942+0000","last_active":"2024-04-25T22:44:47.082996+0000","last_peered":"2024-04-25T22:44:47.082996+0000","last_clean":"2024-04-25T22:44:47.082996+0000","last_became_active":"2024-04-25T22:44:34.099595+0000","last_became_peered":"2024-04-25T22:44:34.099595+0000","last_unstale":"2024-04-25T22:44:47.082996+0000","last_undegraded":"2024-04-25T22:44:47.082996+0000","last_fullsized":"2024-04-25T22:44:47.082996+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:06.523166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12259,"num_write":325,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'465","reported_seq":614,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.370151+0000","last_change":"2024-04-25T22:44:41.425331+0000","last_active":"2024-04-25T22:44:49.370151+0000","last_peered":"2024-04-25T22:44:49.370151+0000","last_clean":"2024-04-25T22:44:49.370151+0000","last_became_active":"2024-04-25T22:44:41.423799+0000","last_became_peered":"2024-04-25T22:44:41.423799+0000","last_unstale":"2024-04-25T22:44:49.370151+0000","last_undegraded":"2024-04-25T22:44:49.370151+0000","last_fullsized":"2024-04-25T22:44:49.370151+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:04.324825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"72'386","reported_seq":931,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080025+0000","last_change":"2024-04-25T22:44:46.113269+0000","last_active":"2024-04-25T22:44:47.080025+0000","last_peered":"2024-04-25T22:44:47.080025+0000","last_clean":"2024-04-25T22:44:47.080025+0000","last_became_active":"2024-04-25T22:44:46.110394+0000","last_became_peered":"2024-04-25T22:44:46.110394+0000","last_unstale":"2024-04-25T22:44:47.080025+0000","last_undegraded":"2024-04-25T22:44:47.080025+0000","last_fullsized":"2024-04-25T22:44:47.080025+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9402,"num_write":352,"num_write_kb":50548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":394,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081692+0000","last_change":"2024-04-25T22:44:26.355770+0000","last_active":"2024-04-25T22:44:47.081692+0000","last_peered":"2024-04-25T22:44:47.081692+0000","last_clean":"2024-04-25T22:44:47.081692+0000","last_became_active":"2024-04-25T22:44:26.354730+0000","last_became_peered":"2024-04-25T22:44:26.354730+0000","last_unstale":"2024-04-25T22:44:47.081692+0000","last_undegraded":"2024-04-25T22:44:47.081692+0000","last_fullsized":"2024-04-25T22:44:47.081692+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:34.987031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":185,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.084341+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:44:47.084341+0000","last_peered":"2024-04-25T22:44:47.084341+0000","last_clean":"2024-04-25T22:44:47.084341+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:44:47.084341+0000","last_undegraded":"2024-04-25T22:44:47.084341+0000","last_fullsized":"2024-04-25T22:44:47.084341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"71'457","reported_seq":652,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078320+0000","last_change":"2024-04-25T22:44:29.399148+0000","last_active":"2024-04-25T22:44:47.078320+0000","last_peered":"2024-04-25T22:44:47.078320+0000","last_clean":"2024-04-25T22:44:47.078320+0000","last_became_active":"2024-04-25T22:44:29.397962+0000","last_became_peered":"2024-04-25T22:44:29.397962+0000","last_unstale":"2024-04-25T22:44:47.078320+0000","last_undegraded":"2024-04-25T22:44:47.078320+0000","last_fullsized":"2024-04-25T22:44:47.078320+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:14.015619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"72'447","reported_seq":1087,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083667+0000","last_change":"2024-04-25T22:44:43.108262+0000","last_active":"2024-04-25T22:44:47.083667+0000","last_peered":"2024-04-25T22:44:47.083667+0000","last_clean":"2024-04-25T22:44:47.083667+0000","last_became_active":"2024-04-25T22:44:43.105231+0000","last_became_peered":"2024-04-25T22:44:43.105231+0000","last_unstale":"2024-04-25T22:44:47.083667+0000","last_undegraded":"2024-04-25T22:44:47.083667+0000","last_fullsized":"2024-04-25T22:44:47.083667+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:09.728618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45074,"num_write":414,"num_write_kb":120596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":192,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081449+0000","last_change":"2024-04-25T22:44:26.355238+0000","last_active":"2024-04-25T22:44:47.081449+0000","last_peered":"2024-04-25T22:44:47.081449+0000","last_clean":"2024-04-25T22:44:47.081449+0000","last_became_active":"2024-04-25T22:44:26.354482+0000","last_became_peered":"2024-04-25T22:44:26.354482+0000","last_unstale":"2024-04-25T22:44:47.081449+0000","last_undegraded":"2024-04-25T22:44:47.081449+0000","last_fullsized":"2024-04-25T22:44:47.081449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.042514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'122","reported_seq":316,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078297+0000","last_change":"2024-04-25T22:44:39.141843+0000","last_active":"2024-04-25T22:44:47.078297+0000","last_peered":"2024-04-25T22:44:47.078297+0000","last_clean":"2024-04-25T22:44:47.078297+0000","last_became_active":"2024-04-25T22:44:39.139689+0000","last_became_peered":"2024-04-25T22:44:39.139689+0000","last_unstale":"2024-04-25T22:44:47.078297+0000","last_undegraded":"2024-04-25T22:44:47.078297+0000","last_fullsized":"2024-04-25T22:44:47.078297+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:18.614670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":62,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"72'449","reported_seq":632,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.372451+0000","last_change":"2024-04-25T22:44:41.439044+0000","last_active":"2024-04-25T22:44:49.372451+0000","last_peered":"2024-04-25T22:44:49.372451+0000","last_clean":"2024-04-25T22:44:49.372451+0000","last_became_active":"2024-04-25T22:44:41.432785+0000","last_became_peered":"2024-04-25T22:44:41.432785+0000","last_unstale":"2024-04-25T22:44:49.372451+0000","last_undegraded":"2024-04-25T22:44:49.372451+0000","last_fullsized":"2024-04-25T22:44:49.372451+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:57.171725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25191,"num_write":420,"num_write_kb":79855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":193,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.079967+0000","last_change":"2024-04-25T22:44:26.363464+0000","last_active":"2024-04-25T22:44:47.079967+0000","last_peered":"2024-04-25T22:44:47.079967+0000","last_clean":"2024-04-25T22:44:47.079967+0000","last_became_active":"2024-04-25T22:44:26.362808+0000","last_became_peered":"2024-04-25T22:44:26.362808+0000","last_unstale":"2024-04-25T22:44:47.079967+0000","last_undegraded":"2024-04-25T22:44:47.079967+0000","last_fullsized":"2024-04-25T22:44:47.079967+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:06.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'435","reported_seq":610,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.369542+0000","last_change":"2024-04-25T22:44:41.417191+0000","last_active":"2024-04-25T22:44:49.369542+0000","last_peered":"2024-04-25T22:44:49.369542+0000","last_clean":"2024-04-25T22:44:49.369542+0000","last_became_active":"2024-04-25T22:44:41.415592+0000","last_became_peered":"2024-04-25T22:44:41.415592+0000","last_unstale":"2024-04-25T22:44:49.369542+0000","last_undegraded":"2024-04-25T22:44:49.369542+0000","last_fullsized":"2024-04-25T22:44:49.369542+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:35.916512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"72'337","reported_seq":864,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080159+0000","last_change":"2024-04-25T22:44:45.113523+0000","last_active":"2024-04-25T22:44:47.080159+0000","last_peered":"2024-04-25T22:44:47.080159+0000","last_clean":"2024-04-25T22:44:47.080159+0000","last_became_active":"2024-04-25T22:44:45.111011+0000","last_became_peered":"2024-04-25T22:44:45.111011+0000","last_unstale":"2024-04-25T22:44:47.080159+0000","last_undegraded":"2024-04-25T22:44:47.080159+0000","last_fullsized":"2024-04-25T22:44:47.080159+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25242,"num_write":307,"num_write_kb":26250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":185,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083242+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:44:47.083242+0000","last_peered":"2024-04-25T22:44:47.083242+0000","last_clean":"2024-04-25T22:44:47.083242+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:44:47.083242+0000","last_undegraded":"2024-04-25T22:44:47.083242+0000","last_fullsized":"2024-04-25T22:44:47.083242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"71'61","reported_seq":240,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.084276+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:44:47.084276+0000","last_peered":"2024-04-25T22:44:47.084276+0000","last_clean":"2024-04-25T22:44:47.084276+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:44:47.084276+0000","last_undegraded":"2024-04-25T22:44:47.084276+0000","last_fullsized":"2024-04-25T22:44:47.084276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'404","reported_seq":992,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080407+0000","last_change":"2024-04-25T22:44:32.092728+0000","last_active":"2024-04-25T22:44:47.080407+0000","last_peered":"2024-04-25T22:44:47.080407+0000","last_clean":"2024-04-25T22:44:47.080407+0000","last_became_active":"2024-04-25T22:44:32.087528+0000","last_became_peered":"2024-04-25T22:44:32.087528+0000","last_unstale":"2024-04-25T22:44:47.080407+0000","last_undegraded":"2024-04-25T22:44:47.080407+0000","last_fullsized":"2024-04-25T22:44:47.080407+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:39.481467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":20287,"num_write":371,"num_write_kb":59919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'285","reported_seq":464,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083914+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:44:47.083914+0000","last_peered":"2024-04-25T22:44:47.083914+0000","last_clean":"2024-04-25T22:44:47.083914+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:44:47.083914+0000","last_undegraded":"2024-04-25T22:44:47.083914+0000","last_fullsized":"2024-04-25T22:44:47.083914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":193,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080720+0000","last_change":"2024-04-25T22:44:26.364185+0000","last_active":"2024-04-25T22:44:47.080720+0000","last_peered":"2024-04-25T22:44:47.080720+0000","last_clean":"2024-04-25T22:44:47.080720+0000","last_became_active":"2024-04-25T22:44:26.363583+0000","last_became_peered":"2024-04-25T22:44:26.363583+0000","last_unstale":"2024-04-25T22:44:47.080720+0000","last_undegraded":"2024-04-25T22:44:47.080720+0000","last_fullsized":"2024-04-25T22:44:47.080720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:35:04.325449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"72'366","reported_seq":551,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.081856+0000","last_change":"2024-04-25T22:44:41.142343+0000","last_active":"2024-04-25T22:44:47.081856+0000","last_peered":"2024-04-25T22:44:47.081856+0000","last_clean":"2024-04-25T22:41:34.254671+0000","last_became_active":"2024-04-25T22:44:41.137495+0000","last_became_peered":"2024-04-25T22:44:41.137495+0000","last_unstale":"2024-04-25T22:44:47.081856+0000","last_undegraded":"2024-04-25T22:44:41.117781+0000","last_fullsized":"2024-04-25T22:44:41.117310+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":346,"num_write":330,"num_write_kb":33934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":241,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080649+0000","last_change":"2024-04-25T22:44:26.364178+0000","last_active":"2024-04-25T22:44:47.080649+0000","last_peered":"2024-04-25T22:44:47.080649+0000","last_clean":"2024-04-25T22:44:47.080649+0000","last_became_active":"2024-04-25T22:44:26.363455+0000","last_became_peered":"2024-04-25T22:44:26.363455+0000","last_unstale":"2024-04-25T22:44:47.080649+0000","last_undegraded":"2024-04-25T22:44:47.080649+0000","last_fullsized":"2024-04-25T22:44:47.080649+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:58.181763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":123,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.371893+0000","last_change":"2024-04-25T22:44:41.423030+0000","last_active":"2024-04-25T22:44:49.371893+0000","last_peered":"2024-04-25T22:44:49.371893+0000","last_clean":"2024-04-25T22:44:49.371893+0000","last_became_active":"2024-04-25T22:44:41.421194+0000","last_became_peered":"2024-04-25T22:44:41.421194+0000","last_unstale":"2024-04-25T22:44:49.371893+0000","last_undegraded":"2024-04-25T22:44:49.371893+0000","last_fullsized":"2024-04-25T22:44:49.371893+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:59.297537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'413","reported_seq":607,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.370403+0000","last_change":"2024-04-25T22:44:48.378474+0000","last_active":"2024-04-25T22:44:49.370403+0000","last_peered":"2024-04-25T22:44:49.370403+0000","last_clean":"2024-04-25T22:44:49.370403+0000","last_became_active":"2024-04-25T22:44:48.372485+0000","last_became_peered":"2024-04-25T22:44:48.372485+0000","last_unstale":"2024-04-25T22:44:49.370403+0000","last_undegraded":"2024-04-25T22:44:49.370403+0000","last_fullsized":"2024-04-25T22:44:49.370403+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:47.402437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22994,"num_write":377,"num_write_kb":63140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'57","reported_seq":245,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081783+0000","last_change":"2024-04-25T22:44:26.366189+0000","last_active":"2024-04-25T22:44:47.081783+0000","last_peered":"2024-04-25T22:44:47.081783+0000","last_clean":"2024-04-25T22:44:47.081783+0000","last_became_active":"2024-04-25T22:44:26.365267+0000","last_became_peered":"2024-04-25T22:44:26.365267+0000","last_unstale":"2024-04-25T22:44:47.081783+0000","last_undegraded":"2024-04-25T22:44:47.081783+0000","last_fullsized":"2024-04-25T22:44:47.081783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:54.128937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":193,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080917+0000","last_change":"2024-04-25T22:44:26.361633+0000","last_active":"2024-04-25T22:44:47.080917+0000","last_peered":"2024-04-25T22:44:47.080917+0000","last_clean":"2024-04-25T22:44:47.080917+0000","last_became_active":"2024-04-25T22:44:26.360968+0000","last_became_peered":"2024-04-25T22:44:26.360968+0000","last_unstale":"2024-04-25T22:44:47.080917+0000","last_undegraded":"2024-04-25T22:44:47.080917+0000","last_fullsized":"2024-04-25T22:44:47.080917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:40.454898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'398","reported_seq":575,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078106+0000","last_change":"2024-04-25T22:44:39.132801+0000","last_active":"2024-04-25T22:44:47.078106+0000","last_peered":"2024-04-25T22:44:47.078106+0000","last_clean":"2024-04-25T22:44:47.078106+0000","last_became_active":"2024-04-25T22:44:39.124378+0000","last_became_peered":"2024-04-25T22:44:39.124378+0000","last_unstale":"2024-04-25T22:44:47.078106+0000","last_undegraded":"2024-04-25T22:44:47.078106+0000","last_fullsized":"2024-04-25T22:44:47.078106+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:29.195889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6306,"num_write":372,"num_write_kb":34077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'100","reported_seq":282,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080676+0000","last_change":"2024-04-25T22:44:39.150245+0000","last_active":"2024-04-25T22:44:47.080676+0000","last_peered":"2024-04-25T22:44:47.080676+0000","last_clean":"2024-04-25T22:44:47.080676+0000","last_became_active":"2024-04-25T22:44:39.147377+0000","last_became_peered":"2024-04-25T22:44:39.147377+0000","last_unstale":"2024-04-25T22:44:47.080676+0000","last_undegraded":"2024-04-25T22:44:47.080676+0000","last_fullsized":"2024-04-25T22:44:47.080676+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:36.007978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":192,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.085341+0000","last_change":"2024-04-25T22:44:26.360890+0000","last_active":"2024-04-25T22:44:47.085341+0000","last_peered":"2024-04-25T22:44:47.085341+0000","last_clean":"2024-04-25T22:44:47.085341+0000","last_became_active":"2024-04-25T22:44:26.360106+0000","last_became_peered":"2024-04-25T22:44:26.360106+0000","last_unstale":"2024-04-25T22:44:47.085341+0000","last_undegraded":"2024-04-25T22:44:47.085341+0000","last_fullsized":"2024-04-25T22:44:47.085341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:09.929196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'390","reported_seq":601,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.370612+0000","last_change":"2024-04-25T22:44:41.433574+0000","last_active":"2024-04-25T22:44:49.370612+0000","last_peered":"2024-04-25T22:44:49.370612+0000","last_clean":"2024-04-25T22:44:49.370612+0000","last_became_active":"2024-04-25T22:44:41.414924+0000","last_became_peered":"2024-04-25T22:44:41.414924+0000","last_unstale":"2024-04-25T22:44:49.370612+0000","last_undegraded":"2024-04-25T22:44:49.370612+0000","last_fullsized":"2024-04-25T22:44:49.370612+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:46.695300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":22915,"num_write":352,"num_write_kb":47201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"72'411","reported_seq":983,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083752+0000","last_change":"2024-04-25T22:44:32.090492+0000","last_active":"2024-04-25T22:44:47.083752+0000","last_peered":"2024-04-25T22:44:47.083752+0000","last_clean":"2024-04-25T22:44:47.083752+0000","last_became_active":"2024-04-25T22:44:32.087303+0000","last_became_peered":"2024-04-25T22:44:32.087303+0000","last_unstale":"2024-04-25T22:44:47.083752+0000","last_undegraded":"2024-04-25T22:44:47.083752+0000","last_fullsized":"2024-04-25T22:44:47.083752+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25412,"num_write":367,"num_write_kb":64656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'268","reported_seq":464,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083160+0000","last_change":"2024-04-25T22:44:29.399184+0000","last_active":"2024-04-25T22:44:47.083160+0000","last_peered":"2024-04-25T22:44:47.083160+0000","last_clean":"2024-04-25T22:44:47.083160+0000","last_became_active":"2024-04-25T22:44:29.398317+0000","last_became_peered":"2024-04-25T22:44:29.398317+0000","last_unstale":"2024-04-25T22:44:47.083160+0000","last_undegraded":"2024-04-25T22:44:47.083160+0000","last_fullsized":"2024-04-25T22:44:47.083160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:21.765162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382817,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"72'423","reported_seq":1022,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.077767+0000","last_change":"2024-04-25T22:44:42.092243+0000","last_active":"2024-04-25T22:44:47.077767+0000","last_peered":"2024-04-25T22:44:47.077767+0000","last_clean":"2024-04-25T22:44:47.077767+0000","last_became_active":"2024-04-25T22:44:42.088432+0000","last_became_peered":"2024-04-25T22:44:42.088432+0000","last_unstale":"2024-04-25T22:44:47.077767+0000","last_undegraded":"2024-04-25T22:44:47.077767+0000","last_fullsized":"2024-04-25T22:44:47.077767+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:54.239406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24794,"num_write":386,"num_write_kb":63756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'102","reported_seq":76,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.371330+0000","last_change":"2024-04-25T22:44:41.423993+0000","last_active":"2024-04-25T22:44:49.371330+0000","last_peered":"2024-04-25T22:44:49.371330+0000","last_clean":"2024-04-25T22:44:49.371330+0000","last_became_active":"2024-04-25T22:44:41.422237+0000","last_became_peered":"2024-04-25T22:44:41.422237+0000","last_unstale":"2024-04-25T22:44:49.371330+0000","last_undegraded":"2024-04-25T22:44:49.371330+0000","last_fullsized":"2024-04-25T22:44:49.371330+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:02.880774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"71'213","reported_seq":391,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.084374+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:44:47.084374+0000","last_peered":"2024-04-25T22:44:47.084374+0000","last_clean":"2024-04-25T22:44:47.084374+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:44:47.084374+0000","last_undegraded":"2024-04-25T22:44:47.084374+0000","last_fullsized":"2024-04-25T22:44:47.084374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"72'504","reported_seq":744,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.077657+0000","last_change":"2024-04-25T22:44:39.142694+0000","last_active":"2024-04-25T22:44:47.077657+0000","last_peered":"2024-04-25T22:44:47.077657+0000","last_clean":"2024-04-25T22:44:47.077657+0000","last_became_active":"2024-04-25T22:44:39.132582+0000","last_became_peered":"2024-04-25T22:44:39.132582+0000","last_unstale":"2024-04-25T22:44:47.077657+0000","last_undegraded":"2024-04-25T22:44:47.077657+0000","last_fullsized":"2024-04-25T22:44:47.077657+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:14.401644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":46975,"num_write":471,"num_write_kb":146290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'64","reported_seq":195,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081475+0000","last_change":"2024-04-25T22:44:39.136961+0000","last_active":"2024-04-25T22:44:47.081475+0000","last_peered":"2024-04-25T22:44:47.081475+0000","last_clean":"2024-04-25T22:44:47.081475+0000","last_became_active":"2024-04-25T22:44:39.136090+0000","last_became_peered":"2024-04-25T22:44:39.136090+0000","last_unstale":"2024-04-25T22:44:47.081475+0000","last_undegraded":"2024-04-25T22:44:47.081475+0000","last_fullsized":"2024-04-25T22:44:47.081475+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:35.220314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"72'475","reported_seq":1129,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.077799+0000","last_change":"2024-04-25T22:44:44.106484+0000","last_active":"2024-04-25T22:44:47.077799+0000","last_peered":"2024-04-25T22:44:47.077799+0000","last_clean":"2024-04-25T22:44:47.077799+0000","last_became_active":"2024-04-25T22:44:44.102061+0000","last_became_peered":"2024-04-25T22:44:44.102061+0000","last_unstale":"2024-04-25T22:44:47.077799+0000","last_undegraded":"2024-04-25T22:44:47.077799+0000","last_fullsized":"2024-04-25T22:44:47.077799+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:05.455255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":23011,"num_write":448,"num_write_kb":76439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"72'370","reported_seq":604,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.085009+0000","last_change":"2024-04-25T22:44:41.149278+0000","last_active":"2024-04-25T22:44:47.085009+0000","last_peered":"2024-04-25T22:44:47.085009+0000","last_clean":"2024-04-25T22:41:34.256787+0000","last_became_active":"2024-04-25T22:44:41.144535+0000","last_became_peered":"2024-04-25T22:44:41.144535+0000","last_unstale":"2024-04-25T22:44:47.085009+0000","last_undegraded":"2024-04-25T22:44:41.120919+0000","last_fullsized":"2024-04-25T22:44:41.120194+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":159,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33211,"num_write":340,"num_write_kb":63312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'647","reported_seq":841,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.078412+0000","last_change":"2024-04-25T22:44:30.396965+0000","last_active":"2024-04-25T22:44:47.078412+0000","last_peered":"2024-04-25T22:44:47.078412+0000","last_clean":"2024-04-25T22:44:47.078412+0000","last_became_active":"2024-04-25T22:44:30.396073+0000","last_became_peered":"2024-04-25T22:44:30.396073+0000","last_unstale":"2024-04-25T22:44:47.078412+0000","last_undegraded":"2024-04-25T22:44:47.078412+0000","last_fullsized":"2024-04-25T22:44:47.078412+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"72'415","reported_seq":612,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.079634+0000","last_change":"2024-04-25T22:44:39.150290+0000","last_active":"2024-04-25T22:44:47.079634+0000","last_peered":"2024-04-25T22:44:47.079634+0000","last_clean":"2024-04-25T22:44:47.079634+0000","last_became_active":"2024-04-25T22:44:39.146949+0000","last_became_peered":"2024-04-25T22:44:39.146949+0000","last_unstale":"2024-04-25T22:44:47.079634+0000","last_undegraded":"2024-04-25T22:44:47.079634+0000","last_fullsized":"2024-04-25T22:44:47.079634+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:11.804350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19493,"num_write":386,"num_write_kb":64692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'207","reported_seq":338,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.077950+0000","last_change":"2024-04-25T22:44:39.141125+0000","last_active":"2024-04-25T22:44:47.077950+0000","last_peered":"2024-04-25T22:44:47.077950+0000","last_clean":"2024-04-25T22:44:47.077950+0000","last_became_active":"2024-04-25T22:44:39.138371+0000","last_became_peered":"2024-04-25T22:44:39.138371+0000","last_unstale":"2024-04-25T22:44:47.077950+0000","last_undegraded":"2024-04-25T22:44:47.077950+0000","last_fullsized":"2024-04-25T22:44:47.077950+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:14.147026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"72'395","reported_seq":596,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.082403+0000","last_change":"2024-04-25T22:44:41.148833+0000","last_active":"2024-04-25T22:44:47.082403+0000","last_peered":"2024-04-25T22:44:47.082403+0000","last_clean":"2024-04-25T22:41:34.256072+0000","last_became_active":"2024-04-25T22:44:41.144491+0000","last_became_peered":"2024-04-25T22:44:41.144491+0000","last_unstale":"2024-04-25T22:44:47.082403+0000","last_undegraded":"2024-04-25T22:44:41.119473+0000","last_fullsized":"2024-04-25T22:44:41.118876+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9576,"num_write":348,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"72'194","reported_seq":343,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.370837+0000","last_change":"2024-04-25T22:44:41.422369+0000","last_active":"2024-04-25T22:44:49.370837+0000","last_peered":"2024-04-25T22:44:49.370837+0000","last_clean":"2024-04-25T22:44:49.370837+0000","last_became_active":"2024-04-25T22:44:41.420491+0000","last_became_peered":"2024-04-25T22:44:41.420491+0000","last_unstale":"2024-04-25T22:44:49.370837+0000","last_undegraded":"2024-04-25T22:44:49.370837+0000","last_fullsized":"2024-04-25T22:44:49.370837+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:35.081225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360511,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":12143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12360511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"72'398","reported_seq":622,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:47.079225+0000","last_change":"2024-04-25T22:44:41.134567+0000","last_active":"2024-04-25T22:44:47.079225+0000","last_peered":"2024-04-25T22:44:47.079225+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130189+0000","last_became_peered":"2024-04-25T22:44:41.130189+0000","last_unstale":"2024-04-25T22:44:47.079225+0000","last_undegraded":"2024-04-25T22:44:41.117532+0000","last_fullsized":"2024-04-25T22:44:41.116946+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":164,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31284,"num_write":371,"num_write_kb":80144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"71'51","reported_seq":74,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.370213+0000","last_change":"2024-04-25T22:44:41.415722+0000","last_active":"2024-04-25T22:44:49.370213+0000","last_peered":"2024-04-25T22:44:49.370213+0000","last_clean":"2024-04-25T22:44:49.370213+0000","last_became_active":"2024-04-25T22:44:41.414774+0000","last_became_peered":"2024-04-25T22:44:41.414774+0000","last_unstale":"2024-04-25T22:44:49.370213+0000","last_undegraded":"2024-04-25T22:44:49.370213+0000","last_fullsized":"2024-04-25T22:44:49.370213+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:20.553373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"72'383","reported_seq":611,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083420+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:44:47.083420+0000","last_peered":"2024-04-25T22:44:47.083420+0000","last_clean":"2024-04-25T22:44:47.083420+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:44:47.083420+0000","last_undegraded":"2024-04-25T22:44:47.083420+0000","last_fullsized":"2024-04-25T22:44:47.083420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29308,"num_write":358,"num_write_kb":66975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"71'177","reported_seq":355,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.083043+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:44:47.083043+0000","last_peered":"2024-04-25T22:44:47.083043+0000","last_clean":"2024-04-25T22:44:47.083043+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:44:47.083043+0000","last_undegraded":"2024-04-25T22:44:47.083043+0000","last_fullsized":"2024-04-25T22:44:47.083043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"72'387","reported_seq":576,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.082748+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:44:47.082748+0000","last_peered":"2024-04-25T22:44:47.082748+0000","last_clean":"2024-04-25T22:44:47.082748+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:44:47.082748+0000","last_undegraded":"2024-04-25T22:44:47.082748+0000","last_fullsized":"2024-04-25T22:44:47.082748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3883,"num_write":348,"num_write_kb":34122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'209","reported_seq":393,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.370837+0000","last_change":"2024-04-25T22:44:41.419972+0000","last_active":"2024-04-25T22:44:49.370837+0000","last_peered":"2024-04-25T22:44:49.370837+0000","last_clean":"2024-04-25T22:44:49.370837+0000","last_became_active":"2024-04-25T22:44:41.418106+0000","last_became_peered":"2024-04-25T22:44:41.418106+0000","last_unstale":"2024-04-25T22:44:49.370837+0000","last_undegraded":"2024-04-25T22:44:49.370837+0000","last_fullsized":"2024-04-25T22:44:49.370837+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:07.628155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":12363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"72'419","reported_seq":587,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T22:44:49.370152+0000","last_change":"2024-04-25T22:44:41.434376+0000","last_active":"2024-04-25T22:44:49.370152+0000","last_peered":"2024-04-25T22:44:49.370152+0000","last_clean":"2024-04-25T22:44:49.370152+0000","last_became_active":"2024-04-25T22:44:41.420505+0000","last_became_peered":"2024-04-25T22:44:41.420505+0000","last_unstale":"2024-04-25T22:44:49.370152+0000","last_undegraded":"2024-04-25T22:44:49.370152+0000","last_fullsized":"2024-04-25T22:44:49.370152+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:04.414563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":13327,"num_write":388,"num_write_kb":55674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"71'131","reported_seq":325,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.080515+0000","last_change":"2024-04-25T22:44:29.398880+0000","last_active":"2024-04-25T22:44:47.080515+0000","last_peered":"2024-04-25T22:44:47.080515+0000","last_clean":"2024-04-25T22:44:47.080515+0000","last_became_active":"2024-04-25T22:44:29.397905+0000","last_became_peered":"2024-04-25T22:44:29.397905+0000","last_unstale":"2024-04-25T22:44:47.080515+0000","last_undegraded":"2024-04-25T22:44:47.080515+0000","last_fullsized":"2024-04-25T22:44:47.080515+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:44.236330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"72'449","reported_seq":659,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081365+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:44:47.081365+0000","last_peered":"2024-04-25T22:44:47.081365+0000","last_clean":"2024-04-25T22:44:47.081365+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:44:47.081365+0000","last_undegraded":"2024-04-25T22:44:47.081365+0000","last_fullsized":"2024-04-25T22:44:47.081365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14222,"num_write":424,"num_write_kb":79796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"71'57","reported_seq":189,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-25T22:44:47.081058+0000","last_change":"2024-04-25T22:44:39.137232+0000","last_active":"2024-04-25T22:44:47.081058+0000","last_peered":"2024-04-25T22:44:47.081058+0000","last_clean":"2024-04-25T22:44:47.081058+0000","last_became_active":"2024-04-25T22:44:39.136283+0000","last_became_peered":"2024-04-25T22:44:39.136283+0000","last_unstale":"2024-04-25T22:44:47.081058+0000","last_undegraded":"2024-04-25T22:44:47.081058+0000","last_fullsized":"2024-04-25T22:44:47.081058+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:32.428982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2311,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2461,"num_read_kb":1248646,"num_write":24434,"num_write_kb":4137258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4896,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26539,"ondisk_log_size":26539,"up":128,"acting":114,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127071275,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":4473,"num_write_kb":127409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254210048,"data_stored":254142550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},"log_size":6216,"ondisk_log_size":6216,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738431,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165200,"kb_used_data":79940,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94206640,"statfs":{"total":96636764160,"available":96467599360,"internally_reserved":0,"allocated":81858560,"data_stored":81359428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":79,"seq":339302416391,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123236,"kb_used_data":83224,"kb_used_omap":5,"kb_used_meta":39994,"kb_avail":94248604,"statfs":{"total":96636764160,"available":96510570496,"internally_reserved":0,"allocated":85221376,"data_stored":84690640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6003,"internal_metadata":40953997},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174208,"kb_used_data":88948,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94197632,"statfs":{"total":96636764160,"available":96458375168,"internally_reserved":0,"allocated":91082752,"data_stored":90561659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89575424,"data_stored":89544940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83689472,"data_stored":83664533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80945152,"data_stored":80933077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:44:55.250 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:44:55.567 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:44:55.569 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:44:55.588 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-04-25T22:44:55.240689+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127661643,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1061,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2659,"num_read_kb":1250233,"num_write":29110,"num_write_kb":4268127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6408,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32912,"ondisk_log_size":32912,"up":210,"acting":204,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":472576,"kb_used_data":252292,"kb_used_omap":8,"kb_used_meta":220215,"kb_avail":282642944,"statfs":{"total":289910292480,"available":289426374656,"internally_reserved":0,"allocated":258347008,"data_stored":256680834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9193,"internal_metadata":225500183},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1250,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1490,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001370"},"pg_stats":[{"pgid":"4.3f","version":"72'404","reported_seq":609,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.080209+0000","last_change":"2024-04-25T22:44:41.145114+0000","last_active":"2024-04-25T22:44:52.080209+0000","last_peered":"2024-04-25T22:44:52.080209+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.142277+0000","last_became_peered":"2024-04-25T22:44:41.142277+0000","last_unstale":"2024-04-25T22:44:52.080209+0000","last_undegraded":"2024-04-25T22:44:41.121372+0000","last_fullsized":"2024-04-25T22:44:41.120599+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19772,"num_write":366,"num_write_kb":46873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"72'420","reported_seq":612,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377841+0000","last_change":"2024-04-25T22:44:41.434387+0000","last_active":"2024-04-25T22:44:54.377841+0000","last_peered":"2024-04-25T22:44:54.377841+0000","last_clean":"2024-04-25T22:44:54.377841+0000","last_became_active":"2024-04-25T22:44:41.418792+0000","last_became_peered":"2024-04-25T22:44:41.418792+0000","last_unstale":"2024-04-25T22:44:54.377841+0000","last_undegraded":"2024-04-25T22:44:54.377841+0000","last_fullsized":"2024-04-25T22:44:54.377841+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:43.196115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24515,"num_write":386,"num_write_kb":55688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"72'377","reported_seq":938,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083922+0000","last_change":"2024-04-25T22:44:42.096911+0000","last_active":"2024-04-25T22:44:52.083922+0000","last_peered":"2024-04-25T22:44:52.083922+0000","last_clean":"2024-04-25T22:44:52.083922+0000","last_became_active":"2024-04-25T22:44:42.093941+0000","last_became_peered":"2024-04-25T22:44:42.093941+0000","last_unstale":"2024-04-25T22:44:52.083922+0000","last_undegraded":"2024-04-25T22:44:52.083922+0000","last_fullsized":"2024-04-25T22:44:52.083922+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11135,"num_write":346,"num_write_kb":38950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"72'366","reported_seq":559,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083331+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:44:52.083331+0000","last_peered":"2024-04-25T22:44:52.083331+0000","last_clean":"2024-04-25T22:44:52.083331+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:44:52.083331+0000","last_undegraded":"2024-04-25T22:44:52.083331+0000","last_fullsized":"2024-04-25T22:44:52.083331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":326,"num_write_kb":34079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"72'455","reported_seq":625,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375993+0000","last_change":"2024-04-25T22:44:50.391674+0000","last_active":"2024-04-25T22:44:54.375993+0000","last_peered":"2024-04-25T22:44:54.375993+0000","last_clean":"2024-04-25T22:44:54.375993+0000","last_became_active":"2024-04-25T22:44:50.384804+0000","last_became_peered":"2024-04-25T22:44:50.384804+0000","last_unstale":"2024-04-25T22:44:54.375993+0000","last_undegraded":"2024-04-25T22:44:54.375993+0000","last_fullsized":"2024-04-25T22:44:54.375993+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:22:54.239989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33897,"num_write":426,"num_write_kb":100721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"72'401","reported_seq":621,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.082641+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:44:52.082641+0000","last_peered":"2024-04-25T22:44:52.082641+0000","last_clean":"2024-04-25T22:44:52.082641+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:44:52.082641+0000","last_undegraded":"2024-04-25T22:44:52.082641+0000","last_fullsized":"2024-04-25T22:44:52.082641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15258,"num_write":369,"num_write_kb":53298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"72'452","reported_seq":704,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.082300+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:44:52.082300+0000","last_peered":"2024-04-25T22:44:52.082300+0000","last_clean":"2024-04-25T22:44:52.082300+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:44:52.082300+0000","last_undegraded":"2024-04-25T22:44:52.082300+0000","last_fullsized":"2024-04-25T22:44:52.082300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34010,"num_write":428,"num_write_kb":157752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"72'401","reported_seq":626,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.081948+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:44:52.081948+0000","last_peered":"2024-04-25T22:44:52.081948+0000","last_clean":"2024-04-25T22:44:52.081948+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:44:52.081948+0000","last_undegraded":"2024-04-25T22:44:52.081948+0000","last_fullsized":"2024-04-25T22:44:52.081948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19917,"num_write":359,"num_write_kb":109382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"72'394","reported_seq":966,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.078481+0000","last_change":"2024-04-25T22:44:48.092689+0000","last_active":"2024-04-25T22:44:52.078481+0000","last_peered":"2024-04-25T22:44:52.078481+0000","last_clean":"2024-04-25T22:44:52.078481+0000","last_became_active":"2024-04-25T22:44:48.089795+0000","last_became_peered":"2024-04-25T22:44:48.089795+0000","last_unstale":"2024-04-25T22:44:52.078481+0000","last_undegraded":"2024-04-25T22:44:52.078481+0000","last_fullsized":"2024-04-25T22:44:52.078481+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:32:33.072950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9569,"num_write":360,"num_write_kb":25560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"72'382","reported_seq":556,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377780+0000","last_change":"2024-04-25T22:44:41.433644+0000","last_active":"2024-04-25T22:44:54.377780+0000","last_peered":"2024-04-25T22:44:54.377780+0000","last_clean":"2024-04-25T22:44:54.377780+0000","last_became_active":"2024-04-25T22:44:41.421234+0000","last_became_peered":"2024-04-25T22:44:41.421234+0000","last_unstale":"2024-04-25T22:44:54.377780+0000","last_undegraded":"2024-04-25T22:44:54.377780+0000","last_fullsized":"2024-04-25T22:44:54.377780+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:24.217391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17192,"num_write":338,"num_write_kb":38688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"72'369","reported_seq":578,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.084198+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:44:52.084198+0000","last_peered":"2024-04-25T22:44:52.084198+0000","last_clean":"2024-04-25T22:44:52.084198+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:44:52.084198+0000","last_undegraded":"2024-04-25T22:44:52.084198+0000","last_fullsized":"2024-04-25T22:44:52.084198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7385,"num_write":349,"num_write_kb":58842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"72'338","reported_seq":512,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377657+0000","last_change":"2024-04-25T22:44:49.384005+0000","last_active":"2024-04-25T22:44:54.377657+0000","last_peered":"2024-04-25T22:44:54.377657+0000","last_clean":"2024-04-25T22:44:54.377657+0000","last_became_active":"2024-04-25T22:44:49.378325+0000","last_became_peered":"2024-04-25T22:44:49.378325+0000","last_unstale":"2024-04-25T22:44:54.377657+0000","last_undegraded":"2024-04-25T22:44:54.377657+0000","last_fullsized":"2024-04-25T22:44:54.377657+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:18.849786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13619,"num_write":312,"num_write_kb":21391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"72'411","reported_seq":595,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376695+0000","last_change":"2024-04-25T22:44:41.432463+0000","last_active":"2024-04-25T22:44:54.376695+0000","last_peered":"2024-04-25T22:44:54.376695+0000","last_clean":"2024-04-25T22:44:54.376695+0000","last_became_active":"2024-04-25T22:44:41.421096+0000","last_became_peered":"2024-04-25T22:44:41.421096+0000","last_unstale":"2024-04-25T22:44:54.376695+0000","last_undegraded":"2024-04-25T22:44:54.376695+0000","last_fullsized":"2024-04-25T22:44:54.376695+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:46.942677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12998,"num_write":375,"num_write_kb":79661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"72'452","reported_seq":1036,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.082946+0000","last_change":"2024-04-25T22:44:40.130299+0000","last_active":"2024-04-25T22:44:52.082946+0000","last_peered":"2024-04-25T22:44:52.082946+0000","last_clean":"2024-04-25T22:44:52.082946+0000","last_became_active":"2024-04-25T22:44:40.127307+0000","last_became_peered":"2024-04-25T22:44:40.127307+0000","last_unstale":"2024-04-25T22:44:52.082946+0000","last_undegraded":"2024-04-25T22:44:52.082946+0000","last_fullsized":"2024-04-25T22:44:52.082946+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:16.746830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":854,"num_write":419,"num_write_kb":88217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"72'428","reported_seq":1016,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.082413+0000","last_change":"2024-04-25T22:44:35.108361+0000","last_active":"2024-04-25T22:44:52.082413+0000","last_peered":"2024-04-25T22:44:52.082413+0000","last_clean":"2024-04-25T22:44:52.082413+0000","last_became_active":"2024-04-25T22:44:35.103208+0000","last_became_peered":"2024-04-25T22:44:35.103208+0000","last_unstale":"2024-04-25T22:44:52.082413+0000","last_undegraded":"2024-04-25T22:44:52.082413+0000","last_fullsized":"2024-04-25T22:44:52.082413+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:22.046332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21291,"num_write":389,"num_write_kb":68562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"72'401","reported_seq":600,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.081975+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:44:52.081975+0000","last_peered":"2024-04-25T22:44:52.081975+0000","last_clean":"2024-04-25T22:44:52.081975+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:44:52.081975+0000","last_undegraded":"2024-04-25T22:44:52.081975+0000","last_fullsized":"2024-04-25T22:44:52.081975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8276,"num_write":369,"num_write_kb":17867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"72'398","reported_seq":956,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.080496+0000","last_change":"2024-04-25T22:44:49.097340+0000","last_active":"2024-04-25T22:44:52.080496+0000","last_peered":"2024-04-25T22:44:52.080496+0000","last_clean":"2024-04-25T22:44:52.080496+0000","last_became_active":"2024-04-25T22:44:49.094478+0000","last_became_peered":"2024-04-25T22:44:49.094478+0000","last_unstale":"2024-04-25T22:44:52.080496+0000","last_undegraded":"2024-04-25T22:44:52.080496+0000","last_fullsized":"2024-04-25T22:44:52.080496+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:33.421713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5883,"num_write":362,"num_write_kb":38188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"72'407","reported_seq":596,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.079751+0000","last_change":"2024-04-25T22:44:41.159724+0000","last_active":"2024-04-25T22:44:52.079751+0000","last_peered":"2024-04-25T22:44:52.079751+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.154547+0000","last_became_peered":"2024-04-25T22:44:41.154547+0000","last_unstale":"2024-04-25T22:44:52.079751+0000","last_undegraded":"2024-04-25T22:44:41.121499+0000","last_fullsized":"2024-04-25T22:44:41.120885+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13073,"num_write":372,"num_write_kb":59323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"72'441","reported_seq":1045,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079032+0000","last_change":"2024-04-25T22:44:41.148409+0000","last_active":"2024-04-25T22:44:52.079032+0000","last_peered":"2024-04-25T22:44:52.079032+0000","last_clean":"2024-04-25T22:44:52.079032+0000","last_became_active":"2024-04-25T22:44:41.143302+0000","last_became_peered":"2024-04-25T22:44:41.143302+0000","last_unstale":"2024-04-25T22:44:52.079032+0000","last_undegraded":"2024-04-25T22:44:52.079032+0000","last_fullsized":"2024-04-25T22:44:52.079032+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:46.289713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37611,"num_write":403,"num_write_kb":116618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"72'438","reported_seq":650,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083398+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:44:52.083398+0000","last_peered":"2024-04-25T22:44:52.083398+0000","last_clean":"2024-04-25T22:44:52.083398+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:44:52.083398+0000","last_undegraded":"2024-04-25T22:44:52.083398+0000","last_fullsized":"2024-04-25T22:44:52.083398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12393,"num_write":408,"num_write_kb":99933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"72'407","reported_seq":608,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083395+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:44:52.083395+0000","last_peered":"2024-04-25T22:44:52.083395+0000","last_clean":"2024-04-25T22:44:52.083395+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:44:52.083395+0000","last_undegraded":"2024-04-25T22:44:52.083395+0000","last_fullsized":"2024-04-25T22:44:52.083395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8932,"num_write":382,"num_write_kb":59684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"72'463","reported_seq":682,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376349+0000","last_change":"2024-04-25T22:44:47.376009+0000","last_active":"2024-04-25T22:44:54.376349+0000","last_peered":"2024-04-25T22:44:54.376349+0000","last_clean":"2024-04-25T22:44:54.376349+0000","last_became_active":"2024-04-25T22:44:47.369995+0000","last_became_peered":"2024-04-25T22:44:47.369995+0000","last_unstale":"2024-04-25T22:44:54.376349+0000","last_undegraded":"2024-04-25T22:44:54.376349+0000","last_fullsized":"2024-04-25T22:44:54.376349+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:04.129559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27589,"num_write":428,"num_write_kb":76861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"72'425","reported_seq":680,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.077509+0000","last_change":"2024-04-25T22:44:39.132230+0000","last_active":"2024-04-25T22:44:52.077509+0000","last_peered":"2024-04-25T22:44:52.077509+0000","last_clean":"2024-04-25T22:44:52.077509+0000","last_became_active":"2024-04-25T22:44:39.118635+0000","last_became_peered":"2024-04-25T22:44:39.118635+0000","last_unstale":"2024-04-25T22:44:52.077509+0000","last_undegraded":"2024-04-25T22:44:52.077509+0000","last_fullsized":"2024-04-25T22:44:52.077509+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:15.096836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":46424,"num_write":390,"num_write_kb":96359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"72'445","reported_seq":609,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.388681+0000","last_change":"2024-04-25T22:44:54.388681+0000","last_active":"2024-04-25T22:44:54.388681+0000","last_peered":"2024-04-25T22:44:54.388681+0000","last_clean":"2024-04-25T22:44:54.388681+0000","last_became_active":"2024-04-25T22:44:54.382124+0000","last_became_peered":"2024-04-25T22:44:54.382124+0000","last_unstale":"2024-04-25T22:44:54.388681+0000","last_undegraded":"2024-04-25T22:44:54.388681+0000","last_fullsized":"2024-04-25T22:44:54.388681+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:49.633770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32317,"num_write":419,"num_write_kb":76071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"72'424","reported_seq":580,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377796+0000","last_change":"2024-04-25T22:44:51.391125+0000","last_active":"2024-04-25T22:44:54.377796+0000","last_peered":"2024-04-25T22:44:54.377796+0000","last_clean":"2024-04-25T22:44:54.377796+0000","last_became_active":"2024-04-25T22:44:51.383461+0000","last_became_peered":"2024-04-25T22:44:51.383461+0000","last_unstale":"2024-04-25T22:44:54.377796+0000","last_undegraded":"2024-04-25T22:44:54.377796+0000","last_fullsized":"2024-04-25T22:44:54.377796+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:33.717342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8396,"num_write":399,"num_write_kb":50416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"72'499","reported_seq":696,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079463+0000","last_change":"2024-04-25T22:44:39.149280+0000","last_active":"2024-04-25T22:44:52.079463+0000","last_peered":"2024-04-25T22:44:52.079463+0000","last_clean":"2024-04-25T22:44:52.079463+0000","last_became_active":"2024-04-25T22:44:39.143391+0000","last_became_peered":"2024-04-25T22:44:39.143391+0000","last_unstale":"2024-04-25T22:44:52.079463+0000","last_undegraded":"2024-04-25T22:44:52.079463+0000","last_fullsized":"2024-04-25T22:44:52.079463+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:54:10.301144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10227,"num_write":453,"num_write_kb":96585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'430","reported_seq":1068,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.084444+0000","last_change":"2024-04-25T22:44:39.113437+0000","last_active":"2024-04-25T22:44:52.084444+0000","last_peered":"2024-04-25T22:44:52.084444+0000","last_clean":"2024-04-25T22:44:52.084444+0000","last_became_active":"2024-04-25T22:44:39.109771+0000","last_became_peered":"2024-04-25T22:44:39.109771+0000","last_unstale":"2024-04-25T22:44:52.084444+0000","last_undegraded":"2024-04-25T22:44:52.084444+0000","last_fullsized":"2024-04-25T22:44:52.084444+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:40:46.739897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":32116,"num_write":409,"num_write_kb":89217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"72'393","reported_seq":646,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377384+0000","last_change":"2024-04-25T22:44:41.425947+0000","last_active":"2024-04-25T22:44:54.377384+0000","last_peered":"2024-04-25T22:44:54.377384+0000","last_clean":"2024-04-25T22:44:54.377384+0000","last_became_active":"2024-04-25T22:44:41.413570+0000","last_became_peered":"2024-04-25T22:44:41.413570+0000","last_unstale":"2024-04-25T22:44:54.377384+0000","last_undegraded":"2024-04-25T22:44:54.377384+0000","last_fullsized":"2024-04-25T22:44:54.377384+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:39:00.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":28076,"num_write":364,"num_write_kb":47473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"72'399","reported_seq":979,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079651+0000","last_change":"2024-04-25T22:44:40.124745+0000","last_active":"2024-04-25T22:44:52.079651+0000","last_peered":"2024-04-25T22:44:52.079651+0000","last_clean":"2024-04-25T22:44:52.079651+0000","last_became_active":"2024-04-25T22:44:40.121838+0000","last_became_peered":"2024-04-25T22:44:40.121838+0000","last_unstale":"2024-04-25T22:44:52.079651+0000","last_undegraded":"2024-04-25T22:44:52.079651+0000","last_fullsized":"2024-04-25T22:44:52.079651+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:28.299317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14005,"num_write":367,"num_write_kb":58883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"72'484","reported_seq":673,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.394316+0000","last_change":"2024-04-25T22:44:54.392451+0000","last_active":"2024-04-25T22:44:54.394316+0000","last_peered":"2024-04-25T22:44:54.394316+0000","last_clean":"2024-04-25T22:44:54.394316+0000","last_became_active":"2024-04-25T22:44:54.383808+0000","last_became_peered":"2024-04-25T22:44:54.383808+0000","last_unstale":"2024-04-25T22:44:54.394316+0000","last_undegraded":"2024-04-25T22:44:54.394316+0000","last_fullsized":"2024-04-25T22:44:54.394316+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:06.630318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23352,"num_write":446,"num_write_kb":100094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'455","reported_seq":1122,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.077674+0000","last_change":"2024-04-25T22:44:33.087211+0000","last_active":"2024-04-25T22:44:52.077674+0000","last_peered":"2024-04-25T22:44:52.077674+0000","last_clean":"2024-04-25T22:44:52.077674+0000","last_became_active":"2024-04-25T22:44:33.084127+0000","last_became_peered":"2024-04-25T22:44:33.084127+0000","last_unstale":"2024-04-25T22:44:52.077674+0000","last_undegraded":"2024-04-25T22:44:52.077674+0000","last_fullsized":"2024-04-25T22:44:52.077674+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38440,"num_write":423,"num_write_kb":71855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"72'434","reported_seq":654,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.082262+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:44:52.082262+0000","last_peered":"2024-04-25T22:44:52.082262+0000","last_clean":"2024-04-25T22:44:52.082262+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:44:52.082262+0000","last_undegraded":"2024-04-25T22:44:52.082262+0000","last_fullsized":"2024-04-25T22:44:52.082262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18701,"num_write":402,"num_write_kb":27564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"72'379","reported_seq":516,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376964+0000","last_change":"2024-04-25T22:44:53.383623+0000","last_active":"2024-04-25T22:44:54.376964+0000","last_peered":"2024-04-25T22:44:54.376964+0000","last_clean":"2024-04-25T22:44:54.376964+0000","last_became_active":"2024-04-25T22:44:53.378402+0000","last_became_peered":"2024-04-25T22:44:53.378402+0000","last_unstale":"2024-04-25T22:44:54.376964+0000","last_undegraded":"2024-04-25T22:44:54.376964+0000","last_fullsized":"2024-04-25T22:44:54.376964+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:52:18.111269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18623,"num_write":344,"num_write_kb":50888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"71'528","reported_seq":716,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083570+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:44:52.083570+0000","last_peered":"2024-04-25T22:44:52.083570+0000","last_clean":"2024-04-25T22:44:52.083570+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:44:52.083570+0000","last_undegraded":"2024-04-25T22:44:52.083570+0000","last_fullsized":"2024-04-25T22:44:52.083570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"72'383","reported_seq":554,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.078637+0000","last_change":"2024-04-25T22:44:41.148275+0000","last_active":"2024-04-25T22:44:52.078637+0000","last_peered":"2024-04-25T22:44:52.078637+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.142954+0000","last_became_peered":"2024-04-25T22:44:41.142954+0000","last_unstale":"2024-04-25T22:44:52.078637+0000","last_undegraded":"2024-04-25T22:44:41.119000+0000","last_fullsized":"2024-04-25T22:44:41.118353+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8364,"num_write":351,"num_write_kb":30625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"71'45","reported_seq":186,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.078395+0000","last_change":"2024-04-25T22:44:39.117622+0000","last_active":"2024-04-25T22:44:52.078395+0000","last_peered":"2024-04-25T22:44:52.078395+0000","last_clean":"2024-04-25T22:44:52.078395+0000","last_became_active":"2024-04-25T22:44:39.115669+0000","last_became_peered":"2024-04-25T22:44:39.115669+0000","last_unstale":"2024-04-25T22:44:52.078395+0000","last_undegraded":"2024-04-25T22:44:52.078395+0000","last_fullsized":"2024-04-25T22:44:52.078395+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:21.793820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"72'429","reported_seq":621,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.080308+0000","last_change":"2024-04-25T22:44:41.157231+0000","last_active":"2024-04-25T22:44:52.080308+0000","last_peered":"2024-04-25T22:44:52.080308+0000","last_clean":"2024-04-25T22:44:24.311958+0000","last_became_active":"2024-04-25T22:44:41.154517+0000","last_became_peered":"2024-04-25T22:44:41.154517+0000","last_unstale":"2024-04-25T22:44:52.080308+0000","last_undegraded":"2024-04-25T22:44:41.121712+0000","last_fullsized":"2024-04-25T22:44:41.121143+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16584,"num_write":393,"num_write_kb":63712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'61","reported_seq":79,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375730+0000","last_change":"2024-04-25T22:44:41.416554+0000","last_active":"2024-04-25T22:44:54.375730+0000","last_peered":"2024-04-25T22:44:54.375730+0000","last_clean":"2024-04-25T22:44:54.375730+0000","last_became_active":"2024-04-25T22:44:41.413853+0000","last_became_peered":"2024-04-25T22:44:41.413853+0000","last_unstale":"2024-04-25T22:44:54.375730+0000","last_undegraded":"2024-04-25T22:44:54.375730+0000","last_fullsized":"2024-04-25T22:44:54.375730+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:50.701110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"72'404","reported_seq":610,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079085+0000","last_change":"2024-04-25T22:44:39.128428+0000","last_active":"2024-04-25T22:44:52.079085+0000","last_peered":"2024-04-25T22:44:52.079085+0000","last_clean":"2024-04-25T22:44:52.079085+0000","last_became_active":"2024-04-25T22:44:39.116562+0000","last_became_peered":"2024-04-25T22:44:39.116562+0000","last_unstale":"2024-04-25T22:44:52.079085+0000","last_undegraded":"2024-04-25T22:44:52.079085+0000","last_fullsized":"2024-04-25T22:44:52.079085+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:09.750726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18745,"num_write":376,"num_write_kb":96145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'71","reported_seq":267,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.082688+0000","last_change":"2024-04-25T22:44:26.363329+0000","last_active":"2024-04-25T22:44:52.082688+0000","last_peered":"2024-04-25T22:44:52.082688+0000","last_clean":"2024-04-25T22:44:52.082688+0000","last_became_active":"2024-04-25T22:44:26.362499+0000","last_became_peered":"2024-04-25T22:44:26.362499+0000","last_unstale":"2024-04-25T22:44:52.082688+0000","last_undegraded":"2024-04-25T22:44:52.082688+0000","last_fullsized":"2024-04-25T22:44:52.082688+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'145","reported_seq":348,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.085247+0000","last_change":"2024-04-25T22:44:29.400540+0000","last_active":"2024-04-25T22:44:52.085247+0000","last_peered":"2024-04-25T22:44:52.085247+0000","last_clean":"2024-04-25T22:44:52.085247+0000","last_became_active":"2024-04-25T22:44:29.399853+0000","last_became_peered":"2024-04-25T22:44:29.399853+0000","last_unstale":"2024-04-25T22:44:52.085247+0000","last_undegraded":"2024-04-25T22:44:52.085247+0000","last_fullsized":"2024-04-25T22:44:52.085247+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"72'399","reported_seq":595,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376145+0000","last_change":"2024-04-25T22:44:46.398600+0000","last_active":"2024-04-25T22:44:54.376145+0000","last_peered":"2024-04-25T22:44:54.376145+0000","last_clean":"2024-04-25T22:44:54.376145+0000","last_became_active":"2024-04-25T22:44:46.392604+0000","last_became_peered":"2024-04-25T22:44:46.392604+0000","last_unstale":"2024-04-25T22:44:54.376145+0000","last_undegraded":"2024-04-25T22:44:54.376145+0000","last_fullsized":"2024-04-25T22:44:54.376145+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:15.771324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25159,"num_write":363,"num_write_kb":34063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"71'226","reported_seq":422,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377452+0000","last_change":"2024-04-25T22:44:41.417859+0000","last_active":"2024-04-25T22:44:54.377452+0000","last_peered":"2024-04-25T22:44:54.377452+0000","last_clean":"2024-04-25T22:44:54.377452+0000","last_became_active":"2024-04-25T22:44:41.416542+0000","last_became_peered":"2024-04-25T22:44:41.416542+0000","last_unstale":"2024-04-25T22:44:54.377452+0000","last_undegraded":"2024-04-25T22:44:54.377452+0000","last_fullsized":"2024-04-25T22:44:54.377452+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:27.884903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"72'431","reported_seq":625,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.078000+0000","last_change":"2024-04-25T22:44:41.136042+0000","last_active":"2024-04-25T22:44:52.078000+0000","last_peered":"2024-04-25T22:44:52.078000+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130862+0000","last_became_peered":"2024-04-25T22:44:41.130862+0000","last_unstale":"2024-04-25T22:44:52.078000+0000","last_undegraded":"2024-04-25T22:44:41.117168+0000","last_fullsized":"2024-04-25T22:44:41.116538+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14688,"num_write":405,"num_write_kb":38957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"71'382","reported_seq":585,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.084709+0000","last_change":"2024-04-25T22:44:30.401893+0000","last_active":"2024-04-25T22:44:52.084709+0000","last_peered":"2024-04-25T22:44:52.084709+0000","last_clean":"2024-04-25T22:44:52.084709+0000","last_became_active":"2024-04-25T22:44:30.401021+0000","last_became_peered":"2024-04-25T22:44:30.401021+0000","last_unstale":"2024-04-25T22:44:52.084709+0000","last_undegraded":"2024-04-25T22:44:52.084709+0000","last_fullsized":"2024-04-25T22:44:52.084709+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:38.452482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'453","reported_seq":671,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083056+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:44:52.083056+0000","last_peered":"2024-04-25T22:44:52.083056+0000","last_clean":"2024-04-25T22:44:52.083056+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:44:52.083056+0000","last_undegraded":"2024-04-25T22:44:52.083056+0000","last_fullsized":"2024-04-25T22:44:52.083056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18900,"num_write":418,"num_write_kb":117500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"71'64","reported_seq":253,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.084029+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:44:52.084029+0000","last_peered":"2024-04-25T22:44:52.084029+0000","last_clean":"2024-04-25T22:44:52.084029+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:44:52.084029+0000","last_undegraded":"2024-04-25T22:44:52.084029+0000","last_fullsized":"2024-04-25T22:44:52.084029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'428","reported_seq":617,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079015+0000","last_change":"2024-04-25T22:44:39.129871+0000","last_active":"2024-04-25T22:44:52.079015+0000","last_peered":"2024-04-25T22:44:52.079015+0000","last_clean":"2024-04-25T22:44:52.079015+0000","last_became_active":"2024-04-25T22:44:39.121205+0000","last_became_peered":"2024-04-25T22:44:39.121205+0000","last_unstale":"2024-04-25T22:44:52.079015+0000","last_undegraded":"2024-04-25T22:44:52.079015+0000","last_fullsized":"2024-04-25T22:44:52.079015+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:48.521828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7477,"num_write":383,"num_write_kb":9617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'166","reported_seq":308,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079565+0000","last_change":"2024-04-25T22:44:39.133550+0000","last_active":"2024-04-25T22:44:52.079565+0000","last_peered":"2024-04-25T22:44:52.079565+0000","last_clean":"2024-04-25T22:44:52.079565+0000","last_became_active":"2024-04-25T22:44:39.131489+0000","last_became_peered":"2024-04-25T22:44:39.131489+0000","last_unstale":"2024-04-25T22:44:52.079565+0000","last_undegraded":"2024-04-25T22:44:52.079565+0000","last_fullsized":"2024-04-25T22:44:52.079565+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:32.980801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"72'446","reported_seq":682,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083642+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:44:52.083642+0000","last_peered":"2024-04-25T22:44:52.083642+0000","last_clean":"2024-04-25T22:44:52.083642+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:44:52.083642+0000","last_undegraded":"2024-04-25T22:44:52.083642+0000","last_fullsized":"2024-04-25T22:44:52.083642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27788,"num_write":414,"num_write_kb":47058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"71'113","reported_seq":302,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083648+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:44:52.083648+0000","last_peered":"2024-04-25T22:44:52.083648+0000","last_clean":"2024-04-25T22:44:52.083648+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:44:52.083648+0000","last_undegraded":"2024-04-25T22:44:52.083648+0000","last_fullsized":"2024-04-25T22:44:52.083648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"72'417","reported_seq":1005,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.084551+0000","last_change":"2024-04-25T22:44:44.113498+0000","last_active":"2024-04-25T22:44:52.084551+0000","last_peered":"2024-04-25T22:44:52.084551+0000","last_clean":"2024-04-25T22:44:52.084551+0000","last_became_active":"2024-04-25T22:44:44.108084+0000","last_became_peered":"2024-04-25T22:44:44.108084+0000","last_unstale":"2024-04-25T22:44:52.084551+0000","last_undegraded":"2024-04-25T22:44:52.084551+0000","last_fullsized":"2024-04-25T22:44:52.084551+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16487,"num_write":388,"num_write_kb":75452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'59","reported_seq":79,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375230+0000","last_change":"2024-04-25T22:44:41.417821+0000","last_active":"2024-04-25T22:44:54.375230+0000","last_peered":"2024-04-25T22:44:54.375230+0000","last_clean":"2024-04-25T22:44:54.375230+0000","last_became_active":"2024-04-25T22:44:41.415769+0000","last_became_peered":"2024-04-25T22:44:41.415769+0000","last_unstale":"2024-04-25T22:44:54.375230+0000","last_undegraded":"2024-04-25T22:44:54.375230+0000","last_fullsized":"2024-04-25T22:44:54.375230+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.099475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'358","reported_seq":886,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.084449+0000","last_change":"2024-04-25T22:44:34.101942+0000","last_active":"2024-04-25T22:44:52.084449+0000","last_peered":"2024-04-25T22:44:52.084449+0000","last_clean":"2024-04-25T22:44:52.084449+0000","last_became_active":"2024-04-25T22:44:34.099595+0000","last_became_peered":"2024-04-25T22:44:34.099595+0000","last_unstale":"2024-04-25T22:44:52.084449+0000","last_undegraded":"2024-04-25T22:44:52.084449+0000","last_fullsized":"2024-04-25T22:44:52.084449+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:06.523166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12259,"num_write":325,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'465","reported_seq":624,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375647+0000","last_change":"2024-04-25T22:44:41.425331+0000","last_active":"2024-04-25T22:44:54.375647+0000","last_peered":"2024-04-25T22:44:54.375647+0000","last_clean":"2024-04-25T22:44:54.375647+0000","last_became_active":"2024-04-25T22:44:41.423799+0000","last_became_peered":"2024-04-25T22:44:41.423799+0000","last_unstale":"2024-04-25T22:44:54.375647+0000","last_undegraded":"2024-04-25T22:44:54.375647+0000","last_fullsized":"2024-04-25T22:44:54.375647+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:04.324825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"72'386","reported_seq":941,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079145+0000","last_change":"2024-04-25T22:44:46.113269+0000","last_active":"2024-04-25T22:44:52.079145+0000","last_peered":"2024-04-25T22:44:52.079145+0000","last_clean":"2024-04-25T22:44:52.079145+0000","last_became_active":"2024-04-25T22:44:46.110394+0000","last_became_peered":"2024-04-25T22:44:46.110394+0000","last_unstale":"2024-04-25T22:44:52.079145+0000","last_undegraded":"2024-04-25T22:44:52.079145+0000","last_fullsized":"2024-04-25T22:44:52.079145+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9402,"num_write":352,"num_write_kb":50548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":404,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083013+0000","last_change":"2024-04-25T22:44:26.355770+0000","last_active":"2024-04-25T22:44:52.083013+0000","last_peered":"2024-04-25T22:44:52.083013+0000","last_clean":"2024-04-25T22:44:52.083013+0000","last_became_active":"2024-04-25T22:44:26.354730+0000","last_became_peered":"2024-04-25T22:44:26.354730+0000","last_unstale":"2024-04-25T22:44:52.083013+0000","last_undegraded":"2024-04-25T22:44:52.083013+0000","last_fullsized":"2024-04-25T22:44:52.083013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:34.987031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":195,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083862+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:44:52.083862+0000","last_peered":"2024-04-25T22:44:52.083862+0000","last_clean":"2024-04-25T22:44:52.083862+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:44:52.083862+0000","last_undegraded":"2024-04-25T22:44:52.083862+0000","last_fullsized":"2024-04-25T22:44:52.083862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"71'457","reported_seq":662,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079295+0000","last_change":"2024-04-25T22:44:29.399148+0000","last_active":"2024-04-25T22:44:52.079295+0000","last_peered":"2024-04-25T22:44:52.079295+0000","last_clean":"2024-04-25T22:44:52.079295+0000","last_became_active":"2024-04-25T22:44:29.397962+0000","last_became_peered":"2024-04-25T22:44:29.397962+0000","last_unstale":"2024-04-25T22:44:52.079295+0000","last_undegraded":"2024-04-25T22:44:52.079295+0000","last_fullsized":"2024-04-25T22:44:52.079295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:14.015619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"72'447","reported_seq":1097,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.084598+0000","last_change":"2024-04-25T22:44:43.108262+0000","last_active":"2024-04-25T22:44:52.084598+0000","last_peered":"2024-04-25T22:44:52.084598+0000","last_clean":"2024-04-25T22:44:52.084598+0000","last_became_active":"2024-04-25T22:44:43.105231+0000","last_became_peered":"2024-04-25T22:44:43.105231+0000","last_unstale":"2024-04-25T22:44:52.084598+0000","last_undegraded":"2024-04-25T22:44:52.084598+0000","last_fullsized":"2024-04-25T22:44:52.084598+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:09.728618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45074,"num_write":414,"num_write_kb":120596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":202,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.082886+0000","last_change":"2024-04-25T22:44:26.355238+0000","last_active":"2024-04-25T22:44:52.082886+0000","last_peered":"2024-04-25T22:44:52.082886+0000","last_clean":"2024-04-25T22:44:52.082886+0000","last_became_active":"2024-04-25T22:44:26.354482+0000","last_became_peered":"2024-04-25T22:44:26.354482+0000","last_unstale":"2024-04-25T22:44:52.082886+0000","last_undegraded":"2024-04-25T22:44:52.082886+0000","last_fullsized":"2024-04-25T22:44:52.082886+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.042514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'122","reported_seq":326,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.078427+0000","last_change":"2024-04-25T22:44:39.141843+0000","last_active":"2024-04-25T22:44:52.078427+0000","last_peered":"2024-04-25T22:44:52.078427+0000","last_clean":"2024-04-25T22:44:52.078427+0000","last_became_active":"2024-04-25T22:44:39.139689+0000","last_became_peered":"2024-04-25T22:44:39.139689+0000","last_unstale":"2024-04-25T22:44:52.078427+0000","last_undegraded":"2024-04-25T22:44:52.078427+0000","last_fullsized":"2024-04-25T22:44:52.078427+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:18.614670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":62,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"72'449","reported_seq":642,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.378064+0000","last_change":"2024-04-25T22:44:41.439044+0000","last_active":"2024-04-25T22:44:54.378064+0000","last_peered":"2024-04-25T22:44:54.378064+0000","last_clean":"2024-04-25T22:44:54.378064+0000","last_became_active":"2024-04-25T22:44:41.432785+0000","last_became_peered":"2024-04-25T22:44:41.432785+0000","last_unstale":"2024-04-25T22:44:54.378064+0000","last_undegraded":"2024-04-25T22:44:54.378064+0000","last_fullsized":"2024-04-25T22:44:54.378064+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:57.171725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25191,"num_write":420,"num_write_kb":79855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":203,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.078717+0000","last_change":"2024-04-25T22:44:26.363464+0000","last_active":"2024-04-25T22:44:52.078717+0000","last_peered":"2024-04-25T22:44:52.078717+0000","last_clean":"2024-04-25T22:44:52.078717+0000","last_became_active":"2024-04-25T22:44:26.362808+0000","last_became_peered":"2024-04-25T22:44:26.362808+0000","last_unstale":"2024-04-25T22:44:52.078717+0000","last_undegraded":"2024-04-25T22:44:52.078717+0000","last_fullsized":"2024-04-25T22:44:52.078717+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:06.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'435","reported_seq":620,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375077+0000","last_change":"2024-04-25T22:44:41.417191+0000","last_active":"2024-04-25T22:44:54.375077+0000","last_peered":"2024-04-25T22:44:54.375077+0000","last_clean":"2024-04-25T22:44:54.375077+0000","last_became_active":"2024-04-25T22:44:41.415592+0000","last_became_peered":"2024-04-25T22:44:41.415592+0000","last_unstale":"2024-04-25T22:44:54.375077+0000","last_undegraded":"2024-04-25T22:44:54.375077+0000","last_fullsized":"2024-04-25T22:44:54.375077+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:35.916512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"72'337","reported_seq":874,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079432+0000","last_change":"2024-04-25T22:44:45.113523+0000","last_active":"2024-04-25T22:44:52.079432+0000","last_peered":"2024-04-25T22:44:52.079432+0000","last_clean":"2024-04-25T22:44:52.079432+0000","last_became_active":"2024-04-25T22:44:45.111011+0000","last_became_peered":"2024-04-25T22:44:45.111011+0000","last_unstale":"2024-04-25T22:44:52.079432+0000","last_undegraded":"2024-04-25T22:44:52.079432+0000","last_fullsized":"2024-04-25T22:44:52.079432+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25242,"num_write":307,"num_write_kb":26250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":195,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083727+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:44:52.083727+0000","last_peered":"2024-04-25T22:44:52.083727+0000","last_clean":"2024-04-25T22:44:52.083727+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:44:52.083727+0000","last_undegraded":"2024-04-25T22:44:52.083727+0000","last_fullsized":"2024-04-25T22:44:52.083727+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"71'61","reported_seq":250,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.084036+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:44:52.084036+0000","last_peered":"2024-04-25T22:44:52.084036+0000","last_clean":"2024-04-25T22:44:52.084036+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:44:52.084036+0000","last_undegraded":"2024-04-25T22:44:52.084036+0000","last_fullsized":"2024-04-25T22:44:52.084036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'404","reported_seq":1002,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.080780+0000","last_change":"2024-04-25T22:44:32.092728+0000","last_active":"2024-04-25T22:44:52.080780+0000","last_peered":"2024-04-25T22:44:52.080780+0000","last_clean":"2024-04-25T22:44:52.080780+0000","last_became_active":"2024-04-25T22:44:32.087528+0000","last_became_peered":"2024-04-25T22:44:32.087528+0000","last_unstale":"2024-04-25T22:44:52.080780+0000","last_undegraded":"2024-04-25T22:44:52.080780+0000","last_fullsized":"2024-04-25T22:44:52.080780+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:39.481467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":20287,"num_write":371,"num_write_kb":59919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'285","reported_seq":474,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.084764+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:44:52.084764+0000","last_peered":"2024-04-25T22:44:52.084764+0000","last_clean":"2024-04-25T22:44:52.084764+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:44:52.084764+0000","last_undegraded":"2024-04-25T22:44:52.084764+0000","last_fullsized":"2024-04-25T22:44:52.084764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":203,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.081506+0000","last_change":"2024-04-25T22:44:26.364185+0000","last_active":"2024-04-25T22:44:52.081506+0000","last_peered":"2024-04-25T22:44:52.081506+0000","last_clean":"2024-04-25T22:44:52.081506+0000","last_became_active":"2024-04-25T22:44:26.363583+0000","last_became_peered":"2024-04-25T22:44:26.363583+0000","last_unstale":"2024-04-25T22:44:52.081506+0000","last_undegraded":"2024-04-25T22:44:52.081506+0000","last_fullsized":"2024-04-25T22:44:52.081506+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:35:04.325449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"72'366","reported_seq":512,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376225+0000","last_change":"2024-04-25T22:44:52.381174+0000","last_active":"2024-04-25T22:44:54.376225+0000","last_peered":"2024-04-25T22:44:54.376225+0000","last_clean":"2024-04-25T22:44:54.376225+0000","last_became_active":"2024-04-25T22:44:52.375504+0000","last_became_peered":"2024-04-25T22:44:52.375504+0000","last_unstale":"2024-04-25T22:44:54.376225+0000","last_undegraded":"2024-04-25T22:44:54.376225+0000","last_fullsized":"2024-04-25T22:44:54.376225+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:41.592790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":346,"num_write":330,"num_write_kb":33934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":251,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.081485+0000","last_change":"2024-04-25T22:44:26.364178+0000","last_active":"2024-04-25T22:44:52.081485+0000","last_peered":"2024-04-25T22:44:52.081485+0000","last_clean":"2024-04-25T22:44:52.081485+0000","last_became_active":"2024-04-25T22:44:26.363455+0000","last_became_peered":"2024-04-25T22:44:26.363455+0000","last_unstale":"2024-04-25T22:44:52.081485+0000","last_undegraded":"2024-04-25T22:44:52.081485+0000","last_fullsized":"2024-04-25T22:44:52.081485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:58.181763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.378144+0000","last_change":"2024-04-25T22:44:41.423030+0000","last_active":"2024-04-25T22:44:54.378144+0000","last_peered":"2024-04-25T22:44:54.378144+0000","last_clean":"2024-04-25T22:44:54.378144+0000","last_became_active":"2024-04-25T22:44:41.421194+0000","last_became_peered":"2024-04-25T22:44:41.421194+0000","last_unstale":"2024-04-25T22:44:54.378144+0000","last_undegraded":"2024-04-25T22:44:54.378144+0000","last_fullsized":"2024-04-25T22:44:54.378144+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:59.297537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'413","reported_seq":617,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376317+0000","last_change":"2024-04-25T22:44:48.378474+0000","last_active":"2024-04-25T22:44:54.376317+0000","last_peered":"2024-04-25T22:44:54.376317+0000","last_clean":"2024-04-25T22:44:54.376317+0000","last_became_active":"2024-04-25T22:44:48.372485+0000","last_became_peered":"2024-04-25T22:44:48.372485+0000","last_unstale":"2024-04-25T22:44:54.376317+0000","last_undegraded":"2024-04-25T22:44:54.376317+0000","last_fullsized":"2024-04-25T22:44:54.376317+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:47.402437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22994,"num_write":377,"num_write_kb":63140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'57","reported_seq":255,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.080664+0000","last_change":"2024-04-25T22:44:26.366189+0000","last_active":"2024-04-25T22:44:52.080664+0000","last_peered":"2024-04-25T22:44:52.080664+0000","last_clean":"2024-04-25T22:44:52.080664+0000","last_became_active":"2024-04-25T22:44:26.365267+0000","last_became_peered":"2024-04-25T22:44:26.365267+0000","last_unstale":"2024-04-25T22:44:52.080664+0000","last_undegraded":"2024-04-25T22:44:52.080664+0000","last_fullsized":"2024-04-25T22:44:52.080664+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:54.128937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":203,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.080837+0000","last_change":"2024-04-25T22:44:26.361633+0000","last_active":"2024-04-25T22:44:52.080837+0000","last_peered":"2024-04-25T22:44:52.080837+0000","last_clean":"2024-04-25T22:44:52.080837+0000","last_became_active":"2024-04-25T22:44:26.360968+0000","last_became_peered":"2024-04-25T22:44:26.360968+0000","last_unstale":"2024-04-25T22:44:52.080837+0000","last_undegraded":"2024-04-25T22:44:52.080837+0000","last_fullsized":"2024-04-25T22:44:52.080837+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:40.454898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'398","reported_seq":585,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.078555+0000","last_change":"2024-04-25T22:44:39.132801+0000","last_active":"2024-04-25T22:44:52.078555+0000","last_peered":"2024-04-25T22:44:52.078555+0000","last_clean":"2024-04-25T22:44:52.078555+0000","last_became_active":"2024-04-25T22:44:39.124378+0000","last_became_peered":"2024-04-25T22:44:39.124378+0000","last_unstale":"2024-04-25T22:44:52.078555+0000","last_undegraded":"2024-04-25T22:44:52.078555+0000","last_fullsized":"2024-04-25T22:44:52.078555+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:29.195889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6306,"num_write":372,"num_write_kb":34077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'100","reported_seq":292,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.080456+0000","last_change":"2024-04-25T22:44:39.150245+0000","last_active":"2024-04-25T22:44:52.080456+0000","last_peered":"2024-04-25T22:44:52.080456+0000","last_clean":"2024-04-25T22:44:52.080456+0000","last_became_active":"2024-04-25T22:44:39.147377+0000","last_became_peered":"2024-04-25T22:44:39.147377+0000","last_unstale":"2024-04-25T22:44:52.080456+0000","last_undegraded":"2024-04-25T22:44:52.080456+0000","last_fullsized":"2024-04-25T22:44:52.080456+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:36.007978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":202,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.085406+0000","last_change":"2024-04-25T22:44:26.360890+0000","last_active":"2024-04-25T22:44:52.085406+0000","last_peered":"2024-04-25T22:44:52.085406+0000","last_clean":"2024-04-25T22:44:52.085406+0000","last_became_active":"2024-04-25T22:44:26.360106+0000","last_became_peered":"2024-04-25T22:44:26.360106+0000","last_unstale":"2024-04-25T22:44:52.085406+0000","last_undegraded":"2024-04-25T22:44:52.085406+0000","last_fullsized":"2024-04-25T22:44:52.085406+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:09.929196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'390","reported_seq":611,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375973+0000","last_change":"2024-04-25T22:44:41.433574+0000","last_active":"2024-04-25T22:44:54.375973+0000","last_peered":"2024-04-25T22:44:54.375973+0000","last_clean":"2024-04-25T22:44:54.375973+0000","last_became_active":"2024-04-25T22:44:41.414924+0000","last_became_peered":"2024-04-25T22:44:41.414924+0000","last_unstale":"2024-04-25T22:44:54.375973+0000","last_undegraded":"2024-04-25T22:44:54.375973+0000","last_fullsized":"2024-04-25T22:44:54.375973+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:46.695300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":22915,"num_write":352,"num_write_kb":47201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"72'411","reported_seq":993,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.082992+0000","last_change":"2024-04-25T22:44:32.090492+0000","last_active":"2024-04-25T22:44:52.082992+0000","last_peered":"2024-04-25T22:44:52.082992+0000","last_clean":"2024-04-25T22:44:52.082992+0000","last_became_active":"2024-04-25T22:44:32.087303+0000","last_became_peered":"2024-04-25T22:44:32.087303+0000","last_unstale":"2024-04-25T22:44:52.082992+0000","last_undegraded":"2024-04-25T22:44:52.082992+0000","last_fullsized":"2024-04-25T22:44:52.082992+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25412,"num_write":367,"num_write_kb":64656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'268","reported_seq":474,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083938+0000","last_change":"2024-04-25T22:44:29.399184+0000","last_active":"2024-04-25T22:44:52.083938+0000","last_peered":"2024-04-25T22:44:52.083938+0000","last_clean":"2024-04-25T22:44:52.083938+0000","last_became_active":"2024-04-25T22:44:29.398317+0000","last_became_peered":"2024-04-25T22:44:29.398317+0000","last_unstale":"2024-04-25T22:44:52.083938+0000","last_undegraded":"2024-04-25T22:44:52.083938+0000","last_fullsized":"2024-04-25T22:44:52.083938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:21.765162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382817,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"72'423","reported_seq":1032,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.077912+0000","last_change":"2024-04-25T22:44:42.092243+0000","last_active":"2024-04-25T22:44:52.077912+0000","last_peered":"2024-04-25T22:44:52.077912+0000","last_clean":"2024-04-25T22:44:52.077912+0000","last_became_active":"2024-04-25T22:44:42.088432+0000","last_became_peered":"2024-04-25T22:44:42.088432+0000","last_unstale":"2024-04-25T22:44:52.077912+0000","last_undegraded":"2024-04-25T22:44:52.077912+0000","last_fullsized":"2024-04-25T22:44:52.077912+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:54.239406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24794,"num_write":386,"num_write_kb":63756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'102","reported_seq":86,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377263+0000","last_change":"2024-04-25T22:44:41.423993+0000","last_active":"2024-04-25T22:44:54.377263+0000","last_peered":"2024-04-25T22:44:54.377263+0000","last_clean":"2024-04-25T22:44:54.377263+0000","last_became_active":"2024-04-25T22:44:41.422237+0000","last_became_peered":"2024-04-25T22:44:41.422237+0000","last_unstale":"2024-04-25T22:44:54.377263+0000","last_undegraded":"2024-04-25T22:44:54.377263+0000","last_fullsized":"2024-04-25T22:44:54.377263+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:02.880774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"71'213","reported_seq":401,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.085074+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:44:52.085074+0000","last_peered":"2024-04-25T22:44:52.085074+0000","last_clean":"2024-04-25T22:44:52.085074+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:44:52.085074+0000","last_undegraded":"2024-04-25T22:44:52.085074+0000","last_fullsized":"2024-04-25T22:44:52.085074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"72'504","reported_seq":754,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.077811+0000","last_change":"2024-04-25T22:44:39.142694+0000","last_active":"2024-04-25T22:44:52.077811+0000","last_peered":"2024-04-25T22:44:52.077811+0000","last_clean":"2024-04-25T22:44:52.077811+0000","last_became_active":"2024-04-25T22:44:39.132582+0000","last_became_peered":"2024-04-25T22:44:39.132582+0000","last_unstale":"2024-04-25T22:44:52.077811+0000","last_undegraded":"2024-04-25T22:44:52.077811+0000","last_fullsized":"2024-04-25T22:44:52.077811+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:14.401644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":46975,"num_write":471,"num_write_kb":146290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'64","reported_seq":205,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.080220+0000","last_change":"2024-04-25T22:44:39.136961+0000","last_active":"2024-04-25T22:44:52.080220+0000","last_peered":"2024-04-25T22:44:52.080220+0000","last_clean":"2024-04-25T22:44:52.080220+0000","last_became_active":"2024-04-25T22:44:39.136090+0000","last_became_peered":"2024-04-25T22:44:39.136090+0000","last_unstale":"2024-04-25T22:44:52.080220+0000","last_undegraded":"2024-04-25T22:44:52.080220+0000","last_fullsized":"2024-04-25T22:44:52.080220+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:35.220314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"72'475","reported_seq":1139,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.077958+0000","last_change":"2024-04-25T22:44:44.106484+0000","last_active":"2024-04-25T22:44:52.077958+0000","last_peered":"2024-04-25T22:44:52.077958+0000","last_clean":"2024-04-25T22:44:52.077958+0000","last_became_active":"2024-04-25T22:44:44.102061+0000","last_became_peered":"2024-04-25T22:44:44.102061+0000","last_unstale":"2024-04-25T22:44:52.077958+0000","last_undegraded":"2024-04-25T22:44:52.077958+0000","last_fullsized":"2024-04-25T22:44:52.077958+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:05.455255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":23011,"num_write":448,"num_write_kb":76439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"72'370","reported_seq":614,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.085079+0000","last_change":"2024-04-25T22:44:41.149278+0000","last_active":"2024-04-25T22:44:52.085079+0000","last_peered":"2024-04-25T22:44:52.085079+0000","last_clean":"2024-04-25T22:41:34.256787+0000","last_became_active":"2024-04-25T22:44:41.144535+0000","last_became_peered":"2024-04-25T22:44:41.144535+0000","last_unstale":"2024-04-25T22:44:52.085079+0000","last_undegraded":"2024-04-25T22:44:41.120919+0000","last_fullsized":"2024-04-25T22:44:41.120194+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":159,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33211,"num_write":340,"num_write_kb":63312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'647","reported_seq":851,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.078361+0000","last_change":"2024-04-25T22:44:30.396965+0000","last_active":"2024-04-25T22:44:52.078361+0000","last_peered":"2024-04-25T22:44:52.078361+0000","last_clean":"2024-04-25T22:44:52.078361+0000","last_became_active":"2024-04-25T22:44:30.396073+0000","last_became_peered":"2024-04-25T22:44:30.396073+0000","last_unstale":"2024-04-25T22:44:52.078361+0000","last_undegraded":"2024-04-25T22:44:52.078361+0000","last_fullsized":"2024-04-25T22:44:52.078361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"72'415","reported_seq":622,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079625+0000","last_change":"2024-04-25T22:44:39.150290+0000","last_active":"2024-04-25T22:44:52.079625+0000","last_peered":"2024-04-25T22:44:52.079625+0000","last_clean":"2024-04-25T22:44:52.079625+0000","last_became_active":"2024-04-25T22:44:39.146949+0000","last_became_peered":"2024-04-25T22:44:39.146949+0000","last_unstale":"2024-04-25T22:44:52.079625+0000","last_undegraded":"2024-04-25T22:44:52.079625+0000","last_fullsized":"2024-04-25T22:44:52.079625+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:11.804350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19493,"num_write":386,"num_write_kb":64692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'207","reported_seq":348,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.078113+0000","last_change":"2024-04-25T22:44:39.141125+0000","last_active":"2024-04-25T22:44:52.078113+0000","last_peered":"2024-04-25T22:44:52.078113+0000","last_clean":"2024-04-25T22:44:52.078113+0000","last_became_active":"2024-04-25T22:44:39.138371+0000","last_became_peered":"2024-04-25T22:44:39.138371+0000","last_unstale":"2024-04-25T22:44:52.078113+0000","last_undegraded":"2024-04-25T22:44:52.078113+0000","last_fullsized":"2024-04-25T22:44:52.078113+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:14.147026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"72'395","reported_seq":546,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-25T22:44:53.510934+0000","last_change":"2024-04-25T22:44:54.660910+0000","last_active":"2024-04-25T22:44:54.660910+0000","last_peered":"2024-04-25T22:44:53.510934+0000","last_clean":"2024-04-25T22:41:34.256072+0000","last_became_active":"2024-04-25T22:44:41.144491+0000","last_became_peered":"2024-04-25T22:44:41.144491+0000","last_unstale":"2024-04-25T22:44:53.510934+0000","last_undegraded":"2024-04-25T22:44:53.510934+0000","last_fullsized":"2024-04-25T22:44:41.118876+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9576,"num_write":348,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'194","reported_seq":353,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375784+0000","last_change":"2024-04-25T22:44:41.422369+0000","last_active":"2024-04-25T22:44:54.375784+0000","last_peered":"2024-04-25T22:44:54.375784+0000","last_clean":"2024-04-25T22:44:54.375784+0000","last_became_active":"2024-04-25T22:44:41.420491+0000","last_became_peered":"2024-04-25T22:44:41.420491+0000","last_unstale":"2024-04-25T22:44:54.375784+0000","last_undegraded":"2024-04-25T22:44:54.375784+0000","last_fullsized":"2024-04-25T22:44:54.375784+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:35.081225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360511,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":12143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12360511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"72'398","reported_seq":583,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.378098+0000","last_change":"2024-04-25T22:44:52.381363+0000","last_active":"2024-04-25T22:44:54.378098+0000","last_peered":"2024-04-25T22:44:54.378098+0000","last_clean":"2024-04-25T22:44:54.378098+0000","last_became_active":"2024-04-25T22:44:52.375632+0000","last_became_peered":"2024-04-25T22:44:52.375632+0000","last_unstale":"2024-04-25T22:44:54.378098+0000","last_undegraded":"2024-04-25T22:44:54.378098+0000","last_fullsized":"2024-04-25T22:44:54.378098+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:38:28.441621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31284,"num_write":371,"num_write_kb":80144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"71'51","reported_seq":84,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375713+0000","last_change":"2024-04-25T22:44:41.415722+0000","last_active":"2024-04-25T22:44:54.375713+0000","last_peered":"2024-04-25T22:44:54.375713+0000","last_clean":"2024-04-25T22:44:54.375713+0000","last_became_active":"2024-04-25T22:44:41.414774+0000","last_became_peered":"2024-04-25T22:44:41.414774+0000","last_unstale":"2024-04-25T22:44:54.375713+0000","last_undegraded":"2024-04-25T22:44:54.375713+0000","last_fullsized":"2024-04-25T22:44:54.375713+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:20.553373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"72'383","reported_seq":621,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.082769+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:44:52.082769+0000","last_peered":"2024-04-25T22:44:52.082769+0000","last_clean":"2024-04-25T22:44:52.082769+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:44:52.082769+0000","last_undegraded":"2024-04-25T22:44:52.082769+0000","last_fullsized":"2024-04-25T22:44:52.082769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29308,"num_write":358,"num_write_kb":66975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"71'177","reported_seq":365,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083738+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:44:52.083738+0000","last_peered":"2024-04-25T22:44:52.083738+0000","last_clean":"2024-04-25T22:44:52.083738+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:44:52.083738+0000","last_undegraded":"2024-04-25T22:44:52.083738+0000","last_fullsized":"2024-04-25T22:44:52.083738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"72'387","reported_seq":586,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083231+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:44:52.083231+0000","last_peered":"2024-04-25T22:44:52.083231+0000","last_clean":"2024-04-25T22:44:52.083231+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:44:52.083231+0000","last_undegraded":"2024-04-25T22:44:52.083231+0000","last_fullsized":"2024-04-25T22:44:52.083231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3883,"num_write":348,"num_write_kb":34122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'209","reported_seq":403,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376952+0000","last_change":"2024-04-25T22:44:41.419972+0000","last_active":"2024-04-25T22:44:54.376952+0000","last_peered":"2024-04-25T22:44:54.376952+0000","last_clean":"2024-04-25T22:44:54.376952+0000","last_became_active":"2024-04-25T22:44:41.418106+0000","last_became_peered":"2024-04-25T22:44:41.418106+0000","last_unstale":"2024-04-25T22:44:54.376952+0000","last_undegraded":"2024-04-25T22:44:54.376952+0000","last_fullsized":"2024-04-25T22:44:54.376952+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:07.628155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":12363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"72'419","reported_seq":597,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375672+0000","last_change":"2024-04-25T22:44:41.434376+0000","last_active":"2024-04-25T22:44:54.375672+0000","last_peered":"2024-04-25T22:44:54.375672+0000","last_clean":"2024-04-25T22:44:54.375672+0000","last_became_active":"2024-04-25T22:44:41.420505+0000","last_became_peered":"2024-04-25T22:44:41.420505+0000","last_unstale":"2024-04-25T22:44:54.375672+0000","last_undegraded":"2024-04-25T22:44:54.375672+0000","last_fullsized":"2024-04-25T22:44:54.375672+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:04.414563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":13327,"num_write":388,"num_write_kb":55674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"71'131","reported_seq":335,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079898+0000","last_change":"2024-04-25T22:44:29.398880+0000","last_active":"2024-04-25T22:44:52.079898+0000","last_peered":"2024-04-25T22:44:52.079898+0000","last_clean":"2024-04-25T22:44:52.079898+0000","last_became_active":"2024-04-25T22:44:29.397905+0000","last_became_peered":"2024-04-25T22:44:29.397905+0000","last_unstale":"2024-04-25T22:44:52.079898+0000","last_undegraded":"2024-04-25T22:44:52.079898+0000","last_fullsized":"2024-04-25T22:44:52.079898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:44.236330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"72'449","reported_seq":669,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.082599+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:44:52.082599+0000","last_peered":"2024-04-25T22:44:52.082599+0000","last_clean":"2024-04-25T22:44:52.082599+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:44:52.082599+0000","last_undegraded":"2024-04-25T22:44:52.082599+0000","last_fullsized":"2024-04-25T22:44:52.082599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14222,"num_write":424,"num_write_kb":79796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"71'57","reported_seq":199,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079483+0000","last_change":"2024-04-25T22:44:39.137232+0000","last_active":"2024-04-25T22:44:52.079483+0000","last_peered":"2024-04-25T22:44:52.079483+0000","last_clean":"2024-04-25T22:44:52.079483+0000","last_became_active":"2024-04-25T22:44:39.136283+0000","last_became_peered":"2024-04-25T22:44:39.136283+0000","last_unstale":"2024-04-25T22:44:52.079483+0000","last_undegraded":"2024-04-25T22:44:52.079483+0000","last_fullsized":"2024-04-25T22:44:52.079483+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:32.428982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1061,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2461,"num_read_kb":1248646,"num_write":24434,"num_write_kb":4137258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6386,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26539,"ondisk_log_size":26539,"up":128,"acting":122,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127071275,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":4473,"num_write_kb":127409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254210048,"data_stored":254142550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},"log_size":6216,"ondisk_log_size":6216,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165268,"kb_used_data":80000,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94206572,"statfs":{"total":96636764160,"available":96467529728,"internally_reserved":0,"allocated":81920000,"data_stored":81382590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":79,"seq":339302416392,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133032,"kb_used_data":83284,"kb_used_omap":5,"kb_used_meta":49722,"kb_avail":94238808,"statfs":{"total":96636764160,"available":96500539392,"internally_reserved":0,"allocated":85282816,"data_stored":84713423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6003,"internal_metadata":50915469},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174276,"kb_used_data":89008,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94197564,"statfs":{"total":96636764160,"available":96458305536,"internally_reserved":0,"allocated":91144192,"data_stored":90584821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89575424,"data_stored":89544940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83689472,"data_stored":83664533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80945152,"data_stored":80933077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:44:55.591 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T22:44:55.994 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:44:55.994 INFO:teuthology.orchestra.run.smithi057.stdout:{"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1910/108 objects degraded (1768.519%), 11 pgs degraded","count":11},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":303,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":109,"num_osds":3,"num_up_osds":3,"osd_up_since":1714085065,"num_in_osds":3,"osd_in_since":1714084793,"num_remapped_pgs":4},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":91},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":11},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"peering","count":1},{"state_name":"active+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":54,"data_bytes":127661643,"bytes_used":473886720,"bytes_avail":289436405760,"bytes_total":289910292480,"inactive_pgs_ratio":0.0095238098874688148,"degraded_objects":1910,"degraded_total":108,"degraded_ratio":17.685185185185187,"recovering_objects_per_sec":234,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":940,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4192}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-25T22:41:21.139402+0000","services":{}},"progress_events":{}} 2024-04-25T22:44:56.012 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-25T22:44:56.012 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:44:56.322 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:44:56.324 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:44:56.341 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-04-25T22:44:56.126700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127661643,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1061,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2659,"num_read_kb":1250233,"num_write":29110,"num_write_kb":4268127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6408,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32912,"ondisk_log_size":32912,"up":210,"acting":204,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":472576,"kb_used_data":252292,"kb_used_omap":8,"kb_used_meta":220215,"kb_avail":282642944,"statfs":{"total":289910292480,"available":289426374656,"internally_reserved":0,"allocated":258347008,"data_stored":256680834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9193,"internal_metadata":225500183},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1250,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1490,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.045962"},"pg_stats":[{"pgid":"4.3f","version":"72'404","reported_seq":609,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.080209+0000","last_change":"2024-04-25T22:44:41.145114+0000","last_active":"2024-04-25T22:44:52.080209+0000","last_peered":"2024-04-25T22:44:52.080209+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.142277+0000","last_became_peered":"2024-04-25T22:44:41.142277+0000","last_unstale":"2024-04-25T22:44:52.080209+0000","last_undegraded":"2024-04-25T22:44:41.121372+0000","last_fullsized":"2024-04-25T22:44:41.120599+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19772,"num_write":366,"num_write_kb":46873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"72'420","reported_seq":612,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377841+0000","last_change":"2024-04-25T22:44:41.434387+0000","last_active":"2024-04-25T22:44:54.377841+0000","last_peered":"2024-04-25T22:44:54.377841+0000","last_clean":"2024-04-25T22:44:54.377841+0000","last_became_active":"2024-04-25T22:44:41.418792+0000","last_became_peered":"2024-04-25T22:44:41.418792+0000","last_unstale":"2024-04-25T22:44:54.377841+0000","last_undegraded":"2024-04-25T22:44:54.377841+0000","last_fullsized":"2024-04-25T22:44:54.377841+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:43.196115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24515,"num_write":386,"num_write_kb":55688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"72'377","reported_seq":938,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083922+0000","last_change":"2024-04-25T22:44:42.096911+0000","last_active":"2024-04-25T22:44:52.083922+0000","last_peered":"2024-04-25T22:44:52.083922+0000","last_clean":"2024-04-25T22:44:52.083922+0000","last_became_active":"2024-04-25T22:44:42.093941+0000","last_became_peered":"2024-04-25T22:44:42.093941+0000","last_unstale":"2024-04-25T22:44:52.083922+0000","last_undegraded":"2024-04-25T22:44:52.083922+0000","last_fullsized":"2024-04-25T22:44:52.083922+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11135,"num_write":346,"num_write_kb":38950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"72'366","reported_seq":559,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083331+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:44:52.083331+0000","last_peered":"2024-04-25T22:44:52.083331+0000","last_clean":"2024-04-25T22:44:52.083331+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:44:52.083331+0000","last_undegraded":"2024-04-25T22:44:52.083331+0000","last_fullsized":"2024-04-25T22:44:52.083331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":326,"num_write_kb":34079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"72'455","reported_seq":625,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375993+0000","last_change":"2024-04-25T22:44:50.391674+0000","last_active":"2024-04-25T22:44:54.375993+0000","last_peered":"2024-04-25T22:44:54.375993+0000","last_clean":"2024-04-25T22:44:54.375993+0000","last_became_active":"2024-04-25T22:44:50.384804+0000","last_became_peered":"2024-04-25T22:44:50.384804+0000","last_unstale":"2024-04-25T22:44:54.375993+0000","last_undegraded":"2024-04-25T22:44:54.375993+0000","last_fullsized":"2024-04-25T22:44:54.375993+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:22:54.239989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33897,"num_write":426,"num_write_kb":100721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"72'401","reported_seq":621,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.082641+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:44:52.082641+0000","last_peered":"2024-04-25T22:44:52.082641+0000","last_clean":"2024-04-25T22:44:52.082641+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:44:52.082641+0000","last_undegraded":"2024-04-25T22:44:52.082641+0000","last_fullsized":"2024-04-25T22:44:52.082641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15258,"num_write":369,"num_write_kb":53298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"72'452","reported_seq":704,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.082300+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:44:52.082300+0000","last_peered":"2024-04-25T22:44:52.082300+0000","last_clean":"2024-04-25T22:44:52.082300+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:44:52.082300+0000","last_undegraded":"2024-04-25T22:44:52.082300+0000","last_fullsized":"2024-04-25T22:44:52.082300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34010,"num_write":428,"num_write_kb":157752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"72'401","reported_seq":626,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.081948+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:44:52.081948+0000","last_peered":"2024-04-25T22:44:52.081948+0000","last_clean":"2024-04-25T22:44:52.081948+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:44:52.081948+0000","last_undegraded":"2024-04-25T22:44:52.081948+0000","last_fullsized":"2024-04-25T22:44:52.081948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19917,"num_write":359,"num_write_kb":109382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"72'394","reported_seq":966,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.078481+0000","last_change":"2024-04-25T22:44:48.092689+0000","last_active":"2024-04-25T22:44:52.078481+0000","last_peered":"2024-04-25T22:44:52.078481+0000","last_clean":"2024-04-25T22:44:52.078481+0000","last_became_active":"2024-04-25T22:44:48.089795+0000","last_became_peered":"2024-04-25T22:44:48.089795+0000","last_unstale":"2024-04-25T22:44:52.078481+0000","last_undegraded":"2024-04-25T22:44:52.078481+0000","last_fullsized":"2024-04-25T22:44:52.078481+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:32:33.072950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9569,"num_write":360,"num_write_kb":25560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"72'382","reported_seq":556,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377780+0000","last_change":"2024-04-25T22:44:41.433644+0000","last_active":"2024-04-25T22:44:54.377780+0000","last_peered":"2024-04-25T22:44:54.377780+0000","last_clean":"2024-04-25T22:44:54.377780+0000","last_became_active":"2024-04-25T22:44:41.421234+0000","last_became_peered":"2024-04-25T22:44:41.421234+0000","last_unstale":"2024-04-25T22:44:54.377780+0000","last_undegraded":"2024-04-25T22:44:54.377780+0000","last_fullsized":"2024-04-25T22:44:54.377780+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:24.217391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17192,"num_write":338,"num_write_kb":38688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"72'369","reported_seq":578,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.084198+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:44:52.084198+0000","last_peered":"2024-04-25T22:44:52.084198+0000","last_clean":"2024-04-25T22:44:52.084198+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:44:52.084198+0000","last_undegraded":"2024-04-25T22:44:52.084198+0000","last_fullsized":"2024-04-25T22:44:52.084198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7385,"num_write":349,"num_write_kb":58842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"72'338","reported_seq":512,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377657+0000","last_change":"2024-04-25T22:44:49.384005+0000","last_active":"2024-04-25T22:44:54.377657+0000","last_peered":"2024-04-25T22:44:54.377657+0000","last_clean":"2024-04-25T22:44:54.377657+0000","last_became_active":"2024-04-25T22:44:49.378325+0000","last_became_peered":"2024-04-25T22:44:49.378325+0000","last_unstale":"2024-04-25T22:44:54.377657+0000","last_undegraded":"2024-04-25T22:44:54.377657+0000","last_fullsized":"2024-04-25T22:44:54.377657+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:18.849786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13619,"num_write":312,"num_write_kb":21391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"72'411","reported_seq":595,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376695+0000","last_change":"2024-04-25T22:44:41.432463+0000","last_active":"2024-04-25T22:44:54.376695+0000","last_peered":"2024-04-25T22:44:54.376695+0000","last_clean":"2024-04-25T22:44:54.376695+0000","last_became_active":"2024-04-25T22:44:41.421096+0000","last_became_peered":"2024-04-25T22:44:41.421096+0000","last_unstale":"2024-04-25T22:44:54.376695+0000","last_undegraded":"2024-04-25T22:44:54.376695+0000","last_fullsized":"2024-04-25T22:44:54.376695+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:46.942677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12998,"num_write":375,"num_write_kb":79661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"72'452","reported_seq":1036,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.082946+0000","last_change":"2024-04-25T22:44:40.130299+0000","last_active":"2024-04-25T22:44:52.082946+0000","last_peered":"2024-04-25T22:44:52.082946+0000","last_clean":"2024-04-25T22:44:52.082946+0000","last_became_active":"2024-04-25T22:44:40.127307+0000","last_became_peered":"2024-04-25T22:44:40.127307+0000","last_unstale":"2024-04-25T22:44:52.082946+0000","last_undegraded":"2024-04-25T22:44:52.082946+0000","last_fullsized":"2024-04-25T22:44:52.082946+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:16.746830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":854,"num_write":419,"num_write_kb":88217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"72'428","reported_seq":1016,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.082413+0000","last_change":"2024-04-25T22:44:35.108361+0000","last_active":"2024-04-25T22:44:52.082413+0000","last_peered":"2024-04-25T22:44:52.082413+0000","last_clean":"2024-04-25T22:44:52.082413+0000","last_became_active":"2024-04-25T22:44:35.103208+0000","last_became_peered":"2024-04-25T22:44:35.103208+0000","last_unstale":"2024-04-25T22:44:52.082413+0000","last_undegraded":"2024-04-25T22:44:52.082413+0000","last_fullsized":"2024-04-25T22:44:52.082413+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:22.046332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21291,"num_write":389,"num_write_kb":68562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"72'401","reported_seq":600,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.081975+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:44:52.081975+0000","last_peered":"2024-04-25T22:44:52.081975+0000","last_clean":"2024-04-25T22:44:52.081975+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:44:52.081975+0000","last_undegraded":"2024-04-25T22:44:52.081975+0000","last_fullsized":"2024-04-25T22:44:52.081975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8276,"num_write":369,"num_write_kb":17867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"72'398","reported_seq":956,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.080496+0000","last_change":"2024-04-25T22:44:49.097340+0000","last_active":"2024-04-25T22:44:52.080496+0000","last_peered":"2024-04-25T22:44:52.080496+0000","last_clean":"2024-04-25T22:44:52.080496+0000","last_became_active":"2024-04-25T22:44:49.094478+0000","last_became_peered":"2024-04-25T22:44:49.094478+0000","last_unstale":"2024-04-25T22:44:52.080496+0000","last_undegraded":"2024-04-25T22:44:52.080496+0000","last_fullsized":"2024-04-25T22:44:52.080496+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:33.421713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5883,"num_write":362,"num_write_kb":38188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"72'407","reported_seq":596,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.079751+0000","last_change":"2024-04-25T22:44:41.159724+0000","last_active":"2024-04-25T22:44:52.079751+0000","last_peered":"2024-04-25T22:44:52.079751+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.154547+0000","last_became_peered":"2024-04-25T22:44:41.154547+0000","last_unstale":"2024-04-25T22:44:52.079751+0000","last_undegraded":"2024-04-25T22:44:41.121499+0000","last_fullsized":"2024-04-25T22:44:41.120885+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13073,"num_write":372,"num_write_kb":59323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"72'441","reported_seq":1045,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079032+0000","last_change":"2024-04-25T22:44:41.148409+0000","last_active":"2024-04-25T22:44:52.079032+0000","last_peered":"2024-04-25T22:44:52.079032+0000","last_clean":"2024-04-25T22:44:52.079032+0000","last_became_active":"2024-04-25T22:44:41.143302+0000","last_became_peered":"2024-04-25T22:44:41.143302+0000","last_unstale":"2024-04-25T22:44:52.079032+0000","last_undegraded":"2024-04-25T22:44:52.079032+0000","last_fullsized":"2024-04-25T22:44:52.079032+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:46.289713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37611,"num_write":403,"num_write_kb":116618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"72'438","reported_seq":650,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083398+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:44:52.083398+0000","last_peered":"2024-04-25T22:44:52.083398+0000","last_clean":"2024-04-25T22:44:52.083398+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:44:52.083398+0000","last_undegraded":"2024-04-25T22:44:52.083398+0000","last_fullsized":"2024-04-25T22:44:52.083398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12393,"num_write":408,"num_write_kb":99933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"72'407","reported_seq":608,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083395+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:44:52.083395+0000","last_peered":"2024-04-25T22:44:52.083395+0000","last_clean":"2024-04-25T22:44:52.083395+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:44:52.083395+0000","last_undegraded":"2024-04-25T22:44:52.083395+0000","last_fullsized":"2024-04-25T22:44:52.083395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8932,"num_write":382,"num_write_kb":59684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"72'463","reported_seq":682,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376349+0000","last_change":"2024-04-25T22:44:47.376009+0000","last_active":"2024-04-25T22:44:54.376349+0000","last_peered":"2024-04-25T22:44:54.376349+0000","last_clean":"2024-04-25T22:44:54.376349+0000","last_became_active":"2024-04-25T22:44:47.369995+0000","last_became_peered":"2024-04-25T22:44:47.369995+0000","last_unstale":"2024-04-25T22:44:54.376349+0000","last_undegraded":"2024-04-25T22:44:54.376349+0000","last_fullsized":"2024-04-25T22:44:54.376349+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:04.129559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27589,"num_write":428,"num_write_kb":76861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"72'425","reported_seq":680,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.077509+0000","last_change":"2024-04-25T22:44:39.132230+0000","last_active":"2024-04-25T22:44:52.077509+0000","last_peered":"2024-04-25T22:44:52.077509+0000","last_clean":"2024-04-25T22:44:52.077509+0000","last_became_active":"2024-04-25T22:44:39.118635+0000","last_became_peered":"2024-04-25T22:44:39.118635+0000","last_unstale":"2024-04-25T22:44:52.077509+0000","last_undegraded":"2024-04-25T22:44:52.077509+0000","last_fullsized":"2024-04-25T22:44:52.077509+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:15.096836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":46424,"num_write":390,"num_write_kb":96359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"72'445","reported_seq":609,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.388681+0000","last_change":"2024-04-25T22:44:54.388681+0000","last_active":"2024-04-25T22:44:54.388681+0000","last_peered":"2024-04-25T22:44:54.388681+0000","last_clean":"2024-04-25T22:44:54.388681+0000","last_became_active":"2024-04-25T22:44:54.382124+0000","last_became_peered":"2024-04-25T22:44:54.382124+0000","last_unstale":"2024-04-25T22:44:54.388681+0000","last_undegraded":"2024-04-25T22:44:54.388681+0000","last_fullsized":"2024-04-25T22:44:54.388681+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:49.633770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32317,"num_write":419,"num_write_kb":76071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"72'424","reported_seq":580,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377796+0000","last_change":"2024-04-25T22:44:51.391125+0000","last_active":"2024-04-25T22:44:54.377796+0000","last_peered":"2024-04-25T22:44:54.377796+0000","last_clean":"2024-04-25T22:44:54.377796+0000","last_became_active":"2024-04-25T22:44:51.383461+0000","last_became_peered":"2024-04-25T22:44:51.383461+0000","last_unstale":"2024-04-25T22:44:54.377796+0000","last_undegraded":"2024-04-25T22:44:54.377796+0000","last_fullsized":"2024-04-25T22:44:54.377796+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:33.717342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8396,"num_write":399,"num_write_kb":50416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"72'499","reported_seq":696,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079463+0000","last_change":"2024-04-25T22:44:39.149280+0000","last_active":"2024-04-25T22:44:52.079463+0000","last_peered":"2024-04-25T22:44:52.079463+0000","last_clean":"2024-04-25T22:44:52.079463+0000","last_became_active":"2024-04-25T22:44:39.143391+0000","last_became_peered":"2024-04-25T22:44:39.143391+0000","last_unstale":"2024-04-25T22:44:52.079463+0000","last_undegraded":"2024-04-25T22:44:52.079463+0000","last_fullsized":"2024-04-25T22:44:52.079463+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:54:10.301144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10227,"num_write":453,"num_write_kb":96585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'430","reported_seq":1068,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.084444+0000","last_change":"2024-04-25T22:44:39.113437+0000","last_active":"2024-04-25T22:44:52.084444+0000","last_peered":"2024-04-25T22:44:52.084444+0000","last_clean":"2024-04-25T22:44:52.084444+0000","last_became_active":"2024-04-25T22:44:39.109771+0000","last_became_peered":"2024-04-25T22:44:39.109771+0000","last_unstale":"2024-04-25T22:44:52.084444+0000","last_undegraded":"2024-04-25T22:44:52.084444+0000","last_fullsized":"2024-04-25T22:44:52.084444+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:40:46.739897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":32116,"num_write":409,"num_write_kb":89217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"72'393","reported_seq":646,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377384+0000","last_change":"2024-04-25T22:44:41.425947+0000","last_active":"2024-04-25T22:44:54.377384+0000","last_peered":"2024-04-25T22:44:54.377384+0000","last_clean":"2024-04-25T22:44:54.377384+0000","last_became_active":"2024-04-25T22:44:41.413570+0000","last_became_peered":"2024-04-25T22:44:41.413570+0000","last_unstale":"2024-04-25T22:44:54.377384+0000","last_undegraded":"2024-04-25T22:44:54.377384+0000","last_fullsized":"2024-04-25T22:44:54.377384+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:39:00.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":28076,"num_write":364,"num_write_kb":47473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"72'399","reported_seq":979,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079651+0000","last_change":"2024-04-25T22:44:40.124745+0000","last_active":"2024-04-25T22:44:52.079651+0000","last_peered":"2024-04-25T22:44:52.079651+0000","last_clean":"2024-04-25T22:44:52.079651+0000","last_became_active":"2024-04-25T22:44:40.121838+0000","last_became_peered":"2024-04-25T22:44:40.121838+0000","last_unstale":"2024-04-25T22:44:52.079651+0000","last_undegraded":"2024-04-25T22:44:52.079651+0000","last_fullsized":"2024-04-25T22:44:52.079651+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:28.299317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14005,"num_write":367,"num_write_kb":58883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"72'484","reported_seq":673,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.394316+0000","last_change":"2024-04-25T22:44:54.392451+0000","last_active":"2024-04-25T22:44:54.394316+0000","last_peered":"2024-04-25T22:44:54.394316+0000","last_clean":"2024-04-25T22:44:54.394316+0000","last_became_active":"2024-04-25T22:44:54.383808+0000","last_became_peered":"2024-04-25T22:44:54.383808+0000","last_unstale":"2024-04-25T22:44:54.394316+0000","last_undegraded":"2024-04-25T22:44:54.394316+0000","last_fullsized":"2024-04-25T22:44:54.394316+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:06.630318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23352,"num_write":446,"num_write_kb":100094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'455","reported_seq":1122,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.077674+0000","last_change":"2024-04-25T22:44:33.087211+0000","last_active":"2024-04-25T22:44:52.077674+0000","last_peered":"2024-04-25T22:44:52.077674+0000","last_clean":"2024-04-25T22:44:52.077674+0000","last_became_active":"2024-04-25T22:44:33.084127+0000","last_became_peered":"2024-04-25T22:44:33.084127+0000","last_unstale":"2024-04-25T22:44:52.077674+0000","last_undegraded":"2024-04-25T22:44:52.077674+0000","last_fullsized":"2024-04-25T22:44:52.077674+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38440,"num_write":423,"num_write_kb":71855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"72'434","reported_seq":654,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.082262+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:44:52.082262+0000","last_peered":"2024-04-25T22:44:52.082262+0000","last_clean":"2024-04-25T22:44:52.082262+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:44:52.082262+0000","last_undegraded":"2024-04-25T22:44:52.082262+0000","last_fullsized":"2024-04-25T22:44:52.082262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18701,"num_write":402,"num_write_kb":27564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"72'379","reported_seq":516,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376964+0000","last_change":"2024-04-25T22:44:53.383623+0000","last_active":"2024-04-25T22:44:54.376964+0000","last_peered":"2024-04-25T22:44:54.376964+0000","last_clean":"2024-04-25T22:44:54.376964+0000","last_became_active":"2024-04-25T22:44:53.378402+0000","last_became_peered":"2024-04-25T22:44:53.378402+0000","last_unstale":"2024-04-25T22:44:54.376964+0000","last_undegraded":"2024-04-25T22:44:54.376964+0000","last_fullsized":"2024-04-25T22:44:54.376964+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:52:18.111269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18623,"num_write":344,"num_write_kb":50888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"71'528","reported_seq":716,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083570+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:44:52.083570+0000","last_peered":"2024-04-25T22:44:52.083570+0000","last_clean":"2024-04-25T22:44:52.083570+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:44:52.083570+0000","last_undegraded":"2024-04-25T22:44:52.083570+0000","last_fullsized":"2024-04-25T22:44:52.083570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"72'383","reported_seq":554,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.078637+0000","last_change":"2024-04-25T22:44:41.148275+0000","last_active":"2024-04-25T22:44:52.078637+0000","last_peered":"2024-04-25T22:44:52.078637+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.142954+0000","last_became_peered":"2024-04-25T22:44:41.142954+0000","last_unstale":"2024-04-25T22:44:52.078637+0000","last_undegraded":"2024-04-25T22:44:41.119000+0000","last_fullsized":"2024-04-25T22:44:41.118353+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8364,"num_write":351,"num_write_kb":30625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"71'45","reported_seq":186,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.078395+0000","last_change":"2024-04-25T22:44:39.117622+0000","last_active":"2024-04-25T22:44:52.078395+0000","last_peered":"2024-04-25T22:44:52.078395+0000","last_clean":"2024-04-25T22:44:52.078395+0000","last_became_active":"2024-04-25T22:44:39.115669+0000","last_became_peered":"2024-04-25T22:44:39.115669+0000","last_unstale":"2024-04-25T22:44:52.078395+0000","last_undegraded":"2024-04-25T22:44:52.078395+0000","last_fullsized":"2024-04-25T22:44:52.078395+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:21.793820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"72'429","reported_seq":621,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.080308+0000","last_change":"2024-04-25T22:44:41.157231+0000","last_active":"2024-04-25T22:44:52.080308+0000","last_peered":"2024-04-25T22:44:52.080308+0000","last_clean":"2024-04-25T22:44:24.311958+0000","last_became_active":"2024-04-25T22:44:41.154517+0000","last_became_peered":"2024-04-25T22:44:41.154517+0000","last_unstale":"2024-04-25T22:44:52.080308+0000","last_undegraded":"2024-04-25T22:44:41.121712+0000","last_fullsized":"2024-04-25T22:44:41.121143+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16584,"num_write":393,"num_write_kb":63712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'61","reported_seq":79,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375730+0000","last_change":"2024-04-25T22:44:41.416554+0000","last_active":"2024-04-25T22:44:54.375730+0000","last_peered":"2024-04-25T22:44:54.375730+0000","last_clean":"2024-04-25T22:44:54.375730+0000","last_became_active":"2024-04-25T22:44:41.413853+0000","last_became_peered":"2024-04-25T22:44:41.413853+0000","last_unstale":"2024-04-25T22:44:54.375730+0000","last_undegraded":"2024-04-25T22:44:54.375730+0000","last_fullsized":"2024-04-25T22:44:54.375730+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:50.701110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"72'404","reported_seq":610,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079085+0000","last_change":"2024-04-25T22:44:39.128428+0000","last_active":"2024-04-25T22:44:52.079085+0000","last_peered":"2024-04-25T22:44:52.079085+0000","last_clean":"2024-04-25T22:44:52.079085+0000","last_became_active":"2024-04-25T22:44:39.116562+0000","last_became_peered":"2024-04-25T22:44:39.116562+0000","last_unstale":"2024-04-25T22:44:52.079085+0000","last_undegraded":"2024-04-25T22:44:52.079085+0000","last_fullsized":"2024-04-25T22:44:52.079085+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:09.750726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18745,"num_write":376,"num_write_kb":96145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'71","reported_seq":267,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.082688+0000","last_change":"2024-04-25T22:44:26.363329+0000","last_active":"2024-04-25T22:44:52.082688+0000","last_peered":"2024-04-25T22:44:52.082688+0000","last_clean":"2024-04-25T22:44:52.082688+0000","last_became_active":"2024-04-25T22:44:26.362499+0000","last_became_peered":"2024-04-25T22:44:26.362499+0000","last_unstale":"2024-04-25T22:44:52.082688+0000","last_undegraded":"2024-04-25T22:44:52.082688+0000","last_fullsized":"2024-04-25T22:44:52.082688+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'145","reported_seq":348,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.085247+0000","last_change":"2024-04-25T22:44:29.400540+0000","last_active":"2024-04-25T22:44:52.085247+0000","last_peered":"2024-04-25T22:44:52.085247+0000","last_clean":"2024-04-25T22:44:52.085247+0000","last_became_active":"2024-04-25T22:44:29.399853+0000","last_became_peered":"2024-04-25T22:44:29.399853+0000","last_unstale":"2024-04-25T22:44:52.085247+0000","last_undegraded":"2024-04-25T22:44:52.085247+0000","last_fullsized":"2024-04-25T22:44:52.085247+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"72'399","reported_seq":595,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376145+0000","last_change":"2024-04-25T22:44:46.398600+0000","last_active":"2024-04-25T22:44:54.376145+0000","last_peered":"2024-04-25T22:44:54.376145+0000","last_clean":"2024-04-25T22:44:54.376145+0000","last_became_active":"2024-04-25T22:44:46.392604+0000","last_became_peered":"2024-04-25T22:44:46.392604+0000","last_unstale":"2024-04-25T22:44:54.376145+0000","last_undegraded":"2024-04-25T22:44:54.376145+0000","last_fullsized":"2024-04-25T22:44:54.376145+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:15.771324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25159,"num_write":363,"num_write_kb":34063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"71'226","reported_seq":422,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377452+0000","last_change":"2024-04-25T22:44:41.417859+0000","last_active":"2024-04-25T22:44:54.377452+0000","last_peered":"2024-04-25T22:44:54.377452+0000","last_clean":"2024-04-25T22:44:54.377452+0000","last_became_active":"2024-04-25T22:44:41.416542+0000","last_became_peered":"2024-04-25T22:44:41.416542+0000","last_unstale":"2024-04-25T22:44:54.377452+0000","last_undegraded":"2024-04-25T22:44:54.377452+0000","last_fullsized":"2024-04-25T22:44:54.377452+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:27.884903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"72'431","reported_seq":625,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.078000+0000","last_change":"2024-04-25T22:44:41.136042+0000","last_active":"2024-04-25T22:44:52.078000+0000","last_peered":"2024-04-25T22:44:52.078000+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130862+0000","last_became_peered":"2024-04-25T22:44:41.130862+0000","last_unstale":"2024-04-25T22:44:52.078000+0000","last_undegraded":"2024-04-25T22:44:41.117168+0000","last_fullsized":"2024-04-25T22:44:41.116538+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14688,"num_write":405,"num_write_kb":38957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"71'382","reported_seq":585,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.084709+0000","last_change":"2024-04-25T22:44:30.401893+0000","last_active":"2024-04-25T22:44:52.084709+0000","last_peered":"2024-04-25T22:44:52.084709+0000","last_clean":"2024-04-25T22:44:52.084709+0000","last_became_active":"2024-04-25T22:44:30.401021+0000","last_became_peered":"2024-04-25T22:44:30.401021+0000","last_unstale":"2024-04-25T22:44:52.084709+0000","last_undegraded":"2024-04-25T22:44:52.084709+0000","last_fullsized":"2024-04-25T22:44:52.084709+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:38.452482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'453","reported_seq":671,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083056+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:44:52.083056+0000","last_peered":"2024-04-25T22:44:52.083056+0000","last_clean":"2024-04-25T22:44:52.083056+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:44:52.083056+0000","last_undegraded":"2024-04-25T22:44:52.083056+0000","last_fullsized":"2024-04-25T22:44:52.083056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18900,"num_write":418,"num_write_kb":117500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"71'64","reported_seq":253,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.084029+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:44:52.084029+0000","last_peered":"2024-04-25T22:44:52.084029+0000","last_clean":"2024-04-25T22:44:52.084029+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:44:52.084029+0000","last_undegraded":"2024-04-25T22:44:52.084029+0000","last_fullsized":"2024-04-25T22:44:52.084029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'428","reported_seq":617,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079015+0000","last_change":"2024-04-25T22:44:39.129871+0000","last_active":"2024-04-25T22:44:52.079015+0000","last_peered":"2024-04-25T22:44:52.079015+0000","last_clean":"2024-04-25T22:44:52.079015+0000","last_became_active":"2024-04-25T22:44:39.121205+0000","last_became_peered":"2024-04-25T22:44:39.121205+0000","last_unstale":"2024-04-25T22:44:52.079015+0000","last_undegraded":"2024-04-25T22:44:52.079015+0000","last_fullsized":"2024-04-25T22:44:52.079015+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:48.521828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7477,"num_write":383,"num_write_kb":9617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'166","reported_seq":308,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079565+0000","last_change":"2024-04-25T22:44:39.133550+0000","last_active":"2024-04-25T22:44:52.079565+0000","last_peered":"2024-04-25T22:44:52.079565+0000","last_clean":"2024-04-25T22:44:52.079565+0000","last_became_active":"2024-04-25T22:44:39.131489+0000","last_became_peered":"2024-04-25T22:44:39.131489+0000","last_unstale":"2024-04-25T22:44:52.079565+0000","last_undegraded":"2024-04-25T22:44:52.079565+0000","last_fullsized":"2024-04-25T22:44:52.079565+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:32.980801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"72'446","reported_seq":682,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083642+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:44:52.083642+0000","last_peered":"2024-04-25T22:44:52.083642+0000","last_clean":"2024-04-25T22:44:52.083642+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:44:52.083642+0000","last_undegraded":"2024-04-25T22:44:52.083642+0000","last_fullsized":"2024-04-25T22:44:52.083642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27788,"num_write":414,"num_write_kb":47058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"71'113","reported_seq":302,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083648+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:44:52.083648+0000","last_peered":"2024-04-25T22:44:52.083648+0000","last_clean":"2024-04-25T22:44:52.083648+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:44:52.083648+0000","last_undegraded":"2024-04-25T22:44:52.083648+0000","last_fullsized":"2024-04-25T22:44:52.083648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"72'417","reported_seq":1005,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.084551+0000","last_change":"2024-04-25T22:44:44.113498+0000","last_active":"2024-04-25T22:44:52.084551+0000","last_peered":"2024-04-25T22:44:52.084551+0000","last_clean":"2024-04-25T22:44:52.084551+0000","last_became_active":"2024-04-25T22:44:44.108084+0000","last_became_peered":"2024-04-25T22:44:44.108084+0000","last_unstale":"2024-04-25T22:44:52.084551+0000","last_undegraded":"2024-04-25T22:44:52.084551+0000","last_fullsized":"2024-04-25T22:44:52.084551+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16487,"num_write":388,"num_write_kb":75452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'59","reported_seq":79,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375230+0000","last_change":"2024-04-25T22:44:41.417821+0000","last_active":"2024-04-25T22:44:54.375230+0000","last_peered":"2024-04-25T22:44:54.375230+0000","last_clean":"2024-04-25T22:44:54.375230+0000","last_became_active":"2024-04-25T22:44:41.415769+0000","last_became_peered":"2024-04-25T22:44:41.415769+0000","last_unstale":"2024-04-25T22:44:54.375230+0000","last_undegraded":"2024-04-25T22:44:54.375230+0000","last_fullsized":"2024-04-25T22:44:54.375230+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.099475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'358","reported_seq":886,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.084449+0000","last_change":"2024-04-25T22:44:34.101942+0000","last_active":"2024-04-25T22:44:52.084449+0000","last_peered":"2024-04-25T22:44:52.084449+0000","last_clean":"2024-04-25T22:44:52.084449+0000","last_became_active":"2024-04-25T22:44:34.099595+0000","last_became_peered":"2024-04-25T22:44:34.099595+0000","last_unstale":"2024-04-25T22:44:52.084449+0000","last_undegraded":"2024-04-25T22:44:52.084449+0000","last_fullsized":"2024-04-25T22:44:52.084449+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:06.523166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12259,"num_write":325,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'465","reported_seq":624,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375647+0000","last_change":"2024-04-25T22:44:41.425331+0000","last_active":"2024-04-25T22:44:54.375647+0000","last_peered":"2024-04-25T22:44:54.375647+0000","last_clean":"2024-04-25T22:44:54.375647+0000","last_became_active":"2024-04-25T22:44:41.423799+0000","last_became_peered":"2024-04-25T22:44:41.423799+0000","last_unstale":"2024-04-25T22:44:54.375647+0000","last_undegraded":"2024-04-25T22:44:54.375647+0000","last_fullsized":"2024-04-25T22:44:54.375647+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:04.324825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"72'386","reported_seq":941,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079145+0000","last_change":"2024-04-25T22:44:46.113269+0000","last_active":"2024-04-25T22:44:52.079145+0000","last_peered":"2024-04-25T22:44:52.079145+0000","last_clean":"2024-04-25T22:44:52.079145+0000","last_became_active":"2024-04-25T22:44:46.110394+0000","last_became_peered":"2024-04-25T22:44:46.110394+0000","last_unstale":"2024-04-25T22:44:52.079145+0000","last_undegraded":"2024-04-25T22:44:52.079145+0000","last_fullsized":"2024-04-25T22:44:52.079145+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9402,"num_write":352,"num_write_kb":50548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":404,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083013+0000","last_change":"2024-04-25T22:44:26.355770+0000","last_active":"2024-04-25T22:44:52.083013+0000","last_peered":"2024-04-25T22:44:52.083013+0000","last_clean":"2024-04-25T22:44:52.083013+0000","last_became_active":"2024-04-25T22:44:26.354730+0000","last_became_peered":"2024-04-25T22:44:26.354730+0000","last_unstale":"2024-04-25T22:44:52.083013+0000","last_undegraded":"2024-04-25T22:44:52.083013+0000","last_fullsized":"2024-04-25T22:44:52.083013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:34.987031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":195,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083862+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:44:52.083862+0000","last_peered":"2024-04-25T22:44:52.083862+0000","last_clean":"2024-04-25T22:44:52.083862+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:44:52.083862+0000","last_undegraded":"2024-04-25T22:44:52.083862+0000","last_fullsized":"2024-04-25T22:44:52.083862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"71'457","reported_seq":662,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079295+0000","last_change":"2024-04-25T22:44:29.399148+0000","last_active":"2024-04-25T22:44:52.079295+0000","last_peered":"2024-04-25T22:44:52.079295+0000","last_clean":"2024-04-25T22:44:52.079295+0000","last_became_active":"2024-04-25T22:44:29.397962+0000","last_became_peered":"2024-04-25T22:44:29.397962+0000","last_unstale":"2024-04-25T22:44:52.079295+0000","last_undegraded":"2024-04-25T22:44:52.079295+0000","last_fullsized":"2024-04-25T22:44:52.079295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:14.015619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"72'447","reported_seq":1097,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.084598+0000","last_change":"2024-04-25T22:44:43.108262+0000","last_active":"2024-04-25T22:44:52.084598+0000","last_peered":"2024-04-25T22:44:52.084598+0000","last_clean":"2024-04-25T22:44:52.084598+0000","last_became_active":"2024-04-25T22:44:43.105231+0000","last_became_peered":"2024-04-25T22:44:43.105231+0000","last_unstale":"2024-04-25T22:44:52.084598+0000","last_undegraded":"2024-04-25T22:44:52.084598+0000","last_fullsized":"2024-04-25T22:44:52.084598+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:09.728618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45074,"num_write":414,"num_write_kb":120596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":202,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.082886+0000","last_change":"2024-04-25T22:44:26.355238+0000","last_active":"2024-04-25T22:44:52.082886+0000","last_peered":"2024-04-25T22:44:52.082886+0000","last_clean":"2024-04-25T22:44:52.082886+0000","last_became_active":"2024-04-25T22:44:26.354482+0000","last_became_peered":"2024-04-25T22:44:26.354482+0000","last_unstale":"2024-04-25T22:44:52.082886+0000","last_undegraded":"2024-04-25T22:44:52.082886+0000","last_fullsized":"2024-04-25T22:44:52.082886+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.042514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'122","reported_seq":326,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.078427+0000","last_change":"2024-04-25T22:44:39.141843+0000","last_active":"2024-04-25T22:44:52.078427+0000","last_peered":"2024-04-25T22:44:52.078427+0000","last_clean":"2024-04-25T22:44:52.078427+0000","last_became_active":"2024-04-25T22:44:39.139689+0000","last_became_peered":"2024-04-25T22:44:39.139689+0000","last_unstale":"2024-04-25T22:44:52.078427+0000","last_undegraded":"2024-04-25T22:44:52.078427+0000","last_fullsized":"2024-04-25T22:44:52.078427+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:18.614670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":62,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"72'449","reported_seq":642,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.378064+0000","last_change":"2024-04-25T22:44:41.439044+0000","last_active":"2024-04-25T22:44:54.378064+0000","last_peered":"2024-04-25T22:44:54.378064+0000","last_clean":"2024-04-25T22:44:54.378064+0000","last_became_active":"2024-04-25T22:44:41.432785+0000","last_became_peered":"2024-04-25T22:44:41.432785+0000","last_unstale":"2024-04-25T22:44:54.378064+0000","last_undegraded":"2024-04-25T22:44:54.378064+0000","last_fullsized":"2024-04-25T22:44:54.378064+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:57.171725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25191,"num_write":420,"num_write_kb":79855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":203,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.078717+0000","last_change":"2024-04-25T22:44:26.363464+0000","last_active":"2024-04-25T22:44:52.078717+0000","last_peered":"2024-04-25T22:44:52.078717+0000","last_clean":"2024-04-25T22:44:52.078717+0000","last_became_active":"2024-04-25T22:44:26.362808+0000","last_became_peered":"2024-04-25T22:44:26.362808+0000","last_unstale":"2024-04-25T22:44:52.078717+0000","last_undegraded":"2024-04-25T22:44:52.078717+0000","last_fullsized":"2024-04-25T22:44:52.078717+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:06.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'435","reported_seq":620,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375077+0000","last_change":"2024-04-25T22:44:41.417191+0000","last_active":"2024-04-25T22:44:54.375077+0000","last_peered":"2024-04-25T22:44:54.375077+0000","last_clean":"2024-04-25T22:44:54.375077+0000","last_became_active":"2024-04-25T22:44:41.415592+0000","last_became_peered":"2024-04-25T22:44:41.415592+0000","last_unstale":"2024-04-25T22:44:54.375077+0000","last_undegraded":"2024-04-25T22:44:54.375077+0000","last_fullsized":"2024-04-25T22:44:54.375077+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:35.916512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"72'337","reported_seq":874,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079432+0000","last_change":"2024-04-25T22:44:45.113523+0000","last_active":"2024-04-25T22:44:52.079432+0000","last_peered":"2024-04-25T22:44:52.079432+0000","last_clean":"2024-04-25T22:44:52.079432+0000","last_became_active":"2024-04-25T22:44:45.111011+0000","last_became_peered":"2024-04-25T22:44:45.111011+0000","last_unstale":"2024-04-25T22:44:52.079432+0000","last_undegraded":"2024-04-25T22:44:52.079432+0000","last_fullsized":"2024-04-25T22:44:52.079432+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25242,"num_write":307,"num_write_kb":26250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":195,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083727+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:44:52.083727+0000","last_peered":"2024-04-25T22:44:52.083727+0000","last_clean":"2024-04-25T22:44:52.083727+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:44:52.083727+0000","last_undegraded":"2024-04-25T22:44:52.083727+0000","last_fullsized":"2024-04-25T22:44:52.083727+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"71'61","reported_seq":250,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.084036+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:44:52.084036+0000","last_peered":"2024-04-25T22:44:52.084036+0000","last_clean":"2024-04-25T22:44:52.084036+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:44:52.084036+0000","last_undegraded":"2024-04-25T22:44:52.084036+0000","last_fullsized":"2024-04-25T22:44:52.084036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'404","reported_seq":1002,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.080780+0000","last_change":"2024-04-25T22:44:32.092728+0000","last_active":"2024-04-25T22:44:52.080780+0000","last_peered":"2024-04-25T22:44:52.080780+0000","last_clean":"2024-04-25T22:44:52.080780+0000","last_became_active":"2024-04-25T22:44:32.087528+0000","last_became_peered":"2024-04-25T22:44:32.087528+0000","last_unstale":"2024-04-25T22:44:52.080780+0000","last_undegraded":"2024-04-25T22:44:52.080780+0000","last_fullsized":"2024-04-25T22:44:52.080780+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:39.481467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":20287,"num_write":371,"num_write_kb":59919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'285","reported_seq":474,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.084764+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:44:52.084764+0000","last_peered":"2024-04-25T22:44:52.084764+0000","last_clean":"2024-04-25T22:44:52.084764+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:44:52.084764+0000","last_undegraded":"2024-04-25T22:44:52.084764+0000","last_fullsized":"2024-04-25T22:44:52.084764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":203,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.081506+0000","last_change":"2024-04-25T22:44:26.364185+0000","last_active":"2024-04-25T22:44:52.081506+0000","last_peered":"2024-04-25T22:44:52.081506+0000","last_clean":"2024-04-25T22:44:52.081506+0000","last_became_active":"2024-04-25T22:44:26.363583+0000","last_became_peered":"2024-04-25T22:44:26.363583+0000","last_unstale":"2024-04-25T22:44:52.081506+0000","last_undegraded":"2024-04-25T22:44:52.081506+0000","last_fullsized":"2024-04-25T22:44:52.081506+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:35:04.325449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"72'366","reported_seq":512,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376225+0000","last_change":"2024-04-25T22:44:52.381174+0000","last_active":"2024-04-25T22:44:54.376225+0000","last_peered":"2024-04-25T22:44:54.376225+0000","last_clean":"2024-04-25T22:44:54.376225+0000","last_became_active":"2024-04-25T22:44:52.375504+0000","last_became_peered":"2024-04-25T22:44:52.375504+0000","last_unstale":"2024-04-25T22:44:54.376225+0000","last_undegraded":"2024-04-25T22:44:54.376225+0000","last_fullsized":"2024-04-25T22:44:54.376225+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:41.592790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":346,"num_write":330,"num_write_kb":33934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":251,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.081485+0000","last_change":"2024-04-25T22:44:26.364178+0000","last_active":"2024-04-25T22:44:52.081485+0000","last_peered":"2024-04-25T22:44:52.081485+0000","last_clean":"2024-04-25T22:44:52.081485+0000","last_became_active":"2024-04-25T22:44:26.363455+0000","last_became_peered":"2024-04-25T22:44:26.363455+0000","last_unstale":"2024-04-25T22:44:52.081485+0000","last_undegraded":"2024-04-25T22:44:52.081485+0000","last_fullsized":"2024-04-25T22:44:52.081485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:58.181763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.378144+0000","last_change":"2024-04-25T22:44:41.423030+0000","last_active":"2024-04-25T22:44:54.378144+0000","last_peered":"2024-04-25T22:44:54.378144+0000","last_clean":"2024-04-25T22:44:54.378144+0000","last_became_active":"2024-04-25T22:44:41.421194+0000","last_became_peered":"2024-04-25T22:44:41.421194+0000","last_unstale":"2024-04-25T22:44:54.378144+0000","last_undegraded":"2024-04-25T22:44:54.378144+0000","last_fullsized":"2024-04-25T22:44:54.378144+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:59.297537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'413","reported_seq":617,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376317+0000","last_change":"2024-04-25T22:44:48.378474+0000","last_active":"2024-04-25T22:44:54.376317+0000","last_peered":"2024-04-25T22:44:54.376317+0000","last_clean":"2024-04-25T22:44:54.376317+0000","last_became_active":"2024-04-25T22:44:48.372485+0000","last_became_peered":"2024-04-25T22:44:48.372485+0000","last_unstale":"2024-04-25T22:44:54.376317+0000","last_undegraded":"2024-04-25T22:44:54.376317+0000","last_fullsized":"2024-04-25T22:44:54.376317+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:47.402437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22994,"num_write":377,"num_write_kb":63140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'57","reported_seq":255,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.080664+0000","last_change":"2024-04-25T22:44:26.366189+0000","last_active":"2024-04-25T22:44:52.080664+0000","last_peered":"2024-04-25T22:44:52.080664+0000","last_clean":"2024-04-25T22:44:52.080664+0000","last_became_active":"2024-04-25T22:44:26.365267+0000","last_became_peered":"2024-04-25T22:44:26.365267+0000","last_unstale":"2024-04-25T22:44:52.080664+0000","last_undegraded":"2024-04-25T22:44:52.080664+0000","last_fullsized":"2024-04-25T22:44:52.080664+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:54.128937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":203,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.080837+0000","last_change":"2024-04-25T22:44:26.361633+0000","last_active":"2024-04-25T22:44:52.080837+0000","last_peered":"2024-04-25T22:44:52.080837+0000","last_clean":"2024-04-25T22:44:52.080837+0000","last_became_active":"2024-04-25T22:44:26.360968+0000","last_became_peered":"2024-04-25T22:44:26.360968+0000","last_unstale":"2024-04-25T22:44:52.080837+0000","last_undegraded":"2024-04-25T22:44:52.080837+0000","last_fullsized":"2024-04-25T22:44:52.080837+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:40.454898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'398","reported_seq":585,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.078555+0000","last_change":"2024-04-25T22:44:39.132801+0000","last_active":"2024-04-25T22:44:52.078555+0000","last_peered":"2024-04-25T22:44:52.078555+0000","last_clean":"2024-04-25T22:44:52.078555+0000","last_became_active":"2024-04-25T22:44:39.124378+0000","last_became_peered":"2024-04-25T22:44:39.124378+0000","last_unstale":"2024-04-25T22:44:52.078555+0000","last_undegraded":"2024-04-25T22:44:52.078555+0000","last_fullsized":"2024-04-25T22:44:52.078555+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:29.195889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6306,"num_write":372,"num_write_kb":34077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'100","reported_seq":292,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.080456+0000","last_change":"2024-04-25T22:44:39.150245+0000","last_active":"2024-04-25T22:44:52.080456+0000","last_peered":"2024-04-25T22:44:52.080456+0000","last_clean":"2024-04-25T22:44:52.080456+0000","last_became_active":"2024-04-25T22:44:39.147377+0000","last_became_peered":"2024-04-25T22:44:39.147377+0000","last_unstale":"2024-04-25T22:44:52.080456+0000","last_undegraded":"2024-04-25T22:44:52.080456+0000","last_fullsized":"2024-04-25T22:44:52.080456+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:36.007978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":202,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.085406+0000","last_change":"2024-04-25T22:44:26.360890+0000","last_active":"2024-04-25T22:44:52.085406+0000","last_peered":"2024-04-25T22:44:52.085406+0000","last_clean":"2024-04-25T22:44:52.085406+0000","last_became_active":"2024-04-25T22:44:26.360106+0000","last_became_peered":"2024-04-25T22:44:26.360106+0000","last_unstale":"2024-04-25T22:44:52.085406+0000","last_undegraded":"2024-04-25T22:44:52.085406+0000","last_fullsized":"2024-04-25T22:44:52.085406+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:09.929196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'390","reported_seq":611,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375973+0000","last_change":"2024-04-25T22:44:41.433574+0000","last_active":"2024-04-25T22:44:54.375973+0000","last_peered":"2024-04-25T22:44:54.375973+0000","last_clean":"2024-04-25T22:44:54.375973+0000","last_became_active":"2024-04-25T22:44:41.414924+0000","last_became_peered":"2024-04-25T22:44:41.414924+0000","last_unstale":"2024-04-25T22:44:54.375973+0000","last_undegraded":"2024-04-25T22:44:54.375973+0000","last_fullsized":"2024-04-25T22:44:54.375973+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:46.695300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":22915,"num_write":352,"num_write_kb":47201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"72'411","reported_seq":993,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.082992+0000","last_change":"2024-04-25T22:44:32.090492+0000","last_active":"2024-04-25T22:44:52.082992+0000","last_peered":"2024-04-25T22:44:52.082992+0000","last_clean":"2024-04-25T22:44:52.082992+0000","last_became_active":"2024-04-25T22:44:32.087303+0000","last_became_peered":"2024-04-25T22:44:32.087303+0000","last_unstale":"2024-04-25T22:44:52.082992+0000","last_undegraded":"2024-04-25T22:44:52.082992+0000","last_fullsized":"2024-04-25T22:44:52.082992+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25412,"num_write":367,"num_write_kb":64656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'268","reported_seq":474,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083938+0000","last_change":"2024-04-25T22:44:29.399184+0000","last_active":"2024-04-25T22:44:52.083938+0000","last_peered":"2024-04-25T22:44:52.083938+0000","last_clean":"2024-04-25T22:44:52.083938+0000","last_became_active":"2024-04-25T22:44:29.398317+0000","last_became_peered":"2024-04-25T22:44:29.398317+0000","last_unstale":"2024-04-25T22:44:52.083938+0000","last_undegraded":"2024-04-25T22:44:52.083938+0000","last_fullsized":"2024-04-25T22:44:52.083938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:21.765162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382817,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"72'423","reported_seq":1032,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.077912+0000","last_change":"2024-04-25T22:44:42.092243+0000","last_active":"2024-04-25T22:44:52.077912+0000","last_peered":"2024-04-25T22:44:52.077912+0000","last_clean":"2024-04-25T22:44:52.077912+0000","last_became_active":"2024-04-25T22:44:42.088432+0000","last_became_peered":"2024-04-25T22:44:42.088432+0000","last_unstale":"2024-04-25T22:44:52.077912+0000","last_undegraded":"2024-04-25T22:44:52.077912+0000","last_fullsized":"2024-04-25T22:44:52.077912+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:54.239406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24794,"num_write":386,"num_write_kb":63756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'102","reported_seq":86,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377263+0000","last_change":"2024-04-25T22:44:41.423993+0000","last_active":"2024-04-25T22:44:54.377263+0000","last_peered":"2024-04-25T22:44:54.377263+0000","last_clean":"2024-04-25T22:44:54.377263+0000","last_became_active":"2024-04-25T22:44:41.422237+0000","last_became_peered":"2024-04-25T22:44:41.422237+0000","last_unstale":"2024-04-25T22:44:54.377263+0000","last_undegraded":"2024-04-25T22:44:54.377263+0000","last_fullsized":"2024-04-25T22:44:54.377263+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:02.880774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"71'213","reported_seq":401,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.085074+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:44:52.085074+0000","last_peered":"2024-04-25T22:44:52.085074+0000","last_clean":"2024-04-25T22:44:52.085074+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:44:52.085074+0000","last_undegraded":"2024-04-25T22:44:52.085074+0000","last_fullsized":"2024-04-25T22:44:52.085074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"72'504","reported_seq":754,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.077811+0000","last_change":"2024-04-25T22:44:39.142694+0000","last_active":"2024-04-25T22:44:52.077811+0000","last_peered":"2024-04-25T22:44:52.077811+0000","last_clean":"2024-04-25T22:44:52.077811+0000","last_became_active":"2024-04-25T22:44:39.132582+0000","last_became_peered":"2024-04-25T22:44:39.132582+0000","last_unstale":"2024-04-25T22:44:52.077811+0000","last_undegraded":"2024-04-25T22:44:52.077811+0000","last_fullsized":"2024-04-25T22:44:52.077811+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:14.401644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":46975,"num_write":471,"num_write_kb":146290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'64","reported_seq":205,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.080220+0000","last_change":"2024-04-25T22:44:39.136961+0000","last_active":"2024-04-25T22:44:52.080220+0000","last_peered":"2024-04-25T22:44:52.080220+0000","last_clean":"2024-04-25T22:44:52.080220+0000","last_became_active":"2024-04-25T22:44:39.136090+0000","last_became_peered":"2024-04-25T22:44:39.136090+0000","last_unstale":"2024-04-25T22:44:52.080220+0000","last_undegraded":"2024-04-25T22:44:52.080220+0000","last_fullsized":"2024-04-25T22:44:52.080220+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:35.220314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"72'475","reported_seq":1139,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.077958+0000","last_change":"2024-04-25T22:44:44.106484+0000","last_active":"2024-04-25T22:44:52.077958+0000","last_peered":"2024-04-25T22:44:52.077958+0000","last_clean":"2024-04-25T22:44:52.077958+0000","last_became_active":"2024-04-25T22:44:44.102061+0000","last_became_peered":"2024-04-25T22:44:44.102061+0000","last_unstale":"2024-04-25T22:44:52.077958+0000","last_undegraded":"2024-04-25T22:44:52.077958+0000","last_fullsized":"2024-04-25T22:44:52.077958+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:05.455255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":23011,"num_write":448,"num_write_kb":76439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"72'370","reported_seq":614,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.085079+0000","last_change":"2024-04-25T22:44:41.149278+0000","last_active":"2024-04-25T22:44:52.085079+0000","last_peered":"2024-04-25T22:44:52.085079+0000","last_clean":"2024-04-25T22:41:34.256787+0000","last_became_active":"2024-04-25T22:44:41.144535+0000","last_became_peered":"2024-04-25T22:44:41.144535+0000","last_unstale":"2024-04-25T22:44:52.085079+0000","last_undegraded":"2024-04-25T22:44:41.120919+0000","last_fullsized":"2024-04-25T22:44:41.120194+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":159,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33211,"num_write":340,"num_write_kb":63312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'647","reported_seq":851,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.078361+0000","last_change":"2024-04-25T22:44:30.396965+0000","last_active":"2024-04-25T22:44:52.078361+0000","last_peered":"2024-04-25T22:44:52.078361+0000","last_clean":"2024-04-25T22:44:52.078361+0000","last_became_active":"2024-04-25T22:44:30.396073+0000","last_became_peered":"2024-04-25T22:44:30.396073+0000","last_unstale":"2024-04-25T22:44:52.078361+0000","last_undegraded":"2024-04-25T22:44:52.078361+0000","last_fullsized":"2024-04-25T22:44:52.078361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"72'415","reported_seq":622,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079625+0000","last_change":"2024-04-25T22:44:39.150290+0000","last_active":"2024-04-25T22:44:52.079625+0000","last_peered":"2024-04-25T22:44:52.079625+0000","last_clean":"2024-04-25T22:44:52.079625+0000","last_became_active":"2024-04-25T22:44:39.146949+0000","last_became_peered":"2024-04-25T22:44:39.146949+0000","last_unstale":"2024-04-25T22:44:52.079625+0000","last_undegraded":"2024-04-25T22:44:52.079625+0000","last_fullsized":"2024-04-25T22:44:52.079625+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:11.804350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19493,"num_write":386,"num_write_kb":64692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'207","reported_seq":348,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.078113+0000","last_change":"2024-04-25T22:44:39.141125+0000","last_active":"2024-04-25T22:44:52.078113+0000","last_peered":"2024-04-25T22:44:52.078113+0000","last_clean":"2024-04-25T22:44:52.078113+0000","last_became_active":"2024-04-25T22:44:39.138371+0000","last_became_peered":"2024-04-25T22:44:39.138371+0000","last_unstale":"2024-04-25T22:44:52.078113+0000","last_undegraded":"2024-04-25T22:44:52.078113+0000","last_fullsized":"2024-04-25T22:44:52.078113+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:14.147026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"72'395","reported_seq":546,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-25T22:44:53.510934+0000","last_change":"2024-04-25T22:44:54.660910+0000","last_active":"2024-04-25T22:44:54.660910+0000","last_peered":"2024-04-25T22:44:53.510934+0000","last_clean":"2024-04-25T22:41:34.256072+0000","last_became_active":"2024-04-25T22:44:41.144491+0000","last_became_peered":"2024-04-25T22:44:41.144491+0000","last_unstale":"2024-04-25T22:44:53.510934+0000","last_undegraded":"2024-04-25T22:44:53.510934+0000","last_fullsized":"2024-04-25T22:44:41.118876+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9576,"num_write":348,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'194","reported_seq":353,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375784+0000","last_change":"2024-04-25T22:44:41.422369+0000","last_active":"2024-04-25T22:44:54.375784+0000","last_peered":"2024-04-25T22:44:54.375784+0000","last_clean":"2024-04-25T22:44:54.375784+0000","last_became_active":"2024-04-25T22:44:41.420491+0000","last_became_peered":"2024-04-25T22:44:41.420491+0000","last_unstale":"2024-04-25T22:44:54.375784+0000","last_undegraded":"2024-04-25T22:44:54.375784+0000","last_fullsized":"2024-04-25T22:44:54.375784+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:35.081225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360511,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":12143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12360511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"72'398","reported_seq":583,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.378098+0000","last_change":"2024-04-25T22:44:52.381363+0000","last_active":"2024-04-25T22:44:54.378098+0000","last_peered":"2024-04-25T22:44:54.378098+0000","last_clean":"2024-04-25T22:44:54.378098+0000","last_became_active":"2024-04-25T22:44:52.375632+0000","last_became_peered":"2024-04-25T22:44:52.375632+0000","last_unstale":"2024-04-25T22:44:54.378098+0000","last_undegraded":"2024-04-25T22:44:54.378098+0000","last_fullsized":"2024-04-25T22:44:54.378098+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:38:28.441621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31284,"num_write":371,"num_write_kb":80144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"71'51","reported_seq":84,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375713+0000","last_change":"2024-04-25T22:44:41.415722+0000","last_active":"2024-04-25T22:44:54.375713+0000","last_peered":"2024-04-25T22:44:54.375713+0000","last_clean":"2024-04-25T22:44:54.375713+0000","last_became_active":"2024-04-25T22:44:41.414774+0000","last_became_peered":"2024-04-25T22:44:41.414774+0000","last_unstale":"2024-04-25T22:44:54.375713+0000","last_undegraded":"2024-04-25T22:44:54.375713+0000","last_fullsized":"2024-04-25T22:44:54.375713+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:20.553373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"72'383","reported_seq":621,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.082769+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:44:52.082769+0000","last_peered":"2024-04-25T22:44:52.082769+0000","last_clean":"2024-04-25T22:44:52.082769+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:44:52.082769+0000","last_undegraded":"2024-04-25T22:44:52.082769+0000","last_fullsized":"2024-04-25T22:44:52.082769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29308,"num_write":358,"num_write_kb":66975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"71'177","reported_seq":365,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083738+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:44:52.083738+0000","last_peered":"2024-04-25T22:44:52.083738+0000","last_clean":"2024-04-25T22:44:52.083738+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:44:52.083738+0000","last_undegraded":"2024-04-25T22:44:52.083738+0000","last_fullsized":"2024-04-25T22:44:52.083738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"72'387","reported_seq":586,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.083231+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:44:52.083231+0000","last_peered":"2024-04-25T22:44:52.083231+0000","last_clean":"2024-04-25T22:44:52.083231+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:44:52.083231+0000","last_undegraded":"2024-04-25T22:44:52.083231+0000","last_fullsized":"2024-04-25T22:44:52.083231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3883,"num_write":348,"num_write_kb":34122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'209","reported_seq":403,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376952+0000","last_change":"2024-04-25T22:44:41.419972+0000","last_active":"2024-04-25T22:44:54.376952+0000","last_peered":"2024-04-25T22:44:54.376952+0000","last_clean":"2024-04-25T22:44:54.376952+0000","last_became_active":"2024-04-25T22:44:41.418106+0000","last_became_peered":"2024-04-25T22:44:41.418106+0000","last_unstale":"2024-04-25T22:44:54.376952+0000","last_undegraded":"2024-04-25T22:44:54.376952+0000","last_fullsized":"2024-04-25T22:44:54.376952+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:07.628155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":12363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"72'419","reported_seq":597,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375672+0000","last_change":"2024-04-25T22:44:41.434376+0000","last_active":"2024-04-25T22:44:54.375672+0000","last_peered":"2024-04-25T22:44:54.375672+0000","last_clean":"2024-04-25T22:44:54.375672+0000","last_became_active":"2024-04-25T22:44:41.420505+0000","last_became_peered":"2024-04-25T22:44:41.420505+0000","last_unstale":"2024-04-25T22:44:54.375672+0000","last_undegraded":"2024-04-25T22:44:54.375672+0000","last_fullsized":"2024-04-25T22:44:54.375672+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:04.414563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":13327,"num_write":388,"num_write_kb":55674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"71'131","reported_seq":335,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079898+0000","last_change":"2024-04-25T22:44:29.398880+0000","last_active":"2024-04-25T22:44:52.079898+0000","last_peered":"2024-04-25T22:44:52.079898+0000","last_clean":"2024-04-25T22:44:52.079898+0000","last_became_active":"2024-04-25T22:44:29.397905+0000","last_became_peered":"2024-04-25T22:44:29.397905+0000","last_unstale":"2024-04-25T22:44:52.079898+0000","last_undegraded":"2024-04-25T22:44:52.079898+0000","last_fullsized":"2024-04-25T22:44:52.079898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:44.236330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"72'449","reported_seq":669,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.082599+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:44:52.082599+0000","last_peered":"2024-04-25T22:44:52.082599+0000","last_clean":"2024-04-25T22:44:52.082599+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:44:52.082599+0000","last_undegraded":"2024-04-25T22:44:52.082599+0000","last_fullsized":"2024-04-25T22:44:52.082599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14222,"num_write":424,"num_write_kb":79796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"71'57","reported_seq":199,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T22:44:52.079483+0000","last_change":"2024-04-25T22:44:39.137232+0000","last_active":"2024-04-25T22:44:52.079483+0000","last_peered":"2024-04-25T22:44:52.079483+0000","last_clean":"2024-04-25T22:44:52.079483+0000","last_became_active":"2024-04-25T22:44:39.136283+0000","last_became_peered":"2024-04-25T22:44:39.136283+0000","last_unstale":"2024-04-25T22:44:52.079483+0000","last_undegraded":"2024-04-25T22:44:52.079483+0000","last_fullsized":"2024-04-25T22:44:52.079483+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:32.428982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1061,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2461,"num_read_kb":1248646,"num_write":24434,"num_write_kb":4137258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6386,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26539,"ondisk_log_size":26539,"up":128,"acting":122,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127071275,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":4473,"num_write_kb":127409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254210048,"data_stored":254142550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},"log_size":6216,"ondisk_log_size":6216,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165268,"kb_used_data":80000,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94206572,"statfs":{"total":96636764160,"available":96467529728,"internally_reserved":0,"allocated":81920000,"data_stored":81382590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":79,"seq":339302416392,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133032,"kb_used_data":83284,"kb_used_omap":5,"kb_used_meta":49722,"kb_avail":94238808,"statfs":{"total":96636764160,"available":96500539392,"internally_reserved":0,"allocated":85282816,"data_stored":84713423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6003,"internal_metadata":50915469},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174276,"kb_used_data":89008,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94197564,"statfs":{"total":96636764160,"available":96458305536,"internally_reserved":0,"allocated":91144192,"data_stored":90584821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89575424,"data_stored":89544940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83689472,"data_stored":83664533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80945152,"data_stored":80933077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:44:59.346 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:44:59.677 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:44:59.679 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:44:59.697 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2024-04-25T22:44:59.242118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127661643,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":885,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2659,"num_read_kb":1250233,"num_write":29110,"num_write_kb":4268127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6509,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32912,"ondisk_log_size":32912,"up":210,"acting":204,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":472680,"kb_used_data":252404,"kb_used_omap":8,"kb_used_meta":220215,"kb_avail":282642840,"statfs":{"total":289910292480,"available":289426268160,"internally_reserved":0,"allocated":258461696,"data_stored":256725300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9193,"internal_metadata":225500183},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001428"},"pg_stats":[{"pgid":"4.3f","version":"72'404","reported_seq":609,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.080209+0000","last_change":"2024-04-25T22:44:41.145114+0000","last_active":"2024-04-25T22:44:52.080209+0000","last_peered":"2024-04-25T22:44:52.080209+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.142277+0000","last_became_peered":"2024-04-25T22:44:41.142277+0000","last_unstale":"2024-04-25T22:44:52.080209+0000","last_undegraded":"2024-04-25T22:44:41.121372+0000","last_fullsized":"2024-04-25T22:44:41.120599+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19772,"num_write":366,"num_write_kb":46873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"72'420","reported_seq":612,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377841+0000","last_change":"2024-04-25T22:44:41.434387+0000","last_active":"2024-04-25T22:44:54.377841+0000","last_peered":"2024-04-25T22:44:54.377841+0000","last_clean":"2024-04-25T22:44:54.377841+0000","last_became_active":"2024-04-25T22:44:41.418792+0000","last_became_peered":"2024-04-25T22:44:41.418792+0000","last_unstale":"2024-04-25T22:44:54.377841+0000","last_undegraded":"2024-04-25T22:44:54.377841+0000","last_fullsized":"2024-04-25T22:44:54.377841+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:43.196115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24515,"num_write":386,"num_write_kb":55688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"72'377","reported_seq":948,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089891+0000","last_change":"2024-04-25T22:44:42.096911+0000","last_active":"2024-04-25T22:44:57.089891+0000","last_peered":"2024-04-25T22:44:57.089891+0000","last_clean":"2024-04-25T22:44:57.089891+0000","last_became_active":"2024-04-25T22:44:42.093941+0000","last_became_peered":"2024-04-25T22:44:42.093941+0000","last_unstale":"2024-04-25T22:44:57.089891+0000","last_undegraded":"2024-04-25T22:44:57.089891+0000","last_fullsized":"2024-04-25T22:44:57.089891+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11135,"num_write":346,"num_write_kb":38950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"72'366","reported_seq":569,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089545+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:44:57.089545+0000","last_peered":"2024-04-25T22:44:57.089545+0000","last_clean":"2024-04-25T22:44:57.089545+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:44:57.089545+0000","last_undegraded":"2024-04-25T22:44:57.089545+0000","last_fullsized":"2024-04-25T22:44:57.089545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":326,"num_write_kb":34079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"72'455","reported_seq":625,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375993+0000","last_change":"2024-04-25T22:44:50.391674+0000","last_active":"2024-04-25T22:44:54.375993+0000","last_peered":"2024-04-25T22:44:54.375993+0000","last_clean":"2024-04-25T22:44:54.375993+0000","last_became_active":"2024-04-25T22:44:50.384804+0000","last_became_peered":"2024-04-25T22:44:50.384804+0000","last_unstale":"2024-04-25T22:44:54.375993+0000","last_undegraded":"2024-04-25T22:44:54.375993+0000","last_fullsized":"2024-04-25T22:44:54.375993+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:22:54.239989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33897,"num_write":426,"num_write_kb":100721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"72'401","reported_seq":631,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089351+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:44:57.089351+0000","last_peered":"2024-04-25T22:44:57.089351+0000","last_clean":"2024-04-25T22:44:57.089351+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:44:57.089351+0000","last_undegraded":"2024-04-25T22:44:57.089351+0000","last_fullsized":"2024-04-25T22:44:57.089351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15258,"num_write":369,"num_write_kb":53298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"72'452","reported_seq":714,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089148+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:44:57.089148+0000","last_peered":"2024-04-25T22:44:57.089148+0000","last_clean":"2024-04-25T22:44:57.089148+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:44:57.089148+0000","last_undegraded":"2024-04-25T22:44:57.089148+0000","last_fullsized":"2024-04-25T22:44:57.089148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34010,"num_write":428,"num_write_kb":157752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"72'401","reported_seq":636,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.088607+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:44:57.088607+0000","last_peered":"2024-04-25T22:44:57.088607+0000","last_clean":"2024-04-25T22:44:57.088607+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:44:57.088607+0000","last_undegraded":"2024-04-25T22:44:57.088607+0000","last_fullsized":"2024-04-25T22:44:57.088607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19917,"num_write":359,"num_write_kb":109382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"72'394","reported_seq":976,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085315+0000","last_change":"2024-04-25T22:44:48.092689+0000","last_active":"2024-04-25T22:44:57.085315+0000","last_peered":"2024-04-25T22:44:57.085315+0000","last_clean":"2024-04-25T22:44:57.085315+0000","last_became_active":"2024-04-25T22:44:48.089795+0000","last_became_peered":"2024-04-25T22:44:48.089795+0000","last_unstale":"2024-04-25T22:44:57.085315+0000","last_undegraded":"2024-04-25T22:44:57.085315+0000","last_fullsized":"2024-04-25T22:44:57.085315+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:32:33.072950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9569,"num_write":360,"num_write_kb":25560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"72'382","reported_seq":556,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377780+0000","last_change":"2024-04-25T22:44:41.433644+0000","last_active":"2024-04-25T22:44:54.377780+0000","last_peered":"2024-04-25T22:44:54.377780+0000","last_clean":"2024-04-25T22:44:54.377780+0000","last_became_active":"2024-04-25T22:44:41.421234+0000","last_became_peered":"2024-04-25T22:44:41.421234+0000","last_unstale":"2024-04-25T22:44:54.377780+0000","last_undegraded":"2024-04-25T22:44:54.377780+0000","last_fullsized":"2024-04-25T22:44:54.377780+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:24.217391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17192,"num_write":338,"num_write_kb":38688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"72'369","reported_seq":588,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089976+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:44:57.089976+0000","last_peered":"2024-04-25T22:44:57.089976+0000","last_clean":"2024-04-25T22:44:57.089976+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:44:57.089976+0000","last_undegraded":"2024-04-25T22:44:57.089976+0000","last_fullsized":"2024-04-25T22:44:57.089976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7385,"num_write":349,"num_write_kb":58842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"72'338","reported_seq":512,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377657+0000","last_change":"2024-04-25T22:44:49.384005+0000","last_active":"2024-04-25T22:44:54.377657+0000","last_peered":"2024-04-25T22:44:54.377657+0000","last_clean":"2024-04-25T22:44:54.377657+0000","last_became_active":"2024-04-25T22:44:49.378325+0000","last_became_peered":"2024-04-25T22:44:49.378325+0000","last_unstale":"2024-04-25T22:44:54.377657+0000","last_undegraded":"2024-04-25T22:44:54.377657+0000","last_fullsized":"2024-04-25T22:44:54.377657+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:18.849786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13619,"num_write":312,"num_write_kb":21391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"72'411","reported_seq":595,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376695+0000","last_change":"2024-04-25T22:44:41.432463+0000","last_active":"2024-04-25T22:44:54.376695+0000","last_peered":"2024-04-25T22:44:54.376695+0000","last_clean":"2024-04-25T22:44:54.376695+0000","last_became_active":"2024-04-25T22:44:41.421096+0000","last_became_peered":"2024-04-25T22:44:41.421096+0000","last_unstale":"2024-04-25T22:44:54.376695+0000","last_undegraded":"2024-04-25T22:44:54.376695+0000","last_fullsized":"2024-04-25T22:44:54.376695+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:46.942677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12998,"num_write":375,"num_write_kb":79661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"72'452","reported_seq":1047,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089901+0000","last_change":"2024-04-25T22:44:40.130299+0000","last_active":"2024-04-25T22:44:57.089901+0000","last_peered":"2024-04-25T22:44:57.089901+0000","last_clean":"2024-04-25T22:44:57.089901+0000","last_became_active":"2024-04-25T22:44:40.127307+0000","last_became_peered":"2024-04-25T22:44:40.127307+0000","last_unstale":"2024-04-25T22:44:57.089901+0000","last_undegraded":"2024-04-25T22:44:57.089901+0000","last_fullsized":"2024-04-25T22:44:57.089901+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:16.746830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":854,"num_write":419,"num_write_kb":88217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"72'428","reported_seq":1027,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089317+0000","last_change":"2024-04-25T22:44:35.108361+0000","last_active":"2024-04-25T22:44:57.089317+0000","last_peered":"2024-04-25T22:44:57.089317+0000","last_clean":"2024-04-25T22:44:57.089317+0000","last_became_active":"2024-04-25T22:44:35.103208+0000","last_became_peered":"2024-04-25T22:44:35.103208+0000","last_unstale":"2024-04-25T22:44:57.089317+0000","last_undegraded":"2024-04-25T22:44:57.089317+0000","last_fullsized":"2024-04-25T22:44:57.089317+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:22.046332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21291,"num_write":389,"num_write_kb":68562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"72'401","reported_seq":611,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.088824+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:44:57.088824+0000","last_peered":"2024-04-25T22:44:57.088824+0000","last_clean":"2024-04-25T22:44:57.088824+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:44:57.088824+0000","last_undegraded":"2024-04-25T22:44:57.088824+0000","last_fullsized":"2024-04-25T22:44:57.088824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8276,"num_write":369,"num_write_kb":17867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"72'398","reported_seq":967,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.086745+0000","last_change":"2024-04-25T22:44:49.097340+0000","last_active":"2024-04-25T22:44:57.086745+0000","last_peered":"2024-04-25T22:44:57.086745+0000","last_clean":"2024-04-25T22:44:57.086745+0000","last_became_active":"2024-04-25T22:44:49.094478+0000","last_became_peered":"2024-04-25T22:44:49.094478+0000","last_unstale":"2024-04-25T22:44:57.086745+0000","last_undegraded":"2024-04-25T22:44:57.086745+0000","last_fullsized":"2024-04-25T22:44:57.086745+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:33.421713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5883,"num_write":362,"num_write_kb":38188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"72'407","reported_seq":809,"reported_epoch":111,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-25T22:44:57.268751+0000","last_change":"2024-04-25T22:44:56.884546+0000","last_active":"2024-04-25T22:44:57.268751+0000","last_peered":"2024-04-25T22:44:57.268751+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.154547+0000","last_became_peered":"2024-04-25T22:44:41.154547+0000","last_unstale":"2024-04-25T22:44:57.268751+0000","last_undegraded":"2024-04-25T22:44:57.268751+0000","last_fullsized":"2024-04-25T22:44:41.120885+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13073,"num_write":372,"num_write_kb":59323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"72'441","reported_seq":1055,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085785+0000","last_change":"2024-04-25T22:44:41.148409+0000","last_active":"2024-04-25T22:44:57.085785+0000","last_peered":"2024-04-25T22:44:57.085785+0000","last_clean":"2024-04-25T22:44:57.085785+0000","last_became_active":"2024-04-25T22:44:41.143302+0000","last_became_peered":"2024-04-25T22:44:41.143302+0000","last_unstale":"2024-04-25T22:44:57.085785+0000","last_undegraded":"2024-04-25T22:44:57.085785+0000","last_fullsized":"2024-04-25T22:44:57.085785+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:46.289713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37611,"num_write":403,"num_write_kb":116618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"72'438","reported_seq":660,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089723+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:44:57.089723+0000","last_peered":"2024-04-25T22:44:57.089723+0000","last_clean":"2024-04-25T22:44:57.089723+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:44:57.089723+0000","last_undegraded":"2024-04-25T22:44:57.089723+0000","last_fullsized":"2024-04-25T22:44:57.089723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12393,"num_write":408,"num_write_kb":99933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"72'407","reported_seq":618,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090769+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:44:57.090769+0000","last_peered":"2024-04-25T22:44:57.090769+0000","last_clean":"2024-04-25T22:44:57.090769+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:44:57.090769+0000","last_undegraded":"2024-04-25T22:44:57.090769+0000","last_fullsized":"2024-04-25T22:44:57.090769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8932,"num_write":382,"num_write_kb":59684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"72'463","reported_seq":682,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376349+0000","last_change":"2024-04-25T22:44:47.376009+0000","last_active":"2024-04-25T22:44:54.376349+0000","last_peered":"2024-04-25T22:44:54.376349+0000","last_clean":"2024-04-25T22:44:54.376349+0000","last_became_active":"2024-04-25T22:44:47.369995+0000","last_became_peered":"2024-04-25T22:44:47.369995+0000","last_unstale":"2024-04-25T22:44:54.376349+0000","last_undegraded":"2024-04-25T22:44:54.376349+0000","last_fullsized":"2024-04-25T22:44:54.376349+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:04.129559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27589,"num_write":428,"num_write_kb":76861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"72'425","reported_seq":690,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.083405+0000","last_change":"2024-04-25T22:44:39.132230+0000","last_active":"2024-04-25T22:44:57.083405+0000","last_peered":"2024-04-25T22:44:57.083405+0000","last_clean":"2024-04-25T22:44:57.083405+0000","last_became_active":"2024-04-25T22:44:39.118635+0000","last_became_peered":"2024-04-25T22:44:39.118635+0000","last_unstale":"2024-04-25T22:44:57.083405+0000","last_undegraded":"2024-04-25T22:44:57.083405+0000","last_fullsized":"2024-04-25T22:44:57.083405+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:15.096836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":46424,"num_write":390,"num_write_kb":96359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"72'445","reported_seq":609,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.388681+0000","last_change":"2024-04-25T22:44:54.388681+0000","last_active":"2024-04-25T22:44:54.388681+0000","last_peered":"2024-04-25T22:44:54.388681+0000","last_clean":"2024-04-25T22:44:54.388681+0000","last_became_active":"2024-04-25T22:44:54.382124+0000","last_became_peered":"2024-04-25T22:44:54.382124+0000","last_unstale":"2024-04-25T22:44:54.388681+0000","last_undegraded":"2024-04-25T22:44:54.388681+0000","last_fullsized":"2024-04-25T22:44:54.388681+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:49.633770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32317,"num_write":419,"num_write_kb":76071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"72'424","reported_seq":580,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377796+0000","last_change":"2024-04-25T22:44:51.391125+0000","last_active":"2024-04-25T22:44:54.377796+0000","last_peered":"2024-04-25T22:44:54.377796+0000","last_clean":"2024-04-25T22:44:54.377796+0000","last_became_active":"2024-04-25T22:44:51.383461+0000","last_became_peered":"2024-04-25T22:44:51.383461+0000","last_unstale":"2024-04-25T22:44:54.377796+0000","last_undegraded":"2024-04-25T22:44:54.377796+0000","last_fullsized":"2024-04-25T22:44:54.377796+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:33.717342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8396,"num_write":399,"num_write_kb":50416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"72'499","reported_seq":706,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085795+0000","last_change":"2024-04-25T22:44:39.149280+0000","last_active":"2024-04-25T22:44:57.085795+0000","last_peered":"2024-04-25T22:44:57.085795+0000","last_clean":"2024-04-25T22:44:57.085795+0000","last_became_active":"2024-04-25T22:44:39.143391+0000","last_became_peered":"2024-04-25T22:44:39.143391+0000","last_unstale":"2024-04-25T22:44:57.085795+0000","last_undegraded":"2024-04-25T22:44:57.085795+0000","last_fullsized":"2024-04-25T22:44:57.085795+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:54:10.301144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10227,"num_write":453,"num_write_kb":96585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'430","reported_seq":1078,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090371+0000","last_change":"2024-04-25T22:44:39.113437+0000","last_active":"2024-04-25T22:44:57.090371+0000","last_peered":"2024-04-25T22:44:57.090371+0000","last_clean":"2024-04-25T22:44:57.090371+0000","last_became_active":"2024-04-25T22:44:39.109771+0000","last_became_peered":"2024-04-25T22:44:39.109771+0000","last_unstale":"2024-04-25T22:44:57.090371+0000","last_undegraded":"2024-04-25T22:44:57.090371+0000","last_fullsized":"2024-04-25T22:44:57.090371+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:40:46.739897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":32116,"num_write":409,"num_write_kb":89217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"72'393","reported_seq":646,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377384+0000","last_change":"2024-04-25T22:44:41.425947+0000","last_active":"2024-04-25T22:44:54.377384+0000","last_peered":"2024-04-25T22:44:54.377384+0000","last_clean":"2024-04-25T22:44:54.377384+0000","last_became_active":"2024-04-25T22:44:41.413570+0000","last_became_peered":"2024-04-25T22:44:41.413570+0000","last_unstale":"2024-04-25T22:44:54.377384+0000","last_undegraded":"2024-04-25T22:44:54.377384+0000","last_fullsized":"2024-04-25T22:44:54.377384+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:39:00.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":28076,"num_write":364,"num_write_kb":47473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"72'399","reported_seq":989,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.084530+0000","last_change":"2024-04-25T22:44:40.124745+0000","last_active":"2024-04-25T22:44:57.084530+0000","last_peered":"2024-04-25T22:44:57.084530+0000","last_clean":"2024-04-25T22:44:57.084530+0000","last_became_active":"2024-04-25T22:44:40.121838+0000","last_became_peered":"2024-04-25T22:44:40.121838+0000","last_unstale":"2024-04-25T22:44:57.084530+0000","last_undegraded":"2024-04-25T22:44:57.084530+0000","last_fullsized":"2024-04-25T22:44:57.084530+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:28.299317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14005,"num_write":367,"num_write_kb":58883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"72'484","reported_seq":673,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.394316+0000","last_change":"2024-04-25T22:44:54.392451+0000","last_active":"2024-04-25T22:44:54.394316+0000","last_peered":"2024-04-25T22:44:54.394316+0000","last_clean":"2024-04-25T22:44:54.394316+0000","last_became_active":"2024-04-25T22:44:54.383808+0000","last_became_peered":"2024-04-25T22:44:54.383808+0000","last_unstale":"2024-04-25T22:44:54.394316+0000","last_undegraded":"2024-04-25T22:44:54.394316+0000","last_fullsized":"2024-04-25T22:44:54.394316+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:06.630318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23352,"num_write":446,"num_write_kb":100094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'455","reported_seq":1132,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.083579+0000","last_change":"2024-04-25T22:44:33.087211+0000","last_active":"2024-04-25T22:44:57.083579+0000","last_peered":"2024-04-25T22:44:57.083579+0000","last_clean":"2024-04-25T22:44:57.083579+0000","last_became_active":"2024-04-25T22:44:33.084127+0000","last_became_peered":"2024-04-25T22:44:33.084127+0000","last_unstale":"2024-04-25T22:44:57.083579+0000","last_undegraded":"2024-04-25T22:44:57.083579+0000","last_fullsized":"2024-04-25T22:44:57.083579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38440,"num_write":423,"num_write_kb":71855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"72'434","reported_seq":664,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.088815+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:44:57.088815+0000","last_peered":"2024-04-25T22:44:57.088815+0000","last_clean":"2024-04-25T22:44:57.088815+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:44:57.088815+0000","last_undegraded":"2024-04-25T22:44:57.088815+0000","last_fullsized":"2024-04-25T22:44:57.088815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18701,"num_write":402,"num_write_kb":27564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"72'379","reported_seq":516,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376964+0000","last_change":"2024-04-25T22:44:53.383623+0000","last_active":"2024-04-25T22:44:54.376964+0000","last_peered":"2024-04-25T22:44:54.376964+0000","last_clean":"2024-04-25T22:44:54.376964+0000","last_became_active":"2024-04-25T22:44:53.378402+0000","last_became_peered":"2024-04-25T22:44:53.378402+0000","last_unstale":"2024-04-25T22:44:54.376964+0000","last_undegraded":"2024-04-25T22:44:54.376964+0000","last_fullsized":"2024-04-25T22:44:54.376964+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:52:18.111269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18623,"num_write":344,"num_write_kb":50888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"71'528","reported_seq":727,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.091426+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:44:57.091426+0000","last_peered":"2024-04-25T22:44:57.091426+0000","last_clean":"2024-04-25T22:44:57.091426+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:44:57.091426+0000","last_undegraded":"2024-04-25T22:44:57.091426+0000","last_fullsized":"2024-04-25T22:44:57.091426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"72'383","reported_seq":554,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.078637+0000","last_change":"2024-04-25T22:44:41.148275+0000","last_active":"2024-04-25T22:44:52.078637+0000","last_peered":"2024-04-25T22:44:52.078637+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.142954+0000","last_became_peered":"2024-04-25T22:44:41.142954+0000","last_unstale":"2024-04-25T22:44:52.078637+0000","last_undegraded":"2024-04-25T22:44:41.119000+0000","last_fullsized":"2024-04-25T22:44:41.118353+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8364,"num_write":351,"num_write_kb":30625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"71'45","reported_seq":197,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.084396+0000","last_change":"2024-04-25T22:44:39.117622+0000","last_active":"2024-04-25T22:44:57.084396+0000","last_peered":"2024-04-25T22:44:57.084396+0000","last_clean":"2024-04-25T22:44:57.084396+0000","last_became_active":"2024-04-25T22:44:39.115669+0000","last_became_peered":"2024-04-25T22:44:39.115669+0000","last_unstale":"2024-04-25T22:44:57.084396+0000","last_undegraded":"2024-04-25T22:44:57.084396+0000","last_fullsized":"2024-04-25T22:44:57.084396+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:21.793820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"72'429","reported_seq":621,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.080308+0000","last_change":"2024-04-25T22:44:41.157231+0000","last_active":"2024-04-25T22:44:52.080308+0000","last_peered":"2024-04-25T22:44:52.080308+0000","last_clean":"2024-04-25T22:44:24.311958+0000","last_became_active":"2024-04-25T22:44:41.154517+0000","last_became_peered":"2024-04-25T22:44:41.154517+0000","last_unstale":"2024-04-25T22:44:52.080308+0000","last_undegraded":"2024-04-25T22:44:41.121712+0000","last_fullsized":"2024-04-25T22:44:41.121143+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16584,"num_write":393,"num_write_kb":63712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'61","reported_seq":79,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375730+0000","last_change":"2024-04-25T22:44:41.416554+0000","last_active":"2024-04-25T22:44:54.375730+0000","last_peered":"2024-04-25T22:44:54.375730+0000","last_clean":"2024-04-25T22:44:54.375730+0000","last_became_active":"2024-04-25T22:44:41.413853+0000","last_became_peered":"2024-04-25T22:44:41.413853+0000","last_unstale":"2024-04-25T22:44:54.375730+0000","last_undegraded":"2024-04-25T22:44:54.375730+0000","last_fullsized":"2024-04-25T22:44:54.375730+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:50.701110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"72'404","reported_seq":620,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085312+0000","last_change":"2024-04-25T22:44:39.128428+0000","last_active":"2024-04-25T22:44:57.085312+0000","last_peered":"2024-04-25T22:44:57.085312+0000","last_clean":"2024-04-25T22:44:57.085312+0000","last_became_active":"2024-04-25T22:44:39.116562+0000","last_became_peered":"2024-04-25T22:44:39.116562+0000","last_unstale":"2024-04-25T22:44:57.085312+0000","last_undegraded":"2024-04-25T22:44:57.085312+0000","last_fullsized":"2024-04-25T22:44:57.085312+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:09.750726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18745,"num_write":376,"num_write_kb":96145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'71","reported_seq":278,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089510+0000","last_change":"2024-04-25T22:44:26.363329+0000","last_active":"2024-04-25T22:44:57.089510+0000","last_peered":"2024-04-25T22:44:57.089510+0000","last_clean":"2024-04-25T22:44:57.089510+0000","last_became_active":"2024-04-25T22:44:26.362499+0000","last_became_peered":"2024-04-25T22:44:26.362499+0000","last_unstale":"2024-04-25T22:44:57.089510+0000","last_undegraded":"2024-04-25T22:44:57.089510+0000","last_fullsized":"2024-04-25T22:44:57.089510+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'145","reported_seq":358,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.091670+0000","last_change":"2024-04-25T22:44:29.400540+0000","last_active":"2024-04-25T22:44:57.091670+0000","last_peered":"2024-04-25T22:44:57.091670+0000","last_clean":"2024-04-25T22:44:57.091670+0000","last_became_active":"2024-04-25T22:44:29.399853+0000","last_became_peered":"2024-04-25T22:44:29.399853+0000","last_unstale":"2024-04-25T22:44:57.091670+0000","last_undegraded":"2024-04-25T22:44:57.091670+0000","last_fullsized":"2024-04-25T22:44:57.091670+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"72'399","reported_seq":595,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376145+0000","last_change":"2024-04-25T22:44:46.398600+0000","last_active":"2024-04-25T22:44:54.376145+0000","last_peered":"2024-04-25T22:44:54.376145+0000","last_clean":"2024-04-25T22:44:54.376145+0000","last_became_active":"2024-04-25T22:44:46.392604+0000","last_became_peered":"2024-04-25T22:44:46.392604+0000","last_unstale":"2024-04-25T22:44:54.376145+0000","last_undegraded":"2024-04-25T22:44:54.376145+0000","last_fullsized":"2024-04-25T22:44:54.376145+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:15.771324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25159,"num_write":363,"num_write_kb":34063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"71'226","reported_seq":422,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377452+0000","last_change":"2024-04-25T22:44:41.417859+0000","last_active":"2024-04-25T22:44:54.377452+0000","last_peered":"2024-04-25T22:44:54.377452+0000","last_clean":"2024-04-25T22:44:54.377452+0000","last_became_active":"2024-04-25T22:44:41.416542+0000","last_became_peered":"2024-04-25T22:44:41.416542+0000","last_unstale":"2024-04-25T22:44:54.377452+0000","last_undegraded":"2024-04-25T22:44:54.377452+0000","last_fullsized":"2024-04-25T22:44:54.377452+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:27.884903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"72'431","reported_seq":625,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.078000+0000","last_change":"2024-04-25T22:44:41.136042+0000","last_active":"2024-04-25T22:44:52.078000+0000","last_peered":"2024-04-25T22:44:52.078000+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130862+0000","last_became_peered":"2024-04-25T22:44:41.130862+0000","last_unstale":"2024-04-25T22:44:52.078000+0000","last_undegraded":"2024-04-25T22:44:41.117168+0000","last_fullsized":"2024-04-25T22:44:41.116538+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14688,"num_write":405,"num_write_kb":38957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"71'382","reported_seq":595,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.091044+0000","last_change":"2024-04-25T22:44:30.401893+0000","last_active":"2024-04-25T22:44:57.091044+0000","last_peered":"2024-04-25T22:44:57.091044+0000","last_clean":"2024-04-25T22:44:57.091044+0000","last_became_active":"2024-04-25T22:44:30.401021+0000","last_became_peered":"2024-04-25T22:44:30.401021+0000","last_unstale":"2024-04-25T22:44:57.091044+0000","last_undegraded":"2024-04-25T22:44:57.091044+0000","last_fullsized":"2024-04-25T22:44:57.091044+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:38.452482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'453","reported_seq":681,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089835+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:44:57.089835+0000","last_peered":"2024-04-25T22:44:57.089835+0000","last_clean":"2024-04-25T22:44:57.089835+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:44:57.089835+0000","last_undegraded":"2024-04-25T22:44:57.089835+0000","last_fullsized":"2024-04-25T22:44:57.089835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18900,"num_write":418,"num_write_kb":117500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"71'64","reported_seq":263,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090717+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:44:57.090717+0000","last_peered":"2024-04-25T22:44:57.090717+0000","last_clean":"2024-04-25T22:44:57.090717+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:44:57.090717+0000","last_undegraded":"2024-04-25T22:44:57.090717+0000","last_fullsized":"2024-04-25T22:44:57.090717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'428","reported_seq":627,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.084682+0000","last_change":"2024-04-25T22:44:39.129871+0000","last_active":"2024-04-25T22:44:57.084682+0000","last_peered":"2024-04-25T22:44:57.084682+0000","last_clean":"2024-04-25T22:44:57.084682+0000","last_became_active":"2024-04-25T22:44:39.121205+0000","last_became_peered":"2024-04-25T22:44:39.121205+0000","last_unstale":"2024-04-25T22:44:57.084682+0000","last_undegraded":"2024-04-25T22:44:57.084682+0000","last_fullsized":"2024-04-25T22:44:57.084682+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:48.521828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7477,"num_write":383,"num_write_kb":9617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'166","reported_seq":318,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.084856+0000","last_change":"2024-04-25T22:44:39.133550+0000","last_active":"2024-04-25T22:44:57.084856+0000","last_peered":"2024-04-25T22:44:57.084856+0000","last_clean":"2024-04-25T22:44:57.084856+0000","last_became_active":"2024-04-25T22:44:39.131489+0000","last_became_peered":"2024-04-25T22:44:39.131489+0000","last_unstale":"2024-04-25T22:44:57.084856+0000","last_undegraded":"2024-04-25T22:44:57.084856+0000","last_fullsized":"2024-04-25T22:44:57.084856+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:32.980801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"72'446","reported_seq":692,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090073+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:44:57.090073+0000","last_peered":"2024-04-25T22:44:57.090073+0000","last_clean":"2024-04-25T22:44:57.090073+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:44:57.090073+0000","last_undegraded":"2024-04-25T22:44:57.090073+0000","last_fullsized":"2024-04-25T22:44:57.090073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27788,"num_write":414,"num_write_kb":47058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"71'113","reported_seq":312,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090763+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:44:57.090763+0000","last_peered":"2024-04-25T22:44:57.090763+0000","last_clean":"2024-04-25T22:44:57.090763+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:44:57.090763+0000","last_undegraded":"2024-04-25T22:44:57.090763+0000","last_fullsized":"2024-04-25T22:44:57.090763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"72'417","reported_seq":1015,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090705+0000","last_change":"2024-04-25T22:44:44.113498+0000","last_active":"2024-04-25T22:44:57.090705+0000","last_peered":"2024-04-25T22:44:57.090705+0000","last_clean":"2024-04-25T22:44:57.090705+0000","last_became_active":"2024-04-25T22:44:44.108084+0000","last_became_peered":"2024-04-25T22:44:44.108084+0000","last_unstale":"2024-04-25T22:44:57.090705+0000","last_undegraded":"2024-04-25T22:44:57.090705+0000","last_fullsized":"2024-04-25T22:44:57.090705+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16487,"num_write":388,"num_write_kb":75452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'59","reported_seq":79,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375230+0000","last_change":"2024-04-25T22:44:41.417821+0000","last_active":"2024-04-25T22:44:54.375230+0000","last_peered":"2024-04-25T22:44:54.375230+0000","last_clean":"2024-04-25T22:44:54.375230+0000","last_became_active":"2024-04-25T22:44:41.415769+0000","last_became_peered":"2024-04-25T22:44:41.415769+0000","last_unstale":"2024-04-25T22:44:54.375230+0000","last_undegraded":"2024-04-25T22:44:54.375230+0000","last_fullsized":"2024-04-25T22:44:54.375230+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.099475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'358","reported_seq":896,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090560+0000","last_change":"2024-04-25T22:44:34.101942+0000","last_active":"2024-04-25T22:44:57.090560+0000","last_peered":"2024-04-25T22:44:57.090560+0000","last_clean":"2024-04-25T22:44:57.090560+0000","last_became_active":"2024-04-25T22:44:34.099595+0000","last_became_peered":"2024-04-25T22:44:34.099595+0000","last_unstale":"2024-04-25T22:44:57.090560+0000","last_undegraded":"2024-04-25T22:44:57.090560+0000","last_fullsized":"2024-04-25T22:44:57.090560+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:06.523166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12259,"num_write":325,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'465","reported_seq":624,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375647+0000","last_change":"2024-04-25T22:44:41.425331+0000","last_active":"2024-04-25T22:44:54.375647+0000","last_peered":"2024-04-25T22:44:54.375647+0000","last_clean":"2024-04-25T22:44:54.375647+0000","last_became_active":"2024-04-25T22:44:41.423799+0000","last_became_peered":"2024-04-25T22:44:41.423799+0000","last_unstale":"2024-04-25T22:44:54.375647+0000","last_undegraded":"2024-04-25T22:44:54.375647+0000","last_fullsized":"2024-04-25T22:44:54.375647+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:04.324825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"72'386","reported_seq":951,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085677+0000","last_change":"2024-04-25T22:44:46.113269+0000","last_active":"2024-04-25T22:44:57.085677+0000","last_peered":"2024-04-25T22:44:57.085677+0000","last_clean":"2024-04-25T22:44:57.085677+0000","last_became_active":"2024-04-25T22:44:46.110394+0000","last_became_peered":"2024-04-25T22:44:46.110394+0000","last_unstale":"2024-04-25T22:44:57.085677+0000","last_undegraded":"2024-04-25T22:44:57.085677+0000","last_fullsized":"2024-04-25T22:44:57.085677+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9402,"num_write":352,"num_write_kb":50548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":414,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089713+0000","last_change":"2024-04-25T22:44:26.355770+0000","last_active":"2024-04-25T22:44:57.089713+0000","last_peered":"2024-04-25T22:44:57.089713+0000","last_clean":"2024-04-25T22:44:57.089713+0000","last_became_active":"2024-04-25T22:44:26.354730+0000","last_became_peered":"2024-04-25T22:44:26.354730+0000","last_unstale":"2024-04-25T22:44:57.089713+0000","last_undegraded":"2024-04-25T22:44:57.089713+0000","last_fullsized":"2024-04-25T22:44:57.089713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:34.987031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":205,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.091577+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:44:57.091577+0000","last_peered":"2024-04-25T22:44:57.091577+0000","last_clean":"2024-04-25T22:44:57.091577+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:44:57.091577+0000","last_undegraded":"2024-04-25T22:44:57.091577+0000","last_fullsized":"2024-04-25T22:44:57.091577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"71'457","reported_seq":672,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.084423+0000","last_change":"2024-04-25T22:44:29.399148+0000","last_active":"2024-04-25T22:44:57.084423+0000","last_peered":"2024-04-25T22:44:57.084423+0000","last_clean":"2024-04-25T22:44:57.084423+0000","last_became_active":"2024-04-25T22:44:29.397962+0000","last_became_peered":"2024-04-25T22:44:29.397962+0000","last_unstale":"2024-04-25T22:44:57.084423+0000","last_undegraded":"2024-04-25T22:44:57.084423+0000","last_fullsized":"2024-04-25T22:44:57.084423+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:14.015619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"72'447","reported_seq":1107,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090730+0000","last_change":"2024-04-25T22:44:43.108262+0000","last_active":"2024-04-25T22:44:57.090730+0000","last_peered":"2024-04-25T22:44:57.090730+0000","last_clean":"2024-04-25T22:44:57.090730+0000","last_became_active":"2024-04-25T22:44:43.105231+0000","last_became_peered":"2024-04-25T22:44:43.105231+0000","last_unstale":"2024-04-25T22:44:57.090730+0000","last_undegraded":"2024-04-25T22:44:57.090730+0000","last_fullsized":"2024-04-25T22:44:57.090730+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:09.728618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45074,"num_write":414,"num_write_kb":120596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":212,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089494+0000","last_change":"2024-04-25T22:44:26.355238+0000","last_active":"2024-04-25T22:44:57.089494+0000","last_peered":"2024-04-25T22:44:57.089494+0000","last_clean":"2024-04-25T22:44:57.089494+0000","last_became_active":"2024-04-25T22:44:26.354482+0000","last_became_peered":"2024-04-25T22:44:26.354482+0000","last_unstale":"2024-04-25T22:44:57.089494+0000","last_undegraded":"2024-04-25T22:44:57.089494+0000","last_fullsized":"2024-04-25T22:44:57.089494+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.042514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'122","reported_seq":336,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.084113+0000","last_change":"2024-04-25T22:44:39.141843+0000","last_active":"2024-04-25T22:44:57.084113+0000","last_peered":"2024-04-25T22:44:57.084113+0000","last_clean":"2024-04-25T22:44:57.084113+0000","last_became_active":"2024-04-25T22:44:39.139689+0000","last_became_peered":"2024-04-25T22:44:39.139689+0000","last_unstale":"2024-04-25T22:44:57.084113+0000","last_undegraded":"2024-04-25T22:44:57.084113+0000","last_fullsized":"2024-04-25T22:44:57.084113+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:18.614670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":62,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"72'449","reported_seq":642,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.378064+0000","last_change":"2024-04-25T22:44:41.439044+0000","last_active":"2024-04-25T22:44:54.378064+0000","last_peered":"2024-04-25T22:44:54.378064+0000","last_clean":"2024-04-25T22:44:54.378064+0000","last_became_active":"2024-04-25T22:44:41.432785+0000","last_became_peered":"2024-04-25T22:44:41.432785+0000","last_unstale":"2024-04-25T22:44:54.378064+0000","last_undegraded":"2024-04-25T22:44:54.378064+0000","last_fullsized":"2024-04-25T22:44:54.378064+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:57.171725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25191,"num_write":420,"num_write_kb":79855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":213,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.084438+0000","last_change":"2024-04-25T22:44:26.363464+0000","last_active":"2024-04-25T22:44:57.084438+0000","last_peered":"2024-04-25T22:44:57.084438+0000","last_clean":"2024-04-25T22:44:57.084438+0000","last_became_active":"2024-04-25T22:44:26.362808+0000","last_became_peered":"2024-04-25T22:44:26.362808+0000","last_unstale":"2024-04-25T22:44:57.084438+0000","last_undegraded":"2024-04-25T22:44:57.084438+0000","last_fullsized":"2024-04-25T22:44:57.084438+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:06.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'435","reported_seq":620,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375077+0000","last_change":"2024-04-25T22:44:41.417191+0000","last_active":"2024-04-25T22:44:54.375077+0000","last_peered":"2024-04-25T22:44:54.375077+0000","last_clean":"2024-04-25T22:44:54.375077+0000","last_became_active":"2024-04-25T22:44:41.415592+0000","last_became_peered":"2024-04-25T22:44:41.415592+0000","last_unstale":"2024-04-25T22:44:54.375077+0000","last_undegraded":"2024-04-25T22:44:54.375077+0000","last_fullsized":"2024-04-25T22:44:54.375077+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:35.916512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"72'337","reported_seq":884,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085841+0000","last_change":"2024-04-25T22:44:45.113523+0000","last_active":"2024-04-25T22:44:57.085841+0000","last_peered":"2024-04-25T22:44:57.085841+0000","last_clean":"2024-04-25T22:44:57.085841+0000","last_became_active":"2024-04-25T22:44:45.111011+0000","last_became_peered":"2024-04-25T22:44:45.111011+0000","last_unstale":"2024-04-25T22:44:57.085841+0000","last_undegraded":"2024-04-25T22:44:57.085841+0000","last_fullsized":"2024-04-25T22:44:57.085841+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25242,"num_write":307,"num_write_kb":26250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":205,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090534+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:44:57.090534+0000","last_peered":"2024-04-25T22:44:57.090534+0000","last_clean":"2024-04-25T22:44:57.090534+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:44:57.090534+0000","last_undegraded":"2024-04-25T22:44:57.090534+0000","last_fullsized":"2024-04-25T22:44:57.090534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"71'61","reported_seq":260,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.091340+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:44:57.091340+0000","last_peered":"2024-04-25T22:44:57.091340+0000","last_clean":"2024-04-25T22:44:57.091340+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:44:57.091340+0000","last_undegraded":"2024-04-25T22:44:57.091340+0000","last_fullsized":"2024-04-25T22:44:57.091340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'404","reported_seq":1012,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085241+0000","last_change":"2024-04-25T22:44:32.092728+0000","last_active":"2024-04-25T22:44:57.085241+0000","last_peered":"2024-04-25T22:44:57.085241+0000","last_clean":"2024-04-25T22:44:57.085241+0000","last_became_active":"2024-04-25T22:44:32.087528+0000","last_became_peered":"2024-04-25T22:44:32.087528+0000","last_unstale":"2024-04-25T22:44:57.085241+0000","last_undegraded":"2024-04-25T22:44:57.085241+0000","last_fullsized":"2024-04-25T22:44:57.085241+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:39.481467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":20287,"num_write":371,"num_write_kb":59919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'285","reported_seq":484,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.091055+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:44:57.091055+0000","last_peered":"2024-04-25T22:44:57.091055+0000","last_clean":"2024-04-25T22:44:57.091055+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:44:57.091055+0000","last_undegraded":"2024-04-25T22:44:57.091055+0000","last_fullsized":"2024-04-25T22:44:57.091055+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":213,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085551+0000","last_change":"2024-04-25T22:44:26.364185+0000","last_active":"2024-04-25T22:44:57.085551+0000","last_peered":"2024-04-25T22:44:57.085551+0000","last_clean":"2024-04-25T22:44:57.085551+0000","last_became_active":"2024-04-25T22:44:26.363583+0000","last_became_peered":"2024-04-25T22:44:26.363583+0000","last_unstale":"2024-04-25T22:44:57.085551+0000","last_undegraded":"2024-04-25T22:44:57.085551+0000","last_fullsized":"2024-04-25T22:44:57.085551+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:35:04.325449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"72'366","reported_seq":512,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376225+0000","last_change":"2024-04-25T22:44:52.381174+0000","last_active":"2024-04-25T22:44:54.376225+0000","last_peered":"2024-04-25T22:44:54.376225+0000","last_clean":"2024-04-25T22:44:54.376225+0000","last_became_active":"2024-04-25T22:44:52.375504+0000","last_became_peered":"2024-04-25T22:44:52.375504+0000","last_unstale":"2024-04-25T22:44:54.376225+0000","last_undegraded":"2024-04-25T22:44:54.376225+0000","last_fullsized":"2024-04-25T22:44:54.376225+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:41.592790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":346,"num_write":330,"num_write_kb":33934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":261,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085288+0000","last_change":"2024-04-25T22:44:26.364178+0000","last_active":"2024-04-25T22:44:57.085288+0000","last_peered":"2024-04-25T22:44:57.085288+0000","last_clean":"2024-04-25T22:44:57.085288+0000","last_became_active":"2024-04-25T22:44:26.363455+0000","last_became_peered":"2024-04-25T22:44:26.363455+0000","last_unstale":"2024-04-25T22:44:57.085288+0000","last_undegraded":"2024-04-25T22:44:57.085288+0000","last_fullsized":"2024-04-25T22:44:57.085288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:58.181763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.378144+0000","last_change":"2024-04-25T22:44:41.423030+0000","last_active":"2024-04-25T22:44:54.378144+0000","last_peered":"2024-04-25T22:44:54.378144+0000","last_clean":"2024-04-25T22:44:54.378144+0000","last_became_active":"2024-04-25T22:44:41.421194+0000","last_became_peered":"2024-04-25T22:44:41.421194+0000","last_unstale":"2024-04-25T22:44:54.378144+0000","last_undegraded":"2024-04-25T22:44:54.378144+0000","last_fullsized":"2024-04-25T22:44:54.378144+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:59.297537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'413","reported_seq":617,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376317+0000","last_change":"2024-04-25T22:44:48.378474+0000","last_active":"2024-04-25T22:44:54.376317+0000","last_peered":"2024-04-25T22:44:54.376317+0000","last_clean":"2024-04-25T22:44:54.376317+0000","last_became_active":"2024-04-25T22:44:48.372485+0000","last_became_peered":"2024-04-25T22:44:48.372485+0000","last_unstale":"2024-04-25T22:44:54.376317+0000","last_undegraded":"2024-04-25T22:44:54.376317+0000","last_fullsized":"2024-04-25T22:44:54.376317+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:47.402437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22994,"num_write":377,"num_write_kb":63140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'57","reported_seq":265,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.086582+0000","last_change":"2024-04-25T22:44:26.366189+0000","last_active":"2024-04-25T22:44:57.086582+0000","last_peered":"2024-04-25T22:44:57.086582+0000","last_clean":"2024-04-25T22:44:57.086582+0000","last_became_active":"2024-04-25T22:44:26.365267+0000","last_became_peered":"2024-04-25T22:44:26.365267+0000","last_unstale":"2024-04-25T22:44:57.086582+0000","last_undegraded":"2024-04-25T22:44:57.086582+0000","last_fullsized":"2024-04-25T22:44:57.086582+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:54.128937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":213,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.086788+0000","last_change":"2024-04-25T22:44:26.361633+0000","last_active":"2024-04-25T22:44:57.086788+0000","last_peered":"2024-04-25T22:44:57.086788+0000","last_clean":"2024-04-25T22:44:57.086788+0000","last_became_active":"2024-04-25T22:44:26.360968+0000","last_became_peered":"2024-04-25T22:44:26.360968+0000","last_unstale":"2024-04-25T22:44:57.086788+0000","last_undegraded":"2024-04-25T22:44:57.086788+0000","last_fullsized":"2024-04-25T22:44:57.086788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:40.454898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'398","reported_seq":595,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.083951+0000","last_change":"2024-04-25T22:44:39.132801+0000","last_active":"2024-04-25T22:44:57.083951+0000","last_peered":"2024-04-25T22:44:57.083951+0000","last_clean":"2024-04-25T22:44:57.083951+0000","last_became_active":"2024-04-25T22:44:39.124378+0000","last_became_peered":"2024-04-25T22:44:39.124378+0000","last_unstale":"2024-04-25T22:44:57.083951+0000","last_undegraded":"2024-04-25T22:44:57.083951+0000","last_fullsized":"2024-04-25T22:44:57.083951+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:29.195889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6306,"num_write":372,"num_write_kb":34077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'100","reported_seq":302,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.086644+0000","last_change":"2024-04-25T22:44:39.150245+0000","last_active":"2024-04-25T22:44:57.086644+0000","last_peered":"2024-04-25T22:44:57.086644+0000","last_clean":"2024-04-25T22:44:57.086644+0000","last_became_active":"2024-04-25T22:44:39.147377+0000","last_became_peered":"2024-04-25T22:44:39.147377+0000","last_unstale":"2024-04-25T22:44:57.086644+0000","last_undegraded":"2024-04-25T22:44:57.086644+0000","last_fullsized":"2024-04-25T22:44:57.086644+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:36.007978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":212,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.091785+0000","last_change":"2024-04-25T22:44:26.360890+0000","last_active":"2024-04-25T22:44:57.091785+0000","last_peered":"2024-04-25T22:44:57.091785+0000","last_clean":"2024-04-25T22:44:57.091785+0000","last_became_active":"2024-04-25T22:44:26.360106+0000","last_became_peered":"2024-04-25T22:44:26.360106+0000","last_unstale":"2024-04-25T22:44:57.091785+0000","last_undegraded":"2024-04-25T22:44:57.091785+0000","last_fullsized":"2024-04-25T22:44:57.091785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:09.929196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'390","reported_seq":611,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375973+0000","last_change":"2024-04-25T22:44:41.433574+0000","last_active":"2024-04-25T22:44:54.375973+0000","last_peered":"2024-04-25T22:44:54.375973+0000","last_clean":"2024-04-25T22:44:54.375973+0000","last_became_active":"2024-04-25T22:44:41.414924+0000","last_became_peered":"2024-04-25T22:44:41.414924+0000","last_unstale":"2024-04-25T22:44:54.375973+0000","last_undegraded":"2024-04-25T22:44:54.375973+0000","last_fullsized":"2024-04-25T22:44:54.375973+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:46.695300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":22915,"num_write":352,"num_write_kb":47201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"72'411","reported_seq":1004,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090546+0000","last_change":"2024-04-25T22:44:32.090492+0000","last_active":"2024-04-25T22:44:57.090546+0000","last_peered":"2024-04-25T22:44:57.090546+0000","last_clean":"2024-04-25T22:44:57.090546+0000","last_became_active":"2024-04-25T22:44:32.087303+0000","last_became_peered":"2024-04-25T22:44:32.087303+0000","last_unstale":"2024-04-25T22:44:57.090546+0000","last_undegraded":"2024-04-25T22:44:57.090546+0000","last_fullsized":"2024-04-25T22:44:57.090546+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25412,"num_write":367,"num_write_kb":64656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'268","reported_seq":485,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090707+0000","last_change":"2024-04-25T22:44:29.399184+0000","last_active":"2024-04-25T22:44:57.090707+0000","last_peered":"2024-04-25T22:44:57.090707+0000","last_clean":"2024-04-25T22:44:57.090707+0000","last_became_active":"2024-04-25T22:44:29.398317+0000","last_became_peered":"2024-04-25T22:44:29.398317+0000","last_unstale":"2024-04-25T22:44:57.090707+0000","last_undegraded":"2024-04-25T22:44:57.090707+0000","last_fullsized":"2024-04-25T22:44:57.090707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:21.765162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382817,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"72'423","reported_seq":1043,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.084009+0000","last_change":"2024-04-25T22:44:42.092243+0000","last_active":"2024-04-25T22:44:57.084009+0000","last_peered":"2024-04-25T22:44:57.084009+0000","last_clean":"2024-04-25T22:44:57.084009+0000","last_became_active":"2024-04-25T22:44:42.088432+0000","last_became_peered":"2024-04-25T22:44:42.088432+0000","last_unstale":"2024-04-25T22:44:57.084009+0000","last_undegraded":"2024-04-25T22:44:57.084009+0000","last_fullsized":"2024-04-25T22:44:57.084009+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:54.239406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24794,"num_write":386,"num_write_kb":63756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'102","reported_seq":86,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377263+0000","last_change":"2024-04-25T22:44:41.423993+0000","last_active":"2024-04-25T22:44:54.377263+0000","last_peered":"2024-04-25T22:44:54.377263+0000","last_clean":"2024-04-25T22:44:54.377263+0000","last_became_active":"2024-04-25T22:44:41.422237+0000","last_became_peered":"2024-04-25T22:44:41.422237+0000","last_unstale":"2024-04-25T22:44:54.377263+0000","last_undegraded":"2024-04-25T22:44:54.377263+0000","last_fullsized":"2024-04-25T22:44:54.377263+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:02.880774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"71'213","reported_seq":411,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.091650+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:44:57.091650+0000","last_peered":"2024-04-25T22:44:57.091650+0000","last_clean":"2024-04-25T22:44:57.091650+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:44:57.091650+0000","last_undegraded":"2024-04-25T22:44:57.091650+0000","last_fullsized":"2024-04-25T22:44:57.091650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"72'504","reported_seq":765,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.083807+0000","last_change":"2024-04-25T22:44:39.142694+0000","last_active":"2024-04-25T22:44:57.083807+0000","last_peered":"2024-04-25T22:44:57.083807+0000","last_clean":"2024-04-25T22:44:57.083807+0000","last_became_active":"2024-04-25T22:44:39.132582+0000","last_became_peered":"2024-04-25T22:44:39.132582+0000","last_unstale":"2024-04-25T22:44:57.083807+0000","last_undegraded":"2024-04-25T22:44:57.083807+0000","last_fullsized":"2024-04-25T22:44:57.083807+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:14.401644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":46975,"num_write":471,"num_write_kb":146290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'64","reported_seq":215,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.086239+0000","last_change":"2024-04-25T22:44:39.136961+0000","last_active":"2024-04-25T22:44:57.086239+0000","last_peered":"2024-04-25T22:44:57.086239+0000","last_clean":"2024-04-25T22:44:57.086239+0000","last_became_active":"2024-04-25T22:44:39.136090+0000","last_became_peered":"2024-04-25T22:44:39.136090+0000","last_unstale":"2024-04-25T22:44:57.086239+0000","last_undegraded":"2024-04-25T22:44:57.086239+0000","last_fullsized":"2024-04-25T22:44:57.086239+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:35.220314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"72'475","reported_seq":1150,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.083969+0000","last_change":"2024-04-25T22:44:44.106484+0000","last_active":"2024-04-25T22:44:57.083969+0000","last_peered":"2024-04-25T22:44:57.083969+0000","last_clean":"2024-04-25T22:44:57.083969+0000","last_became_active":"2024-04-25T22:44:44.102061+0000","last_became_peered":"2024-04-25T22:44:44.102061+0000","last_unstale":"2024-04-25T22:44:57.083969+0000","last_undegraded":"2024-04-25T22:44:57.083969+0000","last_fullsized":"2024-04-25T22:44:57.083969+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:05.455255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":23011,"num_write":448,"num_write_kb":76439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"72'370","reported_seq":614,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.085079+0000","last_change":"2024-04-25T22:44:41.149278+0000","last_active":"2024-04-25T22:44:52.085079+0000","last_peered":"2024-04-25T22:44:52.085079+0000","last_clean":"2024-04-25T22:41:34.256787+0000","last_became_active":"2024-04-25T22:44:41.144535+0000","last_became_peered":"2024-04-25T22:44:41.144535+0000","last_unstale":"2024-04-25T22:44:52.085079+0000","last_undegraded":"2024-04-25T22:44:41.120919+0000","last_fullsized":"2024-04-25T22:44:41.120194+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":159,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33211,"num_write":340,"num_write_kb":63312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'647","reported_seq":861,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.084125+0000","last_change":"2024-04-25T22:44:30.396965+0000","last_active":"2024-04-25T22:44:57.084125+0000","last_peered":"2024-04-25T22:44:57.084125+0000","last_clean":"2024-04-25T22:44:57.084125+0000","last_became_active":"2024-04-25T22:44:30.396073+0000","last_became_peered":"2024-04-25T22:44:30.396073+0000","last_unstale":"2024-04-25T22:44:57.084125+0000","last_undegraded":"2024-04-25T22:44:57.084125+0000","last_fullsized":"2024-04-25T22:44:57.084125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"72'415","reported_seq":632,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085951+0000","last_change":"2024-04-25T22:44:39.150290+0000","last_active":"2024-04-25T22:44:57.085951+0000","last_peered":"2024-04-25T22:44:57.085951+0000","last_clean":"2024-04-25T22:44:57.085951+0000","last_became_active":"2024-04-25T22:44:39.146949+0000","last_became_peered":"2024-04-25T22:44:39.146949+0000","last_unstale":"2024-04-25T22:44:57.085951+0000","last_undegraded":"2024-04-25T22:44:57.085951+0000","last_fullsized":"2024-04-25T22:44:57.085951+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:11.804350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19493,"num_write":386,"num_write_kb":64692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'207","reported_seq":358,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.083952+0000","last_change":"2024-04-25T22:44:39.141125+0000","last_active":"2024-04-25T22:44:57.083952+0000","last_peered":"2024-04-25T22:44:57.083952+0000","last_clean":"2024-04-25T22:44:57.083952+0000","last_became_active":"2024-04-25T22:44:39.138371+0000","last_became_peered":"2024-04-25T22:44:39.138371+0000","last_unstale":"2024-04-25T22:44:57.083952+0000","last_undegraded":"2024-04-25T22:44:57.083952+0000","last_fullsized":"2024-04-25T22:44:57.083952+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:14.147026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"72'395","reported_seq":546,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-25T22:44:53.510934+0000","last_change":"2024-04-25T22:44:54.660910+0000","last_active":"2024-04-25T22:44:54.660910+0000","last_peered":"2024-04-25T22:44:53.510934+0000","last_clean":"2024-04-25T22:41:34.256072+0000","last_became_active":"2024-04-25T22:44:41.144491+0000","last_became_peered":"2024-04-25T22:44:41.144491+0000","last_unstale":"2024-04-25T22:44:53.510934+0000","last_undegraded":"2024-04-25T22:44:53.510934+0000","last_fullsized":"2024-04-25T22:44:41.118876+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9576,"num_write":348,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'194","reported_seq":353,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375784+0000","last_change":"2024-04-25T22:44:41.422369+0000","last_active":"2024-04-25T22:44:54.375784+0000","last_peered":"2024-04-25T22:44:54.375784+0000","last_clean":"2024-04-25T22:44:54.375784+0000","last_became_active":"2024-04-25T22:44:41.420491+0000","last_became_peered":"2024-04-25T22:44:41.420491+0000","last_unstale":"2024-04-25T22:44:54.375784+0000","last_undegraded":"2024-04-25T22:44:54.375784+0000","last_fullsized":"2024-04-25T22:44:54.375784+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:35.081225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360511,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":12143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12360511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"72'398","reported_seq":583,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.378098+0000","last_change":"2024-04-25T22:44:52.381363+0000","last_active":"2024-04-25T22:44:54.378098+0000","last_peered":"2024-04-25T22:44:54.378098+0000","last_clean":"2024-04-25T22:44:54.378098+0000","last_became_active":"2024-04-25T22:44:52.375632+0000","last_became_peered":"2024-04-25T22:44:52.375632+0000","last_unstale":"2024-04-25T22:44:54.378098+0000","last_undegraded":"2024-04-25T22:44:54.378098+0000","last_fullsized":"2024-04-25T22:44:54.378098+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:38:28.441621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31284,"num_write":371,"num_write_kb":80144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"71'51","reported_seq":84,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375713+0000","last_change":"2024-04-25T22:44:41.415722+0000","last_active":"2024-04-25T22:44:54.375713+0000","last_peered":"2024-04-25T22:44:54.375713+0000","last_clean":"2024-04-25T22:44:54.375713+0000","last_became_active":"2024-04-25T22:44:41.414774+0000","last_became_peered":"2024-04-25T22:44:41.414774+0000","last_unstale":"2024-04-25T22:44:54.375713+0000","last_undegraded":"2024-04-25T22:44:54.375713+0000","last_fullsized":"2024-04-25T22:44:54.375713+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:20.553373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"72'383","reported_seq":631,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090045+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:44:57.090045+0000","last_peered":"2024-04-25T22:44:57.090045+0000","last_clean":"2024-04-25T22:44:57.090045+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:44:57.090045+0000","last_undegraded":"2024-04-25T22:44:57.090045+0000","last_fullsized":"2024-04-25T22:44:57.090045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29308,"num_write":358,"num_write_kb":66975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"71'177","reported_seq":375,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090375+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:44:57.090375+0000","last_peered":"2024-04-25T22:44:57.090375+0000","last_clean":"2024-04-25T22:44:57.090375+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:44:57.090375+0000","last_undegraded":"2024-04-25T22:44:57.090375+0000","last_fullsized":"2024-04-25T22:44:57.090375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"72'387","reported_seq":596,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090054+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:44:57.090054+0000","last_peered":"2024-04-25T22:44:57.090054+0000","last_clean":"2024-04-25T22:44:57.090054+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:44:57.090054+0000","last_undegraded":"2024-04-25T22:44:57.090054+0000","last_fullsized":"2024-04-25T22:44:57.090054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3883,"num_write":348,"num_write_kb":34122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'209","reported_seq":403,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376952+0000","last_change":"2024-04-25T22:44:41.419972+0000","last_active":"2024-04-25T22:44:54.376952+0000","last_peered":"2024-04-25T22:44:54.376952+0000","last_clean":"2024-04-25T22:44:54.376952+0000","last_became_active":"2024-04-25T22:44:41.418106+0000","last_became_peered":"2024-04-25T22:44:41.418106+0000","last_unstale":"2024-04-25T22:44:54.376952+0000","last_undegraded":"2024-04-25T22:44:54.376952+0000","last_fullsized":"2024-04-25T22:44:54.376952+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:07.628155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":12363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"72'419","reported_seq":597,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375672+0000","last_change":"2024-04-25T22:44:41.434376+0000","last_active":"2024-04-25T22:44:54.375672+0000","last_peered":"2024-04-25T22:44:54.375672+0000","last_clean":"2024-04-25T22:44:54.375672+0000","last_became_active":"2024-04-25T22:44:41.420505+0000","last_became_peered":"2024-04-25T22:44:41.420505+0000","last_unstale":"2024-04-25T22:44:54.375672+0000","last_undegraded":"2024-04-25T22:44:54.375672+0000","last_fullsized":"2024-04-25T22:44:54.375672+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:04.414563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":13327,"num_write":388,"num_write_kb":55674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"71'131","reported_seq":345,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.086456+0000","last_change":"2024-04-25T22:44:29.398880+0000","last_active":"2024-04-25T22:44:57.086456+0000","last_peered":"2024-04-25T22:44:57.086456+0000","last_clean":"2024-04-25T22:44:57.086456+0000","last_became_active":"2024-04-25T22:44:29.397905+0000","last_became_peered":"2024-04-25T22:44:29.397905+0000","last_unstale":"2024-04-25T22:44:57.086456+0000","last_undegraded":"2024-04-25T22:44:57.086456+0000","last_fullsized":"2024-04-25T22:44:57.086456+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:44.236330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"72'449","reported_seq":679,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089179+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:44:57.089179+0000","last_peered":"2024-04-25T22:44:57.089179+0000","last_clean":"2024-04-25T22:44:57.089179+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:44:57.089179+0000","last_undegraded":"2024-04-25T22:44:57.089179+0000","last_fullsized":"2024-04-25T22:44:57.089179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14222,"num_write":424,"num_write_kb":79796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"71'57","reported_seq":209,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085966+0000","last_change":"2024-04-25T22:44:39.137232+0000","last_active":"2024-04-25T22:44:57.085966+0000","last_peered":"2024-04-25T22:44:57.085966+0000","last_clean":"2024-04-25T22:44:57.085966+0000","last_became_active":"2024-04-25T22:44:39.136283+0000","last_became_peered":"2024-04-25T22:44:39.136283+0000","last_unstale":"2024-04-25T22:44:57.085966+0000","last_undegraded":"2024-04-25T22:44:57.085966+0000","last_fullsized":"2024-04-25T22:44:57.085966+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:32.428982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":885,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2461,"num_read_kb":1248646,"num_write":24434,"num_write_kb":4137258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6487,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26539,"ondisk_log_size":26539,"up":128,"acting":122,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127071275,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":4473,"num_write_kb":127409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254210048,"data_stored":254142550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},"log_size":6216,"ondisk_log_size":6216,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738433,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165320,"kb_used_data":80056,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94206520,"statfs":{"total":96636764160,"available":96467476480,"internally_reserved":0,"allocated":81977344,"data_stored":81404823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":79,"seq":339302416392,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133032,"kb_used_data":83284,"kb_used_omap":5,"kb_used_meta":49722,"kb_avail":94238808,"statfs":{"total":96636764160,"available":96500539392,"internally_reserved":0,"allocated":85282816,"data_stored":84713423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6003,"internal_metadata":50915469},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738433,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174328,"kb_used_data":89064,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94197512,"statfs":{"total":96636764160,"available":96458252288,"internally_reserved":0,"allocated":91201536,"data_stored":90607054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89575424,"data_stored":89544940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83689472,"data_stored":83664533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80945152,"data_stored":80933077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:44:59.701 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T22:45:00.086 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:45:00.087 INFO:teuthology.orchestra.run.smithi057.stdout:{"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1061/108 objects degraded (982.407%), 6 pgs degraded","count":6},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":307,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":113,"num_osds":3,"num_up_osds":3,"osd_up_since":1714085065,"num_in_osds":3,"osd_in_since":1714084793,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":98},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":6},{"state_name":"peering","count":1}],"num_pgs":105,"num_pools":4,"num_objects":54,"data_bytes":127661643,"bytes_used":483917824,"bytes_avail":289426374656,"bytes_total":289910292480,"inactive_pgs_ratio":0.0095238098874688148,"degraded_objects":1061,"degraded_total":108,"degraded_ratio":9.8240740740740744,"recovering_objects_per_sec":302,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1210,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4192}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-25T22:41:21.139402+0000","services":{}},"progress_events":{}} 2024-04-25T22:45:00.106 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-25T22:45:00.106 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:45:00.420 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:45:00.422 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:45:00.440 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2024-04-25T22:44:59.242118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127661643,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":885,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2659,"num_read_kb":1250233,"num_write":29110,"num_write_kb":4268127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6509,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32912,"ondisk_log_size":32912,"up":210,"acting":204,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":472680,"kb_used_data":252404,"kb_used_omap":8,"kb_used_meta":220215,"kb_avail":282642840,"statfs":{"total":289910292480,"available":289426268160,"internally_reserved":0,"allocated":258461696,"data_stored":256725300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9193,"internal_metadata":225500183},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001428"},"pg_stats":[{"pgid":"4.3f","version":"72'404","reported_seq":609,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.080209+0000","last_change":"2024-04-25T22:44:41.145114+0000","last_active":"2024-04-25T22:44:52.080209+0000","last_peered":"2024-04-25T22:44:52.080209+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.142277+0000","last_became_peered":"2024-04-25T22:44:41.142277+0000","last_unstale":"2024-04-25T22:44:52.080209+0000","last_undegraded":"2024-04-25T22:44:41.121372+0000","last_fullsized":"2024-04-25T22:44:41.120599+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19772,"num_write":366,"num_write_kb":46873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"72'420","reported_seq":612,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377841+0000","last_change":"2024-04-25T22:44:41.434387+0000","last_active":"2024-04-25T22:44:54.377841+0000","last_peered":"2024-04-25T22:44:54.377841+0000","last_clean":"2024-04-25T22:44:54.377841+0000","last_became_active":"2024-04-25T22:44:41.418792+0000","last_became_peered":"2024-04-25T22:44:41.418792+0000","last_unstale":"2024-04-25T22:44:54.377841+0000","last_undegraded":"2024-04-25T22:44:54.377841+0000","last_fullsized":"2024-04-25T22:44:54.377841+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:43.196115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24515,"num_write":386,"num_write_kb":55688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"72'377","reported_seq":948,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089891+0000","last_change":"2024-04-25T22:44:42.096911+0000","last_active":"2024-04-25T22:44:57.089891+0000","last_peered":"2024-04-25T22:44:57.089891+0000","last_clean":"2024-04-25T22:44:57.089891+0000","last_became_active":"2024-04-25T22:44:42.093941+0000","last_became_peered":"2024-04-25T22:44:42.093941+0000","last_unstale":"2024-04-25T22:44:57.089891+0000","last_undegraded":"2024-04-25T22:44:57.089891+0000","last_fullsized":"2024-04-25T22:44:57.089891+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11135,"num_write":346,"num_write_kb":38950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"72'366","reported_seq":569,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089545+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:44:57.089545+0000","last_peered":"2024-04-25T22:44:57.089545+0000","last_clean":"2024-04-25T22:44:57.089545+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:44:57.089545+0000","last_undegraded":"2024-04-25T22:44:57.089545+0000","last_fullsized":"2024-04-25T22:44:57.089545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":326,"num_write_kb":34079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"72'455","reported_seq":625,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375993+0000","last_change":"2024-04-25T22:44:50.391674+0000","last_active":"2024-04-25T22:44:54.375993+0000","last_peered":"2024-04-25T22:44:54.375993+0000","last_clean":"2024-04-25T22:44:54.375993+0000","last_became_active":"2024-04-25T22:44:50.384804+0000","last_became_peered":"2024-04-25T22:44:50.384804+0000","last_unstale":"2024-04-25T22:44:54.375993+0000","last_undegraded":"2024-04-25T22:44:54.375993+0000","last_fullsized":"2024-04-25T22:44:54.375993+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:22:54.239989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33897,"num_write":426,"num_write_kb":100721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"72'401","reported_seq":631,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089351+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:44:57.089351+0000","last_peered":"2024-04-25T22:44:57.089351+0000","last_clean":"2024-04-25T22:44:57.089351+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:44:57.089351+0000","last_undegraded":"2024-04-25T22:44:57.089351+0000","last_fullsized":"2024-04-25T22:44:57.089351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15258,"num_write":369,"num_write_kb":53298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"72'452","reported_seq":714,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089148+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:44:57.089148+0000","last_peered":"2024-04-25T22:44:57.089148+0000","last_clean":"2024-04-25T22:44:57.089148+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:44:57.089148+0000","last_undegraded":"2024-04-25T22:44:57.089148+0000","last_fullsized":"2024-04-25T22:44:57.089148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34010,"num_write":428,"num_write_kb":157752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"72'401","reported_seq":636,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.088607+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:44:57.088607+0000","last_peered":"2024-04-25T22:44:57.088607+0000","last_clean":"2024-04-25T22:44:57.088607+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:44:57.088607+0000","last_undegraded":"2024-04-25T22:44:57.088607+0000","last_fullsized":"2024-04-25T22:44:57.088607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19917,"num_write":359,"num_write_kb":109382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"72'394","reported_seq":976,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085315+0000","last_change":"2024-04-25T22:44:48.092689+0000","last_active":"2024-04-25T22:44:57.085315+0000","last_peered":"2024-04-25T22:44:57.085315+0000","last_clean":"2024-04-25T22:44:57.085315+0000","last_became_active":"2024-04-25T22:44:48.089795+0000","last_became_peered":"2024-04-25T22:44:48.089795+0000","last_unstale":"2024-04-25T22:44:57.085315+0000","last_undegraded":"2024-04-25T22:44:57.085315+0000","last_fullsized":"2024-04-25T22:44:57.085315+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:32:33.072950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9569,"num_write":360,"num_write_kb":25560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"72'382","reported_seq":556,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377780+0000","last_change":"2024-04-25T22:44:41.433644+0000","last_active":"2024-04-25T22:44:54.377780+0000","last_peered":"2024-04-25T22:44:54.377780+0000","last_clean":"2024-04-25T22:44:54.377780+0000","last_became_active":"2024-04-25T22:44:41.421234+0000","last_became_peered":"2024-04-25T22:44:41.421234+0000","last_unstale":"2024-04-25T22:44:54.377780+0000","last_undegraded":"2024-04-25T22:44:54.377780+0000","last_fullsized":"2024-04-25T22:44:54.377780+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:24.217391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17192,"num_write":338,"num_write_kb":38688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"72'369","reported_seq":588,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089976+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:44:57.089976+0000","last_peered":"2024-04-25T22:44:57.089976+0000","last_clean":"2024-04-25T22:44:57.089976+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:44:57.089976+0000","last_undegraded":"2024-04-25T22:44:57.089976+0000","last_fullsized":"2024-04-25T22:44:57.089976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7385,"num_write":349,"num_write_kb":58842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"72'338","reported_seq":512,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377657+0000","last_change":"2024-04-25T22:44:49.384005+0000","last_active":"2024-04-25T22:44:54.377657+0000","last_peered":"2024-04-25T22:44:54.377657+0000","last_clean":"2024-04-25T22:44:54.377657+0000","last_became_active":"2024-04-25T22:44:49.378325+0000","last_became_peered":"2024-04-25T22:44:49.378325+0000","last_unstale":"2024-04-25T22:44:54.377657+0000","last_undegraded":"2024-04-25T22:44:54.377657+0000","last_fullsized":"2024-04-25T22:44:54.377657+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:18.849786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13619,"num_write":312,"num_write_kb":21391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"72'411","reported_seq":595,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376695+0000","last_change":"2024-04-25T22:44:41.432463+0000","last_active":"2024-04-25T22:44:54.376695+0000","last_peered":"2024-04-25T22:44:54.376695+0000","last_clean":"2024-04-25T22:44:54.376695+0000","last_became_active":"2024-04-25T22:44:41.421096+0000","last_became_peered":"2024-04-25T22:44:41.421096+0000","last_unstale":"2024-04-25T22:44:54.376695+0000","last_undegraded":"2024-04-25T22:44:54.376695+0000","last_fullsized":"2024-04-25T22:44:54.376695+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:46.942677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12998,"num_write":375,"num_write_kb":79661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"72'452","reported_seq":1047,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089901+0000","last_change":"2024-04-25T22:44:40.130299+0000","last_active":"2024-04-25T22:44:57.089901+0000","last_peered":"2024-04-25T22:44:57.089901+0000","last_clean":"2024-04-25T22:44:57.089901+0000","last_became_active":"2024-04-25T22:44:40.127307+0000","last_became_peered":"2024-04-25T22:44:40.127307+0000","last_unstale":"2024-04-25T22:44:57.089901+0000","last_undegraded":"2024-04-25T22:44:57.089901+0000","last_fullsized":"2024-04-25T22:44:57.089901+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:16.746830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":854,"num_write":419,"num_write_kb":88217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"72'428","reported_seq":1027,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089317+0000","last_change":"2024-04-25T22:44:35.108361+0000","last_active":"2024-04-25T22:44:57.089317+0000","last_peered":"2024-04-25T22:44:57.089317+0000","last_clean":"2024-04-25T22:44:57.089317+0000","last_became_active":"2024-04-25T22:44:35.103208+0000","last_became_peered":"2024-04-25T22:44:35.103208+0000","last_unstale":"2024-04-25T22:44:57.089317+0000","last_undegraded":"2024-04-25T22:44:57.089317+0000","last_fullsized":"2024-04-25T22:44:57.089317+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:22.046332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21291,"num_write":389,"num_write_kb":68562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"72'401","reported_seq":611,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.088824+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:44:57.088824+0000","last_peered":"2024-04-25T22:44:57.088824+0000","last_clean":"2024-04-25T22:44:57.088824+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:44:57.088824+0000","last_undegraded":"2024-04-25T22:44:57.088824+0000","last_fullsized":"2024-04-25T22:44:57.088824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8276,"num_write":369,"num_write_kb":17867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"72'398","reported_seq":967,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.086745+0000","last_change":"2024-04-25T22:44:49.097340+0000","last_active":"2024-04-25T22:44:57.086745+0000","last_peered":"2024-04-25T22:44:57.086745+0000","last_clean":"2024-04-25T22:44:57.086745+0000","last_became_active":"2024-04-25T22:44:49.094478+0000","last_became_peered":"2024-04-25T22:44:49.094478+0000","last_unstale":"2024-04-25T22:44:57.086745+0000","last_undegraded":"2024-04-25T22:44:57.086745+0000","last_fullsized":"2024-04-25T22:44:57.086745+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:33.421713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5883,"num_write":362,"num_write_kb":38188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"72'407","reported_seq":809,"reported_epoch":111,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-25T22:44:57.268751+0000","last_change":"2024-04-25T22:44:56.884546+0000","last_active":"2024-04-25T22:44:57.268751+0000","last_peered":"2024-04-25T22:44:57.268751+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.154547+0000","last_became_peered":"2024-04-25T22:44:41.154547+0000","last_unstale":"2024-04-25T22:44:57.268751+0000","last_undegraded":"2024-04-25T22:44:57.268751+0000","last_fullsized":"2024-04-25T22:44:41.120885+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13073,"num_write":372,"num_write_kb":59323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"72'441","reported_seq":1055,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085785+0000","last_change":"2024-04-25T22:44:41.148409+0000","last_active":"2024-04-25T22:44:57.085785+0000","last_peered":"2024-04-25T22:44:57.085785+0000","last_clean":"2024-04-25T22:44:57.085785+0000","last_became_active":"2024-04-25T22:44:41.143302+0000","last_became_peered":"2024-04-25T22:44:41.143302+0000","last_unstale":"2024-04-25T22:44:57.085785+0000","last_undegraded":"2024-04-25T22:44:57.085785+0000","last_fullsized":"2024-04-25T22:44:57.085785+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:46.289713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37611,"num_write":403,"num_write_kb":116618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"72'438","reported_seq":660,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089723+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:44:57.089723+0000","last_peered":"2024-04-25T22:44:57.089723+0000","last_clean":"2024-04-25T22:44:57.089723+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:44:57.089723+0000","last_undegraded":"2024-04-25T22:44:57.089723+0000","last_fullsized":"2024-04-25T22:44:57.089723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12393,"num_write":408,"num_write_kb":99933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"72'407","reported_seq":618,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090769+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:44:57.090769+0000","last_peered":"2024-04-25T22:44:57.090769+0000","last_clean":"2024-04-25T22:44:57.090769+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:44:57.090769+0000","last_undegraded":"2024-04-25T22:44:57.090769+0000","last_fullsized":"2024-04-25T22:44:57.090769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8932,"num_write":382,"num_write_kb":59684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"72'463","reported_seq":682,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376349+0000","last_change":"2024-04-25T22:44:47.376009+0000","last_active":"2024-04-25T22:44:54.376349+0000","last_peered":"2024-04-25T22:44:54.376349+0000","last_clean":"2024-04-25T22:44:54.376349+0000","last_became_active":"2024-04-25T22:44:47.369995+0000","last_became_peered":"2024-04-25T22:44:47.369995+0000","last_unstale":"2024-04-25T22:44:54.376349+0000","last_undegraded":"2024-04-25T22:44:54.376349+0000","last_fullsized":"2024-04-25T22:44:54.376349+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:04.129559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27589,"num_write":428,"num_write_kb":76861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"72'425","reported_seq":690,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.083405+0000","last_change":"2024-04-25T22:44:39.132230+0000","last_active":"2024-04-25T22:44:57.083405+0000","last_peered":"2024-04-25T22:44:57.083405+0000","last_clean":"2024-04-25T22:44:57.083405+0000","last_became_active":"2024-04-25T22:44:39.118635+0000","last_became_peered":"2024-04-25T22:44:39.118635+0000","last_unstale":"2024-04-25T22:44:57.083405+0000","last_undegraded":"2024-04-25T22:44:57.083405+0000","last_fullsized":"2024-04-25T22:44:57.083405+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:15.096836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":46424,"num_write":390,"num_write_kb":96359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"72'445","reported_seq":609,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.388681+0000","last_change":"2024-04-25T22:44:54.388681+0000","last_active":"2024-04-25T22:44:54.388681+0000","last_peered":"2024-04-25T22:44:54.388681+0000","last_clean":"2024-04-25T22:44:54.388681+0000","last_became_active":"2024-04-25T22:44:54.382124+0000","last_became_peered":"2024-04-25T22:44:54.382124+0000","last_unstale":"2024-04-25T22:44:54.388681+0000","last_undegraded":"2024-04-25T22:44:54.388681+0000","last_fullsized":"2024-04-25T22:44:54.388681+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:49.633770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32317,"num_write":419,"num_write_kb":76071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"72'424","reported_seq":580,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377796+0000","last_change":"2024-04-25T22:44:51.391125+0000","last_active":"2024-04-25T22:44:54.377796+0000","last_peered":"2024-04-25T22:44:54.377796+0000","last_clean":"2024-04-25T22:44:54.377796+0000","last_became_active":"2024-04-25T22:44:51.383461+0000","last_became_peered":"2024-04-25T22:44:51.383461+0000","last_unstale":"2024-04-25T22:44:54.377796+0000","last_undegraded":"2024-04-25T22:44:54.377796+0000","last_fullsized":"2024-04-25T22:44:54.377796+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:33.717342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8396,"num_write":399,"num_write_kb":50416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"72'499","reported_seq":706,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085795+0000","last_change":"2024-04-25T22:44:39.149280+0000","last_active":"2024-04-25T22:44:57.085795+0000","last_peered":"2024-04-25T22:44:57.085795+0000","last_clean":"2024-04-25T22:44:57.085795+0000","last_became_active":"2024-04-25T22:44:39.143391+0000","last_became_peered":"2024-04-25T22:44:39.143391+0000","last_unstale":"2024-04-25T22:44:57.085795+0000","last_undegraded":"2024-04-25T22:44:57.085795+0000","last_fullsized":"2024-04-25T22:44:57.085795+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:54:10.301144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10227,"num_write":453,"num_write_kb":96585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'430","reported_seq":1078,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090371+0000","last_change":"2024-04-25T22:44:39.113437+0000","last_active":"2024-04-25T22:44:57.090371+0000","last_peered":"2024-04-25T22:44:57.090371+0000","last_clean":"2024-04-25T22:44:57.090371+0000","last_became_active":"2024-04-25T22:44:39.109771+0000","last_became_peered":"2024-04-25T22:44:39.109771+0000","last_unstale":"2024-04-25T22:44:57.090371+0000","last_undegraded":"2024-04-25T22:44:57.090371+0000","last_fullsized":"2024-04-25T22:44:57.090371+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:40:46.739897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":32116,"num_write":409,"num_write_kb":89217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"72'393","reported_seq":646,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377384+0000","last_change":"2024-04-25T22:44:41.425947+0000","last_active":"2024-04-25T22:44:54.377384+0000","last_peered":"2024-04-25T22:44:54.377384+0000","last_clean":"2024-04-25T22:44:54.377384+0000","last_became_active":"2024-04-25T22:44:41.413570+0000","last_became_peered":"2024-04-25T22:44:41.413570+0000","last_unstale":"2024-04-25T22:44:54.377384+0000","last_undegraded":"2024-04-25T22:44:54.377384+0000","last_fullsized":"2024-04-25T22:44:54.377384+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:39:00.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":28076,"num_write":364,"num_write_kb":47473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"72'399","reported_seq":989,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.084530+0000","last_change":"2024-04-25T22:44:40.124745+0000","last_active":"2024-04-25T22:44:57.084530+0000","last_peered":"2024-04-25T22:44:57.084530+0000","last_clean":"2024-04-25T22:44:57.084530+0000","last_became_active":"2024-04-25T22:44:40.121838+0000","last_became_peered":"2024-04-25T22:44:40.121838+0000","last_unstale":"2024-04-25T22:44:57.084530+0000","last_undegraded":"2024-04-25T22:44:57.084530+0000","last_fullsized":"2024-04-25T22:44:57.084530+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:28.299317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14005,"num_write":367,"num_write_kb":58883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"72'484","reported_seq":673,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.394316+0000","last_change":"2024-04-25T22:44:54.392451+0000","last_active":"2024-04-25T22:44:54.394316+0000","last_peered":"2024-04-25T22:44:54.394316+0000","last_clean":"2024-04-25T22:44:54.394316+0000","last_became_active":"2024-04-25T22:44:54.383808+0000","last_became_peered":"2024-04-25T22:44:54.383808+0000","last_unstale":"2024-04-25T22:44:54.394316+0000","last_undegraded":"2024-04-25T22:44:54.394316+0000","last_fullsized":"2024-04-25T22:44:54.394316+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:06.630318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23352,"num_write":446,"num_write_kb":100094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'455","reported_seq":1132,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.083579+0000","last_change":"2024-04-25T22:44:33.087211+0000","last_active":"2024-04-25T22:44:57.083579+0000","last_peered":"2024-04-25T22:44:57.083579+0000","last_clean":"2024-04-25T22:44:57.083579+0000","last_became_active":"2024-04-25T22:44:33.084127+0000","last_became_peered":"2024-04-25T22:44:33.084127+0000","last_unstale":"2024-04-25T22:44:57.083579+0000","last_undegraded":"2024-04-25T22:44:57.083579+0000","last_fullsized":"2024-04-25T22:44:57.083579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38440,"num_write":423,"num_write_kb":71855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"72'434","reported_seq":664,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.088815+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:44:57.088815+0000","last_peered":"2024-04-25T22:44:57.088815+0000","last_clean":"2024-04-25T22:44:57.088815+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:44:57.088815+0000","last_undegraded":"2024-04-25T22:44:57.088815+0000","last_fullsized":"2024-04-25T22:44:57.088815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18701,"num_write":402,"num_write_kb":27564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"72'379","reported_seq":516,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376964+0000","last_change":"2024-04-25T22:44:53.383623+0000","last_active":"2024-04-25T22:44:54.376964+0000","last_peered":"2024-04-25T22:44:54.376964+0000","last_clean":"2024-04-25T22:44:54.376964+0000","last_became_active":"2024-04-25T22:44:53.378402+0000","last_became_peered":"2024-04-25T22:44:53.378402+0000","last_unstale":"2024-04-25T22:44:54.376964+0000","last_undegraded":"2024-04-25T22:44:54.376964+0000","last_fullsized":"2024-04-25T22:44:54.376964+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:52:18.111269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18623,"num_write":344,"num_write_kb":50888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"71'528","reported_seq":727,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.091426+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:44:57.091426+0000","last_peered":"2024-04-25T22:44:57.091426+0000","last_clean":"2024-04-25T22:44:57.091426+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:44:57.091426+0000","last_undegraded":"2024-04-25T22:44:57.091426+0000","last_fullsized":"2024-04-25T22:44:57.091426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"72'383","reported_seq":554,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.078637+0000","last_change":"2024-04-25T22:44:41.148275+0000","last_active":"2024-04-25T22:44:52.078637+0000","last_peered":"2024-04-25T22:44:52.078637+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.142954+0000","last_became_peered":"2024-04-25T22:44:41.142954+0000","last_unstale":"2024-04-25T22:44:52.078637+0000","last_undegraded":"2024-04-25T22:44:41.119000+0000","last_fullsized":"2024-04-25T22:44:41.118353+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8364,"num_write":351,"num_write_kb":30625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"71'45","reported_seq":197,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.084396+0000","last_change":"2024-04-25T22:44:39.117622+0000","last_active":"2024-04-25T22:44:57.084396+0000","last_peered":"2024-04-25T22:44:57.084396+0000","last_clean":"2024-04-25T22:44:57.084396+0000","last_became_active":"2024-04-25T22:44:39.115669+0000","last_became_peered":"2024-04-25T22:44:39.115669+0000","last_unstale":"2024-04-25T22:44:57.084396+0000","last_undegraded":"2024-04-25T22:44:57.084396+0000","last_fullsized":"2024-04-25T22:44:57.084396+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:21.793820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"72'429","reported_seq":621,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.080308+0000","last_change":"2024-04-25T22:44:41.157231+0000","last_active":"2024-04-25T22:44:52.080308+0000","last_peered":"2024-04-25T22:44:52.080308+0000","last_clean":"2024-04-25T22:44:24.311958+0000","last_became_active":"2024-04-25T22:44:41.154517+0000","last_became_peered":"2024-04-25T22:44:41.154517+0000","last_unstale":"2024-04-25T22:44:52.080308+0000","last_undegraded":"2024-04-25T22:44:41.121712+0000","last_fullsized":"2024-04-25T22:44:41.121143+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16584,"num_write":393,"num_write_kb":63712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"71'61","reported_seq":79,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375730+0000","last_change":"2024-04-25T22:44:41.416554+0000","last_active":"2024-04-25T22:44:54.375730+0000","last_peered":"2024-04-25T22:44:54.375730+0000","last_clean":"2024-04-25T22:44:54.375730+0000","last_became_active":"2024-04-25T22:44:41.413853+0000","last_became_peered":"2024-04-25T22:44:41.413853+0000","last_unstale":"2024-04-25T22:44:54.375730+0000","last_undegraded":"2024-04-25T22:44:54.375730+0000","last_fullsized":"2024-04-25T22:44:54.375730+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:50.701110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"72'404","reported_seq":620,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085312+0000","last_change":"2024-04-25T22:44:39.128428+0000","last_active":"2024-04-25T22:44:57.085312+0000","last_peered":"2024-04-25T22:44:57.085312+0000","last_clean":"2024-04-25T22:44:57.085312+0000","last_became_active":"2024-04-25T22:44:39.116562+0000","last_became_peered":"2024-04-25T22:44:39.116562+0000","last_unstale":"2024-04-25T22:44:57.085312+0000","last_undegraded":"2024-04-25T22:44:57.085312+0000","last_fullsized":"2024-04-25T22:44:57.085312+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:09.750726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18745,"num_write":376,"num_write_kb":96145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'71","reported_seq":278,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089510+0000","last_change":"2024-04-25T22:44:26.363329+0000","last_active":"2024-04-25T22:44:57.089510+0000","last_peered":"2024-04-25T22:44:57.089510+0000","last_clean":"2024-04-25T22:44:57.089510+0000","last_became_active":"2024-04-25T22:44:26.362499+0000","last_became_peered":"2024-04-25T22:44:26.362499+0000","last_unstale":"2024-04-25T22:44:57.089510+0000","last_undegraded":"2024-04-25T22:44:57.089510+0000","last_fullsized":"2024-04-25T22:44:57.089510+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'145","reported_seq":358,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.091670+0000","last_change":"2024-04-25T22:44:29.400540+0000","last_active":"2024-04-25T22:44:57.091670+0000","last_peered":"2024-04-25T22:44:57.091670+0000","last_clean":"2024-04-25T22:44:57.091670+0000","last_became_active":"2024-04-25T22:44:29.399853+0000","last_became_peered":"2024-04-25T22:44:29.399853+0000","last_unstale":"2024-04-25T22:44:57.091670+0000","last_undegraded":"2024-04-25T22:44:57.091670+0000","last_fullsized":"2024-04-25T22:44:57.091670+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"72'399","reported_seq":595,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376145+0000","last_change":"2024-04-25T22:44:46.398600+0000","last_active":"2024-04-25T22:44:54.376145+0000","last_peered":"2024-04-25T22:44:54.376145+0000","last_clean":"2024-04-25T22:44:54.376145+0000","last_became_active":"2024-04-25T22:44:46.392604+0000","last_became_peered":"2024-04-25T22:44:46.392604+0000","last_unstale":"2024-04-25T22:44:54.376145+0000","last_undegraded":"2024-04-25T22:44:54.376145+0000","last_fullsized":"2024-04-25T22:44:54.376145+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:15.771324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25159,"num_write":363,"num_write_kb":34063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"71'226","reported_seq":422,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377452+0000","last_change":"2024-04-25T22:44:41.417859+0000","last_active":"2024-04-25T22:44:54.377452+0000","last_peered":"2024-04-25T22:44:54.377452+0000","last_clean":"2024-04-25T22:44:54.377452+0000","last_became_active":"2024-04-25T22:44:41.416542+0000","last_became_peered":"2024-04-25T22:44:41.416542+0000","last_unstale":"2024-04-25T22:44:54.377452+0000","last_undegraded":"2024-04-25T22:44:54.377452+0000","last_fullsized":"2024-04-25T22:44:54.377452+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:27.884903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"72'431","reported_seq":625,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.078000+0000","last_change":"2024-04-25T22:44:41.136042+0000","last_active":"2024-04-25T22:44:52.078000+0000","last_peered":"2024-04-25T22:44:52.078000+0000","last_clean":"2024-04-25T22:40:13.541378+0000","last_became_active":"2024-04-25T22:44:41.130862+0000","last_became_peered":"2024-04-25T22:44:41.130862+0000","last_unstale":"2024-04-25T22:44:52.078000+0000","last_undegraded":"2024-04-25T22:44:41.117168+0000","last_fullsized":"2024-04-25T22:44:41.116538+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14688,"num_write":405,"num_write_kb":38957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"71'382","reported_seq":595,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.091044+0000","last_change":"2024-04-25T22:44:30.401893+0000","last_active":"2024-04-25T22:44:57.091044+0000","last_peered":"2024-04-25T22:44:57.091044+0000","last_clean":"2024-04-25T22:44:57.091044+0000","last_became_active":"2024-04-25T22:44:30.401021+0000","last_became_peered":"2024-04-25T22:44:30.401021+0000","last_unstale":"2024-04-25T22:44:57.091044+0000","last_undegraded":"2024-04-25T22:44:57.091044+0000","last_fullsized":"2024-04-25T22:44:57.091044+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:38.452482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'453","reported_seq":681,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089835+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:44:57.089835+0000","last_peered":"2024-04-25T22:44:57.089835+0000","last_clean":"2024-04-25T22:44:57.089835+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:44:57.089835+0000","last_undegraded":"2024-04-25T22:44:57.089835+0000","last_fullsized":"2024-04-25T22:44:57.089835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18900,"num_write":418,"num_write_kb":117500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"71'64","reported_seq":263,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090717+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:44:57.090717+0000","last_peered":"2024-04-25T22:44:57.090717+0000","last_clean":"2024-04-25T22:44:57.090717+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:44:57.090717+0000","last_undegraded":"2024-04-25T22:44:57.090717+0000","last_fullsized":"2024-04-25T22:44:57.090717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'428","reported_seq":627,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.084682+0000","last_change":"2024-04-25T22:44:39.129871+0000","last_active":"2024-04-25T22:44:57.084682+0000","last_peered":"2024-04-25T22:44:57.084682+0000","last_clean":"2024-04-25T22:44:57.084682+0000","last_became_active":"2024-04-25T22:44:39.121205+0000","last_became_peered":"2024-04-25T22:44:39.121205+0000","last_unstale":"2024-04-25T22:44:57.084682+0000","last_undegraded":"2024-04-25T22:44:57.084682+0000","last_fullsized":"2024-04-25T22:44:57.084682+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:48.521828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7477,"num_write":383,"num_write_kb":9617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'166","reported_seq":318,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.084856+0000","last_change":"2024-04-25T22:44:39.133550+0000","last_active":"2024-04-25T22:44:57.084856+0000","last_peered":"2024-04-25T22:44:57.084856+0000","last_clean":"2024-04-25T22:44:57.084856+0000","last_became_active":"2024-04-25T22:44:39.131489+0000","last_became_peered":"2024-04-25T22:44:39.131489+0000","last_unstale":"2024-04-25T22:44:57.084856+0000","last_undegraded":"2024-04-25T22:44:57.084856+0000","last_fullsized":"2024-04-25T22:44:57.084856+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:32.980801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"72'446","reported_seq":692,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090073+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:44:57.090073+0000","last_peered":"2024-04-25T22:44:57.090073+0000","last_clean":"2024-04-25T22:44:57.090073+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:44:57.090073+0000","last_undegraded":"2024-04-25T22:44:57.090073+0000","last_fullsized":"2024-04-25T22:44:57.090073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27788,"num_write":414,"num_write_kb":47058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"71'113","reported_seq":312,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090763+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:44:57.090763+0000","last_peered":"2024-04-25T22:44:57.090763+0000","last_clean":"2024-04-25T22:44:57.090763+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:44:57.090763+0000","last_undegraded":"2024-04-25T22:44:57.090763+0000","last_fullsized":"2024-04-25T22:44:57.090763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"72'417","reported_seq":1015,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090705+0000","last_change":"2024-04-25T22:44:44.113498+0000","last_active":"2024-04-25T22:44:57.090705+0000","last_peered":"2024-04-25T22:44:57.090705+0000","last_clean":"2024-04-25T22:44:57.090705+0000","last_became_active":"2024-04-25T22:44:44.108084+0000","last_became_peered":"2024-04-25T22:44:44.108084+0000","last_unstale":"2024-04-25T22:44:57.090705+0000","last_undegraded":"2024-04-25T22:44:57.090705+0000","last_fullsized":"2024-04-25T22:44:57.090705+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16487,"num_write":388,"num_write_kb":75452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'59","reported_seq":79,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375230+0000","last_change":"2024-04-25T22:44:41.417821+0000","last_active":"2024-04-25T22:44:54.375230+0000","last_peered":"2024-04-25T22:44:54.375230+0000","last_clean":"2024-04-25T22:44:54.375230+0000","last_became_active":"2024-04-25T22:44:41.415769+0000","last_became_peered":"2024-04-25T22:44:41.415769+0000","last_unstale":"2024-04-25T22:44:54.375230+0000","last_undegraded":"2024-04-25T22:44:54.375230+0000","last_fullsized":"2024-04-25T22:44:54.375230+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.099475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'358","reported_seq":896,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090560+0000","last_change":"2024-04-25T22:44:34.101942+0000","last_active":"2024-04-25T22:44:57.090560+0000","last_peered":"2024-04-25T22:44:57.090560+0000","last_clean":"2024-04-25T22:44:57.090560+0000","last_became_active":"2024-04-25T22:44:34.099595+0000","last_became_peered":"2024-04-25T22:44:34.099595+0000","last_unstale":"2024-04-25T22:44:57.090560+0000","last_undegraded":"2024-04-25T22:44:57.090560+0000","last_fullsized":"2024-04-25T22:44:57.090560+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:06.523166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12259,"num_write":325,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'465","reported_seq":624,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375647+0000","last_change":"2024-04-25T22:44:41.425331+0000","last_active":"2024-04-25T22:44:54.375647+0000","last_peered":"2024-04-25T22:44:54.375647+0000","last_clean":"2024-04-25T22:44:54.375647+0000","last_became_active":"2024-04-25T22:44:41.423799+0000","last_became_peered":"2024-04-25T22:44:41.423799+0000","last_unstale":"2024-04-25T22:44:54.375647+0000","last_undegraded":"2024-04-25T22:44:54.375647+0000","last_fullsized":"2024-04-25T22:44:54.375647+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:04.324825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"72'386","reported_seq":951,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085677+0000","last_change":"2024-04-25T22:44:46.113269+0000","last_active":"2024-04-25T22:44:57.085677+0000","last_peered":"2024-04-25T22:44:57.085677+0000","last_clean":"2024-04-25T22:44:57.085677+0000","last_became_active":"2024-04-25T22:44:46.110394+0000","last_became_peered":"2024-04-25T22:44:46.110394+0000","last_unstale":"2024-04-25T22:44:57.085677+0000","last_undegraded":"2024-04-25T22:44:57.085677+0000","last_fullsized":"2024-04-25T22:44:57.085677+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9402,"num_write":352,"num_write_kb":50548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":414,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089713+0000","last_change":"2024-04-25T22:44:26.355770+0000","last_active":"2024-04-25T22:44:57.089713+0000","last_peered":"2024-04-25T22:44:57.089713+0000","last_clean":"2024-04-25T22:44:57.089713+0000","last_became_active":"2024-04-25T22:44:26.354730+0000","last_became_peered":"2024-04-25T22:44:26.354730+0000","last_unstale":"2024-04-25T22:44:57.089713+0000","last_undegraded":"2024-04-25T22:44:57.089713+0000","last_fullsized":"2024-04-25T22:44:57.089713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:34.987031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":205,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.091577+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:44:57.091577+0000","last_peered":"2024-04-25T22:44:57.091577+0000","last_clean":"2024-04-25T22:44:57.091577+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:44:57.091577+0000","last_undegraded":"2024-04-25T22:44:57.091577+0000","last_fullsized":"2024-04-25T22:44:57.091577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"71'457","reported_seq":672,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.084423+0000","last_change":"2024-04-25T22:44:29.399148+0000","last_active":"2024-04-25T22:44:57.084423+0000","last_peered":"2024-04-25T22:44:57.084423+0000","last_clean":"2024-04-25T22:44:57.084423+0000","last_became_active":"2024-04-25T22:44:29.397962+0000","last_became_peered":"2024-04-25T22:44:29.397962+0000","last_unstale":"2024-04-25T22:44:57.084423+0000","last_undegraded":"2024-04-25T22:44:57.084423+0000","last_fullsized":"2024-04-25T22:44:57.084423+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:14.015619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"72'447","reported_seq":1107,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090730+0000","last_change":"2024-04-25T22:44:43.108262+0000","last_active":"2024-04-25T22:44:57.090730+0000","last_peered":"2024-04-25T22:44:57.090730+0000","last_clean":"2024-04-25T22:44:57.090730+0000","last_became_active":"2024-04-25T22:44:43.105231+0000","last_became_peered":"2024-04-25T22:44:43.105231+0000","last_unstale":"2024-04-25T22:44:57.090730+0000","last_undegraded":"2024-04-25T22:44:57.090730+0000","last_fullsized":"2024-04-25T22:44:57.090730+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:09.728618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45074,"num_write":414,"num_write_kb":120596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":212,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089494+0000","last_change":"2024-04-25T22:44:26.355238+0000","last_active":"2024-04-25T22:44:57.089494+0000","last_peered":"2024-04-25T22:44:57.089494+0000","last_clean":"2024-04-25T22:44:57.089494+0000","last_became_active":"2024-04-25T22:44:26.354482+0000","last_became_peered":"2024-04-25T22:44:26.354482+0000","last_unstale":"2024-04-25T22:44:57.089494+0000","last_undegraded":"2024-04-25T22:44:57.089494+0000","last_fullsized":"2024-04-25T22:44:57.089494+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.042514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'122","reported_seq":336,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.084113+0000","last_change":"2024-04-25T22:44:39.141843+0000","last_active":"2024-04-25T22:44:57.084113+0000","last_peered":"2024-04-25T22:44:57.084113+0000","last_clean":"2024-04-25T22:44:57.084113+0000","last_became_active":"2024-04-25T22:44:39.139689+0000","last_became_peered":"2024-04-25T22:44:39.139689+0000","last_unstale":"2024-04-25T22:44:57.084113+0000","last_undegraded":"2024-04-25T22:44:57.084113+0000","last_fullsized":"2024-04-25T22:44:57.084113+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:18.614670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":62,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"72'449","reported_seq":642,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.378064+0000","last_change":"2024-04-25T22:44:41.439044+0000","last_active":"2024-04-25T22:44:54.378064+0000","last_peered":"2024-04-25T22:44:54.378064+0000","last_clean":"2024-04-25T22:44:54.378064+0000","last_became_active":"2024-04-25T22:44:41.432785+0000","last_became_peered":"2024-04-25T22:44:41.432785+0000","last_unstale":"2024-04-25T22:44:54.378064+0000","last_undegraded":"2024-04-25T22:44:54.378064+0000","last_fullsized":"2024-04-25T22:44:54.378064+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:57.171725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25191,"num_write":420,"num_write_kb":79855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":213,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.084438+0000","last_change":"2024-04-25T22:44:26.363464+0000","last_active":"2024-04-25T22:44:57.084438+0000","last_peered":"2024-04-25T22:44:57.084438+0000","last_clean":"2024-04-25T22:44:57.084438+0000","last_became_active":"2024-04-25T22:44:26.362808+0000","last_became_peered":"2024-04-25T22:44:26.362808+0000","last_unstale":"2024-04-25T22:44:57.084438+0000","last_undegraded":"2024-04-25T22:44:57.084438+0000","last_fullsized":"2024-04-25T22:44:57.084438+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:06.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'435","reported_seq":620,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375077+0000","last_change":"2024-04-25T22:44:41.417191+0000","last_active":"2024-04-25T22:44:54.375077+0000","last_peered":"2024-04-25T22:44:54.375077+0000","last_clean":"2024-04-25T22:44:54.375077+0000","last_became_active":"2024-04-25T22:44:41.415592+0000","last_became_peered":"2024-04-25T22:44:41.415592+0000","last_unstale":"2024-04-25T22:44:54.375077+0000","last_undegraded":"2024-04-25T22:44:54.375077+0000","last_fullsized":"2024-04-25T22:44:54.375077+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:35.916512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"72'337","reported_seq":884,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085841+0000","last_change":"2024-04-25T22:44:45.113523+0000","last_active":"2024-04-25T22:44:57.085841+0000","last_peered":"2024-04-25T22:44:57.085841+0000","last_clean":"2024-04-25T22:44:57.085841+0000","last_became_active":"2024-04-25T22:44:45.111011+0000","last_became_peered":"2024-04-25T22:44:45.111011+0000","last_unstale":"2024-04-25T22:44:57.085841+0000","last_undegraded":"2024-04-25T22:44:57.085841+0000","last_fullsized":"2024-04-25T22:44:57.085841+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25242,"num_write":307,"num_write_kb":26250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":205,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090534+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:44:57.090534+0000","last_peered":"2024-04-25T22:44:57.090534+0000","last_clean":"2024-04-25T22:44:57.090534+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:44:57.090534+0000","last_undegraded":"2024-04-25T22:44:57.090534+0000","last_fullsized":"2024-04-25T22:44:57.090534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"71'61","reported_seq":260,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.091340+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:44:57.091340+0000","last_peered":"2024-04-25T22:44:57.091340+0000","last_clean":"2024-04-25T22:44:57.091340+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:44:57.091340+0000","last_undegraded":"2024-04-25T22:44:57.091340+0000","last_fullsized":"2024-04-25T22:44:57.091340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'404","reported_seq":1012,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085241+0000","last_change":"2024-04-25T22:44:32.092728+0000","last_active":"2024-04-25T22:44:57.085241+0000","last_peered":"2024-04-25T22:44:57.085241+0000","last_clean":"2024-04-25T22:44:57.085241+0000","last_became_active":"2024-04-25T22:44:32.087528+0000","last_became_peered":"2024-04-25T22:44:32.087528+0000","last_unstale":"2024-04-25T22:44:57.085241+0000","last_undegraded":"2024-04-25T22:44:57.085241+0000","last_fullsized":"2024-04-25T22:44:57.085241+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:39.481467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":20287,"num_write":371,"num_write_kb":59919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'285","reported_seq":484,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.091055+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:44:57.091055+0000","last_peered":"2024-04-25T22:44:57.091055+0000","last_clean":"2024-04-25T22:44:57.091055+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:44:57.091055+0000","last_undegraded":"2024-04-25T22:44:57.091055+0000","last_fullsized":"2024-04-25T22:44:57.091055+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":213,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085551+0000","last_change":"2024-04-25T22:44:26.364185+0000","last_active":"2024-04-25T22:44:57.085551+0000","last_peered":"2024-04-25T22:44:57.085551+0000","last_clean":"2024-04-25T22:44:57.085551+0000","last_became_active":"2024-04-25T22:44:26.363583+0000","last_became_peered":"2024-04-25T22:44:26.363583+0000","last_unstale":"2024-04-25T22:44:57.085551+0000","last_undegraded":"2024-04-25T22:44:57.085551+0000","last_fullsized":"2024-04-25T22:44:57.085551+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:35:04.325449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"72'366","reported_seq":512,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376225+0000","last_change":"2024-04-25T22:44:52.381174+0000","last_active":"2024-04-25T22:44:54.376225+0000","last_peered":"2024-04-25T22:44:54.376225+0000","last_clean":"2024-04-25T22:44:54.376225+0000","last_became_active":"2024-04-25T22:44:52.375504+0000","last_became_peered":"2024-04-25T22:44:52.375504+0000","last_unstale":"2024-04-25T22:44:54.376225+0000","last_undegraded":"2024-04-25T22:44:54.376225+0000","last_fullsized":"2024-04-25T22:44:54.376225+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:41.592790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":346,"num_write":330,"num_write_kb":33934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":261,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085288+0000","last_change":"2024-04-25T22:44:26.364178+0000","last_active":"2024-04-25T22:44:57.085288+0000","last_peered":"2024-04-25T22:44:57.085288+0000","last_clean":"2024-04-25T22:44:57.085288+0000","last_became_active":"2024-04-25T22:44:26.363455+0000","last_became_peered":"2024-04-25T22:44:26.363455+0000","last_unstale":"2024-04-25T22:44:57.085288+0000","last_undegraded":"2024-04-25T22:44:57.085288+0000","last_fullsized":"2024-04-25T22:44:57.085288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:58.181763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.378144+0000","last_change":"2024-04-25T22:44:41.423030+0000","last_active":"2024-04-25T22:44:54.378144+0000","last_peered":"2024-04-25T22:44:54.378144+0000","last_clean":"2024-04-25T22:44:54.378144+0000","last_became_active":"2024-04-25T22:44:41.421194+0000","last_became_peered":"2024-04-25T22:44:41.421194+0000","last_unstale":"2024-04-25T22:44:54.378144+0000","last_undegraded":"2024-04-25T22:44:54.378144+0000","last_fullsized":"2024-04-25T22:44:54.378144+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:59.297537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'413","reported_seq":617,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376317+0000","last_change":"2024-04-25T22:44:48.378474+0000","last_active":"2024-04-25T22:44:54.376317+0000","last_peered":"2024-04-25T22:44:54.376317+0000","last_clean":"2024-04-25T22:44:54.376317+0000","last_became_active":"2024-04-25T22:44:48.372485+0000","last_became_peered":"2024-04-25T22:44:48.372485+0000","last_unstale":"2024-04-25T22:44:54.376317+0000","last_undegraded":"2024-04-25T22:44:54.376317+0000","last_fullsized":"2024-04-25T22:44:54.376317+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:47.402437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22994,"num_write":377,"num_write_kb":63140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'57","reported_seq":265,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.086582+0000","last_change":"2024-04-25T22:44:26.366189+0000","last_active":"2024-04-25T22:44:57.086582+0000","last_peered":"2024-04-25T22:44:57.086582+0000","last_clean":"2024-04-25T22:44:57.086582+0000","last_became_active":"2024-04-25T22:44:26.365267+0000","last_became_peered":"2024-04-25T22:44:26.365267+0000","last_unstale":"2024-04-25T22:44:57.086582+0000","last_undegraded":"2024-04-25T22:44:57.086582+0000","last_fullsized":"2024-04-25T22:44:57.086582+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:54.128937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":213,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.086788+0000","last_change":"2024-04-25T22:44:26.361633+0000","last_active":"2024-04-25T22:44:57.086788+0000","last_peered":"2024-04-25T22:44:57.086788+0000","last_clean":"2024-04-25T22:44:57.086788+0000","last_became_active":"2024-04-25T22:44:26.360968+0000","last_became_peered":"2024-04-25T22:44:26.360968+0000","last_unstale":"2024-04-25T22:44:57.086788+0000","last_undegraded":"2024-04-25T22:44:57.086788+0000","last_fullsized":"2024-04-25T22:44:57.086788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:40.454898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'398","reported_seq":595,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.083951+0000","last_change":"2024-04-25T22:44:39.132801+0000","last_active":"2024-04-25T22:44:57.083951+0000","last_peered":"2024-04-25T22:44:57.083951+0000","last_clean":"2024-04-25T22:44:57.083951+0000","last_became_active":"2024-04-25T22:44:39.124378+0000","last_became_peered":"2024-04-25T22:44:39.124378+0000","last_unstale":"2024-04-25T22:44:57.083951+0000","last_undegraded":"2024-04-25T22:44:57.083951+0000","last_fullsized":"2024-04-25T22:44:57.083951+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:29.195889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6306,"num_write":372,"num_write_kb":34077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'100","reported_seq":302,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.086644+0000","last_change":"2024-04-25T22:44:39.150245+0000","last_active":"2024-04-25T22:44:57.086644+0000","last_peered":"2024-04-25T22:44:57.086644+0000","last_clean":"2024-04-25T22:44:57.086644+0000","last_became_active":"2024-04-25T22:44:39.147377+0000","last_became_peered":"2024-04-25T22:44:39.147377+0000","last_unstale":"2024-04-25T22:44:57.086644+0000","last_undegraded":"2024-04-25T22:44:57.086644+0000","last_fullsized":"2024-04-25T22:44:57.086644+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:36.007978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":212,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.091785+0000","last_change":"2024-04-25T22:44:26.360890+0000","last_active":"2024-04-25T22:44:57.091785+0000","last_peered":"2024-04-25T22:44:57.091785+0000","last_clean":"2024-04-25T22:44:57.091785+0000","last_became_active":"2024-04-25T22:44:26.360106+0000","last_became_peered":"2024-04-25T22:44:26.360106+0000","last_unstale":"2024-04-25T22:44:57.091785+0000","last_undegraded":"2024-04-25T22:44:57.091785+0000","last_fullsized":"2024-04-25T22:44:57.091785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:09.929196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'390","reported_seq":611,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375973+0000","last_change":"2024-04-25T22:44:41.433574+0000","last_active":"2024-04-25T22:44:54.375973+0000","last_peered":"2024-04-25T22:44:54.375973+0000","last_clean":"2024-04-25T22:44:54.375973+0000","last_became_active":"2024-04-25T22:44:41.414924+0000","last_became_peered":"2024-04-25T22:44:41.414924+0000","last_unstale":"2024-04-25T22:44:54.375973+0000","last_undegraded":"2024-04-25T22:44:54.375973+0000","last_fullsized":"2024-04-25T22:44:54.375973+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:46.695300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":22915,"num_write":352,"num_write_kb":47201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"72'411","reported_seq":1004,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090546+0000","last_change":"2024-04-25T22:44:32.090492+0000","last_active":"2024-04-25T22:44:57.090546+0000","last_peered":"2024-04-25T22:44:57.090546+0000","last_clean":"2024-04-25T22:44:57.090546+0000","last_became_active":"2024-04-25T22:44:32.087303+0000","last_became_peered":"2024-04-25T22:44:32.087303+0000","last_unstale":"2024-04-25T22:44:57.090546+0000","last_undegraded":"2024-04-25T22:44:57.090546+0000","last_fullsized":"2024-04-25T22:44:57.090546+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25412,"num_write":367,"num_write_kb":64656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'268","reported_seq":485,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090707+0000","last_change":"2024-04-25T22:44:29.399184+0000","last_active":"2024-04-25T22:44:57.090707+0000","last_peered":"2024-04-25T22:44:57.090707+0000","last_clean":"2024-04-25T22:44:57.090707+0000","last_became_active":"2024-04-25T22:44:29.398317+0000","last_became_peered":"2024-04-25T22:44:29.398317+0000","last_unstale":"2024-04-25T22:44:57.090707+0000","last_undegraded":"2024-04-25T22:44:57.090707+0000","last_fullsized":"2024-04-25T22:44:57.090707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:21.765162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382817,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"72'423","reported_seq":1043,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.084009+0000","last_change":"2024-04-25T22:44:42.092243+0000","last_active":"2024-04-25T22:44:57.084009+0000","last_peered":"2024-04-25T22:44:57.084009+0000","last_clean":"2024-04-25T22:44:57.084009+0000","last_became_active":"2024-04-25T22:44:42.088432+0000","last_became_peered":"2024-04-25T22:44:42.088432+0000","last_unstale":"2024-04-25T22:44:57.084009+0000","last_undegraded":"2024-04-25T22:44:57.084009+0000","last_fullsized":"2024-04-25T22:44:57.084009+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:54.239406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24794,"num_write":386,"num_write_kb":63756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'102","reported_seq":86,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.377263+0000","last_change":"2024-04-25T22:44:41.423993+0000","last_active":"2024-04-25T22:44:54.377263+0000","last_peered":"2024-04-25T22:44:54.377263+0000","last_clean":"2024-04-25T22:44:54.377263+0000","last_became_active":"2024-04-25T22:44:41.422237+0000","last_became_peered":"2024-04-25T22:44:41.422237+0000","last_unstale":"2024-04-25T22:44:54.377263+0000","last_undegraded":"2024-04-25T22:44:54.377263+0000","last_fullsized":"2024-04-25T22:44:54.377263+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:02.880774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"71'213","reported_seq":411,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.091650+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:44:57.091650+0000","last_peered":"2024-04-25T22:44:57.091650+0000","last_clean":"2024-04-25T22:44:57.091650+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:44:57.091650+0000","last_undegraded":"2024-04-25T22:44:57.091650+0000","last_fullsized":"2024-04-25T22:44:57.091650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"72'504","reported_seq":765,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.083807+0000","last_change":"2024-04-25T22:44:39.142694+0000","last_active":"2024-04-25T22:44:57.083807+0000","last_peered":"2024-04-25T22:44:57.083807+0000","last_clean":"2024-04-25T22:44:57.083807+0000","last_became_active":"2024-04-25T22:44:39.132582+0000","last_became_peered":"2024-04-25T22:44:39.132582+0000","last_unstale":"2024-04-25T22:44:57.083807+0000","last_undegraded":"2024-04-25T22:44:57.083807+0000","last_fullsized":"2024-04-25T22:44:57.083807+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:14.401644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":46975,"num_write":471,"num_write_kb":146290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'64","reported_seq":215,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.086239+0000","last_change":"2024-04-25T22:44:39.136961+0000","last_active":"2024-04-25T22:44:57.086239+0000","last_peered":"2024-04-25T22:44:57.086239+0000","last_clean":"2024-04-25T22:44:57.086239+0000","last_became_active":"2024-04-25T22:44:39.136090+0000","last_became_peered":"2024-04-25T22:44:39.136090+0000","last_unstale":"2024-04-25T22:44:57.086239+0000","last_undegraded":"2024-04-25T22:44:57.086239+0000","last_fullsized":"2024-04-25T22:44:57.086239+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:35.220314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"72'475","reported_seq":1150,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.083969+0000","last_change":"2024-04-25T22:44:44.106484+0000","last_active":"2024-04-25T22:44:57.083969+0000","last_peered":"2024-04-25T22:44:57.083969+0000","last_clean":"2024-04-25T22:44:57.083969+0000","last_became_active":"2024-04-25T22:44:44.102061+0000","last_became_peered":"2024-04-25T22:44:44.102061+0000","last_unstale":"2024-04-25T22:44:57.083969+0000","last_undegraded":"2024-04-25T22:44:57.083969+0000","last_fullsized":"2024-04-25T22:44:57.083969+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:05.455255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":23011,"num_write":448,"num_write_kb":76439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"72'370","reported_seq":614,"reported_epoch":106,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-25T22:44:52.085079+0000","last_change":"2024-04-25T22:44:41.149278+0000","last_active":"2024-04-25T22:44:52.085079+0000","last_peered":"2024-04-25T22:44:52.085079+0000","last_clean":"2024-04-25T22:41:34.256787+0000","last_became_active":"2024-04-25T22:44:41.144535+0000","last_became_peered":"2024-04-25T22:44:41.144535+0000","last_unstale":"2024-04-25T22:44:52.085079+0000","last_undegraded":"2024-04-25T22:44:41.120919+0000","last_fullsized":"2024-04-25T22:44:41.120194+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":159,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33211,"num_write":340,"num_write_kb":63312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"71'647","reported_seq":861,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.084125+0000","last_change":"2024-04-25T22:44:30.396965+0000","last_active":"2024-04-25T22:44:57.084125+0000","last_peered":"2024-04-25T22:44:57.084125+0000","last_clean":"2024-04-25T22:44:57.084125+0000","last_became_active":"2024-04-25T22:44:30.396073+0000","last_became_peered":"2024-04-25T22:44:30.396073+0000","last_unstale":"2024-04-25T22:44:57.084125+0000","last_undegraded":"2024-04-25T22:44:57.084125+0000","last_fullsized":"2024-04-25T22:44:57.084125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"72'415","reported_seq":632,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085951+0000","last_change":"2024-04-25T22:44:39.150290+0000","last_active":"2024-04-25T22:44:57.085951+0000","last_peered":"2024-04-25T22:44:57.085951+0000","last_clean":"2024-04-25T22:44:57.085951+0000","last_became_active":"2024-04-25T22:44:39.146949+0000","last_became_peered":"2024-04-25T22:44:39.146949+0000","last_unstale":"2024-04-25T22:44:57.085951+0000","last_undegraded":"2024-04-25T22:44:57.085951+0000","last_fullsized":"2024-04-25T22:44:57.085951+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:11.804350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19493,"num_write":386,"num_write_kb":64692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'207","reported_seq":358,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.083952+0000","last_change":"2024-04-25T22:44:39.141125+0000","last_active":"2024-04-25T22:44:57.083952+0000","last_peered":"2024-04-25T22:44:57.083952+0000","last_clean":"2024-04-25T22:44:57.083952+0000","last_became_active":"2024-04-25T22:44:39.138371+0000","last_became_peered":"2024-04-25T22:44:39.138371+0000","last_unstale":"2024-04-25T22:44:57.083952+0000","last_undegraded":"2024-04-25T22:44:57.083952+0000","last_fullsized":"2024-04-25T22:44:57.083952+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:14.147026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"72'395","reported_seq":546,"reported_epoch":108,"state":"peering","last_fresh":"2024-04-25T22:44:53.510934+0000","last_change":"2024-04-25T22:44:54.660910+0000","last_active":"2024-04-25T22:44:54.660910+0000","last_peered":"2024-04-25T22:44:53.510934+0000","last_clean":"2024-04-25T22:41:34.256072+0000","last_became_active":"2024-04-25T22:44:41.144491+0000","last_became_peered":"2024-04-25T22:44:41.144491+0000","last_unstale":"2024-04-25T22:44:53.510934+0000","last_undegraded":"2024-04-25T22:44:53.510934+0000","last_fullsized":"2024-04-25T22:44:41.118876+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9576,"num_write":348,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'194","reported_seq":353,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375784+0000","last_change":"2024-04-25T22:44:41.422369+0000","last_active":"2024-04-25T22:44:54.375784+0000","last_peered":"2024-04-25T22:44:54.375784+0000","last_clean":"2024-04-25T22:44:54.375784+0000","last_became_active":"2024-04-25T22:44:41.420491+0000","last_became_peered":"2024-04-25T22:44:41.420491+0000","last_unstale":"2024-04-25T22:44:54.375784+0000","last_undegraded":"2024-04-25T22:44:54.375784+0000","last_fullsized":"2024-04-25T22:44:54.375784+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:35.081225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360511,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":12143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12360511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"72'398","reported_seq":583,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.378098+0000","last_change":"2024-04-25T22:44:52.381363+0000","last_active":"2024-04-25T22:44:54.378098+0000","last_peered":"2024-04-25T22:44:54.378098+0000","last_clean":"2024-04-25T22:44:54.378098+0000","last_became_active":"2024-04-25T22:44:52.375632+0000","last_became_peered":"2024-04-25T22:44:52.375632+0000","last_unstale":"2024-04-25T22:44:54.378098+0000","last_undegraded":"2024-04-25T22:44:54.378098+0000","last_fullsized":"2024-04-25T22:44:54.378098+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:38:28.441621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31284,"num_write":371,"num_write_kb":80144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"71'51","reported_seq":84,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375713+0000","last_change":"2024-04-25T22:44:41.415722+0000","last_active":"2024-04-25T22:44:54.375713+0000","last_peered":"2024-04-25T22:44:54.375713+0000","last_clean":"2024-04-25T22:44:54.375713+0000","last_became_active":"2024-04-25T22:44:41.414774+0000","last_became_peered":"2024-04-25T22:44:41.414774+0000","last_unstale":"2024-04-25T22:44:54.375713+0000","last_undegraded":"2024-04-25T22:44:54.375713+0000","last_fullsized":"2024-04-25T22:44:54.375713+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:20.553373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"72'383","reported_seq":631,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090045+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:44:57.090045+0000","last_peered":"2024-04-25T22:44:57.090045+0000","last_clean":"2024-04-25T22:44:57.090045+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:44:57.090045+0000","last_undegraded":"2024-04-25T22:44:57.090045+0000","last_fullsized":"2024-04-25T22:44:57.090045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29308,"num_write":358,"num_write_kb":66975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"71'177","reported_seq":375,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090375+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:44:57.090375+0000","last_peered":"2024-04-25T22:44:57.090375+0000","last_clean":"2024-04-25T22:44:57.090375+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:44:57.090375+0000","last_undegraded":"2024-04-25T22:44:57.090375+0000","last_fullsized":"2024-04-25T22:44:57.090375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"72'387","reported_seq":596,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.090054+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:44:57.090054+0000","last_peered":"2024-04-25T22:44:57.090054+0000","last_clean":"2024-04-25T22:44:57.090054+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:44:57.090054+0000","last_undegraded":"2024-04-25T22:44:57.090054+0000","last_fullsized":"2024-04-25T22:44:57.090054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3883,"num_write":348,"num_write_kb":34122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'209","reported_seq":403,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.376952+0000","last_change":"2024-04-25T22:44:41.419972+0000","last_active":"2024-04-25T22:44:54.376952+0000","last_peered":"2024-04-25T22:44:54.376952+0000","last_clean":"2024-04-25T22:44:54.376952+0000","last_became_active":"2024-04-25T22:44:41.418106+0000","last_became_peered":"2024-04-25T22:44:41.418106+0000","last_unstale":"2024-04-25T22:44:54.376952+0000","last_undegraded":"2024-04-25T22:44:54.376952+0000","last_fullsized":"2024-04-25T22:44:54.376952+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:07.628155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":12363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"72'419","reported_seq":597,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T22:44:54.375672+0000","last_change":"2024-04-25T22:44:41.434376+0000","last_active":"2024-04-25T22:44:54.375672+0000","last_peered":"2024-04-25T22:44:54.375672+0000","last_clean":"2024-04-25T22:44:54.375672+0000","last_became_active":"2024-04-25T22:44:41.420505+0000","last_became_peered":"2024-04-25T22:44:41.420505+0000","last_unstale":"2024-04-25T22:44:54.375672+0000","last_undegraded":"2024-04-25T22:44:54.375672+0000","last_fullsized":"2024-04-25T22:44:54.375672+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:04.414563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":13327,"num_write":388,"num_write_kb":55674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"71'131","reported_seq":345,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.086456+0000","last_change":"2024-04-25T22:44:29.398880+0000","last_active":"2024-04-25T22:44:57.086456+0000","last_peered":"2024-04-25T22:44:57.086456+0000","last_clean":"2024-04-25T22:44:57.086456+0000","last_became_active":"2024-04-25T22:44:29.397905+0000","last_became_peered":"2024-04-25T22:44:29.397905+0000","last_unstale":"2024-04-25T22:44:57.086456+0000","last_undegraded":"2024-04-25T22:44:57.086456+0000","last_fullsized":"2024-04-25T22:44:57.086456+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:44.236330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"72'449","reported_seq":679,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.089179+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:44:57.089179+0000","last_peered":"2024-04-25T22:44:57.089179+0000","last_clean":"2024-04-25T22:44:57.089179+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:44:57.089179+0000","last_undegraded":"2024-04-25T22:44:57.089179+0000","last_fullsized":"2024-04-25T22:44:57.089179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14222,"num_write":424,"num_write_kb":79796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"71'57","reported_seq":209,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-25T22:44:57.085966+0000","last_change":"2024-04-25T22:44:39.137232+0000","last_active":"2024-04-25T22:44:57.085966+0000","last_peered":"2024-04-25T22:44:57.085966+0000","last_clean":"2024-04-25T22:44:57.085966+0000","last_became_active":"2024-04-25T22:44:39.136283+0000","last_became_peered":"2024-04-25T22:44:39.136283+0000","last_unstale":"2024-04-25T22:44:57.085966+0000","last_undegraded":"2024-04-25T22:44:57.085966+0000","last_fullsized":"2024-04-25T22:44:57.085966+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:32.428982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":885,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2461,"num_read_kb":1248646,"num_write":24434,"num_write_kb":4137258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6487,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26539,"ondisk_log_size":26539,"up":128,"acting":122,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127071275,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":4473,"num_write_kb":127409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254210048,"data_stored":254142550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},"log_size":6216,"ondisk_log_size":6216,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738433,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165320,"kb_used_data":80056,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94206520,"statfs":{"total":96636764160,"available":96467476480,"internally_reserved":0,"allocated":81977344,"data_stored":81404823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":79,"seq":339302416392,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133032,"kb_used_data":83284,"kb_used_omap":5,"kb_used_meta":49722,"kb_avail":94238808,"statfs":{"total":96636764160,"available":96500539392,"internally_reserved":0,"allocated":85282816,"data_stored":84713423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6003,"internal_metadata":50915469},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738433,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174328,"kb_used_data":89064,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94197512,"statfs":{"total":96636764160,"available":96458252288,"internally_reserved":0,"allocated":91201536,"data_stored":90607054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89575424,"data_stored":89544940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83689472,"data_stored":83664533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80945152,"data_stored":80933077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:45:03.445 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:45:03.777 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:45:03.779 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:45:03.796 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-04-25T22:45:03.243659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127661643,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2659,"num_read_kb":1250233,"num_write":29110,"num_write_kb":4268127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7469,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32912,"ondisk_log_size":32912,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":481092,"kb_used_data":252500,"kb_used_omap":8,"kb_used_meta":228535,"kb_avail":282634428,"statfs":{"total":289910292480,"available":289417654272,"internally_reserved":0,"allocated":258560000,"data_stored":256772924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9193,"internal_metadata":234019863},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1061,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1061,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.152689"},"pg_stats":[{"pgid":"4.3f","version":"72'404","reported_seq":559,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.393147+0000","last_change":"2024-04-25T22:44:57.382564+0000","last_active":"2024-04-25T22:44:59.393147+0000","last_peered":"2024-04-25T22:44:59.393147+0000","last_clean":"2024-04-25T22:44:59.393147+0000","last_became_active":"2024-04-25T22:44:57.376098+0000","last_became_peered":"2024-04-25T22:44:57.376098+0000","last_unstale":"2024-04-25T22:44:59.393147+0000","last_undegraded":"2024-04-25T22:44:59.393147+0000","last_fullsized":"2024-04-25T22:44:59.393147+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:31:49.789706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19772,"num_write":366,"num_write_kb":46873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"72'420","reported_seq":622,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392815+0000","last_change":"2024-04-25T22:44:41.434387+0000","last_active":"2024-04-25T22:44:59.392815+0000","last_peered":"2024-04-25T22:44:59.392815+0000","last_clean":"2024-04-25T22:44:59.392815+0000","last_became_active":"2024-04-25T22:44:41.418792+0000","last_became_peered":"2024-04-25T22:44:41.418792+0000","last_unstale":"2024-04-25T22:44:59.392815+0000","last_undegraded":"2024-04-25T22:44:59.392815+0000","last_fullsized":"2024-04-25T22:44:59.392815+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:43.196115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24515,"num_write":386,"num_write_kb":55688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"72'377","reported_seq":952,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107392+0000","last_change":"2024-04-25T22:44:42.096911+0000","last_active":"2024-04-25T22:44:59.107392+0000","last_peered":"2024-04-25T22:44:59.107392+0000","last_clean":"2024-04-25T22:44:59.107392+0000","last_became_active":"2024-04-25T22:44:42.093941+0000","last_became_peered":"2024-04-25T22:44:42.093941+0000","last_unstale":"2024-04-25T22:44:59.107392+0000","last_undegraded":"2024-04-25T22:44:59.107392+0000","last_fullsized":"2024-04-25T22:44:59.107392+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11135,"num_write":346,"num_write_kb":38950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"72'366","reported_seq":573,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107137+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:44:59.107137+0000","last_peered":"2024-04-25T22:44:59.107137+0000","last_clean":"2024-04-25T22:44:59.107137+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:44:59.107137+0000","last_undegraded":"2024-04-25T22:44:59.107137+0000","last_fullsized":"2024-04-25T22:44:59.107137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":326,"num_write_kb":34079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"72'455","reported_seq":635,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390846+0000","last_change":"2024-04-25T22:44:50.391674+0000","last_active":"2024-04-25T22:44:59.390846+0000","last_peered":"2024-04-25T22:44:59.390846+0000","last_clean":"2024-04-25T22:44:59.390846+0000","last_became_active":"2024-04-25T22:44:50.384804+0000","last_became_peered":"2024-04-25T22:44:50.384804+0000","last_unstale":"2024-04-25T22:44:59.390846+0000","last_undegraded":"2024-04-25T22:44:59.390846+0000","last_fullsized":"2024-04-25T22:44:59.390846+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:22:54.239989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33897,"num_write":426,"num_write_kb":100721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"72'401","reported_seq":635,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106493+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:44:59.106493+0000","last_peered":"2024-04-25T22:44:59.106493+0000","last_clean":"2024-04-25T22:44:59.106493+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:44:59.106493+0000","last_undegraded":"2024-04-25T22:44:59.106493+0000","last_fullsized":"2024-04-25T22:44:59.106493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15258,"num_write":369,"num_write_kb":53298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"72'452","reported_seq":718,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106260+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:44:59.106260+0000","last_peered":"2024-04-25T22:44:59.106260+0000","last_clean":"2024-04-25T22:44:59.106260+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:44:59.106260+0000","last_undegraded":"2024-04-25T22:44:59.106260+0000","last_fullsized":"2024-04-25T22:44:59.106260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34010,"num_write":428,"num_write_kb":157752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"72'401","reported_seq":640,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.105970+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:44:59.105970+0000","last_peered":"2024-04-25T22:44:59.105970+0000","last_clean":"2024-04-25T22:44:59.105970+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:44:59.105970+0000","last_undegraded":"2024-04-25T22:44:59.105970+0000","last_fullsized":"2024-04-25T22:44:59.105970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19917,"num_write":359,"num_write_kb":109382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"72'394","reported_seq":980,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101912+0000","last_change":"2024-04-25T22:44:48.092689+0000","last_active":"2024-04-25T22:44:59.101912+0000","last_peered":"2024-04-25T22:44:59.101912+0000","last_clean":"2024-04-25T22:44:59.101912+0000","last_became_active":"2024-04-25T22:44:48.089795+0000","last_became_peered":"2024-04-25T22:44:48.089795+0000","last_unstale":"2024-04-25T22:44:59.101912+0000","last_undegraded":"2024-04-25T22:44:59.101912+0000","last_fullsized":"2024-04-25T22:44:59.101912+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:32:33.072950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9569,"num_write":360,"num_write_kb":25560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"72'382","reported_seq":566,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392804+0000","last_change":"2024-04-25T22:44:41.433644+0000","last_active":"2024-04-25T22:44:59.392804+0000","last_peered":"2024-04-25T22:44:59.392804+0000","last_clean":"2024-04-25T22:44:59.392804+0000","last_became_active":"2024-04-25T22:44:41.421234+0000","last_became_peered":"2024-04-25T22:44:41.421234+0000","last_unstale":"2024-04-25T22:44:59.392804+0000","last_undegraded":"2024-04-25T22:44:59.392804+0000","last_fullsized":"2024-04-25T22:44:59.392804+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:24.217391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17192,"num_write":338,"num_write_kb":38688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"72'369","reported_seq":592,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107541+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:44:59.107541+0000","last_peered":"2024-04-25T22:44:59.107541+0000","last_clean":"2024-04-25T22:44:59.107541+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:44:59.107541+0000","last_undegraded":"2024-04-25T22:44:59.107541+0000","last_fullsized":"2024-04-25T22:44:59.107541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7385,"num_write":349,"num_write_kb":58842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"72'338","reported_seq":522,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391810+0000","last_change":"2024-04-25T22:44:49.384005+0000","last_active":"2024-04-25T22:44:59.391810+0000","last_peered":"2024-04-25T22:44:59.391810+0000","last_clean":"2024-04-25T22:44:59.391810+0000","last_became_active":"2024-04-25T22:44:49.378325+0000","last_became_peered":"2024-04-25T22:44:49.378325+0000","last_unstale":"2024-04-25T22:44:59.391810+0000","last_undegraded":"2024-04-25T22:44:59.391810+0000","last_fullsized":"2024-04-25T22:44:59.391810+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:18.849786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13619,"num_write":312,"num_write_kb":21391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"72'411","reported_seq":605,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391345+0000","last_change":"2024-04-25T22:44:41.432463+0000","last_active":"2024-04-25T22:44:59.391345+0000","last_peered":"2024-04-25T22:44:59.391345+0000","last_clean":"2024-04-25T22:44:59.391345+0000","last_became_active":"2024-04-25T22:44:41.421096+0000","last_became_peered":"2024-04-25T22:44:41.421096+0000","last_unstale":"2024-04-25T22:44:59.391345+0000","last_undegraded":"2024-04-25T22:44:59.391345+0000","last_fullsized":"2024-04-25T22:44:59.391345+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:46.942677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12998,"num_write":375,"num_write_kb":79661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"72'452","reported_seq":1051,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107059+0000","last_change":"2024-04-25T22:44:40.130299+0000","last_active":"2024-04-25T22:44:59.107059+0000","last_peered":"2024-04-25T22:44:59.107059+0000","last_clean":"2024-04-25T22:44:59.107059+0000","last_became_active":"2024-04-25T22:44:40.127307+0000","last_became_peered":"2024-04-25T22:44:40.127307+0000","last_unstale":"2024-04-25T22:44:59.107059+0000","last_undegraded":"2024-04-25T22:44:59.107059+0000","last_fullsized":"2024-04-25T22:44:59.107059+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:16.746830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":854,"num_write":419,"num_write_kb":88217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"72'428","reported_seq":1031,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106380+0000","last_change":"2024-04-25T22:44:35.108361+0000","last_active":"2024-04-25T22:44:59.106380+0000","last_peered":"2024-04-25T22:44:59.106380+0000","last_clean":"2024-04-25T22:44:59.106380+0000","last_became_active":"2024-04-25T22:44:35.103208+0000","last_became_peered":"2024-04-25T22:44:35.103208+0000","last_unstale":"2024-04-25T22:44:59.106380+0000","last_undegraded":"2024-04-25T22:44:59.106380+0000","last_fullsized":"2024-04-25T22:44:59.106380+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:22.046332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21291,"num_write":389,"num_write_kb":68562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"72'401","reported_seq":615,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.105974+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:44:59.105974+0000","last_peered":"2024-04-25T22:44:59.105974+0000","last_clean":"2024-04-25T22:44:59.105974+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:44:59.105974+0000","last_undegraded":"2024-04-25T22:44:59.105974+0000","last_fullsized":"2024-04-25T22:44:59.105974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8276,"num_write":369,"num_write_kb":17867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"72'398","reported_seq":971,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103506+0000","last_change":"2024-04-25T22:44:49.097340+0000","last_active":"2024-04-25T22:44:59.103506+0000","last_peered":"2024-04-25T22:44:59.103506+0000","last_clean":"2024-04-25T22:44:59.103506+0000","last_became_active":"2024-04-25T22:44:49.094478+0000","last_became_peered":"2024-04-25T22:44:49.094478+0000","last_unstale":"2024-04-25T22:44:59.103506+0000","last_undegraded":"2024-04-25T22:44:59.103506+0000","last_fullsized":"2024-04-25T22:44:59.103506+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:33.421713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5883,"num_write":362,"num_write_kb":38188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"72'407","reported_seq":543,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.401367+0000","last_change":"2024-04-25T22:44:59.401367+0000","last_active":"2024-04-25T22:44:59.401367+0000","last_peered":"2024-04-25T22:44:59.401367+0000","last_clean":"2024-04-25T22:44:59.401367+0000","last_became_active":"2024-04-25T22:44:59.396404+0000","last_became_peered":"2024-04-25T22:44:59.396404+0000","last_unstale":"2024-04-25T22:44:59.401367+0000","last_undegraded":"2024-04-25T22:44:59.401367+0000","last_fullsized":"2024-04-25T22:44:59.401367+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:15:41.602118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13073,"num_write":372,"num_write_kb":59323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"72'441","reported_seq":1059,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102684+0000","last_change":"2024-04-25T22:44:41.148409+0000","last_active":"2024-04-25T22:44:59.102684+0000","last_peered":"2024-04-25T22:44:59.102684+0000","last_clean":"2024-04-25T22:44:59.102684+0000","last_became_active":"2024-04-25T22:44:41.143302+0000","last_became_peered":"2024-04-25T22:44:41.143302+0000","last_unstale":"2024-04-25T22:44:59.102684+0000","last_undegraded":"2024-04-25T22:44:59.102684+0000","last_fullsized":"2024-04-25T22:44:59.102684+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:46.289713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37611,"num_write":403,"num_write_kb":116618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"72'438","reported_seq":664,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107576+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:44:59.107576+0000","last_peered":"2024-04-25T22:44:59.107576+0000","last_clean":"2024-04-25T22:44:59.107576+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:44:59.107576+0000","last_undegraded":"2024-04-25T22:44:59.107576+0000","last_fullsized":"2024-04-25T22:44:59.107576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12393,"num_write":408,"num_write_kb":99933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"72'407","reported_seq":622,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108619+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:44:59.108619+0000","last_peered":"2024-04-25T22:44:59.108619+0000","last_clean":"2024-04-25T22:44:59.108619+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:44:59.108619+0000","last_undegraded":"2024-04-25T22:44:59.108619+0000","last_fullsized":"2024-04-25T22:44:59.108619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8932,"num_write":382,"num_write_kb":59684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"72'463","reported_seq":692,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391725+0000","last_change":"2024-04-25T22:44:47.376009+0000","last_active":"2024-04-25T22:44:59.391725+0000","last_peered":"2024-04-25T22:44:59.391725+0000","last_clean":"2024-04-25T22:44:59.391725+0000","last_became_active":"2024-04-25T22:44:47.369995+0000","last_became_peered":"2024-04-25T22:44:47.369995+0000","last_unstale":"2024-04-25T22:44:59.391725+0000","last_undegraded":"2024-04-25T22:44:59.391725+0000","last_fullsized":"2024-04-25T22:44:59.391725+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:04.129559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27589,"num_write":428,"num_write_kb":76861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"72'425","reported_seq":694,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.100741+0000","last_change":"2024-04-25T22:44:39.132230+0000","last_active":"2024-04-25T22:44:59.100741+0000","last_peered":"2024-04-25T22:44:59.100741+0000","last_clean":"2024-04-25T22:44:59.100741+0000","last_became_active":"2024-04-25T22:44:39.118635+0000","last_became_peered":"2024-04-25T22:44:39.118635+0000","last_unstale":"2024-04-25T22:44:59.100741+0000","last_undegraded":"2024-04-25T22:44:59.100741+0000","last_fullsized":"2024-04-25T22:44:59.100741+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:15.096836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":46424,"num_write":390,"num_write_kb":96359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"72'445","reported_seq":619,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390506+0000","last_change":"2024-04-25T22:44:54.388681+0000","last_active":"2024-04-25T22:44:59.390506+0000","last_peered":"2024-04-25T22:44:59.390506+0000","last_clean":"2024-04-25T22:44:59.390506+0000","last_became_active":"2024-04-25T22:44:54.382124+0000","last_became_peered":"2024-04-25T22:44:54.382124+0000","last_unstale":"2024-04-25T22:44:59.390506+0000","last_undegraded":"2024-04-25T22:44:59.390506+0000","last_fullsized":"2024-04-25T22:44:59.390506+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:49.633770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32317,"num_write":419,"num_write_kb":76071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"72'424","reported_seq":590,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392521+0000","last_change":"2024-04-25T22:44:51.391125+0000","last_active":"2024-04-25T22:44:59.392521+0000","last_peered":"2024-04-25T22:44:59.392521+0000","last_clean":"2024-04-25T22:44:59.392521+0000","last_became_active":"2024-04-25T22:44:51.383461+0000","last_became_peered":"2024-04-25T22:44:51.383461+0000","last_unstale":"2024-04-25T22:44:59.392521+0000","last_undegraded":"2024-04-25T22:44:59.392521+0000","last_fullsized":"2024-04-25T22:44:59.392521+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:33.717342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8396,"num_write":399,"num_write_kb":50416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"72'499","reported_seq":710,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102656+0000","last_change":"2024-04-25T22:44:39.149280+0000","last_active":"2024-04-25T22:44:59.102656+0000","last_peered":"2024-04-25T22:44:59.102656+0000","last_clean":"2024-04-25T22:44:59.102656+0000","last_became_active":"2024-04-25T22:44:39.143391+0000","last_became_peered":"2024-04-25T22:44:39.143391+0000","last_unstale":"2024-04-25T22:44:59.102656+0000","last_undegraded":"2024-04-25T22:44:59.102656+0000","last_fullsized":"2024-04-25T22:44:59.102656+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:54:10.301144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10227,"num_write":453,"num_write_kb":96585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'430","reported_seq":1082,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107732+0000","last_change":"2024-04-25T22:44:39.113437+0000","last_active":"2024-04-25T22:44:59.107732+0000","last_peered":"2024-04-25T22:44:59.107732+0000","last_clean":"2024-04-25T22:44:59.107732+0000","last_became_active":"2024-04-25T22:44:39.109771+0000","last_became_peered":"2024-04-25T22:44:39.109771+0000","last_unstale":"2024-04-25T22:44:59.107732+0000","last_undegraded":"2024-04-25T22:44:59.107732+0000","last_fullsized":"2024-04-25T22:44:59.107732+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:40:46.739897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":32116,"num_write":409,"num_write_kb":89217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"72'393","reported_seq":656,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391736+0000","last_change":"2024-04-25T22:44:41.425947+0000","last_active":"2024-04-25T22:44:59.391736+0000","last_peered":"2024-04-25T22:44:59.391736+0000","last_clean":"2024-04-25T22:44:59.391736+0000","last_became_active":"2024-04-25T22:44:41.413570+0000","last_became_peered":"2024-04-25T22:44:41.413570+0000","last_unstale":"2024-04-25T22:44:59.391736+0000","last_undegraded":"2024-04-25T22:44:59.391736+0000","last_fullsized":"2024-04-25T22:44:59.391736+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:39:00.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":28076,"num_write":364,"num_write_kb":47473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"72'399","reported_seq":993,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103262+0000","last_change":"2024-04-25T22:44:40.124745+0000","last_active":"2024-04-25T22:44:59.103262+0000","last_peered":"2024-04-25T22:44:59.103262+0000","last_clean":"2024-04-25T22:44:59.103262+0000","last_became_active":"2024-04-25T22:44:40.121838+0000","last_became_peered":"2024-04-25T22:44:40.121838+0000","last_unstale":"2024-04-25T22:44:59.103262+0000","last_undegraded":"2024-04-25T22:44:59.103262+0000","last_fullsized":"2024-04-25T22:44:59.103262+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:28.299317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14005,"num_write":367,"num_write_kb":58883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"72'484","reported_seq":683,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391410+0000","last_change":"2024-04-25T22:44:54.392451+0000","last_active":"2024-04-25T22:44:59.391410+0000","last_peered":"2024-04-25T22:44:59.391410+0000","last_clean":"2024-04-25T22:44:59.391410+0000","last_became_active":"2024-04-25T22:44:54.383808+0000","last_became_peered":"2024-04-25T22:44:54.383808+0000","last_unstale":"2024-04-25T22:44:59.391410+0000","last_undegraded":"2024-04-25T22:44:59.391410+0000","last_fullsized":"2024-04-25T22:44:59.391410+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:06.630318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23352,"num_write":446,"num_write_kb":100094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'455","reported_seq":1136,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101023+0000","last_change":"2024-04-25T22:44:33.087211+0000","last_active":"2024-04-25T22:44:59.101023+0000","last_peered":"2024-04-25T22:44:59.101023+0000","last_clean":"2024-04-25T22:44:59.101023+0000","last_became_active":"2024-04-25T22:44:33.084127+0000","last_became_peered":"2024-04-25T22:44:33.084127+0000","last_unstale":"2024-04-25T22:44:59.101023+0000","last_undegraded":"2024-04-25T22:44:59.101023+0000","last_fullsized":"2024-04-25T22:44:59.101023+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38440,"num_write":423,"num_write_kb":71855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"72'434","reported_seq":668,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106552+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:44:59.106552+0000","last_peered":"2024-04-25T22:44:59.106552+0000","last_clean":"2024-04-25T22:44:59.106552+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:44:59.106552+0000","last_undegraded":"2024-04-25T22:44:59.106552+0000","last_fullsized":"2024-04-25T22:44:59.106552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18701,"num_write":402,"num_write_kb":27564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"72'379","reported_seq":526,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391067+0000","last_change":"2024-04-25T22:44:53.383623+0000","last_active":"2024-04-25T22:44:59.391067+0000","last_peered":"2024-04-25T22:44:59.391067+0000","last_clean":"2024-04-25T22:44:59.391067+0000","last_became_active":"2024-04-25T22:44:53.378402+0000","last_became_peered":"2024-04-25T22:44:53.378402+0000","last_unstale":"2024-04-25T22:44:59.391067+0000","last_undegraded":"2024-04-25T22:44:59.391067+0000","last_fullsized":"2024-04-25T22:44:59.391067+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:52:18.111269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18623,"num_write":344,"num_write_kb":50888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"71'528","reported_seq":731,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109262+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:44:59.109262+0000","last_peered":"2024-04-25T22:44:59.109262+0000","last_clean":"2024-04-25T22:44:59.109262+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:44:59.109262+0000","last_undegraded":"2024-04-25T22:44:59.109262+0000","last_fullsized":"2024-04-25T22:44:59.109262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"72'383","reported_seq":503,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392060+0000","last_change":"2024-04-25T22:44:58.385931+0000","last_active":"2024-04-25T22:44:59.392060+0000","last_peered":"2024-04-25T22:44:59.392060+0000","last_clean":"2024-04-25T22:44:59.392060+0000","last_became_active":"2024-04-25T22:44:58.380203+0000","last_became_peered":"2024-04-25T22:44:58.380203+0000","last_unstale":"2024-04-25T22:44:59.392060+0000","last_undegraded":"2024-04-25T22:44:59.392060+0000","last_fullsized":"2024-04-25T22:44:59.392060+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:12.874377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8364,"num_write":351,"num_write_kb":30625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"71'45","reported_seq":201,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102522+0000","last_change":"2024-04-25T22:44:39.117622+0000","last_active":"2024-04-25T22:44:59.102522+0000","last_peered":"2024-04-25T22:44:59.102522+0000","last_clean":"2024-04-25T22:44:59.102522+0000","last_became_active":"2024-04-25T22:44:39.115669+0000","last_became_peered":"2024-04-25T22:44:39.115669+0000","last_unstale":"2024-04-25T22:44:59.102522+0000","last_undegraded":"2024-04-25T22:44:59.102522+0000","last_fullsized":"2024-04-25T22:44:59.102522+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:21.793820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"72'429","reported_seq":571,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392387+0000","last_change":"2024-04-25T22:44:58.388677+0000","last_active":"2024-04-25T22:44:59.392387+0000","last_peered":"2024-04-25T22:44:59.392387+0000","last_clean":"2024-04-25T22:44:59.392387+0000","last_became_active":"2024-04-25T22:44:58.382521+0000","last_became_peered":"2024-04-25T22:44:58.382521+0000","last_unstale":"2024-04-25T22:44:59.392387+0000","last_undegraded":"2024-04-25T22:44:59.392387+0000","last_fullsized":"2024-04-25T22:44:59.392387+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:26.999533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16584,"num_write":393,"num_write_kb":63712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'61","reported_seq":89,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391526+0000","last_change":"2024-04-25T22:44:41.416554+0000","last_active":"2024-04-25T22:44:59.391526+0000","last_peered":"2024-04-25T22:44:59.391526+0000","last_clean":"2024-04-25T22:44:59.391526+0000","last_became_active":"2024-04-25T22:44:41.413853+0000","last_became_peered":"2024-04-25T22:44:41.413853+0000","last_unstale":"2024-04-25T22:44:59.391526+0000","last_undegraded":"2024-04-25T22:44:59.391526+0000","last_fullsized":"2024-04-25T22:44:59.391526+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:50.701110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"72'404","reported_seq":624,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102212+0000","last_change":"2024-04-25T22:44:39.128428+0000","last_active":"2024-04-25T22:44:59.102212+0000","last_peered":"2024-04-25T22:44:59.102212+0000","last_clean":"2024-04-25T22:44:59.102212+0000","last_became_active":"2024-04-25T22:44:39.116562+0000","last_became_peered":"2024-04-25T22:44:39.116562+0000","last_unstale":"2024-04-25T22:44:59.102212+0000","last_undegraded":"2024-04-25T22:44:59.102212+0000","last_fullsized":"2024-04-25T22:44:59.102212+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:09.750726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18745,"num_write":376,"num_write_kb":96145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'71","reported_seq":282,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106763+0000","last_change":"2024-04-25T22:44:26.363329+0000","last_active":"2024-04-25T22:44:59.106763+0000","last_peered":"2024-04-25T22:44:59.106763+0000","last_clean":"2024-04-25T22:44:59.106763+0000","last_became_active":"2024-04-25T22:44:26.362499+0000","last_became_peered":"2024-04-25T22:44:26.362499+0000","last_unstale":"2024-04-25T22:44:59.106763+0000","last_undegraded":"2024-04-25T22:44:59.106763+0000","last_fullsized":"2024-04-25T22:44:59.106763+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'145","reported_seq":362,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109263+0000","last_change":"2024-04-25T22:44:29.400540+0000","last_active":"2024-04-25T22:44:59.109263+0000","last_peered":"2024-04-25T22:44:59.109263+0000","last_clean":"2024-04-25T22:44:59.109263+0000","last_became_active":"2024-04-25T22:44:29.399853+0000","last_became_peered":"2024-04-25T22:44:29.399853+0000","last_unstale":"2024-04-25T22:44:59.109263+0000","last_undegraded":"2024-04-25T22:44:59.109263+0000","last_fullsized":"2024-04-25T22:44:59.109263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"72'399","reported_seq":605,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390842+0000","last_change":"2024-04-25T22:44:46.398600+0000","last_active":"2024-04-25T22:44:59.390842+0000","last_peered":"2024-04-25T22:44:59.390842+0000","last_clean":"2024-04-25T22:44:59.390842+0000","last_became_active":"2024-04-25T22:44:46.392604+0000","last_became_peered":"2024-04-25T22:44:46.392604+0000","last_unstale":"2024-04-25T22:44:59.390842+0000","last_undegraded":"2024-04-25T22:44:59.390842+0000","last_fullsized":"2024-04-25T22:44:59.390842+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:15.771324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25159,"num_write":363,"num_write_kb":34063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"71'226","reported_seq":432,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392417+0000","last_change":"2024-04-25T22:44:41.417859+0000","last_active":"2024-04-25T22:44:59.392417+0000","last_peered":"2024-04-25T22:44:59.392417+0000","last_clean":"2024-04-25T22:44:59.392417+0000","last_became_active":"2024-04-25T22:44:41.416542+0000","last_became_peered":"2024-04-25T22:44:41.416542+0000","last_unstale":"2024-04-25T22:44:59.392417+0000","last_undegraded":"2024-04-25T22:44:59.392417+0000","last_fullsized":"2024-04-25T22:44:59.392417+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:27.884903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"72'431","reported_seq":578,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390134+0000","last_change":"2024-04-25T22:44:56.419453+0000","last_active":"2024-04-25T22:44:59.390134+0000","last_peered":"2024-04-25T22:44:59.390134+0000","last_clean":"2024-04-25T22:44:59.390134+0000","last_became_active":"2024-04-25T22:44:56.412151+0000","last_became_peered":"2024-04-25T22:44:56.412151+0000","last_unstale":"2024-04-25T22:44:59.390134+0000","last_undegraded":"2024-04-25T22:44:59.390134+0000","last_fullsized":"2024-04-25T22:44:59.390134+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:07:27.220853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14688,"num_write":405,"num_write_kb":38957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"71'382","reported_seq":599,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108993+0000","last_change":"2024-04-25T22:44:30.401893+0000","last_active":"2024-04-25T22:44:59.108993+0000","last_peered":"2024-04-25T22:44:59.108993+0000","last_clean":"2024-04-25T22:44:59.108993+0000","last_became_active":"2024-04-25T22:44:30.401021+0000","last_became_peered":"2024-04-25T22:44:30.401021+0000","last_unstale":"2024-04-25T22:44:59.108993+0000","last_undegraded":"2024-04-25T22:44:59.108993+0000","last_fullsized":"2024-04-25T22:44:59.108993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:38.452482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'453","reported_seq":685,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107186+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:44:59.107186+0000","last_peered":"2024-04-25T22:44:59.107186+0000","last_clean":"2024-04-25T22:44:59.107186+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:44:59.107186+0000","last_undegraded":"2024-04-25T22:44:59.107186+0000","last_fullsized":"2024-04-25T22:44:59.107186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18900,"num_write":418,"num_write_kb":117500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"71'64","reported_seq":267,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108997+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:44:59.108997+0000","last_peered":"2024-04-25T22:44:59.108997+0000","last_clean":"2024-04-25T22:44:59.108997+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:44:59.108997+0000","last_undegraded":"2024-04-25T22:44:59.108997+0000","last_fullsized":"2024-04-25T22:44:59.108997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'428","reported_seq":631,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103565+0000","last_change":"2024-04-25T22:44:39.129871+0000","last_active":"2024-04-25T22:44:59.103565+0000","last_peered":"2024-04-25T22:44:59.103565+0000","last_clean":"2024-04-25T22:44:59.103565+0000","last_became_active":"2024-04-25T22:44:39.121205+0000","last_became_peered":"2024-04-25T22:44:39.121205+0000","last_unstale":"2024-04-25T22:44:59.103565+0000","last_undegraded":"2024-04-25T22:44:59.103565+0000","last_fullsized":"2024-04-25T22:44:59.103565+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:48.521828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7477,"num_write":383,"num_write_kb":9617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'166","reported_seq":322,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103845+0000","last_change":"2024-04-25T22:44:39.133550+0000","last_active":"2024-04-25T22:44:59.103845+0000","last_peered":"2024-04-25T22:44:59.103845+0000","last_clean":"2024-04-25T22:44:59.103845+0000","last_became_active":"2024-04-25T22:44:39.131489+0000","last_became_peered":"2024-04-25T22:44:39.131489+0000","last_unstale":"2024-04-25T22:44:59.103845+0000","last_undegraded":"2024-04-25T22:44:59.103845+0000","last_fullsized":"2024-04-25T22:44:59.103845+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:32.980801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"72'446","reported_seq":696,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108117+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:44:59.108117+0000","last_peered":"2024-04-25T22:44:59.108117+0000","last_clean":"2024-04-25T22:44:59.108117+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:44:59.108117+0000","last_undegraded":"2024-04-25T22:44:59.108117+0000","last_fullsized":"2024-04-25T22:44:59.108117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27788,"num_write":414,"num_write_kb":47058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"71'113","reported_seq":316,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108347+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:44:59.108347+0000","last_peered":"2024-04-25T22:44:59.108347+0000","last_clean":"2024-04-25T22:44:59.108347+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:44:59.108347+0000","last_undegraded":"2024-04-25T22:44:59.108347+0000","last_fullsized":"2024-04-25T22:44:59.108347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"72'417","reported_seq":1019,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108706+0000","last_change":"2024-04-25T22:44:44.113498+0000","last_active":"2024-04-25T22:44:59.108706+0000","last_peered":"2024-04-25T22:44:59.108706+0000","last_clean":"2024-04-25T22:44:59.108706+0000","last_became_active":"2024-04-25T22:44:44.108084+0000","last_became_peered":"2024-04-25T22:44:44.108084+0000","last_unstale":"2024-04-25T22:44:59.108706+0000","last_undegraded":"2024-04-25T22:44:59.108706+0000","last_fullsized":"2024-04-25T22:44:59.108706+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16487,"num_write":388,"num_write_kb":75452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'59","reported_seq":89,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390108+0000","last_change":"2024-04-25T22:44:41.417821+0000","last_active":"2024-04-25T22:44:59.390108+0000","last_peered":"2024-04-25T22:44:59.390108+0000","last_clean":"2024-04-25T22:44:59.390108+0000","last_became_active":"2024-04-25T22:44:41.415769+0000","last_became_peered":"2024-04-25T22:44:41.415769+0000","last_unstale":"2024-04-25T22:44:59.390108+0000","last_undegraded":"2024-04-25T22:44:59.390108+0000","last_fullsized":"2024-04-25T22:44:59.390108+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.099475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'358","reported_seq":900,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107737+0000","last_change":"2024-04-25T22:44:34.101942+0000","last_active":"2024-04-25T22:44:59.107737+0000","last_peered":"2024-04-25T22:44:59.107737+0000","last_clean":"2024-04-25T22:44:59.107737+0000","last_became_active":"2024-04-25T22:44:34.099595+0000","last_became_peered":"2024-04-25T22:44:34.099595+0000","last_unstale":"2024-04-25T22:44:59.107737+0000","last_undegraded":"2024-04-25T22:44:59.107737+0000","last_fullsized":"2024-04-25T22:44:59.107737+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:06.523166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12259,"num_write":325,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'465","reported_seq":634,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390513+0000","last_change":"2024-04-25T22:44:41.425331+0000","last_active":"2024-04-25T22:44:59.390513+0000","last_peered":"2024-04-25T22:44:59.390513+0000","last_clean":"2024-04-25T22:44:59.390513+0000","last_became_active":"2024-04-25T22:44:41.423799+0000","last_became_peered":"2024-04-25T22:44:41.423799+0000","last_unstale":"2024-04-25T22:44:59.390513+0000","last_undegraded":"2024-04-25T22:44:59.390513+0000","last_fullsized":"2024-04-25T22:44:59.390513+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:04.324825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"72'386","reported_seq":955,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102556+0000","last_change":"2024-04-25T22:44:46.113269+0000","last_active":"2024-04-25T22:44:59.102556+0000","last_peered":"2024-04-25T22:44:59.102556+0000","last_clean":"2024-04-25T22:44:59.102556+0000","last_became_active":"2024-04-25T22:44:46.110394+0000","last_became_peered":"2024-04-25T22:44:46.110394+0000","last_unstale":"2024-04-25T22:44:59.102556+0000","last_undegraded":"2024-04-25T22:44:59.102556+0000","last_fullsized":"2024-04-25T22:44:59.102556+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9402,"num_write":352,"num_write_kb":50548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":418,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107397+0000","last_change":"2024-04-25T22:44:26.355770+0000","last_active":"2024-04-25T22:44:59.107397+0000","last_peered":"2024-04-25T22:44:59.107397+0000","last_clean":"2024-04-25T22:44:59.107397+0000","last_became_active":"2024-04-25T22:44:26.354730+0000","last_became_peered":"2024-04-25T22:44:26.354730+0000","last_unstale":"2024-04-25T22:44:59.107397+0000","last_undegraded":"2024-04-25T22:44:59.107397+0000","last_fullsized":"2024-04-25T22:44:59.107397+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:34.987031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":209,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109432+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:44:59.109432+0000","last_peered":"2024-04-25T22:44:59.109432+0000","last_clean":"2024-04-25T22:44:59.109432+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:44:59.109432+0000","last_undegraded":"2024-04-25T22:44:59.109432+0000","last_fullsized":"2024-04-25T22:44:59.109432+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"71'457","reported_seq":676,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103149+0000","last_change":"2024-04-25T22:44:29.399148+0000","last_active":"2024-04-25T22:44:59.103149+0000","last_peered":"2024-04-25T22:44:59.103149+0000","last_clean":"2024-04-25T22:44:59.103149+0000","last_became_active":"2024-04-25T22:44:29.397962+0000","last_became_peered":"2024-04-25T22:44:29.397962+0000","last_unstale":"2024-04-25T22:44:59.103149+0000","last_undegraded":"2024-04-25T22:44:59.103149+0000","last_fullsized":"2024-04-25T22:44:59.103149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:14.015619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"72'447","reported_seq":1111,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108782+0000","last_change":"2024-04-25T22:44:43.108262+0000","last_active":"2024-04-25T22:44:59.108782+0000","last_peered":"2024-04-25T22:44:59.108782+0000","last_clean":"2024-04-25T22:44:59.108782+0000","last_became_active":"2024-04-25T22:44:43.105231+0000","last_became_peered":"2024-04-25T22:44:43.105231+0000","last_unstale":"2024-04-25T22:44:59.108782+0000","last_undegraded":"2024-04-25T22:44:59.108782+0000","last_fullsized":"2024-04-25T22:44:59.108782+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:09.728618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45074,"num_write":414,"num_write_kb":120596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":216,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107098+0000","last_change":"2024-04-25T22:44:26.355238+0000","last_active":"2024-04-25T22:44:59.107098+0000","last_peered":"2024-04-25T22:44:59.107098+0000","last_clean":"2024-04-25T22:44:59.107098+0000","last_became_active":"2024-04-25T22:44:26.354482+0000","last_became_peered":"2024-04-25T22:44:26.354482+0000","last_unstale":"2024-04-25T22:44:59.107098+0000","last_undegraded":"2024-04-25T22:44:59.107098+0000","last_fullsized":"2024-04-25T22:44:59.107098+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.042514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'122","reported_seq":340,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101684+0000","last_change":"2024-04-25T22:44:39.141843+0000","last_active":"2024-04-25T22:44:59.101684+0000","last_peered":"2024-04-25T22:44:59.101684+0000","last_clean":"2024-04-25T22:44:59.101684+0000","last_became_active":"2024-04-25T22:44:39.139689+0000","last_became_peered":"2024-04-25T22:44:39.139689+0000","last_unstale":"2024-04-25T22:44:59.101684+0000","last_undegraded":"2024-04-25T22:44:59.101684+0000","last_fullsized":"2024-04-25T22:44:59.101684+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:18.614670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":62,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"72'449","reported_seq":652,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.393126+0000","last_change":"2024-04-25T22:44:41.439044+0000","last_active":"2024-04-25T22:44:59.393126+0000","last_peered":"2024-04-25T22:44:59.393126+0000","last_clean":"2024-04-25T22:44:59.393126+0000","last_became_active":"2024-04-25T22:44:41.432785+0000","last_became_peered":"2024-04-25T22:44:41.432785+0000","last_unstale":"2024-04-25T22:44:59.393126+0000","last_undegraded":"2024-04-25T22:44:59.393126+0000","last_fullsized":"2024-04-25T22:44:59.393126+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:57.171725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25191,"num_write":420,"num_write_kb":79855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101972+0000","last_change":"2024-04-25T22:44:26.363464+0000","last_active":"2024-04-25T22:44:59.101972+0000","last_peered":"2024-04-25T22:44:59.101972+0000","last_clean":"2024-04-25T22:44:59.101972+0000","last_became_active":"2024-04-25T22:44:26.362808+0000","last_became_peered":"2024-04-25T22:44:26.362808+0000","last_unstale":"2024-04-25T22:44:59.101972+0000","last_undegraded":"2024-04-25T22:44:59.101972+0000","last_fullsized":"2024-04-25T22:44:59.101972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:06.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'435","reported_seq":630,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.389941+0000","last_change":"2024-04-25T22:44:41.417191+0000","last_active":"2024-04-25T22:44:59.389941+0000","last_peered":"2024-04-25T22:44:59.389941+0000","last_clean":"2024-04-25T22:44:59.389941+0000","last_became_active":"2024-04-25T22:44:41.415592+0000","last_became_peered":"2024-04-25T22:44:41.415592+0000","last_unstale":"2024-04-25T22:44:59.389941+0000","last_undegraded":"2024-04-25T22:44:59.389941+0000","last_fullsized":"2024-04-25T22:44:59.389941+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:35.916512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"72'337","reported_seq":888,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103033+0000","last_change":"2024-04-25T22:44:45.113523+0000","last_active":"2024-04-25T22:44:59.103033+0000","last_peered":"2024-04-25T22:44:59.103033+0000","last_clean":"2024-04-25T22:44:59.103033+0000","last_became_active":"2024-04-25T22:44:45.111011+0000","last_became_peered":"2024-04-25T22:44:45.111011+0000","last_unstale":"2024-04-25T22:44:59.103033+0000","last_undegraded":"2024-04-25T22:44:59.103033+0000","last_fullsized":"2024-04-25T22:44:59.103033+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25242,"num_write":307,"num_write_kb":26250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":209,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108546+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:44:59.108546+0000","last_peered":"2024-04-25T22:44:59.108546+0000","last_clean":"2024-04-25T22:44:59.108546+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:44:59.108546+0000","last_undegraded":"2024-04-25T22:44:59.108546+0000","last_fullsized":"2024-04-25T22:44:59.108546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"71'61","reported_seq":264,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109291+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:44:59.109291+0000","last_peered":"2024-04-25T22:44:59.109291+0000","last_clean":"2024-04-25T22:44:59.109291+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:44:59.109291+0000","last_undegraded":"2024-04-25T22:44:59.109291+0000","last_fullsized":"2024-04-25T22:44:59.109291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'404","reported_seq":1016,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102941+0000","last_change":"2024-04-25T22:44:32.092728+0000","last_active":"2024-04-25T22:44:59.102941+0000","last_peered":"2024-04-25T22:44:59.102941+0000","last_clean":"2024-04-25T22:44:59.102941+0000","last_became_active":"2024-04-25T22:44:32.087528+0000","last_became_peered":"2024-04-25T22:44:32.087528+0000","last_unstale":"2024-04-25T22:44:59.102941+0000","last_undegraded":"2024-04-25T22:44:59.102941+0000","last_fullsized":"2024-04-25T22:44:59.102941+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:39.481467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":20287,"num_write":371,"num_write_kb":59919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'285","reported_seq":488,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109060+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:44:59.109060+0000","last_peered":"2024-04-25T22:44:59.109060+0000","last_clean":"2024-04-25T22:44:59.109060+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:44:59.109060+0000","last_undegraded":"2024-04-25T22:44:59.109060+0000","last_fullsized":"2024-04-25T22:44:59.109060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":217,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.104160+0000","last_change":"2024-04-25T22:44:26.364185+0000","last_active":"2024-04-25T22:44:59.104160+0000","last_peered":"2024-04-25T22:44:59.104160+0000","last_clean":"2024-04-25T22:44:59.104160+0000","last_became_active":"2024-04-25T22:44:26.363583+0000","last_became_peered":"2024-04-25T22:44:26.363583+0000","last_unstale":"2024-04-25T22:44:59.104160+0000","last_undegraded":"2024-04-25T22:44:59.104160+0000","last_fullsized":"2024-04-25T22:44:59.104160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:35:04.325449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"72'366","reported_seq":522,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391466+0000","last_change":"2024-04-25T22:44:52.381174+0000","last_active":"2024-04-25T22:44:59.391466+0000","last_peered":"2024-04-25T22:44:59.391466+0000","last_clean":"2024-04-25T22:44:59.391466+0000","last_became_active":"2024-04-25T22:44:52.375504+0000","last_became_peered":"2024-04-25T22:44:52.375504+0000","last_unstale":"2024-04-25T22:44:59.391466+0000","last_undegraded":"2024-04-25T22:44:59.391466+0000","last_fullsized":"2024-04-25T22:44:59.391466+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:41.592790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":346,"num_write":330,"num_write_kb":33934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":265,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103283+0000","last_change":"2024-04-25T22:44:26.364178+0000","last_active":"2024-04-25T22:44:59.103283+0000","last_peered":"2024-04-25T22:44:59.103283+0000","last_clean":"2024-04-25T22:44:59.103283+0000","last_became_active":"2024-04-25T22:44:26.363455+0000","last_became_peered":"2024-04-25T22:44:26.363455+0000","last_unstale":"2024-04-25T22:44:59.103283+0000","last_undegraded":"2024-04-25T22:44:59.103283+0000","last_fullsized":"2024-04-25T22:44:59.103283+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:58.181763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":143,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392774+0000","last_change":"2024-04-25T22:44:41.423030+0000","last_active":"2024-04-25T22:44:59.392774+0000","last_peered":"2024-04-25T22:44:59.392774+0000","last_clean":"2024-04-25T22:44:59.392774+0000","last_became_active":"2024-04-25T22:44:41.421194+0000","last_became_peered":"2024-04-25T22:44:41.421194+0000","last_unstale":"2024-04-25T22:44:59.392774+0000","last_undegraded":"2024-04-25T22:44:59.392774+0000","last_fullsized":"2024-04-25T22:44:59.392774+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:59.297537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'413","reported_seq":627,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390506+0000","last_change":"2024-04-25T22:44:48.378474+0000","last_active":"2024-04-25T22:44:59.390506+0000","last_peered":"2024-04-25T22:44:59.390506+0000","last_clean":"2024-04-25T22:44:59.390506+0000","last_became_active":"2024-04-25T22:44:48.372485+0000","last_became_peered":"2024-04-25T22:44:48.372485+0000","last_unstale":"2024-04-25T22:44:59.390506+0000","last_undegraded":"2024-04-25T22:44:59.390506+0000","last_fullsized":"2024-04-25T22:44:59.390506+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:47.402437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22994,"num_write":377,"num_write_kb":63140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'57","reported_seq":269,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103690+0000","last_change":"2024-04-25T22:44:26.366189+0000","last_active":"2024-04-25T22:44:59.103690+0000","last_peered":"2024-04-25T22:44:59.103690+0000","last_clean":"2024-04-25T22:44:59.103690+0000","last_became_active":"2024-04-25T22:44:26.365267+0000","last_became_peered":"2024-04-25T22:44:26.365267+0000","last_unstale":"2024-04-25T22:44:59.103690+0000","last_undegraded":"2024-04-25T22:44:59.103690+0000","last_fullsized":"2024-04-25T22:44:59.103690+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:54.128937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":217,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.104205+0000","last_change":"2024-04-25T22:44:26.361633+0000","last_active":"2024-04-25T22:44:59.104205+0000","last_peered":"2024-04-25T22:44:59.104205+0000","last_clean":"2024-04-25T22:44:59.104205+0000","last_became_active":"2024-04-25T22:44:26.360968+0000","last_became_peered":"2024-04-25T22:44:26.360968+0000","last_unstale":"2024-04-25T22:44:59.104205+0000","last_undegraded":"2024-04-25T22:44:59.104205+0000","last_fullsized":"2024-04-25T22:44:59.104205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:40.454898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'398","reported_seq":599,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102087+0000","last_change":"2024-04-25T22:44:39.132801+0000","last_active":"2024-04-25T22:44:59.102087+0000","last_peered":"2024-04-25T22:44:59.102087+0000","last_clean":"2024-04-25T22:44:59.102087+0000","last_became_active":"2024-04-25T22:44:39.124378+0000","last_became_peered":"2024-04-25T22:44:39.124378+0000","last_unstale":"2024-04-25T22:44:59.102087+0000","last_undegraded":"2024-04-25T22:44:59.102087+0000","last_fullsized":"2024-04-25T22:44:59.102087+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:29.195889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6306,"num_write":372,"num_write_kb":34077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'100","reported_seq":306,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.104153+0000","last_change":"2024-04-25T22:44:39.150245+0000","last_active":"2024-04-25T22:44:59.104153+0000","last_peered":"2024-04-25T22:44:59.104153+0000","last_clean":"2024-04-25T22:44:59.104153+0000","last_became_active":"2024-04-25T22:44:39.147377+0000","last_became_peered":"2024-04-25T22:44:39.147377+0000","last_unstale":"2024-04-25T22:44:59.104153+0000","last_undegraded":"2024-04-25T22:44:59.104153+0000","last_fullsized":"2024-04-25T22:44:59.104153+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:36.007978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":216,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109540+0000","last_change":"2024-04-25T22:44:26.360890+0000","last_active":"2024-04-25T22:44:59.109540+0000","last_peered":"2024-04-25T22:44:59.109540+0000","last_clean":"2024-04-25T22:44:59.109540+0000","last_became_active":"2024-04-25T22:44:26.360106+0000","last_became_peered":"2024-04-25T22:44:26.360106+0000","last_unstale":"2024-04-25T22:44:59.109540+0000","last_undegraded":"2024-04-25T22:44:59.109540+0000","last_fullsized":"2024-04-25T22:44:59.109540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:09.929196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'390","reported_seq":621,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390857+0000","last_change":"2024-04-25T22:44:41.433574+0000","last_active":"2024-04-25T22:44:59.390857+0000","last_peered":"2024-04-25T22:44:59.390857+0000","last_clean":"2024-04-25T22:44:59.390857+0000","last_became_active":"2024-04-25T22:44:41.414924+0000","last_became_peered":"2024-04-25T22:44:41.414924+0000","last_unstale":"2024-04-25T22:44:59.390857+0000","last_undegraded":"2024-04-25T22:44:59.390857+0000","last_fullsized":"2024-04-25T22:44:59.390857+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:46.695300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":22915,"num_write":352,"num_write_kb":47201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"72'411","reported_seq":1008,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108328+0000","last_change":"2024-04-25T22:44:32.090492+0000","last_active":"2024-04-25T22:44:59.108328+0000","last_peered":"2024-04-25T22:44:59.108328+0000","last_clean":"2024-04-25T22:44:59.108328+0000","last_became_active":"2024-04-25T22:44:32.087303+0000","last_became_peered":"2024-04-25T22:44:32.087303+0000","last_unstale":"2024-04-25T22:44:59.108328+0000","last_undegraded":"2024-04-25T22:44:59.108328+0000","last_fullsized":"2024-04-25T22:44:59.108328+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25412,"num_write":367,"num_write_kb":64656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'268","reported_seq":489,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108798+0000","last_change":"2024-04-25T22:44:29.399184+0000","last_active":"2024-04-25T22:44:59.108798+0000","last_peered":"2024-04-25T22:44:59.108798+0000","last_clean":"2024-04-25T22:44:59.108798+0000","last_became_active":"2024-04-25T22:44:29.398317+0000","last_became_peered":"2024-04-25T22:44:29.398317+0000","last_unstale":"2024-04-25T22:44:59.108798+0000","last_undegraded":"2024-04-25T22:44:59.108798+0000","last_fullsized":"2024-04-25T22:44:59.108798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:21.765162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382817,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"72'423","reported_seq":1047,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101400+0000","last_change":"2024-04-25T22:44:42.092243+0000","last_active":"2024-04-25T22:44:59.101400+0000","last_peered":"2024-04-25T22:44:59.101400+0000","last_clean":"2024-04-25T22:44:59.101400+0000","last_became_active":"2024-04-25T22:44:42.088432+0000","last_became_peered":"2024-04-25T22:44:42.088432+0000","last_unstale":"2024-04-25T22:44:59.101400+0000","last_undegraded":"2024-04-25T22:44:59.101400+0000","last_fullsized":"2024-04-25T22:44:59.101400+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:54.239406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24794,"num_write":386,"num_write_kb":63756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'102","reported_seq":96,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392357+0000","last_change":"2024-04-25T22:44:41.423993+0000","last_active":"2024-04-25T22:44:59.392357+0000","last_peered":"2024-04-25T22:44:59.392357+0000","last_clean":"2024-04-25T22:44:59.392357+0000","last_became_active":"2024-04-25T22:44:41.422237+0000","last_became_peered":"2024-04-25T22:44:41.422237+0000","last_unstale":"2024-04-25T22:44:59.392357+0000","last_undegraded":"2024-04-25T22:44:59.392357+0000","last_fullsized":"2024-04-25T22:44:59.392357+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:02.880774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"71'213","reported_seq":415,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108237+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:44:59.108237+0000","last_peered":"2024-04-25T22:44:59.108237+0000","last_clean":"2024-04-25T22:44:59.108237+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:44:59.108237+0000","last_undegraded":"2024-04-25T22:44:59.108237+0000","last_fullsized":"2024-04-25T22:44:59.108237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"72'504","reported_seq":769,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101135+0000","last_change":"2024-04-25T22:44:39.142694+0000","last_active":"2024-04-25T22:44:59.101135+0000","last_peered":"2024-04-25T22:44:59.101135+0000","last_clean":"2024-04-25T22:44:59.101135+0000","last_became_active":"2024-04-25T22:44:39.132582+0000","last_became_peered":"2024-04-25T22:44:39.132582+0000","last_unstale":"2024-04-25T22:44:59.101135+0000","last_undegraded":"2024-04-25T22:44:59.101135+0000","last_fullsized":"2024-04-25T22:44:59.101135+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:14.401644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":46975,"num_write":471,"num_write_kb":146290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'64","reported_seq":219,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103398+0000","last_change":"2024-04-25T22:44:39.136961+0000","last_active":"2024-04-25T22:44:59.103398+0000","last_peered":"2024-04-25T22:44:59.103398+0000","last_clean":"2024-04-25T22:44:59.103398+0000","last_became_active":"2024-04-25T22:44:39.136090+0000","last_became_peered":"2024-04-25T22:44:39.136090+0000","last_unstale":"2024-04-25T22:44:59.103398+0000","last_undegraded":"2024-04-25T22:44:59.103398+0000","last_fullsized":"2024-04-25T22:44:59.103398+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:35.220314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"72'475","reported_seq":1154,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101544+0000","last_change":"2024-04-25T22:44:44.106484+0000","last_active":"2024-04-25T22:44:59.101544+0000","last_peered":"2024-04-25T22:44:59.101544+0000","last_clean":"2024-04-25T22:44:59.101544+0000","last_became_active":"2024-04-25T22:44:44.102061+0000","last_became_peered":"2024-04-25T22:44:44.102061+0000","last_unstale":"2024-04-25T22:44:59.101544+0000","last_undegraded":"2024-04-25T22:44:59.101544+0000","last_fullsized":"2024-04-25T22:44:59.101544+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:05.455255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":23011,"num_write":448,"num_write_kb":76439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"72'370","reported_seq":567,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392775+0000","last_change":"2024-04-25T22:44:56.420080+0000","last_active":"2024-04-25T22:44:59.392775+0000","last_peered":"2024-04-25T22:44:59.392775+0000","last_clean":"2024-04-25T22:44:59.392775+0000","last_became_active":"2024-04-25T22:44:56.414231+0000","last_became_peered":"2024-04-25T22:44:56.414231+0000","last_unstale":"2024-04-25T22:44:59.392775+0000","last_undegraded":"2024-04-25T22:44:59.392775+0000","last_fullsized":"2024-04-25T22:44:59.392775+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:22.002829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33211,"num_write":340,"num_write_kb":63312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"71'647","reported_seq":865,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102434+0000","last_change":"2024-04-25T22:44:30.396965+0000","last_active":"2024-04-25T22:44:59.102434+0000","last_peered":"2024-04-25T22:44:59.102434+0000","last_clean":"2024-04-25T22:44:59.102434+0000","last_became_active":"2024-04-25T22:44:30.396073+0000","last_became_peered":"2024-04-25T22:44:30.396073+0000","last_unstale":"2024-04-25T22:44:59.102434+0000","last_undegraded":"2024-04-25T22:44:59.102434+0000","last_fullsized":"2024-04-25T22:44:59.102434+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"72'415","reported_seq":636,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102938+0000","last_change":"2024-04-25T22:44:39.150290+0000","last_active":"2024-04-25T22:44:59.102938+0000","last_peered":"2024-04-25T22:44:59.102938+0000","last_clean":"2024-04-25T22:44:59.102938+0000","last_became_active":"2024-04-25T22:44:39.146949+0000","last_became_peered":"2024-04-25T22:44:39.146949+0000","last_unstale":"2024-04-25T22:44:59.102938+0000","last_undegraded":"2024-04-25T22:44:59.102938+0000","last_fullsized":"2024-04-25T22:44:59.102938+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:11.804350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19493,"num_write":386,"num_write_kb":64692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'207","reported_seq":362,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101542+0000","last_change":"2024-04-25T22:44:39.141125+0000","last_active":"2024-04-25T22:44:59.101542+0000","last_peered":"2024-04-25T22:44:59.101542+0000","last_clean":"2024-04-25T22:44:59.101542+0000","last_became_active":"2024-04-25T22:44:39.138371+0000","last_became_peered":"2024-04-25T22:44:39.138371+0000","last_unstale":"2024-04-25T22:44:59.101542+0000","last_undegraded":"2024-04-25T22:44:59.101542+0000","last_fullsized":"2024-04-25T22:44:59.101542+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:14.147026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"72'395","reported_seq":562,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392340+0000","last_change":"2024-04-25T22:44:55.406524+0000","last_active":"2024-04-25T22:44:59.392340+0000","last_peered":"2024-04-25T22:44:59.392340+0000","last_clean":"2024-04-25T22:44:59.392340+0000","last_became_active":"2024-04-25T22:44:55.396613+0000","last_became_peered":"2024-04-25T22:44:55.396613+0000","last_unstale":"2024-04-25T22:44:59.392340+0000","last_undegraded":"2024-04-25T22:44:59.392340+0000","last_fullsized":"2024-04-25T22:44:59.392340+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:41.515369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9576,"num_write":348,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'194","reported_seq":363,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391176+0000","last_change":"2024-04-25T22:44:41.422369+0000","last_active":"2024-04-25T22:44:59.391176+0000","last_peered":"2024-04-25T22:44:59.391176+0000","last_clean":"2024-04-25T22:44:59.391176+0000","last_became_active":"2024-04-25T22:44:41.420491+0000","last_became_peered":"2024-04-25T22:44:41.420491+0000","last_unstale":"2024-04-25T22:44:59.391176+0000","last_undegraded":"2024-04-25T22:44:59.391176+0000","last_fullsized":"2024-04-25T22:44:59.391176+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:35.081225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360511,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":12143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12360511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"72'398","reported_seq":593,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391353+0000","last_change":"2024-04-25T22:44:52.381363+0000","last_active":"2024-04-25T22:44:59.391353+0000","last_peered":"2024-04-25T22:44:59.391353+0000","last_clean":"2024-04-25T22:44:59.391353+0000","last_became_active":"2024-04-25T22:44:52.375632+0000","last_became_peered":"2024-04-25T22:44:52.375632+0000","last_unstale":"2024-04-25T22:44:59.391353+0000","last_undegraded":"2024-04-25T22:44:59.391353+0000","last_fullsized":"2024-04-25T22:44:59.391353+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:38:28.441621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31284,"num_write":371,"num_write_kb":80144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"71'51","reported_seq":94,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390518+0000","last_change":"2024-04-25T22:44:41.415722+0000","last_active":"2024-04-25T22:44:59.390518+0000","last_peered":"2024-04-25T22:44:59.390518+0000","last_clean":"2024-04-25T22:44:59.390518+0000","last_became_active":"2024-04-25T22:44:41.414774+0000","last_became_peered":"2024-04-25T22:44:41.414774+0000","last_unstale":"2024-04-25T22:44:59.390518+0000","last_undegraded":"2024-04-25T22:44:59.390518+0000","last_fullsized":"2024-04-25T22:44:59.390518+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:20.553373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"72'383","reported_seq":635,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107059+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:44:59.107059+0000","last_peered":"2024-04-25T22:44:59.107059+0000","last_clean":"2024-04-25T22:44:59.107059+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:44:59.107059+0000","last_undegraded":"2024-04-25T22:44:59.107059+0000","last_fullsized":"2024-04-25T22:44:59.107059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29308,"num_write":358,"num_write_kb":66975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"71'177","reported_seq":379,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108565+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:44:59.108565+0000","last_peered":"2024-04-25T22:44:59.108565+0000","last_clean":"2024-04-25T22:44:59.108565+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:44:59.108565+0000","last_undegraded":"2024-04-25T22:44:59.108565+0000","last_fullsized":"2024-04-25T22:44:59.108565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"72'387","reported_seq":600,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107381+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:44:59.107381+0000","last_peered":"2024-04-25T22:44:59.107381+0000","last_clean":"2024-04-25T22:44:59.107381+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:44:59.107381+0000","last_undegraded":"2024-04-25T22:44:59.107381+0000","last_fullsized":"2024-04-25T22:44:59.107381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3883,"num_write":348,"num_write_kb":34122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'209","reported_seq":413,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391358+0000","last_change":"2024-04-25T22:44:41.419972+0000","last_active":"2024-04-25T22:44:59.391358+0000","last_peered":"2024-04-25T22:44:59.391358+0000","last_clean":"2024-04-25T22:44:59.391358+0000","last_became_active":"2024-04-25T22:44:41.418106+0000","last_became_peered":"2024-04-25T22:44:41.418106+0000","last_unstale":"2024-04-25T22:44:59.391358+0000","last_undegraded":"2024-04-25T22:44:59.391358+0000","last_fullsized":"2024-04-25T22:44:59.391358+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:07.628155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":12363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"72'419","reported_seq":607,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390493+0000","last_change":"2024-04-25T22:44:41.434376+0000","last_active":"2024-04-25T22:44:59.390493+0000","last_peered":"2024-04-25T22:44:59.390493+0000","last_clean":"2024-04-25T22:44:59.390493+0000","last_became_active":"2024-04-25T22:44:41.420505+0000","last_became_peered":"2024-04-25T22:44:41.420505+0000","last_unstale":"2024-04-25T22:44:59.390493+0000","last_undegraded":"2024-04-25T22:44:59.390493+0000","last_fullsized":"2024-04-25T22:44:59.390493+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:04.414563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":13327,"num_write":388,"num_write_kb":55674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"71'131","reported_seq":349,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103634+0000","last_change":"2024-04-25T22:44:29.398880+0000","last_active":"2024-04-25T22:44:59.103634+0000","last_peered":"2024-04-25T22:44:59.103634+0000","last_clean":"2024-04-25T22:44:59.103634+0000","last_became_active":"2024-04-25T22:44:29.397905+0000","last_became_peered":"2024-04-25T22:44:29.397905+0000","last_unstale":"2024-04-25T22:44:59.103634+0000","last_undegraded":"2024-04-25T22:44:59.103634+0000","last_fullsized":"2024-04-25T22:44:59.103634+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:44.236330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"72'449","reported_seq":683,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107034+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:44:59.107034+0000","last_peered":"2024-04-25T22:44:59.107034+0000","last_clean":"2024-04-25T22:44:59.107034+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:44:59.107034+0000","last_undegraded":"2024-04-25T22:44:59.107034+0000","last_fullsized":"2024-04-25T22:44:59.107034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14222,"num_write":424,"num_write_kb":79796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"71'57","reported_seq":213,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103091+0000","last_change":"2024-04-25T22:44:39.137232+0000","last_active":"2024-04-25T22:44:59.103091+0000","last_peered":"2024-04-25T22:44:59.103091+0000","last_clean":"2024-04-25T22:44:59.103091+0000","last_became_active":"2024-04-25T22:44:39.136283+0000","last_became_peered":"2024-04-25T22:44:39.136283+0000","last_unstale":"2024-04-25T22:44:59.103091+0000","last_undegraded":"2024-04-25T22:44:59.103091+0000","last_fullsized":"2024-04-25T22:44:59.103091+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:32.428982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2461,"num_read_kb":1248646,"num_write":24434,"num_write_kb":4137258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7447,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26539,"ondisk_log_size":26539,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127071275,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":4473,"num_write_kb":127409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254210048,"data_stored":254142550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},"log_size":6216,"ondisk_log_size":6216,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738434,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165344,"kb_used_data":80080,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94206496,"statfs":{"total":96636764160,"available":96467451904,"internally_reserved":0,"allocated":82001920,"data_stored":81417710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":79,"seq":339302416393,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141396,"kb_used_data":83332,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94230444,"statfs":{"total":96636764160,"available":96491974656,"internally_reserved":0,"allocated":85331968,"data_stored":84735273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6003,"internal_metadata":59435149},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738434,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174352,"kb_used_data":89088,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94197488,"statfs":{"total":96636764160,"available":96458227712,"internally_reserved":0,"allocated":91226112,"data_stored":90619941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89575424,"data_stored":89544940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83689472,"data_stored":83664533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80945152,"data_stored":80933077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:45:03.800 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T22:45:03.801 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-25T22:45:04.188 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T22:45:04.200 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T22:45:04.201 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:45:04.504 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:45:04.508 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:45:04.525 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-04-25T22:45:03.243659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127661643,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2659,"num_read_kb":1250233,"num_write":29110,"num_write_kb":4268127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7469,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32912,"ondisk_log_size":32912,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":481092,"kb_used_data":252500,"kb_used_omap":8,"kb_used_meta":228535,"kb_avail":282634428,"statfs":{"total":289910292480,"available":289417654272,"internally_reserved":0,"allocated":258560000,"data_stored":256772924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9193,"internal_metadata":234019863},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1061,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1061,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.152689"},"pg_stats":[{"pgid":"4.3f","version":"72'404","reported_seq":559,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.393147+0000","last_change":"2024-04-25T22:44:57.382564+0000","last_active":"2024-04-25T22:44:59.393147+0000","last_peered":"2024-04-25T22:44:59.393147+0000","last_clean":"2024-04-25T22:44:59.393147+0000","last_became_active":"2024-04-25T22:44:57.376098+0000","last_became_peered":"2024-04-25T22:44:57.376098+0000","last_unstale":"2024-04-25T22:44:59.393147+0000","last_undegraded":"2024-04-25T22:44:59.393147+0000","last_fullsized":"2024-04-25T22:44:59.393147+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:31:49.789706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19772,"num_write":366,"num_write_kb":46873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"72'420","reported_seq":622,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392815+0000","last_change":"2024-04-25T22:44:41.434387+0000","last_active":"2024-04-25T22:44:59.392815+0000","last_peered":"2024-04-25T22:44:59.392815+0000","last_clean":"2024-04-25T22:44:59.392815+0000","last_became_active":"2024-04-25T22:44:41.418792+0000","last_became_peered":"2024-04-25T22:44:41.418792+0000","last_unstale":"2024-04-25T22:44:59.392815+0000","last_undegraded":"2024-04-25T22:44:59.392815+0000","last_fullsized":"2024-04-25T22:44:59.392815+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:43.196115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24515,"num_write":386,"num_write_kb":55688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"72'377","reported_seq":952,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107392+0000","last_change":"2024-04-25T22:44:42.096911+0000","last_active":"2024-04-25T22:44:59.107392+0000","last_peered":"2024-04-25T22:44:59.107392+0000","last_clean":"2024-04-25T22:44:59.107392+0000","last_became_active":"2024-04-25T22:44:42.093941+0000","last_became_peered":"2024-04-25T22:44:42.093941+0000","last_unstale":"2024-04-25T22:44:59.107392+0000","last_undegraded":"2024-04-25T22:44:59.107392+0000","last_fullsized":"2024-04-25T22:44:59.107392+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11135,"num_write":346,"num_write_kb":38950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"72'366","reported_seq":573,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107137+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:44:59.107137+0000","last_peered":"2024-04-25T22:44:59.107137+0000","last_clean":"2024-04-25T22:44:59.107137+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:44:59.107137+0000","last_undegraded":"2024-04-25T22:44:59.107137+0000","last_fullsized":"2024-04-25T22:44:59.107137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":326,"num_write_kb":34079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"72'455","reported_seq":635,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390846+0000","last_change":"2024-04-25T22:44:50.391674+0000","last_active":"2024-04-25T22:44:59.390846+0000","last_peered":"2024-04-25T22:44:59.390846+0000","last_clean":"2024-04-25T22:44:59.390846+0000","last_became_active":"2024-04-25T22:44:50.384804+0000","last_became_peered":"2024-04-25T22:44:50.384804+0000","last_unstale":"2024-04-25T22:44:59.390846+0000","last_undegraded":"2024-04-25T22:44:59.390846+0000","last_fullsized":"2024-04-25T22:44:59.390846+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:22:54.239989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33897,"num_write":426,"num_write_kb":100721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"72'401","reported_seq":635,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106493+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:44:59.106493+0000","last_peered":"2024-04-25T22:44:59.106493+0000","last_clean":"2024-04-25T22:44:59.106493+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:44:59.106493+0000","last_undegraded":"2024-04-25T22:44:59.106493+0000","last_fullsized":"2024-04-25T22:44:59.106493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15258,"num_write":369,"num_write_kb":53298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"72'452","reported_seq":718,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106260+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:44:59.106260+0000","last_peered":"2024-04-25T22:44:59.106260+0000","last_clean":"2024-04-25T22:44:59.106260+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:44:59.106260+0000","last_undegraded":"2024-04-25T22:44:59.106260+0000","last_fullsized":"2024-04-25T22:44:59.106260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34010,"num_write":428,"num_write_kb":157752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"72'401","reported_seq":640,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.105970+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:44:59.105970+0000","last_peered":"2024-04-25T22:44:59.105970+0000","last_clean":"2024-04-25T22:44:59.105970+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:44:59.105970+0000","last_undegraded":"2024-04-25T22:44:59.105970+0000","last_fullsized":"2024-04-25T22:44:59.105970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19917,"num_write":359,"num_write_kb":109382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"72'394","reported_seq":980,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101912+0000","last_change":"2024-04-25T22:44:48.092689+0000","last_active":"2024-04-25T22:44:59.101912+0000","last_peered":"2024-04-25T22:44:59.101912+0000","last_clean":"2024-04-25T22:44:59.101912+0000","last_became_active":"2024-04-25T22:44:48.089795+0000","last_became_peered":"2024-04-25T22:44:48.089795+0000","last_unstale":"2024-04-25T22:44:59.101912+0000","last_undegraded":"2024-04-25T22:44:59.101912+0000","last_fullsized":"2024-04-25T22:44:59.101912+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:32:33.072950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9569,"num_write":360,"num_write_kb":25560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"72'382","reported_seq":566,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392804+0000","last_change":"2024-04-25T22:44:41.433644+0000","last_active":"2024-04-25T22:44:59.392804+0000","last_peered":"2024-04-25T22:44:59.392804+0000","last_clean":"2024-04-25T22:44:59.392804+0000","last_became_active":"2024-04-25T22:44:41.421234+0000","last_became_peered":"2024-04-25T22:44:41.421234+0000","last_unstale":"2024-04-25T22:44:59.392804+0000","last_undegraded":"2024-04-25T22:44:59.392804+0000","last_fullsized":"2024-04-25T22:44:59.392804+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:24.217391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17192,"num_write":338,"num_write_kb":38688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"72'369","reported_seq":592,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107541+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:44:59.107541+0000","last_peered":"2024-04-25T22:44:59.107541+0000","last_clean":"2024-04-25T22:44:59.107541+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:44:59.107541+0000","last_undegraded":"2024-04-25T22:44:59.107541+0000","last_fullsized":"2024-04-25T22:44:59.107541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7385,"num_write":349,"num_write_kb":58842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"72'338","reported_seq":522,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391810+0000","last_change":"2024-04-25T22:44:49.384005+0000","last_active":"2024-04-25T22:44:59.391810+0000","last_peered":"2024-04-25T22:44:59.391810+0000","last_clean":"2024-04-25T22:44:59.391810+0000","last_became_active":"2024-04-25T22:44:49.378325+0000","last_became_peered":"2024-04-25T22:44:49.378325+0000","last_unstale":"2024-04-25T22:44:59.391810+0000","last_undegraded":"2024-04-25T22:44:59.391810+0000","last_fullsized":"2024-04-25T22:44:59.391810+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:18.849786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13619,"num_write":312,"num_write_kb":21391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"72'411","reported_seq":605,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391345+0000","last_change":"2024-04-25T22:44:41.432463+0000","last_active":"2024-04-25T22:44:59.391345+0000","last_peered":"2024-04-25T22:44:59.391345+0000","last_clean":"2024-04-25T22:44:59.391345+0000","last_became_active":"2024-04-25T22:44:41.421096+0000","last_became_peered":"2024-04-25T22:44:41.421096+0000","last_unstale":"2024-04-25T22:44:59.391345+0000","last_undegraded":"2024-04-25T22:44:59.391345+0000","last_fullsized":"2024-04-25T22:44:59.391345+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:46.942677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12998,"num_write":375,"num_write_kb":79661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"72'452","reported_seq":1051,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107059+0000","last_change":"2024-04-25T22:44:40.130299+0000","last_active":"2024-04-25T22:44:59.107059+0000","last_peered":"2024-04-25T22:44:59.107059+0000","last_clean":"2024-04-25T22:44:59.107059+0000","last_became_active":"2024-04-25T22:44:40.127307+0000","last_became_peered":"2024-04-25T22:44:40.127307+0000","last_unstale":"2024-04-25T22:44:59.107059+0000","last_undegraded":"2024-04-25T22:44:59.107059+0000","last_fullsized":"2024-04-25T22:44:59.107059+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:16.746830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":854,"num_write":419,"num_write_kb":88217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"72'428","reported_seq":1031,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106380+0000","last_change":"2024-04-25T22:44:35.108361+0000","last_active":"2024-04-25T22:44:59.106380+0000","last_peered":"2024-04-25T22:44:59.106380+0000","last_clean":"2024-04-25T22:44:59.106380+0000","last_became_active":"2024-04-25T22:44:35.103208+0000","last_became_peered":"2024-04-25T22:44:35.103208+0000","last_unstale":"2024-04-25T22:44:59.106380+0000","last_undegraded":"2024-04-25T22:44:59.106380+0000","last_fullsized":"2024-04-25T22:44:59.106380+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:22.046332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21291,"num_write":389,"num_write_kb":68562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"72'401","reported_seq":615,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.105974+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:44:59.105974+0000","last_peered":"2024-04-25T22:44:59.105974+0000","last_clean":"2024-04-25T22:44:59.105974+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:44:59.105974+0000","last_undegraded":"2024-04-25T22:44:59.105974+0000","last_fullsized":"2024-04-25T22:44:59.105974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8276,"num_write":369,"num_write_kb":17867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"72'398","reported_seq":971,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103506+0000","last_change":"2024-04-25T22:44:49.097340+0000","last_active":"2024-04-25T22:44:59.103506+0000","last_peered":"2024-04-25T22:44:59.103506+0000","last_clean":"2024-04-25T22:44:59.103506+0000","last_became_active":"2024-04-25T22:44:49.094478+0000","last_became_peered":"2024-04-25T22:44:49.094478+0000","last_unstale":"2024-04-25T22:44:59.103506+0000","last_undegraded":"2024-04-25T22:44:59.103506+0000","last_fullsized":"2024-04-25T22:44:59.103506+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:33.421713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5883,"num_write":362,"num_write_kb":38188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"72'407","reported_seq":543,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.401367+0000","last_change":"2024-04-25T22:44:59.401367+0000","last_active":"2024-04-25T22:44:59.401367+0000","last_peered":"2024-04-25T22:44:59.401367+0000","last_clean":"2024-04-25T22:44:59.401367+0000","last_became_active":"2024-04-25T22:44:59.396404+0000","last_became_peered":"2024-04-25T22:44:59.396404+0000","last_unstale":"2024-04-25T22:44:59.401367+0000","last_undegraded":"2024-04-25T22:44:59.401367+0000","last_fullsized":"2024-04-25T22:44:59.401367+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:15:41.602118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13073,"num_write":372,"num_write_kb":59323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"72'441","reported_seq":1059,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102684+0000","last_change":"2024-04-25T22:44:41.148409+0000","last_active":"2024-04-25T22:44:59.102684+0000","last_peered":"2024-04-25T22:44:59.102684+0000","last_clean":"2024-04-25T22:44:59.102684+0000","last_became_active":"2024-04-25T22:44:41.143302+0000","last_became_peered":"2024-04-25T22:44:41.143302+0000","last_unstale":"2024-04-25T22:44:59.102684+0000","last_undegraded":"2024-04-25T22:44:59.102684+0000","last_fullsized":"2024-04-25T22:44:59.102684+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:46.289713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37611,"num_write":403,"num_write_kb":116618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"72'438","reported_seq":664,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107576+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:44:59.107576+0000","last_peered":"2024-04-25T22:44:59.107576+0000","last_clean":"2024-04-25T22:44:59.107576+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:44:59.107576+0000","last_undegraded":"2024-04-25T22:44:59.107576+0000","last_fullsized":"2024-04-25T22:44:59.107576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12393,"num_write":408,"num_write_kb":99933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"72'407","reported_seq":622,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108619+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:44:59.108619+0000","last_peered":"2024-04-25T22:44:59.108619+0000","last_clean":"2024-04-25T22:44:59.108619+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:44:59.108619+0000","last_undegraded":"2024-04-25T22:44:59.108619+0000","last_fullsized":"2024-04-25T22:44:59.108619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8932,"num_write":382,"num_write_kb":59684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"72'463","reported_seq":692,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391725+0000","last_change":"2024-04-25T22:44:47.376009+0000","last_active":"2024-04-25T22:44:59.391725+0000","last_peered":"2024-04-25T22:44:59.391725+0000","last_clean":"2024-04-25T22:44:59.391725+0000","last_became_active":"2024-04-25T22:44:47.369995+0000","last_became_peered":"2024-04-25T22:44:47.369995+0000","last_unstale":"2024-04-25T22:44:59.391725+0000","last_undegraded":"2024-04-25T22:44:59.391725+0000","last_fullsized":"2024-04-25T22:44:59.391725+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:04.129559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27589,"num_write":428,"num_write_kb":76861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"72'425","reported_seq":694,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.100741+0000","last_change":"2024-04-25T22:44:39.132230+0000","last_active":"2024-04-25T22:44:59.100741+0000","last_peered":"2024-04-25T22:44:59.100741+0000","last_clean":"2024-04-25T22:44:59.100741+0000","last_became_active":"2024-04-25T22:44:39.118635+0000","last_became_peered":"2024-04-25T22:44:39.118635+0000","last_unstale":"2024-04-25T22:44:59.100741+0000","last_undegraded":"2024-04-25T22:44:59.100741+0000","last_fullsized":"2024-04-25T22:44:59.100741+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:15.096836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":46424,"num_write":390,"num_write_kb":96359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"72'445","reported_seq":619,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390506+0000","last_change":"2024-04-25T22:44:54.388681+0000","last_active":"2024-04-25T22:44:59.390506+0000","last_peered":"2024-04-25T22:44:59.390506+0000","last_clean":"2024-04-25T22:44:59.390506+0000","last_became_active":"2024-04-25T22:44:54.382124+0000","last_became_peered":"2024-04-25T22:44:54.382124+0000","last_unstale":"2024-04-25T22:44:59.390506+0000","last_undegraded":"2024-04-25T22:44:59.390506+0000","last_fullsized":"2024-04-25T22:44:59.390506+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:49.633770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32317,"num_write":419,"num_write_kb":76071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"72'424","reported_seq":590,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392521+0000","last_change":"2024-04-25T22:44:51.391125+0000","last_active":"2024-04-25T22:44:59.392521+0000","last_peered":"2024-04-25T22:44:59.392521+0000","last_clean":"2024-04-25T22:44:59.392521+0000","last_became_active":"2024-04-25T22:44:51.383461+0000","last_became_peered":"2024-04-25T22:44:51.383461+0000","last_unstale":"2024-04-25T22:44:59.392521+0000","last_undegraded":"2024-04-25T22:44:59.392521+0000","last_fullsized":"2024-04-25T22:44:59.392521+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:33.717342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8396,"num_write":399,"num_write_kb":50416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"72'499","reported_seq":710,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102656+0000","last_change":"2024-04-25T22:44:39.149280+0000","last_active":"2024-04-25T22:44:59.102656+0000","last_peered":"2024-04-25T22:44:59.102656+0000","last_clean":"2024-04-25T22:44:59.102656+0000","last_became_active":"2024-04-25T22:44:39.143391+0000","last_became_peered":"2024-04-25T22:44:39.143391+0000","last_unstale":"2024-04-25T22:44:59.102656+0000","last_undegraded":"2024-04-25T22:44:59.102656+0000","last_fullsized":"2024-04-25T22:44:59.102656+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:54:10.301144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10227,"num_write":453,"num_write_kb":96585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'430","reported_seq":1082,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107732+0000","last_change":"2024-04-25T22:44:39.113437+0000","last_active":"2024-04-25T22:44:59.107732+0000","last_peered":"2024-04-25T22:44:59.107732+0000","last_clean":"2024-04-25T22:44:59.107732+0000","last_became_active":"2024-04-25T22:44:39.109771+0000","last_became_peered":"2024-04-25T22:44:39.109771+0000","last_unstale":"2024-04-25T22:44:59.107732+0000","last_undegraded":"2024-04-25T22:44:59.107732+0000","last_fullsized":"2024-04-25T22:44:59.107732+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:40:46.739897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":32116,"num_write":409,"num_write_kb":89217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"72'393","reported_seq":656,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391736+0000","last_change":"2024-04-25T22:44:41.425947+0000","last_active":"2024-04-25T22:44:59.391736+0000","last_peered":"2024-04-25T22:44:59.391736+0000","last_clean":"2024-04-25T22:44:59.391736+0000","last_became_active":"2024-04-25T22:44:41.413570+0000","last_became_peered":"2024-04-25T22:44:41.413570+0000","last_unstale":"2024-04-25T22:44:59.391736+0000","last_undegraded":"2024-04-25T22:44:59.391736+0000","last_fullsized":"2024-04-25T22:44:59.391736+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:39:00.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":28076,"num_write":364,"num_write_kb":47473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"72'399","reported_seq":993,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103262+0000","last_change":"2024-04-25T22:44:40.124745+0000","last_active":"2024-04-25T22:44:59.103262+0000","last_peered":"2024-04-25T22:44:59.103262+0000","last_clean":"2024-04-25T22:44:59.103262+0000","last_became_active":"2024-04-25T22:44:40.121838+0000","last_became_peered":"2024-04-25T22:44:40.121838+0000","last_unstale":"2024-04-25T22:44:59.103262+0000","last_undegraded":"2024-04-25T22:44:59.103262+0000","last_fullsized":"2024-04-25T22:44:59.103262+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:28.299317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14005,"num_write":367,"num_write_kb":58883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"72'484","reported_seq":683,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391410+0000","last_change":"2024-04-25T22:44:54.392451+0000","last_active":"2024-04-25T22:44:59.391410+0000","last_peered":"2024-04-25T22:44:59.391410+0000","last_clean":"2024-04-25T22:44:59.391410+0000","last_became_active":"2024-04-25T22:44:54.383808+0000","last_became_peered":"2024-04-25T22:44:54.383808+0000","last_unstale":"2024-04-25T22:44:59.391410+0000","last_undegraded":"2024-04-25T22:44:59.391410+0000","last_fullsized":"2024-04-25T22:44:59.391410+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:06.630318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23352,"num_write":446,"num_write_kb":100094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'455","reported_seq":1136,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101023+0000","last_change":"2024-04-25T22:44:33.087211+0000","last_active":"2024-04-25T22:44:59.101023+0000","last_peered":"2024-04-25T22:44:59.101023+0000","last_clean":"2024-04-25T22:44:59.101023+0000","last_became_active":"2024-04-25T22:44:33.084127+0000","last_became_peered":"2024-04-25T22:44:33.084127+0000","last_unstale":"2024-04-25T22:44:59.101023+0000","last_undegraded":"2024-04-25T22:44:59.101023+0000","last_fullsized":"2024-04-25T22:44:59.101023+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38440,"num_write":423,"num_write_kb":71855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"72'434","reported_seq":668,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106552+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:44:59.106552+0000","last_peered":"2024-04-25T22:44:59.106552+0000","last_clean":"2024-04-25T22:44:59.106552+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:44:59.106552+0000","last_undegraded":"2024-04-25T22:44:59.106552+0000","last_fullsized":"2024-04-25T22:44:59.106552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18701,"num_write":402,"num_write_kb":27564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"72'379","reported_seq":526,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391067+0000","last_change":"2024-04-25T22:44:53.383623+0000","last_active":"2024-04-25T22:44:59.391067+0000","last_peered":"2024-04-25T22:44:59.391067+0000","last_clean":"2024-04-25T22:44:59.391067+0000","last_became_active":"2024-04-25T22:44:53.378402+0000","last_became_peered":"2024-04-25T22:44:53.378402+0000","last_unstale":"2024-04-25T22:44:59.391067+0000","last_undegraded":"2024-04-25T22:44:59.391067+0000","last_fullsized":"2024-04-25T22:44:59.391067+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:52:18.111269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18623,"num_write":344,"num_write_kb":50888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"71'528","reported_seq":731,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109262+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:44:59.109262+0000","last_peered":"2024-04-25T22:44:59.109262+0000","last_clean":"2024-04-25T22:44:59.109262+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:44:59.109262+0000","last_undegraded":"2024-04-25T22:44:59.109262+0000","last_fullsized":"2024-04-25T22:44:59.109262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"72'383","reported_seq":503,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392060+0000","last_change":"2024-04-25T22:44:58.385931+0000","last_active":"2024-04-25T22:44:59.392060+0000","last_peered":"2024-04-25T22:44:59.392060+0000","last_clean":"2024-04-25T22:44:59.392060+0000","last_became_active":"2024-04-25T22:44:58.380203+0000","last_became_peered":"2024-04-25T22:44:58.380203+0000","last_unstale":"2024-04-25T22:44:59.392060+0000","last_undegraded":"2024-04-25T22:44:59.392060+0000","last_fullsized":"2024-04-25T22:44:59.392060+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:12.874377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8364,"num_write":351,"num_write_kb":30625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"71'45","reported_seq":201,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102522+0000","last_change":"2024-04-25T22:44:39.117622+0000","last_active":"2024-04-25T22:44:59.102522+0000","last_peered":"2024-04-25T22:44:59.102522+0000","last_clean":"2024-04-25T22:44:59.102522+0000","last_became_active":"2024-04-25T22:44:39.115669+0000","last_became_peered":"2024-04-25T22:44:39.115669+0000","last_unstale":"2024-04-25T22:44:59.102522+0000","last_undegraded":"2024-04-25T22:44:59.102522+0000","last_fullsized":"2024-04-25T22:44:59.102522+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:21.793820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"72'429","reported_seq":571,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392387+0000","last_change":"2024-04-25T22:44:58.388677+0000","last_active":"2024-04-25T22:44:59.392387+0000","last_peered":"2024-04-25T22:44:59.392387+0000","last_clean":"2024-04-25T22:44:59.392387+0000","last_became_active":"2024-04-25T22:44:58.382521+0000","last_became_peered":"2024-04-25T22:44:58.382521+0000","last_unstale":"2024-04-25T22:44:59.392387+0000","last_undegraded":"2024-04-25T22:44:59.392387+0000","last_fullsized":"2024-04-25T22:44:59.392387+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:26.999533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16584,"num_write":393,"num_write_kb":63712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'61","reported_seq":89,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391526+0000","last_change":"2024-04-25T22:44:41.416554+0000","last_active":"2024-04-25T22:44:59.391526+0000","last_peered":"2024-04-25T22:44:59.391526+0000","last_clean":"2024-04-25T22:44:59.391526+0000","last_became_active":"2024-04-25T22:44:41.413853+0000","last_became_peered":"2024-04-25T22:44:41.413853+0000","last_unstale":"2024-04-25T22:44:59.391526+0000","last_undegraded":"2024-04-25T22:44:59.391526+0000","last_fullsized":"2024-04-25T22:44:59.391526+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:50.701110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"72'404","reported_seq":624,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102212+0000","last_change":"2024-04-25T22:44:39.128428+0000","last_active":"2024-04-25T22:44:59.102212+0000","last_peered":"2024-04-25T22:44:59.102212+0000","last_clean":"2024-04-25T22:44:59.102212+0000","last_became_active":"2024-04-25T22:44:39.116562+0000","last_became_peered":"2024-04-25T22:44:39.116562+0000","last_unstale":"2024-04-25T22:44:59.102212+0000","last_undegraded":"2024-04-25T22:44:59.102212+0000","last_fullsized":"2024-04-25T22:44:59.102212+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:09.750726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18745,"num_write":376,"num_write_kb":96145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'71","reported_seq":282,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106763+0000","last_change":"2024-04-25T22:44:26.363329+0000","last_active":"2024-04-25T22:44:59.106763+0000","last_peered":"2024-04-25T22:44:59.106763+0000","last_clean":"2024-04-25T22:44:59.106763+0000","last_became_active":"2024-04-25T22:44:26.362499+0000","last_became_peered":"2024-04-25T22:44:26.362499+0000","last_unstale":"2024-04-25T22:44:59.106763+0000","last_undegraded":"2024-04-25T22:44:59.106763+0000","last_fullsized":"2024-04-25T22:44:59.106763+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'145","reported_seq":362,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109263+0000","last_change":"2024-04-25T22:44:29.400540+0000","last_active":"2024-04-25T22:44:59.109263+0000","last_peered":"2024-04-25T22:44:59.109263+0000","last_clean":"2024-04-25T22:44:59.109263+0000","last_became_active":"2024-04-25T22:44:29.399853+0000","last_became_peered":"2024-04-25T22:44:29.399853+0000","last_unstale":"2024-04-25T22:44:59.109263+0000","last_undegraded":"2024-04-25T22:44:59.109263+0000","last_fullsized":"2024-04-25T22:44:59.109263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"72'399","reported_seq":605,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390842+0000","last_change":"2024-04-25T22:44:46.398600+0000","last_active":"2024-04-25T22:44:59.390842+0000","last_peered":"2024-04-25T22:44:59.390842+0000","last_clean":"2024-04-25T22:44:59.390842+0000","last_became_active":"2024-04-25T22:44:46.392604+0000","last_became_peered":"2024-04-25T22:44:46.392604+0000","last_unstale":"2024-04-25T22:44:59.390842+0000","last_undegraded":"2024-04-25T22:44:59.390842+0000","last_fullsized":"2024-04-25T22:44:59.390842+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:15.771324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25159,"num_write":363,"num_write_kb":34063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"71'226","reported_seq":432,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392417+0000","last_change":"2024-04-25T22:44:41.417859+0000","last_active":"2024-04-25T22:44:59.392417+0000","last_peered":"2024-04-25T22:44:59.392417+0000","last_clean":"2024-04-25T22:44:59.392417+0000","last_became_active":"2024-04-25T22:44:41.416542+0000","last_became_peered":"2024-04-25T22:44:41.416542+0000","last_unstale":"2024-04-25T22:44:59.392417+0000","last_undegraded":"2024-04-25T22:44:59.392417+0000","last_fullsized":"2024-04-25T22:44:59.392417+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:27.884903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"72'431","reported_seq":578,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390134+0000","last_change":"2024-04-25T22:44:56.419453+0000","last_active":"2024-04-25T22:44:59.390134+0000","last_peered":"2024-04-25T22:44:59.390134+0000","last_clean":"2024-04-25T22:44:59.390134+0000","last_became_active":"2024-04-25T22:44:56.412151+0000","last_became_peered":"2024-04-25T22:44:56.412151+0000","last_unstale":"2024-04-25T22:44:59.390134+0000","last_undegraded":"2024-04-25T22:44:59.390134+0000","last_fullsized":"2024-04-25T22:44:59.390134+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:07:27.220853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14688,"num_write":405,"num_write_kb":38957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"71'382","reported_seq":599,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108993+0000","last_change":"2024-04-25T22:44:30.401893+0000","last_active":"2024-04-25T22:44:59.108993+0000","last_peered":"2024-04-25T22:44:59.108993+0000","last_clean":"2024-04-25T22:44:59.108993+0000","last_became_active":"2024-04-25T22:44:30.401021+0000","last_became_peered":"2024-04-25T22:44:30.401021+0000","last_unstale":"2024-04-25T22:44:59.108993+0000","last_undegraded":"2024-04-25T22:44:59.108993+0000","last_fullsized":"2024-04-25T22:44:59.108993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:38.452482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'453","reported_seq":685,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107186+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:44:59.107186+0000","last_peered":"2024-04-25T22:44:59.107186+0000","last_clean":"2024-04-25T22:44:59.107186+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:44:59.107186+0000","last_undegraded":"2024-04-25T22:44:59.107186+0000","last_fullsized":"2024-04-25T22:44:59.107186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18900,"num_write":418,"num_write_kb":117500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"71'64","reported_seq":267,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108997+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:44:59.108997+0000","last_peered":"2024-04-25T22:44:59.108997+0000","last_clean":"2024-04-25T22:44:59.108997+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:44:59.108997+0000","last_undegraded":"2024-04-25T22:44:59.108997+0000","last_fullsized":"2024-04-25T22:44:59.108997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'428","reported_seq":631,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103565+0000","last_change":"2024-04-25T22:44:39.129871+0000","last_active":"2024-04-25T22:44:59.103565+0000","last_peered":"2024-04-25T22:44:59.103565+0000","last_clean":"2024-04-25T22:44:59.103565+0000","last_became_active":"2024-04-25T22:44:39.121205+0000","last_became_peered":"2024-04-25T22:44:39.121205+0000","last_unstale":"2024-04-25T22:44:59.103565+0000","last_undegraded":"2024-04-25T22:44:59.103565+0000","last_fullsized":"2024-04-25T22:44:59.103565+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:48.521828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7477,"num_write":383,"num_write_kb":9617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'166","reported_seq":322,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103845+0000","last_change":"2024-04-25T22:44:39.133550+0000","last_active":"2024-04-25T22:44:59.103845+0000","last_peered":"2024-04-25T22:44:59.103845+0000","last_clean":"2024-04-25T22:44:59.103845+0000","last_became_active":"2024-04-25T22:44:39.131489+0000","last_became_peered":"2024-04-25T22:44:39.131489+0000","last_unstale":"2024-04-25T22:44:59.103845+0000","last_undegraded":"2024-04-25T22:44:59.103845+0000","last_fullsized":"2024-04-25T22:44:59.103845+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:32.980801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"72'446","reported_seq":696,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108117+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:44:59.108117+0000","last_peered":"2024-04-25T22:44:59.108117+0000","last_clean":"2024-04-25T22:44:59.108117+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:44:59.108117+0000","last_undegraded":"2024-04-25T22:44:59.108117+0000","last_fullsized":"2024-04-25T22:44:59.108117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27788,"num_write":414,"num_write_kb":47058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"71'113","reported_seq":316,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108347+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:44:59.108347+0000","last_peered":"2024-04-25T22:44:59.108347+0000","last_clean":"2024-04-25T22:44:59.108347+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:44:59.108347+0000","last_undegraded":"2024-04-25T22:44:59.108347+0000","last_fullsized":"2024-04-25T22:44:59.108347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"72'417","reported_seq":1019,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108706+0000","last_change":"2024-04-25T22:44:44.113498+0000","last_active":"2024-04-25T22:44:59.108706+0000","last_peered":"2024-04-25T22:44:59.108706+0000","last_clean":"2024-04-25T22:44:59.108706+0000","last_became_active":"2024-04-25T22:44:44.108084+0000","last_became_peered":"2024-04-25T22:44:44.108084+0000","last_unstale":"2024-04-25T22:44:59.108706+0000","last_undegraded":"2024-04-25T22:44:59.108706+0000","last_fullsized":"2024-04-25T22:44:59.108706+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16487,"num_write":388,"num_write_kb":75452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'59","reported_seq":89,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390108+0000","last_change":"2024-04-25T22:44:41.417821+0000","last_active":"2024-04-25T22:44:59.390108+0000","last_peered":"2024-04-25T22:44:59.390108+0000","last_clean":"2024-04-25T22:44:59.390108+0000","last_became_active":"2024-04-25T22:44:41.415769+0000","last_became_peered":"2024-04-25T22:44:41.415769+0000","last_unstale":"2024-04-25T22:44:59.390108+0000","last_undegraded":"2024-04-25T22:44:59.390108+0000","last_fullsized":"2024-04-25T22:44:59.390108+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.099475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'358","reported_seq":900,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107737+0000","last_change":"2024-04-25T22:44:34.101942+0000","last_active":"2024-04-25T22:44:59.107737+0000","last_peered":"2024-04-25T22:44:59.107737+0000","last_clean":"2024-04-25T22:44:59.107737+0000","last_became_active":"2024-04-25T22:44:34.099595+0000","last_became_peered":"2024-04-25T22:44:34.099595+0000","last_unstale":"2024-04-25T22:44:59.107737+0000","last_undegraded":"2024-04-25T22:44:59.107737+0000","last_fullsized":"2024-04-25T22:44:59.107737+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:06.523166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12259,"num_write":325,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'465","reported_seq":634,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390513+0000","last_change":"2024-04-25T22:44:41.425331+0000","last_active":"2024-04-25T22:44:59.390513+0000","last_peered":"2024-04-25T22:44:59.390513+0000","last_clean":"2024-04-25T22:44:59.390513+0000","last_became_active":"2024-04-25T22:44:41.423799+0000","last_became_peered":"2024-04-25T22:44:41.423799+0000","last_unstale":"2024-04-25T22:44:59.390513+0000","last_undegraded":"2024-04-25T22:44:59.390513+0000","last_fullsized":"2024-04-25T22:44:59.390513+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:04.324825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"72'386","reported_seq":955,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102556+0000","last_change":"2024-04-25T22:44:46.113269+0000","last_active":"2024-04-25T22:44:59.102556+0000","last_peered":"2024-04-25T22:44:59.102556+0000","last_clean":"2024-04-25T22:44:59.102556+0000","last_became_active":"2024-04-25T22:44:46.110394+0000","last_became_peered":"2024-04-25T22:44:46.110394+0000","last_unstale":"2024-04-25T22:44:59.102556+0000","last_undegraded":"2024-04-25T22:44:59.102556+0000","last_fullsized":"2024-04-25T22:44:59.102556+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9402,"num_write":352,"num_write_kb":50548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":418,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107397+0000","last_change":"2024-04-25T22:44:26.355770+0000","last_active":"2024-04-25T22:44:59.107397+0000","last_peered":"2024-04-25T22:44:59.107397+0000","last_clean":"2024-04-25T22:44:59.107397+0000","last_became_active":"2024-04-25T22:44:26.354730+0000","last_became_peered":"2024-04-25T22:44:26.354730+0000","last_unstale":"2024-04-25T22:44:59.107397+0000","last_undegraded":"2024-04-25T22:44:59.107397+0000","last_fullsized":"2024-04-25T22:44:59.107397+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:34.987031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":209,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109432+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:44:59.109432+0000","last_peered":"2024-04-25T22:44:59.109432+0000","last_clean":"2024-04-25T22:44:59.109432+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:44:59.109432+0000","last_undegraded":"2024-04-25T22:44:59.109432+0000","last_fullsized":"2024-04-25T22:44:59.109432+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"71'457","reported_seq":676,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103149+0000","last_change":"2024-04-25T22:44:29.399148+0000","last_active":"2024-04-25T22:44:59.103149+0000","last_peered":"2024-04-25T22:44:59.103149+0000","last_clean":"2024-04-25T22:44:59.103149+0000","last_became_active":"2024-04-25T22:44:29.397962+0000","last_became_peered":"2024-04-25T22:44:29.397962+0000","last_unstale":"2024-04-25T22:44:59.103149+0000","last_undegraded":"2024-04-25T22:44:59.103149+0000","last_fullsized":"2024-04-25T22:44:59.103149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:14.015619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"72'447","reported_seq":1111,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108782+0000","last_change":"2024-04-25T22:44:43.108262+0000","last_active":"2024-04-25T22:44:59.108782+0000","last_peered":"2024-04-25T22:44:59.108782+0000","last_clean":"2024-04-25T22:44:59.108782+0000","last_became_active":"2024-04-25T22:44:43.105231+0000","last_became_peered":"2024-04-25T22:44:43.105231+0000","last_unstale":"2024-04-25T22:44:59.108782+0000","last_undegraded":"2024-04-25T22:44:59.108782+0000","last_fullsized":"2024-04-25T22:44:59.108782+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:09.728618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45074,"num_write":414,"num_write_kb":120596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":216,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107098+0000","last_change":"2024-04-25T22:44:26.355238+0000","last_active":"2024-04-25T22:44:59.107098+0000","last_peered":"2024-04-25T22:44:59.107098+0000","last_clean":"2024-04-25T22:44:59.107098+0000","last_became_active":"2024-04-25T22:44:26.354482+0000","last_became_peered":"2024-04-25T22:44:26.354482+0000","last_unstale":"2024-04-25T22:44:59.107098+0000","last_undegraded":"2024-04-25T22:44:59.107098+0000","last_fullsized":"2024-04-25T22:44:59.107098+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.042514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'122","reported_seq":340,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101684+0000","last_change":"2024-04-25T22:44:39.141843+0000","last_active":"2024-04-25T22:44:59.101684+0000","last_peered":"2024-04-25T22:44:59.101684+0000","last_clean":"2024-04-25T22:44:59.101684+0000","last_became_active":"2024-04-25T22:44:39.139689+0000","last_became_peered":"2024-04-25T22:44:39.139689+0000","last_unstale":"2024-04-25T22:44:59.101684+0000","last_undegraded":"2024-04-25T22:44:59.101684+0000","last_fullsized":"2024-04-25T22:44:59.101684+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:18.614670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":62,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"72'449","reported_seq":652,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.393126+0000","last_change":"2024-04-25T22:44:41.439044+0000","last_active":"2024-04-25T22:44:59.393126+0000","last_peered":"2024-04-25T22:44:59.393126+0000","last_clean":"2024-04-25T22:44:59.393126+0000","last_became_active":"2024-04-25T22:44:41.432785+0000","last_became_peered":"2024-04-25T22:44:41.432785+0000","last_unstale":"2024-04-25T22:44:59.393126+0000","last_undegraded":"2024-04-25T22:44:59.393126+0000","last_fullsized":"2024-04-25T22:44:59.393126+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:57.171725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25191,"num_write":420,"num_write_kb":79855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101972+0000","last_change":"2024-04-25T22:44:26.363464+0000","last_active":"2024-04-25T22:44:59.101972+0000","last_peered":"2024-04-25T22:44:59.101972+0000","last_clean":"2024-04-25T22:44:59.101972+0000","last_became_active":"2024-04-25T22:44:26.362808+0000","last_became_peered":"2024-04-25T22:44:26.362808+0000","last_unstale":"2024-04-25T22:44:59.101972+0000","last_undegraded":"2024-04-25T22:44:59.101972+0000","last_fullsized":"2024-04-25T22:44:59.101972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:06.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'435","reported_seq":630,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.389941+0000","last_change":"2024-04-25T22:44:41.417191+0000","last_active":"2024-04-25T22:44:59.389941+0000","last_peered":"2024-04-25T22:44:59.389941+0000","last_clean":"2024-04-25T22:44:59.389941+0000","last_became_active":"2024-04-25T22:44:41.415592+0000","last_became_peered":"2024-04-25T22:44:41.415592+0000","last_unstale":"2024-04-25T22:44:59.389941+0000","last_undegraded":"2024-04-25T22:44:59.389941+0000","last_fullsized":"2024-04-25T22:44:59.389941+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:35.916512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"72'337","reported_seq":888,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103033+0000","last_change":"2024-04-25T22:44:45.113523+0000","last_active":"2024-04-25T22:44:59.103033+0000","last_peered":"2024-04-25T22:44:59.103033+0000","last_clean":"2024-04-25T22:44:59.103033+0000","last_became_active":"2024-04-25T22:44:45.111011+0000","last_became_peered":"2024-04-25T22:44:45.111011+0000","last_unstale":"2024-04-25T22:44:59.103033+0000","last_undegraded":"2024-04-25T22:44:59.103033+0000","last_fullsized":"2024-04-25T22:44:59.103033+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25242,"num_write":307,"num_write_kb":26250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":209,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108546+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:44:59.108546+0000","last_peered":"2024-04-25T22:44:59.108546+0000","last_clean":"2024-04-25T22:44:59.108546+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:44:59.108546+0000","last_undegraded":"2024-04-25T22:44:59.108546+0000","last_fullsized":"2024-04-25T22:44:59.108546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"71'61","reported_seq":264,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109291+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:44:59.109291+0000","last_peered":"2024-04-25T22:44:59.109291+0000","last_clean":"2024-04-25T22:44:59.109291+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:44:59.109291+0000","last_undegraded":"2024-04-25T22:44:59.109291+0000","last_fullsized":"2024-04-25T22:44:59.109291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'404","reported_seq":1016,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102941+0000","last_change":"2024-04-25T22:44:32.092728+0000","last_active":"2024-04-25T22:44:59.102941+0000","last_peered":"2024-04-25T22:44:59.102941+0000","last_clean":"2024-04-25T22:44:59.102941+0000","last_became_active":"2024-04-25T22:44:32.087528+0000","last_became_peered":"2024-04-25T22:44:32.087528+0000","last_unstale":"2024-04-25T22:44:59.102941+0000","last_undegraded":"2024-04-25T22:44:59.102941+0000","last_fullsized":"2024-04-25T22:44:59.102941+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:39.481467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":20287,"num_write":371,"num_write_kb":59919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'285","reported_seq":488,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109060+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:44:59.109060+0000","last_peered":"2024-04-25T22:44:59.109060+0000","last_clean":"2024-04-25T22:44:59.109060+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:44:59.109060+0000","last_undegraded":"2024-04-25T22:44:59.109060+0000","last_fullsized":"2024-04-25T22:44:59.109060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":217,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.104160+0000","last_change":"2024-04-25T22:44:26.364185+0000","last_active":"2024-04-25T22:44:59.104160+0000","last_peered":"2024-04-25T22:44:59.104160+0000","last_clean":"2024-04-25T22:44:59.104160+0000","last_became_active":"2024-04-25T22:44:26.363583+0000","last_became_peered":"2024-04-25T22:44:26.363583+0000","last_unstale":"2024-04-25T22:44:59.104160+0000","last_undegraded":"2024-04-25T22:44:59.104160+0000","last_fullsized":"2024-04-25T22:44:59.104160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:35:04.325449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"72'366","reported_seq":522,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391466+0000","last_change":"2024-04-25T22:44:52.381174+0000","last_active":"2024-04-25T22:44:59.391466+0000","last_peered":"2024-04-25T22:44:59.391466+0000","last_clean":"2024-04-25T22:44:59.391466+0000","last_became_active":"2024-04-25T22:44:52.375504+0000","last_became_peered":"2024-04-25T22:44:52.375504+0000","last_unstale":"2024-04-25T22:44:59.391466+0000","last_undegraded":"2024-04-25T22:44:59.391466+0000","last_fullsized":"2024-04-25T22:44:59.391466+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:41.592790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":346,"num_write":330,"num_write_kb":33934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":265,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103283+0000","last_change":"2024-04-25T22:44:26.364178+0000","last_active":"2024-04-25T22:44:59.103283+0000","last_peered":"2024-04-25T22:44:59.103283+0000","last_clean":"2024-04-25T22:44:59.103283+0000","last_became_active":"2024-04-25T22:44:26.363455+0000","last_became_peered":"2024-04-25T22:44:26.363455+0000","last_unstale":"2024-04-25T22:44:59.103283+0000","last_undegraded":"2024-04-25T22:44:59.103283+0000","last_fullsized":"2024-04-25T22:44:59.103283+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:58.181763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":143,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392774+0000","last_change":"2024-04-25T22:44:41.423030+0000","last_active":"2024-04-25T22:44:59.392774+0000","last_peered":"2024-04-25T22:44:59.392774+0000","last_clean":"2024-04-25T22:44:59.392774+0000","last_became_active":"2024-04-25T22:44:41.421194+0000","last_became_peered":"2024-04-25T22:44:41.421194+0000","last_unstale":"2024-04-25T22:44:59.392774+0000","last_undegraded":"2024-04-25T22:44:59.392774+0000","last_fullsized":"2024-04-25T22:44:59.392774+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:59.297537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'413","reported_seq":627,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390506+0000","last_change":"2024-04-25T22:44:48.378474+0000","last_active":"2024-04-25T22:44:59.390506+0000","last_peered":"2024-04-25T22:44:59.390506+0000","last_clean":"2024-04-25T22:44:59.390506+0000","last_became_active":"2024-04-25T22:44:48.372485+0000","last_became_peered":"2024-04-25T22:44:48.372485+0000","last_unstale":"2024-04-25T22:44:59.390506+0000","last_undegraded":"2024-04-25T22:44:59.390506+0000","last_fullsized":"2024-04-25T22:44:59.390506+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:47.402437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22994,"num_write":377,"num_write_kb":63140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'57","reported_seq":269,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103690+0000","last_change":"2024-04-25T22:44:26.366189+0000","last_active":"2024-04-25T22:44:59.103690+0000","last_peered":"2024-04-25T22:44:59.103690+0000","last_clean":"2024-04-25T22:44:59.103690+0000","last_became_active":"2024-04-25T22:44:26.365267+0000","last_became_peered":"2024-04-25T22:44:26.365267+0000","last_unstale":"2024-04-25T22:44:59.103690+0000","last_undegraded":"2024-04-25T22:44:59.103690+0000","last_fullsized":"2024-04-25T22:44:59.103690+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:54.128937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":217,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.104205+0000","last_change":"2024-04-25T22:44:26.361633+0000","last_active":"2024-04-25T22:44:59.104205+0000","last_peered":"2024-04-25T22:44:59.104205+0000","last_clean":"2024-04-25T22:44:59.104205+0000","last_became_active":"2024-04-25T22:44:26.360968+0000","last_became_peered":"2024-04-25T22:44:26.360968+0000","last_unstale":"2024-04-25T22:44:59.104205+0000","last_undegraded":"2024-04-25T22:44:59.104205+0000","last_fullsized":"2024-04-25T22:44:59.104205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:40.454898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'398","reported_seq":599,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102087+0000","last_change":"2024-04-25T22:44:39.132801+0000","last_active":"2024-04-25T22:44:59.102087+0000","last_peered":"2024-04-25T22:44:59.102087+0000","last_clean":"2024-04-25T22:44:59.102087+0000","last_became_active":"2024-04-25T22:44:39.124378+0000","last_became_peered":"2024-04-25T22:44:39.124378+0000","last_unstale":"2024-04-25T22:44:59.102087+0000","last_undegraded":"2024-04-25T22:44:59.102087+0000","last_fullsized":"2024-04-25T22:44:59.102087+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:29.195889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6306,"num_write":372,"num_write_kb":34077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'100","reported_seq":306,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.104153+0000","last_change":"2024-04-25T22:44:39.150245+0000","last_active":"2024-04-25T22:44:59.104153+0000","last_peered":"2024-04-25T22:44:59.104153+0000","last_clean":"2024-04-25T22:44:59.104153+0000","last_became_active":"2024-04-25T22:44:39.147377+0000","last_became_peered":"2024-04-25T22:44:39.147377+0000","last_unstale":"2024-04-25T22:44:59.104153+0000","last_undegraded":"2024-04-25T22:44:59.104153+0000","last_fullsized":"2024-04-25T22:44:59.104153+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:36.007978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":216,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109540+0000","last_change":"2024-04-25T22:44:26.360890+0000","last_active":"2024-04-25T22:44:59.109540+0000","last_peered":"2024-04-25T22:44:59.109540+0000","last_clean":"2024-04-25T22:44:59.109540+0000","last_became_active":"2024-04-25T22:44:26.360106+0000","last_became_peered":"2024-04-25T22:44:26.360106+0000","last_unstale":"2024-04-25T22:44:59.109540+0000","last_undegraded":"2024-04-25T22:44:59.109540+0000","last_fullsized":"2024-04-25T22:44:59.109540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:09.929196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'390","reported_seq":621,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390857+0000","last_change":"2024-04-25T22:44:41.433574+0000","last_active":"2024-04-25T22:44:59.390857+0000","last_peered":"2024-04-25T22:44:59.390857+0000","last_clean":"2024-04-25T22:44:59.390857+0000","last_became_active":"2024-04-25T22:44:41.414924+0000","last_became_peered":"2024-04-25T22:44:41.414924+0000","last_unstale":"2024-04-25T22:44:59.390857+0000","last_undegraded":"2024-04-25T22:44:59.390857+0000","last_fullsized":"2024-04-25T22:44:59.390857+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:46.695300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":22915,"num_write":352,"num_write_kb":47201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"72'411","reported_seq":1008,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108328+0000","last_change":"2024-04-25T22:44:32.090492+0000","last_active":"2024-04-25T22:44:59.108328+0000","last_peered":"2024-04-25T22:44:59.108328+0000","last_clean":"2024-04-25T22:44:59.108328+0000","last_became_active":"2024-04-25T22:44:32.087303+0000","last_became_peered":"2024-04-25T22:44:32.087303+0000","last_unstale":"2024-04-25T22:44:59.108328+0000","last_undegraded":"2024-04-25T22:44:59.108328+0000","last_fullsized":"2024-04-25T22:44:59.108328+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25412,"num_write":367,"num_write_kb":64656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'268","reported_seq":489,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108798+0000","last_change":"2024-04-25T22:44:29.399184+0000","last_active":"2024-04-25T22:44:59.108798+0000","last_peered":"2024-04-25T22:44:59.108798+0000","last_clean":"2024-04-25T22:44:59.108798+0000","last_became_active":"2024-04-25T22:44:29.398317+0000","last_became_peered":"2024-04-25T22:44:29.398317+0000","last_unstale":"2024-04-25T22:44:59.108798+0000","last_undegraded":"2024-04-25T22:44:59.108798+0000","last_fullsized":"2024-04-25T22:44:59.108798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:21.765162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382817,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"72'423","reported_seq":1047,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101400+0000","last_change":"2024-04-25T22:44:42.092243+0000","last_active":"2024-04-25T22:44:59.101400+0000","last_peered":"2024-04-25T22:44:59.101400+0000","last_clean":"2024-04-25T22:44:59.101400+0000","last_became_active":"2024-04-25T22:44:42.088432+0000","last_became_peered":"2024-04-25T22:44:42.088432+0000","last_unstale":"2024-04-25T22:44:59.101400+0000","last_undegraded":"2024-04-25T22:44:59.101400+0000","last_fullsized":"2024-04-25T22:44:59.101400+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:54.239406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24794,"num_write":386,"num_write_kb":63756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'102","reported_seq":96,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392357+0000","last_change":"2024-04-25T22:44:41.423993+0000","last_active":"2024-04-25T22:44:59.392357+0000","last_peered":"2024-04-25T22:44:59.392357+0000","last_clean":"2024-04-25T22:44:59.392357+0000","last_became_active":"2024-04-25T22:44:41.422237+0000","last_became_peered":"2024-04-25T22:44:41.422237+0000","last_unstale":"2024-04-25T22:44:59.392357+0000","last_undegraded":"2024-04-25T22:44:59.392357+0000","last_fullsized":"2024-04-25T22:44:59.392357+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:02.880774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"71'213","reported_seq":415,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108237+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:44:59.108237+0000","last_peered":"2024-04-25T22:44:59.108237+0000","last_clean":"2024-04-25T22:44:59.108237+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:44:59.108237+0000","last_undegraded":"2024-04-25T22:44:59.108237+0000","last_fullsized":"2024-04-25T22:44:59.108237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"72'504","reported_seq":769,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101135+0000","last_change":"2024-04-25T22:44:39.142694+0000","last_active":"2024-04-25T22:44:59.101135+0000","last_peered":"2024-04-25T22:44:59.101135+0000","last_clean":"2024-04-25T22:44:59.101135+0000","last_became_active":"2024-04-25T22:44:39.132582+0000","last_became_peered":"2024-04-25T22:44:39.132582+0000","last_unstale":"2024-04-25T22:44:59.101135+0000","last_undegraded":"2024-04-25T22:44:59.101135+0000","last_fullsized":"2024-04-25T22:44:59.101135+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:14.401644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":46975,"num_write":471,"num_write_kb":146290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'64","reported_seq":219,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103398+0000","last_change":"2024-04-25T22:44:39.136961+0000","last_active":"2024-04-25T22:44:59.103398+0000","last_peered":"2024-04-25T22:44:59.103398+0000","last_clean":"2024-04-25T22:44:59.103398+0000","last_became_active":"2024-04-25T22:44:39.136090+0000","last_became_peered":"2024-04-25T22:44:39.136090+0000","last_unstale":"2024-04-25T22:44:59.103398+0000","last_undegraded":"2024-04-25T22:44:59.103398+0000","last_fullsized":"2024-04-25T22:44:59.103398+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:35.220314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"72'475","reported_seq":1154,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101544+0000","last_change":"2024-04-25T22:44:44.106484+0000","last_active":"2024-04-25T22:44:59.101544+0000","last_peered":"2024-04-25T22:44:59.101544+0000","last_clean":"2024-04-25T22:44:59.101544+0000","last_became_active":"2024-04-25T22:44:44.102061+0000","last_became_peered":"2024-04-25T22:44:44.102061+0000","last_unstale":"2024-04-25T22:44:59.101544+0000","last_undegraded":"2024-04-25T22:44:59.101544+0000","last_fullsized":"2024-04-25T22:44:59.101544+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:05.455255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":23011,"num_write":448,"num_write_kb":76439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"72'370","reported_seq":567,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392775+0000","last_change":"2024-04-25T22:44:56.420080+0000","last_active":"2024-04-25T22:44:59.392775+0000","last_peered":"2024-04-25T22:44:59.392775+0000","last_clean":"2024-04-25T22:44:59.392775+0000","last_became_active":"2024-04-25T22:44:56.414231+0000","last_became_peered":"2024-04-25T22:44:56.414231+0000","last_unstale":"2024-04-25T22:44:59.392775+0000","last_undegraded":"2024-04-25T22:44:59.392775+0000","last_fullsized":"2024-04-25T22:44:59.392775+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:22.002829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33211,"num_write":340,"num_write_kb":63312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"71'647","reported_seq":865,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102434+0000","last_change":"2024-04-25T22:44:30.396965+0000","last_active":"2024-04-25T22:44:59.102434+0000","last_peered":"2024-04-25T22:44:59.102434+0000","last_clean":"2024-04-25T22:44:59.102434+0000","last_became_active":"2024-04-25T22:44:30.396073+0000","last_became_peered":"2024-04-25T22:44:30.396073+0000","last_unstale":"2024-04-25T22:44:59.102434+0000","last_undegraded":"2024-04-25T22:44:59.102434+0000","last_fullsized":"2024-04-25T22:44:59.102434+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"72'415","reported_seq":636,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102938+0000","last_change":"2024-04-25T22:44:39.150290+0000","last_active":"2024-04-25T22:44:59.102938+0000","last_peered":"2024-04-25T22:44:59.102938+0000","last_clean":"2024-04-25T22:44:59.102938+0000","last_became_active":"2024-04-25T22:44:39.146949+0000","last_became_peered":"2024-04-25T22:44:39.146949+0000","last_unstale":"2024-04-25T22:44:59.102938+0000","last_undegraded":"2024-04-25T22:44:59.102938+0000","last_fullsized":"2024-04-25T22:44:59.102938+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:11.804350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19493,"num_write":386,"num_write_kb":64692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'207","reported_seq":362,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101542+0000","last_change":"2024-04-25T22:44:39.141125+0000","last_active":"2024-04-25T22:44:59.101542+0000","last_peered":"2024-04-25T22:44:59.101542+0000","last_clean":"2024-04-25T22:44:59.101542+0000","last_became_active":"2024-04-25T22:44:39.138371+0000","last_became_peered":"2024-04-25T22:44:39.138371+0000","last_unstale":"2024-04-25T22:44:59.101542+0000","last_undegraded":"2024-04-25T22:44:59.101542+0000","last_fullsized":"2024-04-25T22:44:59.101542+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:14.147026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"72'395","reported_seq":562,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392340+0000","last_change":"2024-04-25T22:44:55.406524+0000","last_active":"2024-04-25T22:44:59.392340+0000","last_peered":"2024-04-25T22:44:59.392340+0000","last_clean":"2024-04-25T22:44:59.392340+0000","last_became_active":"2024-04-25T22:44:55.396613+0000","last_became_peered":"2024-04-25T22:44:55.396613+0000","last_unstale":"2024-04-25T22:44:59.392340+0000","last_undegraded":"2024-04-25T22:44:59.392340+0000","last_fullsized":"2024-04-25T22:44:59.392340+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:41.515369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9576,"num_write":348,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'194","reported_seq":363,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391176+0000","last_change":"2024-04-25T22:44:41.422369+0000","last_active":"2024-04-25T22:44:59.391176+0000","last_peered":"2024-04-25T22:44:59.391176+0000","last_clean":"2024-04-25T22:44:59.391176+0000","last_became_active":"2024-04-25T22:44:41.420491+0000","last_became_peered":"2024-04-25T22:44:41.420491+0000","last_unstale":"2024-04-25T22:44:59.391176+0000","last_undegraded":"2024-04-25T22:44:59.391176+0000","last_fullsized":"2024-04-25T22:44:59.391176+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:35.081225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360511,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":12143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12360511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"72'398","reported_seq":593,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391353+0000","last_change":"2024-04-25T22:44:52.381363+0000","last_active":"2024-04-25T22:44:59.391353+0000","last_peered":"2024-04-25T22:44:59.391353+0000","last_clean":"2024-04-25T22:44:59.391353+0000","last_became_active":"2024-04-25T22:44:52.375632+0000","last_became_peered":"2024-04-25T22:44:52.375632+0000","last_unstale":"2024-04-25T22:44:59.391353+0000","last_undegraded":"2024-04-25T22:44:59.391353+0000","last_fullsized":"2024-04-25T22:44:59.391353+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:38:28.441621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31284,"num_write":371,"num_write_kb":80144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"71'51","reported_seq":94,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390518+0000","last_change":"2024-04-25T22:44:41.415722+0000","last_active":"2024-04-25T22:44:59.390518+0000","last_peered":"2024-04-25T22:44:59.390518+0000","last_clean":"2024-04-25T22:44:59.390518+0000","last_became_active":"2024-04-25T22:44:41.414774+0000","last_became_peered":"2024-04-25T22:44:41.414774+0000","last_unstale":"2024-04-25T22:44:59.390518+0000","last_undegraded":"2024-04-25T22:44:59.390518+0000","last_fullsized":"2024-04-25T22:44:59.390518+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:20.553373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"72'383","reported_seq":635,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107059+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:44:59.107059+0000","last_peered":"2024-04-25T22:44:59.107059+0000","last_clean":"2024-04-25T22:44:59.107059+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:44:59.107059+0000","last_undegraded":"2024-04-25T22:44:59.107059+0000","last_fullsized":"2024-04-25T22:44:59.107059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29308,"num_write":358,"num_write_kb":66975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"71'177","reported_seq":379,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108565+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:44:59.108565+0000","last_peered":"2024-04-25T22:44:59.108565+0000","last_clean":"2024-04-25T22:44:59.108565+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:44:59.108565+0000","last_undegraded":"2024-04-25T22:44:59.108565+0000","last_fullsized":"2024-04-25T22:44:59.108565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"72'387","reported_seq":600,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107381+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:44:59.107381+0000","last_peered":"2024-04-25T22:44:59.107381+0000","last_clean":"2024-04-25T22:44:59.107381+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:44:59.107381+0000","last_undegraded":"2024-04-25T22:44:59.107381+0000","last_fullsized":"2024-04-25T22:44:59.107381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3883,"num_write":348,"num_write_kb":34122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'209","reported_seq":413,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391358+0000","last_change":"2024-04-25T22:44:41.419972+0000","last_active":"2024-04-25T22:44:59.391358+0000","last_peered":"2024-04-25T22:44:59.391358+0000","last_clean":"2024-04-25T22:44:59.391358+0000","last_became_active":"2024-04-25T22:44:41.418106+0000","last_became_peered":"2024-04-25T22:44:41.418106+0000","last_unstale":"2024-04-25T22:44:59.391358+0000","last_undegraded":"2024-04-25T22:44:59.391358+0000","last_fullsized":"2024-04-25T22:44:59.391358+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:07.628155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":12363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"72'419","reported_seq":607,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390493+0000","last_change":"2024-04-25T22:44:41.434376+0000","last_active":"2024-04-25T22:44:59.390493+0000","last_peered":"2024-04-25T22:44:59.390493+0000","last_clean":"2024-04-25T22:44:59.390493+0000","last_became_active":"2024-04-25T22:44:41.420505+0000","last_became_peered":"2024-04-25T22:44:41.420505+0000","last_unstale":"2024-04-25T22:44:59.390493+0000","last_undegraded":"2024-04-25T22:44:59.390493+0000","last_fullsized":"2024-04-25T22:44:59.390493+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:04.414563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":13327,"num_write":388,"num_write_kb":55674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"71'131","reported_seq":349,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103634+0000","last_change":"2024-04-25T22:44:29.398880+0000","last_active":"2024-04-25T22:44:59.103634+0000","last_peered":"2024-04-25T22:44:59.103634+0000","last_clean":"2024-04-25T22:44:59.103634+0000","last_became_active":"2024-04-25T22:44:29.397905+0000","last_became_peered":"2024-04-25T22:44:29.397905+0000","last_unstale":"2024-04-25T22:44:59.103634+0000","last_undegraded":"2024-04-25T22:44:59.103634+0000","last_fullsized":"2024-04-25T22:44:59.103634+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:44.236330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"72'449","reported_seq":683,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107034+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:44:59.107034+0000","last_peered":"2024-04-25T22:44:59.107034+0000","last_clean":"2024-04-25T22:44:59.107034+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:44:59.107034+0000","last_undegraded":"2024-04-25T22:44:59.107034+0000","last_fullsized":"2024-04-25T22:44:59.107034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14222,"num_write":424,"num_write_kb":79796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"71'57","reported_seq":213,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103091+0000","last_change":"2024-04-25T22:44:39.137232+0000","last_active":"2024-04-25T22:44:59.103091+0000","last_peered":"2024-04-25T22:44:59.103091+0000","last_clean":"2024-04-25T22:44:59.103091+0000","last_became_active":"2024-04-25T22:44:39.136283+0000","last_became_peered":"2024-04-25T22:44:39.136283+0000","last_unstale":"2024-04-25T22:44:59.103091+0000","last_undegraded":"2024-04-25T22:44:59.103091+0000","last_fullsized":"2024-04-25T22:44:59.103091+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:32.428982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2461,"num_read_kb":1248646,"num_write":24434,"num_write_kb":4137258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7447,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26539,"ondisk_log_size":26539,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127071275,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":4473,"num_write_kb":127409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254210048,"data_stored":254142550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},"log_size":6216,"ondisk_log_size":6216,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738434,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165344,"kb_used_data":80080,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94206496,"statfs":{"total":96636764160,"available":96467451904,"internally_reserved":0,"allocated":82001920,"data_stored":81417710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":79,"seq":339302416393,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141396,"kb_used_data":83332,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94230444,"statfs":{"total":96636764160,"available":96491974656,"internally_reserved":0,"allocated":85331968,"data_stored":84735273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6003,"internal_metadata":59435149},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738434,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174352,"kb_used_data":89088,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94197488,"statfs":{"total":96636764160,"available":96458227712,"internally_reserved":0,"allocated":91226112,"data_stored":90619941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89575424,"data_stored":89544940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83689472,"data_stored":83664533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80945152,"data_stored":80933077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:45:04.529 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:45:04.889 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:45:04.891 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:45:04.909 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-04-25T22:45:03.243659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127661643,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2659,"num_read_kb":1250233,"num_write":29110,"num_write_kb":4268127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7469,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32912,"ondisk_log_size":32912,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":481092,"kb_used_data":252500,"kb_used_omap":8,"kb_used_meta":228535,"kb_avail":282634428,"statfs":{"total":289910292480,"available":289417654272,"internally_reserved":0,"allocated":258560000,"data_stored":256772924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9193,"internal_metadata":234019863},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1061,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1061,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.152689"},"pg_stats":[{"pgid":"4.3f","version":"72'404","reported_seq":559,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.393147+0000","last_change":"2024-04-25T22:44:57.382564+0000","last_active":"2024-04-25T22:44:59.393147+0000","last_peered":"2024-04-25T22:44:59.393147+0000","last_clean":"2024-04-25T22:44:59.393147+0000","last_became_active":"2024-04-25T22:44:57.376098+0000","last_became_peered":"2024-04-25T22:44:57.376098+0000","last_unstale":"2024-04-25T22:44:59.393147+0000","last_undegraded":"2024-04-25T22:44:59.393147+0000","last_fullsized":"2024-04-25T22:44:59.393147+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:31:49.789706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19772,"num_write":366,"num_write_kb":46873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"72'420","reported_seq":622,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392815+0000","last_change":"2024-04-25T22:44:41.434387+0000","last_active":"2024-04-25T22:44:59.392815+0000","last_peered":"2024-04-25T22:44:59.392815+0000","last_clean":"2024-04-25T22:44:59.392815+0000","last_became_active":"2024-04-25T22:44:41.418792+0000","last_became_peered":"2024-04-25T22:44:41.418792+0000","last_unstale":"2024-04-25T22:44:59.392815+0000","last_undegraded":"2024-04-25T22:44:59.392815+0000","last_fullsized":"2024-04-25T22:44:59.392815+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:43.196115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24515,"num_write":386,"num_write_kb":55688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"72'377","reported_seq":952,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107392+0000","last_change":"2024-04-25T22:44:42.096911+0000","last_active":"2024-04-25T22:44:59.107392+0000","last_peered":"2024-04-25T22:44:59.107392+0000","last_clean":"2024-04-25T22:44:59.107392+0000","last_became_active":"2024-04-25T22:44:42.093941+0000","last_became_peered":"2024-04-25T22:44:42.093941+0000","last_unstale":"2024-04-25T22:44:59.107392+0000","last_undegraded":"2024-04-25T22:44:59.107392+0000","last_fullsized":"2024-04-25T22:44:59.107392+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11135,"num_write":346,"num_write_kb":38950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"72'366","reported_seq":573,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107137+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:44:59.107137+0000","last_peered":"2024-04-25T22:44:59.107137+0000","last_clean":"2024-04-25T22:44:59.107137+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:44:59.107137+0000","last_undegraded":"2024-04-25T22:44:59.107137+0000","last_fullsized":"2024-04-25T22:44:59.107137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":326,"num_write_kb":34079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"72'455","reported_seq":635,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390846+0000","last_change":"2024-04-25T22:44:50.391674+0000","last_active":"2024-04-25T22:44:59.390846+0000","last_peered":"2024-04-25T22:44:59.390846+0000","last_clean":"2024-04-25T22:44:59.390846+0000","last_became_active":"2024-04-25T22:44:50.384804+0000","last_became_peered":"2024-04-25T22:44:50.384804+0000","last_unstale":"2024-04-25T22:44:59.390846+0000","last_undegraded":"2024-04-25T22:44:59.390846+0000","last_fullsized":"2024-04-25T22:44:59.390846+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:22:54.239989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33897,"num_write":426,"num_write_kb":100721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"72'401","reported_seq":635,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106493+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:44:59.106493+0000","last_peered":"2024-04-25T22:44:59.106493+0000","last_clean":"2024-04-25T22:44:59.106493+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:44:59.106493+0000","last_undegraded":"2024-04-25T22:44:59.106493+0000","last_fullsized":"2024-04-25T22:44:59.106493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15258,"num_write":369,"num_write_kb":53298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"72'452","reported_seq":718,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106260+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:44:59.106260+0000","last_peered":"2024-04-25T22:44:59.106260+0000","last_clean":"2024-04-25T22:44:59.106260+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:44:59.106260+0000","last_undegraded":"2024-04-25T22:44:59.106260+0000","last_fullsized":"2024-04-25T22:44:59.106260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34010,"num_write":428,"num_write_kb":157752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"72'401","reported_seq":640,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.105970+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:44:59.105970+0000","last_peered":"2024-04-25T22:44:59.105970+0000","last_clean":"2024-04-25T22:44:59.105970+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:44:59.105970+0000","last_undegraded":"2024-04-25T22:44:59.105970+0000","last_fullsized":"2024-04-25T22:44:59.105970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19917,"num_write":359,"num_write_kb":109382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"72'394","reported_seq":980,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101912+0000","last_change":"2024-04-25T22:44:48.092689+0000","last_active":"2024-04-25T22:44:59.101912+0000","last_peered":"2024-04-25T22:44:59.101912+0000","last_clean":"2024-04-25T22:44:59.101912+0000","last_became_active":"2024-04-25T22:44:48.089795+0000","last_became_peered":"2024-04-25T22:44:48.089795+0000","last_unstale":"2024-04-25T22:44:59.101912+0000","last_undegraded":"2024-04-25T22:44:59.101912+0000","last_fullsized":"2024-04-25T22:44:59.101912+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:32:33.072950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9569,"num_write":360,"num_write_kb":25560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"72'382","reported_seq":566,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392804+0000","last_change":"2024-04-25T22:44:41.433644+0000","last_active":"2024-04-25T22:44:59.392804+0000","last_peered":"2024-04-25T22:44:59.392804+0000","last_clean":"2024-04-25T22:44:59.392804+0000","last_became_active":"2024-04-25T22:44:41.421234+0000","last_became_peered":"2024-04-25T22:44:41.421234+0000","last_unstale":"2024-04-25T22:44:59.392804+0000","last_undegraded":"2024-04-25T22:44:59.392804+0000","last_fullsized":"2024-04-25T22:44:59.392804+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:24.217391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17192,"num_write":338,"num_write_kb":38688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"72'369","reported_seq":592,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107541+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:44:59.107541+0000","last_peered":"2024-04-25T22:44:59.107541+0000","last_clean":"2024-04-25T22:44:59.107541+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:44:59.107541+0000","last_undegraded":"2024-04-25T22:44:59.107541+0000","last_fullsized":"2024-04-25T22:44:59.107541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7385,"num_write":349,"num_write_kb":58842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"72'338","reported_seq":522,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391810+0000","last_change":"2024-04-25T22:44:49.384005+0000","last_active":"2024-04-25T22:44:59.391810+0000","last_peered":"2024-04-25T22:44:59.391810+0000","last_clean":"2024-04-25T22:44:59.391810+0000","last_became_active":"2024-04-25T22:44:49.378325+0000","last_became_peered":"2024-04-25T22:44:49.378325+0000","last_unstale":"2024-04-25T22:44:59.391810+0000","last_undegraded":"2024-04-25T22:44:59.391810+0000","last_fullsized":"2024-04-25T22:44:59.391810+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:18.849786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13619,"num_write":312,"num_write_kb":21391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"72'411","reported_seq":605,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391345+0000","last_change":"2024-04-25T22:44:41.432463+0000","last_active":"2024-04-25T22:44:59.391345+0000","last_peered":"2024-04-25T22:44:59.391345+0000","last_clean":"2024-04-25T22:44:59.391345+0000","last_became_active":"2024-04-25T22:44:41.421096+0000","last_became_peered":"2024-04-25T22:44:41.421096+0000","last_unstale":"2024-04-25T22:44:59.391345+0000","last_undegraded":"2024-04-25T22:44:59.391345+0000","last_fullsized":"2024-04-25T22:44:59.391345+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:46.942677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12998,"num_write":375,"num_write_kb":79661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"72'452","reported_seq":1051,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107059+0000","last_change":"2024-04-25T22:44:40.130299+0000","last_active":"2024-04-25T22:44:59.107059+0000","last_peered":"2024-04-25T22:44:59.107059+0000","last_clean":"2024-04-25T22:44:59.107059+0000","last_became_active":"2024-04-25T22:44:40.127307+0000","last_became_peered":"2024-04-25T22:44:40.127307+0000","last_unstale":"2024-04-25T22:44:59.107059+0000","last_undegraded":"2024-04-25T22:44:59.107059+0000","last_fullsized":"2024-04-25T22:44:59.107059+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:16.746830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":854,"num_write":419,"num_write_kb":88217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"72'428","reported_seq":1031,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106380+0000","last_change":"2024-04-25T22:44:35.108361+0000","last_active":"2024-04-25T22:44:59.106380+0000","last_peered":"2024-04-25T22:44:59.106380+0000","last_clean":"2024-04-25T22:44:59.106380+0000","last_became_active":"2024-04-25T22:44:35.103208+0000","last_became_peered":"2024-04-25T22:44:35.103208+0000","last_unstale":"2024-04-25T22:44:59.106380+0000","last_undegraded":"2024-04-25T22:44:59.106380+0000","last_fullsized":"2024-04-25T22:44:59.106380+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:22.046332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21291,"num_write":389,"num_write_kb":68562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"72'401","reported_seq":615,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.105974+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:44:59.105974+0000","last_peered":"2024-04-25T22:44:59.105974+0000","last_clean":"2024-04-25T22:44:59.105974+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:44:59.105974+0000","last_undegraded":"2024-04-25T22:44:59.105974+0000","last_fullsized":"2024-04-25T22:44:59.105974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8276,"num_write":369,"num_write_kb":17867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"72'398","reported_seq":971,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103506+0000","last_change":"2024-04-25T22:44:49.097340+0000","last_active":"2024-04-25T22:44:59.103506+0000","last_peered":"2024-04-25T22:44:59.103506+0000","last_clean":"2024-04-25T22:44:59.103506+0000","last_became_active":"2024-04-25T22:44:49.094478+0000","last_became_peered":"2024-04-25T22:44:49.094478+0000","last_unstale":"2024-04-25T22:44:59.103506+0000","last_undegraded":"2024-04-25T22:44:59.103506+0000","last_fullsized":"2024-04-25T22:44:59.103506+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:33.421713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5883,"num_write":362,"num_write_kb":38188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"72'407","reported_seq":543,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.401367+0000","last_change":"2024-04-25T22:44:59.401367+0000","last_active":"2024-04-25T22:44:59.401367+0000","last_peered":"2024-04-25T22:44:59.401367+0000","last_clean":"2024-04-25T22:44:59.401367+0000","last_became_active":"2024-04-25T22:44:59.396404+0000","last_became_peered":"2024-04-25T22:44:59.396404+0000","last_unstale":"2024-04-25T22:44:59.401367+0000","last_undegraded":"2024-04-25T22:44:59.401367+0000","last_fullsized":"2024-04-25T22:44:59.401367+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:15:41.602118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13073,"num_write":372,"num_write_kb":59323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"72'441","reported_seq":1059,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102684+0000","last_change":"2024-04-25T22:44:41.148409+0000","last_active":"2024-04-25T22:44:59.102684+0000","last_peered":"2024-04-25T22:44:59.102684+0000","last_clean":"2024-04-25T22:44:59.102684+0000","last_became_active":"2024-04-25T22:44:41.143302+0000","last_became_peered":"2024-04-25T22:44:41.143302+0000","last_unstale":"2024-04-25T22:44:59.102684+0000","last_undegraded":"2024-04-25T22:44:59.102684+0000","last_fullsized":"2024-04-25T22:44:59.102684+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:46.289713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37611,"num_write":403,"num_write_kb":116618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"72'438","reported_seq":664,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107576+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:44:59.107576+0000","last_peered":"2024-04-25T22:44:59.107576+0000","last_clean":"2024-04-25T22:44:59.107576+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:44:59.107576+0000","last_undegraded":"2024-04-25T22:44:59.107576+0000","last_fullsized":"2024-04-25T22:44:59.107576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12393,"num_write":408,"num_write_kb":99933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"72'407","reported_seq":622,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108619+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:44:59.108619+0000","last_peered":"2024-04-25T22:44:59.108619+0000","last_clean":"2024-04-25T22:44:59.108619+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:44:59.108619+0000","last_undegraded":"2024-04-25T22:44:59.108619+0000","last_fullsized":"2024-04-25T22:44:59.108619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8932,"num_write":382,"num_write_kb":59684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"72'463","reported_seq":692,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391725+0000","last_change":"2024-04-25T22:44:47.376009+0000","last_active":"2024-04-25T22:44:59.391725+0000","last_peered":"2024-04-25T22:44:59.391725+0000","last_clean":"2024-04-25T22:44:59.391725+0000","last_became_active":"2024-04-25T22:44:47.369995+0000","last_became_peered":"2024-04-25T22:44:47.369995+0000","last_unstale":"2024-04-25T22:44:59.391725+0000","last_undegraded":"2024-04-25T22:44:59.391725+0000","last_fullsized":"2024-04-25T22:44:59.391725+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:04.129559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27589,"num_write":428,"num_write_kb":76861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"72'425","reported_seq":694,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.100741+0000","last_change":"2024-04-25T22:44:39.132230+0000","last_active":"2024-04-25T22:44:59.100741+0000","last_peered":"2024-04-25T22:44:59.100741+0000","last_clean":"2024-04-25T22:44:59.100741+0000","last_became_active":"2024-04-25T22:44:39.118635+0000","last_became_peered":"2024-04-25T22:44:39.118635+0000","last_unstale":"2024-04-25T22:44:59.100741+0000","last_undegraded":"2024-04-25T22:44:59.100741+0000","last_fullsized":"2024-04-25T22:44:59.100741+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:15.096836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":46424,"num_write":390,"num_write_kb":96359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"72'445","reported_seq":619,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390506+0000","last_change":"2024-04-25T22:44:54.388681+0000","last_active":"2024-04-25T22:44:59.390506+0000","last_peered":"2024-04-25T22:44:59.390506+0000","last_clean":"2024-04-25T22:44:59.390506+0000","last_became_active":"2024-04-25T22:44:54.382124+0000","last_became_peered":"2024-04-25T22:44:54.382124+0000","last_unstale":"2024-04-25T22:44:59.390506+0000","last_undegraded":"2024-04-25T22:44:59.390506+0000","last_fullsized":"2024-04-25T22:44:59.390506+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:49.633770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32317,"num_write":419,"num_write_kb":76071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"72'424","reported_seq":590,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392521+0000","last_change":"2024-04-25T22:44:51.391125+0000","last_active":"2024-04-25T22:44:59.392521+0000","last_peered":"2024-04-25T22:44:59.392521+0000","last_clean":"2024-04-25T22:44:59.392521+0000","last_became_active":"2024-04-25T22:44:51.383461+0000","last_became_peered":"2024-04-25T22:44:51.383461+0000","last_unstale":"2024-04-25T22:44:59.392521+0000","last_undegraded":"2024-04-25T22:44:59.392521+0000","last_fullsized":"2024-04-25T22:44:59.392521+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:33.717342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8396,"num_write":399,"num_write_kb":50416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"72'499","reported_seq":710,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102656+0000","last_change":"2024-04-25T22:44:39.149280+0000","last_active":"2024-04-25T22:44:59.102656+0000","last_peered":"2024-04-25T22:44:59.102656+0000","last_clean":"2024-04-25T22:44:59.102656+0000","last_became_active":"2024-04-25T22:44:39.143391+0000","last_became_peered":"2024-04-25T22:44:39.143391+0000","last_unstale":"2024-04-25T22:44:59.102656+0000","last_undegraded":"2024-04-25T22:44:59.102656+0000","last_fullsized":"2024-04-25T22:44:59.102656+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:54:10.301144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10227,"num_write":453,"num_write_kb":96585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'430","reported_seq":1082,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107732+0000","last_change":"2024-04-25T22:44:39.113437+0000","last_active":"2024-04-25T22:44:59.107732+0000","last_peered":"2024-04-25T22:44:59.107732+0000","last_clean":"2024-04-25T22:44:59.107732+0000","last_became_active":"2024-04-25T22:44:39.109771+0000","last_became_peered":"2024-04-25T22:44:39.109771+0000","last_unstale":"2024-04-25T22:44:59.107732+0000","last_undegraded":"2024-04-25T22:44:59.107732+0000","last_fullsized":"2024-04-25T22:44:59.107732+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:40:46.739897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":32116,"num_write":409,"num_write_kb":89217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"72'393","reported_seq":656,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391736+0000","last_change":"2024-04-25T22:44:41.425947+0000","last_active":"2024-04-25T22:44:59.391736+0000","last_peered":"2024-04-25T22:44:59.391736+0000","last_clean":"2024-04-25T22:44:59.391736+0000","last_became_active":"2024-04-25T22:44:41.413570+0000","last_became_peered":"2024-04-25T22:44:41.413570+0000","last_unstale":"2024-04-25T22:44:59.391736+0000","last_undegraded":"2024-04-25T22:44:59.391736+0000","last_fullsized":"2024-04-25T22:44:59.391736+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:39:00.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":28076,"num_write":364,"num_write_kb":47473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"72'399","reported_seq":993,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103262+0000","last_change":"2024-04-25T22:44:40.124745+0000","last_active":"2024-04-25T22:44:59.103262+0000","last_peered":"2024-04-25T22:44:59.103262+0000","last_clean":"2024-04-25T22:44:59.103262+0000","last_became_active":"2024-04-25T22:44:40.121838+0000","last_became_peered":"2024-04-25T22:44:40.121838+0000","last_unstale":"2024-04-25T22:44:59.103262+0000","last_undegraded":"2024-04-25T22:44:59.103262+0000","last_fullsized":"2024-04-25T22:44:59.103262+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:28.299317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14005,"num_write":367,"num_write_kb":58883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"72'484","reported_seq":683,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391410+0000","last_change":"2024-04-25T22:44:54.392451+0000","last_active":"2024-04-25T22:44:59.391410+0000","last_peered":"2024-04-25T22:44:59.391410+0000","last_clean":"2024-04-25T22:44:59.391410+0000","last_became_active":"2024-04-25T22:44:54.383808+0000","last_became_peered":"2024-04-25T22:44:54.383808+0000","last_unstale":"2024-04-25T22:44:59.391410+0000","last_undegraded":"2024-04-25T22:44:59.391410+0000","last_fullsized":"2024-04-25T22:44:59.391410+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:06.630318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23352,"num_write":446,"num_write_kb":100094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'455","reported_seq":1136,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101023+0000","last_change":"2024-04-25T22:44:33.087211+0000","last_active":"2024-04-25T22:44:59.101023+0000","last_peered":"2024-04-25T22:44:59.101023+0000","last_clean":"2024-04-25T22:44:59.101023+0000","last_became_active":"2024-04-25T22:44:33.084127+0000","last_became_peered":"2024-04-25T22:44:33.084127+0000","last_unstale":"2024-04-25T22:44:59.101023+0000","last_undegraded":"2024-04-25T22:44:59.101023+0000","last_fullsized":"2024-04-25T22:44:59.101023+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38440,"num_write":423,"num_write_kb":71855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"72'434","reported_seq":668,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106552+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:44:59.106552+0000","last_peered":"2024-04-25T22:44:59.106552+0000","last_clean":"2024-04-25T22:44:59.106552+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:44:59.106552+0000","last_undegraded":"2024-04-25T22:44:59.106552+0000","last_fullsized":"2024-04-25T22:44:59.106552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18701,"num_write":402,"num_write_kb":27564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"72'379","reported_seq":526,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391067+0000","last_change":"2024-04-25T22:44:53.383623+0000","last_active":"2024-04-25T22:44:59.391067+0000","last_peered":"2024-04-25T22:44:59.391067+0000","last_clean":"2024-04-25T22:44:59.391067+0000","last_became_active":"2024-04-25T22:44:53.378402+0000","last_became_peered":"2024-04-25T22:44:53.378402+0000","last_unstale":"2024-04-25T22:44:59.391067+0000","last_undegraded":"2024-04-25T22:44:59.391067+0000","last_fullsized":"2024-04-25T22:44:59.391067+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:52:18.111269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18623,"num_write":344,"num_write_kb":50888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"71'528","reported_seq":731,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109262+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:44:59.109262+0000","last_peered":"2024-04-25T22:44:59.109262+0000","last_clean":"2024-04-25T22:44:59.109262+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:44:59.109262+0000","last_undegraded":"2024-04-25T22:44:59.109262+0000","last_fullsized":"2024-04-25T22:44:59.109262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"72'383","reported_seq":503,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392060+0000","last_change":"2024-04-25T22:44:58.385931+0000","last_active":"2024-04-25T22:44:59.392060+0000","last_peered":"2024-04-25T22:44:59.392060+0000","last_clean":"2024-04-25T22:44:59.392060+0000","last_became_active":"2024-04-25T22:44:58.380203+0000","last_became_peered":"2024-04-25T22:44:58.380203+0000","last_unstale":"2024-04-25T22:44:59.392060+0000","last_undegraded":"2024-04-25T22:44:59.392060+0000","last_fullsized":"2024-04-25T22:44:59.392060+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:12.874377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8364,"num_write":351,"num_write_kb":30625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"71'45","reported_seq":201,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102522+0000","last_change":"2024-04-25T22:44:39.117622+0000","last_active":"2024-04-25T22:44:59.102522+0000","last_peered":"2024-04-25T22:44:59.102522+0000","last_clean":"2024-04-25T22:44:59.102522+0000","last_became_active":"2024-04-25T22:44:39.115669+0000","last_became_peered":"2024-04-25T22:44:39.115669+0000","last_unstale":"2024-04-25T22:44:59.102522+0000","last_undegraded":"2024-04-25T22:44:59.102522+0000","last_fullsized":"2024-04-25T22:44:59.102522+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:21.793820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"72'429","reported_seq":571,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392387+0000","last_change":"2024-04-25T22:44:58.388677+0000","last_active":"2024-04-25T22:44:59.392387+0000","last_peered":"2024-04-25T22:44:59.392387+0000","last_clean":"2024-04-25T22:44:59.392387+0000","last_became_active":"2024-04-25T22:44:58.382521+0000","last_became_peered":"2024-04-25T22:44:58.382521+0000","last_unstale":"2024-04-25T22:44:59.392387+0000","last_undegraded":"2024-04-25T22:44:59.392387+0000","last_fullsized":"2024-04-25T22:44:59.392387+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:26.999533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16584,"num_write":393,"num_write_kb":63712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'61","reported_seq":89,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391526+0000","last_change":"2024-04-25T22:44:41.416554+0000","last_active":"2024-04-25T22:44:59.391526+0000","last_peered":"2024-04-25T22:44:59.391526+0000","last_clean":"2024-04-25T22:44:59.391526+0000","last_became_active":"2024-04-25T22:44:41.413853+0000","last_became_peered":"2024-04-25T22:44:41.413853+0000","last_unstale":"2024-04-25T22:44:59.391526+0000","last_undegraded":"2024-04-25T22:44:59.391526+0000","last_fullsized":"2024-04-25T22:44:59.391526+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:50.701110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"72'404","reported_seq":624,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102212+0000","last_change":"2024-04-25T22:44:39.128428+0000","last_active":"2024-04-25T22:44:59.102212+0000","last_peered":"2024-04-25T22:44:59.102212+0000","last_clean":"2024-04-25T22:44:59.102212+0000","last_became_active":"2024-04-25T22:44:39.116562+0000","last_became_peered":"2024-04-25T22:44:39.116562+0000","last_unstale":"2024-04-25T22:44:59.102212+0000","last_undegraded":"2024-04-25T22:44:59.102212+0000","last_fullsized":"2024-04-25T22:44:59.102212+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:09.750726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18745,"num_write":376,"num_write_kb":96145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'71","reported_seq":282,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106763+0000","last_change":"2024-04-25T22:44:26.363329+0000","last_active":"2024-04-25T22:44:59.106763+0000","last_peered":"2024-04-25T22:44:59.106763+0000","last_clean":"2024-04-25T22:44:59.106763+0000","last_became_active":"2024-04-25T22:44:26.362499+0000","last_became_peered":"2024-04-25T22:44:26.362499+0000","last_unstale":"2024-04-25T22:44:59.106763+0000","last_undegraded":"2024-04-25T22:44:59.106763+0000","last_fullsized":"2024-04-25T22:44:59.106763+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'145","reported_seq":362,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109263+0000","last_change":"2024-04-25T22:44:29.400540+0000","last_active":"2024-04-25T22:44:59.109263+0000","last_peered":"2024-04-25T22:44:59.109263+0000","last_clean":"2024-04-25T22:44:59.109263+0000","last_became_active":"2024-04-25T22:44:29.399853+0000","last_became_peered":"2024-04-25T22:44:29.399853+0000","last_unstale":"2024-04-25T22:44:59.109263+0000","last_undegraded":"2024-04-25T22:44:59.109263+0000","last_fullsized":"2024-04-25T22:44:59.109263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"72'399","reported_seq":605,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390842+0000","last_change":"2024-04-25T22:44:46.398600+0000","last_active":"2024-04-25T22:44:59.390842+0000","last_peered":"2024-04-25T22:44:59.390842+0000","last_clean":"2024-04-25T22:44:59.390842+0000","last_became_active":"2024-04-25T22:44:46.392604+0000","last_became_peered":"2024-04-25T22:44:46.392604+0000","last_unstale":"2024-04-25T22:44:59.390842+0000","last_undegraded":"2024-04-25T22:44:59.390842+0000","last_fullsized":"2024-04-25T22:44:59.390842+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:15.771324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25159,"num_write":363,"num_write_kb":34063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"71'226","reported_seq":432,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392417+0000","last_change":"2024-04-25T22:44:41.417859+0000","last_active":"2024-04-25T22:44:59.392417+0000","last_peered":"2024-04-25T22:44:59.392417+0000","last_clean":"2024-04-25T22:44:59.392417+0000","last_became_active":"2024-04-25T22:44:41.416542+0000","last_became_peered":"2024-04-25T22:44:41.416542+0000","last_unstale":"2024-04-25T22:44:59.392417+0000","last_undegraded":"2024-04-25T22:44:59.392417+0000","last_fullsized":"2024-04-25T22:44:59.392417+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:27.884903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"72'431","reported_seq":578,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390134+0000","last_change":"2024-04-25T22:44:56.419453+0000","last_active":"2024-04-25T22:44:59.390134+0000","last_peered":"2024-04-25T22:44:59.390134+0000","last_clean":"2024-04-25T22:44:59.390134+0000","last_became_active":"2024-04-25T22:44:56.412151+0000","last_became_peered":"2024-04-25T22:44:56.412151+0000","last_unstale":"2024-04-25T22:44:59.390134+0000","last_undegraded":"2024-04-25T22:44:59.390134+0000","last_fullsized":"2024-04-25T22:44:59.390134+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:07:27.220853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14688,"num_write":405,"num_write_kb":38957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"71'382","reported_seq":599,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108993+0000","last_change":"2024-04-25T22:44:30.401893+0000","last_active":"2024-04-25T22:44:59.108993+0000","last_peered":"2024-04-25T22:44:59.108993+0000","last_clean":"2024-04-25T22:44:59.108993+0000","last_became_active":"2024-04-25T22:44:30.401021+0000","last_became_peered":"2024-04-25T22:44:30.401021+0000","last_unstale":"2024-04-25T22:44:59.108993+0000","last_undegraded":"2024-04-25T22:44:59.108993+0000","last_fullsized":"2024-04-25T22:44:59.108993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:38.452482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'453","reported_seq":685,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107186+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:44:59.107186+0000","last_peered":"2024-04-25T22:44:59.107186+0000","last_clean":"2024-04-25T22:44:59.107186+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:44:59.107186+0000","last_undegraded":"2024-04-25T22:44:59.107186+0000","last_fullsized":"2024-04-25T22:44:59.107186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18900,"num_write":418,"num_write_kb":117500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"71'64","reported_seq":267,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108997+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:44:59.108997+0000","last_peered":"2024-04-25T22:44:59.108997+0000","last_clean":"2024-04-25T22:44:59.108997+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:44:59.108997+0000","last_undegraded":"2024-04-25T22:44:59.108997+0000","last_fullsized":"2024-04-25T22:44:59.108997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'428","reported_seq":631,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103565+0000","last_change":"2024-04-25T22:44:39.129871+0000","last_active":"2024-04-25T22:44:59.103565+0000","last_peered":"2024-04-25T22:44:59.103565+0000","last_clean":"2024-04-25T22:44:59.103565+0000","last_became_active":"2024-04-25T22:44:39.121205+0000","last_became_peered":"2024-04-25T22:44:39.121205+0000","last_unstale":"2024-04-25T22:44:59.103565+0000","last_undegraded":"2024-04-25T22:44:59.103565+0000","last_fullsized":"2024-04-25T22:44:59.103565+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:48.521828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7477,"num_write":383,"num_write_kb":9617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'166","reported_seq":322,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103845+0000","last_change":"2024-04-25T22:44:39.133550+0000","last_active":"2024-04-25T22:44:59.103845+0000","last_peered":"2024-04-25T22:44:59.103845+0000","last_clean":"2024-04-25T22:44:59.103845+0000","last_became_active":"2024-04-25T22:44:39.131489+0000","last_became_peered":"2024-04-25T22:44:39.131489+0000","last_unstale":"2024-04-25T22:44:59.103845+0000","last_undegraded":"2024-04-25T22:44:59.103845+0000","last_fullsized":"2024-04-25T22:44:59.103845+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:32.980801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"72'446","reported_seq":696,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108117+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:44:59.108117+0000","last_peered":"2024-04-25T22:44:59.108117+0000","last_clean":"2024-04-25T22:44:59.108117+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:44:59.108117+0000","last_undegraded":"2024-04-25T22:44:59.108117+0000","last_fullsized":"2024-04-25T22:44:59.108117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27788,"num_write":414,"num_write_kb":47058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"71'113","reported_seq":316,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108347+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:44:59.108347+0000","last_peered":"2024-04-25T22:44:59.108347+0000","last_clean":"2024-04-25T22:44:59.108347+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:44:59.108347+0000","last_undegraded":"2024-04-25T22:44:59.108347+0000","last_fullsized":"2024-04-25T22:44:59.108347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"72'417","reported_seq":1019,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108706+0000","last_change":"2024-04-25T22:44:44.113498+0000","last_active":"2024-04-25T22:44:59.108706+0000","last_peered":"2024-04-25T22:44:59.108706+0000","last_clean":"2024-04-25T22:44:59.108706+0000","last_became_active":"2024-04-25T22:44:44.108084+0000","last_became_peered":"2024-04-25T22:44:44.108084+0000","last_unstale":"2024-04-25T22:44:59.108706+0000","last_undegraded":"2024-04-25T22:44:59.108706+0000","last_fullsized":"2024-04-25T22:44:59.108706+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16487,"num_write":388,"num_write_kb":75452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'59","reported_seq":89,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390108+0000","last_change":"2024-04-25T22:44:41.417821+0000","last_active":"2024-04-25T22:44:59.390108+0000","last_peered":"2024-04-25T22:44:59.390108+0000","last_clean":"2024-04-25T22:44:59.390108+0000","last_became_active":"2024-04-25T22:44:41.415769+0000","last_became_peered":"2024-04-25T22:44:41.415769+0000","last_unstale":"2024-04-25T22:44:59.390108+0000","last_undegraded":"2024-04-25T22:44:59.390108+0000","last_fullsized":"2024-04-25T22:44:59.390108+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.099475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'358","reported_seq":900,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107737+0000","last_change":"2024-04-25T22:44:34.101942+0000","last_active":"2024-04-25T22:44:59.107737+0000","last_peered":"2024-04-25T22:44:59.107737+0000","last_clean":"2024-04-25T22:44:59.107737+0000","last_became_active":"2024-04-25T22:44:34.099595+0000","last_became_peered":"2024-04-25T22:44:34.099595+0000","last_unstale":"2024-04-25T22:44:59.107737+0000","last_undegraded":"2024-04-25T22:44:59.107737+0000","last_fullsized":"2024-04-25T22:44:59.107737+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:06.523166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12259,"num_write":325,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'465","reported_seq":634,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390513+0000","last_change":"2024-04-25T22:44:41.425331+0000","last_active":"2024-04-25T22:44:59.390513+0000","last_peered":"2024-04-25T22:44:59.390513+0000","last_clean":"2024-04-25T22:44:59.390513+0000","last_became_active":"2024-04-25T22:44:41.423799+0000","last_became_peered":"2024-04-25T22:44:41.423799+0000","last_unstale":"2024-04-25T22:44:59.390513+0000","last_undegraded":"2024-04-25T22:44:59.390513+0000","last_fullsized":"2024-04-25T22:44:59.390513+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:04.324825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"72'386","reported_seq":955,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102556+0000","last_change":"2024-04-25T22:44:46.113269+0000","last_active":"2024-04-25T22:44:59.102556+0000","last_peered":"2024-04-25T22:44:59.102556+0000","last_clean":"2024-04-25T22:44:59.102556+0000","last_became_active":"2024-04-25T22:44:46.110394+0000","last_became_peered":"2024-04-25T22:44:46.110394+0000","last_unstale":"2024-04-25T22:44:59.102556+0000","last_undegraded":"2024-04-25T22:44:59.102556+0000","last_fullsized":"2024-04-25T22:44:59.102556+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9402,"num_write":352,"num_write_kb":50548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":418,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107397+0000","last_change":"2024-04-25T22:44:26.355770+0000","last_active":"2024-04-25T22:44:59.107397+0000","last_peered":"2024-04-25T22:44:59.107397+0000","last_clean":"2024-04-25T22:44:59.107397+0000","last_became_active":"2024-04-25T22:44:26.354730+0000","last_became_peered":"2024-04-25T22:44:26.354730+0000","last_unstale":"2024-04-25T22:44:59.107397+0000","last_undegraded":"2024-04-25T22:44:59.107397+0000","last_fullsized":"2024-04-25T22:44:59.107397+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:34.987031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":209,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109432+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:44:59.109432+0000","last_peered":"2024-04-25T22:44:59.109432+0000","last_clean":"2024-04-25T22:44:59.109432+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:44:59.109432+0000","last_undegraded":"2024-04-25T22:44:59.109432+0000","last_fullsized":"2024-04-25T22:44:59.109432+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"71'457","reported_seq":676,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103149+0000","last_change":"2024-04-25T22:44:29.399148+0000","last_active":"2024-04-25T22:44:59.103149+0000","last_peered":"2024-04-25T22:44:59.103149+0000","last_clean":"2024-04-25T22:44:59.103149+0000","last_became_active":"2024-04-25T22:44:29.397962+0000","last_became_peered":"2024-04-25T22:44:29.397962+0000","last_unstale":"2024-04-25T22:44:59.103149+0000","last_undegraded":"2024-04-25T22:44:59.103149+0000","last_fullsized":"2024-04-25T22:44:59.103149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:14.015619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"72'447","reported_seq":1111,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108782+0000","last_change":"2024-04-25T22:44:43.108262+0000","last_active":"2024-04-25T22:44:59.108782+0000","last_peered":"2024-04-25T22:44:59.108782+0000","last_clean":"2024-04-25T22:44:59.108782+0000","last_became_active":"2024-04-25T22:44:43.105231+0000","last_became_peered":"2024-04-25T22:44:43.105231+0000","last_unstale":"2024-04-25T22:44:59.108782+0000","last_undegraded":"2024-04-25T22:44:59.108782+0000","last_fullsized":"2024-04-25T22:44:59.108782+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:09.728618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45074,"num_write":414,"num_write_kb":120596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":216,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107098+0000","last_change":"2024-04-25T22:44:26.355238+0000","last_active":"2024-04-25T22:44:59.107098+0000","last_peered":"2024-04-25T22:44:59.107098+0000","last_clean":"2024-04-25T22:44:59.107098+0000","last_became_active":"2024-04-25T22:44:26.354482+0000","last_became_peered":"2024-04-25T22:44:26.354482+0000","last_unstale":"2024-04-25T22:44:59.107098+0000","last_undegraded":"2024-04-25T22:44:59.107098+0000","last_fullsized":"2024-04-25T22:44:59.107098+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.042514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'122","reported_seq":340,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101684+0000","last_change":"2024-04-25T22:44:39.141843+0000","last_active":"2024-04-25T22:44:59.101684+0000","last_peered":"2024-04-25T22:44:59.101684+0000","last_clean":"2024-04-25T22:44:59.101684+0000","last_became_active":"2024-04-25T22:44:39.139689+0000","last_became_peered":"2024-04-25T22:44:39.139689+0000","last_unstale":"2024-04-25T22:44:59.101684+0000","last_undegraded":"2024-04-25T22:44:59.101684+0000","last_fullsized":"2024-04-25T22:44:59.101684+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:18.614670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":62,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"72'449","reported_seq":652,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.393126+0000","last_change":"2024-04-25T22:44:41.439044+0000","last_active":"2024-04-25T22:44:59.393126+0000","last_peered":"2024-04-25T22:44:59.393126+0000","last_clean":"2024-04-25T22:44:59.393126+0000","last_became_active":"2024-04-25T22:44:41.432785+0000","last_became_peered":"2024-04-25T22:44:41.432785+0000","last_unstale":"2024-04-25T22:44:59.393126+0000","last_undegraded":"2024-04-25T22:44:59.393126+0000","last_fullsized":"2024-04-25T22:44:59.393126+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:57.171725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25191,"num_write":420,"num_write_kb":79855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101972+0000","last_change":"2024-04-25T22:44:26.363464+0000","last_active":"2024-04-25T22:44:59.101972+0000","last_peered":"2024-04-25T22:44:59.101972+0000","last_clean":"2024-04-25T22:44:59.101972+0000","last_became_active":"2024-04-25T22:44:26.362808+0000","last_became_peered":"2024-04-25T22:44:26.362808+0000","last_unstale":"2024-04-25T22:44:59.101972+0000","last_undegraded":"2024-04-25T22:44:59.101972+0000","last_fullsized":"2024-04-25T22:44:59.101972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:06.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'435","reported_seq":630,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.389941+0000","last_change":"2024-04-25T22:44:41.417191+0000","last_active":"2024-04-25T22:44:59.389941+0000","last_peered":"2024-04-25T22:44:59.389941+0000","last_clean":"2024-04-25T22:44:59.389941+0000","last_became_active":"2024-04-25T22:44:41.415592+0000","last_became_peered":"2024-04-25T22:44:41.415592+0000","last_unstale":"2024-04-25T22:44:59.389941+0000","last_undegraded":"2024-04-25T22:44:59.389941+0000","last_fullsized":"2024-04-25T22:44:59.389941+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:35.916512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"72'337","reported_seq":888,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103033+0000","last_change":"2024-04-25T22:44:45.113523+0000","last_active":"2024-04-25T22:44:59.103033+0000","last_peered":"2024-04-25T22:44:59.103033+0000","last_clean":"2024-04-25T22:44:59.103033+0000","last_became_active":"2024-04-25T22:44:45.111011+0000","last_became_peered":"2024-04-25T22:44:45.111011+0000","last_unstale":"2024-04-25T22:44:59.103033+0000","last_undegraded":"2024-04-25T22:44:59.103033+0000","last_fullsized":"2024-04-25T22:44:59.103033+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25242,"num_write":307,"num_write_kb":26250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":209,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108546+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:44:59.108546+0000","last_peered":"2024-04-25T22:44:59.108546+0000","last_clean":"2024-04-25T22:44:59.108546+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:44:59.108546+0000","last_undegraded":"2024-04-25T22:44:59.108546+0000","last_fullsized":"2024-04-25T22:44:59.108546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"71'61","reported_seq":264,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109291+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:44:59.109291+0000","last_peered":"2024-04-25T22:44:59.109291+0000","last_clean":"2024-04-25T22:44:59.109291+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:44:59.109291+0000","last_undegraded":"2024-04-25T22:44:59.109291+0000","last_fullsized":"2024-04-25T22:44:59.109291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'404","reported_seq":1016,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102941+0000","last_change":"2024-04-25T22:44:32.092728+0000","last_active":"2024-04-25T22:44:59.102941+0000","last_peered":"2024-04-25T22:44:59.102941+0000","last_clean":"2024-04-25T22:44:59.102941+0000","last_became_active":"2024-04-25T22:44:32.087528+0000","last_became_peered":"2024-04-25T22:44:32.087528+0000","last_unstale":"2024-04-25T22:44:59.102941+0000","last_undegraded":"2024-04-25T22:44:59.102941+0000","last_fullsized":"2024-04-25T22:44:59.102941+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:39.481467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":20287,"num_write":371,"num_write_kb":59919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'285","reported_seq":488,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109060+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:44:59.109060+0000","last_peered":"2024-04-25T22:44:59.109060+0000","last_clean":"2024-04-25T22:44:59.109060+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:44:59.109060+0000","last_undegraded":"2024-04-25T22:44:59.109060+0000","last_fullsized":"2024-04-25T22:44:59.109060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":217,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.104160+0000","last_change":"2024-04-25T22:44:26.364185+0000","last_active":"2024-04-25T22:44:59.104160+0000","last_peered":"2024-04-25T22:44:59.104160+0000","last_clean":"2024-04-25T22:44:59.104160+0000","last_became_active":"2024-04-25T22:44:26.363583+0000","last_became_peered":"2024-04-25T22:44:26.363583+0000","last_unstale":"2024-04-25T22:44:59.104160+0000","last_undegraded":"2024-04-25T22:44:59.104160+0000","last_fullsized":"2024-04-25T22:44:59.104160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:35:04.325449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"72'366","reported_seq":522,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391466+0000","last_change":"2024-04-25T22:44:52.381174+0000","last_active":"2024-04-25T22:44:59.391466+0000","last_peered":"2024-04-25T22:44:59.391466+0000","last_clean":"2024-04-25T22:44:59.391466+0000","last_became_active":"2024-04-25T22:44:52.375504+0000","last_became_peered":"2024-04-25T22:44:52.375504+0000","last_unstale":"2024-04-25T22:44:59.391466+0000","last_undegraded":"2024-04-25T22:44:59.391466+0000","last_fullsized":"2024-04-25T22:44:59.391466+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:41.592790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":346,"num_write":330,"num_write_kb":33934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":265,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103283+0000","last_change":"2024-04-25T22:44:26.364178+0000","last_active":"2024-04-25T22:44:59.103283+0000","last_peered":"2024-04-25T22:44:59.103283+0000","last_clean":"2024-04-25T22:44:59.103283+0000","last_became_active":"2024-04-25T22:44:26.363455+0000","last_became_peered":"2024-04-25T22:44:26.363455+0000","last_unstale":"2024-04-25T22:44:59.103283+0000","last_undegraded":"2024-04-25T22:44:59.103283+0000","last_fullsized":"2024-04-25T22:44:59.103283+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:58.181763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":143,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392774+0000","last_change":"2024-04-25T22:44:41.423030+0000","last_active":"2024-04-25T22:44:59.392774+0000","last_peered":"2024-04-25T22:44:59.392774+0000","last_clean":"2024-04-25T22:44:59.392774+0000","last_became_active":"2024-04-25T22:44:41.421194+0000","last_became_peered":"2024-04-25T22:44:41.421194+0000","last_unstale":"2024-04-25T22:44:59.392774+0000","last_undegraded":"2024-04-25T22:44:59.392774+0000","last_fullsized":"2024-04-25T22:44:59.392774+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:59.297537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'413","reported_seq":627,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390506+0000","last_change":"2024-04-25T22:44:48.378474+0000","last_active":"2024-04-25T22:44:59.390506+0000","last_peered":"2024-04-25T22:44:59.390506+0000","last_clean":"2024-04-25T22:44:59.390506+0000","last_became_active":"2024-04-25T22:44:48.372485+0000","last_became_peered":"2024-04-25T22:44:48.372485+0000","last_unstale":"2024-04-25T22:44:59.390506+0000","last_undegraded":"2024-04-25T22:44:59.390506+0000","last_fullsized":"2024-04-25T22:44:59.390506+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:47.402437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22994,"num_write":377,"num_write_kb":63140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'57","reported_seq":269,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103690+0000","last_change":"2024-04-25T22:44:26.366189+0000","last_active":"2024-04-25T22:44:59.103690+0000","last_peered":"2024-04-25T22:44:59.103690+0000","last_clean":"2024-04-25T22:44:59.103690+0000","last_became_active":"2024-04-25T22:44:26.365267+0000","last_became_peered":"2024-04-25T22:44:26.365267+0000","last_unstale":"2024-04-25T22:44:59.103690+0000","last_undegraded":"2024-04-25T22:44:59.103690+0000","last_fullsized":"2024-04-25T22:44:59.103690+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:54.128937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":217,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.104205+0000","last_change":"2024-04-25T22:44:26.361633+0000","last_active":"2024-04-25T22:44:59.104205+0000","last_peered":"2024-04-25T22:44:59.104205+0000","last_clean":"2024-04-25T22:44:59.104205+0000","last_became_active":"2024-04-25T22:44:26.360968+0000","last_became_peered":"2024-04-25T22:44:26.360968+0000","last_unstale":"2024-04-25T22:44:59.104205+0000","last_undegraded":"2024-04-25T22:44:59.104205+0000","last_fullsized":"2024-04-25T22:44:59.104205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:40.454898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'398","reported_seq":599,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102087+0000","last_change":"2024-04-25T22:44:39.132801+0000","last_active":"2024-04-25T22:44:59.102087+0000","last_peered":"2024-04-25T22:44:59.102087+0000","last_clean":"2024-04-25T22:44:59.102087+0000","last_became_active":"2024-04-25T22:44:39.124378+0000","last_became_peered":"2024-04-25T22:44:39.124378+0000","last_unstale":"2024-04-25T22:44:59.102087+0000","last_undegraded":"2024-04-25T22:44:59.102087+0000","last_fullsized":"2024-04-25T22:44:59.102087+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:29.195889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6306,"num_write":372,"num_write_kb":34077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'100","reported_seq":306,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.104153+0000","last_change":"2024-04-25T22:44:39.150245+0000","last_active":"2024-04-25T22:44:59.104153+0000","last_peered":"2024-04-25T22:44:59.104153+0000","last_clean":"2024-04-25T22:44:59.104153+0000","last_became_active":"2024-04-25T22:44:39.147377+0000","last_became_peered":"2024-04-25T22:44:39.147377+0000","last_unstale":"2024-04-25T22:44:59.104153+0000","last_undegraded":"2024-04-25T22:44:59.104153+0000","last_fullsized":"2024-04-25T22:44:59.104153+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:36.007978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":216,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109540+0000","last_change":"2024-04-25T22:44:26.360890+0000","last_active":"2024-04-25T22:44:59.109540+0000","last_peered":"2024-04-25T22:44:59.109540+0000","last_clean":"2024-04-25T22:44:59.109540+0000","last_became_active":"2024-04-25T22:44:26.360106+0000","last_became_peered":"2024-04-25T22:44:26.360106+0000","last_unstale":"2024-04-25T22:44:59.109540+0000","last_undegraded":"2024-04-25T22:44:59.109540+0000","last_fullsized":"2024-04-25T22:44:59.109540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:09.929196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'390","reported_seq":621,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390857+0000","last_change":"2024-04-25T22:44:41.433574+0000","last_active":"2024-04-25T22:44:59.390857+0000","last_peered":"2024-04-25T22:44:59.390857+0000","last_clean":"2024-04-25T22:44:59.390857+0000","last_became_active":"2024-04-25T22:44:41.414924+0000","last_became_peered":"2024-04-25T22:44:41.414924+0000","last_unstale":"2024-04-25T22:44:59.390857+0000","last_undegraded":"2024-04-25T22:44:59.390857+0000","last_fullsized":"2024-04-25T22:44:59.390857+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:46.695300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":22915,"num_write":352,"num_write_kb":47201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"72'411","reported_seq":1008,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108328+0000","last_change":"2024-04-25T22:44:32.090492+0000","last_active":"2024-04-25T22:44:59.108328+0000","last_peered":"2024-04-25T22:44:59.108328+0000","last_clean":"2024-04-25T22:44:59.108328+0000","last_became_active":"2024-04-25T22:44:32.087303+0000","last_became_peered":"2024-04-25T22:44:32.087303+0000","last_unstale":"2024-04-25T22:44:59.108328+0000","last_undegraded":"2024-04-25T22:44:59.108328+0000","last_fullsized":"2024-04-25T22:44:59.108328+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25412,"num_write":367,"num_write_kb":64656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'268","reported_seq":489,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108798+0000","last_change":"2024-04-25T22:44:29.399184+0000","last_active":"2024-04-25T22:44:59.108798+0000","last_peered":"2024-04-25T22:44:59.108798+0000","last_clean":"2024-04-25T22:44:59.108798+0000","last_became_active":"2024-04-25T22:44:29.398317+0000","last_became_peered":"2024-04-25T22:44:29.398317+0000","last_unstale":"2024-04-25T22:44:59.108798+0000","last_undegraded":"2024-04-25T22:44:59.108798+0000","last_fullsized":"2024-04-25T22:44:59.108798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:21.765162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382817,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"72'423","reported_seq":1047,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101400+0000","last_change":"2024-04-25T22:44:42.092243+0000","last_active":"2024-04-25T22:44:59.101400+0000","last_peered":"2024-04-25T22:44:59.101400+0000","last_clean":"2024-04-25T22:44:59.101400+0000","last_became_active":"2024-04-25T22:44:42.088432+0000","last_became_peered":"2024-04-25T22:44:42.088432+0000","last_unstale":"2024-04-25T22:44:59.101400+0000","last_undegraded":"2024-04-25T22:44:59.101400+0000","last_fullsized":"2024-04-25T22:44:59.101400+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:54.239406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24794,"num_write":386,"num_write_kb":63756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'102","reported_seq":96,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392357+0000","last_change":"2024-04-25T22:44:41.423993+0000","last_active":"2024-04-25T22:44:59.392357+0000","last_peered":"2024-04-25T22:44:59.392357+0000","last_clean":"2024-04-25T22:44:59.392357+0000","last_became_active":"2024-04-25T22:44:41.422237+0000","last_became_peered":"2024-04-25T22:44:41.422237+0000","last_unstale":"2024-04-25T22:44:59.392357+0000","last_undegraded":"2024-04-25T22:44:59.392357+0000","last_fullsized":"2024-04-25T22:44:59.392357+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:02.880774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"71'213","reported_seq":415,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108237+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:44:59.108237+0000","last_peered":"2024-04-25T22:44:59.108237+0000","last_clean":"2024-04-25T22:44:59.108237+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:44:59.108237+0000","last_undegraded":"2024-04-25T22:44:59.108237+0000","last_fullsized":"2024-04-25T22:44:59.108237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"72'504","reported_seq":769,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101135+0000","last_change":"2024-04-25T22:44:39.142694+0000","last_active":"2024-04-25T22:44:59.101135+0000","last_peered":"2024-04-25T22:44:59.101135+0000","last_clean":"2024-04-25T22:44:59.101135+0000","last_became_active":"2024-04-25T22:44:39.132582+0000","last_became_peered":"2024-04-25T22:44:39.132582+0000","last_unstale":"2024-04-25T22:44:59.101135+0000","last_undegraded":"2024-04-25T22:44:59.101135+0000","last_fullsized":"2024-04-25T22:44:59.101135+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:14.401644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":46975,"num_write":471,"num_write_kb":146290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'64","reported_seq":219,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103398+0000","last_change":"2024-04-25T22:44:39.136961+0000","last_active":"2024-04-25T22:44:59.103398+0000","last_peered":"2024-04-25T22:44:59.103398+0000","last_clean":"2024-04-25T22:44:59.103398+0000","last_became_active":"2024-04-25T22:44:39.136090+0000","last_became_peered":"2024-04-25T22:44:39.136090+0000","last_unstale":"2024-04-25T22:44:59.103398+0000","last_undegraded":"2024-04-25T22:44:59.103398+0000","last_fullsized":"2024-04-25T22:44:59.103398+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:35.220314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"72'475","reported_seq":1154,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101544+0000","last_change":"2024-04-25T22:44:44.106484+0000","last_active":"2024-04-25T22:44:59.101544+0000","last_peered":"2024-04-25T22:44:59.101544+0000","last_clean":"2024-04-25T22:44:59.101544+0000","last_became_active":"2024-04-25T22:44:44.102061+0000","last_became_peered":"2024-04-25T22:44:44.102061+0000","last_unstale":"2024-04-25T22:44:59.101544+0000","last_undegraded":"2024-04-25T22:44:59.101544+0000","last_fullsized":"2024-04-25T22:44:59.101544+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:05.455255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":23011,"num_write":448,"num_write_kb":76439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"72'370","reported_seq":567,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392775+0000","last_change":"2024-04-25T22:44:56.420080+0000","last_active":"2024-04-25T22:44:59.392775+0000","last_peered":"2024-04-25T22:44:59.392775+0000","last_clean":"2024-04-25T22:44:59.392775+0000","last_became_active":"2024-04-25T22:44:56.414231+0000","last_became_peered":"2024-04-25T22:44:56.414231+0000","last_unstale":"2024-04-25T22:44:59.392775+0000","last_undegraded":"2024-04-25T22:44:59.392775+0000","last_fullsized":"2024-04-25T22:44:59.392775+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:22.002829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33211,"num_write":340,"num_write_kb":63312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"71'647","reported_seq":865,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102434+0000","last_change":"2024-04-25T22:44:30.396965+0000","last_active":"2024-04-25T22:44:59.102434+0000","last_peered":"2024-04-25T22:44:59.102434+0000","last_clean":"2024-04-25T22:44:59.102434+0000","last_became_active":"2024-04-25T22:44:30.396073+0000","last_became_peered":"2024-04-25T22:44:30.396073+0000","last_unstale":"2024-04-25T22:44:59.102434+0000","last_undegraded":"2024-04-25T22:44:59.102434+0000","last_fullsized":"2024-04-25T22:44:59.102434+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"72'415","reported_seq":636,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102938+0000","last_change":"2024-04-25T22:44:39.150290+0000","last_active":"2024-04-25T22:44:59.102938+0000","last_peered":"2024-04-25T22:44:59.102938+0000","last_clean":"2024-04-25T22:44:59.102938+0000","last_became_active":"2024-04-25T22:44:39.146949+0000","last_became_peered":"2024-04-25T22:44:39.146949+0000","last_unstale":"2024-04-25T22:44:59.102938+0000","last_undegraded":"2024-04-25T22:44:59.102938+0000","last_fullsized":"2024-04-25T22:44:59.102938+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:11.804350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19493,"num_write":386,"num_write_kb":64692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'207","reported_seq":362,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101542+0000","last_change":"2024-04-25T22:44:39.141125+0000","last_active":"2024-04-25T22:44:59.101542+0000","last_peered":"2024-04-25T22:44:59.101542+0000","last_clean":"2024-04-25T22:44:59.101542+0000","last_became_active":"2024-04-25T22:44:39.138371+0000","last_became_peered":"2024-04-25T22:44:39.138371+0000","last_unstale":"2024-04-25T22:44:59.101542+0000","last_undegraded":"2024-04-25T22:44:59.101542+0000","last_fullsized":"2024-04-25T22:44:59.101542+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:14.147026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"72'395","reported_seq":562,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392340+0000","last_change":"2024-04-25T22:44:55.406524+0000","last_active":"2024-04-25T22:44:59.392340+0000","last_peered":"2024-04-25T22:44:59.392340+0000","last_clean":"2024-04-25T22:44:59.392340+0000","last_became_active":"2024-04-25T22:44:55.396613+0000","last_became_peered":"2024-04-25T22:44:55.396613+0000","last_unstale":"2024-04-25T22:44:59.392340+0000","last_undegraded":"2024-04-25T22:44:59.392340+0000","last_fullsized":"2024-04-25T22:44:59.392340+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:41.515369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9576,"num_write":348,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'194","reported_seq":363,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391176+0000","last_change":"2024-04-25T22:44:41.422369+0000","last_active":"2024-04-25T22:44:59.391176+0000","last_peered":"2024-04-25T22:44:59.391176+0000","last_clean":"2024-04-25T22:44:59.391176+0000","last_became_active":"2024-04-25T22:44:41.420491+0000","last_became_peered":"2024-04-25T22:44:41.420491+0000","last_unstale":"2024-04-25T22:44:59.391176+0000","last_undegraded":"2024-04-25T22:44:59.391176+0000","last_fullsized":"2024-04-25T22:44:59.391176+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:35.081225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360511,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":12143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12360511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"72'398","reported_seq":593,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391353+0000","last_change":"2024-04-25T22:44:52.381363+0000","last_active":"2024-04-25T22:44:59.391353+0000","last_peered":"2024-04-25T22:44:59.391353+0000","last_clean":"2024-04-25T22:44:59.391353+0000","last_became_active":"2024-04-25T22:44:52.375632+0000","last_became_peered":"2024-04-25T22:44:52.375632+0000","last_unstale":"2024-04-25T22:44:59.391353+0000","last_undegraded":"2024-04-25T22:44:59.391353+0000","last_fullsized":"2024-04-25T22:44:59.391353+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:38:28.441621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31284,"num_write":371,"num_write_kb":80144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"71'51","reported_seq":94,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390518+0000","last_change":"2024-04-25T22:44:41.415722+0000","last_active":"2024-04-25T22:44:59.390518+0000","last_peered":"2024-04-25T22:44:59.390518+0000","last_clean":"2024-04-25T22:44:59.390518+0000","last_became_active":"2024-04-25T22:44:41.414774+0000","last_became_peered":"2024-04-25T22:44:41.414774+0000","last_unstale":"2024-04-25T22:44:59.390518+0000","last_undegraded":"2024-04-25T22:44:59.390518+0000","last_fullsized":"2024-04-25T22:44:59.390518+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:20.553373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"72'383","reported_seq":635,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107059+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:44:59.107059+0000","last_peered":"2024-04-25T22:44:59.107059+0000","last_clean":"2024-04-25T22:44:59.107059+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:44:59.107059+0000","last_undegraded":"2024-04-25T22:44:59.107059+0000","last_fullsized":"2024-04-25T22:44:59.107059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29308,"num_write":358,"num_write_kb":66975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"71'177","reported_seq":379,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108565+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:44:59.108565+0000","last_peered":"2024-04-25T22:44:59.108565+0000","last_clean":"2024-04-25T22:44:59.108565+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:44:59.108565+0000","last_undegraded":"2024-04-25T22:44:59.108565+0000","last_fullsized":"2024-04-25T22:44:59.108565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"72'387","reported_seq":600,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107381+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:44:59.107381+0000","last_peered":"2024-04-25T22:44:59.107381+0000","last_clean":"2024-04-25T22:44:59.107381+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:44:59.107381+0000","last_undegraded":"2024-04-25T22:44:59.107381+0000","last_fullsized":"2024-04-25T22:44:59.107381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3883,"num_write":348,"num_write_kb":34122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'209","reported_seq":413,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391358+0000","last_change":"2024-04-25T22:44:41.419972+0000","last_active":"2024-04-25T22:44:59.391358+0000","last_peered":"2024-04-25T22:44:59.391358+0000","last_clean":"2024-04-25T22:44:59.391358+0000","last_became_active":"2024-04-25T22:44:41.418106+0000","last_became_peered":"2024-04-25T22:44:41.418106+0000","last_unstale":"2024-04-25T22:44:59.391358+0000","last_undegraded":"2024-04-25T22:44:59.391358+0000","last_fullsized":"2024-04-25T22:44:59.391358+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:07.628155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":12363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"72'419","reported_seq":607,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390493+0000","last_change":"2024-04-25T22:44:41.434376+0000","last_active":"2024-04-25T22:44:59.390493+0000","last_peered":"2024-04-25T22:44:59.390493+0000","last_clean":"2024-04-25T22:44:59.390493+0000","last_became_active":"2024-04-25T22:44:41.420505+0000","last_became_peered":"2024-04-25T22:44:41.420505+0000","last_unstale":"2024-04-25T22:44:59.390493+0000","last_undegraded":"2024-04-25T22:44:59.390493+0000","last_fullsized":"2024-04-25T22:44:59.390493+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:04.414563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":13327,"num_write":388,"num_write_kb":55674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"71'131","reported_seq":349,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103634+0000","last_change":"2024-04-25T22:44:29.398880+0000","last_active":"2024-04-25T22:44:59.103634+0000","last_peered":"2024-04-25T22:44:59.103634+0000","last_clean":"2024-04-25T22:44:59.103634+0000","last_became_active":"2024-04-25T22:44:29.397905+0000","last_became_peered":"2024-04-25T22:44:29.397905+0000","last_unstale":"2024-04-25T22:44:59.103634+0000","last_undegraded":"2024-04-25T22:44:59.103634+0000","last_fullsized":"2024-04-25T22:44:59.103634+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:44.236330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"72'449","reported_seq":683,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107034+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:44:59.107034+0000","last_peered":"2024-04-25T22:44:59.107034+0000","last_clean":"2024-04-25T22:44:59.107034+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:44:59.107034+0000","last_undegraded":"2024-04-25T22:44:59.107034+0000","last_fullsized":"2024-04-25T22:44:59.107034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14222,"num_write":424,"num_write_kb":79796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"71'57","reported_seq":213,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103091+0000","last_change":"2024-04-25T22:44:39.137232+0000","last_active":"2024-04-25T22:44:59.103091+0000","last_peered":"2024-04-25T22:44:59.103091+0000","last_clean":"2024-04-25T22:44:59.103091+0000","last_became_active":"2024-04-25T22:44:39.136283+0000","last_became_peered":"2024-04-25T22:44:39.136283+0000","last_unstale":"2024-04-25T22:44:59.103091+0000","last_undegraded":"2024-04-25T22:44:59.103091+0000","last_fullsized":"2024-04-25T22:44:59.103091+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:32.428982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2461,"num_read_kb":1248646,"num_write":24434,"num_write_kb":4137258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7447,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26539,"ondisk_log_size":26539,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127071275,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":4473,"num_write_kb":127409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254210048,"data_stored":254142550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},"log_size":6216,"ondisk_log_size":6216,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738434,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165344,"kb_used_data":80080,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94206496,"statfs":{"total":96636764160,"available":96467451904,"internally_reserved":0,"allocated":82001920,"data_stored":81417710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":79,"seq":339302416393,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141396,"kb_used_data":83332,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94230444,"statfs":{"total":96636764160,"available":96491974656,"internally_reserved":0,"allocated":85331968,"data_stored":84735273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6003,"internal_metadata":59435149},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738434,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174352,"kb_used_data":89088,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94197488,"statfs":{"total":96636764160,"available":96458227712,"internally_reserved":0,"allocated":91226112,"data_stored":90619941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89575424,"data_stored":89544940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83689472,"data_stored":83664533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80945152,"data_stored":80933077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:45:04.944 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T22:45:04.945 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:45:05.274 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:45:05.276 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:45:05.294 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":263,"stamp":"2024-04-25T22:45:05.244472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127661643,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2659,"num_read_kb":1250233,"num_write":29110,"num_write_kb":4268127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7469,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32912,"ondisk_log_size":32912,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":481104,"kb_used_data":252508,"kb_used_omap":8,"kb_used_meta":228535,"kb_avail":282634416,"statfs":{"total":289910292480,"available":289417641984,"internally_reserved":0,"allocated":258568192,"data_stored":256777185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9193,"internal_metadata":234019863},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1061,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1061,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003144"},"pg_stats":[{"pgid":"4.3f","version":"72'404","reported_seq":559,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.393147+0000","last_change":"2024-04-25T22:44:57.382564+0000","last_active":"2024-04-25T22:44:59.393147+0000","last_peered":"2024-04-25T22:44:59.393147+0000","last_clean":"2024-04-25T22:44:59.393147+0000","last_became_active":"2024-04-25T22:44:57.376098+0000","last_became_peered":"2024-04-25T22:44:57.376098+0000","last_unstale":"2024-04-25T22:44:59.393147+0000","last_undegraded":"2024-04-25T22:44:59.393147+0000","last_fullsized":"2024-04-25T22:44:59.393147+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:31:49.789706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19772,"num_write":366,"num_write_kb":46873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"72'420","reported_seq":622,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392815+0000","last_change":"2024-04-25T22:44:41.434387+0000","last_active":"2024-04-25T22:44:59.392815+0000","last_peered":"2024-04-25T22:44:59.392815+0000","last_clean":"2024-04-25T22:44:59.392815+0000","last_became_active":"2024-04-25T22:44:41.418792+0000","last_became_peered":"2024-04-25T22:44:41.418792+0000","last_unstale":"2024-04-25T22:44:59.392815+0000","last_undegraded":"2024-04-25T22:44:59.392815+0000","last_fullsized":"2024-04-25T22:44:59.392815+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:43.196115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24515,"num_write":386,"num_write_kb":55688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"72'377","reported_seq":952,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107392+0000","last_change":"2024-04-25T22:44:42.096911+0000","last_active":"2024-04-25T22:44:59.107392+0000","last_peered":"2024-04-25T22:44:59.107392+0000","last_clean":"2024-04-25T22:44:59.107392+0000","last_became_active":"2024-04-25T22:44:42.093941+0000","last_became_peered":"2024-04-25T22:44:42.093941+0000","last_unstale":"2024-04-25T22:44:59.107392+0000","last_undegraded":"2024-04-25T22:44:59.107392+0000","last_fullsized":"2024-04-25T22:44:59.107392+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11135,"num_write":346,"num_write_kb":38950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"72'366","reported_seq":573,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107137+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:44:59.107137+0000","last_peered":"2024-04-25T22:44:59.107137+0000","last_clean":"2024-04-25T22:44:59.107137+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:44:59.107137+0000","last_undegraded":"2024-04-25T22:44:59.107137+0000","last_fullsized":"2024-04-25T22:44:59.107137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":326,"num_write_kb":34079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"72'455","reported_seq":635,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390846+0000","last_change":"2024-04-25T22:44:50.391674+0000","last_active":"2024-04-25T22:44:59.390846+0000","last_peered":"2024-04-25T22:44:59.390846+0000","last_clean":"2024-04-25T22:44:59.390846+0000","last_became_active":"2024-04-25T22:44:50.384804+0000","last_became_peered":"2024-04-25T22:44:50.384804+0000","last_unstale":"2024-04-25T22:44:59.390846+0000","last_undegraded":"2024-04-25T22:44:59.390846+0000","last_fullsized":"2024-04-25T22:44:59.390846+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:22:54.239989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33897,"num_write":426,"num_write_kb":100721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"72'401","reported_seq":635,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106493+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:44:59.106493+0000","last_peered":"2024-04-25T22:44:59.106493+0000","last_clean":"2024-04-25T22:44:59.106493+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:44:59.106493+0000","last_undegraded":"2024-04-25T22:44:59.106493+0000","last_fullsized":"2024-04-25T22:44:59.106493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15258,"num_write":369,"num_write_kb":53298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"72'452","reported_seq":718,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106260+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:44:59.106260+0000","last_peered":"2024-04-25T22:44:59.106260+0000","last_clean":"2024-04-25T22:44:59.106260+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:44:59.106260+0000","last_undegraded":"2024-04-25T22:44:59.106260+0000","last_fullsized":"2024-04-25T22:44:59.106260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34010,"num_write":428,"num_write_kb":157752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"72'401","reported_seq":640,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.105970+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:44:59.105970+0000","last_peered":"2024-04-25T22:44:59.105970+0000","last_clean":"2024-04-25T22:44:59.105970+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:44:59.105970+0000","last_undegraded":"2024-04-25T22:44:59.105970+0000","last_fullsized":"2024-04-25T22:44:59.105970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19917,"num_write":359,"num_write_kb":109382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"72'394","reported_seq":980,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101912+0000","last_change":"2024-04-25T22:44:48.092689+0000","last_active":"2024-04-25T22:44:59.101912+0000","last_peered":"2024-04-25T22:44:59.101912+0000","last_clean":"2024-04-25T22:44:59.101912+0000","last_became_active":"2024-04-25T22:44:48.089795+0000","last_became_peered":"2024-04-25T22:44:48.089795+0000","last_unstale":"2024-04-25T22:44:59.101912+0000","last_undegraded":"2024-04-25T22:44:59.101912+0000","last_fullsized":"2024-04-25T22:44:59.101912+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:32:33.072950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9569,"num_write":360,"num_write_kb":25560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"72'382","reported_seq":566,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392804+0000","last_change":"2024-04-25T22:44:41.433644+0000","last_active":"2024-04-25T22:44:59.392804+0000","last_peered":"2024-04-25T22:44:59.392804+0000","last_clean":"2024-04-25T22:44:59.392804+0000","last_became_active":"2024-04-25T22:44:41.421234+0000","last_became_peered":"2024-04-25T22:44:41.421234+0000","last_unstale":"2024-04-25T22:44:59.392804+0000","last_undegraded":"2024-04-25T22:44:59.392804+0000","last_fullsized":"2024-04-25T22:44:59.392804+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:24.217391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17192,"num_write":338,"num_write_kb":38688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"72'369","reported_seq":592,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107541+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:44:59.107541+0000","last_peered":"2024-04-25T22:44:59.107541+0000","last_clean":"2024-04-25T22:44:59.107541+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:44:59.107541+0000","last_undegraded":"2024-04-25T22:44:59.107541+0000","last_fullsized":"2024-04-25T22:44:59.107541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7385,"num_write":349,"num_write_kb":58842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"72'338","reported_seq":522,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391810+0000","last_change":"2024-04-25T22:44:49.384005+0000","last_active":"2024-04-25T22:44:59.391810+0000","last_peered":"2024-04-25T22:44:59.391810+0000","last_clean":"2024-04-25T22:44:59.391810+0000","last_became_active":"2024-04-25T22:44:49.378325+0000","last_became_peered":"2024-04-25T22:44:49.378325+0000","last_unstale":"2024-04-25T22:44:59.391810+0000","last_undegraded":"2024-04-25T22:44:59.391810+0000","last_fullsized":"2024-04-25T22:44:59.391810+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:18.849786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13619,"num_write":312,"num_write_kb":21391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"72'411","reported_seq":605,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391345+0000","last_change":"2024-04-25T22:44:41.432463+0000","last_active":"2024-04-25T22:44:59.391345+0000","last_peered":"2024-04-25T22:44:59.391345+0000","last_clean":"2024-04-25T22:44:59.391345+0000","last_became_active":"2024-04-25T22:44:41.421096+0000","last_became_peered":"2024-04-25T22:44:41.421096+0000","last_unstale":"2024-04-25T22:44:59.391345+0000","last_undegraded":"2024-04-25T22:44:59.391345+0000","last_fullsized":"2024-04-25T22:44:59.391345+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:46.942677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12998,"num_write":375,"num_write_kb":79661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"72'452","reported_seq":1051,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107059+0000","last_change":"2024-04-25T22:44:40.130299+0000","last_active":"2024-04-25T22:44:59.107059+0000","last_peered":"2024-04-25T22:44:59.107059+0000","last_clean":"2024-04-25T22:44:59.107059+0000","last_became_active":"2024-04-25T22:44:40.127307+0000","last_became_peered":"2024-04-25T22:44:40.127307+0000","last_unstale":"2024-04-25T22:44:59.107059+0000","last_undegraded":"2024-04-25T22:44:59.107059+0000","last_fullsized":"2024-04-25T22:44:59.107059+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:16.746830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":854,"num_write":419,"num_write_kb":88217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"72'428","reported_seq":1031,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106380+0000","last_change":"2024-04-25T22:44:35.108361+0000","last_active":"2024-04-25T22:44:59.106380+0000","last_peered":"2024-04-25T22:44:59.106380+0000","last_clean":"2024-04-25T22:44:59.106380+0000","last_became_active":"2024-04-25T22:44:35.103208+0000","last_became_peered":"2024-04-25T22:44:35.103208+0000","last_unstale":"2024-04-25T22:44:59.106380+0000","last_undegraded":"2024-04-25T22:44:59.106380+0000","last_fullsized":"2024-04-25T22:44:59.106380+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:22.046332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21291,"num_write":389,"num_write_kb":68562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"72'401","reported_seq":615,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.105974+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:44:59.105974+0000","last_peered":"2024-04-25T22:44:59.105974+0000","last_clean":"2024-04-25T22:44:59.105974+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:44:59.105974+0000","last_undegraded":"2024-04-25T22:44:59.105974+0000","last_fullsized":"2024-04-25T22:44:59.105974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8276,"num_write":369,"num_write_kb":17867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"72'398","reported_seq":971,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103506+0000","last_change":"2024-04-25T22:44:49.097340+0000","last_active":"2024-04-25T22:44:59.103506+0000","last_peered":"2024-04-25T22:44:59.103506+0000","last_clean":"2024-04-25T22:44:59.103506+0000","last_became_active":"2024-04-25T22:44:49.094478+0000","last_became_peered":"2024-04-25T22:44:49.094478+0000","last_unstale":"2024-04-25T22:44:59.103506+0000","last_undegraded":"2024-04-25T22:44:59.103506+0000","last_fullsized":"2024-04-25T22:44:59.103506+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:33.421713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5883,"num_write":362,"num_write_kb":38188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"72'407","reported_seq":543,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.401367+0000","last_change":"2024-04-25T22:44:59.401367+0000","last_active":"2024-04-25T22:44:59.401367+0000","last_peered":"2024-04-25T22:44:59.401367+0000","last_clean":"2024-04-25T22:44:59.401367+0000","last_became_active":"2024-04-25T22:44:59.396404+0000","last_became_peered":"2024-04-25T22:44:59.396404+0000","last_unstale":"2024-04-25T22:44:59.401367+0000","last_undegraded":"2024-04-25T22:44:59.401367+0000","last_fullsized":"2024-04-25T22:44:59.401367+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:15:41.602118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13073,"num_write":372,"num_write_kb":59323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"72'441","reported_seq":1059,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102684+0000","last_change":"2024-04-25T22:44:41.148409+0000","last_active":"2024-04-25T22:44:59.102684+0000","last_peered":"2024-04-25T22:44:59.102684+0000","last_clean":"2024-04-25T22:44:59.102684+0000","last_became_active":"2024-04-25T22:44:41.143302+0000","last_became_peered":"2024-04-25T22:44:41.143302+0000","last_unstale":"2024-04-25T22:44:59.102684+0000","last_undegraded":"2024-04-25T22:44:59.102684+0000","last_fullsized":"2024-04-25T22:44:59.102684+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:46.289713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37611,"num_write":403,"num_write_kb":116618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"72'438","reported_seq":664,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107576+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:44:59.107576+0000","last_peered":"2024-04-25T22:44:59.107576+0000","last_clean":"2024-04-25T22:44:59.107576+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:44:59.107576+0000","last_undegraded":"2024-04-25T22:44:59.107576+0000","last_fullsized":"2024-04-25T22:44:59.107576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12393,"num_write":408,"num_write_kb":99933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"72'407","reported_seq":622,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108619+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:44:59.108619+0000","last_peered":"2024-04-25T22:44:59.108619+0000","last_clean":"2024-04-25T22:44:59.108619+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:44:59.108619+0000","last_undegraded":"2024-04-25T22:44:59.108619+0000","last_fullsized":"2024-04-25T22:44:59.108619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8932,"num_write":382,"num_write_kb":59684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"72'463","reported_seq":692,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391725+0000","last_change":"2024-04-25T22:44:47.376009+0000","last_active":"2024-04-25T22:44:59.391725+0000","last_peered":"2024-04-25T22:44:59.391725+0000","last_clean":"2024-04-25T22:44:59.391725+0000","last_became_active":"2024-04-25T22:44:47.369995+0000","last_became_peered":"2024-04-25T22:44:47.369995+0000","last_unstale":"2024-04-25T22:44:59.391725+0000","last_undegraded":"2024-04-25T22:44:59.391725+0000","last_fullsized":"2024-04-25T22:44:59.391725+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:04.129559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27589,"num_write":428,"num_write_kb":76861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"72'425","reported_seq":694,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.100741+0000","last_change":"2024-04-25T22:44:39.132230+0000","last_active":"2024-04-25T22:44:59.100741+0000","last_peered":"2024-04-25T22:44:59.100741+0000","last_clean":"2024-04-25T22:44:59.100741+0000","last_became_active":"2024-04-25T22:44:39.118635+0000","last_became_peered":"2024-04-25T22:44:39.118635+0000","last_unstale":"2024-04-25T22:44:59.100741+0000","last_undegraded":"2024-04-25T22:44:59.100741+0000","last_fullsized":"2024-04-25T22:44:59.100741+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:15.096836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":46424,"num_write":390,"num_write_kb":96359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"72'445","reported_seq":619,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390506+0000","last_change":"2024-04-25T22:44:54.388681+0000","last_active":"2024-04-25T22:44:59.390506+0000","last_peered":"2024-04-25T22:44:59.390506+0000","last_clean":"2024-04-25T22:44:59.390506+0000","last_became_active":"2024-04-25T22:44:54.382124+0000","last_became_peered":"2024-04-25T22:44:54.382124+0000","last_unstale":"2024-04-25T22:44:59.390506+0000","last_undegraded":"2024-04-25T22:44:59.390506+0000","last_fullsized":"2024-04-25T22:44:59.390506+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:49.633770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32317,"num_write":419,"num_write_kb":76071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"72'424","reported_seq":590,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392521+0000","last_change":"2024-04-25T22:44:51.391125+0000","last_active":"2024-04-25T22:44:59.392521+0000","last_peered":"2024-04-25T22:44:59.392521+0000","last_clean":"2024-04-25T22:44:59.392521+0000","last_became_active":"2024-04-25T22:44:51.383461+0000","last_became_peered":"2024-04-25T22:44:51.383461+0000","last_unstale":"2024-04-25T22:44:59.392521+0000","last_undegraded":"2024-04-25T22:44:59.392521+0000","last_fullsized":"2024-04-25T22:44:59.392521+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:33.717342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8396,"num_write":399,"num_write_kb":50416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"72'499","reported_seq":710,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102656+0000","last_change":"2024-04-25T22:44:39.149280+0000","last_active":"2024-04-25T22:44:59.102656+0000","last_peered":"2024-04-25T22:44:59.102656+0000","last_clean":"2024-04-25T22:44:59.102656+0000","last_became_active":"2024-04-25T22:44:39.143391+0000","last_became_peered":"2024-04-25T22:44:39.143391+0000","last_unstale":"2024-04-25T22:44:59.102656+0000","last_undegraded":"2024-04-25T22:44:59.102656+0000","last_fullsized":"2024-04-25T22:44:59.102656+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:54:10.301144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10227,"num_write":453,"num_write_kb":96585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'430","reported_seq":1082,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107732+0000","last_change":"2024-04-25T22:44:39.113437+0000","last_active":"2024-04-25T22:44:59.107732+0000","last_peered":"2024-04-25T22:44:59.107732+0000","last_clean":"2024-04-25T22:44:59.107732+0000","last_became_active":"2024-04-25T22:44:39.109771+0000","last_became_peered":"2024-04-25T22:44:39.109771+0000","last_unstale":"2024-04-25T22:44:59.107732+0000","last_undegraded":"2024-04-25T22:44:59.107732+0000","last_fullsized":"2024-04-25T22:44:59.107732+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:40:46.739897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":32116,"num_write":409,"num_write_kb":89217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"72'393","reported_seq":656,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391736+0000","last_change":"2024-04-25T22:44:41.425947+0000","last_active":"2024-04-25T22:44:59.391736+0000","last_peered":"2024-04-25T22:44:59.391736+0000","last_clean":"2024-04-25T22:44:59.391736+0000","last_became_active":"2024-04-25T22:44:41.413570+0000","last_became_peered":"2024-04-25T22:44:41.413570+0000","last_unstale":"2024-04-25T22:44:59.391736+0000","last_undegraded":"2024-04-25T22:44:59.391736+0000","last_fullsized":"2024-04-25T22:44:59.391736+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:39:00.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":28076,"num_write":364,"num_write_kb":47473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"72'399","reported_seq":993,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103262+0000","last_change":"2024-04-25T22:44:40.124745+0000","last_active":"2024-04-25T22:44:59.103262+0000","last_peered":"2024-04-25T22:44:59.103262+0000","last_clean":"2024-04-25T22:44:59.103262+0000","last_became_active":"2024-04-25T22:44:40.121838+0000","last_became_peered":"2024-04-25T22:44:40.121838+0000","last_unstale":"2024-04-25T22:44:59.103262+0000","last_undegraded":"2024-04-25T22:44:59.103262+0000","last_fullsized":"2024-04-25T22:44:59.103262+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:28.299317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14005,"num_write":367,"num_write_kb":58883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"72'484","reported_seq":683,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391410+0000","last_change":"2024-04-25T22:44:54.392451+0000","last_active":"2024-04-25T22:44:59.391410+0000","last_peered":"2024-04-25T22:44:59.391410+0000","last_clean":"2024-04-25T22:44:59.391410+0000","last_became_active":"2024-04-25T22:44:54.383808+0000","last_became_peered":"2024-04-25T22:44:54.383808+0000","last_unstale":"2024-04-25T22:44:59.391410+0000","last_undegraded":"2024-04-25T22:44:59.391410+0000","last_fullsized":"2024-04-25T22:44:59.391410+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:06.630318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23352,"num_write":446,"num_write_kb":100094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'455","reported_seq":1136,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101023+0000","last_change":"2024-04-25T22:44:33.087211+0000","last_active":"2024-04-25T22:44:59.101023+0000","last_peered":"2024-04-25T22:44:59.101023+0000","last_clean":"2024-04-25T22:44:59.101023+0000","last_became_active":"2024-04-25T22:44:33.084127+0000","last_became_peered":"2024-04-25T22:44:33.084127+0000","last_unstale":"2024-04-25T22:44:59.101023+0000","last_undegraded":"2024-04-25T22:44:59.101023+0000","last_fullsized":"2024-04-25T22:44:59.101023+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38440,"num_write":423,"num_write_kb":71855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"72'434","reported_seq":668,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106552+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:44:59.106552+0000","last_peered":"2024-04-25T22:44:59.106552+0000","last_clean":"2024-04-25T22:44:59.106552+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:44:59.106552+0000","last_undegraded":"2024-04-25T22:44:59.106552+0000","last_fullsized":"2024-04-25T22:44:59.106552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18701,"num_write":402,"num_write_kb":27564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"72'379","reported_seq":526,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391067+0000","last_change":"2024-04-25T22:44:53.383623+0000","last_active":"2024-04-25T22:44:59.391067+0000","last_peered":"2024-04-25T22:44:59.391067+0000","last_clean":"2024-04-25T22:44:59.391067+0000","last_became_active":"2024-04-25T22:44:53.378402+0000","last_became_peered":"2024-04-25T22:44:53.378402+0000","last_unstale":"2024-04-25T22:44:59.391067+0000","last_undegraded":"2024-04-25T22:44:59.391067+0000","last_fullsized":"2024-04-25T22:44:59.391067+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:52:18.111269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18623,"num_write":344,"num_write_kb":50888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"71'528","reported_seq":731,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109262+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:44:59.109262+0000","last_peered":"2024-04-25T22:44:59.109262+0000","last_clean":"2024-04-25T22:44:59.109262+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:44:59.109262+0000","last_undegraded":"2024-04-25T22:44:59.109262+0000","last_fullsized":"2024-04-25T22:44:59.109262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"72'383","reported_seq":503,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392060+0000","last_change":"2024-04-25T22:44:58.385931+0000","last_active":"2024-04-25T22:44:59.392060+0000","last_peered":"2024-04-25T22:44:59.392060+0000","last_clean":"2024-04-25T22:44:59.392060+0000","last_became_active":"2024-04-25T22:44:58.380203+0000","last_became_peered":"2024-04-25T22:44:58.380203+0000","last_unstale":"2024-04-25T22:44:59.392060+0000","last_undegraded":"2024-04-25T22:44:59.392060+0000","last_fullsized":"2024-04-25T22:44:59.392060+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:12.874377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8364,"num_write":351,"num_write_kb":30625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"71'45","reported_seq":201,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102522+0000","last_change":"2024-04-25T22:44:39.117622+0000","last_active":"2024-04-25T22:44:59.102522+0000","last_peered":"2024-04-25T22:44:59.102522+0000","last_clean":"2024-04-25T22:44:59.102522+0000","last_became_active":"2024-04-25T22:44:39.115669+0000","last_became_peered":"2024-04-25T22:44:39.115669+0000","last_unstale":"2024-04-25T22:44:59.102522+0000","last_undegraded":"2024-04-25T22:44:59.102522+0000","last_fullsized":"2024-04-25T22:44:59.102522+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:21.793820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"72'429","reported_seq":571,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392387+0000","last_change":"2024-04-25T22:44:58.388677+0000","last_active":"2024-04-25T22:44:59.392387+0000","last_peered":"2024-04-25T22:44:59.392387+0000","last_clean":"2024-04-25T22:44:59.392387+0000","last_became_active":"2024-04-25T22:44:58.382521+0000","last_became_peered":"2024-04-25T22:44:58.382521+0000","last_unstale":"2024-04-25T22:44:59.392387+0000","last_undegraded":"2024-04-25T22:44:59.392387+0000","last_fullsized":"2024-04-25T22:44:59.392387+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:26.999533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16584,"num_write":393,"num_write_kb":63712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'61","reported_seq":89,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391526+0000","last_change":"2024-04-25T22:44:41.416554+0000","last_active":"2024-04-25T22:44:59.391526+0000","last_peered":"2024-04-25T22:44:59.391526+0000","last_clean":"2024-04-25T22:44:59.391526+0000","last_became_active":"2024-04-25T22:44:41.413853+0000","last_became_peered":"2024-04-25T22:44:41.413853+0000","last_unstale":"2024-04-25T22:44:59.391526+0000","last_undegraded":"2024-04-25T22:44:59.391526+0000","last_fullsized":"2024-04-25T22:44:59.391526+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:50.701110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"72'404","reported_seq":624,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102212+0000","last_change":"2024-04-25T22:44:39.128428+0000","last_active":"2024-04-25T22:44:59.102212+0000","last_peered":"2024-04-25T22:44:59.102212+0000","last_clean":"2024-04-25T22:44:59.102212+0000","last_became_active":"2024-04-25T22:44:39.116562+0000","last_became_peered":"2024-04-25T22:44:39.116562+0000","last_unstale":"2024-04-25T22:44:59.102212+0000","last_undegraded":"2024-04-25T22:44:59.102212+0000","last_fullsized":"2024-04-25T22:44:59.102212+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:09.750726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18745,"num_write":376,"num_write_kb":96145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'71","reported_seq":282,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106763+0000","last_change":"2024-04-25T22:44:26.363329+0000","last_active":"2024-04-25T22:44:59.106763+0000","last_peered":"2024-04-25T22:44:59.106763+0000","last_clean":"2024-04-25T22:44:59.106763+0000","last_became_active":"2024-04-25T22:44:26.362499+0000","last_became_peered":"2024-04-25T22:44:26.362499+0000","last_unstale":"2024-04-25T22:44:59.106763+0000","last_undegraded":"2024-04-25T22:44:59.106763+0000","last_fullsized":"2024-04-25T22:44:59.106763+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'145","reported_seq":362,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109263+0000","last_change":"2024-04-25T22:44:29.400540+0000","last_active":"2024-04-25T22:44:59.109263+0000","last_peered":"2024-04-25T22:44:59.109263+0000","last_clean":"2024-04-25T22:44:59.109263+0000","last_became_active":"2024-04-25T22:44:29.399853+0000","last_became_peered":"2024-04-25T22:44:29.399853+0000","last_unstale":"2024-04-25T22:44:59.109263+0000","last_undegraded":"2024-04-25T22:44:59.109263+0000","last_fullsized":"2024-04-25T22:44:59.109263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"72'399","reported_seq":605,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390842+0000","last_change":"2024-04-25T22:44:46.398600+0000","last_active":"2024-04-25T22:44:59.390842+0000","last_peered":"2024-04-25T22:44:59.390842+0000","last_clean":"2024-04-25T22:44:59.390842+0000","last_became_active":"2024-04-25T22:44:46.392604+0000","last_became_peered":"2024-04-25T22:44:46.392604+0000","last_unstale":"2024-04-25T22:44:59.390842+0000","last_undegraded":"2024-04-25T22:44:59.390842+0000","last_fullsized":"2024-04-25T22:44:59.390842+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:15.771324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25159,"num_write":363,"num_write_kb":34063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"71'226","reported_seq":432,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392417+0000","last_change":"2024-04-25T22:44:41.417859+0000","last_active":"2024-04-25T22:44:59.392417+0000","last_peered":"2024-04-25T22:44:59.392417+0000","last_clean":"2024-04-25T22:44:59.392417+0000","last_became_active":"2024-04-25T22:44:41.416542+0000","last_became_peered":"2024-04-25T22:44:41.416542+0000","last_unstale":"2024-04-25T22:44:59.392417+0000","last_undegraded":"2024-04-25T22:44:59.392417+0000","last_fullsized":"2024-04-25T22:44:59.392417+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:27.884903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"72'431","reported_seq":578,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390134+0000","last_change":"2024-04-25T22:44:56.419453+0000","last_active":"2024-04-25T22:44:59.390134+0000","last_peered":"2024-04-25T22:44:59.390134+0000","last_clean":"2024-04-25T22:44:59.390134+0000","last_became_active":"2024-04-25T22:44:56.412151+0000","last_became_peered":"2024-04-25T22:44:56.412151+0000","last_unstale":"2024-04-25T22:44:59.390134+0000","last_undegraded":"2024-04-25T22:44:59.390134+0000","last_fullsized":"2024-04-25T22:44:59.390134+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:07:27.220853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14688,"num_write":405,"num_write_kb":38957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"71'382","reported_seq":599,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108993+0000","last_change":"2024-04-25T22:44:30.401893+0000","last_active":"2024-04-25T22:44:59.108993+0000","last_peered":"2024-04-25T22:44:59.108993+0000","last_clean":"2024-04-25T22:44:59.108993+0000","last_became_active":"2024-04-25T22:44:30.401021+0000","last_became_peered":"2024-04-25T22:44:30.401021+0000","last_unstale":"2024-04-25T22:44:59.108993+0000","last_undegraded":"2024-04-25T22:44:59.108993+0000","last_fullsized":"2024-04-25T22:44:59.108993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:38.452482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'453","reported_seq":685,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107186+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:44:59.107186+0000","last_peered":"2024-04-25T22:44:59.107186+0000","last_clean":"2024-04-25T22:44:59.107186+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:44:59.107186+0000","last_undegraded":"2024-04-25T22:44:59.107186+0000","last_fullsized":"2024-04-25T22:44:59.107186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18900,"num_write":418,"num_write_kb":117500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"71'64","reported_seq":267,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108997+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:44:59.108997+0000","last_peered":"2024-04-25T22:44:59.108997+0000","last_clean":"2024-04-25T22:44:59.108997+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:44:59.108997+0000","last_undegraded":"2024-04-25T22:44:59.108997+0000","last_fullsized":"2024-04-25T22:44:59.108997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'428","reported_seq":631,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103565+0000","last_change":"2024-04-25T22:44:39.129871+0000","last_active":"2024-04-25T22:44:59.103565+0000","last_peered":"2024-04-25T22:44:59.103565+0000","last_clean":"2024-04-25T22:44:59.103565+0000","last_became_active":"2024-04-25T22:44:39.121205+0000","last_became_peered":"2024-04-25T22:44:39.121205+0000","last_unstale":"2024-04-25T22:44:59.103565+0000","last_undegraded":"2024-04-25T22:44:59.103565+0000","last_fullsized":"2024-04-25T22:44:59.103565+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:48.521828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7477,"num_write":383,"num_write_kb":9617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'166","reported_seq":322,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103845+0000","last_change":"2024-04-25T22:44:39.133550+0000","last_active":"2024-04-25T22:44:59.103845+0000","last_peered":"2024-04-25T22:44:59.103845+0000","last_clean":"2024-04-25T22:44:59.103845+0000","last_became_active":"2024-04-25T22:44:39.131489+0000","last_became_peered":"2024-04-25T22:44:39.131489+0000","last_unstale":"2024-04-25T22:44:59.103845+0000","last_undegraded":"2024-04-25T22:44:59.103845+0000","last_fullsized":"2024-04-25T22:44:59.103845+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:32.980801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"72'446","reported_seq":696,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108117+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:44:59.108117+0000","last_peered":"2024-04-25T22:44:59.108117+0000","last_clean":"2024-04-25T22:44:59.108117+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:44:59.108117+0000","last_undegraded":"2024-04-25T22:44:59.108117+0000","last_fullsized":"2024-04-25T22:44:59.108117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27788,"num_write":414,"num_write_kb":47058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"71'113","reported_seq":316,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108347+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:44:59.108347+0000","last_peered":"2024-04-25T22:44:59.108347+0000","last_clean":"2024-04-25T22:44:59.108347+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:44:59.108347+0000","last_undegraded":"2024-04-25T22:44:59.108347+0000","last_fullsized":"2024-04-25T22:44:59.108347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"72'417","reported_seq":1019,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108706+0000","last_change":"2024-04-25T22:44:44.113498+0000","last_active":"2024-04-25T22:44:59.108706+0000","last_peered":"2024-04-25T22:44:59.108706+0000","last_clean":"2024-04-25T22:44:59.108706+0000","last_became_active":"2024-04-25T22:44:44.108084+0000","last_became_peered":"2024-04-25T22:44:44.108084+0000","last_unstale":"2024-04-25T22:44:59.108706+0000","last_undegraded":"2024-04-25T22:44:59.108706+0000","last_fullsized":"2024-04-25T22:44:59.108706+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16487,"num_write":388,"num_write_kb":75452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'59","reported_seq":89,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390108+0000","last_change":"2024-04-25T22:44:41.417821+0000","last_active":"2024-04-25T22:44:59.390108+0000","last_peered":"2024-04-25T22:44:59.390108+0000","last_clean":"2024-04-25T22:44:59.390108+0000","last_became_active":"2024-04-25T22:44:41.415769+0000","last_became_peered":"2024-04-25T22:44:41.415769+0000","last_unstale":"2024-04-25T22:44:59.390108+0000","last_undegraded":"2024-04-25T22:44:59.390108+0000","last_fullsized":"2024-04-25T22:44:59.390108+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.099475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'358","reported_seq":900,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107737+0000","last_change":"2024-04-25T22:44:34.101942+0000","last_active":"2024-04-25T22:44:59.107737+0000","last_peered":"2024-04-25T22:44:59.107737+0000","last_clean":"2024-04-25T22:44:59.107737+0000","last_became_active":"2024-04-25T22:44:34.099595+0000","last_became_peered":"2024-04-25T22:44:34.099595+0000","last_unstale":"2024-04-25T22:44:59.107737+0000","last_undegraded":"2024-04-25T22:44:59.107737+0000","last_fullsized":"2024-04-25T22:44:59.107737+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:06.523166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12259,"num_write":325,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'465","reported_seq":634,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390513+0000","last_change":"2024-04-25T22:44:41.425331+0000","last_active":"2024-04-25T22:44:59.390513+0000","last_peered":"2024-04-25T22:44:59.390513+0000","last_clean":"2024-04-25T22:44:59.390513+0000","last_became_active":"2024-04-25T22:44:41.423799+0000","last_became_peered":"2024-04-25T22:44:41.423799+0000","last_unstale":"2024-04-25T22:44:59.390513+0000","last_undegraded":"2024-04-25T22:44:59.390513+0000","last_fullsized":"2024-04-25T22:44:59.390513+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:04.324825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"72'386","reported_seq":955,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102556+0000","last_change":"2024-04-25T22:44:46.113269+0000","last_active":"2024-04-25T22:44:59.102556+0000","last_peered":"2024-04-25T22:44:59.102556+0000","last_clean":"2024-04-25T22:44:59.102556+0000","last_became_active":"2024-04-25T22:44:46.110394+0000","last_became_peered":"2024-04-25T22:44:46.110394+0000","last_unstale":"2024-04-25T22:44:59.102556+0000","last_undegraded":"2024-04-25T22:44:59.102556+0000","last_fullsized":"2024-04-25T22:44:59.102556+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9402,"num_write":352,"num_write_kb":50548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":418,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107397+0000","last_change":"2024-04-25T22:44:26.355770+0000","last_active":"2024-04-25T22:44:59.107397+0000","last_peered":"2024-04-25T22:44:59.107397+0000","last_clean":"2024-04-25T22:44:59.107397+0000","last_became_active":"2024-04-25T22:44:26.354730+0000","last_became_peered":"2024-04-25T22:44:26.354730+0000","last_unstale":"2024-04-25T22:44:59.107397+0000","last_undegraded":"2024-04-25T22:44:59.107397+0000","last_fullsized":"2024-04-25T22:44:59.107397+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:34.987031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":209,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109432+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:44:59.109432+0000","last_peered":"2024-04-25T22:44:59.109432+0000","last_clean":"2024-04-25T22:44:59.109432+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:44:59.109432+0000","last_undegraded":"2024-04-25T22:44:59.109432+0000","last_fullsized":"2024-04-25T22:44:59.109432+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"71'457","reported_seq":676,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103149+0000","last_change":"2024-04-25T22:44:29.399148+0000","last_active":"2024-04-25T22:44:59.103149+0000","last_peered":"2024-04-25T22:44:59.103149+0000","last_clean":"2024-04-25T22:44:59.103149+0000","last_became_active":"2024-04-25T22:44:29.397962+0000","last_became_peered":"2024-04-25T22:44:29.397962+0000","last_unstale":"2024-04-25T22:44:59.103149+0000","last_undegraded":"2024-04-25T22:44:59.103149+0000","last_fullsized":"2024-04-25T22:44:59.103149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:14.015619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"72'447","reported_seq":1111,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108782+0000","last_change":"2024-04-25T22:44:43.108262+0000","last_active":"2024-04-25T22:44:59.108782+0000","last_peered":"2024-04-25T22:44:59.108782+0000","last_clean":"2024-04-25T22:44:59.108782+0000","last_became_active":"2024-04-25T22:44:43.105231+0000","last_became_peered":"2024-04-25T22:44:43.105231+0000","last_unstale":"2024-04-25T22:44:59.108782+0000","last_undegraded":"2024-04-25T22:44:59.108782+0000","last_fullsized":"2024-04-25T22:44:59.108782+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:09.728618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45074,"num_write":414,"num_write_kb":120596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":216,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107098+0000","last_change":"2024-04-25T22:44:26.355238+0000","last_active":"2024-04-25T22:44:59.107098+0000","last_peered":"2024-04-25T22:44:59.107098+0000","last_clean":"2024-04-25T22:44:59.107098+0000","last_became_active":"2024-04-25T22:44:26.354482+0000","last_became_peered":"2024-04-25T22:44:26.354482+0000","last_unstale":"2024-04-25T22:44:59.107098+0000","last_undegraded":"2024-04-25T22:44:59.107098+0000","last_fullsized":"2024-04-25T22:44:59.107098+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.042514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'122","reported_seq":340,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101684+0000","last_change":"2024-04-25T22:44:39.141843+0000","last_active":"2024-04-25T22:44:59.101684+0000","last_peered":"2024-04-25T22:44:59.101684+0000","last_clean":"2024-04-25T22:44:59.101684+0000","last_became_active":"2024-04-25T22:44:39.139689+0000","last_became_peered":"2024-04-25T22:44:39.139689+0000","last_unstale":"2024-04-25T22:44:59.101684+0000","last_undegraded":"2024-04-25T22:44:59.101684+0000","last_fullsized":"2024-04-25T22:44:59.101684+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:18.614670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":62,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"72'449","reported_seq":652,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.393126+0000","last_change":"2024-04-25T22:44:41.439044+0000","last_active":"2024-04-25T22:44:59.393126+0000","last_peered":"2024-04-25T22:44:59.393126+0000","last_clean":"2024-04-25T22:44:59.393126+0000","last_became_active":"2024-04-25T22:44:41.432785+0000","last_became_peered":"2024-04-25T22:44:41.432785+0000","last_unstale":"2024-04-25T22:44:59.393126+0000","last_undegraded":"2024-04-25T22:44:59.393126+0000","last_fullsized":"2024-04-25T22:44:59.393126+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:57.171725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25191,"num_write":420,"num_write_kb":79855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101972+0000","last_change":"2024-04-25T22:44:26.363464+0000","last_active":"2024-04-25T22:44:59.101972+0000","last_peered":"2024-04-25T22:44:59.101972+0000","last_clean":"2024-04-25T22:44:59.101972+0000","last_became_active":"2024-04-25T22:44:26.362808+0000","last_became_peered":"2024-04-25T22:44:26.362808+0000","last_unstale":"2024-04-25T22:44:59.101972+0000","last_undegraded":"2024-04-25T22:44:59.101972+0000","last_fullsized":"2024-04-25T22:44:59.101972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:06.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'435","reported_seq":630,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.389941+0000","last_change":"2024-04-25T22:44:41.417191+0000","last_active":"2024-04-25T22:44:59.389941+0000","last_peered":"2024-04-25T22:44:59.389941+0000","last_clean":"2024-04-25T22:44:59.389941+0000","last_became_active":"2024-04-25T22:44:41.415592+0000","last_became_peered":"2024-04-25T22:44:41.415592+0000","last_unstale":"2024-04-25T22:44:59.389941+0000","last_undegraded":"2024-04-25T22:44:59.389941+0000","last_fullsized":"2024-04-25T22:44:59.389941+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:35.916512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"72'337","reported_seq":888,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103033+0000","last_change":"2024-04-25T22:44:45.113523+0000","last_active":"2024-04-25T22:44:59.103033+0000","last_peered":"2024-04-25T22:44:59.103033+0000","last_clean":"2024-04-25T22:44:59.103033+0000","last_became_active":"2024-04-25T22:44:45.111011+0000","last_became_peered":"2024-04-25T22:44:45.111011+0000","last_unstale":"2024-04-25T22:44:59.103033+0000","last_undegraded":"2024-04-25T22:44:59.103033+0000","last_fullsized":"2024-04-25T22:44:59.103033+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25242,"num_write":307,"num_write_kb":26250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":209,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108546+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:44:59.108546+0000","last_peered":"2024-04-25T22:44:59.108546+0000","last_clean":"2024-04-25T22:44:59.108546+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:44:59.108546+0000","last_undegraded":"2024-04-25T22:44:59.108546+0000","last_fullsized":"2024-04-25T22:44:59.108546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"71'61","reported_seq":264,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109291+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:44:59.109291+0000","last_peered":"2024-04-25T22:44:59.109291+0000","last_clean":"2024-04-25T22:44:59.109291+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:44:59.109291+0000","last_undegraded":"2024-04-25T22:44:59.109291+0000","last_fullsized":"2024-04-25T22:44:59.109291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'404","reported_seq":1016,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102941+0000","last_change":"2024-04-25T22:44:32.092728+0000","last_active":"2024-04-25T22:44:59.102941+0000","last_peered":"2024-04-25T22:44:59.102941+0000","last_clean":"2024-04-25T22:44:59.102941+0000","last_became_active":"2024-04-25T22:44:32.087528+0000","last_became_peered":"2024-04-25T22:44:32.087528+0000","last_unstale":"2024-04-25T22:44:59.102941+0000","last_undegraded":"2024-04-25T22:44:59.102941+0000","last_fullsized":"2024-04-25T22:44:59.102941+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:39.481467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":20287,"num_write":371,"num_write_kb":59919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'285","reported_seq":488,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109060+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:44:59.109060+0000","last_peered":"2024-04-25T22:44:59.109060+0000","last_clean":"2024-04-25T22:44:59.109060+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:44:59.109060+0000","last_undegraded":"2024-04-25T22:44:59.109060+0000","last_fullsized":"2024-04-25T22:44:59.109060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":217,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.104160+0000","last_change":"2024-04-25T22:44:26.364185+0000","last_active":"2024-04-25T22:44:59.104160+0000","last_peered":"2024-04-25T22:44:59.104160+0000","last_clean":"2024-04-25T22:44:59.104160+0000","last_became_active":"2024-04-25T22:44:26.363583+0000","last_became_peered":"2024-04-25T22:44:26.363583+0000","last_unstale":"2024-04-25T22:44:59.104160+0000","last_undegraded":"2024-04-25T22:44:59.104160+0000","last_fullsized":"2024-04-25T22:44:59.104160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:35:04.325449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"72'366","reported_seq":522,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391466+0000","last_change":"2024-04-25T22:44:52.381174+0000","last_active":"2024-04-25T22:44:59.391466+0000","last_peered":"2024-04-25T22:44:59.391466+0000","last_clean":"2024-04-25T22:44:59.391466+0000","last_became_active":"2024-04-25T22:44:52.375504+0000","last_became_peered":"2024-04-25T22:44:52.375504+0000","last_unstale":"2024-04-25T22:44:59.391466+0000","last_undegraded":"2024-04-25T22:44:59.391466+0000","last_fullsized":"2024-04-25T22:44:59.391466+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:41.592790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":346,"num_write":330,"num_write_kb":33934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":265,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103283+0000","last_change":"2024-04-25T22:44:26.364178+0000","last_active":"2024-04-25T22:44:59.103283+0000","last_peered":"2024-04-25T22:44:59.103283+0000","last_clean":"2024-04-25T22:44:59.103283+0000","last_became_active":"2024-04-25T22:44:26.363455+0000","last_became_peered":"2024-04-25T22:44:26.363455+0000","last_unstale":"2024-04-25T22:44:59.103283+0000","last_undegraded":"2024-04-25T22:44:59.103283+0000","last_fullsized":"2024-04-25T22:44:59.103283+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:58.181763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":143,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392774+0000","last_change":"2024-04-25T22:44:41.423030+0000","last_active":"2024-04-25T22:44:59.392774+0000","last_peered":"2024-04-25T22:44:59.392774+0000","last_clean":"2024-04-25T22:44:59.392774+0000","last_became_active":"2024-04-25T22:44:41.421194+0000","last_became_peered":"2024-04-25T22:44:41.421194+0000","last_unstale":"2024-04-25T22:44:59.392774+0000","last_undegraded":"2024-04-25T22:44:59.392774+0000","last_fullsized":"2024-04-25T22:44:59.392774+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:59.297537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'413","reported_seq":627,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390506+0000","last_change":"2024-04-25T22:44:48.378474+0000","last_active":"2024-04-25T22:44:59.390506+0000","last_peered":"2024-04-25T22:44:59.390506+0000","last_clean":"2024-04-25T22:44:59.390506+0000","last_became_active":"2024-04-25T22:44:48.372485+0000","last_became_peered":"2024-04-25T22:44:48.372485+0000","last_unstale":"2024-04-25T22:44:59.390506+0000","last_undegraded":"2024-04-25T22:44:59.390506+0000","last_fullsized":"2024-04-25T22:44:59.390506+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:47.402437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22994,"num_write":377,"num_write_kb":63140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'57","reported_seq":269,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103690+0000","last_change":"2024-04-25T22:44:26.366189+0000","last_active":"2024-04-25T22:44:59.103690+0000","last_peered":"2024-04-25T22:44:59.103690+0000","last_clean":"2024-04-25T22:44:59.103690+0000","last_became_active":"2024-04-25T22:44:26.365267+0000","last_became_peered":"2024-04-25T22:44:26.365267+0000","last_unstale":"2024-04-25T22:44:59.103690+0000","last_undegraded":"2024-04-25T22:44:59.103690+0000","last_fullsized":"2024-04-25T22:44:59.103690+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:54.128937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":217,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.104205+0000","last_change":"2024-04-25T22:44:26.361633+0000","last_active":"2024-04-25T22:44:59.104205+0000","last_peered":"2024-04-25T22:44:59.104205+0000","last_clean":"2024-04-25T22:44:59.104205+0000","last_became_active":"2024-04-25T22:44:26.360968+0000","last_became_peered":"2024-04-25T22:44:26.360968+0000","last_unstale":"2024-04-25T22:44:59.104205+0000","last_undegraded":"2024-04-25T22:44:59.104205+0000","last_fullsized":"2024-04-25T22:44:59.104205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:40.454898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'398","reported_seq":599,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102087+0000","last_change":"2024-04-25T22:44:39.132801+0000","last_active":"2024-04-25T22:44:59.102087+0000","last_peered":"2024-04-25T22:44:59.102087+0000","last_clean":"2024-04-25T22:44:59.102087+0000","last_became_active":"2024-04-25T22:44:39.124378+0000","last_became_peered":"2024-04-25T22:44:39.124378+0000","last_unstale":"2024-04-25T22:44:59.102087+0000","last_undegraded":"2024-04-25T22:44:59.102087+0000","last_fullsized":"2024-04-25T22:44:59.102087+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:29.195889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6306,"num_write":372,"num_write_kb":34077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'100","reported_seq":306,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.104153+0000","last_change":"2024-04-25T22:44:39.150245+0000","last_active":"2024-04-25T22:44:59.104153+0000","last_peered":"2024-04-25T22:44:59.104153+0000","last_clean":"2024-04-25T22:44:59.104153+0000","last_became_active":"2024-04-25T22:44:39.147377+0000","last_became_peered":"2024-04-25T22:44:39.147377+0000","last_unstale":"2024-04-25T22:44:59.104153+0000","last_undegraded":"2024-04-25T22:44:59.104153+0000","last_fullsized":"2024-04-25T22:44:59.104153+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:36.007978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":216,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109540+0000","last_change":"2024-04-25T22:44:26.360890+0000","last_active":"2024-04-25T22:44:59.109540+0000","last_peered":"2024-04-25T22:44:59.109540+0000","last_clean":"2024-04-25T22:44:59.109540+0000","last_became_active":"2024-04-25T22:44:26.360106+0000","last_became_peered":"2024-04-25T22:44:26.360106+0000","last_unstale":"2024-04-25T22:44:59.109540+0000","last_undegraded":"2024-04-25T22:44:59.109540+0000","last_fullsized":"2024-04-25T22:44:59.109540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:09.929196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'390","reported_seq":621,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390857+0000","last_change":"2024-04-25T22:44:41.433574+0000","last_active":"2024-04-25T22:44:59.390857+0000","last_peered":"2024-04-25T22:44:59.390857+0000","last_clean":"2024-04-25T22:44:59.390857+0000","last_became_active":"2024-04-25T22:44:41.414924+0000","last_became_peered":"2024-04-25T22:44:41.414924+0000","last_unstale":"2024-04-25T22:44:59.390857+0000","last_undegraded":"2024-04-25T22:44:59.390857+0000","last_fullsized":"2024-04-25T22:44:59.390857+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:46.695300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":22915,"num_write":352,"num_write_kb":47201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"72'411","reported_seq":1008,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108328+0000","last_change":"2024-04-25T22:44:32.090492+0000","last_active":"2024-04-25T22:44:59.108328+0000","last_peered":"2024-04-25T22:44:59.108328+0000","last_clean":"2024-04-25T22:44:59.108328+0000","last_became_active":"2024-04-25T22:44:32.087303+0000","last_became_peered":"2024-04-25T22:44:32.087303+0000","last_unstale":"2024-04-25T22:44:59.108328+0000","last_undegraded":"2024-04-25T22:44:59.108328+0000","last_fullsized":"2024-04-25T22:44:59.108328+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25412,"num_write":367,"num_write_kb":64656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'268","reported_seq":489,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108798+0000","last_change":"2024-04-25T22:44:29.399184+0000","last_active":"2024-04-25T22:44:59.108798+0000","last_peered":"2024-04-25T22:44:59.108798+0000","last_clean":"2024-04-25T22:44:59.108798+0000","last_became_active":"2024-04-25T22:44:29.398317+0000","last_became_peered":"2024-04-25T22:44:29.398317+0000","last_unstale":"2024-04-25T22:44:59.108798+0000","last_undegraded":"2024-04-25T22:44:59.108798+0000","last_fullsized":"2024-04-25T22:44:59.108798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:21.765162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382817,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"72'423","reported_seq":1047,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101400+0000","last_change":"2024-04-25T22:44:42.092243+0000","last_active":"2024-04-25T22:44:59.101400+0000","last_peered":"2024-04-25T22:44:59.101400+0000","last_clean":"2024-04-25T22:44:59.101400+0000","last_became_active":"2024-04-25T22:44:42.088432+0000","last_became_peered":"2024-04-25T22:44:42.088432+0000","last_unstale":"2024-04-25T22:44:59.101400+0000","last_undegraded":"2024-04-25T22:44:59.101400+0000","last_fullsized":"2024-04-25T22:44:59.101400+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:54.239406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24794,"num_write":386,"num_write_kb":63756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'102","reported_seq":96,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392357+0000","last_change":"2024-04-25T22:44:41.423993+0000","last_active":"2024-04-25T22:44:59.392357+0000","last_peered":"2024-04-25T22:44:59.392357+0000","last_clean":"2024-04-25T22:44:59.392357+0000","last_became_active":"2024-04-25T22:44:41.422237+0000","last_became_peered":"2024-04-25T22:44:41.422237+0000","last_unstale":"2024-04-25T22:44:59.392357+0000","last_undegraded":"2024-04-25T22:44:59.392357+0000","last_fullsized":"2024-04-25T22:44:59.392357+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:02.880774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"71'213","reported_seq":415,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108237+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:44:59.108237+0000","last_peered":"2024-04-25T22:44:59.108237+0000","last_clean":"2024-04-25T22:44:59.108237+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:44:59.108237+0000","last_undegraded":"2024-04-25T22:44:59.108237+0000","last_fullsized":"2024-04-25T22:44:59.108237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"72'504","reported_seq":769,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101135+0000","last_change":"2024-04-25T22:44:39.142694+0000","last_active":"2024-04-25T22:44:59.101135+0000","last_peered":"2024-04-25T22:44:59.101135+0000","last_clean":"2024-04-25T22:44:59.101135+0000","last_became_active":"2024-04-25T22:44:39.132582+0000","last_became_peered":"2024-04-25T22:44:39.132582+0000","last_unstale":"2024-04-25T22:44:59.101135+0000","last_undegraded":"2024-04-25T22:44:59.101135+0000","last_fullsized":"2024-04-25T22:44:59.101135+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:14.401644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":46975,"num_write":471,"num_write_kb":146290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'64","reported_seq":219,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103398+0000","last_change":"2024-04-25T22:44:39.136961+0000","last_active":"2024-04-25T22:44:59.103398+0000","last_peered":"2024-04-25T22:44:59.103398+0000","last_clean":"2024-04-25T22:44:59.103398+0000","last_became_active":"2024-04-25T22:44:39.136090+0000","last_became_peered":"2024-04-25T22:44:39.136090+0000","last_unstale":"2024-04-25T22:44:59.103398+0000","last_undegraded":"2024-04-25T22:44:59.103398+0000","last_fullsized":"2024-04-25T22:44:59.103398+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:35.220314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"72'475","reported_seq":1154,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101544+0000","last_change":"2024-04-25T22:44:44.106484+0000","last_active":"2024-04-25T22:44:59.101544+0000","last_peered":"2024-04-25T22:44:59.101544+0000","last_clean":"2024-04-25T22:44:59.101544+0000","last_became_active":"2024-04-25T22:44:44.102061+0000","last_became_peered":"2024-04-25T22:44:44.102061+0000","last_unstale":"2024-04-25T22:44:59.101544+0000","last_undegraded":"2024-04-25T22:44:59.101544+0000","last_fullsized":"2024-04-25T22:44:59.101544+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:05.455255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":23011,"num_write":448,"num_write_kb":76439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"72'370","reported_seq":567,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392775+0000","last_change":"2024-04-25T22:44:56.420080+0000","last_active":"2024-04-25T22:44:59.392775+0000","last_peered":"2024-04-25T22:44:59.392775+0000","last_clean":"2024-04-25T22:44:59.392775+0000","last_became_active":"2024-04-25T22:44:56.414231+0000","last_became_peered":"2024-04-25T22:44:56.414231+0000","last_unstale":"2024-04-25T22:44:59.392775+0000","last_undegraded":"2024-04-25T22:44:59.392775+0000","last_fullsized":"2024-04-25T22:44:59.392775+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:22.002829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33211,"num_write":340,"num_write_kb":63312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"71'647","reported_seq":865,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102434+0000","last_change":"2024-04-25T22:44:30.396965+0000","last_active":"2024-04-25T22:44:59.102434+0000","last_peered":"2024-04-25T22:44:59.102434+0000","last_clean":"2024-04-25T22:44:59.102434+0000","last_became_active":"2024-04-25T22:44:30.396073+0000","last_became_peered":"2024-04-25T22:44:30.396073+0000","last_unstale":"2024-04-25T22:44:59.102434+0000","last_undegraded":"2024-04-25T22:44:59.102434+0000","last_fullsized":"2024-04-25T22:44:59.102434+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"72'415","reported_seq":636,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102938+0000","last_change":"2024-04-25T22:44:39.150290+0000","last_active":"2024-04-25T22:44:59.102938+0000","last_peered":"2024-04-25T22:44:59.102938+0000","last_clean":"2024-04-25T22:44:59.102938+0000","last_became_active":"2024-04-25T22:44:39.146949+0000","last_became_peered":"2024-04-25T22:44:39.146949+0000","last_unstale":"2024-04-25T22:44:59.102938+0000","last_undegraded":"2024-04-25T22:44:59.102938+0000","last_fullsized":"2024-04-25T22:44:59.102938+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:11.804350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19493,"num_write":386,"num_write_kb":64692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'207","reported_seq":362,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101542+0000","last_change":"2024-04-25T22:44:39.141125+0000","last_active":"2024-04-25T22:44:59.101542+0000","last_peered":"2024-04-25T22:44:59.101542+0000","last_clean":"2024-04-25T22:44:59.101542+0000","last_became_active":"2024-04-25T22:44:39.138371+0000","last_became_peered":"2024-04-25T22:44:39.138371+0000","last_unstale":"2024-04-25T22:44:59.101542+0000","last_undegraded":"2024-04-25T22:44:59.101542+0000","last_fullsized":"2024-04-25T22:44:59.101542+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:14.147026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"72'395","reported_seq":562,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392340+0000","last_change":"2024-04-25T22:44:55.406524+0000","last_active":"2024-04-25T22:44:59.392340+0000","last_peered":"2024-04-25T22:44:59.392340+0000","last_clean":"2024-04-25T22:44:59.392340+0000","last_became_active":"2024-04-25T22:44:55.396613+0000","last_became_peered":"2024-04-25T22:44:55.396613+0000","last_unstale":"2024-04-25T22:44:59.392340+0000","last_undegraded":"2024-04-25T22:44:59.392340+0000","last_fullsized":"2024-04-25T22:44:59.392340+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:41.515369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9576,"num_write":348,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'194","reported_seq":363,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391176+0000","last_change":"2024-04-25T22:44:41.422369+0000","last_active":"2024-04-25T22:44:59.391176+0000","last_peered":"2024-04-25T22:44:59.391176+0000","last_clean":"2024-04-25T22:44:59.391176+0000","last_became_active":"2024-04-25T22:44:41.420491+0000","last_became_peered":"2024-04-25T22:44:41.420491+0000","last_unstale":"2024-04-25T22:44:59.391176+0000","last_undegraded":"2024-04-25T22:44:59.391176+0000","last_fullsized":"2024-04-25T22:44:59.391176+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:35.081225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360511,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":12143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12360511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"72'398","reported_seq":593,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391353+0000","last_change":"2024-04-25T22:44:52.381363+0000","last_active":"2024-04-25T22:44:59.391353+0000","last_peered":"2024-04-25T22:44:59.391353+0000","last_clean":"2024-04-25T22:44:59.391353+0000","last_became_active":"2024-04-25T22:44:52.375632+0000","last_became_peered":"2024-04-25T22:44:52.375632+0000","last_unstale":"2024-04-25T22:44:59.391353+0000","last_undegraded":"2024-04-25T22:44:59.391353+0000","last_fullsized":"2024-04-25T22:44:59.391353+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:38:28.441621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31284,"num_write":371,"num_write_kb":80144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"71'51","reported_seq":94,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390518+0000","last_change":"2024-04-25T22:44:41.415722+0000","last_active":"2024-04-25T22:44:59.390518+0000","last_peered":"2024-04-25T22:44:59.390518+0000","last_clean":"2024-04-25T22:44:59.390518+0000","last_became_active":"2024-04-25T22:44:41.414774+0000","last_became_peered":"2024-04-25T22:44:41.414774+0000","last_unstale":"2024-04-25T22:44:59.390518+0000","last_undegraded":"2024-04-25T22:44:59.390518+0000","last_fullsized":"2024-04-25T22:44:59.390518+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:20.553373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"72'383","reported_seq":635,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107059+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:44:59.107059+0000","last_peered":"2024-04-25T22:44:59.107059+0000","last_clean":"2024-04-25T22:44:59.107059+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:44:59.107059+0000","last_undegraded":"2024-04-25T22:44:59.107059+0000","last_fullsized":"2024-04-25T22:44:59.107059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29308,"num_write":358,"num_write_kb":66975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"71'177","reported_seq":379,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108565+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:44:59.108565+0000","last_peered":"2024-04-25T22:44:59.108565+0000","last_clean":"2024-04-25T22:44:59.108565+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:44:59.108565+0000","last_undegraded":"2024-04-25T22:44:59.108565+0000","last_fullsized":"2024-04-25T22:44:59.108565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"72'387","reported_seq":600,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107381+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:44:59.107381+0000","last_peered":"2024-04-25T22:44:59.107381+0000","last_clean":"2024-04-25T22:44:59.107381+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:44:59.107381+0000","last_undegraded":"2024-04-25T22:44:59.107381+0000","last_fullsized":"2024-04-25T22:44:59.107381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3883,"num_write":348,"num_write_kb":34122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'209","reported_seq":413,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391358+0000","last_change":"2024-04-25T22:44:41.419972+0000","last_active":"2024-04-25T22:44:59.391358+0000","last_peered":"2024-04-25T22:44:59.391358+0000","last_clean":"2024-04-25T22:44:59.391358+0000","last_became_active":"2024-04-25T22:44:41.418106+0000","last_became_peered":"2024-04-25T22:44:41.418106+0000","last_unstale":"2024-04-25T22:44:59.391358+0000","last_undegraded":"2024-04-25T22:44:59.391358+0000","last_fullsized":"2024-04-25T22:44:59.391358+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:07.628155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":12363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"72'419","reported_seq":607,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390493+0000","last_change":"2024-04-25T22:44:41.434376+0000","last_active":"2024-04-25T22:44:59.390493+0000","last_peered":"2024-04-25T22:44:59.390493+0000","last_clean":"2024-04-25T22:44:59.390493+0000","last_became_active":"2024-04-25T22:44:41.420505+0000","last_became_peered":"2024-04-25T22:44:41.420505+0000","last_unstale":"2024-04-25T22:44:59.390493+0000","last_undegraded":"2024-04-25T22:44:59.390493+0000","last_fullsized":"2024-04-25T22:44:59.390493+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:04.414563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":13327,"num_write":388,"num_write_kb":55674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"71'131","reported_seq":349,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103634+0000","last_change":"2024-04-25T22:44:29.398880+0000","last_active":"2024-04-25T22:44:59.103634+0000","last_peered":"2024-04-25T22:44:59.103634+0000","last_clean":"2024-04-25T22:44:59.103634+0000","last_became_active":"2024-04-25T22:44:29.397905+0000","last_became_peered":"2024-04-25T22:44:29.397905+0000","last_unstale":"2024-04-25T22:44:59.103634+0000","last_undegraded":"2024-04-25T22:44:59.103634+0000","last_fullsized":"2024-04-25T22:44:59.103634+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:44.236330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"72'449","reported_seq":683,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107034+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:44:59.107034+0000","last_peered":"2024-04-25T22:44:59.107034+0000","last_clean":"2024-04-25T22:44:59.107034+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:44:59.107034+0000","last_undegraded":"2024-04-25T22:44:59.107034+0000","last_fullsized":"2024-04-25T22:44:59.107034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14222,"num_write":424,"num_write_kb":79796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"71'57","reported_seq":213,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103091+0000","last_change":"2024-04-25T22:44:39.137232+0000","last_active":"2024-04-25T22:44:59.103091+0000","last_peered":"2024-04-25T22:44:59.103091+0000","last_clean":"2024-04-25T22:44:59.103091+0000","last_became_active":"2024-04-25T22:44:39.136283+0000","last_became_peered":"2024-04-25T22:44:39.136283+0000","last_unstale":"2024-04-25T22:44:59.103091+0000","last_undegraded":"2024-04-25T22:44:59.103091+0000","last_fullsized":"2024-04-25T22:44:59.103091+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:32.428982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2461,"num_read_kb":1248646,"num_write":24434,"num_write_kb":4137258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7447,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26539,"ondisk_log_size":26539,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127071275,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":4473,"num_write_kb":127409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254210048,"data_stored":254142550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},"log_size":6216,"ondisk_log_size":6216,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738434,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165344,"kb_used_data":80080,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94206496,"statfs":{"total":96636764160,"available":96467451904,"internally_reserved":0,"allocated":82001920,"data_stored":81417710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":79,"seq":339302416394,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141408,"kb_used_data":83340,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94230432,"statfs":{"total":96636764160,"available":96491962368,"internally_reserved":0,"allocated":85340160,"data_stored":84739534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6003,"internal_metadata":59435149},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738434,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174352,"kb_used_data":89088,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94197488,"statfs":{"total":96636764160,"available":96458227712,"internally_reserved":0,"allocated":91226112,"data_stored":90619941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89575424,"data_stored":89544940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83689472,"data_stored":83664533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80945152,"data_stored":80933077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:45:05.298 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:45:05.638 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:45:05.639 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":113,"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","created":"2024-04-25T22:39:52.303074+0000","modified":"2024-04-25T22:44:59.081979+0000","last_up_change":"2024-04-25T22:44:25.314578+0000","last_in_change":"2024-04-25T22:39:53.230242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:40:03.197725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:40:07.560858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:40:12.431697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:40:12.919828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d465b4-5896-4d69-80b1-7e69d31eb455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6801","nonce":765118869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6803","nonce":765118869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6807","nonce":765118869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6805","nonce":765118869}]},"public_addr":"172.21.15.122:6801/765118869","cluster_addr":"172.21.15.122:6803/765118869","heartbeat_back_addr":"172.21.15.122:6807/765118869","heartbeat_front_addr":"172.21.15.122:6805/765118869","state":["exists","up"]},{"osd":1,"uuid":"8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":45,"up_from":79,"up_thru":112,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":3379571590},{"type":"v1","addr":"172.21.15.148:6801","nonce":3379571590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":3379571590},{"type":"v1","addr":"172.21.15.148:6803","nonce":3379571590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":3379571590},{"type":"v1","addr":"172.21.15.148:6807","nonce":3379571590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":3379571590},{"type":"v1","addr":"172.21.15.148:6805","nonce":3379571590}]},"public_addr":"172.21.15.148:6801/3379571590","cluster_addr":"172.21.15.148:6803/3379571590","heartbeat_back_addr":"172.21.15.148:6807/3379571590","heartbeat_front_addr":"172.21.15.148:6805/3379571590","state":["exists","up"]},{"osd":2,"uuid":"164fc653-2135-4e9b-8826-1716fdba6ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6801","nonce":368834361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6803","nonce":368834361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6807","nonce":368834361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6805","nonce":368834361}]},"public_addr":"172.21.15.188:6801/368834361","cluster_addr":"172.21.15.188:6803/368834361","heartbeat_back_addr":"172.21.15.188:6807/368834361","heartbeat_front_addr":"172.21.15.188:6805/368834361","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.559393+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.563434+0000","dead_epoch":45},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.557643+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.16","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:45:06.659 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T22:45:06.659 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T22:45:06.827 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:45:06.827 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T22:45:06.827 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:45:06.844 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T22:45:07.143 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T22:45:07.163 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T22:45:07.163 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T22:45:07.314 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:45:07.314 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-25T22:45:07.314 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:45:07.331 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T22:45:07.621 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T22:45:07.640 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T22:45:07.640 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T22:45:07.797 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-25T22:45:07.797 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T22:45:07.798 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-25T22:45:07.814 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T22:45:08.094 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T22:45:08.112 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:45:08.421 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:45:08.424 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:45:08.439 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-04-25T22:45:07.245150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127661643,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2659,"num_read_kb":1250233,"num_write":29110,"num_write_kb":4268127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7469,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32912,"ondisk_log_size":32912,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":481104,"kb_used_data":252508,"kb_used_omap":8,"kb_used_meta":228535,"kb_avail":282634416,"statfs":{"total":289910292480,"available":289417641984,"internally_reserved":0,"allocated":258568192,"data_stored":256777185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9193,"internal_metadata":234019863},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-885,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":960,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.161535"},"pg_stats":[{"pgid":"4.3f","version":"72'404","reported_seq":559,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.393147+0000","last_change":"2024-04-25T22:44:57.382564+0000","last_active":"2024-04-25T22:44:59.393147+0000","last_peered":"2024-04-25T22:44:59.393147+0000","last_clean":"2024-04-25T22:44:59.393147+0000","last_became_active":"2024-04-25T22:44:57.376098+0000","last_became_peered":"2024-04-25T22:44:57.376098+0000","last_unstale":"2024-04-25T22:44:59.393147+0000","last_undegraded":"2024-04-25T22:44:59.393147+0000","last_fullsized":"2024-04-25T22:44:59.393147+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:31:49.789706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19772,"num_write":366,"num_write_kb":46873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"72'420","reported_seq":622,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392815+0000","last_change":"2024-04-25T22:44:41.434387+0000","last_active":"2024-04-25T22:44:59.392815+0000","last_peered":"2024-04-25T22:44:59.392815+0000","last_clean":"2024-04-25T22:44:59.392815+0000","last_became_active":"2024-04-25T22:44:41.418792+0000","last_became_peered":"2024-04-25T22:44:41.418792+0000","last_unstale":"2024-04-25T22:44:59.392815+0000","last_undegraded":"2024-04-25T22:44:59.392815+0000","last_fullsized":"2024-04-25T22:44:59.392815+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:43.196115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24515,"num_write":386,"num_write_kb":55688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"72'377","reported_seq":952,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107392+0000","last_change":"2024-04-25T22:44:42.096911+0000","last_active":"2024-04-25T22:44:59.107392+0000","last_peered":"2024-04-25T22:44:59.107392+0000","last_clean":"2024-04-25T22:44:59.107392+0000","last_became_active":"2024-04-25T22:44:42.093941+0000","last_became_peered":"2024-04-25T22:44:42.093941+0000","last_unstale":"2024-04-25T22:44:59.107392+0000","last_undegraded":"2024-04-25T22:44:59.107392+0000","last_fullsized":"2024-04-25T22:44:59.107392+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11135,"num_write":346,"num_write_kb":38950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"72'366","reported_seq":573,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107137+0000","last_change":"2024-04-25T22:40:14.628484+0000","last_active":"2024-04-25T22:44:59.107137+0000","last_peered":"2024-04-25T22:44:59.107137+0000","last_clean":"2024-04-25T22:44:59.107137+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:44:59.107137+0000","last_undegraded":"2024-04-25T22:44:59.107137+0000","last_fullsized":"2024-04-25T22:44:59.107137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:21:11.284614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":326,"num_write_kb":34079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"72'455","reported_seq":635,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390846+0000","last_change":"2024-04-25T22:44:50.391674+0000","last_active":"2024-04-25T22:44:59.390846+0000","last_peered":"2024-04-25T22:44:59.390846+0000","last_clean":"2024-04-25T22:44:59.390846+0000","last_became_active":"2024-04-25T22:44:50.384804+0000","last_became_peered":"2024-04-25T22:44:50.384804+0000","last_unstale":"2024-04-25T22:44:59.390846+0000","last_undegraded":"2024-04-25T22:44:59.390846+0000","last_fullsized":"2024-04-25T22:44:59.390846+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:22:54.239989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33897,"num_write":426,"num_write_kb":100721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"72'401","reported_seq":635,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106493+0000","last_change":"2024-04-25T22:40:14.632134+0000","last_active":"2024-04-25T22:44:59.106493+0000","last_peered":"2024-04-25T22:44:59.106493+0000","last_clean":"2024-04-25T22:44:59.106493+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:44:59.106493+0000","last_undegraded":"2024-04-25T22:44:59.106493+0000","last_fullsized":"2024-04-25T22:44:59.106493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:42.634783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15258,"num_write":369,"num_write_kb":53298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"72'452","reported_seq":718,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106260+0000","last_change":"2024-04-25T22:40:14.629000+0000","last_active":"2024-04-25T22:44:59.106260+0000","last_peered":"2024-04-25T22:44:59.106260+0000","last_clean":"2024-04-25T22:44:59.106260+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:44:59.106260+0000","last_undegraded":"2024-04-25T22:44:59.106260+0000","last_fullsized":"2024-04-25T22:44:59.106260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:36.085002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34010,"num_write":428,"num_write_kb":157752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"72'401","reported_seq":640,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.105970+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:44:59.105970+0000","last_peered":"2024-04-25T22:44:59.105970+0000","last_clean":"2024-04-25T22:44:59.105970+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:44:59.105970+0000","last_undegraded":"2024-04-25T22:44:59.105970+0000","last_fullsized":"2024-04-25T22:44:59.105970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:39.831093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19917,"num_write":359,"num_write_kb":109382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"72'394","reported_seq":980,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101912+0000","last_change":"2024-04-25T22:44:48.092689+0000","last_active":"2024-04-25T22:44:59.101912+0000","last_peered":"2024-04-25T22:44:59.101912+0000","last_clean":"2024-04-25T22:44:59.101912+0000","last_became_active":"2024-04-25T22:44:48.089795+0000","last_became_peered":"2024-04-25T22:44:48.089795+0000","last_unstale":"2024-04-25T22:44:59.101912+0000","last_undegraded":"2024-04-25T22:44:59.101912+0000","last_fullsized":"2024-04-25T22:44:59.101912+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:32:33.072950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9569,"num_write":360,"num_write_kb":25560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"72'382","reported_seq":566,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392804+0000","last_change":"2024-04-25T22:44:41.433644+0000","last_active":"2024-04-25T22:44:59.392804+0000","last_peered":"2024-04-25T22:44:59.392804+0000","last_clean":"2024-04-25T22:44:59.392804+0000","last_became_active":"2024-04-25T22:44:41.421234+0000","last_became_peered":"2024-04-25T22:44:41.421234+0000","last_unstale":"2024-04-25T22:44:59.392804+0000","last_undegraded":"2024-04-25T22:44:59.392804+0000","last_fullsized":"2024-04-25T22:44:59.392804+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:24.217391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17192,"num_write":338,"num_write_kb":38688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"72'369","reported_seq":592,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107541+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:44:59.107541+0000","last_peered":"2024-04-25T22:44:59.107541+0000","last_clean":"2024-04-25T22:44:59.107541+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:44:59.107541+0000","last_undegraded":"2024-04-25T22:44:59.107541+0000","last_fullsized":"2024-04-25T22:44:59.107541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:18:40.876292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7385,"num_write":349,"num_write_kb":58842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"72'338","reported_seq":522,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391810+0000","last_change":"2024-04-25T22:44:49.384005+0000","last_active":"2024-04-25T22:44:59.391810+0000","last_peered":"2024-04-25T22:44:59.391810+0000","last_clean":"2024-04-25T22:44:59.391810+0000","last_became_active":"2024-04-25T22:44:49.378325+0000","last_became_peered":"2024-04-25T22:44:49.378325+0000","last_unstale":"2024-04-25T22:44:59.391810+0000","last_undegraded":"2024-04-25T22:44:59.391810+0000","last_fullsized":"2024-04-25T22:44:59.391810+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:18.849786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13619,"num_write":312,"num_write_kb":21391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"72'411","reported_seq":605,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391345+0000","last_change":"2024-04-25T22:44:41.432463+0000","last_active":"2024-04-25T22:44:59.391345+0000","last_peered":"2024-04-25T22:44:59.391345+0000","last_clean":"2024-04-25T22:44:59.391345+0000","last_became_active":"2024-04-25T22:44:41.421096+0000","last_became_peered":"2024-04-25T22:44:41.421096+0000","last_unstale":"2024-04-25T22:44:59.391345+0000","last_undegraded":"2024-04-25T22:44:59.391345+0000","last_fullsized":"2024-04-25T22:44:59.391345+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:46.942677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12998,"num_write":375,"num_write_kb":79661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"72'452","reported_seq":1051,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107059+0000","last_change":"2024-04-25T22:44:40.130299+0000","last_active":"2024-04-25T22:44:59.107059+0000","last_peered":"2024-04-25T22:44:59.107059+0000","last_clean":"2024-04-25T22:44:59.107059+0000","last_became_active":"2024-04-25T22:44:40.127307+0000","last_became_peered":"2024-04-25T22:44:40.127307+0000","last_unstale":"2024-04-25T22:44:59.107059+0000","last_undegraded":"2024-04-25T22:44:59.107059+0000","last_fullsized":"2024-04-25T22:44:59.107059+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:51:16.746830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":854,"num_write":419,"num_write_kb":88217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"72'428","reported_seq":1031,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106380+0000","last_change":"2024-04-25T22:44:35.108361+0000","last_active":"2024-04-25T22:44:59.106380+0000","last_peered":"2024-04-25T22:44:59.106380+0000","last_clean":"2024-04-25T22:44:59.106380+0000","last_became_active":"2024-04-25T22:44:35.103208+0000","last_became_peered":"2024-04-25T22:44:35.103208+0000","last_unstale":"2024-04-25T22:44:59.106380+0000","last_undegraded":"2024-04-25T22:44:59.106380+0000","last_fullsized":"2024-04-25T22:44:59.106380+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:17:22.046332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21291,"num_write":389,"num_write_kb":68562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"72'401","reported_seq":615,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.105974+0000","last_change":"2024-04-25T22:40:14.633375+0000","last_active":"2024-04-25T22:44:59.105974+0000","last_peered":"2024-04-25T22:44:59.105974+0000","last_clean":"2024-04-25T22:44:59.105974+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:44:59.105974+0000","last_undegraded":"2024-04-25T22:44:59.105974+0000","last_fullsized":"2024-04-25T22:44:59.105974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:25:51.029146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8276,"num_write":369,"num_write_kb":17867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"72'398","reported_seq":971,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103506+0000","last_change":"2024-04-25T22:44:49.097340+0000","last_active":"2024-04-25T22:44:59.103506+0000","last_peered":"2024-04-25T22:44:59.103506+0000","last_clean":"2024-04-25T22:44:59.103506+0000","last_became_active":"2024-04-25T22:44:49.094478+0000","last_became_peered":"2024-04-25T22:44:49.094478+0000","last_unstale":"2024-04-25T22:44:59.103506+0000","last_undegraded":"2024-04-25T22:44:59.103506+0000","last_fullsized":"2024-04-25T22:44:59.103506+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:33.421713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5883,"num_write":362,"num_write_kb":38188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"72'407","reported_seq":543,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.401367+0000","last_change":"2024-04-25T22:44:59.401367+0000","last_active":"2024-04-25T22:44:59.401367+0000","last_peered":"2024-04-25T22:44:59.401367+0000","last_clean":"2024-04-25T22:44:59.401367+0000","last_became_active":"2024-04-25T22:44:59.396404+0000","last_became_peered":"2024-04-25T22:44:59.396404+0000","last_unstale":"2024-04-25T22:44:59.401367+0000","last_undegraded":"2024-04-25T22:44:59.401367+0000","last_fullsized":"2024-04-25T22:44:59.401367+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:15:41.602118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13073,"num_write":372,"num_write_kb":59323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"72'441","reported_seq":1059,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102684+0000","last_change":"2024-04-25T22:44:41.148409+0000","last_active":"2024-04-25T22:44:59.102684+0000","last_peered":"2024-04-25T22:44:59.102684+0000","last_clean":"2024-04-25T22:44:59.102684+0000","last_became_active":"2024-04-25T22:44:41.143302+0000","last_became_peered":"2024-04-25T22:44:41.143302+0000","last_unstale":"2024-04-25T22:44:59.102684+0000","last_undegraded":"2024-04-25T22:44:59.102684+0000","last_fullsized":"2024-04-25T22:44:59.102684+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:46.289713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37611,"num_write":403,"num_write_kb":116618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"72'438","reported_seq":664,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107576+0000","last_change":"2024-04-25T22:40:14.631951+0000","last_active":"2024-04-25T22:44:59.107576+0000","last_peered":"2024-04-25T22:44:59.107576+0000","last_clean":"2024-04-25T22:44:59.107576+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:44:59.107576+0000","last_undegraded":"2024-04-25T22:44:59.107576+0000","last_fullsized":"2024-04-25T22:44:59.107576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:04.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12393,"num_write":408,"num_write_kb":99933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"72'407","reported_seq":622,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108619+0000","last_change":"2024-04-25T22:40:14.630505+0000","last_active":"2024-04-25T22:44:59.108619+0000","last_peered":"2024-04-25T22:44:59.108619+0000","last_clean":"2024-04-25T22:44:59.108619+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:44:59.108619+0000","last_undegraded":"2024-04-25T22:44:59.108619+0000","last_fullsized":"2024-04-25T22:44:59.108619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:24.946860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8932,"num_write":382,"num_write_kb":59684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"72'463","reported_seq":692,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391725+0000","last_change":"2024-04-25T22:44:47.376009+0000","last_active":"2024-04-25T22:44:59.391725+0000","last_peered":"2024-04-25T22:44:59.391725+0000","last_clean":"2024-04-25T22:44:59.391725+0000","last_became_active":"2024-04-25T22:44:47.369995+0000","last_became_peered":"2024-04-25T22:44:47.369995+0000","last_unstale":"2024-04-25T22:44:59.391725+0000","last_undegraded":"2024-04-25T22:44:59.391725+0000","last_fullsized":"2024-04-25T22:44:59.391725+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:01:04.129559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27589,"num_write":428,"num_write_kb":76861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"72'425","reported_seq":694,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.100741+0000","last_change":"2024-04-25T22:44:39.132230+0000","last_active":"2024-04-25T22:44:59.100741+0000","last_peered":"2024-04-25T22:44:59.100741+0000","last_clean":"2024-04-25T22:44:59.100741+0000","last_became_active":"2024-04-25T22:44:39.118635+0000","last_became_peered":"2024-04-25T22:44:39.118635+0000","last_unstale":"2024-04-25T22:44:59.100741+0000","last_undegraded":"2024-04-25T22:44:59.100741+0000","last_fullsized":"2024-04-25T22:44:59.100741+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:15.096836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":46424,"num_write":390,"num_write_kb":96359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"72'445","reported_seq":619,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390506+0000","last_change":"2024-04-25T22:44:54.388681+0000","last_active":"2024-04-25T22:44:59.390506+0000","last_peered":"2024-04-25T22:44:59.390506+0000","last_clean":"2024-04-25T22:44:59.390506+0000","last_became_active":"2024-04-25T22:44:54.382124+0000","last_became_peered":"2024-04-25T22:44:54.382124+0000","last_unstale":"2024-04-25T22:44:59.390506+0000","last_undegraded":"2024-04-25T22:44:59.390506+0000","last_fullsized":"2024-04-25T22:44:59.390506+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:32:49.633770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32317,"num_write":419,"num_write_kb":76071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"72'424","reported_seq":590,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392521+0000","last_change":"2024-04-25T22:44:51.391125+0000","last_active":"2024-04-25T22:44:59.392521+0000","last_peered":"2024-04-25T22:44:59.392521+0000","last_clean":"2024-04-25T22:44:59.392521+0000","last_became_active":"2024-04-25T22:44:51.383461+0000","last_became_peered":"2024-04-25T22:44:51.383461+0000","last_unstale":"2024-04-25T22:44:59.392521+0000","last_undegraded":"2024-04-25T22:44:59.392521+0000","last_fullsized":"2024-04-25T22:44:59.392521+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:52:33.717342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8396,"num_write":399,"num_write_kb":50416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"72'499","reported_seq":710,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102656+0000","last_change":"2024-04-25T22:44:39.149280+0000","last_active":"2024-04-25T22:44:59.102656+0000","last_peered":"2024-04-25T22:44:59.102656+0000","last_clean":"2024-04-25T22:44:59.102656+0000","last_became_active":"2024-04-25T22:44:39.143391+0000","last_became_peered":"2024-04-25T22:44:39.143391+0000","last_unstale":"2024-04-25T22:44:59.102656+0000","last_undegraded":"2024-04-25T22:44:59.102656+0000","last_fullsized":"2024-04-25T22:44:59.102656+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:54:10.301144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10227,"num_write":453,"num_write_kb":96585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'430","reported_seq":1082,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107732+0000","last_change":"2024-04-25T22:44:39.113437+0000","last_active":"2024-04-25T22:44:59.107732+0000","last_peered":"2024-04-25T22:44:59.107732+0000","last_clean":"2024-04-25T22:44:59.107732+0000","last_became_active":"2024-04-25T22:44:39.109771+0000","last_became_peered":"2024-04-25T22:44:39.109771+0000","last_unstale":"2024-04-25T22:44:59.107732+0000","last_undegraded":"2024-04-25T22:44:59.107732+0000","last_fullsized":"2024-04-25T22:44:59.107732+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:40:46.739897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":32116,"num_write":409,"num_write_kb":89217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"72'393","reported_seq":656,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391736+0000","last_change":"2024-04-25T22:44:41.425947+0000","last_active":"2024-04-25T22:44:59.391736+0000","last_peered":"2024-04-25T22:44:59.391736+0000","last_clean":"2024-04-25T22:44:59.391736+0000","last_became_active":"2024-04-25T22:44:41.413570+0000","last_became_peered":"2024-04-25T22:44:41.413570+0000","last_unstale":"2024-04-25T22:44:59.391736+0000","last_undegraded":"2024-04-25T22:44:59.391736+0000","last_fullsized":"2024-04-25T22:44:59.391736+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:39:00.508414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":28076,"num_write":364,"num_write_kb":47473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"72'399","reported_seq":993,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103262+0000","last_change":"2024-04-25T22:44:40.124745+0000","last_active":"2024-04-25T22:44:59.103262+0000","last_peered":"2024-04-25T22:44:59.103262+0000","last_clean":"2024-04-25T22:44:59.103262+0000","last_became_active":"2024-04-25T22:44:40.121838+0000","last_became_peered":"2024-04-25T22:44:40.121838+0000","last_unstale":"2024-04-25T22:44:59.103262+0000","last_undegraded":"2024-04-25T22:44:59.103262+0000","last_fullsized":"2024-04-25T22:44:59.103262+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:08:28.299317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14005,"num_write":367,"num_write_kb":58883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"72'484","reported_seq":683,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391410+0000","last_change":"2024-04-25T22:44:54.392451+0000","last_active":"2024-04-25T22:44:59.391410+0000","last_peered":"2024-04-25T22:44:59.391410+0000","last_clean":"2024-04-25T22:44:59.391410+0000","last_became_active":"2024-04-25T22:44:54.383808+0000","last_became_peered":"2024-04-25T22:44:54.383808+0000","last_unstale":"2024-04-25T22:44:59.391410+0000","last_undegraded":"2024-04-25T22:44:59.391410+0000","last_fullsized":"2024-04-25T22:44:59.391410+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:06.630318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23352,"num_write":446,"num_write_kb":100094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'455","reported_seq":1136,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101023+0000","last_change":"2024-04-25T22:44:33.087211+0000","last_active":"2024-04-25T22:44:59.101023+0000","last_peered":"2024-04-25T22:44:59.101023+0000","last_clean":"2024-04-25T22:44:59.101023+0000","last_became_active":"2024-04-25T22:44:33.084127+0000","last_became_peered":"2024-04-25T22:44:33.084127+0000","last_unstale":"2024-04-25T22:44:59.101023+0000","last_undegraded":"2024-04-25T22:44:59.101023+0000","last_fullsized":"2024-04-25T22:44:59.101023+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38440,"num_write":423,"num_write_kb":71855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"72'434","reported_seq":668,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106552+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:44:59.106552+0000","last_peered":"2024-04-25T22:44:59.106552+0000","last_clean":"2024-04-25T22:44:59.106552+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:44:59.106552+0000","last_undegraded":"2024-04-25T22:44:59.106552+0000","last_fullsized":"2024-04-25T22:44:59.106552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:11:50.211283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18701,"num_write":402,"num_write_kb":27564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"72'379","reported_seq":526,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391067+0000","last_change":"2024-04-25T22:44:53.383623+0000","last_active":"2024-04-25T22:44:59.391067+0000","last_peered":"2024-04-25T22:44:59.391067+0000","last_clean":"2024-04-25T22:44:59.391067+0000","last_became_active":"2024-04-25T22:44:53.378402+0000","last_became_peered":"2024-04-25T22:44:53.378402+0000","last_unstale":"2024-04-25T22:44:59.391067+0000","last_undegraded":"2024-04-25T22:44:59.391067+0000","last_fullsized":"2024-04-25T22:44:59.391067+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:52:18.111269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18623,"num_write":344,"num_write_kb":50888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"71'528","reported_seq":731,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109262+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:44:59.109262+0000","last_peered":"2024-04-25T22:44:59.109262+0000","last_clean":"2024-04-25T22:44:59.109262+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:44:59.109262+0000","last_undegraded":"2024-04-25T22:44:59.109262+0000","last_fullsized":"2024-04-25T22:44:59.109262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:22.892603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"72'383","reported_seq":503,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392060+0000","last_change":"2024-04-25T22:44:58.385931+0000","last_active":"2024-04-25T22:44:59.392060+0000","last_peered":"2024-04-25T22:44:59.392060+0000","last_clean":"2024-04-25T22:44:59.392060+0000","last_became_active":"2024-04-25T22:44:58.380203+0000","last_became_peered":"2024-04-25T22:44:58.380203+0000","last_unstale":"2024-04-25T22:44:59.392060+0000","last_undegraded":"2024-04-25T22:44:59.392060+0000","last_fullsized":"2024-04-25T22:44:59.392060+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:25:12.874377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8364,"num_write":351,"num_write_kb":30625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"71'45","reported_seq":201,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102522+0000","last_change":"2024-04-25T22:44:39.117622+0000","last_active":"2024-04-25T22:44:59.102522+0000","last_peered":"2024-04-25T22:44:59.102522+0000","last_clean":"2024-04-25T22:44:59.102522+0000","last_became_active":"2024-04-25T22:44:39.115669+0000","last_became_peered":"2024-04-25T22:44:39.115669+0000","last_unstale":"2024-04-25T22:44:59.102522+0000","last_undegraded":"2024-04-25T22:44:59.102522+0000","last_fullsized":"2024-04-25T22:44:59.102522+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:21.793820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"72'429","reported_seq":571,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392387+0000","last_change":"2024-04-25T22:44:58.388677+0000","last_active":"2024-04-25T22:44:59.392387+0000","last_peered":"2024-04-25T22:44:59.392387+0000","last_clean":"2024-04-25T22:44:59.392387+0000","last_became_active":"2024-04-25T22:44:58.382521+0000","last_became_peered":"2024-04-25T22:44:58.382521+0000","last_unstale":"2024-04-25T22:44:59.392387+0000","last_undegraded":"2024-04-25T22:44:59.392387+0000","last_fullsized":"2024-04-25T22:44:59.392387+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:02:26.999533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16584,"num_write":393,"num_write_kb":63712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'61","reported_seq":89,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391526+0000","last_change":"2024-04-25T22:44:41.416554+0000","last_active":"2024-04-25T22:44:59.391526+0000","last_peered":"2024-04-25T22:44:59.391526+0000","last_clean":"2024-04-25T22:44:59.391526+0000","last_became_active":"2024-04-25T22:44:41.413853+0000","last_became_peered":"2024-04-25T22:44:41.413853+0000","last_unstale":"2024-04-25T22:44:59.391526+0000","last_undegraded":"2024-04-25T22:44:59.391526+0000","last_fullsized":"2024-04-25T22:44:59.391526+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:50.701110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"72'404","reported_seq":624,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102212+0000","last_change":"2024-04-25T22:44:39.128428+0000","last_active":"2024-04-25T22:44:59.102212+0000","last_peered":"2024-04-25T22:44:59.102212+0000","last_clean":"2024-04-25T22:44:59.102212+0000","last_became_active":"2024-04-25T22:44:39.116562+0000","last_became_peered":"2024-04-25T22:44:39.116562+0000","last_unstale":"2024-04-25T22:44:59.102212+0000","last_undegraded":"2024-04-25T22:44:59.102212+0000","last_fullsized":"2024-04-25T22:44:59.102212+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:20:09.750726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18745,"num_write":376,"num_write_kb":96145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'71","reported_seq":282,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106763+0000","last_change":"2024-04-25T22:44:26.363329+0000","last_active":"2024-04-25T22:44:59.106763+0000","last_peered":"2024-04-25T22:44:59.106763+0000","last_clean":"2024-04-25T22:44:59.106763+0000","last_became_active":"2024-04-25T22:44:26.362499+0000","last_became_peered":"2024-04-25T22:44:26.362499+0000","last_unstale":"2024-04-25T22:44:59.106763+0000","last_undegraded":"2024-04-25T22:44:59.106763+0000","last_fullsized":"2024-04-25T22:44:59.106763+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"71'145","reported_seq":362,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109263+0000","last_change":"2024-04-25T22:44:29.400540+0000","last_active":"2024-04-25T22:44:59.109263+0000","last_peered":"2024-04-25T22:44:59.109263+0000","last_clean":"2024-04-25T22:44:59.109263+0000","last_became_active":"2024-04-25T22:44:29.399853+0000","last_became_peered":"2024-04-25T22:44:29.399853+0000","last_unstale":"2024-04-25T22:44:59.109263+0000","last_undegraded":"2024-04-25T22:44:59.109263+0000","last_fullsized":"2024-04-25T22:44:59.109263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"72'399","reported_seq":605,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390842+0000","last_change":"2024-04-25T22:44:46.398600+0000","last_active":"2024-04-25T22:44:59.390842+0000","last_peered":"2024-04-25T22:44:59.390842+0000","last_clean":"2024-04-25T22:44:59.390842+0000","last_became_active":"2024-04-25T22:44:46.392604+0000","last_became_peered":"2024-04-25T22:44:46.392604+0000","last_unstale":"2024-04-25T22:44:59.390842+0000","last_undegraded":"2024-04-25T22:44:59.390842+0000","last_fullsized":"2024-04-25T22:44:59.390842+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:18:15.771324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25159,"num_write":363,"num_write_kb":34063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"71'226","reported_seq":432,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392417+0000","last_change":"2024-04-25T22:44:41.417859+0000","last_active":"2024-04-25T22:44:59.392417+0000","last_peered":"2024-04-25T22:44:59.392417+0000","last_clean":"2024-04-25T22:44:59.392417+0000","last_became_active":"2024-04-25T22:44:41.416542+0000","last_became_peered":"2024-04-25T22:44:41.416542+0000","last_unstale":"2024-04-25T22:44:59.392417+0000","last_undegraded":"2024-04-25T22:44:59.392417+0000","last_fullsized":"2024-04-25T22:44:59.392417+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:27.884903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"72'431","reported_seq":578,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390134+0000","last_change":"2024-04-25T22:44:56.419453+0000","last_active":"2024-04-25T22:44:59.390134+0000","last_peered":"2024-04-25T22:44:59.390134+0000","last_clean":"2024-04-25T22:44:59.390134+0000","last_became_active":"2024-04-25T22:44:56.412151+0000","last_became_peered":"2024-04-25T22:44:56.412151+0000","last_unstale":"2024-04-25T22:44:59.390134+0000","last_undegraded":"2024-04-25T22:44:59.390134+0000","last_fullsized":"2024-04-25T22:44:59.390134+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:07:27.220853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14688,"num_write":405,"num_write_kb":38957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"71'382","reported_seq":599,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108993+0000","last_change":"2024-04-25T22:44:30.401893+0000","last_active":"2024-04-25T22:44:59.108993+0000","last_peered":"2024-04-25T22:44:59.108993+0000","last_clean":"2024-04-25T22:44:59.108993+0000","last_became_active":"2024-04-25T22:44:30.401021+0000","last_became_peered":"2024-04-25T22:44:30.401021+0000","last_unstale":"2024-04-25T22:44:59.108993+0000","last_undegraded":"2024-04-25T22:44:59.108993+0000","last_fullsized":"2024-04-25T22:44:59.108993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:38.452482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'453","reported_seq":685,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107186+0000","last_change":"2024-04-25T22:40:14.631061+0000","last_active":"2024-04-25T22:44:59.107186+0000","last_peered":"2024-04-25T22:44:59.107186+0000","last_clean":"2024-04-25T22:44:59.107186+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:44:59.107186+0000","last_undegraded":"2024-04-25T22:44:59.107186+0000","last_fullsized":"2024-04-25T22:44:59.107186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.544353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18900,"num_write":418,"num_write_kb":117500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"71'64","reported_seq":267,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108997+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:44:59.108997+0000","last_peered":"2024-04-25T22:44:59.108997+0000","last_clean":"2024-04-25T22:44:59.108997+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:44:59.108997+0000","last_undegraded":"2024-04-25T22:44:59.108997+0000","last_fullsized":"2024-04-25T22:44:59.108997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:29:12.605119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'428","reported_seq":631,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103565+0000","last_change":"2024-04-25T22:44:39.129871+0000","last_active":"2024-04-25T22:44:59.103565+0000","last_peered":"2024-04-25T22:44:59.103565+0000","last_clean":"2024-04-25T22:44:59.103565+0000","last_became_active":"2024-04-25T22:44:39.121205+0000","last_became_peered":"2024-04-25T22:44:39.121205+0000","last_unstale":"2024-04-25T22:44:59.103565+0000","last_undegraded":"2024-04-25T22:44:59.103565+0000","last_fullsized":"2024-04-25T22:44:59.103565+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:48.521828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7477,"num_write":383,"num_write_kb":9617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"71'166","reported_seq":322,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103845+0000","last_change":"2024-04-25T22:44:39.133550+0000","last_active":"2024-04-25T22:44:59.103845+0000","last_peered":"2024-04-25T22:44:59.103845+0000","last_clean":"2024-04-25T22:44:59.103845+0000","last_became_active":"2024-04-25T22:44:39.131489+0000","last_became_peered":"2024-04-25T22:44:39.131489+0000","last_unstale":"2024-04-25T22:44:59.103845+0000","last_undegraded":"2024-04-25T22:44:59.103845+0000","last_fullsized":"2024-04-25T22:44:59.103845+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:32.980801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"72'446","reported_seq":696,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108117+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:44:59.108117+0000","last_peered":"2024-04-25T22:44:59.108117+0000","last_clean":"2024-04-25T22:44:59.108117+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:44:59.108117+0000","last_undegraded":"2024-04-25T22:44:59.108117+0000","last_fullsized":"2024-04-25T22:44:59.108117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:29:04.126829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27788,"num_write":414,"num_write_kb":47058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"71'113","reported_seq":316,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108347+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:44:59.108347+0000","last_peered":"2024-04-25T22:44:59.108347+0000","last_clean":"2024-04-25T22:44:59.108347+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:44:59.108347+0000","last_undegraded":"2024-04-25T22:44:59.108347+0000","last_fullsized":"2024-04-25T22:44:59.108347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:56.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"72'417","reported_seq":1019,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108706+0000","last_change":"2024-04-25T22:44:44.113498+0000","last_active":"2024-04-25T22:44:59.108706+0000","last_peered":"2024-04-25T22:44:59.108706+0000","last_clean":"2024-04-25T22:44:59.108706+0000","last_became_active":"2024-04-25T22:44:44.108084+0000","last_became_peered":"2024-04-25T22:44:44.108084+0000","last_unstale":"2024-04-25T22:44:59.108706+0000","last_undegraded":"2024-04-25T22:44:59.108706+0000","last_fullsized":"2024-04-25T22:44:59.108706+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16487,"num_write":388,"num_write_kb":75452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'59","reported_seq":89,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390108+0000","last_change":"2024-04-25T22:44:41.417821+0000","last_active":"2024-04-25T22:44:59.390108+0000","last_peered":"2024-04-25T22:44:59.390108+0000","last_clean":"2024-04-25T22:44:59.390108+0000","last_became_active":"2024-04-25T22:44:41.415769+0000","last_became_peered":"2024-04-25T22:44:41.415769+0000","last_unstale":"2024-04-25T22:44:59.390108+0000","last_undegraded":"2024-04-25T22:44:59.390108+0000","last_fullsized":"2024-04-25T22:44:59.390108+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.099475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'358","reported_seq":900,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107737+0000","last_change":"2024-04-25T22:44:34.101942+0000","last_active":"2024-04-25T22:44:59.107737+0000","last_peered":"2024-04-25T22:44:59.107737+0000","last_clean":"2024-04-25T22:44:59.107737+0000","last_became_active":"2024-04-25T22:44:34.099595+0000","last_became_peered":"2024-04-25T22:44:34.099595+0000","last_unstale":"2024-04-25T22:44:59.107737+0000","last_undegraded":"2024-04-25T22:44:59.107737+0000","last_fullsized":"2024-04-25T22:44:59.107737+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:44:06.523166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12259,"num_write":325,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"71'465","reported_seq":634,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390513+0000","last_change":"2024-04-25T22:44:41.425331+0000","last_active":"2024-04-25T22:44:59.390513+0000","last_peered":"2024-04-25T22:44:59.390513+0000","last_clean":"2024-04-25T22:44:59.390513+0000","last_became_active":"2024-04-25T22:44:41.423799+0000","last_became_peered":"2024-04-25T22:44:41.423799+0000","last_unstale":"2024-04-25T22:44:59.390513+0000","last_undegraded":"2024-04-25T22:44:59.390513+0000","last_fullsized":"2024-04-25T22:44:59.390513+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:04.324825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"72'386","reported_seq":955,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102556+0000","last_change":"2024-04-25T22:44:46.113269+0000","last_active":"2024-04-25T22:44:59.102556+0000","last_peered":"2024-04-25T22:44:59.102556+0000","last_clean":"2024-04-25T22:44:59.102556+0000","last_became_active":"2024-04-25T22:44:46.110394+0000","last_became_peered":"2024-04-25T22:44:46.110394+0000","last_unstale":"2024-04-25T22:44:59.102556+0000","last_undegraded":"2024-04-25T22:44:59.102556+0000","last_fullsized":"2024-04-25T22:44:59.102556+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:47:06.147428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9402,"num_write":352,"num_write_kb":50548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":418,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107397+0000","last_change":"2024-04-25T22:44:26.355770+0000","last_active":"2024-04-25T22:44:59.107397+0000","last_peered":"2024-04-25T22:44:59.107397+0000","last_clean":"2024-04-25T22:44:59.107397+0000","last_became_active":"2024-04-25T22:44:26.354730+0000","last_became_peered":"2024-04-25T22:44:26.354730+0000","last_unstale":"2024-04-25T22:44:59.107397+0000","last_undegraded":"2024-04-25T22:44:59.107397+0000","last_fullsized":"2024-04-25T22:44:59.107397+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:34.987031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":209,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109432+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:44:59.109432+0000","last_peered":"2024-04-25T22:44:59.109432+0000","last_clean":"2024-04-25T22:44:59.109432+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:44:59.109432+0000","last_undegraded":"2024-04-25T22:44:59.109432+0000","last_fullsized":"2024-04-25T22:44:59.109432+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:53.564780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"71'457","reported_seq":676,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103149+0000","last_change":"2024-04-25T22:44:29.399148+0000","last_active":"2024-04-25T22:44:59.103149+0000","last_peered":"2024-04-25T22:44:59.103149+0000","last_clean":"2024-04-25T22:44:59.103149+0000","last_became_active":"2024-04-25T22:44:29.397962+0000","last_became_peered":"2024-04-25T22:44:29.397962+0000","last_unstale":"2024-04-25T22:44:59.103149+0000","last_undegraded":"2024-04-25T22:44:59.103149+0000","last_fullsized":"2024-04-25T22:44:59.103149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:14.015619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"72'447","reported_seq":1111,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108782+0000","last_change":"2024-04-25T22:44:43.108262+0000","last_active":"2024-04-25T22:44:59.108782+0000","last_peered":"2024-04-25T22:44:59.108782+0000","last_clean":"2024-04-25T22:44:59.108782+0000","last_became_active":"2024-04-25T22:44:43.105231+0000","last_became_peered":"2024-04-25T22:44:43.105231+0000","last_unstale":"2024-04-25T22:44:59.108782+0000","last_undegraded":"2024-04-25T22:44:59.108782+0000","last_fullsized":"2024-04-25T22:44:59.108782+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:55:09.728618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45074,"num_write":414,"num_write_kb":120596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":216,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107098+0000","last_change":"2024-04-25T22:44:26.355238+0000","last_active":"2024-04-25T22:44:59.107098+0000","last_peered":"2024-04-25T22:44:59.107098+0000","last_clean":"2024-04-25T22:44:59.107098+0000","last_became_active":"2024-04-25T22:44:26.354482+0000","last_became_peered":"2024-04-25T22:44:26.354482+0000","last_unstale":"2024-04-25T22:44:59.107098+0000","last_undegraded":"2024-04-25T22:44:59.107098+0000","last_fullsized":"2024-04-25T22:44:59.107098+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:50.042514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"72'122","reported_seq":340,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101684+0000","last_change":"2024-04-25T22:44:39.141843+0000","last_active":"2024-04-25T22:44:59.101684+0000","last_peered":"2024-04-25T22:44:59.101684+0000","last_clean":"2024-04-25T22:44:59.101684+0000","last_became_active":"2024-04-25T22:44:39.139689+0000","last_became_peered":"2024-04-25T22:44:39.139689+0000","last_unstale":"2024-04-25T22:44:59.101684+0000","last_undegraded":"2024-04-25T22:44:59.101684+0000","last_fullsized":"2024-04-25T22:44:59.101684+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:10:18.614670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":62,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"72'449","reported_seq":652,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.393126+0000","last_change":"2024-04-25T22:44:41.439044+0000","last_active":"2024-04-25T22:44:59.393126+0000","last_peered":"2024-04-25T22:44:59.393126+0000","last_clean":"2024-04-25T22:44:59.393126+0000","last_became_active":"2024-04-25T22:44:41.432785+0000","last_became_peered":"2024-04-25T22:44:41.432785+0000","last_unstale":"2024-04-25T22:44:59.393126+0000","last_undegraded":"2024-04-25T22:44:59.393126+0000","last_fullsized":"2024-04-25T22:44:59.393126+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:57.171725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25191,"num_write":420,"num_write_kb":79855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101972+0000","last_change":"2024-04-25T22:44:26.363464+0000","last_active":"2024-04-25T22:44:59.101972+0000","last_peered":"2024-04-25T22:44:59.101972+0000","last_clean":"2024-04-25T22:44:59.101972+0000","last_became_active":"2024-04-25T22:44:26.362808+0000","last_became_peered":"2024-04-25T22:44:26.362808+0000","last_unstale":"2024-04-25T22:44:59.101972+0000","last_undegraded":"2024-04-25T22:44:59.101972+0000","last_fullsized":"2024-04-25T22:44:59.101972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:06.276060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'435","reported_seq":630,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.389941+0000","last_change":"2024-04-25T22:44:41.417191+0000","last_active":"2024-04-25T22:44:59.389941+0000","last_peered":"2024-04-25T22:44:59.389941+0000","last_clean":"2024-04-25T22:44:59.389941+0000","last_became_active":"2024-04-25T22:44:41.415592+0000","last_became_peered":"2024-04-25T22:44:41.415592+0000","last_unstale":"2024-04-25T22:44:59.389941+0000","last_undegraded":"2024-04-25T22:44:59.389941+0000","last_fullsized":"2024-04-25T22:44:59.389941+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:35.916512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"72'337","reported_seq":888,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103033+0000","last_change":"2024-04-25T22:44:45.113523+0000","last_active":"2024-04-25T22:44:59.103033+0000","last_peered":"2024-04-25T22:44:59.103033+0000","last_clean":"2024-04-25T22:44:59.103033+0000","last_became_active":"2024-04-25T22:44:45.111011+0000","last_became_peered":"2024-04-25T22:44:45.111011+0000","last_unstale":"2024-04-25T22:44:59.103033+0000","last_undegraded":"2024-04-25T22:44:59.103033+0000","last_fullsized":"2024-04-25T22:44:59.103033+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:24.567996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25242,"num_write":307,"num_write_kb":26250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":209,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108546+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:44:59.108546+0000","last_peered":"2024-04-25T22:44:59.108546+0000","last_clean":"2024-04-25T22:44:59.108546+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:44:59.108546+0000","last_undegraded":"2024-04-25T22:44:59.108546+0000","last_fullsized":"2024-04-25T22:44:59.108546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:37.886846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"71'61","reported_seq":264,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109291+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:44:59.109291+0000","last_peered":"2024-04-25T22:44:59.109291+0000","last_clean":"2024-04-25T22:44:59.109291+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:44:59.109291+0000","last_undegraded":"2024-04-25T22:44:59.109291+0000","last_fullsized":"2024-04-25T22:44:59.109291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:19.062173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'404","reported_seq":1016,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102941+0000","last_change":"2024-04-25T22:44:32.092728+0000","last_active":"2024-04-25T22:44:59.102941+0000","last_peered":"2024-04-25T22:44:59.102941+0000","last_clean":"2024-04-25T22:44:59.102941+0000","last_became_active":"2024-04-25T22:44:32.087528+0000","last_became_peered":"2024-04-25T22:44:32.087528+0000","last_unstale":"2024-04-25T22:44:59.102941+0000","last_undegraded":"2024-04-25T22:44:59.102941+0000","last_fullsized":"2024-04-25T22:44:59.102941+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:39.481467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":20287,"num_write":371,"num_write_kb":59919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'285","reported_seq":488,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109060+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:44:59.109060+0000","last_peered":"2024-04-25T22:44:59.109060+0000","last_clean":"2024-04-25T22:44:59.109060+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:44:59.109060+0000","last_undegraded":"2024-04-25T22:44:59.109060+0000","last_fullsized":"2024-04-25T22:44:59.109060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:07:20.215817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":217,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.104160+0000","last_change":"2024-04-25T22:44:26.364185+0000","last_active":"2024-04-25T22:44:59.104160+0000","last_peered":"2024-04-25T22:44:59.104160+0000","last_clean":"2024-04-25T22:44:59.104160+0000","last_became_active":"2024-04-25T22:44:26.363583+0000","last_became_peered":"2024-04-25T22:44:26.363583+0000","last_unstale":"2024-04-25T22:44:59.104160+0000","last_undegraded":"2024-04-25T22:44:59.104160+0000","last_fullsized":"2024-04-25T22:44:59.104160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:35:04.325449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"72'366","reported_seq":522,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391466+0000","last_change":"2024-04-25T22:44:52.381174+0000","last_active":"2024-04-25T22:44:59.391466+0000","last_peered":"2024-04-25T22:44:59.391466+0000","last_clean":"2024-04-25T22:44:59.391466+0000","last_became_active":"2024-04-25T22:44:52.375504+0000","last_became_peered":"2024-04-25T22:44:52.375504+0000","last_unstale":"2024-04-25T22:44:59.391466+0000","last_undegraded":"2024-04-25T22:44:59.391466+0000","last_fullsized":"2024-04-25T22:44:59.391466+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:04:41.592790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":346,"num_write":330,"num_write_kb":33934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":265,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103283+0000","last_change":"2024-04-25T22:44:26.364178+0000","last_active":"2024-04-25T22:44:59.103283+0000","last_peered":"2024-04-25T22:44:59.103283+0000","last_clean":"2024-04-25T22:44:59.103283+0000","last_became_active":"2024-04-25T22:44:26.363455+0000","last_became_peered":"2024-04-25T22:44:26.363455+0000","last_unstale":"2024-04-25T22:44:59.103283+0000","last_undegraded":"2024-04-25T22:44:59.103283+0000","last_fullsized":"2024-04-25T22:44:59.103283+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:58.181763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":143,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392774+0000","last_change":"2024-04-25T22:44:41.423030+0000","last_active":"2024-04-25T22:44:59.392774+0000","last_peered":"2024-04-25T22:44:59.392774+0000","last_clean":"2024-04-25T22:44:59.392774+0000","last_became_active":"2024-04-25T22:44:41.421194+0000","last_became_peered":"2024-04-25T22:44:41.421194+0000","last_unstale":"2024-04-25T22:44:59.392774+0000","last_undegraded":"2024-04-25T22:44:59.392774+0000","last_fullsized":"2024-04-25T22:44:59.392774+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:59.297537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'413","reported_seq":627,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390506+0000","last_change":"2024-04-25T22:44:48.378474+0000","last_active":"2024-04-25T22:44:59.390506+0000","last_peered":"2024-04-25T22:44:59.390506+0000","last_clean":"2024-04-25T22:44:59.390506+0000","last_became_active":"2024-04-25T22:44:48.372485+0000","last_became_peered":"2024-04-25T22:44:48.372485+0000","last_unstale":"2024-04-25T22:44:59.390506+0000","last_undegraded":"2024-04-25T22:44:59.390506+0000","last_fullsized":"2024-04-25T22:44:59.390506+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:47.402437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22994,"num_write":377,"num_write_kb":63140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'57","reported_seq":269,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103690+0000","last_change":"2024-04-25T22:44:26.366189+0000","last_active":"2024-04-25T22:44:59.103690+0000","last_peered":"2024-04-25T22:44:59.103690+0000","last_clean":"2024-04-25T22:44:59.103690+0000","last_became_active":"2024-04-25T22:44:26.365267+0000","last_became_peered":"2024-04-25T22:44:26.365267+0000","last_unstale":"2024-04-25T22:44:59.103690+0000","last_undegraded":"2024-04-25T22:44:59.103690+0000","last_fullsized":"2024-04-25T22:44:59.103690+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:54.128937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":217,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.104205+0000","last_change":"2024-04-25T22:44:26.361633+0000","last_active":"2024-04-25T22:44:59.104205+0000","last_peered":"2024-04-25T22:44:59.104205+0000","last_clean":"2024-04-25T22:44:59.104205+0000","last_became_active":"2024-04-25T22:44:26.360968+0000","last_became_peered":"2024-04-25T22:44:26.360968+0000","last_unstale":"2024-04-25T22:44:59.104205+0000","last_undegraded":"2024-04-25T22:44:59.104205+0000","last_fullsized":"2024-04-25T22:44:59.104205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:15:40.454898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'398","reported_seq":599,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102087+0000","last_change":"2024-04-25T22:44:39.132801+0000","last_active":"2024-04-25T22:44:59.102087+0000","last_peered":"2024-04-25T22:44:59.102087+0000","last_clean":"2024-04-25T22:44:59.102087+0000","last_became_active":"2024-04-25T22:44:39.124378+0000","last_became_peered":"2024-04-25T22:44:39.124378+0000","last_unstale":"2024-04-25T22:44:59.102087+0000","last_undegraded":"2024-04-25T22:44:59.102087+0000","last_fullsized":"2024-04-25T22:44:59.102087+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:29.195889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6306,"num_write":372,"num_write_kb":34077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"73'100","reported_seq":306,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.104153+0000","last_change":"2024-04-25T22:44:39.150245+0000","last_active":"2024-04-25T22:44:59.104153+0000","last_peered":"2024-04-25T22:44:59.104153+0000","last_clean":"2024-04-25T22:44:59.104153+0000","last_became_active":"2024-04-25T22:44:39.147377+0000","last_became_peered":"2024-04-25T22:44:39.147377+0000","last_unstale":"2024-04-25T22:44:59.104153+0000","last_undegraded":"2024-04-25T22:44:59.104153+0000","last_fullsized":"2024-04-25T22:44:59.104153+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:36.007978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":216,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109540+0000","last_change":"2024-04-25T22:44:26.360890+0000","last_active":"2024-04-25T22:44:59.109540+0000","last_peered":"2024-04-25T22:44:59.109540+0000","last_clean":"2024-04-25T22:44:59.109540+0000","last_became_active":"2024-04-25T22:44:26.360106+0000","last_became_peered":"2024-04-25T22:44:26.360106+0000","last_unstale":"2024-04-25T22:44:59.109540+0000","last_undegraded":"2024-04-25T22:44:59.109540+0000","last_fullsized":"2024-04-25T22:44:59.109540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:09.929196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'390","reported_seq":621,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390857+0000","last_change":"2024-04-25T22:44:41.433574+0000","last_active":"2024-04-25T22:44:59.390857+0000","last_peered":"2024-04-25T22:44:59.390857+0000","last_clean":"2024-04-25T22:44:59.390857+0000","last_became_active":"2024-04-25T22:44:41.414924+0000","last_became_peered":"2024-04-25T22:44:41.414924+0000","last_unstale":"2024-04-25T22:44:59.390857+0000","last_undegraded":"2024-04-25T22:44:59.390857+0000","last_fullsized":"2024-04-25T22:44:59.390857+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:46.695300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":22915,"num_write":352,"num_write_kb":47201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"72'411","reported_seq":1008,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108328+0000","last_change":"2024-04-25T22:44:32.090492+0000","last_active":"2024-04-25T22:44:59.108328+0000","last_peered":"2024-04-25T22:44:59.108328+0000","last_clean":"2024-04-25T22:44:59.108328+0000","last_became_active":"2024-04-25T22:44:32.087303+0000","last_became_peered":"2024-04-25T22:44:32.087303+0000","last_unstale":"2024-04-25T22:44:59.108328+0000","last_undegraded":"2024-04-25T22:44:59.108328+0000","last_fullsized":"2024-04-25T22:44:59.108328+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:09:43.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25412,"num_write":367,"num_write_kb":64656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"72'268","reported_seq":489,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108798+0000","last_change":"2024-04-25T22:44:29.399184+0000","last_active":"2024-04-25T22:44:59.108798+0000","last_peered":"2024-04-25T22:44:59.108798+0000","last_clean":"2024-04-25T22:44:59.108798+0000","last_became_active":"2024-04-25T22:44:29.398317+0000","last_became_peered":"2024-04-25T22:44:29.398317+0000","last_unstale":"2024-04-25T22:44:59.108798+0000","last_undegraded":"2024-04-25T22:44:59.108798+0000","last_fullsized":"2024-04-25T22:44:59.108798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:21.765162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382817,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"72'423","reported_seq":1047,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101400+0000","last_change":"2024-04-25T22:44:42.092243+0000","last_active":"2024-04-25T22:44:59.101400+0000","last_peered":"2024-04-25T22:44:59.101400+0000","last_clean":"2024-04-25T22:44:59.101400+0000","last_became_active":"2024-04-25T22:44:42.088432+0000","last_became_peered":"2024-04-25T22:44:42.088432+0000","last_unstale":"2024-04-25T22:44:59.101400+0000","last_undegraded":"2024-04-25T22:44:59.101400+0000","last_fullsized":"2024-04-25T22:44:59.101400+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:25:54.239406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24794,"num_write":386,"num_write_kb":63756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'102","reported_seq":96,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392357+0000","last_change":"2024-04-25T22:44:41.423993+0000","last_active":"2024-04-25T22:44:59.392357+0000","last_peered":"2024-04-25T22:44:59.392357+0000","last_clean":"2024-04-25T22:44:59.392357+0000","last_became_active":"2024-04-25T22:44:41.422237+0000","last_became_peered":"2024-04-25T22:44:41.422237+0000","last_unstale":"2024-04-25T22:44:59.392357+0000","last_undegraded":"2024-04-25T22:44:59.392357+0000","last_fullsized":"2024-04-25T22:44:59.392357+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:59:02.880774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"71'213","reported_seq":415,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108237+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:44:59.108237+0000","last_peered":"2024-04-25T22:44:59.108237+0000","last_clean":"2024-04-25T22:44:59.108237+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:44:59.108237+0000","last_undegraded":"2024-04-25T22:44:59.108237+0000","last_fullsized":"2024-04-25T22:44:59.108237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:14.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"72'504","reported_seq":769,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101135+0000","last_change":"2024-04-25T22:44:39.142694+0000","last_active":"2024-04-25T22:44:59.101135+0000","last_peered":"2024-04-25T22:44:59.101135+0000","last_clean":"2024-04-25T22:44:59.101135+0000","last_became_active":"2024-04-25T22:44:39.132582+0000","last_became_peered":"2024-04-25T22:44:39.132582+0000","last_unstale":"2024-04-25T22:44:59.101135+0000","last_undegraded":"2024-04-25T22:44:59.101135+0000","last_fullsized":"2024-04-25T22:44:59.101135+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:14.401644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":46975,"num_write":471,"num_write_kb":146290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'64","reported_seq":219,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103398+0000","last_change":"2024-04-25T22:44:39.136961+0000","last_active":"2024-04-25T22:44:59.103398+0000","last_peered":"2024-04-25T22:44:59.103398+0000","last_clean":"2024-04-25T22:44:59.103398+0000","last_became_active":"2024-04-25T22:44:39.136090+0000","last_became_peered":"2024-04-25T22:44:39.136090+0000","last_unstale":"2024-04-25T22:44:59.103398+0000","last_undegraded":"2024-04-25T22:44:59.103398+0000","last_fullsized":"2024-04-25T22:44:59.103398+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:35.220314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"72'475","reported_seq":1154,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101544+0000","last_change":"2024-04-25T22:44:44.106484+0000","last_active":"2024-04-25T22:44:59.101544+0000","last_peered":"2024-04-25T22:44:59.101544+0000","last_clean":"2024-04-25T22:44:59.101544+0000","last_became_active":"2024-04-25T22:44:44.102061+0000","last_became_peered":"2024-04-25T22:44:44.102061+0000","last_unstale":"2024-04-25T22:44:59.101544+0000","last_undegraded":"2024-04-25T22:44:59.101544+0000","last_fullsized":"2024-04-25T22:44:59.101544+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:05.455255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":23011,"num_write":448,"num_write_kb":76439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"72'370","reported_seq":567,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392775+0000","last_change":"2024-04-25T22:44:56.420080+0000","last_active":"2024-04-25T22:44:59.392775+0000","last_peered":"2024-04-25T22:44:59.392775+0000","last_clean":"2024-04-25T22:44:59.392775+0000","last_became_active":"2024-04-25T22:44:56.414231+0000","last_became_peered":"2024-04-25T22:44:56.414231+0000","last_unstale":"2024-04-25T22:44:59.392775+0000","last_undegraded":"2024-04-25T22:44:59.392775+0000","last_fullsized":"2024-04-25T22:44:59.392775+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:26:22.002829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33211,"num_write":340,"num_write_kb":63312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"71'647","reported_seq":865,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102434+0000","last_change":"2024-04-25T22:44:30.396965+0000","last_active":"2024-04-25T22:44:59.102434+0000","last_peered":"2024-04-25T22:44:59.102434+0000","last_clean":"2024-04-25T22:44:59.102434+0000","last_became_active":"2024-04-25T22:44:30.396073+0000","last_became_peered":"2024-04-25T22:44:30.396073+0000","last_unstale":"2024-04-25T22:44:59.102434+0000","last_undegraded":"2024-04-25T22:44:59.102434+0000","last_fullsized":"2024-04-25T22:44:59.102434+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:58:46.169103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"72'415","reported_seq":636,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102938+0000","last_change":"2024-04-25T22:44:39.150290+0000","last_active":"2024-04-25T22:44:59.102938+0000","last_peered":"2024-04-25T22:44:59.102938+0000","last_clean":"2024-04-25T22:44:59.102938+0000","last_became_active":"2024-04-25T22:44:39.146949+0000","last_became_peered":"2024-04-25T22:44:39.146949+0000","last_unstale":"2024-04-25T22:44:59.102938+0000","last_undegraded":"2024-04-25T22:44:59.102938+0000","last_fullsized":"2024-04-25T22:44:59.102938+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:11.804350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19493,"num_write":386,"num_write_kb":64692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"71'207","reported_seq":362,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101542+0000","last_change":"2024-04-25T22:44:39.141125+0000","last_active":"2024-04-25T22:44:59.101542+0000","last_peered":"2024-04-25T22:44:59.101542+0000","last_clean":"2024-04-25T22:44:59.101542+0000","last_became_active":"2024-04-25T22:44:39.138371+0000","last_became_peered":"2024-04-25T22:44:39.138371+0000","last_unstale":"2024-04-25T22:44:59.101542+0000","last_undegraded":"2024-04-25T22:44:59.101542+0000","last_fullsized":"2024-04-25T22:44:59.101542+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:14.147026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"72'395","reported_seq":562,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392340+0000","last_change":"2024-04-25T22:44:55.406524+0000","last_active":"2024-04-25T22:44:59.392340+0000","last_peered":"2024-04-25T22:44:59.392340+0000","last_clean":"2024-04-25T22:44:59.392340+0000","last_became_active":"2024-04-25T22:44:55.396613+0000","last_became_peered":"2024-04-25T22:44:55.396613+0000","last_unstale":"2024-04-25T22:44:59.392340+0000","last_undegraded":"2024-04-25T22:44:59.392340+0000","last_fullsized":"2024-04-25T22:44:59.392340+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:41.515369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9576,"num_write":348,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'194","reported_seq":363,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391176+0000","last_change":"2024-04-25T22:44:41.422369+0000","last_active":"2024-04-25T22:44:59.391176+0000","last_peered":"2024-04-25T22:44:59.391176+0000","last_clean":"2024-04-25T22:44:59.391176+0000","last_became_active":"2024-04-25T22:44:41.420491+0000","last_became_peered":"2024-04-25T22:44:41.420491+0000","last_unstale":"2024-04-25T22:44:59.391176+0000","last_undegraded":"2024-04-25T22:44:59.391176+0000","last_fullsized":"2024-04-25T22:44:59.391176+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:04:35.081225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360511,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":12143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12360511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"72'398","reported_seq":593,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391353+0000","last_change":"2024-04-25T22:44:52.381363+0000","last_active":"2024-04-25T22:44:59.391353+0000","last_peered":"2024-04-25T22:44:59.391353+0000","last_clean":"2024-04-25T22:44:59.391353+0000","last_became_active":"2024-04-25T22:44:52.375632+0000","last_became_peered":"2024-04-25T22:44:52.375632+0000","last_unstale":"2024-04-25T22:44:59.391353+0000","last_undegraded":"2024-04-25T22:44:59.391353+0000","last_fullsized":"2024-04-25T22:44:59.391353+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:38:28.441621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31284,"num_write":371,"num_write_kb":80144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"71'51","reported_seq":94,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390518+0000","last_change":"2024-04-25T22:44:41.415722+0000","last_active":"2024-04-25T22:44:59.390518+0000","last_peered":"2024-04-25T22:44:59.390518+0000","last_clean":"2024-04-25T22:44:59.390518+0000","last_became_active":"2024-04-25T22:44:41.414774+0000","last_became_peered":"2024-04-25T22:44:41.414774+0000","last_unstale":"2024-04-25T22:44:59.390518+0000","last_undegraded":"2024-04-25T22:44:59.390518+0000","last_fullsized":"2024-04-25T22:44:59.390518+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:20.553373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"72'383","reported_seq":635,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107059+0000","last_change":"2024-04-25T22:40:14.632997+0000","last_active":"2024-04-25T22:44:59.107059+0000","last_peered":"2024-04-25T22:44:59.107059+0000","last_clean":"2024-04-25T22:44:59.107059+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:44:59.107059+0000","last_undegraded":"2024-04-25T22:44:59.107059+0000","last_fullsized":"2024-04-25T22:44:59.107059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:55.830804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29308,"num_write":358,"num_write_kb":66975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"71'177","reported_seq":379,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108565+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:44:59.108565+0000","last_peered":"2024-04-25T22:44:59.108565+0000","last_clean":"2024-04-25T22:44:59.108565+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:44:59.108565+0000","last_undegraded":"2024-04-25T22:44:59.108565+0000","last_fullsized":"2024-04-25T22:44:59.108565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:59.249883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"72'387","reported_seq":600,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107381+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:44:59.107381+0000","last_peered":"2024-04-25T22:44:59.107381+0000","last_clean":"2024-04-25T22:44:59.107381+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:44:59.107381+0000","last_undegraded":"2024-04-25T22:44:59.107381+0000","last_fullsized":"2024-04-25T22:44:59.107381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:49:32.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3883,"num_write":348,"num_write_kb":34122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'209","reported_seq":413,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391358+0000","last_change":"2024-04-25T22:44:41.419972+0000","last_active":"2024-04-25T22:44:59.391358+0000","last_peered":"2024-04-25T22:44:59.391358+0000","last_clean":"2024-04-25T22:44:59.391358+0000","last_became_active":"2024-04-25T22:44:41.418106+0000","last_became_peered":"2024-04-25T22:44:41.418106+0000","last_unstale":"2024-04-25T22:44:59.391358+0000","last_undegraded":"2024-04-25T22:44:59.391358+0000","last_fullsized":"2024-04-25T22:44:59.391358+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:07.628155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":12363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"72'419","reported_seq":607,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390493+0000","last_change":"2024-04-25T22:44:41.434376+0000","last_active":"2024-04-25T22:44:59.390493+0000","last_peered":"2024-04-25T22:44:59.390493+0000","last_clean":"2024-04-25T22:44:59.390493+0000","last_became_active":"2024-04-25T22:44:41.420505+0000","last_became_peered":"2024-04-25T22:44:41.420505+0000","last_unstale":"2024-04-25T22:44:59.390493+0000","last_undegraded":"2024-04-25T22:44:59.390493+0000","last_fullsized":"2024-04-25T22:44:59.390493+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:04.414563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":13327,"num_write":388,"num_write_kb":55674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"71'131","reported_seq":349,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103634+0000","last_change":"2024-04-25T22:44:29.398880+0000","last_active":"2024-04-25T22:44:59.103634+0000","last_peered":"2024-04-25T22:44:59.103634+0000","last_clean":"2024-04-25T22:44:59.103634+0000","last_became_active":"2024-04-25T22:44:29.397905+0000","last_became_peered":"2024-04-25T22:44:29.397905+0000","last_unstale":"2024-04-25T22:44:59.103634+0000","last_undegraded":"2024-04-25T22:44:59.103634+0000","last_fullsized":"2024-04-25T22:44:59.103634+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:44.236330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"72'449","reported_seq":683,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107034+0000","last_change":"2024-04-25T22:40:14.633198+0000","last_active":"2024-04-25T22:44:59.107034+0000","last_peered":"2024-04-25T22:44:59.107034+0000","last_clean":"2024-04-25T22:44:59.107034+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:44:59.107034+0000","last_undegraded":"2024-04-25T22:44:59.107034+0000","last_fullsized":"2024-04-25T22:44:59.107034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:54:03.581189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14222,"num_write":424,"num_write_kb":79796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"71'57","reported_seq":213,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103091+0000","last_change":"2024-04-25T22:44:39.137232+0000","last_active":"2024-04-25T22:44:59.103091+0000","last_peered":"2024-04-25T22:44:59.103091+0000","last_clean":"2024-04-25T22:44:59.103091+0000","last_became_active":"2024-04-25T22:44:39.136283+0000","last_became_peered":"2024-04-25T22:44:39.136283+0000","last_unstale":"2024-04-25T22:44:59.103091+0000","last_undegraded":"2024-04-25T22:44:59.103091+0000","last_fullsized":"2024-04-25T22:44:59.103091+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:32.428982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2461,"num_read_kb":1248646,"num_write":24434,"num_write_kb":4137258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7447,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26539,"ondisk_log_size":26539,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127071275,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":4473,"num_write_kb":127409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254210048,"data_stored":254142550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},"log_size":6216,"ondisk_log_size":6216,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738434,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165344,"kb_used_data":80080,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94206496,"statfs":{"total":96636764160,"available":96467451904,"internally_reserved":0,"allocated":82001920,"data_stored":81417710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":79,"seq":339302416394,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141408,"kb_used_data":83340,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94230432,"statfs":{"total":96636764160,"available":96491962368,"internally_reserved":0,"allocated":85340160,"data_stored":84739534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6003,"internal_metadata":59435149},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738434,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174352,"kb_used_data":89088,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94197488,"statfs":{"total":96636764160,"available":96458227712,"internally_reserved":0,"allocated":91226112,"data_stored":90619941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89575424,"data_stored":89544940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83689472,"data_stored":83664533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80945152,"data_stored":80933077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:45:08.447 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.447 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.447 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.447 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.447 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.447 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.448 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.448 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.448 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.448 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.448 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.448 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.449 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.449 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.449 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.449 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.449 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.449 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.450 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.450 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.450 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.450 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.450 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.450 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.450 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.450 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.451 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.451 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.451 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.451 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.451 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.451 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.451 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.451 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.451 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.452 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.452 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.452 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.452 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.452 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.452 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.452 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.452 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.452 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.453 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.453 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.453 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.453 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.453 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.453 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.454 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.454 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.454 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.454 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.454 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.454 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.455 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T22:40:03.263093+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.455 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T22:40:08.425969+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.455 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.455 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.455 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T22:40:08.425969+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.456 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.456 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.456 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T22:40:08.425969+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.456 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.456 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.457 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T22:40:08.425969+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.457 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.457 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.457 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.457 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T22:40:08.425969+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.457 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.458 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.458 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T22:40:08.425969+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.458 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.458 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.458 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T22:40:08.425969+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.459 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.459 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.459 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T22:40:08.425969+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.459 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.459 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.459 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.460 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.460 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.460 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.460 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.460 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.461 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.461 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.461 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.461 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.461 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.461 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.462 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.462 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.462 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.462 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.462 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.463 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.463 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.463 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.463 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.463 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.463 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:08.464 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T22:45:28.465 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:45:28.779 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:45:28.781 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:45:28.799 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":274,"stamp":"2024-04-25T22:45:27.252660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127661643,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2659,"num_read_kb":1250233,"num_write":29110,"num_write_kb":4268127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7469,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32935,"ondisk_log_size":32935,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":481076,"kb_used_data":252508,"kb_used_omap":8,"kb_used_meta":228535,"kb_avail":282634444,"statfs":{"total":289910292480,"available":289417670656,"internally_reserved":0,"allocated":258568192,"data_stored":256777185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9193,"internal_metadata":234019863},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004447"},"pg_stats":[{"pgid":"4.3f","version":"72'404","reported_seq":560,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.393264+0000","last_change":"2024-04-25T22:44:57.382564+0000","last_active":"2024-04-25T22:44:59.393264+0000","last_peered":"2024-04-25T22:44:59.393264+0000","last_clean":"2024-04-25T22:44:59.393264+0000","last_became_active":"2024-04-25T22:44:57.376098+0000","last_became_peered":"2024-04-25T22:44:57.376098+0000","last_unstale":"2024-04-25T22:44:59.393264+0000","last_undegraded":"2024-04-25T22:44:59.393264+0000","last_fullsized":"2024-04-25T22:44:59.393264+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19772,"num_write":366,"num_write_kb":46873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"72'420","reported_seq":631,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:12.184338+0000","last_change":"2024-04-25T22:45:12.184395+0000","last_active":"2024-04-25T22:45:12.184338+0000","last_peered":"2024-04-25T22:45:12.184338+0000","last_clean":"2024-04-25T22:45:12.184338+0000","last_became_active":"2024-04-25T22:44:41.418792+0000","last_became_peered":"2024-04-25T22:44:41.418792+0000","last_unstale":"2024-04-25T22:45:12.184338+0000","last_undegraded":"2024-04-25T22:45:12.184338+0000","last_fullsized":"2024-04-25T22:45:12.184338+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'420","last_scrub_stamp":"2024-04-25T22:45:12.184147+0000","last_deep_scrub":"72'420","last_deep_scrub_stamp":"2024-04-25T22:45:12.184147+0000","last_clean_scrub_stamp":"2024-04-25T22:45:12.184147+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:42:08.825155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24515,"num_write":386,"num_write_kb":55688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"72'377","reported_seq":953,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107550+0000","last_change":"2024-04-25T22:44:42.096911+0000","last_active":"2024-04-25T22:44:59.107550+0000","last_peered":"2024-04-25T22:44:59.107550+0000","last_clean":"2024-04-25T22:44:59.107550+0000","last_became_active":"2024-04-25T22:44:42.093941+0000","last_became_peered":"2024-04-25T22:44:42.093941+0000","last_unstale":"2024-04-25T22:44:59.107550+0000","last_undegraded":"2024-04-25T22:44:59.107550+0000","last_fullsized":"2024-04-25T22:44:59.107550+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11135,"num_write":346,"num_write_kb":38950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"72'366","reported_seq":582,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:20.800938+0000","last_change":"2024-04-25T22:45:20.800998+0000","last_active":"2024-04-25T22:45:20.800938+0000","last_peered":"2024-04-25T22:45:20.800938+0000","last_clean":"2024-04-25T22:45:20.800938+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:45:20.800938+0000","last_undegraded":"2024-04-25T22:45:20.800938+0000","last_fullsized":"2024-04-25T22:45:20.800938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'366","last_scrub_stamp":"2024-04-25T22:45:20.800720+0000","last_deep_scrub":"72'366","last_deep_scrub_stamp":"2024-04-25T22:45:20.800720+0000","last_clean_scrub_stamp":"2024-04-25T22:45:20.800720+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:30:30.198446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":326,"num_write_kb":34079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"72'455","reported_seq":644,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:21.294505+0000","last_change":"2024-04-25T22:45:21.294650+0000","last_active":"2024-04-25T22:45:21.294505+0000","last_peered":"2024-04-25T22:45:21.294505+0000","last_clean":"2024-04-25T22:45:21.294505+0000","last_became_active":"2024-04-25T22:44:50.384804+0000","last_became_peered":"2024-04-25T22:44:50.384804+0000","last_unstale":"2024-04-25T22:45:21.294505+0000","last_undegraded":"2024-04-25T22:45:21.294505+0000","last_fullsized":"2024-04-25T22:45:21.294505+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'455","last_scrub_stamp":"2024-04-25T22:45:21.294262+0000","last_deep_scrub":"72'455","last_deep_scrub_stamp":"2024-04-25T22:45:21.294262+0000","last_clean_scrub_stamp":"2024-04-25T22:45:21.294262+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:23:59.755528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33897,"num_write":426,"num_write_kb":100721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"72'401","reported_seq":645,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:13.805050+0000","last_change":"2024-04-25T22:45:13.805050+0000","last_active":"2024-04-25T22:45:13.805050+0000","last_peered":"2024-04-25T22:45:13.805050+0000","last_clean":"2024-04-25T22:45:13.805050+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:45:13.805050+0000","last_undegraded":"2024-04-25T22:45:13.805050+0000","last_fullsized":"2024-04-25T22:45:13.805050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'401","last_scrub_stamp":"2024-04-25T22:45:13.804798+0000","last_deep_scrub":"72'401","last_deep_scrub_stamp":"2024-04-25T22:45:13.804798+0000","last_clean_scrub_stamp":"2024-04-25T22:45:13.804798+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:59.583390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15258,"num_write":369,"num_write_kb":53298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"72'452","reported_seq":728,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:18.816458+0000","last_change":"2024-04-25T22:45:18.816514+0000","last_active":"2024-04-25T22:45:18.816458+0000","last_peered":"2024-04-25T22:45:18.816458+0000","last_clean":"2024-04-25T22:45:18.816458+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:45:18.816458+0000","last_undegraded":"2024-04-25T22:45:18.816458+0000","last_fullsized":"2024-04-25T22:45:18.816458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'452","last_scrub_stamp":"2024-04-25T22:45:18.816273+0000","last_deep_scrub":"72'452","last_deep_scrub_stamp":"2024-04-25T22:45:18.816273+0000","last_clean_scrub_stamp":"2024-04-25T22:45:18.816273+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:12.155613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34010,"num_write":428,"num_write_kb":157752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"72'401","reported_seq":642,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:07.146393+0000","last_change":"2024-04-25T22:40:14.636079+0000","last_active":"2024-04-25T22:45:07.146393+0000","last_peered":"2024-04-25T22:45:07.146393+0000","last_clean":"2024-04-25T22:45:07.146393+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:45:07.146393+0000","last_undegraded":"2024-04-25T22:45:07.146393+0000","last_fullsized":"2024-04-25T22:45:07.146393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19917,"num_write":359,"num_write_kb":109382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"72'394","reported_seq":982,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:07.272441+0000","last_change":"2024-04-25T22:44:48.092689+0000","last_active":"2024-04-25T22:45:07.272441+0000","last_peered":"2024-04-25T22:45:07.272441+0000","last_clean":"2024-04-25T22:45:07.272441+0000","last_became_active":"2024-04-25T22:44:48.089795+0000","last_became_peered":"2024-04-25T22:44:48.089795+0000","last_unstale":"2024-04-25T22:45:07.272441+0000","last_undegraded":"2024-04-25T22:45:07.272441+0000","last_fullsized":"2024-04-25T22:45:07.272441+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9569,"num_write":360,"num_write_kb":25560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"72'382","reported_seq":575,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:16.197759+0000","last_change":"2024-04-25T22:45:16.197815+0000","last_active":"2024-04-25T22:45:16.197759+0000","last_peered":"2024-04-25T22:45:16.197759+0000","last_clean":"2024-04-25T22:45:16.197759+0000","last_became_active":"2024-04-25T22:44:41.421234+0000","last_became_peered":"2024-04-25T22:44:41.421234+0000","last_unstale":"2024-04-25T22:45:16.197759+0000","last_undegraded":"2024-04-25T22:45:16.197759+0000","last_fullsized":"2024-04-25T22:45:16.197759+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'382","last_scrub_stamp":"2024-04-25T22:45:16.197564+0000","last_deep_scrub":"72'382","last_deep_scrub_stamp":"2024-04-25T22:45:16.197564+0000","last_clean_scrub_stamp":"2024-04-25T22:45:16.197564+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:55.640137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17192,"num_write":338,"num_write_kb":38688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"72'369","reported_seq":594,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:07.146578+0000","last_change":"2024-04-25T22:40:14.637343+0000","last_active":"2024-04-25T22:45:07.146578+0000","last_peered":"2024-04-25T22:45:07.146578+0000","last_clean":"2024-04-25T22:45:07.146578+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:45:07.146578+0000","last_undegraded":"2024-04-25T22:45:07.146578+0000","last_fullsized":"2024-04-25T22:45:07.146578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7385,"num_write":349,"num_write_kb":58842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"72'338","reported_seq":531,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:19.204479+0000","last_change":"2024-04-25T22:45:19.204542+0000","last_active":"2024-04-25T22:45:19.204479+0000","last_peered":"2024-04-25T22:45:19.204479+0000","last_clean":"2024-04-25T22:45:19.204479+0000","last_became_active":"2024-04-25T22:44:49.378325+0000","last_became_peered":"2024-04-25T22:44:49.378325+0000","last_unstale":"2024-04-25T22:45:19.204479+0000","last_undegraded":"2024-04-25T22:45:19.204479+0000","last_fullsized":"2024-04-25T22:45:19.204479+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'338","last_scrub_stamp":"2024-04-25T22:45:19.204281+0000","last_deep_scrub":"72'338","last_deep_scrub_stamp":"2024-04-25T22:45:19.204281+0000","last_clean_scrub_stamp":"2024-04-25T22:45:19.204281+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:24:35.194784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13619,"num_write":312,"num_write_kb":21391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"72'411","reported_seq":614,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:20.249763+0000","last_change":"2024-04-25T22:45:20.249821+0000","last_active":"2024-04-25T22:45:20.249763+0000","last_peered":"2024-04-25T22:45:20.249763+0000","last_clean":"2024-04-25T22:45:20.249763+0000","last_became_active":"2024-04-25T22:44:41.421096+0000","last_became_peered":"2024-04-25T22:44:41.421096+0000","last_unstale":"2024-04-25T22:45:20.249763+0000","last_undegraded":"2024-04-25T22:45:20.249763+0000","last_fullsized":"2024-04-25T22:45:20.249763+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'411","last_scrub_stamp":"2024-04-25T22:45:20.249567+0000","last_deep_scrub":"72'411","last_deep_scrub_stamp":"2024-04-25T22:45:20.249567+0000","last_clean_scrub_stamp":"2024-04-25T22:45:20.249567+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:01.734764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12998,"num_write":375,"num_write_kb":79661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"72'452","reported_seq":1052,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107228+0000","last_change":"2024-04-25T22:44:40.130299+0000","last_active":"2024-04-25T22:44:59.107228+0000","last_peered":"2024-04-25T22:44:59.107228+0000","last_clean":"2024-04-25T22:44:59.107228+0000","last_became_active":"2024-04-25T22:44:40.127307+0000","last_became_peered":"2024-04-25T22:44:40.127307+0000","last_unstale":"2024-04-25T22:44:59.107228+0000","last_undegraded":"2024-04-25T22:44:59.107228+0000","last_fullsized":"2024-04-25T22:44:59.107228+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":854,"num_write":419,"num_write_kb":88217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"72'428","reported_seq":1032,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106525+0000","last_change":"2024-04-25T22:44:35.108361+0000","last_active":"2024-04-25T22:44:59.106525+0000","last_peered":"2024-04-25T22:44:59.106525+0000","last_clean":"2024-04-25T22:44:59.106525+0000","last_became_active":"2024-04-25T22:44:35.103208+0000","last_became_peered":"2024-04-25T22:44:35.103208+0000","last_unstale":"2024-04-25T22:44:59.106525+0000","last_undegraded":"2024-04-25T22:44:59.106525+0000","last_fullsized":"2024-04-25T22:44:59.106525+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21291,"num_write":389,"num_write_kb":68562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"72'401","reported_seq":624,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:17.806706+0000","last_change":"2024-04-25T22:45:17.806824+0000","last_active":"2024-04-25T22:45:17.806706+0000","last_peered":"2024-04-25T22:45:17.806706+0000","last_clean":"2024-04-25T22:45:17.806706+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:45:17.806706+0000","last_undegraded":"2024-04-25T22:45:17.806706+0000","last_fullsized":"2024-04-25T22:45:17.806706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'401","last_scrub_stamp":"2024-04-25T22:45:17.806458+0000","last_deep_scrub":"72'401","last_deep_scrub_stamp":"2024-04-25T22:45:17.806458+0000","last_clean_scrub_stamp":"2024-04-25T22:45:17.806458+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:08.446390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8276,"num_write":369,"num_write_kb":17867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"72'398","reported_seq":972,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103642+0000","last_change":"2024-04-25T22:44:49.097340+0000","last_active":"2024-04-25T22:44:59.103642+0000","last_peered":"2024-04-25T22:44:59.103642+0000","last_clean":"2024-04-25T22:44:59.103642+0000","last_became_active":"2024-04-25T22:44:49.094478+0000","last_became_peered":"2024-04-25T22:44:49.094478+0000","last_unstale":"2024-04-25T22:44:59.103642+0000","last_undegraded":"2024-04-25T22:44:59.103642+0000","last_fullsized":"2024-04-25T22:44:59.103642+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5883,"num_write":362,"num_write_kb":38188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"72'407","reported_seq":544,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.402519+0000","last_change":"2024-04-25T22:44:59.401367+0000","last_active":"2024-04-25T22:44:59.402519+0000","last_peered":"2024-04-25T22:44:59.402519+0000","last_clean":"2024-04-25T22:44:59.402519+0000","last_became_active":"2024-04-25T22:44:59.396404+0000","last_became_peered":"2024-04-25T22:44:59.396404+0000","last_unstale":"2024-04-25T22:44:59.402519+0000","last_undegraded":"2024-04-25T22:44:59.402519+0000","last_fullsized":"2024-04-25T22:44:59.402519+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13073,"num_write":372,"num_write_kb":59323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"72'441","reported_seq":1060,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102861+0000","last_change":"2024-04-25T22:44:41.148409+0000","last_active":"2024-04-25T22:44:59.102861+0000","last_peered":"2024-04-25T22:44:59.102861+0000","last_clean":"2024-04-25T22:44:59.102861+0000","last_became_active":"2024-04-25T22:44:41.143302+0000","last_became_peered":"2024-04-25T22:44:41.143302+0000","last_unstale":"2024-04-25T22:44:59.102861+0000","last_undegraded":"2024-04-25T22:44:59.102861+0000","last_fullsized":"2024-04-25T22:44:59.102861+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37611,"num_write":403,"num_write_kb":116618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"72'438","reported_seq":673,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:19.816036+0000","last_change":"2024-04-25T22:45:19.816093+0000","last_active":"2024-04-25T22:45:19.816036+0000","last_peered":"2024-04-25T22:45:19.816036+0000","last_clean":"2024-04-25T22:45:19.816036+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:45:19.816036+0000","last_undegraded":"2024-04-25T22:45:19.816036+0000","last_fullsized":"2024-04-25T22:45:19.816036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'438","last_scrub_stamp":"2024-04-25T22:45:19.815827+0000","last_deep_scrub":"72'438","last_deep_scrub_stamp":"2024-04-25T22:45:19.815827+0000","last_clean_scrub_stamp":"2024-04-25T22:45:19.815827+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:36:57.469378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12393,"num_write":408,"num_write_kb":99933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"72'407","reported_seq":631,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:16.780914+0000","last_change":"2024-04-25T22:45:16.780971+0000","last_active":"2024-04-25T22:45:16.780914+0000","last_peered":"2024-04-25T22:45:16.780914+0000","last_clean":"2024-04-25T22:45:16.780914+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:45:16.780914+0000","last_undegraded":"2024-04-25T22:45:16.780914+0000","last_fullsized":"2024-04-25T22:45:16.780914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'407","last_scrub_stamp":"2024-04-25T22:45:16.780720+0000","last_deep_scrub":"72'407","last_deep_scrub_stamp":"2024-04-25T22:45:16.780720+0000","last_clean_scrub_stamp":"2024-04-25T22:45:16.780720+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:18.464252+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8932,"num_write":382,"num_write_kb":59684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"72'463","reported_seq":701,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:15.170317+0000","last_change":"2024-04-25T22:45:15.170394+0000","last_active":"2024-04-25T22:45:15.170317+0000","last_peered":"2024-04-25T22:45:15.170317+0000","last_clean":"2024-04-25T22:45:15.170317+0000","last_became_active":"2024-04-25T22:44:47.369995+0000","last_became_peered":"2024-04-25T22:44:47.369995+0000","last_unstale":"2024-04-25T22:45:15.170317+0000","last_undegraded":"2024-04-25T22:45:15.170317+0000","last_fullsized":"2024-04-25T22:45:15.170317+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'463","last_scrub_stamp":"2024-04-25T22:45:15.170124+0000","last_deep_scrub":"72'463","last_deep_scrub_stamp":"2024-04-25T22:45:15.170124+0000","last_clean_scrub_stamp":"2024-04-25T22:45:15.170124+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:16:47.186871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27589,"num_write":428,"num_write_kb":76861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"72'425","reported_seq":703,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:13.959533+0000","last_change":"2024-04-25T22:45:13.959595+0000","last_active":"2024-04-25T22:45:13.959533+0000","last_peered":"2024-04-25T22:45:13.959533+0000","last_clean":"2024-04-25T22:45:13.959533+0000","last_became_active":"2024-04-25T22:44:39.118635+0000","last_became_peered":"2024-04-25T22:44:39.118635+0000","last_unstale":"2024-04-25T22:45:13.959533+0000","last_undegraded":"2024-04-25T22:45:13.959533+0000","last_fullsized":"2024-04-25T22:45:13.959533+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'425","last_scrub_stamp":"2024-04-25T22:45:13.959287+0000","last_deep_scrub":"72'425","last_deep_scrub_stamp":"2024-04-25T22:45:13.959287+0000","last_clean_scrub_stamp":"2024-04-25T22:45:13.959287+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:32.240463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":46424,"num_write":390,"num_write_kb":96359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"72'445","reported_seq":628,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:08.104270+0000","last_change":"2024-04-25T22:45:08.104354+0000","last_active":"2024-04-25T22:45:08.104270+0000","last_peered":"2024-04-25T22:45:08.104270+0000","last_clean":"2024-04-25T22:45:08.104270+0000","last_became_active":"2024-04-25T22:44:54.382124+0000","last_became_peered":"2024-04-25T22:44:54.382124+0000","last_unstale":"2024-04-25T22:45:08.104270+0000","last_undegraded":"2024-04-25T22:45:08.104270+0000","last_fullsized":"2024-04-25T22:45:08.104270+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'445","last_scrub_stamp":"2024-04-25T22:45:08.104062+0000","last_deep_scrub":"72'445","last_deep_scrub_stamp":"2024-04-25T22:45:08.104062+0000","last_clean_scrub_stamp":"2024-04-25T22:45:08.104062+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:05.080111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32317,"num_write":419,"num_write_kb":76071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"72'424","reported_seq":599,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:23.308204+0000","last_change":"2024-04-25T22:45:23.308261+0000","last_active":"2024-04-25T22:45:23.308204+0000","last_peered":"2024-04-25T22:45:23.308204+0000","last_clean":"2024-04-25T22:45:23.308204+0000","last_became_active":"2024-04-25T22:44:51.383461+0000","last_became_peered":"2024-04-25T22:44:51.383461+0000","last_unstale":"2024-04-25T22:45:23.308204+0000","last_undegraded":"2024-04-25T22:45:23.308204+0000","last_fullsized":"2024-04-25T22:45:23.308204+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'424","last_scrub_stamp":"2024-04-25T22:45:23.308006+0000","last_deep_scrub":"72'424","last_deep_scrub_stamp":"2024-04-25T22:45:23.308006+0000","last_clean_scrub_stamp":"2024-04-25T22:45:23.308006+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:18.496607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8396,"num_write":399,"num_write_kb":50416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"72'499","reported_seq":719,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:19.029685+0000","last_change":"2024-04-25T22:45:19.029744+0000","last_active":"2024-04-25T22:45:19.029685+0000","last_peered":"2024-04-25T22:45:19.029685+0000","last_clean":"2024-04-25T22:45:19.029685+0000","last_became_active":"2024-04-25T22:44:39.143391+0000","last_became_peered":"2024-04-25T22:44:39.143391+0000","last_unstale":"2024-04-25T22:45:19.029685+0000","last_undegraded":"2024-04-25T22:45:19.029685+0000","last_fullsized":"2024-04-25T22:45:19.029685+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'499","last_scrub_stamp":"2024-04-25T22:45:19.029484+0000","last_deep_scrub":"72'499","last_deep_scrub_stamp":"2024-04-25T22:45:19.029484+0000","last_clean_scrub_stamp":"2024-04-25T22:45:19.029484+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:40.593352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10227,"num_write":453,"num_write_kb":96585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'430","reported_seq":1083,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108426+0000","last_change":"2024-04-25T22:44:39.113437+0000","last_active":"2024-04-25T22:44:59.108426+0000","last_peered":"2024-04-25T22:44:59.108426+0000","last_clean":"2024-04-25T22:44:59.108426+0000","last_became_active":"2024-04-25T22:44:39.109771+0000","last_became_peered":"2024-04-25T22:44:39.109771+0000","last_unstale":"2024-04-25T22:44:59.108426+0000","last_undegraded":"2024-04-25T22:44:59.108426+0000","last_fullsized":"2024-04-25T22:44:59.108426+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":32116,"num_write":409,"num_write_kb":89217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"72'393","reported_seq":665,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:22.342484+0000","last_change":"2024-04-25T22:45:22.342612+0000","last_active":"2024-04-25T22:45:22.342484+0000","last_peered":"2024-04-25T22:45:22.342484+0000","last_clean":"2024-04-25T22:45:22.342484+0000","last_became_active":"2024-04-25T22:44:41.413570+0000","last_became_peered":"2024-04-25T22:44:41.413570+0000","last_unstale":"2024-04-25T22:45:22.342484+0000","last_undegraded":"2024-04-25T22:45:22.342484+0000","last_fullsized":"2024-04-25T22:45:22.342484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'393","last_scrub_stamp":"2024-04-25T22:45:22.342226+0000","last_deep_scrub":"72'393","last_deep_scrub_stamp":"2024-04-25T22:45:22.342226+0000","last_clean_scrub_stamp":"2024-04-25T22:45:22.342226+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:15:44.431501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":28076,"num_write":364,"num_write_kb":47473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"72'399","reported_seq":994,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103415+0000","last_change":"2024-04-25T22:44:40.124745+0000","last_active":"2024-04-25T22:44:59.103415+0000","last_peered":"2024-04-25T22:44:59.103415+0000","last_clean":"2024-04-25T22:44:59.103415+0000","last_became_active":"2024-04-25T22:44:40.121838+0000","last_became_peered":"2024-04-25T22:44:40.121838+0000","last_unstale":"2024-04-25T22:44:59.103415+0000","last_undegraded":"2024-04-25T22:44:59.103415+0000","last_fullsized":"2024-04-25T22:44:59.103415+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14005,"num_write":367,"num_write_kb":58883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"72'484","reported_seq":692,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:09.121900+0000","last_change":"2024-04-25T22:45:09.121967+0000","last_active":"2024-04-25T22:45:09.121900+0000","last_peered":"2024-04-25T22:45:09.121900+0000","last_clean":"2024-04-25T22:45:09.121900+0000","last_became_active":"2024-04-25T22:44:54.383808+0000","last_became_peered":"2024-04-25T22:44:54.383808+0000","last_unstale":"2024-04-25T22:45:09.121900+0000","last_undegraded":"2024-04-25T22:45:09.121900+0000","last_fullsized":"2024-04-25T22:45:09.121900+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'484","last_scrub_stamp":"2024-04-25T22:45:09.121700+0000","last_deep_scrub":"72'484","last_deep_scrub_stamp":"2024-04-25T22:45:09.121700+0000","last_clean_scrub_stamp":"2024-04-25T22:45:09.121700+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:39.991100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23352,"num_write":446,"num_write_kb":100094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'455","reported_seq":1145,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:22.025109+0000","last_change":"2024-04-25T22:45:22.025174+0000","last_active":"2024-04-25T22:45:22.025109+0000","last_peered":"2024-04-25T22:45:22.025109+0000","last_clean":"2024-04-25T22:45:22.025109+0000","last_became_active":"2024-04-25T22:44:33.084127+0000","last_became_peered":"2024-04-25T22:44:33.084127+0000","last_unstale":"2024-04-25T22:45:22.025109+0000","last_undegraded":"2024-04-25T22:45:22.025109+0000","last_fullsized":"2024-04-25T22:45:22.025109+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'455","last_scrub_stamp":"2024-04-25T22:45:22.024900+0000","last_deep_scrub":"72'455","last_deep_scrub_stamp":"2024-04-25T22:45:22.024900+0000","last_clean_scrub_stamp":"2024-04-25T22:45:22.024900+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:11:33.397396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38440,"num_write":423,"num_write_kb":71855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"72'434","reported_seq":669,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.106714+0000","last_change":"2024-04-25T22:40:14.622481+0000","last_active":"2024-04-25T22:44:59.106714+0000","last_peered":"2024-04-25T22:44:59.106714+0000","last_clean":"2024-04-25T22:44:59.106714+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:44:59.106714+0000","last_undegraded":"2024-04-25T22:44:59.106714+0000","last_fullsized":"2024-04-25T22:44:59.106714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18701,"num_write":402,"num_write_kb":27564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"72'379","reported_seq":535,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:10.161130+0000","last_change":"2024-04-25T22:45:10.161189+0000","last_active":"2024-04-25T22:45:10.161130+0000","last_peered":"2024-04-25T22:45:10.161130+0000","last_clean":"2024-04-25T22:45:10.161130+0000","last_became_active":"2024-04-25T22:44:53.378402+0000","last_became_peered":"2024-04-25T22:44:53.378402+0000","last_unstale":"2024-04-25T22:45:10.161130+0000","last_undegraded":"2024-04-25T22:45:10.161130+0000","last_fullsized":"2024-04-25T22:45:10.161130+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'379","last_scrub_stamp":"2024-04-25T22:45:10.160926+0000","last_deep_scrub":"72'379","last_deep_scrub_stamp":"2024-04-25T22:45:10.160926+0000","last_clean_scrub_stamp":"2024-04-25T22:45:10.160926+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:05:12.549495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18623,"num_write":344,"num_write_kb":50888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"71'528","reported_seq":732,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109344+0000","last_change":"2024-04-25T22:40:13.595206+0000","last_active":"2024-04-25T22:44:59.109344+0000","last_peered":"2024-04-25T22:44:59.109344+0000","last_clean":"2024-04-25T22:44:59.109344+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:44:59.109344+0000","last_undegraded":"2024-04-25T22:44:59.109344+0000","last_fullsized":"2024-04-25T22:44:59.109344+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"72'383","reported_seq":504,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392192+0000","last_change":"2024-04-25T22:44:58.385931+0000","last_active":"2024-04-25T22:44:59.392192+0000","last_peered":"2024-04-25T22:44:59.392192+0000","last_clean":"2024-04-25T22:44:59.392192+0000","last_became_active":"2024-04-25T22:44:58.380203+0000","last_became_peered":"2024-04-25T22:44:58.380203+0000","last_unstale":"2024-04-25T22:44:59.392192+0000","last_undegraded":"2024-04-25T22:44:59.392192+0000","last_fullsized":"2024-04-25T22:44:59.392192+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8364,"num_write":351,"num_write_kb":30625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"71'45","reported_seq":210,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:20.013456+0000","last_change":"2024-04-25T22:45:20.013520+0000","last_active":"2024-04-25T22:45:20.013456+0000","last_peered":"2024-04-25T22:45:20.013456+0000","last_clean":"2024-04-25T22:45:20.013456+0000","last_became_active":"2024-04-25T22:44:39.115669+0000","last_became_peered":"2024-04-25T22:44:39.115669+0000","last_unstale":"2024-04-25T22:45:20.013456+0000","last_undegraded":"2024-04-25T22:45:20.013456+0000","last_fullsized":"2024-04-25T22:45:20.013456+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'45","last_scrub_stamp":"2024-04-25T22:45:20.013252+0000","last_deep_scrub":"71'45","last_deep_scrub_stamp":"2024-04-25T22:45:20.013252+0000","last_clean_scrub_stamp":"2024-04-25T22:45:20.013252+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:07.692493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"72'429","reported_seq":572,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.661956+0000","last_change":"2024-04-25T22:44:58.388677+0000","last_active":"2024-04-25T22:44:59.661956+0000","last_peered":"2024-04-25T22:44:59.661956+0000","last_clean":"2024-04-25T22:44:59.661956+0000","last_became_active":"2024-04-25T22:44:58.382521+0000","last_became_peered":"2024-04-25T22:44:58.382521+0000","last_unstale":"2024-04-25T22:44:59.661956+0000","last_undegraded":"2024-04-25T22:44:59.661956+0000","last_fullsized":"2024-04-25T22:44:59.661956+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16584,"num_write":393,"num_write_kb":63712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'61","reported_seq":90,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391676+0000","last_change":"2024-04-25T22:44:41.416554+0000","last_active":"2024-04-25T22:44:59.391676+0000","last_peered":"2024-04-25T22:44:59.391676+0000","last_clean":"2024-04-25T22:44:59.391676+0000","last_became_active":"2024-04-25T22:44:41.413853+0000","last_became_peered":"2024-04-25T22:44:41.413853+0000","last_unstale":"2024-04-25T22:44:59.391676+0000","last_undegraded":"2024-04-25T22:44:59.391676+0000","last_fullsized":"2024-04-25T22:44:59.391676+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"72'404","reported_seq":634,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:17.985216+0000","last_change":"2024-04-25T22:45:17.985339+0000","last_active":"2024-04-25T22:45:17.985216+0000","last_peered":"2024-04-25T22:45:17.985216+0000","last_clean":"2024-04-25T22:45:17.985216+0000","last_became_active":"2024-04-25T22:44:39.116562+0000","last_became_peered":"2024-04-25T22:44:39.116562+0000","last_unstale":"2024-04-25T22:45:17.985216+0000","last_undegraded":"2024-04-25T22:45:17.985216+0000","last_fullsized":"2024-04-25T22:45:17.985216+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'404","last_scrub_stamp":"2024-04-25T22:45:17.984989+0000","last_deep_scrub":"72'404","last_deep_scrub_stamp":"2024-04-25T22:45:17.984989+0000","last_clean_scrub_stamp":"2024-04-25T22:45:17.984989+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:47.522405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18745,"num_write":376,"num_write_kb":96145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"113'75","reported_seq":295,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:10.869816+0000","last_change":"2024-04-25T22:45:10.869885+0000","last_active":"2024-04-25T22:45:10.869816+0000","last_peered":"2024-04-25T22:45:10.869816+0000","last_clean":"2024-04-25T22:45:10.869816+0000","last_became_active":"2024-04-25T22:44:26.362499+0000","last_became_peered":"2024-04-25T22:44:26.362499+0000","last_unstale":"2024-04-25T22:45:10.869816+0000","last_undegraded":"2024-04-25T22:45:10.869816+0000","last_fullsized":"2024-04-25T22:45:10.869816+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'75","last_scrub_stamp":"2024-04-25T22:45:10.869595+0000","last_deep_scrub":"113'75","last_deep_scrub_stamp":"2024-04-25T22:45:10.869595+0000","last_clean_scrub_stamp":"2024-04-25T22:45:10.869595+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:39:00.404286+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"113'147","reported_seq":373,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:08.894101+0000","last_change":"2024-04-25T22:45:08.894163+0000","last_active":"2024-04-25T22:45:08.894101+0000","last_peered":"2024-04-25T22:45:08.894101+0000","last_clean":"2024-04-25T22:45:08.894101+0000","last_became_active":"2024-04-25T22:44:29.399853+0000","last_became_peered":"2024-04-25T22:44:29.399853+0000","last_unstale":"2024-04-25T22:45:08.894101+0000","last_undegraded":"2024-04-25T22:45:08.894101+0000","last_fullsized":"2024-04-25T22:45:08.894101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'147","last_scrub_stamp":"2024-04-25T22:45:08.893921+0000","last_deep_scrub":"113'147","last_deep_scrub_stamp":"2024-04-25T22:45:08.893921+0000","last_clean_scrub_stamp":"2024-04-25T22:45:08.893921+0000","objects_scrubbed":2,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:56.976041+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"72'399","reported_seq":614,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:13.230823+0000","last_change":"2024-04-25T22:45:13.230879+0000","last_active":"2024-04-25T22:45:13.230823+0000","last_peered":"2024-04-25T22:45:13.230823+0000","last_clean":"2024-04-25T22:45:13.230823+0000","last_became_active":"2024-04-25T22:44:46.392604+0000","last_became_peered":"2024-04-25T22:44:46.392604+0000","last_unstale":"2024-04-25T22:45:13.230823+0000","last_undegraded":"2024-04-25T22:45:13.230823+0000","last_fullsized":"2024-04-25T22:45:13.230823+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'399","last_scrub_stamp":"2024-04-25T22:45:13.230628+0000","last_deep_scrub":"72'399","last_deep_scrub_stamp":"2024-04-25T22:45:13.230628+0000","last_clean_scrub_stamp":"2024-04-25T22:45:13.230628+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:59:41.103570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25159,"num_write":363,"num_write_kb":34063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"71'226","reported_seq":433,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392581+0000","last_change":"2024-04-25T22:44:41.417859+0000","last_active":"2024-04-25T22:44:59.392581+0000","last_peered":"2024-04-25T22:44:59.392581+0000","last_clean":"2024-04-25T22:44:59.392581+0000","last_became_active":"2024-04-25T22:44:41.416542+0000","last_became_peered":"2024-04-25T22:44:41.416542+0000","last_unstale":"2024-04-25T22:44:59.392581+0000","last_undegraded":"2024-04-25T22:44:59.392581+0000","last_fullsized":"2024-04-25T22:44:59.392581+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"72'431","reported_seq":579,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390278+0000","last_change":"2024-04-25T22:44:56.419453+0000","last_active":"2024-04-25T22:44:59.390278+0000","last_peered":"2024-04-25T22:44:59.390278+0000","last_clean":"2024-04-25T22:44:59.390278+0000","last_became_active":"2024-04-25T22:44:56.412151+0000","last_became_peered":"2024-04-25T22:44:56.412151+0000","last_unstale":"2024-04-25T22:44:59.390278+0000","last_undegraded":"2024-04-25T22:44:59.390278+0000","last_fullsized":"2024-04-25T22:44:59.390278+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14688,"num_write":405,"num_write_kb":38957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"113'384","reported_seq":610,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:07.894276+0000","last_change":"2024-04-25T22:45:07.894340+0000","last_active":"2024-04-25T22:45:07.894276+0000","last_peered":"2024-04-25T22:45:07.894276+0000","last_clean":"2024-04-25T22:45:07.894276+0000","last_became_active":"2024-04-25T22:44:30.401021+0000","last_became_peered":"2024-04-25T22:44:30.401021+0000","last_unstale":"2024-04-25T22:45:07.894276+0000","last_undegraded":"2024-04-25T22:45:07.894276+0000","last_fullsized":"2024-04-25T22:45:07.894276+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'384","last_scrub_stamp":"2024-04-25T22:45:07.894090+0000","last_deep_scrub":"113'384","last_deep_scrub_stamp":"2024-04-25T22:45:07.894090+0000","last_clean_scrub_stamp":"2024-04-25T22:45:07.894090+0000","objects_scrubbed":2,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:37:27.144873+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'453","reported_seq":694,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:14.778720+0000","last_change":"2024-04-25T22:45:14.778798+0000","last_active":"2024-04-25T22:45:14.778720+0000","last_peered":"2024-04-25T22:45:14.778720+0000","last_clean":"2024-04-25T22:45:14.778720+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:45:14.778720+0000","last_undegraded":"2024-04-25T22:45:14.778720+0000","last_fullsized":"2024-04-25T22:45:14.778720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'453","last_scrub_stamp":"2024-04-25T22:45:14.778468+0000","last_deep_scrub":"72'453","last_deep_scrub_stamp":"2024-04-25T22:45:14.778468+0000","last_clean_scrub_stamp":"2024-04-25T22:45:14.778468+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:11:13.757693+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18900,"num_write":418,"num_write_kb":117500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"71'64","reported_seq":268,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109449+0000","last_change":"2024-04-25T22:40:13.593373+0000","last_active":"2024-04-25T22:44:59.109449+0000","last_peered":"2024-04-25T22:44:59.109449+0000","last_clean":"2024-04-25T22:44:59.109449+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:44:59.109449+0000","last_undegraded":"2024-04-25T22:44:59.109449+0000","last_fullsized":"2024-04-25T22:44:59.109449+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'428","reported_seq":640,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:15.954382+0000","last_change":"2024-04-25T22:45:15.954444+0000","last_active":"2024-04-25T22:45:15.954382+0000","last_peered":"2024-04-25T22:45:15.954382+0000","last_clean":"2024-04-25T22:45:15.954382+0000","last_became_active":"2024-04-25T22:44:39.121205+0000","last_became_peered":"2024-04-25T22:44:39.121205+0000","last_unstale":"2024-04-25T22:45:15.954382+0000","last_undegraded":"2024-04-25T22:45:15.954382+0000","last_fullsized":"2024-04-25T22:45:15.954382+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'428","last_scrub_stamp":"2024-04-25T22:45:15.954178+0000","last_deep_scrub":"72'428","last_deep_scrub_stamp":"2024-04-25T22:45:15.954178+0000","last_clean_scrub_stamp":"2024-04-25T22:45:15.954178+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:43:04.938222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7477,"num_write":383,"num_write_kb":9617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"113'169","reported_seq":334,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:09.956160+0000","last_change":"2024-04-25T22:45:09.956324+0000","last_active":"2024-04-25T22:45:09.956160+0000","last_peered":"2024-04-25T22:45:09.956160+0000","last_clean":"2024-04-25T22:45:09.956160+0000","last_became_active":"2024-04-25T22:44:39.131489+0000","last_became_peered":"2024-04-25T22:44:39.131489+0000","last_unstale":"2024-04-25T22:45:09.956160+0000","last_undegraded":"2024-04-25T22:45:09.956160+0000","last_fullsized":"2024-04-25T22:45:09.956160+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'169","last_scrub_stamp":"2024-04-25T22:45:09.955944+0000","last_deep_scrub":"113'169","last_deep_scrub_stamp":"2024-04-25T22:45:09.955944+0000","last_clean_scrub_stamp":"2024-04-25T22:45:09.955944+0000","objects_scrubbed":3,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.893227+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"72'446","reported_seq":697,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108252+0000","last_change":"2024-04-25T22:40:14.625323+0000","last_active":"2024-04-25T22:44:59.108252+0000","last_peered":"2024-04-25T22:44:59.108252+0000","last_clean":"2024-04-25T22:44:59.108252+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:44:59.108252+0000","last_undegraded":"2024-04-25T22:44:59.108252+0000","last_fullsized":"2024-04-25T22:44:59.108252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27788,"num_write":414,"num_write_kb":47058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"71'113","reported_seq":317,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108477+0000","last_change":"2024-04-25T22:40:13.593330+0000","last_active":"2024-04-25T22:44:59.108477+0000","last_peered":"2024-04-25T22:44:59.108477+0000","last_clean":"2024-04-25T22:44:59.108477+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:44:59.108477+0000","last_undegraded":"2024-04-25T22:44:59.108477+0000","last_fullsized":"2024-04-25T22:44:59.108477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"72'417","reported_seq":1020,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108839+0000","last_change":"2024-04-25T22:44:44.113498+0000","last_active":"2024-04-25T22:44:59.108839+0000","last_peered":"2024-04-25T22:44:59.108839+0000","last_clean":"2024-04-25T22:44:59.108839+0000","last_became_active":"2024-04-25T22:44:44.108084+0000","last_became_peered":"2024-04-25T22:44:44.108084+0000","last_unstale":"2024-04-25T22:44:59.108839+0000","last_undegraded":"2024-04-25T22:44:59.108839+0000","last_fullsized":"2024-04-25T22:44:59.108839+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16487,"num_write":388,"num_write_kb":75452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'59","reported_seq":90,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390239+0000","last_change":"2024-04-25T22:44:41.417821+0000","last_active":"2024-04-25T22:44:59.390239+0000","last_peered":"2024-04-25T22:44:59.390239+0000","last_clean":"2024-04-25T22:44:59.390239+0000","last_became_active":"2024-04-25T22:44:41.415769+0000","last_became_peered":"2024-04-25T22:44:41.415769+0000","last_unstale":"2024-04-25T22:44:59.390239+0000","last_undegraded":"2024-04-25T22:44:59.390239+0000","last_fullsized":"2024-04-25T22:44:59.390239+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'358","reported_seq":901,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107887+0000","last_change":"2024-04-25T22:44:34.101942+0000","last_active":"2024-04-25T22:44:59.107887+0000","last_peered":"2024-04-25T22:44:59.107887+0000","last_clean":"2024-04-25T22:44:59.107887+0000","last_became_active":"2024-04-25T22:44:34.099595+0000","last_became_peered":"2024-04-25T22:44:34.099595+0000","last_unstale":"2024-04-25T22:44:59.107887+0000","last_undegraded":"2024-04-25T22:44:59.107887+0000","last_fullsized":"2024-04-25T22:44:59.107887+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12259,"num_write":325,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"113'466","reported_seq":644,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:24.365511+0000","last_change":"2024-04-25T22:45:24.365573+0000","last_active":"2024-04-25T22:45:24.365511+0000","last_peered":"2024-04-25T22:45:24.365511+0000","last_clean":"2024-04-25T22:45:24.365511+0000","last_became_active":"2024-04-25T22:44:41.423799+0000","last_became_peered":"2024-04-25T22:44:41.423799+0000","last_unstale":"2024-04-25T22:45:24.365511+0000","last_undegraded":"2024-04-25T22:45:24.365511+0000","last_fullsized":"2024-04-25T22:45:24.365511+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'466","last_scrub_stamp":"2024-04-25T22:45:24.365286+0000","last_deep_scrub":"113'466","last_deep_scrub_stamp":"2024-04-25T22:45:24.365286+0000","last_clean_scrub_stamp":"2024-04-25T22:45:24.365286+0000","objects_scrubbed":1,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:44:37.132110+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"72'386","reported_seq":956,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102691+0000","last_change":"2024-04-25T22:44:46.113269+0000","last_active":"2024-04-25T22:44:59.102691+0000","last_peered":"2024-04-25T22:44:59.102691+0000","last_clean":"2024-04-25T22:44:59.102691+0000","last_became_active":"2024-04-25T22:44:46.110394+0000","last_became_peered":"2024-04-25T22:44:46.110394+0000","last_unstale":"2024-04-25T22:44:59.102691+0000","last_undegraded":"2024-04-25T22:44:59.102691+0000","last_fullsized":"2024-04-25T22:44:59.102691+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9402,"num_write":352,"num_write_kb":50548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":419,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107968+0000","last_change":"2024-04-25T22:44:26.355770+0000","last_active":"2024-04-25T22:44:59.107968+0000","last_peered":"2024-04-25T22:44:59.107968+0000","last_clean":"2024-04-25T22:44:59.107968+0000","last_became_active":"2024-04-25T22:44:26.354730+0000","last_became_peered":"2024-04-25T22:44:26.354730+0000","last_unstale":"2024-04-25T22:44:59.107968+0000","last_undegraded":"2024-04-25T22:44:59.107968+0000","last_fullsized":"2024-04-25T22:44:59.107968+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:03.263093+0000","last_clean_scrub_stamp":"2024-04-25T22:40:03.263093+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":210,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109488+0000","last_change":"2024-04-25T22:40:09.491951+0000","last_active":"2024-04-25T22:44:59.109488+0000","last_peered":"2024-04-25T22:44:59.109488+0000","last_clean":"2024-04-25T22:44:59.109488+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:44:59.109488+0000","last_undegraded":"2024-04-25T22:44:59.109488+0000","last_fullsized":"2024-04-25T22:44:59.109488+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"71'457","reported_seq":677,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103296+0000","last_change":"2024-04-25T22:44:29.399148+0000","last_active":"2024-04-25T22:44:59.103296+0000","last_peered":"2024-04-25T22:44:59.103296+0000","last_clean":"2024-04-25T22:44:59.103296+0000","last_became_active":"2024-04-25T22:44:29.397962+0000","last_became_peered":"2024-04-25T22:44:29.397962+0000","last_unstale":"2024-04-25T22:44:59.103296+0000","last_undegraded":"2024-04-25T22:44:59.103296+0000","last_fullsized":"2024-04-25T22:44:59.103296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"72'447","reported_seq":1112,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108927+0000","last_change":"2024-04-25T22:44:43.108262+0000","last_active":"2024-04-25T22:44:59.108927+0000","last_peered":"2024-04-25T22:44:59.108927+0000","last_clean":"2024-04-25T22:44:59.108927+0000","last_became_active":"2024-04-25T22:44:43.105231+0000","last_became_peered":"2024-04-25T22:44:43.105231+0000","last_unstale":"2024-04-25T22:44:59.108927+0000","last_undegraded":"2024-04-25T22:44:59.108927+0000","last_fullsized":"2024-04-25T22:44:59.108927+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45074,"num_write":414,"num_write_kb":120596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":217,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107231+0000","last_change":"2024-04-25T22:44:26.355238+0000","last_active":"2024-04-25T22:44:59.107231+0000","last_peered":"2024-04-25T22:44:59.107231+0000","last_clean":"2024-04-25T22:44:59.107231+0000","last_became_active":"2024-04-25T22:44:26.354482+0000","last_became_peered":"2024-04-25T22:44:26.354482+0000","last_unstale":"2024-04-25T22:44:59.107231+0000","last_undegraded":"2024-04-25T22:44:59.107231+0000","last_fullsized":"2024-04-25T22:44:59.107231+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"113'123","reported_seq":350,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:14.969914+0000","last_change":"2024-04-25T22:45:14.969982+0000","last_active":"2024-04-25T22:45:14.969914+0000","last_peered":"2024-04-25T22:45:14.969914+0000","last_clean":"2024-04-25T22:45:14.969914+0000","last_became_active":"2024-04-25T22:44:39.139689+0000","last_became_peered":"2024-04-25T22:44:39.139689+0000","last_unstale":"2024-04-25T22:45:14.969914+0000","last_undegraded":"2024-04-25T22:45:14.969914+0000","last_fullsized":"2024-04-25T22:45:14.969914+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'123","last_scrub_stamp":"2024-04-25T22:45:14.969730+0000","last_deep_scrub":"113'123","last_deep_scrub_stamp":"2024-04-25T22:45:14.969730+0000","last_clean_scrub_stamp":"2024-04-25T22:45:14.969730+0000","objects_scrubbed":1,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:03:32.133354+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":62,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"72'449","reported_seq":661,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:11.145433+0000","last_change":"2024-04-25T22:45:11.145558+0000","last_active":"2024-04-25T22:45:11.145433+0000","last_peered":"2024-04-25T22:45:11.145433+0000","last_clean":"2024-04-25T22:45:11.145433+0000","last_became_active":"2024-04-25T22:44:41.432785+0000","last_became_peered":"2024-04-25T22:44:41.432785+0000","last_unstale":"2024-04-25T22:45:11.145433+0000","last_undegraded":"2024-04-25T22:45:11.145433+0000","last_fullsized":"2024-04-25T22:45:11.145433+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'449","last_scrub_stamp":"2024-04-25T22:45:11.145126+0000","last_deep_scrub":"72'449","last_deep_scrub_stamp":"2024-04-25T22:45:11.145126+0000","last_clean_scrub_stamp":"2024-04-25T22:45:11.145126+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:18.105492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25191,"num_write":420,"num_write_kb":79855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":218,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102082+0000","last_change":"2024-04-25T22:44:26.363464+0000","last_active":"2024-04-25T22:44:59.102082+0000","last_peered":"2024-04-25T22:44:59.102082+0000","last_clean":"2024-04-25T22:44:59.102082+0000","last_became_active":"2024-04-25T22:44:26.362808+0000","last_became_peered":"2024-04-25T22:44:26.362808+0000","last_unstale":"2024-04-25T22:44:59.102082+0000","last_undegraded":"2024-04-25T22:44:59.102082+0000","last_fullsized":"2024-04-25T22:44:59.102082+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"71'435","reported_seq":631,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390105+0000","last_change":"2024-04-25T22:44:41.417191+0000","last_active":"2024-04-25T22:44:59.390105+0000","last_peered":"2024-04-25T22:44:59.390105+0000","last_clean":"2024-04-25T22:44:59.390105+0000","last_became_active":"2024-04-25T22:44:41.415592+0000","last_became_peered":"2024-04-25T22:44:41.415592+0000","last_unstale":"2024-04-25T22:44:59.390105+0000","last_undegraded":"2024-04-25T22:44:59.390105+0000","last_fullsized":"2024-04-25T22:44:59.390105+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"72'337","reported_seq":889,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103175+0000","last_change":"2024-04-25T22:44:45.113523+0000","last_active":"2024-04-25T22:44:59.103175+0000","last_peered":"2024-04-25T22:44:59.103175+0000","last_clean":"2024-04-25T22:44:59.103175+0000","last_became_active":"2024-04-25T22:44:45.111011+0000","last_became_peered":"2024-04-25T22:44:45.111011+0000","last_unstale":"2024-04-25T22:44:59.103175+0000","last_undegraded":"2024-04-25T22:44:59.103175+0000","last_fullsized":"2024-04-25T22:44:59.103175+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25242,"num_write":307,"num_write_kb":26250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":210,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108659+0000","last_change":"2024-04-25T22:40:09.492572+0000","last_active":"2024-04-25T22:44:59.108659+0000","last_peered":"2024-04-25T22:44:59.108659+0000","last_clean":"2024-04-25T22:44:59.108659+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:44:59.108659+0000","last_undegraded":"2024-04-25T22:44:59.108659+0000","last_fullsized":"2024-04-25T22:44:59.108659+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"71'61","reported_seq":265,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109401+0000","last_change":"2024-04-25T22:40:13.593792+0000","last_active":"2024-04-25T22:44:59.109401+0000","last_peered":"2024-04-25T22:44:59.109401+0000","last_clean":"2024-04-25T22:44:59.109401+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:44:59.109401+0000","last_undegraded":"2024-04-25T22:44:59.109401+0000","last_fullsized":"2024-04-25T22:44:59.109401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'404","reported_seq":1017,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103087+0000","last_change":"2024-04-25T22:44:32.092728+0000","last_active":"2024-04-25T22:44:59.103087+0000","last_peered":"2024-04-25T22:44:59.103087+0000","last_clean":"2024-04-25T22:44:59.103087+0000","last_became_active":"2024-04-25T22:44:32.087528+0000","last_became_peered":"2024-04-25T22:44:32.087528+0000","last_unstale":"2024-04-25T22:44:59.103087+0000","last_undegraded":"2024-04-25T22:44:59.103087+0000","last_fullsized":"2024-04-25T22:44:59.103087+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":20287,"num_write":371,"num_write_kb":59919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"71'285","reported_seq":489,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.109211+0000","last_change":"2024-04-25T22:40:13.596461+0000","last_active":"2024-04-25T22:44:59.109211+0000","last_peered":"2024-04-25T22:44:59.109211+0000","last_clean":"2024-04-25T22:44:59.109211+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:44:59.109211+0000","last_undegraded":"2024-04-25T22:44:59.109211+0000","last_fullsized":"2024-04-25T22:44:59.109211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":218,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.104267+0000","last_change":"2024-04-25T22:44:26.364185+0000","last_active":"2024-04-25T22:44:59.104267+0000","last_peered":"2024-04-25T22:44:59.104267+0000","last_clean":"2024-04-25T22:44:59.104267+0000","last_became_active":"2024-04-25T22:44:26.363583+0000","last_became_peered":"2024-04-25T22:44:26.363583+0000","last_unstale":"2024-04-25T22:44:59.104267+0000","last_undegraded":"2024-04-25T22:44:59.104267+0000","last_fullsized":"2024-04-25T22:44:59.104267+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"72'366","reported_seq":523,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391656+0000","last_change":"2024-04-25T22:44:52.381174+0000","last_active":"2024-04-25T22:44:59.391656+0000","last_peered":"2024-04-25T22:44:59.391656+0000","last_clean":"2024-04-25T22:44:59.391656+0000","last_became_active":"2024-04-25T22:44:52.375504+0000","last_became_peered":"2024-04-25T22:44:52.375504+0000","last_unstale":"2024-04-25T22:44:59.391656+0000","last_undegraded":"2024-04-25T22:44:59.391656+0000","last_fullsized":"2024-04-25T22:44:59.391656+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":346,"num_write":330,"num_write_kb":33934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":266,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103447+0000","last_change":"2024-04-25T22:44:26.364178+0000","last_active":"2024-04-25T22:44:59.103447+0000","last_peered":"2024-04-25T22:44:59.103447+0000","last_clean":"2024-04-25T22:44:59.103447+0000","last_became_active":"2024-04-25T22:44:26.363455+0000","last_became_peered":"2024-04-25T22:44:26.363455+0000","last_unstale":"2024-04-25T22:44:59.103447+0000","last_undegraded":"2024-04-25T22:44:59.103447+0000","last_fullsized":"2024-04-25T22:44:59.103447+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":144,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392841+0000","last_change":"2024-04-25T22:44:41.423030+0000","last_active":"2024-04-25T22:44:59.392841+0000","last_peered":"2024-04-25T22:44:59.392841+0000","last_clean":"2024-04-25T22:44:59.392841+0000","last_became_active":"2024-04-25T22:44:41.421194+0000","last_became_peered":"2024-04-25T22:44:41.421194+0000","last_unstale":"2024-04-25T22:44:59.392841+0000","last_undegraded":"2024-04-25T22:44:59.392841+0000","last_fullsized":"2024-04-25T22:44:59.392841+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'413","reported_seq":636,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:17.151630+0000","last_change":"2024-04-25T22:45:17.151689+0000","last_active":"2024-04-25T22:45:17.151630+0000","last_peered":"2024-04-25T22:45:17.151630+0000","last_clean":"2024-04-25T22:45:17.151630+0000","last_became_active":"2024-04-25T22:44:48.372485+0000","last_became_peered":"2024-04-25T22:44:48.372485+0000","last_unstale":"2024-04-25T22:45:17.151630+0000","last_undegraded":"2024-04-25T22:45:17.151630+0000","last_fullsized":"2024-04-25T22:45:17.151630+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'413","last_scrub_stamp":"2024-04-25T22:45:17.151430+0000","last_deep_scrub":"72'413","last_deep_scrub_stamp":"2024-04-25T22:45:17.151430+0000","last_clean_scrub_stamp":"2024-04-25T22:45:17.151430+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:13.003612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22994,"num_write":377,"num_write_kb":63140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"72'57","reported_seq":270,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103829+0000","last_change":"2024-04-25T22:44:26.366189+0000","last_active":"2024-04-25T22:44:59.103829+0000","last_peered":"2024-04-25T22:44:59.103829+0000","last_clean":"2024-04-25T22:44:59.103829+0000","last_became_active":"2024-04-25T22:44:26.365267+0000","last_became_peered":"2024-04-25T22:44:26.365267+0000","last_unstale":"2024-04-25T22:44:59.103829+0000","last_undegraded":"2024-04-25T22:44:59.103829+0000","last_fullsized":"2024-04-25T22:44:59.103829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":218,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.104270+0000","last_change":"2024-04-25T22:44:26.361633+0000","last_active":"2024-04-25T22:44:59.104270+0000","last_peered":"2024-04-25T22:44:59.104270+0000","last_clean":"2024-04-25T22:44:59.104270+0000","last_became_active":"2024-04-25T22:44:26.360968+0000","last_became_peered":"2024-04-25T22:44:26.360968+0000","last_unstale":"2024-04-25T22:44:59.104270+0000","last_undegraded":"2024-04-25T22:44:59.104270+0000","last_fullsized":"2024-04-25T22:44:59.104270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:08.425969+0000","last_clean_scrub_stamp":"2024-04-25T22:40:08.425969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'398","reported_seq":608,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:11.946634+0000","last_change":"2024-04-25T22:45:11.946697+0000","last_active":"2024-04-25T22:45:11.946634+0000","last_peered":"2024-04-25T22:45:11.946634+0000","last_clean":"2024-04-25T22:45:11.946634+0000","last_became_active":"2024-04-25T22:44:39.124378+0000","last_became_peered":"2024-04-25T22:44:39.124378+0000","last_unstale":"2024-04-25T22:45:11.946634+0000","last_undegraded":"2024-04-25T22:45:11.946634+0000","last_fullsized":"2024-04-25T22:45:11.946634+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'398","last_scrub_stamp":"2024-04-25T22:45:11.946438+0000","last_deep_scrub":"72'398","last_deep_scrub_stamp":"2024-04-25T22:45:11.946438+0000","last_clean_scrub_stamp":"2024-04-25T22:45:11.946438+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:53:57.648591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6306,"num_write":372,"num_write_kb":34077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"113'101","reported_seq":316,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:21.055062+0000","last_change":"2024-04-25T22:45:21.055134+0000","last_active":"2024-04-25T22:45:21.055062+0000","last_peered":"2024-04-25T22:45:21.055062+0000","last_clean":"2024-04-25T22:45:21.055062+0000","last_became_active":"2024-04-25T22:44:39.147377+0000","last_became_peered":"2024-04-25T22:44:39.147377+0000","last_unstale":"2024-04-25T22:45:21.055062+0000","last_undegraded":"2024-04-25T22:45:21.055062+0000","last_fullsized":"2024-04-25T22:45:21.055062+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'101","last_scrub_stamp":"2024-04-25T22:45:21.054875+0000","last_deep_scrub":"113'101","last_deep_scrub_stamp":"2024-04-25T22:45:21.054875+0000","last_clean_scrub_stamp":"2024-04-25T22:45:21.054875+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:19:13.176608+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":225,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:12.826059+0000","last_change":"2024-04-25T22:45:12.826113+0000","last_active":"2024-04-25T22:45:12.826059+0000","last_peered":"2024-04-25T22:45:12.826059+0000","last_clean":"2024-04-25T22:45:12.826059+0000","last_became_active":"2024-04-25T22:44:26.360106+0000","last_became_peered":"2024-04-25T22:44:26.360106+0000","last_unstale":"2024-04-25T22:45:12.826059+0000","last_undegraded":"2024-04-25T22:45:12.826059+0000","last_fullsized":"2024-04-25T22:45:12.826059+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:45:12.825863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:45:12.825863+0000","last_clean_scrub_stamp":"2024-04-25T22:45:12.825863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:56.790968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'390","reported_seq":630,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:18.170108+0000","last_change":"2024-04-25T22:45:18.170169+0000","last_active":"2024-04-25T22:45:18.170108+0000","last_peered":"2024-04-25T22:45:18.170108+0000","last_clean":"2024-04-25T22:45:18.170108+0000","last_became_active":"2024-04-25T22:44:41.414924+0000","last_became_peered":"2024-04-25T22:44:41.414924+0000","last_unstale":"2024-04-25T22:45:18.170108+0000","last_undegraded":"2024-04-25T22:45:18.170108+0000","last_fullsized":"2024-04-25T22:45:18.170108+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'390","last_scrub_stamp":"2024-04-25T22:45:18.169909+0000","last_deep_scrub":"72'390","last_deep_scrub_stamp":"2024-04-25T22:45:18.169909+0000","last_clean_scrub_stamp":"2024-04-25T22:45:18.169909+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:40.114419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":22915,"num_write":352,"num_write_kb":47201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"72'411","reported_seq":1017,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:11.857384+0000","last_change":"2024-04-25T22:45:11.857443+0000","last_active":"2024-04-25T22:45:11.857384+0000","last_peered":"2024-04-25T22:45:11.857384+0000","last_clean":"2024-04-25T22:45:11.857384+0000","last_became_active":"2024-04-25T22:44:32.087303+0000","last_became_peered":"2024-04-25T22:44:32.087303+0000","last_unstale":"2024-04-25T22:45:11.857384+0000","last_undegraded":"2024-04-25T22:45:11.857384+0000","last_fullsized":"2024-04-25T22:45:11.857384+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'411","last_scrub_stamp":"2024-04-25T22:45:11.857179+0000","last_deep_scrub":"72'411","last_deep_scrub_stamp":"2024-04-25T22:45:11.857179+0000","last_clean_scrub_stamp":"2024-04-25T22:45:11.857179+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:15.380436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25412,"num_write":367,"num_write_kb":64656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"113'273","reported_seq":503,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:09.928187+0000","last_change":"2024-04-25T22:45:09.928318+0000","last_active":"2024-04-25T22:45:09.928187+0000","last_peered":"2024-04-25T22:45:09.928187+0000","last_clean":"2024-04-25T22:45:09.928187+0000","last_became_active":"2024-04-25T22:44:29.398317+0000","last_became_peered":"2024-04-25T22:44:29.398317+0000","last_unstale":"2024-04-25T22:45:09.928187+0000","last_undegraded":"2024-04-25T22:45:09.928187+0000","last_fullsized":"2024-04-25T22:45:09.928187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'273","last_scrub_stamp":"2024-04-25T22:45:09.927957+0000","last_deep_scrub":"113'273","last_deep_scrub_stamp":"2024-04-25T22:45:09.927957+0000","last_clean_scrub_stamp":"2024-04-25T22:45:09.927957+0000","objects_scrubbed":5,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:47:07.690999+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382817,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"72'423","reported_seq":1048,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.102028+0000","last_change":"2024-04-25T22:44:42.092243+0000","last_active":"2024-04-25T22:44:59.102028+0000","last_peered":"2024-04-25T22:44:59.102028+0000","last_clean":"2024-04-25T22:44:59.102028+0000","last_became_active":"2024-04-25T22:44:42.088432+0000","last_became_peered":"2024-04-25T22:44:42.088432+0000","last_unstale":"2024-04-25T22:44:59.102028+0000","last_undegraded":"2024-04-25T22:44:59.102028+0000","last_fullsized":"2024-04-25T22:44:59.102028+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24794,"num_write":386,"num_write_kb":63756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"72'102","reported_seq":97,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392484+0000","last_change":"2024-04-25T22:44:41.423993+0000","last_active":"2024-04-25T22:44:59.392484+0000","last_peered":"2024-04-25T22:44:59.392484+0000","last_clean":"2024-04-25T22:44:59.392484+0000","last_became_active":"2024-04-25T22:44:41.422237+0000","last_became_peered":"2024-04-25T22:44:41.422237+0000","last_unstale":"2024-04-25T22:44:59.392484+0000","last_undegraded":"2024-04-25T22:44:59.392484+0000","last_fullsized":"2024-04-25T22:44:59.392484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"71'213","reported_seq":417,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:07.145774+0000","last_change":"2024-04-25T22:40:13.593492+0000","last_active":"2024-04-25T22:45:07.145774+0000","last_peered":"2024-04-25T22:45:07.145774+0000","last_clean":"2024-04-25T22:45:07.145774+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:45:07.145774+0000","last_undegraded":"2024-04-25T22:45:07.145774+0000","last_fullsized":"2024-04-25T22:45:07.145774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"72'504","reported_seq":778,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:16.937256+0000","last_change":"2024-04-25T22:45:16.937314+0000","last_active":"2024-04-25T22:45:16.937256+0000","last_peered":"2024-04-25T22:45:16.937256+0000","last_clean":"2024-04-25T22:45:16.937256+0000","last_became_active":"2024-04-25T22:44:39.132582+0000","last_became_peered":"2024-04-25T22:44:39.132582+0000","last_unstale":"2024-04-25T22:45:16.937256+0000","last_undegraded":"2024-04-25T22:45:16.937256+0000","last_fullsized":"2024-04-25T22:45:16.937256+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'504","last_scrub_stamp":"2024-04-25T22:45:16.937061+0000","last_deep_scrub":"72'504","last_deep_scrub_stamp":"2024-04-25T22:45:16.937061+0000","last_clean_scrub_stamp":"2024-04-25T22:45:16.937061+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:02.108326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":46975,"num_write":471,"num_write_kb":146290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'64","reported_seq":229,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:08.972151+0000","last_change":"2024-04-25T22:45:08.972215+0000","last_active":"2024-04-25T22:45:08.972151+0000","last_peered":"2024-04-25T22:45:08.972151+0000","last_clean":"2024-04-25T22:45:08.972151+0000","last_became_active":"2024-04-25T22:44:39.136090+0000","last_became_peered":"2024-04-25T22:44:39.136090+0000","last_unstale":"2024-04-25T22:45:08.972151+0000","last_undegraded":"2024-04-25T22:45:08.972151+0000","last_fullsized":"2024-04-25T22:45:08.972151+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'64","last_scrub_stamp":"2024-04-25T22:45:08.971948+0000","last_deep_scrub":"71'64","last_deep_scrub_stamp":"2024-04-25T22:45:08.971948+0000","last_clean_scrub_stamp":"2024-04-25T22:45:08.971948+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:17:00.632713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"72'475","reported_seq":1155,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.101902+0000","last_change":"2024-04-25T22:44:44.106484+0000","last_active":"2024-04-25T22:44:59.101902+0000","last_peered":"2024-04-25T22:44:59.101902+0000","last_clean":"2024-04-25T22:44:59.101902+0000","last_became_active":"2024-04-25T22:44:44.102061+0000","last_became_peered":"2024-04-25T22:44:44.102061+0000","last_unstale":"2024-04-25T22:44:59.101902+0000","last_undegraded":"2024-04-25T22:44:59.101902+0000","last_fullsized":"2024-04-25T22:44:59.101902+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":23011,"num_write":448,"num_write_kb":76439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"72'370","reported_seq":568,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.662025+0000","last_change":"2024-04-25T22:44:56.420080+0000","last_active":"2024-04-25T22:44:59.662025+0000","last_peered":"2024-04-25T22:44:59.662025+0000","last_clean":"2024-04-25T22:44:59.662025+0000","last_became_active":"2024-04-25T22:44:56.414231+0000","last_became_peered":"2024-04-25T22:44:56.414231+0000","last_unstale":"2024-04-25T22:44:59.662025+0000","last_undegraded":"2024-04-25T22:44:59.662025+0000","last_fullsized":"2024-04-25T22:44:59.662025+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33211,"num_write":340,"num_write_kb":63312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"71'647","reported_seq":867,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:07.272317+0000","last_change":"2024-04-25T22:44:30.396965+0000","last_active":"2024-04-25T22:45:07.272317+0000","last_peered":"2024-04-25T22:45:07.272317+0000","last_clean":"2024-04-25T22:45:07.272317+0000","last_became_active":"2024-04-25T22:44:30.396073+0000","last_became_peered":"2024-04-25T22:44:30.396073+0000","last_unstale":"2024-04-25T22:45:07.272317+0000","last_undegraded":"2024-04-25T22:45:07.272317+0000","last_fullsized":"2024-04-25T22:45:07.272317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"72'415","reported_seq":637,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103068+0000","last_change":"2024-04-25T22:44:39.150290+0000","last_active":"2024-04-25T22:44:59.103068+0000","last_peered":"2024-04-25T22:44:59.103068+0000","last_clean":"2024-04-25T22:44:59.103068+0000","last_became_active":"2024-04-25T22:44:39.146949+0000","last_became_peered":"2024-04-25T22:44:39.146949+0000","last_unstale":"2024-04-25T22:44:59.103068+0000","last_undegraded":"2024-04-25T22:44:59.103068+0000","last_fullsized":"2024-04-25T22:44:59.103068+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19493,"num_write":386,"num_write_kb":64692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"113'208","reported_seq":373,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:12.940687+0000","last_change":"2024-04-25T22:45:12.940827+0000","last_active":"2024-04-25T22:45:12.940687+0000","last_peered":"2024-04-25T22:45:12.940687+0000","last_clean":"2024-04-25T22:45:12.940687+0000","last_became_active":"2024-04-25T22:44:39.138371+0000","last_became_peered":"2024-04-25T22:44:39.138371+0000","last_unstale":"2024-04-25T22:45:12.940687+0000","last_undegraded":"2024-04-25T22:45:12.940687+0000","last_fullsized":"2024-04-25T22:45:12.940687+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'208","last_scrub_stamp":"2024-04-25T22:45:12.940458+0000","last_deep_scrub":"113'208","last_deep_scrub_stamp":"2024-04-25T22:45:12.940458+0000","last_clean_scrub_stamp":"2024-04-25T22:45:12.940458+0000","objects_scrubbed":1,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:06:25.970714+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"72'395","reported_seq":563,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.392481+0000","last_change":"2024-04-25T22:44:55.406524+0000","last_active":"2024-04-25T22:44:59.392481+0000","last_peered":"2024-04-25T22:44:59.392481+0000","last_clean":"2024-04-25T22:44:59.392481+0000","last_became_active":"2024-04-25T22:44:55.396613+0000","last_became_peered":"2024-04-25T22:44:55.396613+0000","last_unstale":"2024-04-25T22:44:59.392481+0000","last_undegraded":"2024-04-25T22:44:59.392481+0000","last_fullsized":"2024-04-25T22:44:59.392481+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9576,"num_write":348,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'194","reported_seq":364,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391326+0000","last_change":"2024-04-25T22:44:41.422369+0000","last_active":"2024-04-25T22:44:59.391326+0000","last_peered":"2024-04-25T22:44:59.391326+0000","last_clean":"2024-04-25T22:44:59.391326+0000","last_became_active":"2024-04-25T22:44:41.420491+0000","last_became_peered":"2024-04-25T22:44:41.420491+0000","last_unstale":"2024-04-25T22:44:59.391326+0000","last_undegraded":"2024-04-25T22:44:59.391326+0000","last_fullsized":"2024-04-25T22:44:59.391326+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360511,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":12143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12360511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"72'398","reported_seq":594,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391492+0000","last_change":"2024-04-25T22:44:52.381363+0000","last_active":"2024-04-25T22:44:59.391492+0000","last_peered":"2024-04-25T22:44:59.391492+0000","last_clean":"2024-04-25T22:44:59.391492+0000","last_became_active":"2024-04-25T22:44:52.375632+0000","last_became_peered":"2024-04-25T22:44:52.375632+0000","last_unstale":"2024-04-25T22:44:59.391492+0000","last_undegraded":"2024-04-25T22:44:59.391492+0000","last_fullsized":"2024-04-25T22:44:59.391492+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31284,"num_write":371,"num_write_kb":80144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"71'51","reported_seq":95,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.390679+0000","last_change":"2024-04-25T22:44:41.415722+0000","last_active":"2024-04-25T22:44:59.390679+0000","last_peered":"2024-04-25T22:44:59.390679+0000","last_clean":"2024-04-25T22:44:59.390679+0000","last_became_active":"2024-04-25T22:44:41.414774+0000","last_became_peered":"2024-04-25T22:44:41.414774+0000","last_unstale":"2024-04-25T22:44:59.390679+0000","last_undegraded":"2024-04-25T22:44:59.390679+0000","last_fullsized":"2024-04-25T22:44:59.390679+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"72'383","reported_seq":645,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:15.745107+0000","last_change":"2024-04-25T22:45:15.745107+0000","last_active":"2024-04-25T22:45:15.745107+0000","last_peered":"2024-04-25T22:45:15.745107+0000","last_clean":"2024-04-25T22:45:15.745107+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:45:15.745107+0000","last_undegraded":"2024-04-25T22:45:15.745107+0000","last_fullsized":"2024-04-25T22:45:15.745107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'383","last_scrub_stamp":"2024-04-25T22:45:15.744713+0000","last_deep_scrub":"72'383","last_deep_scrub_stamp":"2024-04-25T22:45:15.744713+0000","last_clean_scrub_stamp":"2024-04-25T22:45:15.744713+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:24.822195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29308,"num_write":358,"num_write_kb":66975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"71'177","reported_seq":381,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:07.145919+0000","last_change":"2024-04-25T22:40:13.593892+0000","last_active":"2024-04-25T22:45:07.145919+0000","last_peered":"2024-04-25T22:45:07.145919+0000","last_clean":"2024-04-25T22:45:07.145919+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:45:07.145919+0000","last_undegraded":"2024-04-25T22:45:07.145919+0000","last_fullsized":"2024-04-25T22:45:07.145919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"72'387","reported_seq":602,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:07.146194+0000","last_change":"2024-04-25T22:40:14.628438+0000","last_active":"2024-04-25T22:45:07.146194+0000","last_peered":"2024-04-25T22:45:07.146194+0000","last_clean":"2024-04-25T22:45:07.146194+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:45:07.146194+0000","last_undegraded":"2024-04-25T22:45:07.146194+0000","last_fullsized":"2024-04-25T22:45:07.146194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3883,"num_write":348,"num_write_kb":34122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"71'209","reported_seq":414,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.391521+0000","last_change":"2024-04-25T22:44:41.419972+0000","last_active":"2024-04-25T22:44:59.391521+0000","last_peered":"2024-04-25T22:44:59.391521+0000","last_clean":"2024-04-25T22:44:59.391521+0000","last_became_active":"2024-04-25T22:44:41.418106+0000","last_became_peered":"2024-04-25T22:44:41.418106+0000","last_unstale":"2024-04-25T22:44:59.391521+0000","last_undegraded":"2024-04-25T22:44:59.391521+0000","last_fullsized":"2024-04-25T22:44:59.391521+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":12363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"72'419","reported_seq":616,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:14.195273+0000","last_change":"2024-04-25T22:45:14.195329+0000","last_active":"2024-04-25T22:45:14.195273+0000","last_peered":"2024-04-25T22:45:14.195273+0000","last_clean":"2024-04-25T22:45:14.195273+0000","last_became_active":"2024-04-25T22:44:41.420505+0000","last_became_peered":"2024-04-25T22:44:41.420505+0000","last_unstale":"2024-04-25T22:45:14.195273+0000","last_undegraded":"2024-04-25T22:45:14.195273+0000","last_fullsized":"2024-04-25T22:45:14.195273+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'419","last_scrub_stamp":"2024-04-25T22:45:14.195073+0000","last_deep_scrub":"72'419","last_deep_scrub_stamp":"2024-04-25T22:45:14.195073+0000","last_clean_scrub_stamp":"2024-04-25T22:45:14.195073+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:10.119407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":13327,"num_write":388,"num_write_kb":55674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"71'131","reported_seq":350,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.103998+0000","last_change":"2024-04-25T22:44:29.398880+0000","last_active":"2024-04-25T22:44:59.103998+0000","last_peered":"2024-04-25T22:44:59.103998+0000","last_clean":"2024-04-25T22:44:59.103998+0000","last_became_active":"2024-04-25T22:44:29.397905+0000","last_became_peered":"2024-04-25T22:44:29.397905+0000","last_unstale":"2024-04-25T22:44:59.103998+0000","last_undegraded":"2024-04-25T22:44:59.103998+0000","last_fullsized":"2024-04-25T22:44:59.103998+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:12.512392+0000","last_clean_scrub_stamp":"2024-04-25T22:40:12.512392+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"72'449","reported_seq":693,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:21.789313+0000","last_change":"2024-04-25T22:45:21.789369+0000","last_active":"2024-04-25T22:45:21.789313+0000","last_peered":"2024-04-25T22:45:21.789313+0000","last_clean":"2024-04-25T22:45:21.789313+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:45:21.789313+0000","last_undegraded":"2024-04-25T22:45:21.789313+0000","last_fullsized":"2024-04-25T22:45:21.789313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'449","last_scrub_stamp":"2024-04-25T22:45:21.789127+0000","last_deep_scrub":"72'449","last_deep_scrub_stamp":"2024-04-25T22:45:21.789127+0000","last_clean_scrub_stamp":"2024-04-25T22:45:21.789127+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:22.847617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14222,"num_write":424,"num_write_kb":79796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"113'60","reported_seq":225,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:10.988727+0000","last_change":"2024-04-25T22:45:10.988900+0000","last_active":"2024-04-25T22:45:10.988727+0000","last_peered":"2024-04-25T22:45:10.988727+0000","last_clean":"2024-04-25T22:45:10.988727+0000","last_became_active":"2024-04-25T22:44:39.136283+0000","last_became_peered":"2024-04-25T22:44:39.136283+0000","last_unstale":"2024-04-25T22:45:10.988727+0000","last_undegraded":"2024-04-25T22:45:10.988727+0000","last_fullsized":"2024-04-25T22:45:10.988727+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'60","last_scrub_stamp":"2024-04-25T22:45:10.988509+0000","last_deep_scrub":"113'60","last_deep_scrub_stamp":"2024-04-25T22:45:10.988509+0000","last_clean_scrub_stamp":"2024-04-25T22:45:10.988509+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:33.410497+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2461,"num_read_kb":1248646,"num_write":24434,"num_write_kb":4137258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7447,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26539,"ondisk_log_size":26539,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127071275,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":4473,"num_write_kb":127409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254210048,"data_stored":254142550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},"log_size":6239,"ondisk_log_size":6239,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738438,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165336,"kb_used_data":80080,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94206504,"statfs":{"total":96636764160,"available":96467460096,"internally_reserved":0,"allocated":82001920,"data_stored":81417710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":79,"seq":339302416398,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141396,"kb_used_data":83340,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94230444,"statfs":{"total":96636764160,"available":96491974656,"internally_reserved":0,"allocated":85340160,"data_stored":84739534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6003,"internal_metadata":59435149},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174344,"kb_used_data":89088,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94197496,"statfs":{"total":96636764160,"available":96458235904,"internally_reserved":0,"allocated":91226112,"data_stored":90619941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89575424,"data_stored":89544940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83689472,"data_stored":83664533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80945152,"data_stored":80933077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:45:28.804 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.804 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.804 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.804 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.804 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.805 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.805 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.805 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.805 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.805 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.805 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.805 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.805 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.806 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.806 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.806 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.806 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.806 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.806 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.806 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.806 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.807 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.807 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.807 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.807 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.807 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.807 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T22:40:03.263093+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=3, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.807 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T22:40:08.425969+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.807 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.807 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.807 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T22:40:08.425969+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.808 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T22:40:08.425969+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.808 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.808 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.808 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T22:40:08.425969+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.808 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.808 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.808 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.808 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T22:40:08.425969+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.808 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.808 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.809 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T22:40:08.425969+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.809 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.809 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T22:40:08.425969+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.809 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.809 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.809 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.809 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.809 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.810 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.810 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.810 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.810 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.810 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.810 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.810 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.810 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.810 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.811 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T22:40:12.512392+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:28.811 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T22:45:48.812 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:45:49.135 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:45:49.137 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:45:49.153 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-04-25T22:45:47.260745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127661643,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2659,"num_read_kb":1250233,"num_write":29110,"num_write_kb":4268127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7469,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32966,"ondisk_log_size":32966,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":481076,"kb_used_data":252508,"kb_used_omap":8,"kb_used_meta":228535,"kb_avail":282634444,"statfs":{"total":289910292480,"available":289417670656,"internally_reserved":0,"allocated":258568192,"data_stored":256777185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9193,"internal_metadata":234019863},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004709"},"pg_stats":[{"pgid":"4.3f","version":"72'404","reported_seq":568,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:39.547461+0000","last_change":"2024-04-25T22:45:39.547521+0000","last_active":"2024-04-25T22:45:39.547461+0000","last_peered":"2024-04-25T22:45:39.547461+0000","last_clean":"2024-04-25T22:45:39.547461+0000","last_became_active":"2024-04-25T22:44:57.376098+0000","last_became_peered":"2024-04-25T22:44:57.376098+0000","last_unstale":"2024-04-25T22:45:39.547461+0000","last_undegraded":"2024-04-25T22:45:39.547461+0000","last_fullsized":"2024-04-25T22:45:39.547461+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'404","last_scrub_stamp":"2024-04-25T22:45:39.547222+0000","last_deep_scrub":"72'404","last_deep_scrub_stamp":"2024-04-25T22:45:39.547222+0000","last_clean_scrub_stamp":"2024-04-25T22:45:39.547222+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:02.614954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19772,"num_write":366,"num_write_kb":46873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"72'420","reported_seq":631,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:12.184338+0000","last_change":"2024-04-25T22:45:12.184395+0000","last_active":"2024-04-25T22:45:12.184338+0000","last_peered":"2024-04-25T22:45:12.184338+0000","last_clean":"2024-04-25T22:45:12.184338+0000","last_became_active":"2024-04-25T22:44:41.418792+0000","last_became_peered":"2024-04-25T22:44:41.418792+0000","last_unstale":"2024-04-25T22:45:12.184338+0000","last_undegraded":"2024-04-25T22:45:12.184338+0000","last_fullsized":"2024-04-25T22:45:12.184338+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'420","last_scrub_stamp":"2024-04-25T22:45:12.184147+0000","last_deep_scrub":"72'420","last_deep_scrub_stamp":"2024-04-25T22:45:12.184147+0000","last_clean_scrub_stamp":"2024-04-25T22:45:12.184147+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:42:08.825155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24515,"num_write":386,"num_write_kb":55688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"72'377","reported_seq":953,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.107550+0000","last_change":"2024-04-25T22:44:42.096911+0000","last_active":"2024-04-25T22:44:59.107550+0000","last_peered":"2024-04-25T22:44:59.107550+0000","last_clean":"2024-04-25T22:44:59.107550+0000","last_became_active":"2024-04-25T22:44:42.093941+0000","last_became_peered":"2024-04-25T22:44:42.093941+0000","last_unstale":"2024-04-25T22:44:59.107550+0000","last_undegraded":"2024-04-25T22:44:59.107550+0000","last_fullsized":"2024-04-25T22:44:59.107550+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11135,"num_write":346,"num_write_kb":38950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"72'366","reported_seq":582,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:20.800938+0000","last_change":"2024-04-25T22:45:20.800998+0000","last_active":"2024-04-25T22:45:20.800938+0000","last_peered":"2024-04-25T22:45:20.800938+0000","last_clean":"2024-04-25T22:45:20.800938+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:45:20.800938+0000","last_undegraded":"2024-04-25T22:45:20.800938+0000","last_fullsized":"2024-04-25T22:45:20.800938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'366","last_scrub_stamp":"2024-04-25T22:45:20.800720+0000","last_deep_scrub":"72'366","last_deep_scrub_stamp":"2024-04-25T22:45:20.800720+0000","last_clean_scrub_stamp":"2024-04-25T22:45:20.800720+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:30:30.198446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":326,"num_write_kb":34079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"72'455","reported_seq":644,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:21.294505+0000","last_change":"2024-04-25T22:45:21.294650+0000","last_active":"2024-04-25T22:45:21.294505+0000","last_peered":"2024-04-25T22:45:21.294505+0000","last_clean":"2024-04-25T22:45:21.294505+0000","last_became_active":"2024-04-25T22:44:50.384804+0000","last_became_peered":"2024-04-25T22:44:50.384804+0000","last_unstale":"2024-04-25T22:45:21.294505+0000","last_undegraded":"2024-04-25T22:45:21.294505+0000","last_fullsized":"2024-04-25T22:45:21.294505+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'455","last_scrub_stamp":"2024-04-25T22:45:21.294262+0000","last_deep_scrub":"72'455","last_deep_scrub_stamp":"2024-04-25T22:45:21.294262+0000","last_clean_scrub_stamp":"2024-04-25T22:45:21.294262+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:23:59.755528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33897,"num_write":426,"num_write_kb":100721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"72'401","reported_seq":645,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:13.805050+0000","last_change":"2024-04-25T22:45:13.805050+0000","last_active":"2024-04-25T22:45:13.805050+0000","last_peered":"2024-04-25T22:45:13.805050+0000","last_clean":"2024-04-25T22:45:13.805050+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:45:13.805050+0000","last_undegraded":"2024-04-25T22:45:13.805050+0000","last_fullsized":"2024-04-25T22:45:13.805050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'401","last_scrub_stamp":"2024-04-25T22:45:13.804798+0000","last_deep_scrub":"72'401","last_deep_scrub_stamp":"2024-04-25T22:45:13.804798+0000","last_clean_scrub_stamp":"2024-04-25T22:45:13.804798+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:59.583390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15258,"num_write":369,"num_write_kb":53298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"72'452","reported_seq":728,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:18.816458+0000","last_change":"2024-04-25T22:45:18.816514+0000","last_active":"2024-04-25T22:45:18.816458+0000","last_peered":"2024-04-25T22:45:18.816458+0000","last_clean":"2024-04-25T22:45:18.816458+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:45:18.816458+0000","last_undegraded":"2024-04-25T22:45:18.816458+0000","last_fullsized":"2024-04-25T22:45:18.816458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'452","last_scrub_stamp":"2024-04-25T22:45:18.816273+0000","last_deep_scrub":"72'452","last_deep_scrub_stamp":"2024-04-25T22:45:18.816273+0000","last_clean_scrub_stamp":"2024-04-25T22:45:18.816273+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:12.155613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34010,"num_write":428,"num_write_kb":157752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"72'401","reported_seq":650,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:23.738883+0000","last_change":"2024-04-25T22:45:23.738944+0000","last_active":"2024-04-25T22:45:23.738883+0000","last_peered":"2024-04-25T22:45:23.738883+0000","last_clean":"2024-04-25T22:45:23.738883+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:45:23.738883+0000","last_undegraded":"2024-04-25T22:45:23.738883+0000","last_fullsized":"2024-04-25T22:45:23.738883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'401","last_scrub_stamp":"2024-04-25T22:45:23.738682+0000","last_deep_scrub":"72'401","last_deep_scrub_stamp":"2024-04-25T22:45:23.738682+0000","last_clean_scrub_stamp":"2024-04-25T22:45:23.738682+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:16.674591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19917,"num_write":359,"num_write_kb":109382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"72'394","reported_seq":990,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:39.122331+0000","last_change":"2024-04-25T22:45:39.122395+0000","last_active":"2024-04-25T22:45:39.122331+0000","last_peered":"2024-04-25T22:45:39.122331+0000","last_clean":"2024-04-25T22:45:39.122331+0000","last_became_active":"2024-04-25T22:44:48.089795+0000","last_became_peered":"2024-04-25T22:44:48.089795+0000","last_unstale":"2024-04-25T22:45:39.122331+0000","last_undegraded":"2024-04-25T22:45:39.122331+0000","last_fullsized":"2024-04-25T22:45:39.122331+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'394","last_scrub_stamp":"2024-04-25T22:45:39.122145+0000","last_deep_scrub":"72'394","last_deep_scrub_stamp":"2024-04-25T22:45:39.122145+0000","last_clean_scrub_stamp":"2024-04-25T22:45:39.122145+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:34:56.062074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9569,"num_write":360,"num_write_kb":25560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"72'382","reported_seq":575,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:16.197759+0000","last_change":"2024-04-25T22:45:16.197815+0000","last_active":"2024-04-25T22:45:16.197759+0000","last_peered":"2024-04-25T22:45:16.197759+0000","last_clean":"2024-04-25T22:45:16.197759+0000","last_became_active":"2024-04-25T22:44:41.421234+0000","last_became_peered":"2024-04-25T22:44:41.421234+0000","last_unstale":"2024-04-25T22:45:16.197759+0000","last_undegraded":"2024-04-25T22:45:16.197759+0000","last_fullsized":"2024-04-25T22:45:16.197759+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'382","last_scrub_stamp":"2024-04-25T22:45:16.197564+0000","last_deep_scrub":"72'382","last_deep_scrub_stamp":"2024-04-25T22:45:16.197564+0000","last_clean_scrub_stamp":"2024-04-25T22:45:16.197564+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:55.640137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17192,"num_write":338,"num_write_kb":38688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"72'369","reported_seq":602,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:25.795277+0000","last_change":"2024-04-25T22:45:25.795337+0000","last_active":"2024-04-25T22:45:25.795277+0000","last_peered":"2024-04-25T22:45:25.795277+0000","last_clean":"2024-04-25T22:45:25.795277+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:45:25.795277+0000","last_undegraded":"2024-04-25T22:45:25.795277+0000","last_fullsized":"2024-04-25T22:45:25.795277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'369","last_scrub_stamp":"2024-04-25T22:45:25.795029+0000","last_deep_scrub":"72'369","last_deep_scrub_stamp":"2024-04-25T22:45:25.795029+0000","last_clean_scrub_stamp":"2024-04-25T22:45:25.795029+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:19:27.181488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7385,"num_write":349,"num_write_kb":58842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"72'338","reported_seq":531,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:19.204479+0000","last_change":"2024-04-25T22:45:19.204542+0000","last_active":"2024-04-25T22:45:19.204479+0000","last_peered":"2024-04-25T22:45:19.204479+0000","last_clean":"2024-04-25T22:45:19.204479+0000","last_became_active":"2024-04-25T22:44:49.378325+0000","last_became_peered":"2024-04-25T22:44:49.378325+0000","last_unstale":"2024-04-25T22:45:19.204479+0000","last_undegraded":"2024-04-25T22:45:19.204479+0000","last_fullsized":"2024-04-25T22:45:19.204479+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'338","last_scrub_stamp":"2024-04-25T22:45:19.204281+0000","last_deep_scrub":"72'338","last_deep_scrub_stamp":"2024-04-25T22:45:19.204281+0000","last_clean_scrub_stamp":"2024-04-25T22:45:19.204281+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:24:35.194784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13619,"num_write":312,"num_write_kb":21391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"72'411","reported_seq":614,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:20.249763+0000","last_change":"2024-04-25T22:45:20.249821+0000","last_active":"2024-04-25T22:45:20.249763+0000","last_peered":"2024-04-25T22:45:20.249763+0000","last_clean":"2024-04-25T22:45:20.249763+0000","last_became_active":"2024-04-25T22:44:41.421096+0000","last_became_peered":"2024-04-25T22:44:41.421096+0000","last_unstale":"2024-04-25T22:45:20.249763+0000","last_undegraded":"2024-04-25T22:45:20.249763+0000","last_fullsized":"2024-04-25T22:45:20.249763+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'411","last_scrub_stamp":"2024-04-25T22:45:20.249567+0000","last_deep_scrub":"72'411","last_deep_scrub_stamp":"2024-04-25T22:45:20.249567+0000","last_clean_scrub_stamp":"2024-04-25T22:45:20.249567+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:01.734764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12998,"num_write":375,"num_write_kb":79661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"72'452","reported_seq":1060,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:41.566666+0000","last_change":"2024-04-25T22:45:41.566727+0000","last_active":"2024-04-25T22:45:41.566666+0000","last_peered":"2024-04-25T22:45:41.566666+0000","last_clean":"2024-04-25T22:45:41.566666+0000","last_became_active":"2024-04-25T22:44:40.127307+0000","last_became_peered":"2024-04-25T22:44:40.127307+0000","last_unstale":"2024-04-25T22:45:41.566666+0000","last_undegraded":"2024-04-25T22:45:41.566666+0000","last_fullsized":"2024-04-25T22:45:41.566666+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'452","last_scrub_stamp":"2024-04-25T22:45:41.566459+0000","last_deep_scrub":"72'452","last_deep_scrub_stamp":"2024-04-25T22:45:41.566459+0000","last_clean_scrub_stamp":"2024-04-25T22:45:41.566459+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:27:49.107252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":854,"num_write":419,"num_write_kb":88217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"72'428","reported_seq":1040,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:39.597468+0000","last_change":"2024-04-25T22:45:39.597526+0000","last_active":"2024-04-25T22:45:39.597468+0000","last_peered":"2024-04-25T22:45:39.597468+0000","last_clean":"2024-04-25T22:45:39.597468+0000","last_became_active":"2024-04-25T22:44:35.103208+0000","last_became_peered":"2024-04-25T22:44:35.103208+0000","last_unstale":"2024-04-25T22:45:39.597468+0000","last_undegraded":"2024-04-25T22:45:39.597468+0000","last_fullsized":"2024-04-25T22:45:39.597468+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'428","last_scrub_stamp":"2024-04-25T22:45:39.597265+0000","last_deep_scrub":"72'428","last_deep_scrub_stamp":"2024-04-25T22:45:39.597265+0000","last_clean_scrub_stamp":"2024-04-25T22:45:39.597265+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:43:07.736662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21291,"num_write":389,"num_write_kb":68562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"72'401","reported_seq":624,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:17.806706+0000","last_change":"2024-04-25T22:45:17.806824+0000","last_active":"2024-04-25T22:45:17.806706+0000","last_peered":"2024-04-25T22:45:17.806706+0000","last_clean":"2024-04-25T22:45:17.806706+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:45:17.806706+0000","last_undegraded":"2024-04-25T22:45:17.806706+0000","last_fullsized":"2024-04-25T22:45:17.806706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'401","last_scrub_stamp":"2024-04-25T22:45:17.806458+0000","last_deep_scrub":"72'401","last_deep_scrub_stamp":"2024-04-25T22:45:17.806458+0000","last_clean_scrub_stamp":"2024-04-25T22:45:17.806458+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:08.446390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8276,"num_write":369,"num_write_kb":17867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"72'398","reported_seq":980,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:40.160643+0000","last_change":"2024-04-25T22:45:40.160707+0000","last_active":"2024-04-25T22:45:40.160643+0000","last_peered":"2024-04-25T22:45:40.160643+0000","last_clean":"2024-04-25T22:45:40.160643+0000","last_became_active":"2024-04-25T22:44:49.094478+0000","last_became_peered":"2024-04-25T22:44:49.094478+0000","last_unstale":"2024-04-25T22:45:40.160643+0000","last_undegraded":"2024-04-25T22:45:40.160643+0000","last_fullsized":"2024-04-25T22:45:40.160643+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'398","last_scrub_stamp":"2024-04-25T22:45:40.160447+0000","last_deep_scrub":"72'398","last_deep_scrub_stamp":"2024-04-25T22:45:40.160447+0000","last_clean_scrub_stamp":"2024-04-25T22:45:40.160447+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:52.207576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5883,"num_write":362,"num_write_kb":38188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"72'407","reported_seq":552,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:42.624230+0000","last_change":"2024-04-25T22:45:42.624287+0000","last_active":"2024-04-25T22:45:42.624230+0000","last_peered":"2024-04-25T22:45:42.624230+0000","last_clean":"2024-04-25T22:45:42.624230+0000","last_became_active":"2024-04-25T22:44:59.396404+0000","last_became_peered":"2024-04-25T22:44:59.396404+0000","last_unstale":"2024-04-25T22:45:42.624230+0000","last_undegraded":"2024-04-25T22:45:42.624230+0000","last_fullsized":"2024-04-25T22:45:42.624230+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'407","last_scrub_stamp":"2024-04-25T22:45:42.624044+0000","last_deep_scrub":"72'407","last_deep_scrub_stamp":"2024-04-25T22:45:42.624044+0000","last_clean_scrub_stamp":"2024-04-25T22:45:42.624044+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:10.573505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13073,"num_write":372,"num_write_kb":59323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"72'441","reported_seq":1068,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:34.140060+0000","last_change":"2024-04-25T22:45:34.140120+0000","last_active":"2024-04-25T22:45:34.140060+0000","last_peered":"2024-04-25T22:45:34.140060+0000","last_clean":"2024-04-25T22:45:34.140060+0000","last_became_active":"2024-04-25T22:44:41.143302+0000","last_became_peered":"2024-04-25T22:44:41.143302+0000","last_unstale":"2024-04-25T22:45:34.140060+0000","last_undegraded":"2024-04-25T22:45:34.140060+0000","last_fullsized":"2024-04-25T22:45:34.140060+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'441","last_scrub_stamp":"2024-04-25T22:45:34.139765+0000","last_deep_scrub":"72'441","last_deep_scrub_stamp":"2024-04-25T22:45:34.139765+0000","last_clean_scrub_stamp":"2024-04-25T22:45:34.139765+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:40:19.346042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37611,"num_write":403,"num_write_kb":116618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"72'438","reported_seq":673,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:19.816036+0000","last_change":"2024-04-25T22:45:19.816093+0000","last_active":"2024-04-25T22:45:19.816036+0000","last_peered":"2024-04-25T22:45:19.816036+0000","last_clean":"2024-04-25T22:45:19.816036+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:45:19.816036+0000","last_undegraded":"2024-04-25T22:45:19.816036+0000","last_fullsized":"2024-04-25T22:45:19.816036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'438","last_scrub_stamp":"2024-04-25T22:45:19.815827+0000","last_deep_scrub":"72'438","last_deep_scrub_stamp":"2024-04-25T22:45:19.815827+0000","last_clean_scrub_stamp":"2024-04-25T22:45:19.815827+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:36:57.469378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12393,"num_write":408,"num_write_kb":99933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"72'407","reported_seq":631,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:16.780914+0000","last_change":"2024-04-25T22:45:16.780971+0000","last_active":"2024-04-25T22:45:16.780914+0000","last_peered":"2024-04-25T22:45:16.780914+0000","last_clean":"2024-04-25T22:45:16.780914+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:45:16.780914+0000","last_undegraded":"2024-04-25T22:45:16.780914+0000","last_fullsized":"2024-04-25T22:45:16.780914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'407","last_scrub_stamp":"2024-04-25T22:45:16.780720+0000","last_deep_scrub":"72'407","last_deep_scrub_stamp":"2024-04-25T22:45:16.780720+0000","last_clean_scrub_stamp":"2024-04-25T22:45:16.780720+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:18.464252+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8932,"num_write":382,"num_write_kb":59684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"72'463","reported_seq":701,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:15.170317+0000","last_change":"2024-04-25T22:45:15.170394+0000","last_active":"2024-04-25T22:45:15.170317+0000","last_peered":"2024-04-25T22:45:15.170317+0000","last_clean":"2024-04-25T22:45:15.170317+0000","last_became_active":"2024-04-25T22:44:47.369995+0000","last_became_peered":"2024-04-25T22:44:47.369995+0000","last_unstale":"2024-04-25T22:45:15.170317+0000","last_undegraded":"2024-04-25T22:45:15.170317+0000","last_fullsized":"2024-04-25T22:45:15.170317+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'463","last_scrub_stamp":"2024-04-25T22:45:15.170124+0000","last_deep_scrub":"72'463","last_deep_scrub_stamp":"2024-04-25T22:45:15.170124+0000","last_clean_scrub_stamp":"2024-04-25T22:45:15.170124+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:16:47.186871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27589,"num_write":428,"num_write_kb":76861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"72'425","reported_seq":703,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:13.959533+0000","last_change":"2024-04-25T22:45:13.959595+0000","last_active":"2024-04-25T22:45:13.959533+0000","last_peered":"2024-04-25T22:45:13.959533+0000","last_clean":"2024-04-25T22:45:13.959533+0000","last_became_active":"2024-04-25T22:44:39.118635+0000","last_became_peered":"2024-04-25T22:44:39.118635+0000","last_unstale":"2024-04-25T22:45:13.959533+0000","last_undegraded":"2024-04-25T22:45:13.959533+0000","last_fullsized":"2024-04-25T22:45:13.959533+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'425","last_scrub_stamp":"2024-04-25T22:45:13.959287+0000","last_deep_scrub":"72'425","last_deep_scrub_stamp":"2024-04-25T22:45:13.959287+0000","last_clean_scrub_stamp":"2024-04-25T22:45:13.959287+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:32.240463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":46424,"num_write":390,"num_write_kb":96359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"72'445","reported_seq":628,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:08.104270+0000","last_change":"2024-04-25T22:45:08.104354+0000","last_active":"2024-04-25T22:45:08.104270+0000","last_peered":"2024-04-25T22:45:08.104270+0000","last_clean":"2024-04-25T22:45:08.104270+0000","last_became_active":"2024-04-25T22:44:54.382124+0000","last_became_peered":"2024-04-25T22:44:54.382124+0000","last_unstale":"2024-04-25T22:45:08.104270+0000","last_undegraded":"2024-04-25T22:45:08.104270+0000","last_fullsized":"2024-04-25T22:45:08.104270+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'445","last_scrub_stamp":"2024-04-25T22:45:08.104062+0000","last_deep_scrub":"72'445","last_deep_scrub_stamp":"2024-04-25T22:45:08.104062+0000","last_clean_scrub_stamp":"2024-04-25T22:45:08.104062+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:05.080111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32317,"num_write":419,"num_write_kb":76071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"72'424","reported_seq":599,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:23.308204+0000","last_change":"2024-04-25T22:45:23.308261+0000","last_active":"2024-04-25T22:45:23.308204+0000","last_peered":"2024-04-25T22:45:23.308204+0000","last_clean":"2024-04-25T22:45:23.308204+0000","last_became_active":"2024-04-25T22:44:51.383461+0000","last_became_peered":"2024-04-25T22:44:51.383461+0000","last_unstale":"2024-04-25T22:45:23.308204+0000","last_undegraded":"2024-04-25T22:45:23.308204+0000","last_fullsized":"2024-04-25T22:45:23.308204+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'424","last_scrub_stamp":"2024-04-25T22:45:23.308006+0000","last_deep_scrub":"72'424","last_deep_scrub_stamp":"2024-04-25T22:45:23.308006+0000","last_clean_scrub_stamp":"2024-04-25T22:45:23.308006+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:18.496607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8396,"num_write":399,"num_write_kb":50416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"72'499","reported_seq":719,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:19.029685+0000","last_change":"2024-04-25T22:45:19.029744+0000","last_active":"2024-04-25T22:45:19.029685+0000","last_peered":"2024-04-25T22:45:19.029685+0000","last_clean":"2024-04-25T22:45:19.029685+0000","last_became_active":"2024-04-25T22:44:39.143391+0000","last_became_peered":"2024-04-25T22:44:39.143391+0000","last_unstale":"2024-04-25T22:45:19.029685+0000","last_undegraded":"2024-04-25T22:45:19.029685+0000","last_fullsized":"2024-04-25T22:45:19.029685+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'499","last_scrub_stamp":"2024-04-25T22:45:19.029484+0000","last_deep_scrub":"72'499","last_deep_scrub_stamp":"2024-04-25T22:45:19.029484+0000","last_clean_scrub_stamp":"2024-04-25T22:45:19.029484+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:40.593352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10227,"num_write":453,"num_write_kb":96585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'430","reported_seq":1091,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:40.602946+0000","last_change":"2024-04-25T22:45:40.603135+0000","last_active":"2024-04-25T22:45:40.602946+0000","last_peered":"2024-04-25T22:45:40.602946+0000","last_clean":"2024-04-25T22:45:40.602946+0000","last_became_active":"2024-04-25T22:44:39.109771+0000","last_became_peered":"2024-04-25T22:44:39.109771+0000","last_unstale":"2024-04-25T22:45:40.602946+0000","last_undegraded":"2024-04-25T22:45:40.602946+0000","last_fullsized":"2024-04-25T22:45:40.602946+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'430","last_scrub_stamp":"2024-04-25T22:45:40.602721+0000","last_deep_scrub":"72'430","last_deep_scrub_stamp":"2024-04-25T22:45:40.602721+0000","last_clean_scrub_stamp":"2024-04-25T22:45:40.602721+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:45.941937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":32116,"num_write":409,"num_write_kb":89217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"72'393","reported_seq":665,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:22.342484+0000","last_change":"2024-04-25T22:45:22.342612+0000","last_active":"2024-04-25T22:45:22.342484+0000","last_peered":"2024-04-25T22:45:22.342484+0000","last_clean":"2024-04-25T22:45:22.342484+0000","last_became_active":"2024-04-25T22:44:41.413570+0000","last_became_peered":"2024-04-25T22:44:41.413570+0000","last_unstale":"2024-04-25T22:45:22.342484+0000","last_undegraded":"2024-04-25T22:45:22.342484+0000","last_fullsized":"2024-04-25T22:45:22.342484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'393","last_scrub_stamp":"2024-04-25T22:45:22.342226+0000","last_deep_scrub":"72'393","last_deep_scrub_stamp":"2024-04-25T22:45:22.342226+0000","last_clean_scrub_stamp":"2024-04-25T22:45:22.342226+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:15:44.431501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":28076,"num_write":364,"num_write_kb":47473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"72'399","reported_seq":1002,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:33.092417+0000","last_change":"2024-04-25T22:45:33.092562+0000","last_active":"2024-04-25T22:45:33.092417+0000","last_peered":"2024-04-25T22:45:33.092417+0000","last_clean":"2024-04-25T22:45:33.092417+0000","last_became_active":"2024-04-25T22:44:40.121838+0000","last_became_peered":"2024-04-25T22:44:40.121838+0000","last_unstale":"2024-04-25T22:45:33.092417+0000","last_undegraded":"2024-04-25T22:45:33.092417+0000","last_fullsized":"2024-04-25T22:45:33.092417+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'399","last_scrub_stamp":"2024-04-25T22:45:33.092179+0000","last_deep_scrub":"72'399","last_deep_scrub_stamp":"2024-04-25T22:45:33.092179+0000","last_clean_scrub_stamp":"2024-04-25T22:45:33.092179+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:01:19.694306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14005,"num_write":367,"num_write_kb":58883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"72'484","reported_seq":692,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:09.121900+0000","last_change":"2024-04-25T22:45:09.121967+0000","last_active":"2024-04-25T22:45:09.121900+0000","last_peered":"2024-04-25T22:45:09.121900+0000","last_clean":"2024-04-25T22:45:09.121900+0000","last_became_active":"2024-04-25T22:44:54.383808+0000","last_became_peered":"2024-04-25T22:44:54.383808+0000","last_unstale":"2024-04-25T22:45:09.121900+0000","last_undegraded":"2024-04-25T22:45:09.121900+0000","last_fullsized":"2024-04-25T22:45:09.121900+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'484","last_scrub_stamp":"2024-04-25T22:45:09.121700+0000","last_deep_scrub":"72'484","last_deep_scrub_stamp":"2024-04-25T22:45:09.121700+0000","last_clean_scrub_stamp":"2024-04-25T22:45:09.121700+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:39.991100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23352,"num_write":446,"num_write_kb":100094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'455","reported_seq":1145,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:22.025109+0000","last_change":"2024-04-25T22:45:22.025174+0000","last_active":"2024-04-25T22:45:22.025109+0000","last_peered":"2024-04-25T22:45:22.025109+0000","last_clean":"2024-04-25T22:45:22.025109+0000","last_became_active":"2024-04-25T22:44:33.084127+0000","last_became_peered":"2024-04-25T22:44:33.084127+0000","last_unstale":"2024-04-25T22:45:22.025109+0000","last_undegraded":"2024-04-25T22:45:22.025109+0000","last_fullsized":"2024-04-25T22:45:22.025109+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'455","last_scrub_stamp":"2024-04-25T22:45:22.024900+0000","last_deep_scrub":"72'455","last_deep_scrub_stamp":"2024-04-25T22:45:22.024900+0000","last_clean_scrub_stamp":"2024-04-25T22:45:22.024900+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:11:33.397396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38440,"num_write":423,"num_write_kb":71855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"72'434","reported_seq":677,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:26.746381+0000","last_change":"2024-04-25T22:45:26.746443+0000","last_active":"2024-04-25T22:45:26.746381+0000","last_peered":"2024-04-25T22:45:26.746381+0000","last_clean":"2024-04-25T22:45:26.746381+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:45:26.746381+0000","last_undegraded":"2024-04-25T22:45:26.746381+0000","last_fullsized":"2024-04-25T22:45:26.746381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'434","last_scrub_stamp":"2024-04-25T22:45:26.746183+0000","last_deep_scrub":"72'434","last_deep_scrub_stamp":"2024-04-25T22:45:26.746183+0000","last_clean_scrub_stamp":"2024-04-25T22:45:26.746183+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:39:41.486526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18701,"num_write":402,"num_write_kb":27564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"72'379","reported_seq":535,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:10.161130+0000","last_change":"2024-04-25T22:45:10.161189+0000","last_active":"2024-04-25T22:45:10.161130+0000","last_peered":"2024-04-25T22:45:10.161130+0000","last_clean":"2024-04-25T22:45:10.161130+0000","last_became_active":"2024-04-25T22:44:53.378402+0000","last_became_peered":"2024-04-25T22:44:53.378402+0000","last_unstale":"2024-04-25T22:45:10.161130+0000","last_undegraded":"2024-04-25T22:45:10.161130+0000","last_fullsized":"2024-04-25T22:45:10.161130+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'379","last_scrub_stamp":"2024-04-25T22:45:10.160926+0000","last_deep_scrub":"72'379","last_deep_scrub_stamp":"2024-04-25T22:45:10.160926+0000","last_clean_scrub_stamp":"2024-04-25T22:45:10.160926+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:05:12.549495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18623,"num_write":344,"num_write_kb":50888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"113'532","reported_seq":744,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:36.694683+0000","last_change":"2024-04-25T22:45:36.694811+0000","last_active":"2024-04-25T22:45:36.694683+0000","last_peered":"2024-04-25T22:45:36.694683+0000","last_clean":"2024-04-25T22:45:36.694683+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:45:36.694683+0000","last_undegraded":"2024-04-25T22:45:36.694683+0000","last_fullsized":"2024-04-25T22:45:36.694683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'532","last_scrub_stamp":"2024-04-25T22:45:36.694455+0000","last_deep_scrub":"113'532","last_deep_scrub_stamp":"2024-04-25T22:45:36.694455+0000","last_clean_scrub_stamp":"2024-04-25T22:45:36.694455+0000","objects_scrubbed":4,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:00:14.642429+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"72'383","reported_seq":512,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:40.566326+0000","last_change":"2024-04-25T22:45:40.566410+0000","last_active":"2024-04-25T22:45:40.566326+0000","last_peered":"2024-04-25T22:45:40.566326+0000","last_clean":"2024-04-25T22:45:40.566326+0000","last_became_active":"2024-04-25T22:44:58.380203+0000","last_became_peered":"2024-04-25T22:44:58.380203+0000","last_unstale":"2024-04-25T22:45:40.566326+0000","last_undegraded":"2024-04-25T22:45:40.566326+0000","last_fullsized":"2024-04-25T22:45:40.566326+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'383","last_scrub_stamp":"2024-04-25T22:45:40.566118+0000","last_deep_scrub":"72'383","last_deep_scrub_stamp":"2024-04-25T22:45:40.566118+0000","last_clean_scrub_stamp":"2024-04-25T22:45:40.566118+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:12.503898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8364,"num_write":351,"num_write_kb":30625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"71'45","reported_seq":210,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:20.013456+0000","last_change":"2024-04-25T22:45:20.013520+0000","last_active":"2024-04-25T22:45:20.013456+0000","last_peered":"2024-04-25T22:45:20.013456+0000","last_clean":"2024-04-25T22:45:20.013456+0000","last_became_active":"2024-04-25T22:44:39.115669+0000","last_became_peered":"2024-04-25T22:44:39.115669+0000","last_unstale":"2024-04-25T22:45:20.013456+0000","last_undegraded":"2024-04-25T22:45:20.013456+0000","last_fullsized":"2024-04-25T22:45:20.013456+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'45","last_scrub_stamp":"2024-04-25T22:45:20.013252+0000","last_deep_scrub":"71'45","last_deep_scrub_stamp":"2024-04-25T22:45:20.013252+0000","last_clean_scrub_stamp":"2024-04-25T22:45:20.013252+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:07.692493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"72'429","reported_seq":580,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:41.606978+0000","last_change":"2024-04-25T22:45:41.607034+0000","last_active":"2024-04-25T22:45:41.606978+0000","last_peered":"2024-04-25T22:45:41.606978+0000","last_clean":"2024-04-25T22:45:41.606978+0000","last_became_active":"2024-04-25T22:44:58.382521+0000","last_became_peered":"2024-04-25T22:44:58.382521+0000","last_unstale":"2024-04-25T22:45:41.606978+0000","last_undegraded":"2024-04-25T22:45:41.606978+0000","last_fullsized":"2024-04-25T22:45:41.606978+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'429","last_scrub_stamp":"2024-04-25T22:45:41.606779+0000","last_deep_scrub":"72'429","last_deep_scrub_stamp":"2024-04-25T22:45:41.606779+0000","last_clean_scrub_stamp":"2024-04-25T22:45:41.606779+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:12:22.746156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16584,"num_write":393,"num_write_kb":63712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'61","reported_seq":98,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:28.411110+0000","last_change":"2024-04-25T22:45:28.411168+0000","last_active":"2024-04-25T22:45:28.411110+0000","last_peered":"2024-04-25T22:45:28.411110+0000","last_clean":"2024-04-25T22:45:28.411110+0000","last_became_active":"2024-04-25T22:44:41.413853+0000","last_became_peered":"2024-04-25T22:44:41.413853+0000","last_unstale":"2024-04-25T22:45:28.411110+0000","last_undegraded":"2024-04-25T22:45:28.411110+0000","last_fullsized":"2024-04-25T22:45:28.411110+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'61","last_scrub_stamp":"2024-04-25T22:45:28.410912+0000","last_deep_scrub":"71'61","last_deep_scrub_stamp":"2024-04-25T22:45:28.410912+0000","last_clean_scrub_stamp":"2024-04-25T22:45:28.410912+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:11.522079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"72'404","reported_seq":634,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:17.985216+0000","last_change":"2024-04-25T22:45:17.985339+0000","last_active":"2024-04-25T22:45:17.985216+0000","last_peered":"2024-04-25T22:45:17.985216+0000","last_clean":"2024-04-25T22:45:17.985216+0000","last_became_active":"2024-04-25T22:44:39.116562+0000","last_became_peered":"2024-04-25T22:44:39.116562+0000","last_unstale":"2024-04-25T22:45:17.985216+0000","last_undegraded":"2024-04-25T22:45:17.985216+0000","last_fullsized":"2024-04-25T22:45:17.985216+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'404","last_scrub_stamp":"2024-04-25T22:45:17.984989+0000","last_deep_scrub":"72'404","last_deep_scrub_stamp":"2024-04-25T22:45:17.984989+0000","last_clean_scrub_stamp":"2024-04-25T22:45:17.984989+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:47.522405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18745,"num_write":376,"num_write_kb":96145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"113'75","reported_seq":295,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:10.869816+0000","last_change":"2024-04-25T22:45:10.869885+0000","last_active":"2024-04-25T22:45:10.869816+0000","last_peered":"2024-04-25T22:45:10.869816+0000","last_clean":"2024-04-25T22:45:10.869816+0000","last_became_active":"2024-04-25T22:44:26.362499+0000","last_became_peered":"2024-04-25T22:44:26.362499+0000","last_unstale":"2024-04-25T22:45:10.869816+0000","last_undegraded":"2024-04-25T22:45:10.869816+0000","last_fullsized":"2024-04-25T22:45:10.869816+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'75","last_scrub_stamp":"2024-04-25T22:45:10.869595+0000","last_deep_scrub":"113'75","last_deep_scrub_stamp":"2024-04-25T22:45:10.869595+0000","last_clean_scrub_stamp":"2024-04-25T22:45:10.869595+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:39:00.404286+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"113'147","reported_seq":373,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:08.894101+0000","last_change":"2024-04-25T22:45:08.894163+0000","last_active":"2024-04-25T22:45:08.894101+0000","last_peered":"2024-04-25T22:45:08.894101+0000","last_clean":"2024-04-25T22:45:08.894101+0000","last_became_active":"2024-04-25T22:44:29.399853+0000","last_became_peered":"2024-04-25T22:44:29.399853+0000","last_unstale":"2024-04-25T22:45:08.894101+0000","last_undegraded":"2024-04-25T22:45:08.894101+0000","last_fullsized":"2024-04-25T22:45:08.894101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'147","last_scrub_stamp":"2024-04-25T22:45:08.893921+0000","last_deep_scrub":"113'147","last_deep_scrub_stamp":"2024-04-25T22:45:08.893921+0000","last_clean_scrub_stamp":"2024-04-25T22:45:08.893921+0000","objects_scrubbed":2,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:56.976041+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"72'399","reported_seq":614,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:13.230823+0000","last_change":"2024-04-25T22:45:13.230879+0000","last_active":"2024-04-25T22:45:13.230823+0000","last_peered":"2024-04-25T22:45:13.230823+0000","last_clean":"2024-04-25T22:45:13.230823+0000","last_became_active":"2024-04-25T22:44:46.392604+0000","last_became_peered":"2024-04-25T22:44:46.392604+0000","last_unstale":"2024-04-25T22:45:13.230823+0000","last_undegraded":"2024-04-25T22:45:13.230823+0000","last_fullsized":"2024-04-25T22:45:13.230823+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'399","last_scrub_stamp":"2024-04-25T22:45:13.230628+0000","last_deep_scrub":"72'399","last_deep_scrub_stamp":"2024-04-25T22:45:13.230628+0000","last_clean_scrub_stamp":"2024-04-25T22:45:13.230628+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:59:41.103570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25159,"num_write":363,"num_write_kb":34063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"113'228","reported_seq":443,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:31.484579+0000","last_change":"2024-04-25T22:45:31.484644+0000","last_active":"2024-04-25T22:45:31.484579+0000","last_peered":"2024-04-25T22:45:31.484579+0000","last_clean":"2024-04-25T22:45:31.484579+0000","last_became_active":"2024-04-25T22:44:41.416542+0000","last_became_peered":"2024-04-25T22:44:41.416542+0000","last_unstale":"2024-04-25T22:45:31.484579+0000","last_undegraded":"2024-04-25T22:45:31.484579+0000","last_fullsized":"2024-04-25T22:45:31.484579+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'228","last_scrub_stamp":"2024-04-25T22:45:31.484386+0000","last_deep_scrub":"113'228","last_deep_scrub_stamp":"2024-04-25T22:45:31.484386+0000","last_clean_scrub_stamp":"2024-04-25T22:45:31.484386+0000","objects_scrubbed":2,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:14:21.634483+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"72'431","reported_seq":587,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:37.492484+0000","last_change":"2024-04-25T22:45:37.492546+0000","last_active":"2024-04-25T22:45:37.492484+0000","last_peered":"2024-04-25T22:45:37.492484+0000","last_clean":"2024-04-25T22:45:37.492484+0000","last_became_active":"2024-04-25T22:44:56.412151+0000","last_became_peered":"2024-04-25T22:44:56.412151+0000","last_unstale":"2024-04-25T22:45:37.492484+0000","last_undegraded":"2024-04-25T22:45:37.492484+0000","last_fullsized":"2024-04-25T22:45:37.492484+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'431","last_scrub_stamp":"2024-04-25T22:45:37.492281+0000","last_deep_scrub":"72'431","last_deep_scrub_stamp":"2024-04-25T22:45:37.492281+0000","last_clean_scrub_stamp":"2024-04-25T22:45:37.492281+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:23:59.501837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14688,"num_write":405,"num_write_kb":38957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"113'384","reported_seq":610,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:07.894276+0000","last_change":"2024-04-25T22:45:07.894340+0000","last_active":"2024-04-25T22:45:07.894276+0000","last_peered":"2024-04-25T22:45:07.894276+0000","last_clean":"2024-04-25T22:45:07.894276+0000","last_became_active":"2024-04-25T22:44:30.401021+0000","last_became_peered":"2024-04-25T22:44:30.401021+0000","last_unstale":"2024-04-25T22:45:07.894276+0000","last_undegraded":"2024-04-25T22:45:07.894276+0000","last_fullsized":"2024-04-25T22:45:07.894276+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'384","last_scrub_stamp":"2024-04-25T22:45:07.894090+0000","last_deep_scrub":"113'384","last_deep_scrub_stamp":"2024-04-25T22:45:07.894090+0000","last_clean_scrub_stamp":"2024-04-25T22:45:07.894090+0000","objects_scrubbed":2,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:37:27.144873+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'453","reported_seq":694,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:14.778720+0000","last_change":"2024-04-25T22:45:14.778798+0000","last_active":"2024-04-25T22:45:14.778720+0000","last_peered":"2024-04-25T22:45:14.778720+0000","last_clean":"2024-04-25T22:45:14.778720+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:45:14.778720+0000","last_undegraded":"2024-04-25T22:45:14.778720+0000","last_fullsized":"2024-04-25T22:45:14.778720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'453","last_scrub_stamp":"2024-04-25T22:45:14.778468+0000","last_deep_scrub":"72'453","last_deep_scrub_stamp":"2024-04-25T22:45:14.778468+0000","last_clean_scrub_stamp":"2024-04-25T22:45:14.778468+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:11:13.757693+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18900,"num_write":418,"num_write_kb":117500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"71'64","reported_seq":276,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:34.688776+0000","last_change":"2024-04-25T22:45:34.688837+0000","last_active":"2024-04-25T22:45:34.688776+0000","last_peered":"2024-04-25T22:45:34.688776+0000","last_clean":"2024-04-25T22:45:34.688776+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:45:34.688776+0000","last_undegraded":"2024-04-25T22:45:34.688776+0000","last_fullsized":"2024-04-25T22:45:34.688776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'64","last_scrub_stamp":"2024-04-25T22:45:34.688575+0000","last_deep_scrub":"71'64","last_deep_scrub_stamp":"2024-04-25T22:45:34.688575+0000","last_clean_scrub_stamp":"2024-04-25T22:45:34.688575+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:30.351068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'428","reported_seq":640,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:15.954382+0000","last_change":"2024-04-25T22:45:15.954444+0000","last_active":"2024-04-25T22:45:15.954382+0000","last_peered":"2024-04-25T22:45:15.954382+0000","last_clean":"2024-04-25T22:45:15.954382+0000","last_became_active":"2024-04-25T22:44:39.121205+0000","last_became_peered":"2024-04-25T22:44:39.121205+0000","last_unstale":"2024-04-25T22:45:15.954382+0000","last_undegraded":"2024-04-25T22:45:15.954382+0000","last_fullsized":"2024-04-25T22:45:15.954382+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'428","last_scrub_stamp":"2024-04-25T22:45:15.954178+0000","last_deep_scrub":"72'428","last_deep_scrub_stamp":"2024-04-25T22:45:15.954178+0000","last_clean_scrub_stamp":"2024-04-25T22:45:15.954178+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:43:04.938222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7477,"num_write":383,"num_write_kb":9617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"113'169","reported_seq":334,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:09.956160+0000","last_change":"2024-04-25T22:45:09.956324+0000","last_active":"2024-04-25T22:45:09.956160+0000","last_peered":"2024-04-25T22:45:09.956160+0000","last_clean":"2024-04-25T22:45:09.956160+0000","last_became_active":"2024-04-25T22:44:39.131489+0000","last_became_peered":"2024-04-25T22:44:39.131489+0000","last_unstale":"2024-04-25T22:45:09.956160+0000","last_undegraded":"2024-04-25T22:45:09.956160+0000","last_fullsized":"2024-04-25T22:45:09.956160+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'169","last_scrub_stamp":"2024-04-25T22:45:09.955944+0000","last_deep_scrub":"113'169","last_deep_scrub_stamp":"2024-04-25T22:45:09.955944+0000","last_clean_scrub_stamp":"2024-04-25T22:45:09.955944+0000","objects_scrubbed":3,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.893227+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"72'446","reported_seq":705,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:24.769694+0000","last_change":"2024-04-25T22:45:24.769754+0000","last_active":"2024-04-25T22:45:24.769694+0000","last_peered":"2024-04-25T22:45:24.769694+0000","last_clean":"2024-04-25T22:45:24.769694+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:45:24.769694+0000","last_undegraded":"2024-04-25T22:45:24.769694+0000","last_fullsized":"2024-04-25T22:45:24.769694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'446","last_scrub_stamp":"2024-04-25T22:45:24.769498+0000","last_deep_scrub":"72'446","last_deep_scrub_stamp":"2024-04-25T22:45:24.769498+0000","last_clean_scrub_stamp":"2024-04-25T22:45:24.769498+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:58.868653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27788,"num_write":414,"num_write_kb":47058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"113'114","reported_seq":326,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:31.708141+0000","last_change":"2024-04-25T22:45:31.708209+0000","last_active":"2024-04-25T22:45:31.708141+0000","last_peered":"2024-04-25T22:45:31.708141+0000","last_clean":"2024-04-25T22:45:31.708141+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:45:31.708141+0000","last_undegraded":"2024-04-25T22:45:31.708141+0000","last_fullsized":"2024-04-25T22:45:31.708141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'114","last_scrub_stamp":"2024-04-25T22:45:31.707926+0000","last_deep_scrub":"113'114","last_deep_scrub_stamp":"2024-04-25T22:45:31.707926+0000","last_clean_scrub_stamp":"2024-04-25T22:45:31.707926+0000","objects_scrubbed":1,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:31.347417+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"72'417","reported_seq":1020,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108839+0000","last_change":"2024-04-25T22:44:44.113498+0000","last_active":"2024-04-25T22:44:59.108839+0000","last_peered":"2024-04-25T22:44:59.108839+0000","last_clean":"2024-04-25T22:44:59.108839+0000","last_became_active":"2024-04-25T22:44:44.108084+0000","last_became_peered":"2024-04-25T22:44:44.108084+0000","last_unstale":"2024-04-25T22:44:59.108839+0000","last_undegraded":"2024-04-25T22:44:59.108839+0000","last_fullsized":"2024-04-25T22:44:59.108839+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16487,"num_write":388,"num_write_kb":75452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'59","reported_seq":98,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:30.473680+0000","last_change":"2024-04-25T22:45:30.473742+0000","last_active":"2024-04-25T22:45:30.473680+0000","last_peered":"2024-04-25T22:45:30.473680+0000","last_clean":"2024-04-25T22:45:30.473680+0000","last_became_active":"2024-04-25T22:44:41.415769+0000","last_became_peered":"2024-04-25T22:44:41.415769+0000","last_unstale":"2024-04-25T22:45:30.473680+0000","last_undegraded":"2024-04-25T22:45:30.473680+0000","last_fullsized":"2024-04-25T22:45:30.473680+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'59","last_scrub_stamp":"2024-04-25T22:45:30.473473+0000","last_deep_scrub":"71'59","last_deep_scrub_stamp":"2024-04-25T22:45:30.473473+0000","last_clean_scrub_stamp":"2024-04-25T22:45:30.473473+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:02:41.136885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'358","reported_seq":909,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:38.632778+0000","last_change":"2024-04-25T22:45:38.632839+0000","last_active":"2024-04-25T22:45:38.632778+0000","last_peered":"2024-04-25T22:45:38.632778+0000","last_clean":"2024-04-25T22:45:38.632778+0000","last_became_active":"2024-04-25T22:44:34.099595+0000","last_became_peered":"2024-04-25T22:44:34.099595+0000","last_unstale":"2024-04-25T22:45:38.632778+0000","last_undegraded":"2024-04-25T22:45:38.632778+0000","last_fullsized":"2024-04-25T22:45:38.632778+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'358","last_scrub_stamp":"2024-04-25T22:45:38.632578+0000","last_deep_scrub":"72'358","last_deep_scrub_stamp":"2024-04-25T22:45:38.632578+0000","last_clean_scrub_stamp":"2024-04-25T22:45:38.632578+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:48:22.859265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12259,"num_write":325,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"113'466","reported_seq":644,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:24.365511+0000","last_change":"2024-04-25T22:45:24.365573+0000","last_active":"2024-04-25T22:45:24.365511+0000","last_peered":"2024-04-25T22:45:24.365511+0000","last_clean":"2024-04-25T22:45:24.365511+0000","last_became_active":"2024-04-25T22:44:41.423799+0000","last_became_peered":"2024-04-25T22:44:41.423799+0000","last_unstale":"2024-04-25T22:45:24.365511+0000","last_undegraded":"2024-04-25T22:45:24.365511+0000","last_fullsized":"2024-04-25T22:45:24.365511+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'466","last_scrub_stamp":"2024-04-25T22:45:24.365286+0000","last_deep_scrub":"113'466","last_deep_scrub_stamp":"2024-04-25T22:45:24.365286+0000","last_clean_scrub_stamp":"2024-04-25T22:45:24.365286+0000","objects_scrubbed":1,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:44:37.132110+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"72'386","reported_seq":964,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:38.141751+0000","last_change":"2024-04-25T22:45:38.141815+0000","last_active":"2024-04-25T22:45:38.141751+0000","last_peered":"2024-04-25T22:45:38.141751+0000","last_clean":"2024-04-25T22:45:38.141751+0000","last_became_active":"2024-04-25T22:44:46.110394+0000","last_became_peered":"2024-04-25T22:44:46.110394+0000","last_unstale":"2024-04-25T22:45:38.141751+0000","last_undegraded":"2024-04-25T22:45:38.141751+0000","last_fullsized":"2024-04-25T22:45:38.141751+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'386","last_scrub_stamp":"2024-04-25T22:45:38.141551+0000","last_deep_scrub":"72'386","last_deep_scrub_stamp":"2024-04-25T22:45:38.141551+0000","last_clean_scrub_stamp":"2024-04-25T22:45:38.141551+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:01:32.625577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9402,"num_write":352,"num_write_kb":50548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"113'159","reported_seq":429,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:37.679463+0000","last_change":"2024-04-25T22:45:37.679542+0000","last_active":"2024-04-25T22:45:37.679463+0000","last_peered":"2024-04-25T22:45:37.679463+0000","last_clean":"2024-04-25T22:45:37.679463+0000","last_became_active":"2024-04-25T22:44:26.354730+0000","last_became_peered":"2024-04-25T22:44:26.354730+0000","last_unstale":"2024-04-25T22:45:37.679463+0000","last_undegraded":"2024-04-25T22:45:37.679463+0000","last_fullsized":"2024-04-25T22:45:37.679463+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'159","last_scrub_stamp":"2024-04-25T22:45:37.679273+0000","last_deep_scrub":"113'159","last_deep_scrub_stamp":"2024-04-25T22:45:37.679273+0000","last_clean_scrub_stamp":"2024-04-25T22:45:37.679273+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:20.519502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":218,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:29.702819+0000","last_change":"2024-04-25T22:45:29.702870+0000","last_active":"2024-04-25T22:45:29.702819+0000","last_peered":"2024-04-25T22:45:29.702819+0000","last_clean":"2024-04-25T22:45:29.702819+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:45:29.702819+0000","last_undegraded":"2024-04-25T22:45:29.702819+0000","last_fullsized":"2024-04-25T22:45:29.702819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:45:29.702624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:45:29.702624+0000","last_clean_scrub_stamp":"2024-04-25T22:45:29.702624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:16:51.022963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"113'459","reported_seq":687,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:31.148021+0000","last_change":"2024-04-25T22:45:31.148157+0000","last_active":"2024-04-25T22:45:31.148021+0000","last_peered":"2024-04-25T22:45:31.148021+0000","last_clean":"2024-04-25T22:45:31.148021+0000","last_became_active":"2024-04-25T22:44:29.397962+0000","last_became_peered":"2024-04-25T22:44:29.397962+0000","last_unstale":"2024-04-25T22:45:31.148021+0000","last_undegraded":"2024-04-25T22:45:31.148021+0000","last_fullsized":"2024-04-25T22:45:31.148021+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'459","last_scrub_stamp":"2024-04-25T22:45:31.147804+0000","last_deep_scrub":"113'459","last_deep_scrub_stamp":"2024-04-25T22:45:31.147804+0000","last_clean_scrub_stamp":"2024-04-25T22:45:31.147804+0000","objects_scrubbed":2,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:16:52.468142+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"72'447","reported_seq":1112,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:44:59.108927+0000","last_change":"2024-04-25T22:44:43.108262+0000","last_active":"2024-04-25T22:44:59.108927+0000","last_peered":"2024-04-25T22:44:59.108927+0000","last_clean":"2024-04-25T22:44:59.108927+0000","last_became_active":"2024-04-25T22:44:43.105231+0000","last_became_peered":"2024-04-25T22:44:43.105231+0000","last_unstale":"2024-04-25T22:44:59.108927+0000","last_undegraded":"2024-04-25T22:44:59.108927+0000","last_fullsized":"2024-04-25T22:44:59.108927+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:40:13.541378+0000","last_clean_scrub_stamp":"2024-04-25T22:40:13.541378+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45074,"num_write":414,"num_write_kb":120596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":225,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:27.722696+0000","last_change":"2024-04-25T22:45:27.722813+0000","last_active":"2024-04-25T22:45:27.722696+0000","last_peered":"2024-04-25T22:45:27.722696+0000","last_clean":"2024-04-25T22:45:27.722696+0000","last_became_active":"2024-04-25T22:44:26.354482+0000","last_became_peered":"2024-04-25T22:44:26.354482+0000","last_unstale":"2024-04-25T22:45:27.722696+0000","last_undegraded":"2024-04-25T22:45:27.722696+0000","last_fullsized":"2024-04-25T22:45:27.722696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:45:27.722446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:45:27.722446+0000","last_clean_scrub_stamp":"2024-04-25T22:45:27.722446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:05:41.441994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"113'123","reported_seq":350,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:14.969914+0000","last_change":"2024-04-25T22:45:14.969982+0000","last_active":"2024-04-25T22:45:14.969914+0000","last_peered":"2024-04-25T22:45:14.969914+0000","last_clean":"2024-04-25T22:45:14.969914+0000","last_became_active":"2024-04-25T22:44:39.139689+0000","last_became_peered":"2024-04-25T22:44:39.139689+0000","last_unstale":"2024-04-25T22:45:14.969914+0000","last_undegraded":"2024-04-25T22:45:14.969914+0000","last_fullsized":"2024-04-25T22:45:14.969914+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'123","last_scrub_stamp":"2024-04-25T22:45:14.969730+0000","last_deep_scrub":"113'123","last_deep_scrub_stamp":"2024-04-25T22:45:14.969730+0000","last_clean_scrub_stamp":"2024-04-25T22:45:14.969730+0000","objects_scrubbed":1,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:03:32.133354+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":62,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"72'449","reported_seq":661,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:11.145433+0000","last_change":"2024-04-25T22:45:11.145558+0000","last_active":"2024-04-25T22:45:11.145433+0000","last_peered":"2024-04-25T22:45:11.145433+0000","last_clean":"2024-04-25T22:45:11.145433+0000","last_became_active":"2024-04-25T22:44:41.432785+0000","last_became_peered":"2024-04-25T22:44:41.432785+0000","last_unstale":"2024-04-25T22:45:11.145433+0000","last_undegraded":"2024-04-25T22:45:11.145433+0000","last_fullsized":"2024-04-25T22:45:11.145433+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'449","last_scrub_stamp":"2024-04-25T22:45:11.145126+0000","last_deep_scrub":"72'449","last_deep_scrub_stamp":"2024-04-25T22:45:11.145126+0000","last_clean_scrub_stamp":"2024-04-25T22:45:11.145126+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:18.105492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25191,"num_write":420,"num_write_kb":79855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":226,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:26.074435+0000","last_change":"2024-04-25T22:45:26.074490+0000","last_active":"2024-04-25T22:45:26.074435+0000","last_peered":"2024-04-25T22:45:26.074435+0000","last_clean":"2024-04-25T22:45:26.074435+0000","last_became_active":"2024-04-25T22:44:26.362808+0000","last_became_peered":"2024-04-25T22:44:26.362808+0000","last_unstale":"2024-04-25T22:45:26.074435+0000","last_undegraded":"2024-04-25T22:45:26.074435+0000","last_fullsized":"2024-04-25T22:45:26.074435+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:45:26.074197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:45:26.074197+0000","last_clean_scrub_stamp":"2024-04-25T22:45:26.074197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:14.430400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"113'437","reported_seq":641,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:29.458395+0000","last_change":"2024-04-25T22:45:29.458471+0000","last_active":"2024-04-25T22:45:29.458395+0000","last_peered":"2024-04-25T22:45:29.458395+0000","last_clean":"2024-04-25T22:45:29.458395+0000","last_became_active":"2024-04-25T22:44:41.415592+0000","last_became_peered":"2024-04-25T22:44:41.415592+0000","last_unstale":"2024-04-25T22:45:29.458395+0000","last_undegraded":"2024-04-25T22:45:29.458395+0000","last_fullsized":"2024-04-25T22:45:29.458395+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'437","last_scrub_stamp":"2024-04-25T22:45:29.458160+0000","last_deep_scrub":"113'437","last_deep_scrub_stamp":"2024-04-25T22:45:29.458160+0000","last_clean_scrub_stamp":"2024-04-25T22:45:29.458160+0000","objects_scrubbed":2,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:47:59.960078+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"72'337","reported_seq":897,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:37.175785+0000","last_change":"2024-04-25T22:45:37.175914+0000","last_active":"2024-04-25T22:45:37.175785+0000","last_peered":"2024-04-25T22:45:37.175785+0000","last_clean":"2024-04-25T22:45:37.175785+0000","last_became_active":"2024-04-25T22:44:45.111011+0000","last_became_peered":"2024-04-25T22:44:45.111011+0000","last_unstale":"2024-04-25T22:45:37.175785+0000","last_undegraded":"2024-04-25T22:45:37.175785+0000","last_fullsized":"2024-04-25T22:45:37.175785+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'337","last_scrub_stamp":"2024-04-25T22:45:37.175471+0000","last_deep_scrub":"72'337","last_deep_scrub_stamp":"2024-04-25T22:45:37.175471+0000","last_clean_scrub_stamp":"2024-04-25T22:45:37.175471+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:26.726443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25242,"num_write":307,"num_write_kb":26250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":218,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:30.685737+0000","last_change":"2024-04-25T22:45:30.685787+0000","last_active":"2024-04-25T22:45:30.685737+0000","last_peered":"2024-04-25T22:45:30.685737+0000","last_clean":"2024-04-25T22:45:30.685737+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:45:30.685737+0000","last_undegraded":"2024-04-25T22:45:30.685737+0000","last_fullsized":"2024-04-25T22:45:30.685737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:45:30.685539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:45:30.685539+0000","last_clean_scrub_stamp":"2024-04-25T22:45:30.685539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:23.948306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"71'61","reported_seq":273,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:35.646237+0000","last_change":"2024-04-25T22:45:35.646302+0000","last_active":"2024-04-25T22:45:35.646237+0000","last_peered":"2024-04-25T22:45:35.646237+0000","last_clean":"2024-04-25T22:45:35.646237+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:45:35.646237+0000","last_undegraded":"2024-04-25T22:45:35.646237+0000","last_fullsized":"2024-04-25T22:45:35.646237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'61","last_scrub_stamp":"2024-04-25T22:45:35.646032+0000","last_deep_scrub":"71'61","last_deep_scrub_stamp":"2024-04-25T22:45:35.646032+0000","last_clean_scrub_stamp":"2024-04-25T22:45:35.646032+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:59.650052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'404","reported_seq":1025,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:24.062050+0000","last_change":"2024-04-25T22:45:24.062112+0000","last_active":"2024-04-25T22:45:24.062050+0000","last_peered":"2024-04-25T22:45:24.062050+0000","last_clean":"2024-04-25T22:45:24.062050+0000","last_became_active":"2024-04-25T22:44:32.087528+0000","last_became_peered":"2024-04-25T22:44:32.087528+0000","last_unstale":"2024-04-25T22:45:24.062050+0000","last_undegraded":"2024-04-25T22:45:24.062050+0000","last_fullsized":"2024-04-25T22:45:24.062050+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'404","last_scrub_stamp":"2024-04-25T22:45:24.061853+0000","last_deep_scrub":"72'404","last_deep_scrub_stamp":"2024-04-25T22:45:24.061853+0000","last_clean_scrub_stamp":"2024-04-25T22:45:24.061853+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:44:54.575774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":20287,"num_write":371,"num_write_kb":59919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"113'286","reported_seq":498,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:28.726886+0000","last_change":"2024-04-25T22:45:28.726957+0000","last_active":"2024-04-25T22:45:28.726886+0000","last_peered":"2024-04-25T22:45:28.726886+0000","last_clean":"2024-04-25T22:45:28.726886+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:45:28.726886+0000","last_undegraded":"2024-04-25T22:45:28.726886+0000","last_fullsized":"2024-04-25T22:45:28.726886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'286","last_scrub_stamp":"2024-04-25T22:45:28.726678+0000","last_deep_scrub":"113'286","last_deep_scrub_stamp":"2024-04-25T22:45:28.726678+0000","last_clean_scrub_stamp":"2024-04-25T22:45:28.726678+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:29:13.032026+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":226,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:28.152388+0000","last_change":"2024-04-25T22:45:28.152491+0000","last_active":"2024-04-25T22:45:28.152388+0000","last_peered":"2024-04-25T22:45:28.152388+0000","last_clean":"2024-04-25T22:45:28.152388+0000","last_became_active":"2024-04-25T22:44:26.363583+0000","last_became_peered":"2024-04-25T22:44:26.363583+0000","last_unstale":"2024-04-25T22:45:28.152388+0000","last_undegraded":"2024-04-25T22:45:28.152388+0000","last_fullsized":"2024-04-25T22:45:28.152388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:45:28.152161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:45:28.152161+0000","last_clean_scrub_stamp":"2024-04-25T22:45:28.152161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:39:42.892504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"72'366","reported_seq":531,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:25.316368+0000","last_change":"2024-04-25T22:45:25.316427+0000","last_active":"2024-04-25T22:45:25.316368+0000","last_peered":"2024-04-25T22:45:25.316368+0000","last_clean":"2024-04-25T22:45:25.316368+0000","last_became_active":"2024-04-25T22:44:52.375504+0000","last_became_peered":"2024-04-25T22:44:52.375504+0000","last_unstale":"2024-04-25T22:45:25.316368+0000","last_undegraded":"2024-04-25T22:45:25.316368+0000","last_fullsized":"2024-04-25T22:45:25.316368+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'366","last_scrub_stamp":"2024-04-25T22:45:25.316164+0000","last_deep_scrub":"72'366","last_deep_scrub_stamp":"2024-04-25T22:45:25.316164+0000","last_clean_scrub_stamp":"2024-04-25T22:45:25.316164+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:41:34.723996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":346,"num_write":330,"num_write_kb":33934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":274,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:27.102658+0000","last_change":"2024-04-25T22:45:27.102718+0000","last_active":"2024-04-25T22:45:27.102658+0000","last_peered":"2024-04-25T22:45:27.102658+0000","last_clean":"2024-04-25T22:45:27.102658+0000","last_became_active":"2024-04-25T22:44:26.363455+0000","last_became_peered":"2024-04-25T22:44:26.363455+0000","last_unstale":"2024-04-25T22:45:27.102658+0000","last_undegraded":"2024-04-25T22:45:27.102658+0000","last_fullsized":"2024-04-25T22:45:27.102658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'54","last_scrub_stamp":"2024-04-25T22:45:27.102434+0000","last_deep_scrub":"71'54","last_deep_scrub_stamp":"2024-04-25T22:45:27.102434+0000","last_clean_scrub_stamp":"2024-04-25T22:45:27.102434+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:19:28.488893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:34.489591+0000","last_change":"2024-04-25T22:45:34.489705+0000","last_active":"2024-04-25T22:45:34.489591+0000","last_peered":"2024-04-25T22:45:34.489591+0000","last_clean":"2024-04-25T22:45:34.489591+0000","last_became_active":"2024-04-25T22:44:41.421194+0000","last_became_peered":"2024-04-25T22:44:41.421194+0000","last_unstale":"2024-04-25T22:45:34.489591+0000","last_undegraded":"2024-04-25T22:45:34.489591+0000","last_fullsized":"2024-04-25T22:45:34.489591+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:45:34.489371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:45:34.489371+0000","last_clean_scrub_stamp":"2024-04-25T22:45:34.489371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:28:48.322398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'413","reported_seq":636,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:17.151630+0000","last_change":"2024-04-25T22:45:17.151689+0000","last_active":"2024-04-25T22:45:17.151630+0000","last_peered":"2024-04-25T22:45:17.151630+0000","last_clean":"2024-04-25T22:45:17.151630+0000","last_became_active":"2024-04-25T22:44:48.372485+0000","last_became_peered":"2024-04-25T22:44:48.372485+0000","last_unstale":"2024-04-25T22:45:17.151630+0000","last_undegraded":"2024-04-25T22:45:17.151630+0000","last_fullsized":"2024-04-25T22:45:17.151630+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'413","last_scrub_stamp":"2024-04-25T22:45:17.151430+0000","last_deep_scrub":"72'413","last_deep_scrub_stamp":"2024-04-25T22:45:17.151430+0000","last_clean_scrub_stamp":"2024-04-25T22:45:17.151430+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:13.003612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22994,"num_write":377,"num_write_kb":63140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"113'58","reported_seq":279,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:29.143625+0000","last_change":"2024-04-25T22:45:29.143685+0000","last_active":"2024-04-25T22:45:29.143625+0000","last_peered":"2024-04-25T22:45:29.143625+0000","last_clean":"2024-04-25T22:45:29.143625+0000","last_became_active":"2024-04-25T22:44:26.365267+0000","last_became_peered":"2024-04-25T22:44:26.365267+0000","last_unstale":"2024-04-25T22:45:29.143625+0000","last_undegraded":"2024-04-25T22:45:29.143625+0000","last_fullsized":"2024-04-25T22:45:29.143625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'58","last_scrub_stamp":"2024-04-25T22:45:29.143459+0000","last_deep_scrub":"113'58","last_deep_scrub_stamp":"2024-04-25T22:45:29.143459+0000","last_clean_scrub_stamp":"2024-04-25T22:45:29.143459+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:05:42.863006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":226,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:25.095167+0000","last_change":"2024-04-25T22:45:25.095218+0000","last_active":"2024-04-25T22:45:25.095167+0000","last_peered":"2024-04-25T22:45:25.095167+0000","last_clean":"2024-04-25T22:45:25.095167+0000","last_became_active":"2024-04-25T22:44:26.360968+0000","last_became_peered":"2024-04-25T22:44:26.360968+0000","last_unstale":"2024-04-25T22:45:25.095167+0000","last_undegraded":"2024-04-25T22:45:25.095167+0000","last_fullsized":"2024-04-25T22:45:25.095167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:45:25.094979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:45:25.094979+0000","last_clean_scrub_stamp":"2024-04-25T22:45:25.094979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:42:13.492002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'398","reported_seq":608,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:11.946634+0000","last_change":"2024-04-25T22:45:11.946697+0000","last_active":"2024-04-25T22:45:11.946634+0000","last_peered":"2024-04-25T22:45:11.946634+0000","last_clean":"2024-04-25T22:45:11.946634+0000","last_became_active":"2024-04-25T22:44:39.124378+0000","last_became_peered":"2024-04-25T22:44:39.124378+0000","last_unstale":"2024-04-25T22:45:11.946634+0000","last_undegraded":"2024-04-25T22:45:11.946634+0000","last_fullsized":"2024-04-25T22:45:11.946634+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'398","last_scrub_stamp":"2024-04-25T22:45:11.946438+0000","last_deep_scrub":"72'398","last_deep_scrub_stamp":"2024-04-25T22:45:11.946438+0000","last_clean_scrub_stamp":"2024-04-25T22:45:11.946438+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:53:57.648591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6306,"num_write":372,"num_write_kb":34077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"113'101","reported_seq":316,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:21.055062+0000","last_change":"2024-04-25T22:45:21.055134+0000","last_active":"2024-04-25T22:45:21.055062+0000","last_peered":"2024-04-25T22:45:21.055062+0000","last_clean":"2024-04-25T22:45:21.055062+0000","last_became_active":"2024-04-25T22:44:39.147377+0000","last_became_peered":"2024-04-25T22:44:39.147377+0000","last_unstale":"2024-04-25T22:45:21.055062+0000","last_undegraded":"2024-04-25T22:45:21.055062+0000","last_fullsized":"2024-04-25T22:45:21.055062+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'101","last_scrub_stamp":"2024-04-25T22:45:21.054875+0000","last_deep_scrub":"113'101","last_deep_scrub_stamp":"2024-04-25T22:45:21.054875+0000","last_clean_scrub_stamp":"2024-04-25T22:45:21.054875+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:19:13.176608+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":225,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:12.826059+0000","last_change":"2024-04-25T22:45:12.826113+0000","last_active":"2024-04-25T22:45:12.826059+0000","last_peered":"2024-04-25T22:45:12.826059+0000","last_clean":"2024-04-25T22:45:12.826059+0000","last_became_active":"2024-04-25T22:44:26.360106+0000","last_became_peered":"2024-04-25T22:44:26.360106+0000","last_unstale":"2024-04-25T22:45:12.826059+0000","last_undegraded":"2024-04-25T22:45:12.826059+0000","last_fullsized":"2024-04-25T22:45:12.826059+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:45:12.825863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:45:12.825863+0000","last_clean_scrub_stamp":"2024-04-25T22:45:12.825863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:56.790968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'390","reported_seq":630,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:18.170108+0000","last_change":"2024-04-25T22:45:18.170169+0000","last_active":"2024-04-25T22:45:18.170108+0000","last_peered":"2024-04-25T22:45:18.170108+0000","last_clean":"2024-04-25T22:45:18.170108+0000","last_became_active":"2024-04-25T22:44:41.414924+0000","last_became_peered":"2024-04-25T22:44:41.414924+0000","last_unstale":"2024-04-25T22:45:18.170108+0000","last_undegraded":"2024-04-25T22:45:18.170108+0000","last_fullsized":"2024-04-25T22:45:18.170108+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'390","last_scrub_stamp":"2024-04-25T22:45:18.169909+0000","last_deep_scrub":"72'390","last_deep_scrub_stamp":"2024-04-25T22:45:18.169909+0000","last_clean_scrub_stamp":"2024-04-25T22:45:18.169909+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:40.114419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":22915,"num_write":352,"num_write_kb":47201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"72'411","reported_seq":1017,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:11.857384+0000","last_change":"2024-04-25T22:45:11.857443+0000","last_active":"2024-04-25T22:45:11.857384+0000","last_peered":"2024-04-25T22:45:11.857384+0000","last_clean":"2024-04-25T22:45:11.857384+0000","last_became_active":"2024-04-25T22:44:32.087303+0000","last_became_peered":"2024-04-25T22:44:32.087303+0000","last_unstale":"2024-04-25T22:45:11.857384+0000","last_undegraded":"2024-04-25T22:45:11.857384+0000","last_fullsized":"2024-04-25T22:45:11.857384+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'411","last_scrub_stamp":"2024-04-25T22:45:11.857179+0000","last_deep_scrub":"72'411","last_deep_scrub_stamp":"2024-04-25T22:45:11.857179+0000","last_clean_scrub_stamp":"2024-04-25T22:45:11.857179+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:15.380436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25412,"num_write":367,"num_write_kb":64656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"113'273","reported_seq":503,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:09.928187+0000","last_change":"2024-04-25T22:45:09.928318+0000","last_active":"2024-04-25T22:45:09.928187+0000","last_peered":"2024-04-25T22:45:09.928187+0000","last_clean":"2024-04-25T22:45:09.928187+0000","last_became_active":"2024-04-25T22:44:29.398317+0000","last_became_peered":"2024-04-25T22:44:29.398317+0000","last_unstale":"2024-04-25T22:45:09.928187+0000","last_undegraded":"2024-04-25T22:45:09.928187+0000","last_fullsized":"2024-04-25T22:45:09.928187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'273","last_scrub_stamp":"2024-04-25T22:45:09.927957+0000","last_deep_scrub":"113'273","last_deep_scrub_stamp":"2024-04-25T22:45:09.927957+0000","last_clean_scrub_stamp":"2024-04-25T22:45:09.927957+0000","objects_scrubbed":5,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:47:07.690999+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382817,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"72'423","reported_seq":1056,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:35.129639+0000","last_change":"2024-04-25T22:45:35.129702+0000","last_active":"2024-04-25T22:45:35.129639+0000","last_peered":"2024-04-25T22:45:35.129639+0000","last_clean":"2024-04-25T22:45:35.129639+0000","last_became_active":"2024-04-25T22:44:42.088432+0000","last_became_peered":"2024-04-25T22:44:42.088432+0000","last_unstale":"2024-04-25T22:45:35.129639+0000","last_undegraded":"2024-04-25T22:45:35.129639+0000","last_fullsized":"2024-04-25T22:45:35.129639+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'423","last_scrub_stamp":"2024-04-25T22:45:35.129446+0000","last_deep_scrub":"72'423","last_deep_scrub_stamp":"2024-04-25T22:45:35.129446+0000","last_clean_scrub_stamp":"2024-04-25T22:45:35.129446+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:21.042906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24794,"num_write":386,"num_write_kb":63756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"113'104","reported_seq":107,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:26.360387+0000","last_change":"2024-04-25T22:45:26.360454+0000","last_active":"2024-04-25T22:45:26.360387+0000","last_peered":"2024-04-25T22:45:26.360387+0000","last_clean":"2024-04-25T22:45:26.360387+0000","last_became_active":"2024-04-25T22:44:41.422237+0000","last_became_peered":"2024-04-25T22:44:41.422237+0000","last_unstale":"2024-04-25T22:45:26.360387+0000","last_undegraded":"2024-04-25T22:45:26.360387+0000","last_fullsized":"2024-04-25T22:45:26.360387+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'104","last_scrub_stamp":"2024-04-25T22:45:26.360186+0000","last_deep_scrub":"113'104","last_deep_scrub_stamp":"2024-04-25T22:45:26.360186+0000","last_clean_scrub_stamp":"2024-04-25T22:45:26.360186+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:53:23.386336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"113'214","reported_seq":426,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:32.702232+0000","last_change":"2024-04-25T22:45:32.702304+0000","last_active":"2024-04-25T22:45:32.702232+0000","last_peered":"2024-04-25T22:45:32.702232+0000","last_clean":"2024-04-25T22:45:32.702232+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:45:32.702232+0000","last_undegraded":"2024-04-25T22:45:32.702232+0000","last_fullsized":"2024-04-25T22:45:32.702232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'214","last_scrub_stamp":"2024-04-25T22:45:32.702047+0000","last_deep_scrub":"113'214","last_deep_scrub_stamp":"2024-04-25T22:45:32.702047+0000","last_clean_scrub_stamp":"2024-04-25T22:45:32.702047+0000","objects_scrubbed":1,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:11.425907+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"72'504","reported_seq":778,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:16.937256+0000","last_change":"2024-04-25T22:45:16.937314+0000","last_active":"2024-04-25T22:45:16.937256+0000","last_peered":"2024-04-25T22:45:16.937256+0000","last_clean":"2024-04-25T22:45:16.937256+0000","last_became_active":"2024-04-25T22:44:39.132582+0000","last_became_peered":"2024-04-25T22:44:39.132582+0000","last_unstale":"2024-04-25T22:45:16.937256+0000","last_undegraded":"2024-04-25T22:45:16.937256+0000","last_fullsized":"2024-04-25T22:45:16.937256+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'504","last_scrub_stamp":"2024-04-25T22:45:16.937061+0000","last_deep_scrub":"72'504","last_deep_scrub_stamp":"2024-04-25T22:45:16.937061+0000","last_clean_scrub_stamp":"2024-04-25T22:45:16.937061+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:02.108326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":46975,"num_write":471,"num_write_kb":146290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'64","reported_seq":229,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:08.972151+0000","last_change":"2024-04-25T22:45:08.972215+0000","last_active":"2024-04-25T22:45:08.972151+0000","last_peered":"2024-04-25T22:45:08.972151+0000","last_clean":"2024-04-25T22:45:08.972151+0000","last_became_active":"2024-04-25T22:44:39.136090+0000","last_became_peered":"2024-04-25T22:44:39.136090+0000","last_unstale":"2024-04-25T22:45:08.972151+0000","last_undegraded":"2024-04-25T22:45:08.972151+0000","last_fullsized":"2024-04-25T22:45:08.972151+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'64","last_scrub_stamp":"2024-04-25T22:45:08.971948+0000","last_deep_scrub":"71'64","last_deep_scrub_stamp":"2024-04-25T22:45:08.971948+0000","last_clean_scrub_stamp":"2024-04-25T22:45:08.971948+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:17:00.632713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"72'475","reported_seq":1163,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:36.166824+0000","last_change":"2024-04-25T22:45:36.166881+0000","last_active":"2024-04-25T22:45:36.166824+0000","last_peered":"2024-04-25T22:45:36.166824+0000","last_clean":"2024-04-25T22:45:36.166824+0000","last_became_active":"2024-04-25T22:44:44.102061+0000","last_became_peered":"2024-04-25T22:44:44.102061+0000","last_unstale":"2024-04-25T22:45:36.166824+0000","last_undegraded":"2024-04-25T22:45:36.166824+0000","last_fullsized":"2024-04-25T22:45:36.166824+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'475","last_scrub_stamp":"2024-04-25T22:45:36.166631+0000","last_deep_scrub":"72'475","last_deep_scrub_stamp":"2024-04-25T22:45:36.166631+0000","last_clean_scrub_stamp":"2024-04-25T22:45:36.166631+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:33:29.656730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":23011,"num_write":448,"num_write_kb":76439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"72'370","reported_seq":576,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:38.526162+0000","last_change":"2024-04-25T22:45:38.526219+0000","last_active":"2024-04-25T22:45:38.526162+0000","last_peered":"2024-04-25T22:45:38.526162+0000","last_clean":"2024-04-25T22:45:38.526162+0000","last_became_active":"2024-04-25T22:44:56.414231+0000","last_became_peered":"2024-04-25T22:44:56.414231+0000","last_unstale":"2024-04-25T22:45:38.526162+0000","last_undegraded":"2024-04-25T22:45:38.526162+0000","last_fullsized":"2024-04-25T22:45:38.526162+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'370","last_scrub_stamp":"2024-04-25T22:45:38.525948+0000","last_deep_scrub":"72'370","last_deep_scrub_stamp":"2024-04-25T22:45:38.525948+0000","last_clean_scrub_stamp":"2024-04-25T22:45:38.525948+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:17:29.688711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33211,"num_write":340,"num_write_kb":63312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"113'649","reported_seq":877,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:32.161416+0000","last_change":"2024-04-25T22:45:32.161584+0000","last_active":"2024-04-25T22:45:32.161416+0000","last_peered":"2024-04-25T22:45:32.161416+0000","last_clean":"2024-04-25T22:45:32.161416+0000","last_became_active":"2024-04-25T22:44:30.396073+0000","last_became_peered":"2024-04-25T22:44:30.396073+0000","last_unstale":"2024-04-25T22:45:32.161416+0000","last_undegraded":"2024-04-25T22:45:32.161416+0000","last_fullsized":"2024-04-25T22:45:32.161416+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'649","last_scrub_stamp":"2024-04-25T22:45:32.161195+0000","last_deep_scrub":"113'649","last_deep_scrub_stamp":"2024-04-25T22:45:32.161195+0000","last_clean_scrub_stamp":"2024-04-25T22:45:32.161195+0000","objects_scrubbed":2,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:44.121465+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"72'415","reported_seq":645,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:23.071501+0000","last_change":"2024-04-25T22:45:23.071561+0000","last_active":"2024-04-25T22:45:23.071501+0000","last_peered":"2024-04-25T22:45:23.071501+0000","last_clean":"2024-04-25T22:45:23.071501+0000","last_became_active":"2024-04-25T22:44:39.146949+0000","last_became_peered":"2024-04-25T22:44:39.146949+0000","last_unstale":"2024-04-25T22:45:23.071501+0000","last_undegraded":"2024-04-25T22:45:23.071501+0000","last_fullsized":"2024-04-25T22:45:23.071501+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'415","last_scrub_stamp":"2024-04-25T22:45:23.071270+0000","last_deep_scrub":"72'415","last_deep_scrub_stamp":"2024-04-25T22:45:23.071270+0000","last_clean_scrub_stamp":"2024-04-25T22:45:23.071270+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:24.129760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19493,"num_write":386,"num_write_kb":64692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"113'208","reported_seq":373,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:12.940687+0000","last_change":"2024-04-25T22:45:12.940827+0000","last_active":"2024-04-25T22:45:12.940687+0000","last_peered":"2024-04-25T22:45:12.940687+0000","last_clean":"2024-04-25T22:45:12.940687+0000","last_became_active":"2024-04-25T22:44:39.138371+0000","last_became_peered":"2024-04-25T22:44:39.138371+0000","last_unstale":"2024-04-25T22:45:12.940687+0000","last_undegraded":"2024-04-25T22:45:12.940687+0000","last_fullsized":"2024-04-25T22:45:12.940687+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'208","last_scrub_stamp":"2024-04-25T22:45:12.940458+0000","last_deep_scrub":"113'208","last_deep_scrub_stamp":"2024-04-25T22:45:12.940458+0000","last_clean_scrub_stamp":"2024-04-25T22:45:12.940458+0000","objects_scrubbed":1,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:06:25.970714+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"72'395","reported_seq":571,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:36.513749+0000","last_change":"2024-04-25T22:45:36.513804+0000","last_active":"2024-04-25T22:45:36.513749+0000","last_peered":"2024-04-25T22:45:36.513749+0000","last_clean":"2024-04-25T22:45:36.513749+0000","last_became_active":"2024-04-25T22:44:55.396613+0000","last_became_peered":"2024-04-25T22:44:55.396613+0000","last_unstale":"2024-04-25T22:45:36.513749+0000","last_undegraded":"2024-04-25T22:45:36.513749+0000","last_fullsized":"2024-04-25T22:45:36.513749+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'395","last_scrub_stamp":"2024-04-25T22:45:36.513549+0000","last_deep_scrub":"72'395","last_deep_scrub_stamp":"2024-04-25T22:45:36.513549+0000","last_clean_scrub_stamp":"2024-04-25T22:45:36.513549+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:54:57.467295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9576,"num_write":348,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"113'197","reported_seq":375,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:33.562767+0000","last_change":"2024-04-25T22:45:33.562837+0000","last_active":"2024-04-25T22:45:33.562767+0000","last_peered":"2024-04-25T22:45:33.562767+0000","last_clean":"2024-04-25T22:45:33.562767+0000","last_became_active":"2024-04-25T22:44:41.420491+0000","last_became_peered":"2024-04-25T22:44:41.420491+0000","last_unstale":"2024-04-25T22:45:33.562767+0000","last_undegraded":"2024-04-25T22:45:33.562767+0000","last_fullsized":"2024-04-25T22:45:33.562767+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'197","last_scrub_stamp":"2024-04-25T22:45:33.562571+0000","last_deep_scrub":"113'197","last_deep_scrub_stamp":"2024-04-25T22:45:33.562571+0000","last_clean_scrub_stamp":"2024-04-25T22:45:33.562571+0000","objects_scrubbed":3,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:56.175724+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360511,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":12143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12360511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"72'398","reported_seq":602,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:35.476864+0000","last_change":"2024-04-25T22:45:35.477030+0000","last_active":"2024-04-25T22:45:35.476864+0000","last_peered":"2024-04-25T22:45:35.476864+0000","last_clean":"2024-04-25T22:45:35.476864+0000","last_became_active":"2024-04-25T22:44:52.375632+0000","last_became_peered":"2024-04-25T22:44:52.375632+0000","last_unstale":"2024-04-25T22:45:35.476864+0000","last_undegraded":"2024-04-25T22:45:35.476864+0000","last_fullsized":"2024-04-25T22:45:35.476864+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'398","last_scrub_stamp":"2024-04-25T22:45:35.476625+0000","last_deep_scrub":"72'398","last_deep_scrub_stamp":"2024-04-25T22:45:35.476625+0000","last_clean_scrub_stamp":"2024-04-25T22:45:35.476625+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:11.398927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31284,"num_write":371,"num_write_kb":80144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"113'52","reported_seq":104,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:27.410878+0000","last_change":"2024-04-25T22:45:27.410952+0000","last_active":"2024-04-25T22:45:27.410878+0000","last_peered":"2024-04-25T22:45:27.410878+0000","last_clean":"2024-04-25T22:45:27.410878+0000","last_became_active":"2024-04-25T22:44:41.414774+0000","last_became_peered":"2024-04-25T22:44:41.414774+0000","last_unstale":"2024-04-25T22:45:27.410878+0000","last_undegraded":"2024-04-25T22:45:27.410878+0000","last_fullsized":"2024-04-25T22:45:27.410878+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'52","last_scrub_stamp":"2024-04-25T22:45:27.410684+0000","last_deep_scrub":"113'52","last_deep_scrub_stamp":"2024-04-25T22:45:27.410684+0000","last_clean_scrub_stamp":"2024-04-25T22:45:27.410684+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:24.117277+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"72'383","reported_seq":645,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:15.745107+0000","last_change":"2024-04-25T22:45:15.745107+0000","last_active":"2024-04-25T22:45:15.745107+0000","last_peered":"2024-04-25T22:45:15.745107+0000","last_clean":"2024-04-25T22:45:15.745107+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:45:15.745107+0000","last_undegraded":"2024-04-25T22:45:15.745107+0000","last_fullsized":"2024-04-25T22:45:15.745107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'383","last_scrub_stamp":"2024-04-25T22:45:15.744713+0000","last_deep_scrub":"72'383","last_deep_scrub_stamp":"2024-04-25T22:45:15.744713+0000","last_clean_scrub_stamp":"2024-04-25T22:45:15.744713+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:24.822195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29308,"num_write":358,"num_write_kb":66975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"113'179","reported_seq":391,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:33.709387+0000","last_change":"2024-04-25T22:45:33.709459+0000","last_active":"2024-04-25T22:45:33.709387+0000","last_peered":"2024-04-25T22:45:33.709387+0000","last_clean":"2024-04-25T22:45:33.709387+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:45:33.709387+0000","last_undegraded":"2024-04-25T22:45:33.709387+0000","last_fullsized":"2024-04-25T22:45:33.709387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'179","last_scrub_stamp":"2024-04-25T22:45:33.709201+0000","last_deep_scrub":"113'179","last_deep_scrub_stamp":"2024-04-25T22:45:33.709201+0000","last_clean_scrub_stamp":"2024-04-25T22:45:33.709201+0000","objects_scrubbed":2,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:28.313224+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"72'387","reported_seq":610,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:22.769968+0000","last_change":"2024-04-25T22:45:22.770027+0000","last_active":"2024-04-25T22:45:22.769968+0000","last_peered":"2024-04-25T22:45:22.769968+0000","last_clean":"2024-04-25T22:45:22.769968+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:45:22.769968+0000","last_undegraded":"2024-04-25T22:45:22.769968+0000","last_fullsized":"2024-04-25T22:45:22.769968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'387","last_scrub_stamp":"2024-04-25T22:45:22.769766+0000","last_deep_scrub":"72'387","last_deep_scrub_stamp":"2024-04-25T22:45:22.769766+0000","last_clean_scrub_stamp":"2024-04-25T22:45:22.769766+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:21.591299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3883,"num_write":348,"num_write_kb":34122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"113'213","reported_seq":426,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:32.563798+0000","last_change":"2024-04-25T22:45:32.563872+0000","last_active":"2024-04-25T22:45:32.563798+0000","last_peered":"2024-04-25T22:45:32.563798+0000","last_clean":"2024-04-25T22:45:32.563798+0000","last_became_active":"2024-04-25T22:44:41.418106+0000","last_became_peered":"2024-04-25T22:44:41.418106+0000","last_unstale":"2024-04-25T22:45:32.563798+0000","last_undegraded":"2024-04-25T22:45:32.563798+0000","last_fullsized":"2024-04-25T22:45:32.563798+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'213","last_scrub_stamp":"2024-04-25T22:45:32.563610+0000","last_deep_scrub":"113'213","last_deep_scrub_stamp":"2024-04-25T22:45:32.563610+0000","last_clean_scrub_stamp":"2024-04-25T22:45:32.563610+0000","objects_scrubbed":4,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:54.102851+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":12363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"72'419","reported_seq":616,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:14.195273+0000","last_change":"2024-04-25T22:45:14.195329+0000","last_active":"2024-04-25T22:45:14.195273+0000","last_peered":"2024-04-25T22:45:14.195273+0000","last_clean":"2024-04-25T22:45:14.195273+0000","last_became_active":"2024-04-25T22:44:41.420505+0000","last_became_peered":"2024-04-25T22:44:41.420505+0000","last_unstale":"2024-04-25T22:45:14.195273+0000","last_undegraded":"2024-04-25T22:45:14.195273+0000","last_fullsized":"2024-04-25T22:45:14.195273+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'419","last_scrub_stamp":"2024-04-25T22:45:14.195073+0000","last_deep_scrub":"72'419","last_deep_scrub_stamp":"2024-04-25T22:45:14.195073+0000","last_clean_scrub_stamp":"2024-04-25T22:45:14.195073+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:10.119407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":13327,"num_write":388,"num_write_kb":55674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"113'132","reported_seq":359,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:30.163909+0000","last_change":"2024-04-25T22:45:30.164063+0000","last_active":"2024-04-25T22:45:30.163909+0000","last_peered":"2024-04-25T22:45:30.163909+0000","last_clean":"2024-04-25T22:45:30.163909+0000","last_became_active":"2024-04-25T22:44:29.397905+0000","last_became_peered":"2024-04-25T22:44:29.397905+0000","last_unstale":"2024-04-25T22:45:30.163909+0000","last_undegraded":"2024-04-25T22:45:30.163909+0000","last_fullsized":"2024-04-25T22:45:30.163909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'132","last_scrub_stamp":"2024-04-25T22:45:30.163698+0000","last_deep_scrub":"113'132","last_deep_scrub_stamp":"2024-04-25T22:45:30.163698+0000","last_clean_scrub_stamp":"2024-04-25T22:45:30.163698+0000","objects_scrubbed":1,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:29:14.469045+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"72'449","reported_seq":693,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:21.789313+0000","last_change":"2024-04-25T22:45:21.789369+0000","last_active":"2024-04-25T22:45:21.789313+0000","last_peered":"2024-04-25T22:45:21.789313+0000","last_clean":"2024-04-25T22:45:21.789313+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:45:21.789313+0000","last_undegraded":"2024-04-25T22:45:21.789313+0000","last_fullsized":"2024-04-25T22:45:21.789313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'449","last_scrub_stamp":"2024-04-25T22:45:21.789127+0000","last_deep_scrub":"72'449","last_deep_scrub_stamp":"2024-04-25T22:45:21.789127+0000","last_clean_scrub_stamp":"2024-04-25T22:45:21.789127+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:22.847617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14222,"num_write":424,"num_write_kb":79796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"113'60","reported_seq":225,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:10.988727+0000","last_change":"2024-04-25T22:45:10.988900+0000","last_active":"2024-04-25T22:45:10.988727+0000","last_peered":"2024-04-25T22:45:10.988727+0000","last_clean":"2024-04-25T22:45:10.988727+0000","last_became_active":"2024-04-25T22:44:39.136283+0000","last_became_peered":"2024-04-25T22:44:39.136283+0000","last_unstale":"2024-04-25T22:45:10.988727+0000","last_undegraded":"2024-04-25T22:45:10.988727+0000","last_fullsized":"2024-04-25T22:45:10.988727+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'60","last_scrub_stamp":"2024-04-25T22:45:10.988509+0000","last_deep_scrub":"113'60","last_deep_scrub_stamp":"2024-04-25T22:45:10.988509+0000","last_clean_scrub_stamp":"2024-04-25T22:45:10.988509+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:33.410497+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2461,"num_read_kb":1248646,"num_write":24434,"num_write_kb":4137258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7447,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26539,"ondisk_log_size":26539,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127071275,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":4473,"num_write_kb":127409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254210048,"data_stored":254142550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},"log_size":6268,"ondisk_log_size":6268,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738442,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165336,"kb_used_data":80080,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94206504,"statfs":{"total":96636764160,"available":96467460096,"internally_reserved":0,"allocated":82001920,"data_stored":81417710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":79,"seq":339302416402,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141396,"kb_used_data":83340,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94230444,"statfs":{"total":96636764160,"available":96491974656,"internally_reserved":0,"allocated":85340160,"data_stored":84739534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6003,"internal_metadata":59435149},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174344,"kb_used_data":89088,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94197496,"statfs":{"total":96636764160,"available":96458235904,"internally_reserved":0,"allocated":91226112,"data_stored":90619941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89575424,"data_stored":89544940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83689472,"data_stored":83664533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80945152,"data_stored":80933077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:45:49.158 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:49.159 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:49.159 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T22:40:13.541378+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=40, tm_sec=13, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=45, tm_sec=5, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:45:49.160 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T22:46:09.160 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:46:09.492 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:46:09.493 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-25T22:46:09.512 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-04-25T22:46:09.269405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127661643,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":2659,"num_read_kb":1250233,"num_write":29110,"num_write_kb":4268127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7469,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32966,"ondisk_log_size":32966,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":481076,"kb_used_data":252508,"kb_used_omap":8,"kb_used_meta":228535,"kb_avail":282634444,"statfs":{"total":289910292480,"available":289417670656,"internally_reserved":0,"allocated":258568192,"data_stored":256777185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9193,"internal_metadata":234019863},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004516"},"pg_stats":[{"pgid":"4.3f","version":"72'404","reported_seq":568,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:39.547461+0000","last_change":"2024-04-25T22:45:39.547521+0000","last_active":"2024-04-25T22:45:39.547461+0000","last_peered":"2024-04-25T22:45:39.547461+0000","last_clean":"2024-04-25T22:45:39.547461+0000","last_became_active":"2024-04-25T22:44:57.376098+0000","last_became_peered":"2024-04-25T22:44:57.376098+0000","last_unstale":"2024-04-25T22:45:39.547461+0000","last_undegraded":"2024-04-25T22:45:39.547461+0000","last_fullsized":"2024-04-25T22:45:39.547461+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'404","last_scrub_stamp":"2024-04-25T22:45:39.547222+0000","last_deep_scrub":"72'404","last_deep_scrub_stamp":"2024-04-25T22:45:39.547222+0000","last_clean_scrub_stamp":"2024-04-25T22:45:39.547222+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:02.614954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":19772,"num_write":366,"num_write_kb":46873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"72'420","reported_seq":631,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:12.184338+0000","last_change":"2024-04-25T22:45:12.184395+0000","last_active":"2024-04-25T22:45:12.184338+0000","last_peered":"2024-04-25T22:45:12.184338+0000","last_clean":"2024-04-25T22:45:12.184338+0000","last_became_active":"2024-04-25T22:44:41.418792+0000","last_became_peered":"2024-04-25T22:44:41.418792+0000","last_unstale":"2024-04-25T22:45:12.184338+0000","last_undegraded":"2024-04-25T22:45:12.184338+0000","last_fullsized":"2024-04-25T22:45:12.184338+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'420","last_scrub_stamp":"2024-04-25T22:45:12.184147+0000","last_deep_scrub":"72'420","last_deep_scrub_stamp":"2024-04-25T22:45:12.184147+0000","last_clean_scrub_stamp":"2024-04-25T22:45:12.184147+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:42:08.825155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":24515,"num_write":386,"num_write_kb":55688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"72'377","reported_seq":961,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:42.555877+0000","last_change":"2024-04-25T22:45:42.555936+0000","last_active":"2024-04-25T22:45:42.555877+0000","last_peered":"2024-04-25T22:45:42.555877+0000","last_clean":"2024-04-25T22:45:42.555877+0000","last_became_active":"2024-04-25T22:44:42.093941+0000","last_became_peered":"2024-04-25T22:44:42.093941+0000","last_unstale":"2024-04-25T22:45:42.555877+0000","last_undegraded":"2024-04-25T22:45:42.555877+0000","last_fullsized":"2024-04-25T22:45:42.555877+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'377","last_scrub_stamp":"2024-04-25T22:45:42.555680+0000","last_deep_scrub":"72'377","last_deep_scrub_stamp":"2024-04-25T22:45:42.555680+0000","last_clean_scrub_stamp":"2024-04-25T22:45:42.555680+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:59:11.416831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11135,"num_write":346,"num_write_kb":38950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"72'366","reported_seq":582,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:20.800938+0000","last_change":"2024-04-25T22:45:20.800998+0000","last_active":"2024-04-25T22:45:20.800938+0000","last_peered":"2024-04-25T22:45:20.800938+0000","last_clean":"2024-04-25T22:45:20.800938+0000","last_became_active":"2024-04-25T22:40:14.626075+0000","last_became_peered":"2024-04-25T22:40:14.626075+0000","last_unstale":"2024-04-25T22:45:20.800938+0000","last_undegraded":"2024-04-25T22:45:20.800938+0000","last_fullsized":"2024-04-25T22:45:20.800938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'366","last_scrub_stamp":"2024-04-25T22:45:20.800720+0000","last_deep_scrub":"72'366","last_deep_scrub_stamp":"2024-04-25T22:45:20.800720+0000","last_clean_scrub_stamp":"2024-04-25T22:45:20.800720+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:30:30.198446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":326,"num_write_kb":34079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"72'455","reported_seq":644,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:21.294505+0000","last_change":"2024-04-25T22:45:21.294650+0000","last_active":"2024-04-25T22:45:21.294505+0000","last_peered":"2024-04-25T22:45:21.294505+0000","last_clean":"2024-04-25T22:45:21.294505+0000","last_became_active":"2024-04-25T22:44:50.384804+0000","last_became_peered":"2024-04-25T22:44:50.384804+0000","last_unstale":"2024-04-25T22:45:21.294505+0000","last_undegraded":"2024-04-25T22:45:21.294505+0000","last_fullsized":"2024-04-25T22:45:21.294505+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'455","last_scrub_stamp":"2024-04-25T22:45:21.294262+0000","last_deep_scrub":"72'455","last_deep_scrub_stamp":"2024-04-25T22:45:21.294262+0000","last_clean_scrub_stamp":"2024-04-25T22:45:21.294262+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:23:59.755528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":33897,"num_write":426,"num_write_kb":100721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"72'401","reported_seq":645,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:13.805050+0000","last_change":"2024-04-25T22:45:13.805050+0000","last_active":"2024-04-25T22:45:13.805050+0000","last_peered":"2024-04-25T22:45:13.805050+0000","last_clean":"2024-04-25T22:45:13.805050+0000","last_became_active":"2024-04-25T22:40:14.630543+0000","last_became_peered":"2024-04-25T22:40:14.630543+0000","last_unstale":"2024-04-25T22:45:13.805050+0000","last_undegraded":"2024-04-25T22:45:13.805050+0000","last_fullsized":"2024-04-25T22:45:13.805050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'401","last_scrub_stamp":"2024-04-25T22:45:13.804798+0000","last_deep_scrub":"72'401","last_deep_scrub_stamp":"2024-04-25T22:45:13.804798+0000","last_clean_scrub_stamp":"2024-04-25T22:45:13.804798+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:59.583390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15258,"num_write":369,"num_write_kb":53298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"72'452","reported_seq":728,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:18.816458+0000","last_change":"2024-04-25T22:45:18.816514+0000","last_active":"2024-04-25T22:45:18.816458+0000","last_peered":"2024-04-25T22:45:18.816458+0000","last_clean":"2024-04-25T22:45:18.816458+0000","last_became_active":"2024-04-25T22:40:14.626381+0000","last_became_peered":"2024-04-25T22:40:14.626381+0000","last_unstale":"2024-04-25T22:45:18.816458+0000","last_undegraded":"2024-04-25T22:45:18.816458+0000","last_fullsized":"2024-04-25T22:45:18.816458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'452","last_scrub_stamp":"2024-04-25T22:45:18.816273+0000","last_deep_scrub":"72'452","last_deep_scrub_stamp":"2024-04-25T22:45:18.816273+0000","last_clean_scrub_stamp":"2024-04-25T22:45:18.816273+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:12.155613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34010,"num_write":428,"num_write_kb":157752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"72'401","reported_seq":650,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:23.738883+0000","last_change":"2024-04-25T22:45:23.738944+0000","last_active":"2024-04-25T22:45:23.738883+0000","last_peered":"2024-04-25T22:45:23.738883+0000","last_clean":"2024-04-25T22:45:23.738883+0000","last_became_active":"2024-04-25T22:40:14.631806+0000","last_became_peered":"2024-04-25T22:40:14.631806+0000","last_unstale":"2024-04-25T22:45:23.738883+0000","last_undegraded":"2024-04-25T22:45:23.738883+0000","last_fullsized":"2024-04-25T22:45:23.738883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'401","last_scrub_stamp":"2024-04-25T22:45:23.738682+0000","last_deep_scrub":"72'401","last_deep_scrub_stamp":"2024-04-25T22:45:23.738682+0000","last_clean_scrub_stamp":"2024-04-25T22:45:23.738682+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:16.674591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19917,"num_write":359,"num_write_kb":109382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"72'394","reported_seq":990,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:39.122331+0000","last_change":"2024-04-25T22:45:39.122395+0000","last_active":"2024-04-25T22:45:39.122331+0000","last_peered":"2024-04-25T22:45:39.122331+0000","last_clean":"2024-04-25T22:45:39.122331+0000","last_became_active":"2024-04-25T22:44:48.089795+0000","last_became_peered":"2024-04-25T22:44:48.089795+0000","last_unstale":"2024-04-25T22:45:39.122331+0000","last_undegraded":"2024-04-25T22:45:39.122331+0000","last_fullsized":"2024-04-25T22:45:39.122331+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'394","last_scrub_stamp":"2024-04-25T22:45:39.122145+0000","last_deep_scrub":"72'394","last_deep_scrub_stamp":"2024-04-25T22:45:39.122145+0000","last_clean_scrub_stamp":"2024-04-25T22:45:39.122145+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:34:56.062074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9569,"num_write":360,"num_write_kb":25560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"72'382","reported_seq":575,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:16.197759+0000","last_change":"2024-04-25T22:45:16.197815+0000","last_active":"2024-04-25T22:45:16.197759+0000","last_peered":"2024-04-25T22:45:16.197759+0000","last_clean":"2024-04-25T22:45:16.197759+0000","last_became_active":"2024-04-25T22:44:41.421234+0000","last_became_peered":"2024-04-25T22:44:41.421234+0000","last_unstale":"2024-04-25T22:45:16.197759+0000","last_undegraded":"2024-04-25T22:45:16.197759+0000","last_fullsized":"2024-04-25T22:45:16.197759+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'382","last_scrub_stamp":"2024-04-25T22:45:16.197564+0000","last_deep_scrub":"72'382","last_deep_scrub_stamp":"2024-04-25T22:45:16.197564+0000","last_clean_scrub_stamp":"2024-04-25T22:45:16.197564+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:55.640137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":17192,"num_write":338,"num_write_kb":38688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"72'369","reported_seq":602,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:25.795277+0000","last_change":"2024-04-25T22:45:25.795337+0000","last_active":"2024-04-25T22:45:25.795277+0000","last_peered":"2024-04-25T22:45:25.795277+0000","last_clean":"2024-04-25T22:45:25.795277+0000","last_became_active":"2024-04-25T22:40:14.629112+0000","last_became_peered":"2024-04-25T22:40:14.629112+0000","last_unstale":"2024-04-25T22:45:25.795277+0000","last_undegraded":"2024-04-25T22:45:25.795277+0000","last_fullsized":"2024-04-25T22:45:25.795277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'369","last_scrub_stamp":"2024-04-25T22:45:25.795029+0000","last_deep_scrub":"72'369","last_deep_scrub_stamp":"2024-04-25T22:45:25.795029+0000","last_clean_scrub_stamp":"2024-04-25T22:45:25.795029+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:19:27.181488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7385,"num_write":349,"num_write_kb":58842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"72'338","reported_seq":531,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:19.204479+0000","last_change":"2024-04-25T22:45:19.204542+0000","last_active":"2024-04-25T22:45:19.204479+0000","last_peered":"2024-04-25T22:45:19.204479+0000","last_clean":"2024-04-25T22:45:19.204479+0000","last_became_active":"2024-04-25T22:44:49.378325+0000","last_became_peered":"2024-04-25T22:44:49.378325+0000","last_unstale":"2024-04-25T22:45:19.204479+0000","last_undegraded":"2024-04-25T22:45:19.204479+0000","last_fullsized":"2024-04-25T22:45:19.204479+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'338","last_scrub_stamp":"2024-04-25T22:45:19.204281+0000","last_deep_scrub":"72'338","last_deep_scrub_stamp":"2024-04-25T22:45:19.204281+0000","last_clean_scrub_stamp":"2024-04-25T22:45:19.204281+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:24:35.194784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13619,"num_write":312,"num_write_kb":21391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"72'411","reported_seq":614,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:20.249763+0000","last_change":"2024-04-25T22:45:20.249821+0000","last_active":"2024-04-25T22:45:20.249763+0000","last_peered":"2024-04-25T22:45:20.249763+0000","last_clean":"2024-04-25T22:45:20.249763+0000","last_became_active":"2024-04-25T22:44:41.421096+0000","last_became_peered":"2024-04-25T22:44:41.421096+0000","last_unstale":"2024-04-25T22:45:20.249763+0000","last_undegraded":"2024-04-25T22:45:20.249763+0000","last_fullsized":"2024-04-25T22:45:20.249763+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'411","last_scrub_stamp":"2024-04-25T22:45:20.249567+0000","last_deep_scrub":"72'411","last_deep_scrub_stamp":"2024-04-25T22:45:20.249567+0000","last_clean_scrub_stamp":"2024-04-25T22:45:20.249567+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:01.734764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12998,"num_write":375,"num_write_kb":79661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"72'452","reported_seq":1060,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:41.566666+0000","last_change":"2024-04-25T22:45:41.566727+0000","last_active":"2024-04-25T22:45:41.566666+0000","last_peered":"2024-04-25T22:45:41.566666+0000","last_clean":"2024-04-25T22:45:41.566666+0000","last_became_active":"2024-04-25T22:44:40.127307+0000","last_became_peered":"2024-04-25T22:44:40.127307+0000","last_unstale":"2024-04-25T22:45:41.566666+0000","last_undegraded":"2024-04-25T22:45:41.566666+0000","last_fullsized":"2024-04-25T22:45:41.566666+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'452","last_scrub_stamp":"2024-04-25T22:45:41.566459+0000","last_deep_scrub":"72'452","last_deep_scrub_stamp":"2024-04-25T22:45:41.566459+0000","last_clean_scrub_stamp":"2024-04-25T22:45:41.566459+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:27:49.107252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":854,"num_write":419,"num_write_kb":88217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"72'428","reported_seq":1040,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:39.597468+0000","last_change":"2024-04-25T22:45:39.597526+0000","last_active":"2024-04-25T22:45:39.597468+0000","last_peered":"2024-04-25T22:45:39.597468+0000","last_clean":"2024-04-25T22:45:39.597468+0000","last_became_active":"2024-04-25T22:44:35.103208+0000","last_became_peered":"2024-04-25T22:44:35.103208+0000","last_unstale":"2024-04-25T22:45:39.597468+0000","last_undegraded":"2024-04-25T22:45:39.597468+0000","last_fullsized":"2024-04-25T22:45:39.597468+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'428","last_scrub_stamp":"2024-04-25T22:45:39.597265+0000","last_deep_scrub":"72'428","last_deep_scrub_stamp":"2024-04-25T22:45:39.597265+0000","last_clean_scrub_stamp":"2024-04-25T22:45:39.597265+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:43:07.736662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21291,"num_write":389,"num_write_kb":68562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"72'401","reported_seq":624,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:17.806706+0000","last_change":"2024-04-25T22:45:17.806824+0000","last_active":"2024-04-25T22:45:17.806706+0000","last_peered":"2024-04-25T22:45:17.806706+0000","last_clean":"2024-04-25T22:45:17.806706+0000","last_became_active":"2024-04-25T22:40:14.628914+0000","last_became_peered":"2024-04-25T22:40:14.628914+0000","last_unstale":"2024-04-25T22:45:17.806706+0000","last_undegraded":"2024-04-25T22:45:17.806706+0000","last_fullsized":"2024-04-25T22:45:17.806706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'401","last_scrub_stamp":"2024-04-25T22:45:17.806458+0000","last_deep_scrub":"72'401","last_deep_scrub_stamp":"2024-04-25T22:45:17.806458+0000","last_clean_scrub_stamp":"2024-04-25T22:45:17.806458+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:02:08.446390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8276,"num_write":369,"num_write_kb":17867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"72'398","reported_seq":980,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:40.160643+0000","last_change":"2024-04-25T22:45:40.160707+0000","last_active":"2024-04-25T22:45:40.160643+0000","last_peered":"2024-04-25T22:45:40.160643+0000","last_clean":"2024-04-25T22:45:40.160643+0000","last_became_active":"2024-04-25T22:44:49.094478+0000","last_became_peered":"2024-04-25T22:44:49.094478+0000","last_unstale":"2024-04-25T22:45:40.160643+0000","last_undegraded":"2024-04-25T22:45:40.160643+0000","last_fullsized":"2024-04-25T22:45:40.160643+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'398","last_scrub_stamp":"2024-04-25T22:45:40.160447+0000","last_deep_scrub":"72'398","last_deep_scrub_stamp":"2024-04-25T22:45:40.160447+0000","last_clean_scrub_stamp":"2024-04-25T22:45:40.160447+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:52.207576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5883,"num_write":362,"num_write_kb":38188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"72'407","reported_seq":552,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:42.624230+0000","last_change":"2024-04-25T22:45:42.624287+0000","last_active":"2024-04-25T22:45:42.624230+0000","last_peered":"2024-04-25T22:45:42.624230+0000","last_clean":"2024-04-25T22:45:42.624230+0000","last_became_active":"2024-04-25T22:44:59.396404+0000","last_became_peered":"2024-04-25T22:44:59.396404+0000","last_unstale":"2024-04-25T22:45:42.624230+0000","last_undegraded":"2024-04-25T22:45:42.624230+0000","last_fullsized":"2024-04-25T22:45:42.624230+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'407","last_scrub_stamp":"2024-04-25T22:45:42.624044+0000","last_deep_scrub":"72'407","last_deep_scrub_stamp":"2024-04-25T22:45:42.624044+0000","last_clean_scrub_stamp":"2024-04-25T22:45:42.624044+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:10.573505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13073,"num_write":372,"num_write_kb":59323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"72'441","reported_seq":1068,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:34.140060+0000","last_change":"2024-04-25T22:45:34.140120+0000","last_active":"2024-04-25T22:45:34.140060+0000","last_peered":"2024-04-25T22:45:34.140060+0000","last_clean":"2024-04-25T22:45:34.140060+0000","last_became_active":"2024-04-25T22:44:41.143302+0000","last_became_peered":"2024-04-25T22:44:41.143302+0000","last_unstale":"2024-04-25T22:45:34.140060+0000","last_undegraded":"2024-04-25T22:45:34.140060+0000","last_fullsized":"2024-04-25T22:45:34.140060+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'441","last_scrub_stamp":"2024-04-25T22:45:34.139765+0000","last_deep_scrub":"72'441","last_deep_scrub_stamp":"2024-04-25T22:45:34.139765+0000","last_clean_scrub_stamp":"2024-04-25T22:45:34.139765+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:40:19.346042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37611,"num_write":403,"num_write_kb":116618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"72'438","reported_seq":673,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:19.816036+0000","last_change":"2024-04-25T22:45:19.816093+0000","last_active":"2024-04-25T22:45:19.816036+0000","last_peered":"2024-04-25T22:45:19.816036+0000","last_clean":"2024-04-25T22:45:19.816036+0000","last_became_active":"2024-04-25T22:40:14.630361+0000","last_became_peered":"2024-04-25T22:40:14.630361+0000","last_unstale":"2024-04-25T22:45:19.816036+0000","last_undegraded":"2024-04-25T22:45:19.816036+0000","last_fullsized":"2024-04-25T22:45:19.816036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'438","last_scrub_stamp":"2024-04-25T22:45:19.815827+0000","last_deep_scrub":"72'438","last_deep_scrub_stamp":"2024-04-25T22:45:19.815827+0000","last_clean_scrub_stamp":"2024-04-25T22:45:19.815827+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:36:57.469378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12393,"num_write":408,"num_write_kb":99933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"72'407","reported_seq":631,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:16.780914+0000","last_change":"2024-04-25T22:45:16.780971+0000","last_active":"2024-04-25T22:45:16.780914+0000","last_peered":"2024-04-25T22:45:16.780914+0000","last_clean":"2024-04-25T22:45:16.780914+0000","last_became_active":"2024-04-25T22:40:14.627682+0000","last_became_peered":"2024-04-25T22:40:14.627682+0000","last_unstale":"2024-04-25T22:45:16.780914+0000","last_undegraded":"2024-04-25T22:45:16.780914+0000","last_fullsized":"2024-04-25T22:45:16.780914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'407","last_scrub_stamp":"2024-04-25T22:45:16.780720+0000","last_deep_scrub":"72'407","last_deep_scrub_stamp":"2024-04-25T22:45:16.780720+0000","last_clean_scrub_stamp":"2024-04-25T22:45:16.780720+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:18.464252+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8932,"num_write":382,"num_write_kb":59684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"72'463","reported_seq":701,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:15.170317+0000","last_change":"2024-04-25T22:45:15.170394+0000","last_active":"2024-04-25T22:45:15.170317+0000","last_peered":"2024-04-25T22:45:15.170317+0000","last_clean":"2024-04-25T22:45:15.170317+0000","last_became_active":"2024-04-25T22:44:47.369995+0000","last_became_peered":"2024-04-25T22:44:47.369995+0000","last_unstale":"2024-04-25T22:45:15.170317+0000","last_undegraded":"2024-04-25T22:45:15.170317+0000","last_fullsized":"2024-04-25T22:45:15.170317+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'463","last_scrub_stamp":"2024-04-25T22:45:15.170124+0000","last_deep_scrub":"72'463","last_deep_scrub_stamp":"2024-04-25T22:45:15.170124+0000","last_clean_scrub_stamp":"2024-04-25T22:45:15.170124+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:16:47.186871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27589,"num_write":428,"num_write_kb":76861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"72'425","reported_seq":703,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:13.959533+0000","last_change":"2024-04-25T22:45:13.959595+0000","last_active":"2024-04-25T22:45:13.959533+0000","last_peered":"2024-04-25T22:45:13.959533+0000","last_clean":"2024-04-25T22:45:13.959533+0000","last_became_active":"2024-04-25T22:44:39.118635+0000","last_became_peered":"2024-04-25T22:44:39.118635+0000","last_unstale":"2024-04-25T22:45:13.959533+0000","last_undegraded":"2024-04-25T22:45:13.959533+0000","last_fullsized":"2024-04-25T22:45:13.959533+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'425","last_scrub_stamp":"2024-04-25T22:45:13.959287+0000","last_deep_scrub":"72'425","last_deep_scrub_stamp":"2024-04-25T22:45:13.959287+0000","last_clean_scrub_stamp":"2024-04-25T22:45:13.959287+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:32.240463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":46424,"num_write":390,"num_write_kb":96359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"72'445","reported_seq":628,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:08.104270+0000","last_change":"2024-04-25T22:45:08.104354+0000","last_active":"2024-04-25T22:45:08.104270+0000","last_peered":"2024-04-25T22:45:08.104270+0000","last_clean":"2024-04-25T22:45:08.104270+0000","last_became_active":"2024-04-25T22:44:54.382124+0000","last_became_peered":"2024-04-25T22:44:54.382124+0000","last_unstale":"2024-04-25T22:45:08.104270+0000","last_undegraded":"2024-04-25T22:45:08.104270+0000","last_fullsized":"2024-04-25T22:45:08.104270+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'445","last_scrub_stamp":"2024-04-25T22:45:08.104062+0000","last_deep_scrub":"72'445","last_deep_scrub_stamp":"2024-04-25T22:45:08.104062+0000","last_clean_scrub_stamp":"2024-04-25T22:45:08.104062+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:05.080111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32317,"num_write":419,"num_write_kb":76071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"72'424","reported_seq":599,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:23.308204+0000","last_change":"2024-04-25T22:45:23.308261+0000","last_active":"2024-04-25T22:45:23.308204+0000","last_peered":"2024-04-25T22:45:23.308204+0000","last_clean":"2024-04-25T22:45:23.308204+0000","last_became_active":"2024-04-25T22:44:51.383461+0000","last_became_peered":"2024-04-25T22:44:51.383461+0000","last_unstale":"2024-04-25T22:45:23.308204+0000","last_undegraded":"2024-04-25T22:45:23.308204+0000","last_fullsized":"2024-04-25T22:45:23.308204+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'424","last_scrub_stamp":"2024-04-25T22:45:23.308006+0000","last_deep_scrub":"72'424","last_deep_scrub_stamp":"2024-04-25T22:45:23.308006+0000","last_clean_scrub_stamp":"2024-04-25T22:45:23.308006+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:14:18.496607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8396,"num_write":399,"num_write_kb":50416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"72'499","reported_seq":719,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:19.029685+0000","last_change":"2024-04-25T22:45:19.029744+0000","last_active":"2024-04-25T22:45:19.029685+0000","last_peered":"2024-04-25T22:45:19.029685+0000","last_clean":"2024-04-25T22:45:19.029685+0000","last_became_active":"2024-04-25T22:44:39.143391+0000","last_became_peered":"2024-04-25T22:44:39.143391+0000","last_unstale":"2024-04-25T22:45:19.029685+0000","last_undegraded":"2024-04-25T22:45:19.029685+0000","last_fullsized":"2024-04-25T22:45:19.029685+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'499","last_scrub_stamp":"2024-04-25T22:45:19.029484+0000","last_deep_scrub":"72'499","last_deep_scrub_stamp":"2024-04-25T22:45:19.029484+0000","last_clean_scrub_stamp":"2024-04-25T22:45:19.029484+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:40.593352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":10227,"num_write":453,"num_write_kb":96585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"72'430","reported_seq":1091,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:40.602946+0000","last_change":"2024-04-25T22:45:40.603135+0000","last_active":"2024-04-25T22:45:40.602946+0000","last_peered":"2024-04-25T22:45:40.602946+0000","last_clean":"2024-04-25T22:45:40.602946+0000","last_became_active":"2024-04-25T22:44:39.109771+0000","last_became_peered":"2024-04-25T22:44:39.109771+0000","last_unstale":"2024-04-25T22:45:40.602946+0000","last_undegraded":"2024-04-25T22:45:40.602946+0000","last_fullsized":"2024-04-25T22:45:40.602946+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'430","last_scrub_stamp":"2024-04-25T22:45:40.602721+0000","last_deep_scrub":"72'430","last_deep_scrub_stamp":"2024-04-25T22:45:40.602721+0000","last_clean_scrub_stamp":"2024-04-25T22:45:40.602721+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:45.941937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":32116,"num_write":409,"num_write_kb":89217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"72'393","reported_seq":665,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:22.342484+0000","last_change":"2024-04-25T22:45:22.342612+0000","last_active":"2024-04-25T22:45:22.342484+0000","last_peered":"2024-04-25T22:45:22.342484+0000","last_clean":"2024-04-25T22:45:22.342484+0000","last_became_active":"2024-04-25T22:44:41.413570+0000","last_became_peered":"2024-04-25T22:44:41.413570+0000","last_unstale":"2024-04-25T22:45:22.342484+0000","last_undegraded":"2024-04-25T22:45:22.342484+0000","last_fullsized":"2024-04-25T22:45:22.342484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'393","last_scrub_stamp":"2024-04-25T22:45:22.342226+0000","last_deep_scrub":"72'393","last_deep_scrub_stamp":"2024-04-25T22:45:22.342226+0000","last_clean_scrub_stamp":"2024-04-25T22:45:22.342226+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:15:44.431501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":28076,"num_write":364,"num_write_kb":47473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"72'399","reported_seq":1002,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:33.092417+0000","last_change":"2024-04-25T22:45:33.092562+0000","last_active":"2024-04-25T22:45:33.092417+0000","last_peered":"2024-04-25T22:45:33.092417+0000","last_clean":"2024-04-25T22:45:33.092417+0000","last_became_active":"2024-04-25T22:44:40.121838+0000","last_became_peered":"2024-04-25T22:44:40.121838+0000","last_unstale":"2024-04-25T22:45:33.092417+0000","last_undegraded":"2024-04-25T22:45:33.092417+0000","last_fullsized":"2024-04-25T22:45:33.092417+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'399","last_scrub_stamp":"2024-04-25T22:45:33.092179+0000","last_deep_scrub":"72'399","last_deep_scrub_stamp":"2024-04-25T22:45:33.092179+0000","last_clean_scrub_stamp":"2024-04-25T22:45:33.092179+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:01:19.694306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14005,"num_write":367,"num_write_kb":58883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"72'484","reported_seq":692,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:09.121900+0000","last_change":"2024-04-25T22:45:09.121967+0000","last_active":"2024-04-25T22:45:09.121900+0000","last_peered":"2024-04-25T22:45:09.121900+0000","last_clean":"2024-04-25T22:45:09.121900+0000","last_became_active":"2024-04-25T22:44:54.383808+0000","last_became_peered":"2024-04-25T22:44:54.383808+0000","last_unstale":"2024-04-25T22:45:09.121900+0000","last_undegraded":"2024-04-25T22:45:09.121900+0000","last_fullsized":"2024-04-25T22:45:09.121900+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'484","last_scrub_stamp":"2024-04-25T22:45:09.121700+0000","last_deep_scrub":"72'484","last_deep_scrub_stamp":"2024-04-25T22:45:09.121700+0000","last_clean_scrub_stamp":"2024-04-25T22:45:09.121700+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:05:39.991100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":23352,"num_write":446,"num_write_kb":100094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"72'455","reported_seq":1145,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:22.025109+0000","last_change":"2024-04-25T22:45:22.025174+0000","last_active":"2024-04-25T22:45:22.025109+0000","last_peered":"2024-04-25T22:45:22.025109+0000","last_clean":"2024-04-25T22:45:22.025109+0000","last_became_active":"2024-04-25T22:44:33.084127+0000","last_became_peered":"2024-04-25T22:44:33.084127+0000","last_unstale":"2024-04-25T22:45:22.025109+0000","last_undegraded":"2024-04-25T22:45:22.025109+0000","last_fullsized":"2024-04-25T22:45:22.025109+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'455","last_scrub_stamp":"2024-04-25T22:45:22.024900+0000","last_deep_scrub":"72'455","last_deep_scrub_stamp":"2024-04-25T22:45:22.024900+0000","last_clean_scrub_stamp":"2024-04-25T22:45:22.024900+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:11:33.397396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":38440,"num_write":423,"num_write_kb":71855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"72'434","reported_seq":677,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:26.746381+0000","last_change":"2024-04-25T22:45:26.746443+0000","last_active":"2024-04-25T22:45:26.746381+0000","last_peered":"2024-04-25T22:45:26.746381+0000","last_clean":"2024-04-25T22:45:26.746381+0000","last_became_active":"2024-04-25T22:40:14.621543+0000","last_became_peered":"2024-04-25T22:40:14.621543+0000","last_unstale":"2024-04-25T22:45:26.746381+0000","last_undegraded":"2024-04-25T22:45:26.746381+0000","last_fullsized":"2024-04-25T22:45:26.746381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'434","last_scrub_stamp":"2024-04-25T22:45:26.746183+0000","last_deep_scrub":"72'434","last_deep_scrub_stamp":"2024-04-25T22:45:26.746183+0000","last_clean_scrub_stamp":"2024-04-25T22:45:26.746183+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:39:41.486526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18701,"num_write":402,"num_write_kb":27564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"72'379","reported_seq":535,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:10.161130+0000","last_change":"2024-04-25T22:45:10.161189+0000","last_active":"2024-04-25T22:45:10.161130+0000","last_peered":"2024-04-25T22:45:10.161130+0000","last_clean":"2024-04-25T22:45:10.161130+0000","last_became_active":"2024-04-25T22:44:53.378402+0000","last_became_peered":"2024-04-25T22:44:53.378402+0000","last_unstale":"2024-04-25T22:45:10.161130+0000","last_undegraded":"2024-04-25T22:45:10.161130+0000","last_fullsized":"2024-04-25T22:45:10.161130+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'379","last_scrub_stamp":"2024-04-25T22:45:10.160926+0000","last_deep_scrub":"72'379","last_deep_scrub_stamp":"2024-04-25T22:45:10.160926+0000","last_clean_scrub_stamp":"2024-04-25T22:45:10.160926+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:05:12.549495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18623,"num_write":344,"num_write_kb":50888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"113'532","reported_seq":744,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:36.694683+0000","last_change":"2024-04-25T22:45:36.694811+0000","last_active":"2024-04-25T22:45:36.694683+0000","last_peered":"2024-04-25T22:45:36.694683+0000","last_clean":"2024-04-25T22:45:36.694683+0000","last_became_active":"2024-04-25T22:40:13.593622+0000","last_became_peered":"2024-04-25T22:40:13.593622+0000","last_unstale":"2024-04-25T22:45:36.694683+0000","last_undegraded":"2024-04-25T22:45:36.694683+0000","last_fullsized":"2024-04-25T22:45:36.694683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'532","last_scrub_stamp":"2024-04-25T22:45:36.694455+0000","last_deep_scrub":"113'532","last_deep_scrub_stamp":"2024-04-25T22:45:36.694455+0000","last_clean_scrub_stamp":"2024-04-25T22:45:36.694455+0000","objects_scrubbed":4,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:00:14.642429+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"72'383","reported_seq":512,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:40.566326+0000","last_change":"2024-04-25T22:45:40.566410+0000","last_active":"2024-04-25T22:45:40.566326+0000","last_peered":"2024-04-25T22:45:40.566326+0000","last_clean":"2024-04-25T22:45:40.566326+0000","last_became_active":"2024-04-25T22:44:58.380203+0000","last_became_peered":"2024-04-25T22:44:58.380203+0000","last_unstale":"2024-04-25T22:45:40.566326+0000","last_undegraded":"2024-04-25T22:45:40.566326+0000","last_fullsized":"2024-04-25T22:45:40.566326+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'383","last_scrub_stamp":"2024-04-25T22:45:40.566118+0000","last_deep_scrub":"72'383","last_deep_scrub_stamp":"2024-04-25T22:45:40.566118+0000","last_clean_scrub_stamp":"2024-04-25T22:45:40.566118+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:12.503898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8364,"num_write":351,"num_write_kb":30625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"71'45","reported_seq":210,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:20.013456+0000","last_change":"2024-04-25T22:45:20.013520+0000","last_active":"2024-04-25T22:45:20.013456+0000","last_peered":"2024-04-25T22:45:20.013456+0000","last_clean":"2024-04-25T22:45:20.013456+0000","last_became_active":"2024-04-25T22:44:39.115669+0000","last_became_peered":"2024-04-25T22:44:39.115669+0000","last_unstale":"2024-04-25T22:45:20.013456+0000","last_undegraded":"2024-04-25T22:45:20.013456+0000","last_fullsized":"2024-04-25T22:45:20.013456+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'45","last_scrub_stamp":"2024-04-25T22:45:20.013252+0000","last_deep_scrub":"71'45","last_deep_scrub_stamp":"2024-04-25T22:45:20.013252+0000","last_clean_scrub_stamp":"2024-04-25T22:45:20.013252+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:07.692493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"72'429","reported_seq":580,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:41.606978+0000","last_change":"2024-04-25T22:45:41.607034+0000","last_active":"2024-04-25T22:45:41.606978+0000","last_peered":"2024-04-25T22:45:41.606978+0000","last_clean":"2024-04-25T22:45:41.606978+0000","last_became_active":"2024-04-25T22:44:58.382521+0000","last_became_peered":"2024-04-25T22:44:58.382521+0000","last_unstale":"2024-04-25T22:45:41.606978+0000","last_undegraded":"2024-04-25T22:45:41.606978+0000","last_fullsized":"2024-04-25T22:45:41.606978+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'429","last_scrub_stamp":"2024-04-25T22:45:41.606779+0000","last_deep_scrub":"72'429","last_deep_scrub_stamp":"2024-04-25T22:45:41.606779+0000","last_clean_scrub_stamp":"2024-04-25T22:45:41.606779+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:12:22.746156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":16584,"num_write":393,"num_write_kb":63712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"71'61","reported_seq":98,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:28.411110+0000","last_change":"2024-04-25T22:45:28.411168+0000","last_active":"2024-04-25T22:45:28.411110+0000","last_peered":"2024-04-25T22:45:28.411110+0000","last_clean":"2024-04-25T22:45:28.411110+0000","last_became_active":"2024-04-25T22:44:41.413853+0000","last_became_peered":"2024-04-25T22:44:41.413853+0000","last_unstale":"2024-04-25T22:45:28.411110+0000","last_undegraded":"2024-04-25T22:45:28.411110+0000","last_fullsized":"2024-04-25T22:45:28.411110+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'61","last_scrub_stamp":"2024-04-25T22:45:28.410912+0000","last_deep_scrub":"71'61","last_deep_scrub_stamp":"2024-04-25T22:45:28.410912+0000","last_clean_scrub_stamp":"2024-04-25T22:45:28.410912+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:11.522079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"72'404","reported_seq":634,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:17.985216+0000","last_change":"2024-04-25T22:45:17.985339+0000","last_active":"2024-04-25T22:45:17.985216+0000","last_peered":"2024-04-25T22:45:17.985216+0000","last_clean":"2024-04-25T22:45:17.985216+0000","last_became_active":"2024-04-25T22:44:39.116562+0000","last_became_peered":"2024-04-25T22:44:39.116562+0000","last_unstale":"2024-04-25T22:45:17.985216+0000","last_undegraded":"2024-04-25T22:45:17.985216+0000","last_fullsized":"2024-04-25T22:45:17.985216+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'404","last_scrub_stamp":"2024-04-25T22:45:17.984989+0000","last_deep_scrub":"72'404","last_deep_scrub_stamp":"2024-04-25T22:45:17.984989+0000","last_clean_scrub_stamp":"2024-04-25T22:45:17.984989+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:47.522405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18745,"num_write":376,"num_write_kb":96145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"113'75","reported_seq":295,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:10.869816+0000","last_change":"2024-04-25T22:45:10.869885+0000","last_active":"2024-04-25T22:45:10.869816+0000","last_peered":"2024-04-25T22:45:10.869816+0000","last_clean":"2024-04-25T22:45:10.869816+0000","last_became_active":"2024-04-25T22:44:26.362499+0000","last_became_peered":"2024-04-25T22:44:26.362499+0000","last_unstale":"2024-04-25T22:45:10.869816+0000","last_undegraded":"2024-04-25T22:45:10.869816+0000","last_fullsized":"2024-04-25T22:45:10.869816+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'75","last_scrub_stamp":"2024-04-25T22:45:10.869595+0000","last_deep_scrub":"113'75","last_deep_scrub_stamp":"2024-04-25T22:45:10.869595+0000","last_clean_scrub_stamp":"2024-04-25T22:45:10.869595+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:39:00.404286+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"113'147","reported_seq":373,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:08.894101+0000","last_change":"2024-04-25T22:45:08.894163+0000","last_active":"2024-04-25T22:45:08.894101+0000","last_peered":"2024-04-25T22:45:08.894101+0000","last_clean":"2024-04-25T22:45:08.894101+0000","last_became_active":"2024-04-25T22:44:29.399853+0000","last_became_peered":"2024-04-25T22:44:29.399853+0000","last_unstale":"2024-04-25T22:45:08.894101+0000","last_undegraded":"2024-04-25T22:45:08.894101+0000","last_fullsized":"2024-04-25T22:45:08.894101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'147","last_scrub_stamp":"2024-04-25T22:45:08.893921+0000","last_deep_scrub":"113'147","last_deep_scrub_stamp":"2024-04-25T22:45:08.893921+0000","last_clean_scrub_stamp":"2024-04-25T22:45:08.893921+0000","objects_scrubbed":2,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:20:56.976041+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"72'399","reported_seq":614,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:13.230823+0000","last_change":"2024-04-25T22:45:13.230879+0000","last_active":"2024-04-25T22:45:13.230823+0000","last_peered":"2024-04-25T22:45:13.230823+0000","last_clean":"2024-04-25T22:45:13.230823+0000","last_became_active":"2024-04-25T22:44:46.392604+0000","last_became_peered":"2024-04-25T22:44:46.392604+0000","last_unstale":"2024-04-25T22:45:13.230823+0000","last_undegraded":"2024-04-25T22:45:13.230823+0000","last_fullsized":"2024-04-25T22:45:13.230823+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'399","last_scrub_stamp":"2024-04-25T22:45:13.230628+0000","last_deep_scrub":"72'399","last_deep_scrub_stamp":"2024-04-25T22:45:13.230628+0000","last_clean_scrub_stamp":"2024-04-25T22:45:13.230628+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:59:41.103570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":25159,"num_write":363,"num_write_kb":34063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"113'228","reported_seq":443,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:31.484579+0000","last_change":"2024-04-25T22:45:31.484644+0000","last_active":"2024-04-25T22:45:31.484579+0000","last_peered":"2024-04-25T22:45:31.484579+0000","last_clean":"2024-04-25T22:45:31.484579+0000","last_became_active":"2024-04-25T22:44:41.416542+0000","last_became_peered":"2024-04-25T22:44:41.416542+0000","last_unstale":"2024-04-25T22:45:31.484579+0000","last_undegraded":"2024-04-25T22:45:31.484579+0000","last_fullsized":"2024-04-25T22:45:31.484579+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'228","last_scrub_stamp":"2024-04-25T22:45:31.484386+0000","last_deep_scrub":"113'228","last_deep_scrub_stamp":"2024-04-25T22:45:31.484386+0000","last_clean_scrub_stamp":"2024-04-25T22:45:31.484386+0000","objects_scrubbed":2,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:14:21.634483+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"72'431","reported_seq":587,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:37.492484+0000","last_change":"2024-04-25T22:45:37.492546+0000","last_active":"2024-04-25T22:45:37.492484+0000","last_peered":"2024-04-25T22:45:37.492484+0000","last_clean":"2024-04-25T22:45:37.492484+0000","last_became_active":"2024-04-25T22:44:56.412151+0000","last_became_peered":"2024-04-25T22:44:56.412151+0000","last_unstale":"2024-04-25T22:45:37.492484+0000","last_undegraded":"2024-04-25T22:45:37.492484+0000","last_fullsized":"2024-04-25T22:45:37.492484+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'431","last_scrub_stamp":"2024-04-25T22:45:37.492281+0000","last_deep_scrub":"72'431","last_deep_scrub_stamp":"2024-04-25T22:45:37.492281+0000","last_clean_scrub_stamp":"2024-04-25T22:45:37.492281+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:23:59.501837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14688,"num_write":405,"num_write_kb":38957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"113'384","reported_seq":610,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:07.894276+0000","last_change":"2024-04-25T22:45:07.894340+0000","last_active":"2024-04-25T22:45:07.894276+0000","last_peered":"2024-04-25T22:45:07.894276+0000","last_clean":"2024-04-25T22:45:07.894276+0000","last_became_active":"2024-04-25T22:44:30.401021+0000","last_became_peered":"2024-04-25T22:44:30.401021+0000","last_unstale":"2024-04-25T22:45:07.894276+0000","last_undegraded":"2024-04-25T22:45:07.894276+0000","last_fullsized":"2024-04-25T22:45:07.894276+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'384","last_scrub_stamp":"2024-04-25T22:45:07.894090+0000","last_deep_scrub":"113'384","last_deep_scrub_stamp":"2024-04-25T22:45:07.894090+0000","last_clean_scrub_stamp":"2024-04-25T22:45:07.894090+0000","objects_scrubbed":2,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:37:27.144873+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"72'453","reported_seq":694,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:14.778720+0000","last_change":"2024-04-25T22:45:14.778798+0000","last_active":"2024-04-25T22:45:14.778720+0000","last_peered":"2024-04-25T22:45:14.778720+0000","last_clean":"2024-04-25T22:45:14.778720+0000","last_became_active":"2024-04-25T22:40:14.628606+0000","last_became_peered":"2024-04-25T22:40:14.628606+0000","last_unstale":"2024-04-25T22:45:14.778720+0000","last_undegraded":"2024-04-25T22:45:14.778720+0000","last_fullsized":"2024-04-25T22:45:14.778720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'453","last_scrub_stamp":"2024-04-25T22:45:14.778468+0000","last_deep_scrub":"72'453","last_deep_scrub_stamp":"2024-04-25T22:45:14.778468+0000","last_clean_scrub_stamp":"2024-04-25T22:45:14.778468+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:11:13.757693+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18900,"num_write":418,"num_write_kb":117500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"71'64","reported_seq":276,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:34.688776+0000","last_change":"2024-04-25T22:45:34.688837+0000","last_active":"2024-04-25T22:45:34.688776+0000","last_peered":"2024-04-25T22:45:34.688776+0000","last_clean":"2024-04-25T22:45:34.688776+0000","last_became_active":"2024-04-25T22:40:13.592427+0000","last_became_peered":"2024-04-25T22:40:13.592427+0000","last_unstale":"2024-04-25T22:45:34.688776+0000","last_undegraded":"2024-04-25T22:45:34.688776+0000","last_fullsized":"2024-04-25T22:45:34.688776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'64","last_scrub_stamp":"2024-04-25T22:45:34.688575+0000","last_deep_scrub":"71'64","last_deep_scrub_stamp":"2024-04-25T22:45:34.688575+0000","last_clean_scrub_stamp":"2024-04-25T22:45:34.688575+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:30.351068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"72'428","reported_seq":640,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:15.954382+0000","last_change":"2024-04-25T22:45:15.954444+0000","last_active":"2024-04-25T22:45:15.954382+0000","last_peered":"2024-04-25T22:45:15.954382+0000","last_clean":"2024-04-25T22:45:15.954382+0000","last_became_active":"2024-04-25T22:44:39.121205+0000","last_became_peered":"2024-04-25T22:44:39.121205+0000","last_unstale":"2024-04-25T22:45:15.954382+0000","last_undegraded":"2024-04-25T22:45:15.954382+0000","last_fullsized":"2024-04-25T22:45:15.954382+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'428","last_scrub_stamp":"2024-04-25T22:45:15.954178+0000","last_deep_scrub":"72'428","last_deep_scrub_stamp":"2024-04-25T22:45:15.954178+0000","last_clean_scrub_stamp":"2024-04-25T22:45:15.954178+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:43:04.938222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":7477,"num_write":383,"num_write_kb":9617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"113'169","reported_seq":334,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:09.956160+0000","last_change":"2024-04-25T22:45:09.956324+0000","last_active":"2024-04-25T22:45:09.956160+0000","last_peered":"2024-04-25T22:45:09.956160+0000","last_clean":"2024-04-25T22:45:09.956160+0000","last_became_active":"2024-04-25T22:44:39.131489+0000","last_became_peered":"2024-04-25T22:44:39.131489+0000","last_unstale":"2024-04-25T22:45:09.956160+0000","last_undegraded":"2024-04-25T22:45:09.956160+0000","last_fullsized":"2024-04-25T22:45:09.956160+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'169","last_scrub_stamp":"2024-04-25T22:45:09.955944+0000","last_deep_scrub":"113'169","last_deep_scrub_stamp":"2024-04-25T22:45:09.955944+0000","last_clean_scrub_stamp":"2024-04-25T22:45:09.955944+0000","objects_scrubbed":3,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.893227+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"72'446","reported_seq":705,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:24.769694+0000","last_change":"2024-04-25T22:45:24.769754+0000","last_active":"2024-04-25T22:45:24.769694+0000","last_peered":"2024-04-25T22:45:24.769694+0000","last_clean":"2024-04-25T22:45:24.769694+0000","last_became_active":"2024-04-25T22:40:14.622504+0000","last_became_peered":"2024-04-25T22:40:14.622504+0000","last_unstale":"2024-04-25T22:45:24.769694+0000","last_undegraded":"2024-04-25T22:45:24.769694+0000","last_fullsized":"2024-04-25T22:45:24.769694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'446","last_scrub_stamp":"2024-04-25T22:45:24.769498+0000","last_deep_scrub":"72'446","last_deep_scrub_stamp":"2024-04-25T22:45:24.769498+0000","last_clean_scrub_stamp":"2024-04-25T22:45:24.769498+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:58.868653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27788,"num_write":414,"num_write_kb":47058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"113'114","reported_seq":326,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:31.708141+0000","last_change":"2024-04-25T22:45:31.708209+0000","last_active":"2024-04-25T22:45:31.708141+0000","last_peered":"2024-04-25T22:45:31.708141+0000","last_clean":"2024-04-25T22:45:31.708141+0000","last_became_active":"2024-04-25T22:40:13.592377+0000","last_became_peered":"2024-04-25T22:40:13.592377+0000","last_unstale":"2024-04-25T22:45:31.708141+0000","last_undegraded":"2024-04-25T22:45:31.708141+0000","last_fullsized":"2024-04-25T22:45:31.708141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'114","last_scrub_stamp":"2024-04-25T22:45:31.707926+0000","last_deep_scrub":"113'114","last_deep_scrub_stamp":"2024-04-25T22:45:31.707926+0000","last_clean_scrub_stamp":"2024-04-25T22:45:31.707926+0000","objects_scrubbed":1,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:31.347417+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"72'417","reported_seq":1028,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:44.536827+0000","last_change":"2024-04-25T22:45:44.536890+0000","last_active":"2024-04-25T22:45:44.536827+0000","last_peered":"2024-04-25T22:45:44.536827+0000","last_clean":"2024-04-25T22:45:44.536827+0000","last_became_active":"2024-04-25T22:44:44.108084+0000","last_became_peered":"2024-04-25T22:44:44.108084+0000","last_unstale":"2024-04-25T22:45:44.536827+0000","last_undegraded":"2024-04-25T22:45:44.536827+0000","last_fullsized":"2024-04-25T22:45:44.536827+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'417","last_scrub_stamp":"2024-04-25T22:45:44.536628+0000","last_deep_scrub":"72'417","last_deep_scrub_stamp":"2024-04-25T22:45:44.536628+0000","last_clean_scrub_stamp":"2024-04-25T22:45:44.536628+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:55:29.985796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16487,"num_write":388,"num_write_kb":75452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"71'59","reported_seq":98,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:30.473680+0000","last_change":"2024-04-25T22:45:30.473742+0000","last_active":"2024-04-25T22:45:30.473680+0000","last_peered":"2024-04-25T22:45:30.473680+0000","last_clean":"2024-04-25T22:45:30.473680+0000","last_became_active":"2024-04-25T22:44:41.415769+0000","last_became_peered":"2024-04-25T22:44:41.415769+0000","last_unstale":"2024-04-25T22:45:30.473680+0000","last_undegraded":"2024-04-25T22:45:30.473680+0000","last_fullsized":"2024-04-25T22:45:30.473680+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'59","last_scrub_stamp":"2024-04-25T22:45:30.473473+0000","last_deep_scrub":"71'59","last_deep_scrub_stamp":"2024-04-25T22:45:30.473473+0000","last_clean_scrub_stamp":"2024-04-25T22:45:30.473473+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:02:41.136885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"72'358","reported_seq":909,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:38.632778+0000","last_change":"2024-04-25T22:45:38.632839+0000","last_active":"2024-04-25T22:45:38.632778+0000","last_peered":"2024-04-25T22:45:38.632778+0000","last_clean":"2024-04-25T22:45:38.632778+0000","last_became_active":"2024-04-25T22:44:34.099595+0000","last_became_peered":"2024-04-25T22:44:34.099595+0000","last_unstale":"2024-04-25T22:45:38.632778+0000","last_undegraded":"2024-04-25T22:45:38.632778+0000","last_fullsized":"2024-04-25T22:45:38.632778+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'358","last_scrub_stamp":"2024-04-25T22:45:38.632578+0000","last_deep_scrub":"72'358","last_deep_scrub_stamp":"2024-04-25T22:45:38.632578+0000","last_clean_scrub_stamp":"2024-04-25T22:45:38.632578+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:48:22.859265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12259,"num_write":325,"num_write_kb":62738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"113'466","reported_seq":644,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:24.365511+0000","last_change":"2024-04-25T22:45:24.365573+0000","last_active":"2024-04-25T22:45:24.365511+0000","last_peered":"2024-04-25T22:45:24.365511+0000","last_clean":"2024-04-25T22:45:24.365511+0000","last_became_active":"2024-04-25T22:44:41.423799+0000","last_became_peered":"2024-04-25T22:44:41.423799+0000","last_unstale":"2024-04-25T22:45:24.365511+0000","last_undegraded":"2024-04-25T22:45:24.365511+0000","last_fullsized":"2024-04-25T22:45:24.365511+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'466","last_scrub_stamp":"2024-04-25T22:45:24.365286+0000","last_deep_scrub":"113'466","last_deep_scrub_stamp":"2024-04-25T22:45:24.365286+0000","last_clean_scrub_stamp":"2024-04-25T22:45:24.365286+0000","objects_scrubbed":1,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:44:37.132110+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"72'386","reported_seq":964,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:38.141751+0000","last_change":"2024-04-25T22:45:38.141815+0000","last_active":"2024-04-25T22:45:38.141751+0000","last_peered":"2024-04-25T22:45:38.141751+0000","last_clean":"2024-04-25T22:45:38.141751+0000","last_became_active":"2024-04-25T22:44:46.110394+0000","last_became_peered":"2024-04-25T22:44:46.110394+0000","last_unstale":"2024-04-25T22:45:38.141751+0000","last_undegraded":"2024-04-25T22:45:38.141751+0000","last_fullsized":"2024-04-25T22:45:38.141751+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'386","last_scrub_stamp":"2024-04-25T22:45:38.141551+0000","last_deep_scrub":"72'386","last_deep_scrub_stamp":"2024-04-25T22:45:38.141551+0000","last_clean_scrub_stamp":"2024-04-25T22:45:38.141551+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:01:32.625577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9402,"num_write":352,"num_write_kb":50548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"113'159","reported_seq":430,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:37.679542+0000","last_change":"2024-04-25T22:45:37.679542+0000","last_active":"2024-04-25T22:45:37.679542+0000","last_peered":"2024-04-25T22:45:37.679542+0000","last_clean":"2024-04-25T22:45:37.679542+0000","last_became_active":"2024-04-25T22:44:26.354730+0000","last_became_peered":"2024-04-25T22:44:26.354730+0000","last_unstale":"2024-04-25T22:45:37.679542+0000","last_undegraded":"2024-04-25T22:45:37.679542+0000","last_fullsized":"2024-04-25T22:45:37.679542+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'159","last_scrub_stamp":"2024-04-25T22:45:37.679273+0000","last_deep_scrub":"113'159","last_deep_scrub_stamp":"2024-04-25T22:45:37.679273+0000","last_clean_scrub_stamp":"2024-04-25T22:45:37.679273+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:14:20.519502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":218,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:29.702819+0000","last_change":"2024-04-25T22:45:29.702870+0000","last_active":"2024-04-25T22:45:29.702819+0000","last_peered":"2024-04-25T22:45:29.702819+0000","last_clean":"2024-04-25T22:45:29.702819+0000","last_became_active":"2024-04-25T22:40:09.491343+0000","last_became_peered":"2024-04-25T22:40:09.491343+0000","last_unstale":"2024-04-25T22:45:29.702819+0000","last_undegraded":"2024-04-25T22:45:29.702819+0000","last_fullsized":"2024-04-25T22:45:29.702819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:45:29.702624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:45:29.702624+0000","last_clean_scrub_stamp":"2024-04-25T22:45:29.702624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:16:51.022963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"113'459","reported_seq":687,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:31.148021+0000","last_change":"2024-04-25T22:45:31.148157+0000","last_active":"2024-04-25T22:45:31.148021+0000","last_peered":"2024-04-25T22:45:31.148021+0000","last_clean":"2024-04-25T22:45:31.148021+0000","last_became_active":"2024-04-25T22:44:29.397962+0000","last_became_peered":"2024-04-25T22:44:29.397962+0000","last_unstale":"2024-04-25T22:45:31.148021+0000","last_undegraded":"2024-04-25T22:45:31.148021+0000","last_fullsized":"2024-04-25T22:45:31.148021+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'459","last_scrub_stamp":"2024-04-25T22:45:31.147804+0000","last_deep_scrub":"113'459","last_deep_scrub_stamp":"2024-04-25T22:45:31.147804+0000","last_clean_scrub_stamp":"2024-04-25T22:45:31.147804+0000","objects_scrubbed":2,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:16:52.468142+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"72'447","reported_seq":1120,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:43.580880+0000","last_change":"2024-04-25T22:45:43.580941+0000","last_active":"2024-04-25T22:45:43.580880+0000","last_peered":"2024-04-25T22:45:43.580880+0000","last_clean":"2024-04-25T22:45:43.580880+0000","last_became_active":"2024-04-25T22:44:43.105231+0000","last_became_peered":"2024-04-25T22:44:43.105231+0000","last_unstale":"2024-04-25T22:45:43.580880+0000","last_undegraded":"2024-04-25T22:45:43.580880+0000","last_fullsized":"2024-04-25T22:45:43.580880+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'447","last_scrub_stamp":"2024-04-25T22:45:43.580681+0000","last_deep_scrub":"72'447","last_deep_scrub_stamp":"2024-04-25T22:45:43.580681+0000","last_clean_scrub_stamp":"2024-04-25T22:45:43.580681+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:39:42.427743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45074,"num_write":414,"num_write_kb":120596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":225,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:27.722696+0000","last_change":"2024-04-25T22:45:27.722813+0000","last_active":"2024-04-25T22:45:27.722696+0000","last_peered":"2024-04-25T22:45:27.722696+0000","last_clean":"2024-04-25T22:45:27.722696+0000","last_became_active":"2024-04-25T22:44:26.354482+0000","last_became_peered":"2024-04-25T22:44:26.354482+0000","last_unstale":"2024-04-25T22:45:27.722696+0000","last_undegraded":"2024-04-25T22:45:27.722696+0000","last_fullsized":"2024-04-25T22:45:27.722696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:45:27.722446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:45:27.722446+0000","last_clean_scrub_stamp":"2024-04-25T22:45:27.722446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:05:41.441994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"113'123","reported_seq":350,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:14.969914+0000","last_change":"2024-04-25T22:45:14.969982+0000","last_active":"2024-04-25T22:45:14.969914+0000","last_peered":"2024-04-25T22:45:14.969914+0000","last_clean":"2024-04-25T22:45:14.969914+0000","last_became_active":"2024-04-25T22:44:39.139689+0000","last_became_peered":"2024-04-25T22:44:39.139689+0000","last_unstale":"2024-04-25T22:45:14.969914+0000","last_undegraded":"2024-04-25T22:45:14.969914+0000","last_fullsized":"2024-04-25T22:45:14.969914+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'123","last_scrub_stamp":"2024-04-25T22:45:14.969730+0000","last_deep_scrub":"113'123","last_deep_scrub_stamp":"2024-04-25T22:45:14.969730+0000","last_clean_scrub_stamp":"2024-04-25T22:45:14.969730+0000","objects_scrubbed":1,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:03:32.133354+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1463086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":62,"num_write_kb":1469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"72'449","reported_seq":661,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:11.145433+0000","last_change":"2024-04-25T22:45:11.145558+0000","last_active":"2024-04-25T22:45:11.145433+0000","last_peered":"2024-04-25T22:45:11.145433+0000","last_clean":"2024-04-25T22:45:11.145433+0000","last_became_active":"2024-04-25T22:44:41.432785+0000","last_became_peered":"2024-04-25T22:44:41.432785+0000","last_unstale":"2024-04-25T22:45:11.145433+0000","last_undegraded":"2024-04-25T22:45:11.145433+0000","last_fullsized":"2024-04-25T22:45:11.145433+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'449","last_scrub_stamp":"2024-04-25T22:45:11.145126+0000","last_deep_scrub":"72'449","last_deep_scrub_stamp":"2024-04-25T22:45:11.145126+0000","last_clean_scrub_stamp":"2024-04-25T22:45:11.145126+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:37:18.105492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25191,"num_write":420,"num_write_kb":79855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":226,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:26.074435+0000","last_change":"2024-04-25T22:45:26.074490+0000","last_active":"2024-04-25T22:45:26.074435+0000","last_peered":"2024-04-25T22:45:26.074435+0000","last_clean":"2024-04-25T22:45:26.074435+0000","last_became_active":"2024-04-25T22:44:26.362808+0000","last_became_peered":"2024-04-25T22:44:26.362808+0000","last_unstale":"2024-04-25T22:45:26.074435+0000","last_undegraded":"2024-04-25T22:45:26.074435+0000","last_fullsized":"2024-04-25T22:45:26.074435+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:45:26.074197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:45:26.074197+0000","last_clean_scrub_stamp":"2024-04-25T22:45:26.074197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:14.430400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"113'437","reported_seq":641,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:29.458395+0000","last_change":"2024-04-25T22:45:29.458471+0000","last_active":"2024-04-25T22:45:29.458395+0000","last_peered":"2024-04-25T22:45:29.458395+0000","last_clean":"2024-04-25T22:45:29.458395+0000","last_became_active":"2024-04-25T22:44:41.415592+0000","last_became_peered":"2024-04-25T22:44:41.415592+0000","last_unstale":"2024-04-25T22:45:29.458395+0000","last_undegraded":"2024-04-25T22:45:29.458395+0000","last_fullsized":"2024-04-25T22:45:29.458395+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'437","last_scrub_stamp":"2024-04-25T22:45:29.458160+0000","last_deep_scrub":"113'437","last_deep_scrub_stamp":"2024-04-25T22:45:29.458160+0000","last_clean_scrub_stamp":"2024-04-25T22:45:29.458160+0000","objects_scrubbed":2,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:47:59.960078+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":8349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"72'337","reported_seq":897,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:37.175785+0000","last_change":"2024-04-25T22:45:37.175914+0000","last_active":"2024-04-25T22:45:37.175785+0000","last_peered":"2024-04-25T22:45:37.175785+0000","last_clean":"2024-04-25T22:45:37.175785+0000","last_became_active":"2024-04-25T22:44:45.111011+0000","last_became_peered":"2024-04-25T22:44:45.111011+0000","last_unstale":"2024-04-25T22:45:37.175785+0000","last_undegraded":"2024-04-25T22:45:37.175785+0000","last_fullsized":"2024-04-25T22:45:37.175785+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'337","last_scrub_stamp":"2024-04-25T22:45:37.175471+0000","last_deep_scrub":"72'337","last_deep_scrub_stamp":"2024-04-25T22:45:37.175471+0000","last_clean_scrub_stamp":"2024-04-25T22:45:37.175471+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:03:26.726443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25242,"num_write":307,"num_write_kb":26250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":218,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:30.685737+0000","last_change":"2024-04-25T22:45:30.685787+0000","last_active":"2024-04-25T22:45:30.685737+0000","last_peered":"2024-04-25T22:45:30.685737+0000","last_clean":"2024-04-25T22:45:30.685737+0000","last_became_active":"2024-04-25T22:40:09.491808+0000","last_became_peered":"2024-04-25T22:40:09.491808+0000","last_unstale":"2024-04-25T22:45:30.685737+0000","last_undegraded":"2024-04-25T22:45:30.685737+0000","last_fullsized":"2024-04-25T22:45:30.685737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:45:30.685539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:45:30.685539+0000","last_clean_scrub_stamp":"2024-04-25T22:45:30.685539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:20:23.948306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"71'61","reported_seq":273,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:35.646237+0000","last_change":"2024-04-25T22:45:35.646302+0000","last_active":"2024-04-25T22:45:35.646237+0000","last_peered":"2024-04-25T22:45:35.646237+0000","last_clean":"2024-04-25T22:45:35.646237+0000","last_became_active":"2024-04-25T22:40:13.592918+0000","last_became_peered":"2024-04-25T22:40:13.592918+0000","last_unstale":"2024-04-25T22:45:35.646237+0000","last_undegraded":"2024-04-25T22:45:35.646237+0000","last_fullsized":"2024-04-25T22:45:35.646237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'61","last_scrub_stamp":"2024-04-25T22:45:35.646032+0000","last_deep_scrub":"71'61","last_deep_scrub_stamp":"2024-04-25T22:45:35.646032+0000","last_clean_scrub_stamp":"2024-04-25T22:45:35.646032+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:32:59.650052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"72'404","reported_seq":1025,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:24.062050+0000","last_change":"2024-04-25T22:45:24.062112+0000","last_active":"2024-04-25T22:45:24.062050+0000","last_peered":"2024-04-25T22:45:24.062050+0000","last_clean":"2024-04-25T22:45:24.062050+0000","last_became_active":"2024-04-25T22:44:32.087528+0000","last_became_peered":"2024-04-25T22:44:32.087528+0000","last_unstale":"2024-04-25T22:45:24.062050+0000","last_undegraded":"2024-04-25T22:45:24.062050+0000","last_fullsized":"2024-04-25T22:45:24.062050+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'404","last_scrub_stamp":"2024-04-25T22:45:24.061853+0000","last_deep_scrub":"72'404","last_deep_scrub_stamp":"2024-04-25T22:45:24.061853+0000","last_clean_scrub_stamp":"2024-04-25T22:45:24.061853+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:44:54.575774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":20287,"num_write":371,"num_write_kb":59919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"113'286","reported_seq":498,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:28.726886+0000","last_change":"2024-04-25T22:45:28.726957+0000","last_active":"2024-04-25T22:45:28.726886+0000","last_peered":"2024-04-25T22:45:28.726886+0000","last_clean":"2024-04-25T22:45:28.726886+0000","last_became_active":"2024-04-25T22:40:13.591960+0000","last_became_peered":"2024-04-25T22:40:13.591960+0000","last_unstale":"2024-04-25T22:45:28.726886+0000","last_undegraded":"2024-04-25T22:45:28.726886+0000","last_fullsized":"2024-04-25T22:45:28.726886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'286","last_scrub_stamp":"2024-04-25T22:45:28.726678+0000","last_deep_scrub":"113'286","last_deep_scrub_stamp":"2024-04-25T22:45:28.726678+0000","last_clean_scrub_stamp":"2024-04-25T22:45:28.726678+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:29:13.032026+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":226,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:28.152388+0000","last_change":"2024-04-25T22:45:28.152491+0000","last_active":"2024-04-25T22:45:28.152388+0000","last_peered":"2024-04-25T22:45:28.152388+0000","last_clean":"2024-04-25T22:45:28.152388+0000","last_became_active":"2024-04-25T22:44:26.363583+0000","last_became_peered":"2024-04-25T22:44:26.363583+0000","last_unstale":"2024-04-25T22:45:28.152388+0000","last_undegraded":"2024-04-25T22:45:28.152388+0000","last_fullsized":"2024-04-25T22:45:28.152388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:45:28.152161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:45:28.152161+0000","last_clean_scrub_stamp":"2024-04-25T22:45:28.152161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:39:42.892504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"72'366","reported_seq":531,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:25.316368+0000","last_change":"2024-04-25T22:45:25.316427+0000","last_active":"2024-04-25T22:45:25.316368+0000","last_peered":"2024-04-25T22:45:25.316368+0000","last_clean":"2024-04-25T22:45:25.316368+0000","last_became_active":"2024-04-25T22:44:52.375504+0000","last_became_peered":"2024-04-25T22:44:52.375504+0000","last_unstale":"2024-04-25T22:45:25.316368+0000","last_undegraded":"2024-04-25T22:45:25.316368+0000","last_fullsized":"2024-04-25T22:45:25.316368+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'366","last_scrub_stamp":"2024-04-25T22:45:25.316164+0000","last_deep_scrub":"72'366","last_deep_scrub_stamp":"2024-04-25T22:45:25.316164+0000","last_clean_scrub_stamp":"2024-04-25T22:45:25.316164+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:41:34.723996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":346,"num_write":330,"num_write_kb":33934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"71'54","reported_seq":274,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:27.102658+0000","last_change":"2024-04-25T22:45:27.102718+0000","last_active":"2024-04-25T22:45:27.102658+0000","last_peered":"2024-04-25T22:45:27.102658+0000","last_clean":"2024-04-25T22:45:27.102658+0000","last_became_active":"2024-04-25T22:44:26.363455+0000","last_became_peered":"2024-04-25T22:44:26.363455+0000","last_unstale":"2024-04-25T22:45:27.102658+0000","last_undegraded":"2024-04-25T22:45:27.102658+0000","last_fullsized":"2024-04-25T22:45:27.102658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'54","last_scrub_stamp":"2024-04-25T22:45:27.102434+0000","last_deep_scrub":"71'54","last_deep_scrub_stamp":"2024-04-25T22:45:27.102434+0000","last_clean_scrub_stamp":"2024-04-25T22:45:27.102434+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:19:28.488893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:34.489591+0000","last_change":"2024-04-25T22:45:34.489705+0000","last_active":"2024-04-25T22:45:34.489591+0000","last_peered":"2024-04-25T22:45:34.489591+0000","last_clean":"2024-04-25T22:45:34.489591+0000","last_became_active":"2024-04-25T22:44:41.421194+0000","last_became_peered":"2024-04-25T22:44:41.421194+0000","last_unstale":"2024-04-25T22:45:34.489591+0000","last_undegraded":"2024-04-25T22:45:34.489591+0000","last_fullsized":"2024-04-25T22:45:34.489591+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:45:34.489371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:45:34.489371+0000","last_clean_scrub_stamp":"2024-04-25T22:45:34.489371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:28:48.322398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"72'413","reported_seq":636,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:17.151630+0000","last_change":"2024-04-25T22:45:17.151689+0000","last_active":"2024-04-25T22:45:17.151630+0000","last_peered":"2024-04-25T22:45:17.151630+0000","last_clean":"2024-04-25T22:45:17.151630+0000","last_became_active":"2024-04-25T22:44:48.372485+0000","last_became_peered":"2024-04-25T22:44:48.372485+0000","last_unstale":"2024-04-25T22:45:17.151630+0000","last_undegraded":"2024-04-25T22:45:17.151630+0000","last_fullsized":"2024-04-25T22:45:17.151630+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'413","last_scrub_stamp":"2024-04-25T22:45:17.151430+0000","last_deep_scrub":"72'413","last_deep_scrub_stamp":"2024-04-25T22:45:17.151430+0000","last_clean_scrub_stamp":"2024-04-25T22:45:17.151430+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:13.003612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22994,"num_write":377,"num_write_kb":63140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"113'58","reported_seq":279,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:29.143625+0000","last_change":"2024-04-25T22:45:29.143685+0000","last_active":"2024-04-25T22:45:29.143625+0000","last_peered":"2024-04-25T22:45:29.143625+0000","last_clean":"2024-04-25T22:45:29.143625+0000","last_became_active":"2024-04-25T22:44:26.365267+0000","last_became_peered":"2024-04-25T22:44:26.365267+0000","last_unstale":"2024-04-25T22:45:29.143625+0000","last_undegraded":"2024-04-25T22:45:29.143625+0000","last_fullsized":"2024-04-25T22:45:29.143625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'58","last_scrub_stamp":"2024-04-25T22:45:29.143459+0000","last_deep_scrub":"113'58","last_deep_scrub_stamp":"2024-04-25T22:45:29.143459+0000","last_clean_scrub_stamp":"2024-04-25T22:45:29.143459+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:05:42.863006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":226,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:25.095167+0000","last_change":"2024-04-25T22:45:25.095218+0000","last_active":"2024-04-25T22:45:25.095167+0000","last_peered":"2024-04-25T22:45:25.095167+0000","last_clean":"2024-04-25T22:45:25.095167+0000","last_became_active":"2024-04-25T22:44:26.360968+0000","last_became_peered":"2024-04-25T22:44:26.360968+0000","last_unstale":"2024-04-25T22:45:25.095167+0000","last_undegraded":"2024-04-25T22:45:25.095167+0000","last_fullsized":"2024-04-25T22:45:25.095167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:45:25.094979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:45:25.094979+0000","last_clean_scrub_stamp":"2024-04-25T22:45:25.094979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:42:13.492002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"72'398","reported_seq":608,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:11.946634+0000","last_change":"2024-04-25T22:45:11.946697+0000","last_active":"2024-04-25T22:45:11.946634+0000","last_peered":"2024-04-25T22:45:11.946634+0000","last_clean":"2024-04-25T22:45:11.946634+0000","last_became_active":"2024-04-25T22:44:39.124378+0000","last_became_peered":"2024-04-25T22:44:39.124378+0000","last_unstale":"2024-04-25T22:45:11.946634+0000","last_undegraded":"2024-04-25T22:45:11.946634+0000","last_fullsized":"2024-04-25T22:45:11.946634+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'398","last_scrub_stamp":"2024-04-25T22:45:11.946438+0000","last_deep_scrub":"72'398","last_deep_scrub_stamp":"2024-04-25T22:45:11.946438+0000","last_clean_scrub_stamp":"2024-04-25T22:45:11.946438+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:53:57.648591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6306,"num_write":372,"num_write_kb":34077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"113'101","reported_seq":316,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:21.055062+0000","last_change":"2024-04-25T22:45:21.055134+0000","last_active":"2024-04-25T22:45:21.055062+0000","last_peered":"2024-04-25T22:45:21.055062+0000","last_clean":"2024-04-25T22:45:21.055062+0000","last_became_active":"2024-04-25T22:44:39.147377+0000","last_became_peered":"2024-04-25T22:44:39.147377+0000","last_unstale":"2024-04-25T22:45:21.055062+0000","last_undegraded":"2024-04-25T22:45:21.055062+0000","last_fullsized":"2024-04-25T22:45:21.055062+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'101","last_scrub_stamp":"2024-04-25T22:45:21.054875+0000","last_deep_scrub":"113'101","last_deep_scrub_stamp":"2024-04-25T22:45:21.054875+0000","last_clean_scrub_stamp":"2024-04-25T22:45:21.054875+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:19:13.176608+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":225,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:12.826059+0000","last_change":"2024-04-25T22:45:12.826113+0000","last_active":"2024-04-25T22:45:12.826059+0000","last_peered":"2024-04-25T22:45:12.826059+0000","last_clean":"2024-04-25T22:45:12.826059+0000","last_became_active":"2024-04-25T22:44:26.360106+0000","last_became_peered":"2024-04-25T22:44:26.360106+0000","last_unstale":"2024-04-25T22:45:12.826059+0000","last_undegraded":"2024-04-25T22:45:12.826059+0000","last_fullsized":"2024-04-25T22:45:12.826059+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:45:12.825863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:45:12.825863+0000","last_clean_scrub_stamp":"2024-04-25T22:45:12.825863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:56.790968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"72'390","reported_seq":630,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:18.170108+0000","last_change":"2024-04-25T22:45:18.170169+0000","last_active":"2024-04-25T22:45:18.170108+0000","last_peered":"2024-04-25T22:45:18.170108+0000","last_clean":"2024-04-25T22:45:18.170108+0000","last_became_active":"2024-04-25T22:44:41.414924+0000","last_became_peered":"2024-04-25T22:44:41.414924+0000","last_unstale":"2024-04-25T22:45:18.170108+0000","last_undegraded":"2024-04-25T22:45:18.170108+0000","last_fullsized":"2024-04-25T22:45:18.170108+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'390","last_scrub_stamp":"2024-04-25T22:45:18.169909+0000","last_deep_scrub":"72'390","last_deep_scrub_stamp":"2024-04-25T22:45:18.169909+0000","last_clean_scrub_stamp":"2024-04-25T22:45:18.169909+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:40.114419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":22915,"num_write":352,"num_write_kb":47201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"72'411","reported_seq":1017,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:11.857384+0000","last_change":"2024-04-25T22:45:11.857443+0000","last_active":"2024-04-25T22:45:11.857384+0000","last_peered":"2024-04-25T22:45:11.857384+0000","last_clean":"2024-04-25T22:45:11.857384+0000","last_became_active":"2024-04-25T22:44:32.087303+0000","last_became_peered":"2024-04-25T22:44:32.087303+0000","last_unstale":"2024-04-25T22:45:11.857384+0000","last_undegraded":"2024-04-25T22:45:11.857384+0000","last_fullsized":"2024-04-25T22:45:11.857384+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'411","last_scrub_stamp":"2024-04-25T22:45:11.857179+0000","last_deep_scrub":"72'411","last_deep_scrub_stamp":"2024-04-25T22:45:11.857179+0000","last_clean_scrub_stamp":"2024-04-25T22:45:11.857179+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:57:15.380436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25412,"num_write":367,"num_write_kb":64656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"113'273","reported_seq":503,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:09.928187+0000","last_change":"2024-04-25T22:45:09.928318+0000","last_active":"2024-04-25T22:45:09.928187+0000","last_peered":"2024-04-25T22:45:09.928187+0000","last_clean":"2024-04-25T22:45:09.928187+0000","last_became_active":"2024-04-25T22:44:29.398317+0000","last_became_peered":"2024-04-25T22:44:29.398317+0000","last_unstale":"2024-04-25T22:45:09.928187+0000","last_undegraded":"2024-04-25T22:45:09.928187+0000","last_fullsized":"2024-04-25T22:45:09.928187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'273","last_scrub_stamp":"2024-04-25T22:45:09.927957+0000","last_deep_scrub":"113'273","last_deep_scrub_stamp":"2024-04-25T22:45:09.927957+0000","last_clean_scrub_stamp":"2024-04-25T22:45:09.927957+0000","objects_scrubbed":5,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:47:07.690999+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382817,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"72'423","reported_seq":1056,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:35.129639+0000","last_change":"2024-04-25T22:45:35.129702+0000","last_active":"2024-04-25T22:45:35.129639+0000","last_peered":"2024-04-25T22:45:35.129639+0000","last_clean":"2024-04-25T22:45:35.129639+0000","last_became_active":"2024-04-25T22:44:42.088432+0000","last_became_peered":"2024-04-25T22:44:42.088432+0000","last_unstale":"2024-04-25T22:45:35.129639+0000","last_undegraded":"2024-04-25T22:45:35.129639+0000","last_fullsized":"2024-04-25T22:45:35.129639+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'423","last_scrub_stamp":"2024-04-25T22:45:35.129446+0000","last_deep_scrub":"72'423","last_deep_scrub_stamp":"2024-04-25T22:45:35.129446+0000","last_clean_scrub_stamp":"2024-04-25T22:45:35.129446+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:21.042906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24794,"num_write":386,"num_write_kb":63756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"113'104","reported_seq":107,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:26.360387+0000","last_change":"2024-04-25T22:45:26.360454+0000","last_active":"2024-04-25T22:45:26.360387+0000","last_peered":"2024-04-25T22:45:26.360387+0000","last_clean":"2024-04-25T22:45:26.360387+0000","last_became_active":"2024-04-25T22:44:41.422237+0000","last_became_peered":"2024-04-25T22:44:41.422237+0000","last_unstale":"2024-04-25T22:45:26.360387+0000","last_undegraded":"2024-04-25T22:45:26.360387+0000","last_fullsized":"2024-04-25T22:45:26.360387+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'104","last_scrub_stamp":"2024-04-25T22:45:26.360186+0000","last_deep_scrub":"113'104","last_deep_scrub_stamp":"2024-04-25T22:45:26.360186+0000","last_clean_scrub_stamp":"2024-04-25T22:45:26.360186+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:53:23.386336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"113'214","reported_seq":426,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:32.702232+0000","last_change":"2024-04-25T22:45:32.702304+0000","last_active":"2024-04-25T22:45:32.702232+0000","last_peered":"2024-04-25T22:45:32.702232+0000","last_clean":"2024-04-25T22:45:32.702232+0000","last_became_active":"2024-04-25T22:40:13.592357+0000","last_became_peered":"2024-04-25T22:40:13.592357+0000","last_unstale":"2024-04-25T22:45:32.702232+0000","last_undegraded":"2024-04-25T22:45:32.702232+0000","last_fullsized":"2024-04-25T22:45:32.702232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'214","last_scrub_stamp":"2024-04-25T22:45:32.702047+0000","last_deep_scrub":"113'214","last_deep_scrub_stamp":"2024-04-25T22:45:32.702047+0000","last_clean_scrub_stamp":"2024-04-25T22:45:32.702047+0000","objects_scrubbed":1,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:35:11.425907+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"72'504","reported_seq":778,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:16.937256+0000","last_change":"2024-04-25T22:45:16.937314+0000","last_active":"2024-04-25T22:45:16.937256+0000","last_peered":"2024-04-25T22:45:16.937256+0000","last_clean":"2024-04-25T22:45:16.937256+0000","last_became_active":"2024-04-25T22:44:39.132582+0000","last_became_peered":"2024-04-25T22:44:39.132582+0000","last_unstale":"2024-04-25T22:45:16.937256+0000","last_undegraded":"2024-04-25T22:45:16.937256+0000","last_fullsized":"2024-04-25T22:45:16.937256+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'504","last_scrub_stamp":"2024-04-25T22:45:16.937061+0000","last_deep_scrub":"72'504","last_deep_scrub_stamp":"2024-04-25T22:45:16.937061+0000","last_clean_scrub_stamp":"2024-04-25T22:45:16.937061+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:02.108326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":46975,"num_write":471,"num_write_kb":146290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"71'64","reported_seq":229,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:08.972151+0000","last_change":"2024-04-25T22:45:08.972215+0000","last_active":"2024-04-25T22:45:08.972151+0000","last_peered":"2024-04-25T22:45:08.972151+0000","last_clean":"2024-04-25T22:45:08.972151+0000","last_became_active":"2024-04-25T22:44:39.136090+0000","last_became_peered":"2024-04-25T22:44:39.136090+0000","last_unstale":"2024-04-25T22:45:08.972151+0000","last_undegraded":"2024-04-25T22:45:08.972151+0000","last_fullsized":"2024-04-25T22:45:08.972151+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'64","last_scrub_stamp":"2024-04-25T22:45:08.971948+0000","last_deep_scrub":"71'64","last_deep_scrub_stamp":"2024-04-25T22:45:08.971948+0000","last_clean_scrub_stamp":"2024-04-25T22:45:08.971948+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:17:00.632713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"72'475","reported_seq":1163,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:36.166824+0000","last_change":"2024-04-25T22:45:36.166881+0000","last_active":"2024-04-25T22:45:36.166824+0000","last_peered":"2024-04-25T22:45:36.166824+0000","last_clean":"2024-04-25T22:45:36.166824+0000","last_became_active":"2024-04-25T22:44:44.102061+0000","last_became_peered":"2024-04-25T22:44:44.102061+0000","last_unstale":"2024-04-25T22:45:36.166824+0000","last_undegraded":"2024-04-25T22:45:36.166824+0000","last_fullsized":"2024-04-25T22:45:36.166824+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'475","last_scrub_stamp":"2024-04-25T22:45:36.166631+0000","last_deep_scrub":"72'475","last_deep_scrub_stamp":"2024-04-25T22:45:36.166631+0000","last_clean_scrub_stamp":"2024-04-25T22:45:36.166631+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:33:29.656730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":23011,"num_write":448,"num_write_kb":76439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"72'370","reported_seq":576,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:38.526162+0000","last_change":"2024-04-25T22:45:38.526219+0000","last_active":"2024-04-25T22:45:38.526162+0000","last_peered":"2024-04-25T22:45:38.526162+0000","last_clean":"2024-04-25T22:45:38.526162+0000","last_became_active":"2024-04-25T22:44:56.414231+0000","last_became_peered":"2024-04-25T22:44:56.414231+0000","last_unstale":"2024-04-25T22:45:38.526162+0000","last_undegraded":"2024-04-25T22:45:38.526162+0000","last_fullsized":"2024-04-25T22:45:38.526162+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'370","last_scrub_stamp":"2024-04-25T22:45:38.525948+0000","last_deep_scrub":"72'370","last_deep_scrub_stamp":"2024-04-25T22:45:38.525948+0000","last_clean_scrub_stamp":"2024-04-25T22:45:38.525948+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:17:29.688711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":33211,"num_write":340,"num_write_kb":63312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"113'649","reported_seq":877,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:32.161416+0000","last_change":"2024-04-25T22:45:32.161584+0000","last_active":"2024-04-25T22:45:32.161416+0000","last_peered":"2024-04-25T22:45:32.161416+0000","last_clean":"2024-04-25T22:45:32.161416+0000","last_became_active":"2024-04-25T22:44:30.396073+0000","last_became_peered":"2024-04-25T22:44:30.396073+0000","last_unstale":"2024-04-25T22:45:32.161416+0000","last_undegraded":"2024-04-25T22:45:32.161416+0000","last_fullsized":"2024-04-25T22:45:32.161416+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'649","last_scrub_stamp":"2024-04-25T22:45:32.161195+0000","last_deep_scrub":"113'649","last_deep_scrub_stamp":"2024-04-25T22:45:32.161195+0000","last_clean_scrub_stamp":"2024-04-25T22:45:32.161195+0000","objects_scrubbed":2,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:44.121465+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"72'415","reported_seq":645,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:23.071501+0000","last_change":"2024-04-25T22:45:23.071561+0000","last_active":"2024-04-25T22:45:23.071501+0000","last_peered":"2024-04-25T22:45:23.071501+0000","last_clean":"2024-04-25T22:45:23.071501+0000","last_became_active":"2024-04-25T22:44:39.146949+0000","last_became_peered":"2024-04-25T22:44:39.146949+0000","last_unstale":"2024-04-25T22:45:23.071501+0000","last_undegraded":"2024-04-25T22:45:23.071501+0000","last_fullsized":"2024-04-25T22:45:23.071501+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'415","last_scrub_stamp":"2024-04-25T22:45:23.071270+0000","last_deep_scrub":"72'415","last_deep_scrub_stamp":"2024-04-25T22:45:23.071270+0000","last_clean_scrub_stamp":"2024-04-25T22:45:23.071270+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:24.129760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":19493,"num_write":386,"num_write_kb":64692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"113'208","reported_seq":373,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:12.940687+0000","last_change":"2024-04-25T22:45:12.940827+0000","last_active":"2024-04-25T22:45:12.940687+0000","last_peered":"2024-04-25T22:45:12.940687+0000","last_clean":"2024-04-25T22:45:12.940687+0000","last_became_active":"2024-04-25T22:44:39.138371+0000","last_became_peered":"2024-04-25T22:44:39.138371+0000","last_unstale":"2024-04-25T22:45:12.940687+0000","last_undegraded":"2024-04-25T22:45:12.940687+0000","last_fullsized":"2024-04-25T22:45:12.940687+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'208","last_scrub_stamp":"2024-04-25T22:45:12.940458+0000","last_deep_scrub":"113'208","last_deep_scrub_stamp":"2024-04-25T22:45:12.940458+0000","last_clean_scrub_stamp":"2024-04-25T22:45:12.940458+0000","objects_scrubbed":1,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:06:25.970714+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"72'395","reported_seq":571,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:36.513749+0000","last_change":"2024-04-25T22:45:36.513804+0000","last_active":"2024-04-25T22:45:36.513749+0000","last_peered":"2024-04-25T22:45:36.513749+0000","last_clean":"2024-04-25T22:45:36.513749+0000","last_became_active":"2024-04-25T22:44:55.396613+0000","last_became_peered":"2024-04-25T22:44:55.396613+0000","last_unstale":"2024-04-25T22:45:36.513749+0000","last_undegraded":"2024-04-25T22:45:36.513749+0000","last_fullsized":"2024-04-25T22:45:36.513749+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'395","last_scrub_stamp":"2024-04-25T22:45:36.513549+0000","last_deep_scrub":"72'395","last_deep_scrub_stamp":"2024-04-25T22:45:36.513549+0000","last_clean_scrub_stamp":"2024-04-25T22:45:36.513549+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:54:57.467295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9576,"num_write":348,"num_write_kb":38472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"113'197","reported_seq":375,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:33.562767+0000","last_change":"2024-04-25T22:45:33.562837+0000","last_active":"2024-04-25T22:45:33.562767+0000","last_peered":"2024-04-25T22:45:33.562767+0000","last_clean":"2024-04-25T22:45:33.562767+0000","last_became_active":"2024-04-25T22:44:41.420491+0000","last_became_peered":"2024-04-25T22:44:41.420491+0000","last_unstale":"2024-04-25T22:45:33.562767+0000","last_undegraded":"2024-04-25T22:45:33.562767+0000","last_fullsized":"2024-04-25T22:45:33.562767+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'197","last_scrub_stamp":"2024-04-25T22:45:33.562571+0000","last_deep_scrub":"113'197","last_deep_scrub_stamp":"2024-04-25T22:45:33.562571+0000","last_clean_scrub_stamp":"2024-04-25T22:45:33.562571+0000","objects_scrubbed":3,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:18:56.175724+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12360511,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":12143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12360511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"72'398","reported_seq":602,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:35.476864+0000","last_change":"2024-04-25T22:45:35.477030+0000","last_active":"2024-04-25T22:45:35.476864+0000","last_peered":"2024-04-25T22:45:35.476864+0000","last_clean":"2024-04-25T22:45:35.476864+0000","last_became_active":"2024-04-25T22:44:52.375632+0000","last_became_peered":"2024-04-25T22:44:52.375632+0000","last_unstale":"2024-04-25T22:45:35.476864+0000","last_undegraded":"2024-04-25T22:45:35.476864+0000","last_fullsized":"2024-04-25T22:45:35.476864+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'398","last_scrub_stamp":"2024-04-25T22:45:35.476625+0000","last_deep_scrub":"72'398","last_deep_scrub_stamp":"2024-04-25T22:45:35.476625+0000","last_clean_scrub_stamp":"2024-04-25T22:45:35.476625+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:59:11.398927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":31284,"num_write":371,"num_write_kb":80144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"113'52","reported_seq":104,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:27.410878+0000","last_change":"2024-04-25T22:45:27.410952+0000","last_active":"2024-04-25T22:45:27.410878+0000","last_peered":"2024-04-25T22:45:27.410878+0000","last_clean":"2024-04-25T22:45:27.410878+0000","last_became_active":"2024-04-25T22:44:41.414774+0000","last_became_peered":"2024-04-25T22:44:41.414774+0000","last_unstale":"2024-04-25T22:45:27.410878+0000","last_undegraded":"2024-04-25T22:45:27.410878+0000","last_fullsized":"2024-04-25T22:45:27.410878+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'52","last_scrub_stamp":"2024-04-25T22:45:27.410684+0000","last_deep_scrub":"113'52","last_deep_scrub_stamp":"2024-04-25T22:45:27.410684+0000","last_clean_scrub_stamp":"2024-04-25T22:45:27.410684+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:24.117277+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"72'383","reported_seq":645,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:15.745107+0000","last_change":"2024-04-25T22:45:15.745107+0000","last_active":"2024-04-25T22:45:15.745107+0000","last_peered":"2024-04-25T22:45:15.745107+0000","last_clean":"2024-04-25T22:45:15.745107+0000","last_became_active":"2024-04-25T22:40:14.630899+0000","last_became_peered":"2024-04-25T22:40:14.630899+0000","last_unstale":"2024-04-25T22:45:15.745107+0000","last_undegraded":"2024-04-25T22:45:15.745107+0000","last_fullsized":"2024-04-25T22:45:15.745107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'383","last_scrub_stamp":"2024-04-25T22:45:15.744713+0000","last_deep_scrub":"72'383","last_deep_scrub_stamp":"2024-04-25T22:45:15.744713+0000","last_clean_scrub_stamp":"2024-04-25T22:45:15.744713+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:24.822195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":29308,"num_write":358,"num_write_kb":66975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"113'179","reported_seq":391,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:33.709387+0000","last_change":"2024-04-25T22:45:33.709459+0000","last_active":"2024-04-25T22:45:33.709387+0000","last_peered":"2024-04-25T22:45:33.709387+0000","last_clean":"2024-04-25T22:45:33.709387+0000","last_became_active":"2024-04-25T22:40:13.592946+0000","last_became_peered":"2024-04-25T22:40:13.592946+0000","last_unstale":"2024-04-25T22:45:33.709387+0000","last_undegraded":"2024-04-25T22:45:33.709387+0000","last_fullsized":"2024-04-25T22:45:33.709387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'179","last_scrub_stamp":"2024-04-25T22:45:33.709201+0000","last_deep_scrub":"113'179","last_deep_scrub_stamp":"2024-04-25T22:45:33.709201+0000","last_clean_scrub_stamp":"2024-04-25T22:45:33.709201+0000","objects_scrubbed":2,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:28.313224+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"72'387","reported_seq":610,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:22.769968+0000","last_change":"2024-04-25T22:45:22.770027+0000","last_active":"2024-04-25T22:45:22.769968+0000","last_peered":"2024-04-25T22:45:22.769968+0000","last_clean":"2024-04-25T22:45:22.769968+0000","last_became_active":"2024-04-25T22:40:14.621698+0000","last_became_peered":"2024-04-25T22:40:14.621698+0000","last_unstale":"2024-04-25T22:45:22.769968+0000","last_undegraded":"2024-04-25T22:45:22.769968+0000","last_fullsized":"2024-04-25T22:45:22.769968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'387","last_scrub_stamp":"2024-04-25T22:45:22.769766+0000","last_deep_scrub":"72'387","last_deep_scrub_stamp":"2024-04-25T22:45:22.769766+0000","last_clean_scrub_stamp":"2024-04-25T22:45:22.769766+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:04:21.591299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3883,"num_write":348,"num_write_kb":34122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"113'213","reported_seq":426,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:32.563798+0000","last_change":"2024-04-25T22:45:32.563872+0000","last_active":"2024-04-25T22:45:32.563798+0000","last_peered":"2024-04-25T22:45:32.563798+0000","last_clean":"2024-04-25T22:45:32.563798+0000","last_became_active":"2024-04-25T22:44:41.418106+0000","last_became_peered":"2024-04-25T22:44:41.418106+0000","last_unstale":"2024-04-25T22:45:32.563798+0000","last_undegraded":"2024-04-25T22:45:32.563798+0000","last_fullsized":"2024-04-25T22:45:32.563798+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'213","last_scrub_stamp":"2024-04-25T22:45:32.563610+0000","last_deep_scrub":"113'213","last_deep_scrub_stamp":"2024-04-25T22:45:32.563610+0000","last_clean_scrub_stamp":"2024-04-25T22:45:32.563610+0000","objects_scrubbed":4,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:46:54.102851+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":12363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"72'419","reported_seq":616,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:14.195273+0000","last_change":"2024-04-25T22:45:14.195329+0000","last_active":"2024-04-25T22:45:14.195273+0000","last_peered":"2024-04-25T22:45:14.195273+0000","last_clean":"2024-04-25T22:45:14.195273+0000","last_became_active":"2024-04-25T22:44:41.420505+0000","last_became_peered":"2024-04-25T22:44:41.420505+0000","last_unstale":"2024-04-25T22:45:14.195273+0000","last_undegraded":"2024-04-25T22:45:14.195273+0000","last_fullsized":"2024-04-25T22:45:14.195273+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'419","last_scrub_stamp":"2024-04-25T22:45:14.195073+0000","last_deep_scrub":"72'419","last_deep_scrub_stamp":"2024-04-25T22:45:14.195073+0000","last_clean_scrub_stamp":"2024-04-25T22:45:14.195073+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:10.119407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":13327,"num_write":388,"num_write_kb":55674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"113'132","reported_seq":359,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:30.163909+0000","last_change":"2024-04-25T22:45:30.164063+0000","last_active":"2024-04-25T22:45:30.163909+0000","last_peered":"2024-04-25T22:45:30.163909+0000","last_clean":"2024-04-25T22:45:30.163909+0000","last_became_active":"2024-04-25T22:44:29.397905+0000","last_became_peered":"2024-04-25T22:44:29.397905+0000","last_unstale":"2024-04-25T22:45:30.163909+0000","last_undegraded":"2024-04-25T22:45:30.163909+0000","last_fullsized":"2024-04-25T22:45:30.163909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'132","last_scrub_stamp":"2024-04-25T22:45:30.163698+0000","last_deep_scrub":"113'132","last_deep_scrub_stamp":"2024-04-25T22:45:30.163698+0000","last_clean_scrub_stamp":"2024-04-25T22:45:30.163698+0000","objects_scrubbed":1,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:29:14.469045+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"72'449","reported_seq":693,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:21.789313+0000","last_change":"2024-04-25T22:45:21.789369+0000","last_active":"2024-04-25T22:45:21.789313+0000","last_peered":"2024-04-25T22:45:21.789313+0000","last_clean":"2024-04-25T22:45:21.789313+0000","last_became_active":"2024-04-25T22:40:14.627888+0000","last_became_peered":"2024-04-25T22:40:14.627888+0000","last_unstale":"2024-04-25T22:45:21.789313+0000","last_undegraded":"2024-04-25T22:45:21.789313+0000","last_fullsized":"2024-04-25T22:45:21.789313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'449","last_scrub_stamp":"2024-04-25T22:45:21.789127+0000","last_deep_scrub":"72'449","last_deep_scrub_stamp":"2024-04-25T22:45:21.789127+0000","last_clean_scrub_stamp":"2024-04-25T22:45:21.789127+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:22.847617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14222,"num_write":424,"num_write_kb":79796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"113'60","reported_seq":225,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T22:45:10.988727+0000","last_change":"2024-04-25T22:45:10.988900+0000","last_active":"2024-04-25T22:45:10.988727+0000","last_peered":"2024-04-25T22:45:10.988727+0000","last_clean":"2024-04-25T22:45:10.988727+0000","last_became_active":"2024-04-25T22:44:39.136283+0000","last_became_peered":"2024-04-25T22:44:39.136283+0000","last_unstale":"2024-04-25T22:45:10.988727+0000","last_undegraded":"2024-04-25T22:45:10.988727+0000","last_fullsized":"2024-04-25T22:45:10.988727+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'60","last_scrub_stamp":"2024-04-25T22:45:10.988509+0000","last_deep_scrub":"113'60","last_deep_scrub_stamp":"2024-04-25T22:45:10.988509+0000","last_clean_scrub_stamp":"2024-04-25T22:45:10.988509+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:33.410497+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2461,"num_read_kb":1248646,"num_write":24434,"num_write_kb":4137258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7447,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26539,"ondisk_log_size":26539,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127071275,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":62,"num_read_kb":1469,"num_write":4473,"num_write_kb":127409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83657978,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254210048,"data_stored":254142550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},"log_size":6268,"ondisk_log_size":6268,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738447,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165336,"kb_used_data":80080,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94206504,"statfs":{"total":96636764160,"available":96467460096,"internally_reserved":0,"allocated":82001920,"data_stored":81417710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":79,"seq":339302416406,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141396,"kb_used_data":83340,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94230444,"statfs":{"total":96636764160,"available":96491974656,"internally_reserved":0,"allocated":85340160,"data_stored":84739534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6003,"internal_metadata":59435149},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174344,"kb_used_data":89088,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94197496,"statfs":{"total":96636764160,"available":96458235904,"internally_reserved":0,"allocated":91226112,"data_stored":90619941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89575424,"data_stored":89544940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83689472,"data_stored":83664533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4408,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80945152,"data_stored":80933077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:46:09.518 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T22:46:09.889 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T22:46:09.889 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:46:10.220 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:46:10.221 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:40:13.931282+0000","modified":"2024-04-25T22:40:15.954082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4192},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4192":{"gid":4192,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6803/4101484059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":4101484059},{"type":"v1","addr":"172.21.15.57:6803","nonce":4101484059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4192,"qdb_cluster":[4192]},"id":1}]} 2024-04-25T22:46:10.221 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 5 2024-04-25T22:46:10.240 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:46:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:46:10.571 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:40:13.931282+0000","modified":"2024-04-25T22:40:15.954082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4192},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4192":{"gid":4192,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6803/4101484059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":4101484059},{"type":"v1","addr":"172.21.15.57:6803","nonce":4101484059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4192,"qdb_cluster":[4192]},"id":1}]} 2024-04-25T22:46:10.571 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 5 2024-04-25T22:46:10.588 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:46:10.871 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-25T22:46:10.871 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":113,"fsid":"5ac21fc4-e2e2-4ef6-815f-73ba062b1b1d","created":"2024-04-25T22:39:52.303074+0000","modified":"2024-04-25T22:44:59.081979+0000","last_up_change":"2024-04-25T22:44:25.314578+0000","last_in_change":"2024-04-25T22:39:53.230242+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:40:03.197725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:40:07.560858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:40:12.431697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:40:12.919828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d465b4-5896-4d69-80b1-7e69d31eb455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6801","nonce":765118869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6803","nonce":765118869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6807","nonce":765118869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":765118869},{"type":"v1","addr":"172.21.15.122:6805","nonce":765118869}]},"public_addr":"172.21.15.122:6801/765118869","cluster_addr":"172.21.15.122:6803/765118869","heartbeat_back_addr":"172.21.15.122:6807/765118869","heartbeat_front_addr":"172.21.15.122:6805/765118869","state":["exists","up"]},{"osd":1,"uuid":"8a1e4905-ddb3-4cd1-95b0-d36c3936dfe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":45,"up_from":79,"up_thru":112,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":3379571590},{"type":"v1","addr":"172.21.15.148:6801","nonce":3379571590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":3379571590},{"type":"v1","addr":"172.21.15.148:6803","nonce":3379571590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":3379571590},{"type":"v1","addr":"172.21.15.148:6807","nonce":3379571590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":3379571590},{"type":"v1","addr":"172.21.15.148:6805","nonce":3379571590}]},"public_addr":"172.21.15.148:6801/3379571590","cluster_addr":"172.21.15.148:6803/3379571590","heartbeat_back_addr":"172.21.15.148:6807/3379571590","heartbeat_front_addr":"172.21.15.148:6805/3379571590","state":["exists","up"]},{"osd":2,"uuid":"164fc653-2135-4e9b-8826-1716fdba6ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6801","nonce":368834361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6803","nonce":368834361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6807","nonce":368834361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":368834361},{"type":"v1","addr":"172.21.15.188:6805","nonce":368834361}]},"public_addr":"172.21.15.188:6801/368834361","cluster_addr":"172.21.15.188:6803/368834361","heartbeat_back_addr":"172.21.15.188:6807/368834361","heartbeat_front_addr":"172.21.15.188:6805/368834361","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.559393+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.563434+0000","dead_epoch":45},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:39:58.557643+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.16","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:46:10.889 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T22:46:11.229 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T22:46:11.252 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T22:46:11.291 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2024-04-25T22:46:12.269 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T22:46:13.491 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2024-04-25T22:46:13.517 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T22:46:14.524 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2024-04-25T22:46:14.551 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T22:46:14.551 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T22:46:14.551 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:46:14.561 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T22:46:14.561 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T22:46:14.562 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T22:46:14.562 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:46:14.638 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T22:46:14.639 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T22:46:14.639 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:46:14.723 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T22:46:14.723 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T22:46:14.723 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:46:14.820 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T22:46:14.820 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T22:46:14.820 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T22:46:14.820 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:46:14.858 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T22:46:14.858 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T22:46:14.858 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:46:14.954 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T22:46:14.954 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T22:46:14.955 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T22:46:14.955 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:46:14.969 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T22:46:14.969 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T22:46:14.969 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:46:15.027 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T22:46:15.027 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T22:46:15.028 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:46:15.084 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T22:46:15.084 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T22:46:15.084 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | head -n 1 2024-04-25T22:46:15.142 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi122.front.sepia.ceph.com 2024-04-25T22:46:15.143 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T22:46:15.294 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi148.front.sepia.ceph.com 2024-04-25T22:46:15.294 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T22:46:15.428 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi188.front.sepia.ceph.com 2024-04-25T22:46:15.428 DEBUG:teuthology.orchestra.run.smithi188:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T22:46:15.590 INFO:tasks.ceph:Archiving mon data... 2024-04-25T22:46:15.591 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058/data/mon.a.tgz 2024-04-25T22:46:15.592 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-04-25T22:46:15.597 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.GtJWRPwvWs 2024-04-25T22:46:15.598 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.GtJWRPwvWs 2024-04-25T22:46:15.753 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.GtJWRPwvWs 2024-04-25T22:46:15.817 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.GtJWRPwvWs is 411KB 2024-04-25T22:46:15.879 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.GtJWRPwvWs 2024-04-25T22:46:15.885 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058/data/mon.b.tgz 2024-04-25T22:46:15.885 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-04-25T22:46:15.933 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.622zgA515K 2024-04-25T22:46:15.934 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.622zgA515K 2024-04-25T22:46:16.123 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.622zgA515K 2024-04-25T22:46:16.190 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.622zgA515K is 574KB 2024-04-25T22:46:16.256 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.622zgA515K 2024-04-25T22:46:16.261 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058/data/mon.c.tgz 2024-04-25T22:46:16.261 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-04-25T22:46:16.314 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.lO4HgiJbsJ 2024-04-25T22:46:16.314 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.lO4HgiJbsJ 2024-04-25T22:46:16.503 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.lO4HgiJbsJ 2024-04-25T22:46:16.570 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.lO4HgiJbsJ is 574KB 2024-04-25T22:46:16.632 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.lO4HgiJbsJ 2024-04-25T22:46:16.639 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T22:46:16.639 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T22:46:16.684 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T22:46:16.687 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T22:46:16.690 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T22:46:16.853 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T22:46:16.859 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T22:46:16.870 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T22:46:16.877 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T22:46:16.877 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T22:46:16.878 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058/remote/smithi057/crash 2024-04-25T22:46:16.879 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T22:46:16.911 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058/remote/smithi122/crash 2024-04-25T22:46:16.912 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T22:46:16.926 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058/remote/smithi148/crash 2024-04-25T22:46:16.926 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T22:46:16.958 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058/remote/smithi188/crash 2024-04-25T22:46:16.959 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T22:46:16.973 INFO:tasks.ceph:Compressing logs... 2024-04-25T22:46:16.973 DEBUG:teuthology.orchestra.run.smithi057:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T22:46:16.975 DEBUG:teuthology.orchestra.run.smithi122:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T22:46:16.978 DEBUG:teuthology.orchestra.run.smithi148:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T22:46:16.998 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21159.log 2024-04-25T22:46:17.000 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20980.log 2024-04-25T22:46:17.000 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22619.log 2024-04-25T22:46:17.000 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21159.log.gz 2024-04-25T22:46:17.001 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.20980.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.20980.log.gz 2024-04-25T22:46:17.001 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22346.log 2024-04-25T22:46:17.001 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22619.log.gz 2024-04-25T22:46:17.001 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26201.log 2024-04-25T22:46:17.005 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24372.log 2024-04-25T22:46:17.005 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22346.log: /var/log/ceph/ceph-client.admin.26201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22346.log.gz 2024-04-25T22:46:17.006 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26201.log.gz 2024-04-25T22:46:17.006 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27962.log 2024-04-25T22:46:17.006 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24071.log 2024-04-25T22:46:17.006 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24372.log.gz 2024-04-25T22:46:17.006 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27962.log.gz 2024-04-25T22:46:17.006 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23532.log 2024-04-25T22:46:17.006 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24071.log.gz 2024-04-25T22:46:17.006 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21540.log 2024-04-25T22:46:17.006 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23532.log.gz 2024-04-25T22:46:17.006 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22320.log 2024-04-25T22:46:17.006 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21540.log.gz 2024-04-25T22:46:17.007 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24290.log 2024-04-25T22:46:17.007 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22320.log.gz 2024-04-25T22:46:17.007 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20758.log 2024-04-25T22:46:17.007 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24290.log.gz 2024-04-25T22:46:17.007 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T22:46:17.007 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.20758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20758.log.gz 2024-04-25T22:46:17.007 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27988.log 2024-04-25T22:46:17.007 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23089.log 2024-04-25T22:46:17.015 DEBUG:teuthology.orchestra.run.smithi188:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T22:46:17.036 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.917.log 2024-04-25T22:46:17.036 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T22:46:17.036 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.917.log.gz 2024-04-25T22:46:17.074 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T22:46:17.111 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25534.log 2024-04-25T22:46:17.111 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27988.log.gz 2024-04-25T22:46:17.112 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23089.log.gz 2024-04-25T22:46:17.112 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28017.log 2024-04-25T22:46:17.112 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28509.log 2024-04-25T22:46:17.112 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25534.log.gz 2024-04-25T22:46:17.112 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21909.log 2024-04-25T22:46:17.112 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28017.log.gz 2024-04-25T22:46:17.112 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21211.log 2024-04-25T22:46:17.112 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28509.log.gz 2024-04-25T22:46:17.112 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22398.log 2024-04-25T22:46:17.112 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21909.log.gz 2024-04-25T22:46:17.112 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25586.log 2024-04-25T22:46:17.112 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21211.log.gz 2024-04-25T22:46:17.112 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21035.log 2024-04-25T22:46:17.112 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22398.log.gz 2024-04-25T22:46:17.112 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27208.log 2024-04-25T22:46:17.113 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25586.log.gz 2024-04-25T22:46:17.113 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27936.log 2024-04-25T22:46:17.113 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21035.log.gz 2024-04-25T22:46:17.113 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27371.log 2024-04-25T22:46:17.113 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27208.log.gz 2024-04-25T22:46:17.113 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27676.log 2024-04-25T22:46:17.113 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27936.log.gz 2024-04-25T22:46:17.113 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21911.log 2024-04-25T22:46:17.113 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27371.log.gz 2024-04-25T22:46:17.113 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21833.log 2024-04-25T22:46:17.113 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27676.log.gz 2024-04-25T22:46:17.113 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23251.log 2024-04-25T22:46:17.113 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21911.log.gz 2024-04-25T22:46:17.113 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22060.log 2024-04-25T22:46:17.113 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21833.log.gz 2024-04-25T22:46:17.113 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27527.log 2024-04-25T22:46:17.114 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23251.log.gz 2024-04-25T22:46:17.114 INFO:teuthology.orchestra.run.smithi057.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T22:46:17.114 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27780.log 2024-04-25T22:46:17.114 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22060.log.gz 2024-04-25T22:46:17.114 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27527.log.gz 2024-04-25T22:46:17.114 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25874.log 2024-04-25T22:46:17.114 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22869.log 2024-04-25T22:46:17.114 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27780.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27780.log.gz 2024-04-25T22:46:17.114 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23392.log 2024-04-25T22:46:17.114 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25874.log.gz 2024-04-25T22:46:17.114 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22869.log.gz 2024-04-25T22:46:17.114 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26697.log 2024-04-25T22:46:17.114 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22034.log 2024-04-25T22:46:17.115 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23392.log.gz 2024-04-25T22:46:17.115 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26697.log.gz 2024-04-25T22:46:17.115 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25615.log 2024-04-25T22:46:17.115 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28199.log 2024-04-25T22:46:17.115 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22034.log.gz 2024-04-25T22:46:17.115 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25615.log.gz 2024-04-25T22:46:17.115 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26039.log 2024-04-25T22:46:17.115 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28199.log.gz 2024-04-25T22:46:17.115 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26801.log 2024-04-25T22:46:17.115 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25426.log 2024-04-25T22:46:17.115 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26039.log.gz 2024-04-25T22:46:17.115 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23032.log 2024-04-25T22:46:17.115 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26801.log.gz 2024-04-25T22:46:17.116 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24831.log 2024-04-25T22:46:17.116 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25426.log.gz 2024-04-25T22:46:17.116 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27125.log 2024-04-25T22:46:17.116 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23032.log.gz 2024-04-25T22:46:17.116 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24831.log.gz 2024-04-25T22:46:17.116 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23479.log 2024-04-25T22:46:17.116 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26588.log 2024-04-25T22:46:17.116 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23479.log: /var/log/ceph/ceph-client.admin.27125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27728.log 2024-04-25T22:46:17.116 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23479.log.gz 2024-04-25T22:46:17.116 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27125.log.gz 2024-04-25T22:46:17.116 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23563.log 2024-04-25T22:46:17.116 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26588.log.gz 2024-04-25T22:46:17.117 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26256.log 2024-04-25T22:46:17.117 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27728.log.gz 2024-04-25T22:46:17.117 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21354.log 2024-04-25T22:46:17.117 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23563.log.gz 2024-04-25T22:46:17.117 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24460.log 2024-04-25T22:46:17.117 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26256.log.gz 2024-04-25T22:46:17.117 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.21354.log: /var/log/ceph/ceph-client.admin.23956.log 2024-04-25T22:46:17.117 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21354.log.gz 2024-04-25T22:46:17.117 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24460.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20363.log 2024-04-25T22:46:17.117 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24460.log.gz 2024-04-25T22:46:17.117 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23956.log.gz 2024-04-25T22:46:17.117 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25942.log 2024-04-25T22:46:17.117 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5/var/log/ceph/ceph.tmp-client.admin.20363.log: --verbose -- /var/log/ceph/ceph-client.admin.27702.log 2024-04-25T22:46:17.118 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20363.log.gz 2024-04-25T22:46:17.118 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28095.log 2024-04-25T22:46:17.118 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25942.log.gz 2024-04-25T22:46:17.118 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26825.log 2024-04-25T22:46:17.118 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27702.log.gz 2024-04-25T22:46:17.118 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27884.log 2024-04-25T22:46:17.118 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28095.log.gz 2024-04-25T22:46:17.118 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26115.log 2024-04-25T22:46:17.118 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26825.log.gz 2024-04-25T22:46:17.118 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27884.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.27884.log.gz --verbose 2024-04-25T22:46:17.118 INFO:teuthology.orchestra.run.smithi057.stderr: -- /var/log/ceph/ceph-client.admin.22294.log 2024-04-25T22:46:17.119 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T22:46:17.119 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26115.log.gz 2024-04-25T22:46:17.119 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22294.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.22294.log.gz -- 2024-04-25T22:46:17.119 INFO:teuthology.orchestra.run.smithi057.stderr: /var/log/ceph/ceph-client.admin.26860.log 2024-04-25T22:46:17.119 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21488.log 2024-04-25T22:46:17.119 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25508.log 2024-04-25T22:46:17.119 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26860.log.gz 2024-04-25T22:46:17.119 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22620.log 2024-04-25T22:46:17.119 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21488.log.gz 2024-04-25T22:46:17.119 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26618.log 2024-04-25T22:46:17.119 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25508.log.gz 2024-04-25T22:46:17.119 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23196.log 2024-04-25T22:46:17.119 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22620.log.gz 2024-04-25T22:46:17.119 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25696.log 2024-04-25T22:46:17.119 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26618.log.gz 2024-04-25T22:46:17.120 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24696.log 2024-04-25T22:46:17.120 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23196.log.gz 2024-04-25T22:46:17.120 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26535.log 2024-04-25T22:46:17.120 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25696.log.gz 2024-04-25T22:46:17.120 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26450.log 2024-04-25T22:46:17.120 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24696.log.gz 2024-04-25T22:46:17.120 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23924.log 2024-04-25T22:46:17.120 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26535.log.gz 2024-04-25T22:46:17.120 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24346.log 2024-04-25T22:46:17.120 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26450.log.gz 2024-04-25T22:46:17.120 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21834.log 2024-04-25T22:46:17.120 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23924.log.gz 2024-04-25T22:46:17.120 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26365.log 2024-04-25T22:46:17.120 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24346.log.gz 2024-04-25T22:46:17.120 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28121.log/var/log/ceph/ceph-client.admin.21834.log: 2024-04-25T22:46:17.120 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21834.log.gz 2024-04-25T22:46:17.121 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22242.log 2024-04-25T22:46:17.121 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26365.log.gz 2024-04-25T22:46:17.121 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28121.log.gz 2024-04-25T22:46:17.121 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25809.log 2024-04-25T22:46:17.121 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.22242.log: -- /var/log/ceph/ceph-client.admin.27525.log 2024-04-25T22:46:17.121 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22242.log.gz 2024-04-25T22:46:17.121 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25047.log 2024-04-25T22:46:17.121 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25809.log.gz 2024-04-25T22:46:17.121 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21462.log 2024-04-25T22:46:17.121 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27525.log.gz 2024-04-25T22:46:17.121 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21291.log 2024-04-25T22:46:17.121 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25047.log.gz 2024-04-25T22:46:17.121 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23478.log 2024-04-25T22:46:17.121 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21462.log.gz 2024-04-25T22:46:17.121 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21406.log 2024-04-25T22:46:17.122 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21291.log.gz 2024-04-25T22:46:17.122 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25291.log 2024-04-25T22:46:17.122 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23478.log.gz 2024-04-25T22:46:17.122 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22583.log 2024-04-25T22:46:17.122 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21406.log.gz 2024-04-25T22:46:17.122 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24856.log 2024-04-25T22:46:17.122 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25291.log.gz 2024-04-25T22:46:17.122 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25838.log 2024-04-25T22:46:17.122 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22583.log.gz 2024-04-25T22:46:17.122 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28277.log 2024-04-25T22:46:17.122 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24856.log.gz 2024-04-25T22:46:17.122 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26995.log 2024-04-25T22:46:17.122 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25838.log.gz 2024-04-25T22:46:17.122 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20565.log 2024-04-25T22:46:17.122 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28277.log.gz 2024-04-25T22:46:17.123 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26749.log 2024-04-25T22:46:17.123 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26995.log.gz 2024-04-25T22:46:17.123 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.20565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25670.log 2024-04-25T22:46:17.123 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20565.log.gz 2024-04-25T22:46:17.123 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24970.log 2024-04-25T22:46:17.123 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26749.log.gz 2024-04-25T22:46:17.123 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24578.log 2024-04-25T22:46:17.123 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25670.log.gz 2024-04-25T22:46:17.123 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24970.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24970.log.gz -5 2024-04-25T22:46:17.123 INFO:teuthology.orchestra.run.smithi057.stderr: --verbose -- /var/log/ceph/ceph-client.admin.28147.log 2024-04-25T22:46:17.123 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21755.log 2024-04-25T22:46:17.123 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24578.log.gz 2024-04-25T22:46:17.123 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26424.log 2024-04-25T22:46:17.123 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28147.log.gz 2024-04-25T22:46:17.123 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26230.log 2024-04-25T22:46:17.124 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21755.log.gz 2024-04-25T22:46:17.124 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27832.log 2024-04-25T22:46:17.124 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26424.log.gz 2024-04-25T22:46:17.124 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24802.log 2024-04-25T22:46:17.124 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26230.log.gz 2024-04-25T22:46:17.124 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24486.log 2024-04-25T22:46:17.124 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27832.log.gz 2024-04-25T22:46:17.124 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27806.log/var/log/ceph/ceph-client.admin.24802.log: 2024-04-25T22:46:17.124 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24802.log.gz 2024-04-25T22:46:17.124 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25482.log 2024-04-25T22:46:17.124 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24486.log.gz 2024-04-25T22:46:17.124 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24604.log 2024-04-25T22:46:17.124 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27806.log.gz 2024-04-25T22:46:17.124 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23615.log 2024-04-25T22:46:17.124 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25482.log.gz 2024-04-25T22:46:17.124 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25346.log 2024-04-25T22:46:17.125 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24604.log.gz 2024-04-25T22:46:17.125 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23615.log.gz 2024-04-25T22:46:17.125 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28431.log 2024-04-25T22:46:17.125 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24429.log 2024-04-25T22:46:17.125 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25346.log.gz 2024-04-25T22:46:17.125 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26911.log 2024-04-25T22:46:17.125 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28431.log.gz 2024-04-25T22:46:17.125 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27910.log 2024-04-25T22:46:17.125 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24429.log.gz 2024-04-25T22:46:17.125 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26285.log 2024-04-25T22:46:17.125 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26911.log.gz 2024-04-25T22:46:17.125 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22527.log 2024-04-25T22:46:17.125 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27910.log.gz 2024-04-25T22:46:17.126 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24514.log 2024-04-25T22:46:17.126 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26285.log.gz 2024-04-25T22:46:17.126 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.22527.log: /var/log/ceph/ceph-client.admin.27286.log 2024-04-25T22:46:17.126 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22527.log.gz 2024-04-25T22:46:17.126 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28355.log 2024-04-25T22:46:17.126 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24514.log.gz 2024-04-25T22:46:17.126 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21982.log 2024-04-25T22:46:17.126 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27286.log.gz 2024-04-25T22:46:17.126 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24635.log/var/log/ceph/ceph-client.admin.28355.log: 2024-04-25T22:46:17.126 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28355.log.gz 2024-04-25T22:46:17.126 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23811.log 2024-04-25T22:46:17.126 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21982.log.gz 2024-04-25T22:46:17.126 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24635.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24635.log.gz -5 2024-04-25T22:46:17.126 INFO:teuthology.orchestra.run.smithi057.stderr: --verbose -- /var/log/ceph/ceph-client.admin.21566.log 2024-04-25T22:46:17.127 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.23811.log: -- /var/log/ceph/ceph-client.admin.25261.log 2024-04-25T22:46:17.127 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23811.log.gz 2024-04-25T22:46:17.127 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23417.log 2024-04-25T22:46:17.127 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21566.log.gz 2024-04-25T22:46:17.127 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27096.log 2024-04-25T22:46:17.127 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25261.log.gz 2024-04-25T22:46:17.127 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.23417.log: /var/log/ceph/ceph-client.admin.25725.log 2024-04-25T22:46:17.127 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23417.log.gz 2024-04-25T22:46:17.127 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22671.log 2024-04-25T22:46:17.128 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27096.log.gz 2024-04-25T22:46:17.128 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28561.log 2024-04-25T22:46:17.128 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25725.log.gz 2024-04-25T22:46:17.128 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21436.log 2024-04-25T22:46:17.128 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22671.log.gz 2024-04-25T22:46:17.128 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26670.log 2024-04-25T22:46:17.128 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28561.log.gz 2024-04-25T22:46:17.128 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22984.log 2024-04-25T22:46:17.128 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21436.log.gz 2024-04-25T22:46:17.128 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28225.log/var/log/ceph/ceph-client.admin.26670.log: 2024-04-25T22:46:17.128 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26670.log.gz 2024-04-25T22:46:17.128 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25072.log 2024-04-25T22:46:17.128 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22984.log.gz 2024-04-25T22:46:17.128 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25232.log 2024-04-25T22:46:17.129 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28225.log.gz 2024-04-25T22:46:17.129 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log/var/log/ceph/ceph-client.admin.25072.log: 2024-04-25T22:46:17.129 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25072.log.gz 2024-04-25T22:46:17.129 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23589.log 2024-04-25T22:46:17.129 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25232.log.gz 2024-04-25T22:46:17.129 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22623.log 2024-04-25T22:46:17.129 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23672.log 2024-04-25T22:46:17.129 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23589.log.gz 2024-04-25T22:46:17.129 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22623.log.gz 2024-04-25T22:46:17.129 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T22:46:17.129 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.23672.log: /var/log/ceph/ceph-client.admin.24149.log 2024-04-25T22:46:17.129 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23672.log.gz 2024-04-25T22:46:17.129 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22164.log 2024-04-25T22:46:17.129 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21644.log 2024-04-25T22:46:17.129 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24149.log.gz 2024-04-25T22:46:17.130 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26086.log 2024-04-25T22:46:17.130 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22164.log.gz 2024-04-25T22:46:17.130 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21696.log 2024-04-25T22:46:17.130 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23334.log 2024-04-25T22:46:17.130 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21753.log 2024-04-25T22:46:17.130 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21644.log.gz 2024-04-25T22:46:17.130 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23334.log: gzip 94.7%/var/log/ceph/ceph-client.admin.21696.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.24238.log 2024-04-25T22:46:17.130 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph.log.gz 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23334.log.gz 2024-04-25T22:46:17.130 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26086.log.gz 2024-04-25T22:46:17.130 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-25T22:46:17.130 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21696.log.gz 2024-04-25T22:46:17.130 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21753.log.gz 2024-04-25T22:46:17.130 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23899.log 2024-04-25T22:46:17.130 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23120.log 2024-04-25T22:46:17.131 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24238.log.gz 2024-04-25T22:46:17.131 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23899.log.gz 2024-04-25T22:46:17.131 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28483.log 2024-04-25T22:46:17.131 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22475.log 2024-04-25T22:46:17.131 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23120.log: 0.0%/var/log/ceph/ceph-client.admin.28483.log: -- replaced with /var/log/ceph/ceph-client.admin.23120.log.gz 2024-04-25T22:46:17.131 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28483.log.gz 2024-04-25T22:46:17.131 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23164.log 2024-04-25T22:46:17.131 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24941.log 2024-04-25T22:46:17.131 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22475.log.gz 2024-04-25T22:46:17.131 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23164.log.gz 2024-04-25T22:46:17.131 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25749.log 2024-04-25T22:46:17.131 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24660.log 2024-04-25T22:46:17.131 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24941.log.gz 2024-04-25T22:46:17.131 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25749.log.gz 2024-04-25T22:46:17.131 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22268.log 2024-04-25T22:46:17.132 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28251.log 2024-04-25T22:46:17.132 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24660.log.gz 2024-04-25T22:46:17.132 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22268.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.22268.log.gz 2024-04-25T22:46:17.132 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22190.log 2024-04-25T22:46:17.132 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25401.log 2024-04-25T22:46:17.132 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28251.log.gz 2024-04-25T22:46:17.132 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28632.log 2024-04-25T22:46:17.132 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22190.log.gz 2024-04-25T22:46:17.132 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25401.log.gz 2024-04-25T22:46:17.132 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27650.log 2024-04-25T22:46:17.132 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21832.log 2024-04-25T22:46:17.132 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28632.log.gz 2024-04-25T22:46:17.132 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24974.log 2024-04-25T22:46:17.132 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27650.log.gz 2024-04-25T22:46:17.132 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21670.log 2024-04-25T22:46:17.133 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21832.log.gz 2024-04-25T22:46:17.133 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21722.log 2024-04-25T22:46:17.133 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24974.log.gz 2024-04-25T22:46:17.133 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21670.log.gz 2024-04-25T22:46:17.133 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24097.log 2024-04-25T22:46:17.133 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26511.log 2024-04-25T22:46:17.133 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21722.log.gz 2024-04-25T22:46:17.133 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23619.log 2024-04-25T22:46:17.133 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24097.log.gz 2024-04-25T22:46:17.133 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26511.log.gzgzip 2024-04-25T22:46:17.133 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.24776.log 2024-04-25T22:46:17.133 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27260.log 2024-04-25T22:46:17.133 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23619.log.gz 2024-04-25T22:46:17.133 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24776.log.gz 2024-04-25T22:46:17.134 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28606.log 2024-04-25T22:46:17.134 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24264.log 2024-04-25T22:46:17.134 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27260.log.gz 2024-04-25T22:46:17.134 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28606.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.28606.log.gz 2024-04-25T22:46:17.134 INFO:teuthology.orchestra.run.smithi057.stderr: /var/log/ceph/ceph-client.admin.24547.log 2024-04-25T22:46:17.134 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T22:46:17.134 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24264.log: 0.0%/var/log/ceph/ceph-client.admin.24547.log: -- replaced with /var/log/ceph/ceph-client.admin.24264.log.gz 2024-04-25T22:46:17.134 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24547.log.gz 2024-04-25T22:46:17.134 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24403.log 2024-04-25T22:46:17.134 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26541.log 2024-04-25T22:46:17.134 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.24403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24403.log.gz 2024-04-25T22:46:17.134 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23758.log 2024-04-25T22:46:17.134 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26485.log 2024-04-25T22:46:17.134 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26541.log: /var/log/ceph/ceph-client.admin.23758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26541.log.gzgzip 2024-04-25T22:46:17.134 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.23842.log 2024-04-25T22:46:17.135 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23758.log.gz 2024-04-25T22:46:17.135 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20955.log 2024-04-25T22:46:17.135 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26485.log.gz 2024-04-25T22:46:17.135 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23303.log 2024-04-25T22:46:17.135 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23842.log.gz 2024-04-25T22:46:17.135 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.20955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20955.log.gz 2024-04-25T22:46:17.135 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21081.log 2024-04-25T22:46:17.135 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27020.log 2024-04-25T22:46:17.135 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23303.log: /var/log/ceph/ceph-client.admin.21081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23303.log.gz 2024-04-25T22:46:17.135 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20781.log 2024-04-25T22:46:17.135 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21081.log.gz 2024-04-25T22:46:17.135 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27020.log.gz 2024-04-25T22:46:17.135 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26311.log 2024-04-25T22:46:17.135 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.20781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22086.log 2024-04-25T22:46:17.136 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20781.log.gz 2024-04-25T22:46:17.136 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26311.log.gz 2024-04-25T22:46:17.136 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28043.log 2024-04-25T22:46:17.136 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21514.log 2024-04-25T22:46:17.136 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22086.log.gz 2024-04-25T22:46:17.136 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21133.log 2024-04-25T22:46:17.136 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28043.log.gz 2024-04-25T22:46:17.136 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21514.log.gz 2024-04-25T22:46:17.136 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27528.log 2024-04-25T22:46:17.136 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22501.log 2024-04-25T22:46:17.136 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21133.log: /var/log/ceph/ceph-client.admin.27528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27528.log.gz 2024-04-25T22:46:17.136 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21133.log.gz 2024-04-25T22:46:17.136 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25455.log 2024-04-25T22:46:17.136 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23115.log 2024-04-25T22:46:17.136 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22501.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22501.log.gz 2024-04-25T22:46:17.137 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24886.log 2024-04-25T22:46:17.137 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25455.log.gz 2024-04-25T22:46:17.137 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23115.log.gz 2024-04-25T22:46:17.137 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22900.log 2024-04-25T22:46:17.137 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28535.log 2024-04-25T22:46:17.137 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24886.log: /var/log/ceph/ceph-client.admin.22900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24886.log.gz 2024-04-25T22:46:17.137 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22949.log 2024-04-25T22:46:17.137 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22900.log.gz 2024-04-25T22:46:17.137 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28535.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.28535.log.gz 2024-04-25T22:46:17.137 INFO:teuthology.orchestra.run.smithi057.stderr: -- /var/log/ceph/ceph.audit.log 2024-04-25T22:46:17.137 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24014.log 2024-04-25T22:46:17.137 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22949.log.gz 2024-04-25T22:46:17.137 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27312.log 2024-04-25T22:46:17.138 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27624.log 2024-04-25T22:46:17.138 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24014.log.gz 2024-04-25T22:46:17.138 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21756.log 2024-04-25T22:46:17.138 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27312.log.gz 2024-04-25T22:46:17.138 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27070.log 2024-04-25T22:46:17.138 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27624.log.gz 2024-04-25T22:46:17.138 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21756.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.27754.log -- replaced with /var/log/ceph/ceph-client.admin.21756.log.gz 2024-04-25T22:46:17.138 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-25T22:46:17.138 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27070.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T22:46:17.139 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27070.log.gz 2024-04-25T22:46:17.139 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24747.log 2024-04-25T22:46:17.139 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27754.log.gz 2024-04-25T22:46:17.139 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25104.log 2024-04-25T22:46:17.139 INFO:teuthology.orchestra.run.smithi057.stderr: 95.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T22:46:17.139 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24747.log.gz 2024-04-25T22:46:17.139 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28069.log 2024-04-25T22:46:17.139 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26856.log 2024-04-25T22:46:17.139 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25104.log.gz 2024-04-25T22:46:17.139 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27448.log 2024-04-25T22:46:17.139 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28069.log.gz 2024-04-25T22:46:17.139 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21263.log 2024-04-25T22:46:17.139 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26856.log.gz 2024-04-25T22:46:17.139 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27182.log 2024-04-25T22:46:17.140 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27448.log.gz 2024-04-25T22:46:17.140 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27598.log 2024-04-25T22:46:17.140 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21263.log.gz 2024-04-25T22:46:17.140 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22980.log 2024-04-25T22:46:17.140 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27182.log.gz 2024-04-25T22:46:17.140 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28329.log 2024-04-25T22:46:17.140 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27598.log.gz 2024-04-25T22:46:17.140 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24314.log 2024-04-25T22:46:17.140 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22980.log.gz 2024-04-25T22:46:17.140 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28329.log.gz 2024-04-25T22:46:17.140 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21319.log 2024-04-25T22:46:17.140 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24692.log 2024-04-25T22:46:17.140 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24314.log.gz 2024-04-25T22:46:17.140 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27450.log 2024-04-25T22:46:17.141 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21319.log.gz 2024-04-25T22:46:17.141 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24692.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.24692.log.gz --verbose 2024-04-25T22:46:17.141 INFO:teuthology.orchestra.run.smithi057.stderr: -- /var/log/ceph/ceph-client.admin.26395.log 2024-04-25T22:46:17.141 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21912.log 2024-04-25T22:46:17.141 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27450.log.gz 2024-04-25T22:46:17.141 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23754.log 2024-04-25T22:46:17.141 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26395.log.gz 2024-04-25T22:46:17.141 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28457.log 2024-04-25T22:46:17.141 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21912.log.gz 2024-04-25T22:46:17.141 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27338.log 2024-04-25T22:46:17.141 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23754.log.gz 2024-04-25T22:46:17.141 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22216.log 2024-04-25T22:46:17.141 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28457.log.gz 2024-04-25T22:46:17.141 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27338.log.gz 2024-04-25T22:46:17.141 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25129.log 2024-04-25T22:46:17.142 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21006.log 2024-04-25T22:46:17.142 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22216.log.gz 2024-04-25T22:46:17.142 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25129.log.gz 2024-04-25T22:46:17.142 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27368.log 2024-04-25T22:46:17.142 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21006.log.gz 2024-04-25T22:46:17.142 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27372.log 2024-04-25T22:46:17.142 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23277.log 2024-04-25T22:46:17.142 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27368.log.gz 2024-04-25T22:46:17.142 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23722.log 2024-04-25T22:46:17.142 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27372.log.gz 2024-04-25T22:46:17.142 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26966.log 2024-04-25T22:46:17.142 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23277.log.gz 2024-04-25T22:46:17.142 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25641.log 2024-04-25T22:46:17.142 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23722.log.gz 2024-04-25T22:46:17.143 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27858.log 2024-04-25T22:46:17.143 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26966.log.gz 2024-04-25T22:46:17.143 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25641.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.25641.log.gz 2024-04-25T22:46:17.143 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22424.log 2024-04-25T22:46:17.143 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23361.log 2024-04-25T22:46:17.143 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27858.log.gz 2024-04-25T22:46:17.143 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22112.log 2024-04-25T22:46:17.143 INFO:teuthology.orchestra.run.smithi057.stderr: 48.6% -- replaced with /var/log/ceph/ceph-client.admin.22424.log.gz 2024-04-25T22:46:17.143 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23361.log.gz 2024-04-25T22:46:17.143 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23868.log 2024-04-25T22:46:17.143 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.22831.log 2024-04-25T22:46:17.143 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22112.log.gz 2024-04-25T22:46:17.143 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27156.log 2024-04-25T22:46:17.143 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23868.log.gz 2024-04-25T22:46:17.144 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.0.22831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24890.log 2024-04-25T22:46:17.144 INFO:teuthology.orchestra.run.smithi057.stderr: 34.1% -- replaced with /var/log/ceph/ceph-client.0.22831.log.gz 2024-04-25T22:46:17.144 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23697.log 2024-04-25T22:46:17.144 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27156.log.gz 2024-04-25T22:46:17.144 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26775.log 2024-04-25T22:46:17.144 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24890.log.gz 2024-04-25T22:46:17.144 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23448.log 2024-04-25T22:46:17.144 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23697.log.gz 2024-04-25T22:46:17.144 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26775.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T22:46:17.144 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26775.log.gz 2024-04-25T22:46:17.144 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23448.log.gz 2024-04-25T22:46:17.144 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28173.log 2024-04-25T22:46:17.144 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22138.log 2024-04-25T22:46:17.144 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.28173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23987.log 2024-04-25T22:46:17.145 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28173.log.gz 2024-04-25T22:46:17.145 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22138.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25560.log 2024-04-25T22:46:17.145 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.22138.log.gz 2024-04-25T22:46:17.145 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23987.log: 92.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T22:46:17.145 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22008.log 2024-04-25T22:46:17.145 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23987.log.gz 2024-04-25T22:46:17.145 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21592.log 2024-04-25T22:46:17.145 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25560.log: 0.0%/var/log/ceph/ceph-client.admin.22008.log: -- replaced with /var/log/ceph/ceph-client.admin.25560.log.gz 2024-04-25T22:46:17.145 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.22008.log.gz 2024-04-25T22:46:17.145 INFO:teuthology.orchestra.run.smithi057.stderr: /var/log/ceph/ceph-client.admin.27449.log 2024-04-25T22:46:17.145 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24180.log 2024-04-25T22:46:17.145 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21592.log.gz 2024-04-25T22:46:17.145 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26340.log 2024-04-25T22:46:17.145 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27449.log.gz 2024-04-25T22:46:17.145 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28407.log 2024-04-25T22:46:17.146 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24180.log.gz 2024-04-25T22:46:17.146 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21380.log 2024-04-25T22:46:17.146 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26340.log.gz 2024-04-25T22:46:17.146 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28407.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.24045.log -- replaced with /var/log/ceph/ceph-client.admin.28407.log.gz 2024-04-25T22:46:17.146 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-25T22:46:17.146 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27234.log 2024-04-25T22:46:17.146 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21380.log.gz 2024-04-25T22:46:17.146 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24045.log.gz 2024-04-25T22:46:17.146 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21237.log 2024-04-25T22:46:17.146 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25021.log 2024-04-25T22:46:17.146 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.27234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27234.log.gz 2024-04-25T22:46:17.146 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22372.log 2024-04-25T22:46:17.146 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21237.log.gz 2024-04-25T22:46:17.146 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24123.log 2024-04-25T22:46:17.147 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25021.log.gz 2024-04-25T22:46:17.147 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21618.log 2024-04-25T22:46:17.147 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22372.log.gz 2024-04-25T22:46:17.147 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24123.log.gz 2024-04-25T22:46:17.147 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25317.log 2024-04-25T22:46:17.147 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21107.log 2024-04-25T22:46:17.147 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21618.log.gz 2024-04-25T22:46:17.147 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25972.log 2024-04-25T22:46:17.147 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25317.log.gz 2024-04-25T22:46:17.147 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23036.log 2024-04-25T22:46:17.147 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21107.log.gz 2024-04-25T22:46:17.147 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25372.log 2024-04-25T22:46:17.147 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25972.log.gz 2024-04-25T22:46:17.147 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.23036.log: /var/log/ceph/ceph-client.admin.26144.log 2024-04-25T22:46:17.148 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23036.log.gz 2024-04-25T22:46:17.148 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.25372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26614.log 2024-04-25T22:46:17.148 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25372.log.gz 2024-04-25T22:46:17.148 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26144.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26144.log.gz 2024-04-25T22:46:17.148 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22553.log 2024-04-25T22:46:17.148 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20900.log 2024-04-25T22:46:17.148 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26614.log.gz 2024-04-25T22:46:17.148 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.22553.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.28303.log -- replaced with /var/log/ceph/ceph-client.admin.22553.log.gz 2024-04-25T22:46:17.148 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-25T22:46:17.149 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26169.log 2024-04-25T22:46:17.149 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.20900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20900.log.gz 2024-04-25T22:46:17.149 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24205.log 2024-04-25T22:46:17.149 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28303.log.gz 2024-04-25T22:46:17.149 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28381.log 2024-04-25T22:46:17.149 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26169.log.gz 2024-04-25T22:46:17.149 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23224.log 2024-04-25T22:46:17.149 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.24205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24205.log.gz 2024-04-25T22:46:17.149 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26940.log 2024-04-25T22:46:17.149 INFO:teuthology.orchestra.run.smithi057.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28381.log.gz 2024-04-25T22:46:17.149 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.23224.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.21185.log -- replaced with /var/log/ceph/ceph-client.admin.23224.log.gz 2024-04-25T22:46:17.149 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-25T22:46:17.149 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26723.log 2024-04-25T22:46:17.149 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26940.log.gz 2024-04-25T22:46:17.150 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.21185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21185.log.gz 2024-04-25T22:46:17.150 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.26723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26723.log.gz 2024-04-25T22:46:17.150 INFO:teuthology.orchestra.run.smithi057.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T22:46:17.151 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T22:46:17.152 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21698.log 2024-04-25T22:46:17.152 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21650.log 2024-04-25T22:46:17.152 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21674.log 2024-04-25T22:46:17.152 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21698.log: /var/log/ceph/ceph-client.admin.21650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21698.log.gz 2024-04-25T22:46:17.152 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21650.log.gz 2024-04-25T22:46:17.152 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.21674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21674.log.gz 2024-04-25T22:46:17.220 INFO:teuthology.orchestra.run.smithi057.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T22:46:17.266 INFO:teuthology.orchestra.run.smithi057.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T22:46:17.333 INFO:teuthology.orchestra.run.smithi057.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T22:46:17.335 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-25T22:46:17.335 INFO:teuthology.orchestra.run.smithi057.stderr:real 0m0.357s 2024-04-25T22:46:17.335 INFO:teuthology.orchestra.run.smithi057.stderr:user 0m0.915s 2024-04-25T22:46:17.335 INFO:teuthology.orchestra.run.smithi057.stderr:sys 0m0.112s 2024-04-25T22:46:18.014 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.1.log: 94.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T22:46:18.016 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-04-25T22:46:18.016 INFO:teuthology.orchestra.run.smithi148.stderr:real 0m1.004s 2024-04-25T22:46:18.016 INFO:teuthology.orchestra.run.smithi148.stderr:user 0m0.958s 2024-04-25T22:46:18.016 INFO:teuthology.orchestra.run.smithi148.stderr:sys 0m0.040s 2024-04-25T22:46:22.189 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-osd.0.log: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T22:46:22.190 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-04-25T22:46:22.190 INFO:teuthology.orchestra.run.smithi122.stderr:real 0m5.210s 2024-04-25T22:46:22.190 INFO:teuthology.orchestra.run.smithi122.stderr:user 0m4.942s 2024-04-25T22:46:22.190 INFO:teuthology.orchestra.run.smithi122.stderr:sys 0m0.198s 2024-04-25T22:46:22.402 INFO:teuthology.orchestra.run.smithi188.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T22:46:22.403 INFO:teuthology.orchestra.run.smithi188.stderr: 2024-04-25T22:46:22.403 INFO:teuthology.orchestra.run.smithi188.stderr:real 0m5.378s 2024-04-25T22:46:22.403 INFO:teuthology.orchestra.run.smithi188.stderr:user 0m5.113s 2024-04-25T22:46:22.404 INFO:teuthology.orchestra.run.smithi188.stderr:sys 0m0.195s 2024-04-25T22:46:22.404 INFO:tasks.ceph:Archiving logs... 2024-04-25T22:46:22.405 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058/remote/smithi057/log 2024-04-25T22:46:22.406 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T22:46:22.771 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058/remote/smithi122/log 2024-04-25T22:46:22.773 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T22:46:23.431 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058/remote/smithi148/log 2024-04-25T22:46:23.432 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T22:46:23.574 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058/remote/smithi188/log 2024-04-25T22:46:23.575 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T22:46:24.282 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T22:46:24.292 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T22:46:24.292 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T22:46:24.295 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T22:46:24.298 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T22:46:24.300 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T22:46:24.411 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T22:46:24.420 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T22:46:24.421 DEBUG:teuthology.orchestra.run.smithi057:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:46:24.423 DEBUG:teuthology.orchestra.run.smithi122:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:46:24.426 DEBUG:teuthology.orchestra.run.smithi148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:46:24.428 DEBUG:teuthology.orchestra.run.smithi188:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:46:24.434 INFO:teuthology.orchestra.run.smithi057.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T22:46:24.434 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================== 2024-04-25T22:46:24.434 INFO:teuthology.orchestra.run.smithi057.stdout:+hv01.front.sepi 67.205.162.81 3 u 34 64 377 0.093 -1.359 0.899 2024-04-25T22:46:24.434 INFO:teuthology.orchestra.run.smithi057.stdout:*hv02.front.sepi 63.231.80.2 3 u 30 64 377 0.072 +0.301 0.841 2024-04-25T22:46:24.434 INFO:teuthology.orchestra.run.smithi057.stdout:+hv03.front.sepi 74.6.168.72 3 u 25 64 377 0.078 +0.170 1.032 2024-04-25T22:46:24.435 INFO:teuthology.orchestra.run.smithi057.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:46:24.436 INFO:teuthology.orchestra.run.smithi122.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T22:46:24.436 INFO:teuthology.orchestra.run.smithi122.stdout:============================================================================== 2024-04-25T22:46:24.436 INFO:teuthology.orchestra.run.smithi122.stdout:+hv01.front.sepi 67.205.162.81 3 u 25 64 377 0.057 -2.165 0.903 2024-04-25T22:46:24.437 INFO:teuthology.orchestra.run.smithi122.stdout:+hv02.front.sepi 63.231.80.2 3 u 29 64 377 0.073 -1.183 0.883 2024-04-25T22:46:24.437 INFO:teuthology.orchestra.run.smithi122.stdout:*hv03.front.sepi 74.6.168.72 3 u 29 64 377 0.102 -2.714 1.523 2024-04-25T22:46:24.437 INFO:teuthology.orchestra.run.smithi122.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:46:24.439 INFO:teuthology.orchestra.run.smithi188.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T22:46:24.439 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================== 2024-04-25T22:46:24.439 INFO:teuthology.orchestra.run.smithi188.stdout:+hv01.front.sepi 67.205.162.81 3 u 25 64 377 0.063 -2.499 0.674 2024-04-25T22:46:24.439 INFO:teuthology.orchestra.run.smithi188.stdout:+hv02.front.sepi 63.231.80.2 3 u 30 64 377 0.093 -1.053 1.162 2024-04-25T22:46:24.439 INFO:teuthology.orchestra.run.smithi188.stdout:*hv03.front.sepi 74.6.168.72 3 u 29 64 377 0.076 -1.256 0.707 2024-04-25T22:46:24.439 INFO:teuthology.orchestra.run.smithi188.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:46:24.530 INFO:teuthology.orchestra.run.smithi148.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T22:46:24.531 INFO:teuthology.orchestra.run.smithi148.stdout:============================================================================== 2024-04-25T22:46:24.531 INFO:teuthology.orchestra.run.smithi148.stdout: hv01.front.sepi 67.205.162.81 3 u 64 64 3 0.115 -287.99 0.984 2024-04-25T22:46:24.531 INFO:teuthology.orchestra.run.smithi148.stdout: hv02.front.sepi 63.231.80.2 3 u 1 64 7 0.138 -286.85 1.500 2024-04-25T22:46:24.531 INFO:teuthology.orchestra.run.smithi148.stdout: hv03.front.sepi 74.6.168.72 3 u 3 64 7 0.138 -287.55 1.486 2024-04-25T22:46:24.531 INFO:teuthology.orchestra.run.smithi148.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T22:46:24.532 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T22:46:24.542 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T22:46:24.543 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T22:46:24.552 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T22:46:24.561 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T22:46:24.570 INFO:teuthology.task.internal:Duration was 1039.106639 seconds 2024-04-25T22:46:24.570 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T22:46:24.580 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T22:46:24.580 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T22:46:24.583 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T22:46:24.585 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T22:46:24.587 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T22:46:24.632 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T22:46:24.632 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi057.front.sepia.ceph.com 2024-04-25T22:46:24.632 DEBUG:teuthology.orchestra.run.smithi057:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T22:46:24.679 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi122.front.sepia.ceph.com 2024-04-25T22:46:24.679 DEBUG:teuthology.orchestra.run.smithi122:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T22:46:24.689 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi148.front.sepia.ceph.com 2024-04-25T22:46:24.689 DEBUG:teuthology.orchestra.run.smithi148:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T22:46:24.699 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi188.front.sepia.ceph.com 2024-04-25T22:46:24.699 DEBUG:teuthology.orchestra.run.smithi188:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T22:46:24.709 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T22:46:24.710 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T22:46:24.722 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T22:46:24.737 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T22:46:24.743 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T22:46:24.810 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T22:46:24.810 DEBUG:teuthology.orchestra.run.smithi057:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T22:46:24.813 DEBUG:teuthology.orchestra.run.smithi122:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T22:46:24.815 DEBUG:teuthology.orchestra.run.smithi148:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T22:46:24.819 DEBUG:teuthology.orchestra.run.smithi188:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T22:46:24.881 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T22:46:24.893 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T22:46:24.893 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T22:46:24.904 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T22:46:24.915 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T22:46:24.927 DEBUG:teuthology.orchestra.run.smithi188:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T22:46:24.940 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T22:46:24.951 DEBUG:teuthology.orchestra.run.smithi057:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:46:24.954 DEBUG:teuthology.orchestra.run.smithi122:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:46:24.958 DEBUG:teuthology.orchestra.run.smithi148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:46:24.961 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = core 2024-04-25T22:46:24.967 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = core 2024-04-25T22:46:24.971 DEBUG:teuthology.orchestra.run.smithi188:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:46:24.992 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = core 2024-04-25T22:46:24.997 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = core 2024-04-25T22:46:25.081 DEBUG:teuthology.orchestra.run.smithi057:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:46:25.086 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:46:25.087 DEBUG:teuthology.orchestra.run.smithi122:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:46:25.120 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:46:25.121 DEBUG:teuthology.orchestra.run.smithi148:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:46:25.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:46:25.127 DEBUG:teuthology.orchestra.run.smithi188:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:46:25.131 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:46:25.132 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T22:46:25.143 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T22:46:25.144 DEBUG:teuthology.misc:Transferring archived files from smithi057:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058/remote/smithi057 2024-04-25T22:46:25.144 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T22:46:25.167 DEBUG:teuthology.misc:Transferring archived files from smithi122:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058/remote/smithi122 2024-04-25T22:46:25.167 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T22:46:25.189 DEBUG:teuthology.misc:Transferring archived files from smithi148:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058/remote/smithi148 2024-04-25T22:46:25.189 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T22:46:25.209 DEBUG:teuthology.misc:Transferring archived files from smithi188:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674058/remote/smithi188 2024-04-25T22:46:25.209 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T22:46:25.230 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T22:46:25.230 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T22:46:25.232 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T22:46:25.234 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T22:46:25.251 DEBUG:teuthology.orchestra.run.smithi188:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T22:46:25.277 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T22:46:25.290 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T22:46:25.290 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T22:46:25.300 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T22:46:25.300 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T22:46:25.303 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T22:46:25.305 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T22:46:25.307 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T22:46:25.308 INFO:teuthology.orchestra.run.smithi057.stdout: 658626 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 22:46 /home/ubuntu/cephtest 2024-04-25T22:46:25.309 INFO:teuthology.orchestra.run.smithi122.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 22:46 /home/ubuntu/cephtest 2024-04-25T22:46:25.311 INFO:teuthology.orchestra.run.smithi148.stdout: 658639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 22:46 /home/ubuntu/cephtest 2024-04-25T22:46:25.325 INFO:teuthology.orchestra.run.smithi188.stdout: 658656 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 22:46 /home/ubuntu/cephtest 2024-04-25T22:46:25.327 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T22:46:25.338 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T22:46:25.435 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} duration: 1039.1066386699677 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-25T22:46:25.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T22:46:25.513 INFO:teuthology.run:pass